From owner-freebsd-questions@FreeBSD.ORG Sat Jan 10 23:16:38 2004 Return-Path: Delivered-To: freebsd-questions@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id B3AFE16A4CE for ; Sat, 10 Jan 2004 23:16:38 -0800 (PST) Received: from ganymede.hub.org (u46n208.hfx.eastlink.ca [24.222.46.208]) by mx1.FreeBSD.org (Postfix) with ESMTP id 03BF243D2D for ; Sat, 10 Jan 2004 23:16:37 -0800 (PST) (envelope-from scrappy@hub.org) Received: by ganymede.hub.org (Postfix, from userid 1000) id 9E09437B6D; Sun, 11 Jan 2004 03:13:18 -0400 (AST) Received: from localhost (localhost [127.0.0.1]) by ganymede.hub.org (Postfix) with ESMTP id 9B33437A35; Sun, 11 Jan 2004 03:13:18 -0400 (AST) Date: Sun, 11 Jan 2004 03:13:18 -0400 (AST) From: "Marc G. Fournier" To: dap99@i-55.com In-Reply-To: <002601c3d7ff$b88d34c0$6401a8c0@mybox> Message-ID: <20040111030902.G51801@ganymede.hub.org> References: <002601c3d7ff$b88d34c0$6401a8c0@mybox> MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII cc: questions@freebsd.org Subject: Re: Jails not quite stable.. X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 11 Jan 2004 07:16:38 -0000 On Sat, 10 Jan 2004 dap99@i-55.com wrote: > I am working on a project to move various services running directly under > FreeBSD 4.8-REL to run under jails on the same servers. Setting up the jails > is no problem at all (I can follow manpages), and bringing the jails up > using either '/bin/sh /etc/rc' or '/usr/local/sbin/jailer' works as well. > Basically, I can get a jail up and running with the desired service. > > However, I've found that jails are producing some problems during my > testing. > > 1. On several occassions I have been unable to kill a process in a jail, > even with a 'kill -9' from inside or outside the jail as root. > > europa# ps aux|grep J > root 90423 0.0 0.4 1268 920 p0- DJ 10:44PM 0:00.01 /bin/csh > europa# kill 90423 > europa# ps aux | grep J > root 90423 0.0 0.4 1268 920 p0- DJ 10:44PM 0:00.01 /bin/csh > europa# kill -9 90423 > europa# ps aux | grep J > root 90423 0.0 0.4 1268 920 p0- DJ 10:44PM 0:00.01 /bin/csh stupid question, but is there anything in /var/log/messages on the base machine to indicate any problems? how many processes are running on that machine? are the processes above as indicated? ie. are they just shells, or are they actually running something? > 3. If a process is hung, such as /bin/csh, then odd things happen when > accessing the location of the jail: > > # cd /dsk/jails/ > # ll > total 51684 > drwxr-xr-x 13 root wheel 512 Jan 10 22:17 mail1 > -rw------- 1 root wheel 52896075 Jan 10 20:47 skel.tgz > # cd mail1europa > # ll > (ls just hangs at this point) it sounds like what I used to experience with the 'running out of vnodes' issue, but that is with using unionfs for a file system, and that is with 60+ jails running ... plus, the vnode problems that I was experiencing were fixed a while back, such that its been >6months since I've experienced that problem... > # uname -v > FreeBSD 4.9-STABLE #0: # uname -v FreeBSD 4.9-STABLE #4: Tue Jan 6 00:59:37 AST 2004 root@neptune.hub.org:/usr/obj/usr/src/sys/kernel > I WANT to use jails to host most of our services, if for no other reason > than the increase manageability, but there just seems to be a stability > issue here. I realize I will get a lot of "It works for me", but again, > these problems are reproducible, so I'm sure someone else has seen it. :) I run 60+ jails per server, running just about anything you can think of in the way of services ... no, I haven't seen this :( ---- Marc G. Fournier Hub.Org Networking Services (http://www.hub.org) Email: scrappy@hub.org Yahoo!: yscrappy ICQ: 7615664