From owner-freebsd-isp@FreeBSD.ORG Sat Jan 10 21:01:10 2004 Return-Path: Delivered-To: freebsd-isp@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 6E45316A4CE for ; Sat, 10 Jan 2004 21:01:10 -0800 (PST) Received: from exit1.i-55.com (exit1.i-55.com [208.231.96.22]) by mx1.FreeBSD.org (Postfix) with ESMTP id 4CAF143D41 for ; Sat, 10 Jan 2004 21:01:08 -0800 (PST) (envelope-from dap99@i-55.com) Received: from mybox (dsl-209-205-185-56.i-55.com [209.205.185.56]) by exit1.i-55.com (8.11.7/8.11.4) with SMTP id i0B51EH13404 for ; Sat, 10 Jan 2004 23:01:14 -0600 From: dap99@i-55.com Message-ID: <002c01c3d7ff$e6ff28e0$6401a8c0@mybox> To: Date: Sat, 10 Jan 2004 23:00:51 -0600 MIME-Version: 1.0 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: 7bit X-Priority: 3 X-MSMail-Priority: Normal X-Mailer: Microsoft Outlook Express 6.00.2800.1158 X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2800.1165 Subject: Fw: Jails not quite stable.. X-BeenThere: freebsd-isp@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Internet Services Providers List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 11 Jan 2004 05:01:10 -0000 I meant to CC isp@freebsd.org since I am actually doing this for a hosting provider. Because of the fact that jails can make it easy to manage services I have to assume that other people on this list are trying (or have accomplished) what I'm trying to do here. Thoughts? ----- Original Message ----- From: To: Sent: Saturday, January 10, 2004 10:59 PM Subject: Jails not quite stable.. > I am working on a project to move various services running directly under > FreeBSD 4.8-REL to run under jails on the same servers. Setting up the jails > is no problem at all (I can follow manpages), and bringing the jails up > using either '/bin/sh /etc/rc' or '/usr/local/sbin/jailer' works as well. > Basically, I can get a jail up and running with the desired service. > > However, I've found that jails are producing some problems during my > testing. > > 1. On several occassions I have been unable to kill a process in a jail, > even with a 'kill -9' from inside or outside the jail as root. > > europa# ps aux|grep J > root 90423 0.0 0.4 1268 920 p0- DJ 10:44PM 0:00.01 /bin/csh > europa# kill 90423 > europa# ps aux | grep J > root 90423 0.0 0.4 1268 920 p0- DJ 10:44PM 0:00.01 /bin/csh > europa# kill -9 90423 > europa# ps aux | grep J > root 90423 0.0 0.4 1268 920 p0- DJ 10:44PM 0:00.01 /bin/csh > > (If I reboot this machine it will probably hang. See below.) > > 2. On one occasion (and I haven't attempted to replicate this), I tried a > server reboot (with 'reboot') after a jailed process would not die, and the > server promptly went offline to never return. I had to have someone hard > reset the server. Unfortunately, I am not sure what was on the screen as I > wasn't around. I can say though that the server was pingable but not > reachable otherwise. > > 3. If a process is hung, such as /bin/csh, then odd things happen when > accessing the location of the jail: > > # cd /dsk/jails/ > # ll > total 51684 > drwxr-xr-x 13 root wheel 512 Jan 10 22:17 mail1 > -rw------- 1 root wheel 52896075 Jan 10 20:47 skel.tgz > # cd mail1europa > # ll > (ls just hangs at this point) > > I have to kill my ssh session using ~. to get out of this. Note that > /dsk/jails/mail1 is not mounted via NFS. It's on the actual local disk. > > These problems are reproducible across machines running both FreeBSD 4.8-REL > and FreeBSD 4.9-STABLE: > > # uname -v > FreeBSD 4.9-STABLE #0: > > I WANT to use jails to host most of our services, if for no other reason > than the increase manageability, but there just seems to be a stability > issue here. I realize I will get a lot of "It works for me", but again, > these problems are reproducible, so I'm sure someone else has seen it. :) > > Thoughts on this? >