From owner-freebsd-questions@FreeBSD.ORG Sat Jan 10 20:59:52 2004 Return-Path: Delivered-To: freebsd-questions@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 08CA616A4CE for ; Sat, 10 Jan 2004 20:59:52 -0800 (PST) Received: from exit1.i-55.com (exit1.i-55.com [208.231.96.22]) by mx1.FreeBSD.org (Postfix) with ESMTP id 6DE9143D41 for ; Sat, 10 Jan 2004 20:59:50 -0800 (PST) (envelope-from dap99@i-55.com) Received: from mybox (dsl-209-205-185-56.i-55.com [209.205.185.56]) by exit1.i-55.com (8.11.7/8.11.4) with SMTP id i0B4xuH13050 for ; Sat, 10 Jan 2004 22:59:56 -0600 From: dap99@i-55.com Message-ID: <002601c3d7ff$b88d34c0$6401a8c0@mybox> To: Date: Sat, 10 Jan 2004 22:59:11 -0600 MIME-Version: 1.0 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: 7bit X-Priority: 3 X-MSMail-Priority: Normal X-Mailer: Microsoft Outlook Express 6.00.2800.1158 X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2800.1165 Subject: Jails not quite stable.. X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 11 Jan 2004 04:59:52 -0000 I am working on a project to move various services running directly under FreeBSD 4.8-REL to run under jails on the same servers. Setting up the jails is no problem at all (I can follow manpages), and bringing the jails up using either '/bin/sh /etc/rc' or '/usr/local/sbin/jailer' works as well. Basically, I can get a jail up and running with the desired service. However, I've found that jails are producing some problems during my testing. 1. On several occassions I have been unable to kill a process in a jail, even with a 'kill -9' from inside or outside the jail as root. europa# ps aux|grep J root 90423 0.0 0.4 1268 920 p0- DJ 10:44PM 0:00.01 /bin/csh europa# kill 90423 europa# ps aux | grep J root 90423 0.0 0.4 1268 920 p0- DJ 10:44PM 0:00.01 /bin/csh europa# kill -9 90423 europa# ps aux | grep J root 90423 0.0 0.4 1268 920 p0- DJ 10:44PM 0:00.01 /bin/csh (If I reboot this machine it will probably hang. See below.) 2. On one occasion (and I haven't attempted to replicate this), I tried a server reboot (with 'reboot') after a jailed process would not die, and the server promptly went offline to never return. I had to have someone hard reset the server. Unfortunately, I am not sure what was on the screen as I wasn't around. I can say though that the server was pingable but not reachable otherwise. 3. If a process is hung, such as /bin/csh, then odd things happen when accessing the location of the jail: # cd /dsk/jails/ # ll total 51684 drwxr-xr-x 13 root wheel 512 Jan 10 22:17 mail1 -rw------- 1 root wheel 52896075 Jan 10 20:47 skel.tgz # cd mail1europa # ll (ls just hangs at this point) I have to kill my ssh session using ~. to get out of this. Note that /dsk/jails/mail1 is not mounted via NFS. It's on the actual local disk. These problems are reproducible across machines running both FreeBSD 4.8-REL and FreeBSD 4.9-STABLE: # uname -v FreeBSD 4.9-STABLE #0: I WANT to use jails to host most of our services, if for no other reason than the increase manageability, but there just seems to be a stability issue here. I realize I will get a lot of "It works for me", but again, these problems are reproducible, so I'm sure someone else has seen it. :) Thoughts on this?