From owner-freebsd-jail@FreeBSD.ORG Wed Apr 21 20:48:26 2010 Return-Path: Delivered-To: freebsd-jail@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 003CC106564A for ; Wed, 21 Apr 2010 20:48:25 +0000 (UTC) (envelope-from terry@bluelight.org.uk) Received: from mail.bigbass.org.uk (bigbass.org.uk [80.229.144.50]) by mx1.freebsd.org (Postfix) with ESMTP id 97AD18FC13 for ; Wed, 21 Apr 2010 20:48:25 +0000 (UTC) Received: from [192.168.2.138] by mail.bigbass.org.uk with esmtpsa (TLSv1:CAMELLIA256-SHA:256) (Exim 4.71) (envelope-from ) id 1O4gNp-000IAg-Nf for freebsd-jail@freebsd.org; Wed, 21 Apr 2010 20:18:53 +0000 Message-ID: <4BCF5DA6.5090201@bluelight.org.uk> Date: Wed, 21 Apr 2010 21:18:46 +0100 From: Terry User-Agent: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-GB; rv:1.9.1.9) Gecko/20100317 Thunderbird/3.0.4 MIME-Version: 1.0 To: freebsd-jail@freebsd.org References: <130172.56447.qm@web113207.mail.gq1.yahoo.com> In-Reply-To: <130172.56447.qm@web113207.mail.gq1.yahoo.com> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Scanned-By: unscanned primary on mail.bigbass.org.uk (80.229.144.50); Wed, 21 Apr 2010 20:18:53 +0000 X-SA-Exim-Connect-IP: 192.168.2.138 X-SA-Exim-Mail-From: terry@bluelight.org.uk X-SA-Exim-Scanned: No (on mail.bigbass.org.uk); SAEximRunCond expanded to false Subject: Re: dump and jails - system becomes unuseable then self heals X-BeenThere: freebsd-jail@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: "Discussion about FreeBSD jail\(8\)" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 21 Apr 2010 20:48:26 -0000 On 20/04/2010 23:31, Trever wrote: > Hello, > > We have 4 servers that are running FBSD RELEASE 7.2 amd64. The servers are each a jailer for 2 other jails (all basically identical configuration). The jails were built per: > http://www.freebsd.org/doc/en_US.ISO8859-1/books/handbook/jails-application.html > > We run standard dump to back up the systems. This is a procedure we use on a large number of other FreeBSD servers, none of which have the problem I'm about to describe. (It is clear the problem is confined to these 4 systems that have jails). > > When dump runs on jailers (we don't run from within the jails), the system becomes unuseable eventually, then becomes available when the dump is finished (system freezes, unfreezes, etc. until the dump is done). Apache spawns 256 children, etc. We can't ssh. Then we can. We can't login on the console, then we can. Etc. So it goes until the dump has finished. We have noticed that the system always responds to ping (simple ping checks from a load balancer do not detect the outage, whereas other health checks do detect). > > The relevant filesystem situation looks like this: > > df -h > /dev/da0s1e 1.7T 22G 1.6T 1% /data > /data/jread/mroot 1.7T 22G 1.6T 1% /data/jread/webs1j1 > /data/jread/mroot 1.7T 22G 1.6T 1% /data/jread/webs1j2 > /data/jwrite/webs1j1 1.7T 22G 1.6T 1% /data/jread/webs1j1/data > /data/jwrite/webs1j2 1.7T 22G 1.6T 1% /data/jread/webs1j2/data > > mount > /dev/da0s1e on /data (ufs, local, soft-updates) > /data/jread/mroot on /data/jread/webs1j1 (nullfs, local, read-only) > /data/jread/mroot on /data/jread/webs1j2 (nullfs, local, read-only) > /data/jwrite/webs1j1 on /data/jread/webs1j1/data (nullfs, local) > /data/jwrite/webs1j2 on /data/jread/webs1j2/data (nullfs, local) > devfs on /data/jread/webs1j1/dev (devfs, local) > devfs on /data/jread/webs1j2/dev (devfs, local) > > cat /etc/fstab: > /dev/da0s1e /data ufs rw 2 2 > /data/jread/mroot /data/jread/webs1j1 nullfs ro 0 0 > /data/jread/mroot /data/jread/webs1j2 nullfs ro 0 0 > /data/jwrite/webs1j1 /data/jread/webs1j1/data nullfs rw 0 0 > /data/jwrite/webs1j2 /data/jread/webs1j2/data nullfs rw 0 0 > > > > Anyone know what this could be? > > Thanks in advance, > > -T > > > > > > _______________________________________________ > freebsd-jail@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-jail > To unsubscribe, send any mail to "freebsd-jail-unsubscribe@freebsd.org" > I think if your dumping a live system with the -L switch it will lock things up while it takes a snapshot