From owner-freebsd-hackers@FreeBSD.ORG Wed Jun 27 00:56:18 2012 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 624CF1065673 for ; Wed, 27 Jun 2012 00:56:18 +0000 (UTC) (envelope-from rsimmons0@gmail.com) Received: from mail-vc0-f182.google.com (mail-vc0-f182.google.com [209.85.220.182]) by mx1.freebsd.org (Postfix) with ESMTP id 146FF8FC15 for ; Wed, 27 Jun 2012 00:56:17 +0000 (UTC) Received: by vcbfy7 with SMTP id fy7so432374vcb.13 for ; Tue, 26 Jun 2012 17:56:17 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type:content-transfer-encoding; bh=mZMBetslR2+U4EL9MAMFO6tZ001B9bsr6kNbo/Dq+7g=; b=jUxsI29Kz/sITUFkAyp1nnUL1Cvs/JJe7yH/817+G0FMV9gaodO1OK9HKvE2eGGm4A jlqKBumWJm+C+hrFTP7WDZ/SapZptQJsUEOgYcr38zjitJsWSzwEYdwVKneJjVNkqfQH ESiXgDqzaJmHw5+qW78DXrlz1bm9arP4ToUNA3t55Oi5r9WTuCBHNXNN9QutyGvqNY+8 bwXt3LDkpRMM98QDXpIwHSS46R1YOp8IKnkdu3Kuolnhu90VzwniSh9+lNb17FBbo1WD YqmUsEZrEeNF9OaX2+HQ796GVxBz4jOGlDw9Di95RrZxiVRXKzTEOWoQ/7ThzTAN6FLr qytw== MIME-Version: 1.0 Received: by 10.52.28.202 with SMTP id d10mr10510091vdh.39.1340758576967; Tue, 26 Jun 2012 17:56:16 -0700 (PDT) Received: by 10.52.16.148 with HTTP; Tue, 26 Jun 2012 17:56:16 -0700 (PDT) In-Reply-To: <4FEA5229.2060308@martenvijn.nl> References: <4FEA5229.2060308@martenvijn.nl> Date: Tue, 26 Jun 2012 20:56:16 -0400 Message-ID: From: Robert Simmons To: freebsd-hackers@freebsd.org Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Subject: Re: Freeze when running freebsd-update X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 27 Jun 2012 00:56:18 -0000 On Tue, Jun 26, 2012 at 8:22 PM, Marten Vijn wrote: > On 06/27/2012 12:32 AM, Robert Simmons wrote: >> >> I've run into a totally reproducible freeze in 9.0. =A0There are a >> number of variables involved, but I'm able to reproduce this freeze >> 100% of the time. >> >> I'm installing very small servers in a Xen HVM virtualization >> environment. =A0Each instance has 128M memory and 4G of disk space. >> There is 384M of swap encrypted using geli_swap_flags=3D"-d -l 256 -s >> 4096". >> >> The rest of the disk space is encrypted with "geli init -b -v -a >> hmac/sha256 -l 256 -s 4096 /dev/ada0p4". >> >> After I've installed a VPS in this way, I run the freebsd-update fetch >> command and it freezes at: >> Applying patches... >> >> I've been trying to diagnose the problem by running top and watching >> what happens during this stage. =A0I noticed the following: >> >> 1) the box runs out of physical memory at this stage (totally >> expected, that's why there is sufficient swap space). >> 2) All the processes except 2 sleep: >> 31 processes: =A01 running, 29 sleeping, 1 waiting >> 3) the box is responsive to hitting enter at the console (it produces >> another login: prompt) >> 4) sshd is asleep, so I can't ssh into the box >> 5) if I try to login to the console, it lets me enter a username then >> locks up totally, it does not present me with a password: prompt. >> 6) it has not run out of swap, nowhere close: >> Mem: 54M Active, 9524K Inact, 41M Wired, 24K Cache, 21M Buf, 32K Free >> Swap: 384M Total, 6452K Used, 378M Free, 1% Inuse >> 7) the moment it runs out of physical memory it begins being unresponsiv= e >> >> Any idea what might be going on here? > > no sorry, but I may have encounted the same issue/behavior in a jail setu= p > on freebsd 9.0 some month ago: > > jails stacked ro-mount and unionfs. In the url below is POC script to bui= ld > 50 jails. I used (old) i386 hardware. More memory and faster cpu seems to > delay this behavior, adding more jails on a bit faster system. > > http://martenvijn.nl/mk_jail.sh I've done some testing using a VirtualBox VM with exactly the same specs as the Xen HVM setup. I installed ports/benchmarks/forkbomb, and I am able to reproduce the exact same freeze with "forkbomb -f".