From owner-freebsd-stable@FreeBSD.ORG Tue Apr 8 07:42:21 2008 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 4A92E106566B; Tue, 8 Apr 2008 07:42:21 +0000 (UTC) (envelope-from johan@headweb.com) Received: from core.stromnet.se (core.stromnet.se [83.218.84.131]) by mx1.freebsd.org (Postfix) with ESMTP id 02CAA8FC27; Tue, 8 Apr 2008 07:42:20 +0000 (UTC) (envelope-from johan@headweb.com) Received: from localhost (core.stromnet.se [83.218.84.131]) by core.stromnet.se (Postfix) with ESMTP id 1D0A2D46414; Tue, 8 Apr 2008 09:42:20 +0200 (CEST) X-Virus-Scanned: amavisd-new at stromnet.se Received: from core.stromnet.se ([83.218.84.131]) by localhost (core.stromnet.se [83.218.84.135]) (amavisd-new, port 10024) with ESMTP id aHQhOZyssf6f; Tue, 8 Apr 2008 09:42:16 +0200 (CEST) Received: from johan-mp.stromnet.se (90-224-172-102-no129.tbcn.telia.com [90.224.172.102]) by core.stromnet.se (Postfix) with ESMTP id 4B0F8D46418; Tue, 8 Apr 2008 09:42:16 +0200 (CEST) Message-Id: From: =?ISO-8859-1?Q?Johan_Str=F6m?= To: d@delphij.net In-Reply-To: <47FB20B5.8050205@delphij.net> Content-Type: text/plain; charset=ISO-8859-1; format=flowed; delsp=yes Content-Transfer-Encoding: quoted-printable Mime-Version: 1.0 (Apple Message framework v919.2) Date: Tue, 8 Apr 2008 09:42:15 +0200 References: <0B67CBBD-11CB-44C2-807D-5F00654CDD35@headweb.com> <47FB20B5.8050205@delphij.net> X-Mailer: Apple Mail (2.919.2) Cc: freebsd-fs@freebsd.org, freebsd-stable@freebsd.org Subject: Re: ZFS deadlock X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 08 Apr 2008 07:42:21 -0000 On Apr 8, 2008, at 9:37 AM, LI Xin wrote: > Johan Str=F6m wrote: >> Hello >> A box of mine running RELENG_7_0 and ZFS over a couple of disks (6 =20= >> disks, 3 mirrors) seems to have gotten stuck. =46rom Ctrl-T: >> load: 0.50 cmd: zsh 40188 =20 >> [zfs:&buf_hash_table.ht_locks[i].ht_lock] 0.02u 0.04s 0% 3404k >> load: 0.43 cmd: zsh 40188 =20 >> [zfs:&buf_hash_table.ht_locks[i].ht_lock] 0.02u 0.04s 0% 3404k >> load: 0.10 cmd: zsh 40188 =20 >> [zfs:&buf_hash_table.ht_locks[i].ht_lock] 0.02u 0.04s 0% 3404k >> load: 0.10 cmd: zsh 40188 =20 >> [zfs:&buf_hash_table.ht_locks[i].ht_lock] 0.02u 0.04s 0% 3404k >> load: 0.11 cmd: zsh 40188 =20 >> [zfs:&buf_hash_table.ht_locks[i].ht_lock] 0.02u 0.04s 0% 3404k >> Worked for a while then that stopped working too (was over ssh). =20 >> When trying a local login i only got >> load: 0.09 cmd: login 1611 [zfs] 0.00u 0.00s 0% 208k >> I found one post like this earlier (by Xin LI), but nobody seemed =20 >> to have replied... >> in my current conf, I think my kmem/kmem_max is at 512Mb (not sure =20= >> though, since I've edited my file yesterday for next reboot), with =20= >> 2G of system RAM.. Normally I'd run kmem(max) 1G (with arcsize of =20 >> 512M. currently it is at default), but since I just got back to 2G =20= >> total mem after some hardware problems I've been runnig at those =20 >> lows (1G total is kindof tight with zfs..) >> Well, just wanted to report... The box is not totally dead yet, ie =20= >> I can still do Ctrl-T on console, but thats it.. I don't really =20 >> know what more I can do so.. I don't have KDB/DDB. >> I'll wait another hour or so before I hard reboot it, unless it =20 >> "unlocks" or if anyone have any suggestions. > > The key is to increase your kmem and prevent it from being =20 > exhausted. I think more recent OpenSolaris's ZFS code has some =20 > improvements but I do not have spare devices at hand to test and =20 > debug :( Yep, never had the problem when I was running with 2G total mem, but =20 then one stick (damn consumer crap) failed and I was left with 1G, and =20= I started to have random problems. Going to tune kmem back up now when =20= I got more mem again, thinking about putting in 4G too.. > > > Maybe pjd@ would get a new import at some point? I have cc'ed him. > > Cheers, > --=20 > Xin LI http://www.delphij.net/ > FreeBSD - The Power to Serve! >