From owner-freebsd-stable@FreeBSD.ORG Tue Apr 25 13:09:46 2006 Return-Path: X-Original-To: stable@freebsd.org Delivered-To: freebsd-stable@FreeBSD.ORG Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 5B50416A400 for ; Tue, 25 Apr 2006 13:09:46 +0000 (UTC) (envelope-from cdillon@wolves.k12.mo.us) Received: from mail.wolves.k12.mo.us (mail.wolves.k12.mo.us [207.160.214.1]) by mx1.FreeBSD.org (Postfix) with ESMTP id D23C343D68 for ; Tue, 25 Apr 2006 13:09:37 +0000 (GMT) (envelope-from cdillon@wolves.k12.mo.us) Received: from localhost (localhost [127.0.0.1]) by mail.wolves.k12.mo.us (Postfix) with ESMTP id 89A4CB846; Tue, 25 Apr 2006 08:09:36 -0500 (CDT) Received: from mail.wolves.k12.mo.us ([127.0.0.1]) by localhost (mail.wolves.k12.mo.us [127.0.0.1]) (amavisd-new, port 10024) with LMTP id 96028-06-44; Tue, 25 Apr 2006 08:09:35 -0500 (CDT) Received: from wolves.k12.mo.us (localhost [127.0.0.1]) by mail.wolves.k12.mo.us (Postfix) with ESMTP id 446B9B847; Tue, 25 Apr 2006 08:09:32 -0500 (CDT) Received: from d8-174.rb.clm.centurytel.net (d8-174.rb.clm.centurytel.net [69.29.71.174]) by www.wolves.k12.mo.us (Horde MIME library) with HTTP; Tue, 25 Apr 2006 08:09:32 -0500 Message-ID: <20060425080932.1rv9hq0rcws4wc84@www.wolves.k12.mo.us> Date: Tue, 25 Apr 2006 08:09:32 -0500 From: Chris Dillon To: Dmitry Morozovsky References: <20060423193208.N1187@woozle.rinet.ru> <20060423201732.GA74905@xor.obsecurity.org> <20060424091803.L20593@woozle.rinet.ru> <20060424215650.P36233@woozle.rinet.ru> <20060424181531.GA13774@xor.obsecurity.org> <20060425001751.S44618@woozle.rinet.ru> <20060424202859.GA18457@xor.obsecurity.org> <20060425004405.G44618@woozle.rinet.ru> <20060424205026.GA18844@xor.obsecurity.org> <20060425134418.J57625@woozle.rinet.ru> In-Reply-To: <20060425134418.J57625@woozle.rinet.ru> MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1; DelSp="Yes"; format="flowed" Content-Disposition: inline Content-Transfer-Encoding: quoted-printable User-Agent: Internet Messaging Program (IMP) H3 (4.1) / FreeBSD-6.1 X-Virus-Scanned: amavisd-new at wolves.k12.mo.us Cc: stable@freebsd.org, Kris Kennaway Subject: Re: fsck_ufs locked in snaplk X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 25 Apr 2006 13:09:48 -0000 Quoting Dmitry Morozovsky : > On Mon, 24 Apr 2006, Kris Kennaway wrote: > > KK> Also you should add DEBUG_LOCKS and DEBUG_VFS_LOCKS on the off chance > KK> they catch the problem. > > I got one thought about the source of these hangs/crashes: this =20 > machine is the > only one with actively used quotas. I'll test the more thoroughly =20 > this evening. I had problems with snapshots and hangs in 5.x. For that, a daily =20 reboot would keep the problems at bay. I upgraded to 6.0 and the =20 problems completely disappeared. I kept 6.0-STABLE running for weeks. =20 Somewhere along the line, as 6.1 approached, similar problems =20 re-appeared, but not exactly the same as what I had in 5.x. Now =20 instead of a complete system hang, individual processes will hang =20 while attempting to access a certain filesystem. I'm running =20 6.1-PRERELEASE from April 2 and for some reason since this weekend it =20 has happened more often, but I'm not sure why since I haven't made any =20 system changes since April 2. I also am using quotas heavily with this system, and snapshoting every =20 filesystem once a day. The filesystem which processes will hang on =20 when attempting to access it happens to be the one with quotas enabled. I'm going to update to the latest 6.1 code this evening and enable =20 INVARIANTS, WITNESS, and the two DEBUG_LOCKS options to the kernel to =20 see if it catches anything.