From owner-freebsd-current@FreeBSD.ORG Thu Jan 17 00:24:30 2008 Return-Path: Delivered-To: freebsd-current@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 71A6D16A417 for ; Thu, 17 Jan 2008 00:24:30 +0000 (UTC) (envelope-from swhetzel@gmail.com) Received: from fg-out-1718.google.com (fg-out-1718.google.com [72.14.220.156]) by mx1.freebsd.org (Postfix) with ESMTP id E1A4213C43E for ; Thu, 17 Jan 2008 00:24:29 +0000 (UTC) (envelope-from swhetzel@gmail.com) Received: by fg-out-1718.google.com with SMTP id 16so518452fgg.35 for ; Wed, 16 Jan 2008 16:24:28 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; bh=0+fvKUq+Z1/Cb7Y+VREiw05vdehvSd1ic2YWJ9+mOl8=; b=gGFr+mk4d/V+E2Cy9QiRQAkJwA+Kd+GASerjo2QRwek/xQQpMgWLhvG6jjdSZ5fQaLQeP66b1lF84PWWrbwQP49Kx2FDDvlZM/zFe2YfKEYEcwvh3K9IPJfaAbPMDZHsd1Xx7rxpE9vAqlE5/cOK1aIgZoO6CrO91qzVS/wS6Rg= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; b=OFdx4swfZSzaEuaCeMaTI/0Kx5EacCZtc1SVU7gZ1yHayrCbu7lB/btdjJpwaRIbOO3cpZmfdONI0dvqGtN/YrosYEGpCYfXlXs21Ttq19QmAK/tq88FGp/l4F+EdfwhnmpkGHXUTMEqgND3QzwfITYbXZQw+qFKYBTIDlxYIsI= Received: by 10.86.51.2 with SMTP id y2mr1281078fgy.56.1200529468444; Wed, 16 Jan 2008 16:24:28 -0800 (PST) Received: by 10.86.3.20 with HTTP; Wed, 16 Jan 2008 16:24:28 -0800 (PST) Message-ID: <790a9fff0801161624g459857b8y6217e579337f2f0e@mail.gmail.com> Date: Wed, 16 Jan 2008 18:24:28 -0600 From: "Scot Hetzel" To: "Kostik Belousov" In-Reply-To: <790a9fff0801152301l5d50461aw3a253608506368e2@mail.gmail.com> MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline References: <790a9fff0801150552l542a4238ofc12efe5fdb45fc2@mail.gmail.com> <20080115143924.GB57756@deviant.kiev.zoral.com.ua> <790a9fff0801152301l5d50461aw3a253608506368e2@mail.gmail.com> Cc: freebsd-current@freebsd.org Subject: Re: panic: System call lstat returning with 1 locks held X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 17 Jan 2008 00:24:30 -0000 On 1/16/08, Scot Hetzel wrote: > On 1/15/08, Kostik Belousov wrote: > > On Tue, Jan 15, 2008 at 07:52:12AM -0600, Scot Hetzel wrote: > > > When I boot a Jan 13th or Jan 15th kernel, and then run > > > /usr/local/etc/cvsup/update.sh to update the local CVS repository, I > > > get the following panic: > > > > > > panic: System call lstat returning with 1 locks held > > > cpuid = 0 > > > KDB: enter: panic > > > [thread ; pid 1240 tid 10031] > > > stopped at kdb_enter+0x3d: movq $0,0x41b048(%rip) > > > db> show alllocks > > > db> show locks > > > db> bt > > > tracing pid 1240 tid 10031 td 0xffffff001c1ad360 > > > kdb_enter() at kdb_enter+0x3d > > > panic() at panic+0x176 > > > syscalls() at syscalls+0x66d > > > Xfast_syscalls() at Xfast_syscalls+0xab > > > --- syscall (0, FreeBSD ELF64, nosys), rip = 0x8009e87ec, rsp= > > > 0x72ec50, rbp = 0x72ed28 --- > > > > > I think this could be related to the recent vn_lock()/VOP_LOCK() KPI changes. > > Please, add DEBUG_VFS_LOCKS to the kernel config, and do the > > show lockedvnods > > from the ddb prompt when the panic occurs. The witness does not track > > the lockmgr locks. > > > I added DEBUG_VFS_LOCKS to the kernel config file, rebuilt and > installed the kernel. After rebooting the system, I started the cvsup > update for my local mirror, when the panic occured I received a > similar panic to the one above. When I used 'show lockedvnods' the > only thing that was displayed was 'Locked vnodes' and that was it. > > I'm going to try a binary search to see if I can narrow the problem down. > > Scot > I found the point where the problem occurs. If I update /usr/src/sys to Jan 08 23:45 UTC 2008, then I don't get the lstat panic. But when I update to Jan 08 23:49 UTC 2008, the panic returns. These are the files that change between these times: dev/usb/ehci.c: $FreeBSD: src/sys/dev/usb/ehci.c,v 1.57 2008/01/08 23:48:30 attilio Exp $ dev/usb/if_udav.c: $FreeBSD: src/sys/dev/usb/if_udav.c,v 1.34 2008/01/08 23:48:30 attilio Exp $ fs/hpfs/hpfs_subr.h: $FreeBSD: src/sys/fs/hpfs/hpfs_subr.h,v 1.4 2008/01/08 23:48:31 attilio Exp $ fs/ntfs/ntfs_subr.c: $FreeBSD: src/sys/fs/ntfs/ntfs_subr.c,v 1.43 2008/01/08 23:48:31 attilio Exp $ kern/kern_lock.c: $FreeBSD: src/sys/kern/kern_lock.c,v 1.117 2008/01/08 23:48:31 attilio Exp $ sys/buf.h: $FreeBSD: src/sys/sys/buf.h,v 1.197 2008/01/08 23:48:31 attilio Exp $ sys/lockmgr.h: $FreeBSD: src/sys/sys/lockmgr.h,v 1.56 2008/01/08 23:48:31 attilio Exp $ Scot