From owner-freebsd-current@FreeBSD.ORG Thu Jan 17 00:33:15 2008 Return-Path: Delivered-To: freebsd-current@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id BE47A16A4F0 for ; Thu, 17 Jan 2008 00:33:15 +0000 (UTC) (envelope-from swhetzel@gmail.com) Received: from fg-out-1718.google.com (fg-out-1718.google.com [72.14.220.157]) by mx1.freebsd.org (Postfix) with ESMTP id 3F8A213C465 for ; Thu, 17 Jan 2008 00:33:15 +0000 (UTC) (envelope-from swhetzel@gmail.com) Received: by fg-out-1718.google.com with SMTP id 16so521211fgg.35 for ; Wed, 16 Jan 2008 16:33:14 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; bh=a8qVtwJ9rxt5wIugiz806IHXFlYxnN5Wy1oihqyWXOI=; b=reAwORe33ewHOJjjZYi3JlJn6ltJwAnsRoHgkXkH7U/Lpu+Ft8dHD4R4wuWn2wEh24i18yfjArweLVz6XBvf7i8RbKDoOnDuyccSjw+tn+Am/e5xFqflMngd0LQ6OYwBTvWyge3Jo7bKF1KW8RsDerIcdQ/cA2j1j/++GtxhFhI= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; b=b7GcsjoqS/OguAaLM0RMPUurw5arZIaychwcwh228mPYmb80W7WOKrZFhvuf+NDR+agH5ZDlnjY8XShOxZM8URz378t081T4Qh9JAX/+bpOGDKgVA7/Z9LjPDJian9Da3zcLkB5ftE8BDUWG1wUnd7bwPO4O79dpLli2ssuvpAA= Received: by 10.86.97.7 with SMTP id u7mr1277136fgb.65.1200529994116; Wed, 16 Jan 2008 16:33:14 -0800 (PST) Received: by 10.86.3.20 with HTTP; Wed, 16 Jan 2008 16:33:14 -0800 (PST) Message-ID: <790a9fff0801161633k73b79123ka729861abb2ec71c@mail.gmail.com> Date: Wed, 16 Jan 2008 18:33:14 -0600 From: "Scot Hetzel" To: "Kris Kennaway" In-Reply-To: <478DD4A2.6020202@FreeBSD.org> MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline References: <790a9fff0801150552l542a4238ofc12efe5fdb45fc2@mail.gmail.com> <20080115143924.GB57756@deviant.kiev.zoral.com.ua> <790a9fff0801152301l5d50461aw3a253608506368e2@mail.gmail.com> <478DD4A2.6020202@FreeBSD.org> Cc: Kostik Belousov , freebsd-current@freebsd.org Subject: Re: panic: System call lstat returning with 1 locks held X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 17 Jan 2008 00:33:15 -0000 On 1/16/08, Kris Kennaway wrote: > Scot Hetzel wrote: > > On 1/15/08, Kostik Belousov wrote: > >> On Tue, Jan 15, 2008 at 07:52:12AM -0600, Scot Hetzel wrote: > >>> When I boot a Jan 13th or Jan 15th kernel, and then run > >>> /usr/local/etc/cvsup/update.sh to update the local CVS repository, I > >>> get the following panic: > >>> > >>> panic: System call lstat returning with 1 locks held > >>> cpuid = 0 > >>> KDB: enter: panic > >>> [thread ; pid 1240 tid 10031] > >>> stopped at kdb_enter+0x3d: movq $0,0x41b048(%rip) > >>> db> show alllocks > >>> db> show locks > >>> db> bt > >>> tracing pid 1240 tid 10031 td 0xffffff001c1ad360 > >>> kdb_enter() at kdb_enter+0x3d > >>> panic() at panic+0x176 > >>> syscalls() at syscalls+0x66d > >>> Xfast_syscalls() at Xfast_syscalls+0xab > >>> --- syscall (0, FreeBSD ELF64, nosys), rip = 0x8009e87ec, rsp= > >>> 0x72ec50, rbp = 0x72ed28 --- > >>> > >> I think this could be related to the recent vn_lock()/VOP_LOCK() KPI changes. > >> Please, add DEBUG_VFS_LOCKS to the kernel config, and do the > >> show lockedvnods > >> from the ddb prompt when the panic occurs. The witness does not track > >> the lockmgr locks. > >> > > I added DEBUG_VFS_LOCKS to the kernel config file, rebuilt and > > installed the kernel. After rebooting the system, I started the cvsup > > update for my local mirror, when the panic occured I received a > > similar panic to the one above. When I used 'show lockedvnods' the > > only thing that was displayed was 'Locked vnodes' and that was it. > > > > I'm going to try a binary search to see if I can narrow the problem down. > > Do you also have witness enabled? > witness is enabled in the kernel: # Debugging for use in -current options KDB # Enable kernel debugger support. options DDB # Support DDB. options GDB # Support remote GDB. options INVARIANTS # Enable calls of extra sanity checking options INVARIANT_SUPPORT # Extra sanity checks of internal struct ures, required by INVARIANTS options WITNESS # Enable checks to detect deadlocks and cycles options WITNESS_SKIPSPIN # Don't run witness on spinlocks for spe ed options DEBUG_VFS_LOCKS and sysctl debug.witness.watch is set to 1. Scot