From owner-freebsd-current@FreeBSD.ORG Thu Mar 12 21:23:28 2009 Return-Path: Delivered-To: freebsd-current@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 36B27106568B for ; Thu, 12 Mar 2009 21:23:28 +0000 (UTC) (envelope-from swell.k@gmail.com) Received: from ti-out-0910.google.com (ti-out-0910.google.com [209.85.142.187]) by mx1.freebsd.org (Postfix) with ESMTP id E33E68FC17 for ; Thu, 12 Mar 2009 21:23:25 +0000 (UTC) (envelope-from swell.k@gmail.com) Received: by ti-out-0910.google.com with SMTP id a1so3440tib.3 for ; Thu, 12 Mar 2009 14:23:24 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:from:to:cc:subject:references :date:in-reply-to:message-id:user-agent:mime-version:content-type; bh=bGDHv4+R/tm8YAW9uQhCOdew8hSTprXM4qhOQhlaS1I=; b=Cpg05u1fNY0ffGPlsuy8kVHKOAqOB9OZGlilfPoFMcvPjjblXVEPnXeBACkdHRj341 XcexP4LhF3Rhec0oSfbpcUG3nQ2Glwy2+fe+nxvwI1s65VQeR+m3VDn/pk2xyxBcHPU2 TYdurI3+I/EuHdzDCZy3ujMg8xZMaMjChdvuE= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=from:to:cc:subject:references:date:in-reply-to:message-id :user-agent:mime-version:content-type; b=icfGMLiInXberuN3Kqx9Dhohw4JlVCPZRyJ6FESX4olMdzOu/tdRG8b6+zzkf7Nhw7 H2B/ZxnTArW4sJlMRfXQsdCLqNr22eBah5Qr9M1O9a2EyFUhjPWcb/B6yJh+k1KcEnJI JXsQ1YjEBvL7x0pEuVilLjIheWLl9CgEr0UD4= Received: by 10.110.10.16 with SMTP id 16mr712062tij.27.1236892634255; Thu, 12 Mar 2009 14:17:14 -0700 (PDT) Received: from localhost (95-24-212-58.broadband.corbina.ru [95.24.212.58]) by mx.google.com with ESMTPS id d7sm1837463tib.22.2009.03.12.14.16.57 (version=TLSv1/SSLv3 cipher=RC4-MD5); Thu, 12 Mar 2009 14:17:01 -0700 (PDT) From: Anonymous To: Tim Kientzle References: <20090312175345.Y80227@rust.salford.ac.uk> <20090312191333.GA97342@hyperion.scode.org> <49B97617.8010709@freebsd.org> Date: Fri, 13 Mar 2009 00:16:24 +0300 In-Reply-To: <49B97617.8010709@freebsd.org> (Tim Kientzle's message of "Thu, 12 Mar 2009 13:52:39 -0700") Message-ID: <86r6124f2v.fsf@gmail.com> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/23.0.91 (berkeley-unix) MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Cc: freebsd-current@freebsd.org, Peter Schuller , Mark Powell Subject: Re: repeatable ZFS panic: share->excl X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 12 Mar 2009 21:23:43 -0000 Tim Kientzle writes: > Peter Schuller wrote: >>> First problem I notice is a panic, which seems to occur every >>> time 'tar' is used. Might be unrelated to tar, but it definately >>> provokes it. Simply the tar command or a pkg_add causes it. >> >> See the "ZFS/extattr lockup"/"bsdtar lockup on current" threads from >> the past handful of days. > > I think this may be a different problem. > The earlier thread involved a ZFS bug that causes > it to lock up if it receives a request to enumerate > extended attributes on a file (via extattr_list_link > system call). Tar recently added support for > backing up extended attributes. I've disabled > that support until this particular ZFS problem can > be fixed. I guess you're wrong, it's same issue. Here is output from unmodified kernel (r189728) under qemu which looks exactly as on that screenshot. Perhaps, the panic is triggered by INVARIANTS. # lsextattr -h user foo shared lock of (lockmgr) zfs @ /usr/src/sys/kern/vfs_lookup.c:477 while exclusively locked from /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_znode.c:152 panic: share->excl cpuid = 0 KDB: enter: panic [thread pid 105 tid 100078 ] Stopped at kdb_enter+0x3d: movq $0,0x662538(%rip) db> bt Tracing pid 105 tid 100078 td 0xffffff00015bea80 kdb_enter() at kdb_enter+0x3d panic() at panic+0x17b witness_checkorder() at witness_checkorder+0x16e __lockmgr_args() at __lockmgr_args+0xd1b vop_stdlock() at vop_stdlock+0x39 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x9b _vn_lock() at _vn_lock+0x57 lookup() at lookup+0xf4 namei() at namei+0x545 zfs_listextattr() at zfs_listextattr+0x18c VOP_LISTEXTATTR_APV() at VOP_LISTEXTATTR_APV+0xb5 extattr_list_vp() at extattr_list_vp+0x22a extattr_list_link() at extattr_list_link+0xc3 syscall() at syscall+0x1e7 Xfast_syscall() at Xfast_syscall+0xab --- syscall (439, FreeBSD ELF64, extattr_list_link), rip = 0x800692e4c, rsp = 0x7fffffffed08, rbp = 0x7fffffffede0 --- db> show all locks Process 105 (lsextattr) thread 0xffffff00015bea80 (100078) exclusive lockmgr zfs (zfs) r = 0 (0xffffff0001581578) locked @ /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_znode.c:152 exclusive lockmgr zfs (zfs) r = 0 (0xffffff0001581a58) locked @ /usr/src/sys/kern/vfs_extattr.c:668 db> show lockedvnods Locked vnodes 0xffffff00015819c0: tag zfs, type VREG usecount 1, writecount 0, refcount 1 mountedhere 0 flags () v_object 0xffffff0001574898 ref 0 pages 0 lock type zfs: EXCL by thread 0xffffff00015bea80 (pid 105) #0 0xffffffff80530568 at __lockmgr_args+0x758 #1 0xffffffff805c0fd9 at vop_stdlock+0x39 #2 0xffffffff808557db at VOP_LOCK1_APV+0x9b #3 0xffffffff805dd6a7 at _vn_lock+0x57 #4 0xffffffff805c2f20 at extattr_list_vp+0xb0 #5 0xffffffff805c3173 at extattr_list_link+0xc3 #6 0xffffffff8080f227 at syscall+0x1e7 #7 0xffffffff807ec39b at Xfast_syscall+0xab 0xffffff00015814e0: tag zfs, type VDIR usecount 1, writecount 0, refcount 1 mountedhere 0 flags () lock type zfs: EXCL by thread 0xffffff00015bea80 (pid 105) #0 0xffffffff80530568 at __lockmgr_args+0x758 #1 0xffffffff805c0fd9 at vop_stdlock+0x39 #2 0xffffffff808557db at VOP_LOCK1_APV+0x9b #3 0xffffffff805dd6a7 at _vn_lock+0x57 #4 0xffffffff8108405e at zfs_znode_cache_constructor+0x4e #5 0xffffffff81085029 at zfs_znode_alloc+0x39 #6 0xffffffff81085915 at zfs_mknode+0x205 #7 0xffffffff810948f5 at zfs_make_xattrdir+0x155 #8 0xffffffff81095bc3 at zfs_get_xattrdir+0xd3 #9 0xffffffff810a4dbf at zfs_lookup+0x11f #10 0xffffffff810a51d8 at zfs_listextattr+0x128 #11 0xffffffff80853255 at VOP_LISTEXTATTR_APV+0xb5 #12 0xffffffff805c309a at extattr_list_vp+0x22a #13 0xffffffff805c3173 at extattr_list_link+0xc3 #14 0xffffffff8080f227 at syscall+0x1e7 #15 0xffffffff807ec39b at Xfast_syscall+0xab > > However, pkg_add uses tar to extract archives, > not create them, so this is not the same > problem. I haven't disabled tar support for > restoring extended attributes, but no > existing packages should have extended attributes > to be restored, so I doubt this is the same issue. > > 1) Do you get the same symptoms on UFS? > > 2) Is this on extraction or just create? > > 3) Can you run tar under "ktrace" and > figure out what system call is provoking > the problem? > > Tim