From owner-freebsd-current@FreeBSD.ORG Sun Oct 6 13:44:52 2013 Return-Path: Delivered-To: current@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTP id A4A3F271 for ; Sun, 6 Oct 2013 13:44:52 +0000 (UTC) (envelope-from jhs@berklix.com) Received: from land.berklix.org (land.berklix.org [144.76.10.75]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 26F8F2AA4 for ; Sun, 6 Oct 2013 13:44:51 +0000 (UTC) Received: from mart.js.berklix.net (pD9FBE2C9.dip0.t-ipconnect.de [217.251.226.201]) (authenticated bits=128) by land.berklix.org (8.14.5/8.14.5) with ESMTP id r96DihjL082189 for ; Sun, 6 Oct 2013 13:44:43 GMT (envelope-from jhs@berklix.com) Received: from fire.js.berklix.net (fire.js.berklix.net [192.168.91.41]) by mart.js.berklix.net (8.14.3/8.14.3) with ESMTP id r96DiRMd026177 for ; Sun, 6 Oct 2013 15:44:27 +0200 (CEST) (envelope-from jhs@berklix.com) Received: from fire.js.berklix.net (localhost.js.berklix.net [127.0.0.1]) by fire.js.berklix.net (8.14.4/8.14.4) with ESMTP id r96DiLnN059117 for ; Sun, 6 Oct 2013 15:44:27 +0200 (CEST) (envelope-from jhs@fire.js.berklix.net) Message-Id: <201310061344.r96DiLnN059117@fire.js.berklix.net> To: current@freebsd.org Subject: lock order reversals on 10.0-ALPHA4 From: "Julian H. Stacey" Organization: http://berklix.com BSD Linux Unix Consultancy, Munich Germany User-agent: EXMH on FreeBSD http://www.berklix.com/free/ X-URL: http://www.berklix.com/~jhs/cv/ Date: Sun, 06 Oct 2013 15:44:21 +0200 Sender: jhs@berklix.com X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 06 Oct 2013 13:44:52 -0000 With: FreeBSD lapr.js.berklix.net 10.0-ALPHA4 FreeBSD 10.0-ALPHA4 #0 r255933: Sun Sep 29 02:50:54 UTC 2013 root@snap.freebsd.org:/usr/obj/usr/src/sys/GENERIC amd64 At boot dmesg shows several lock order reversals, eg ------ Trying to mount root from ufs:/dev/ad4s2a [rw]... ipfw2 (+ipv6) initialized, divert loadable, nat loadable, default to deny, logging disabled lock order reversal: 1st 0xfffffe00a6e26b48 bufwait (bufwait) @ /usr/src/sys/kern/vfs_bio.c:3059 2nd 0xfffff80005cf8400 dirhash (dirhash) @ /usr/src/sys/ufs/ufs/ufs_dirhash.c:284 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00c8f3d3f0 kdb_backtrace() at kdb_backtrace+0x39/frame 0xfffffe00c8f3d4a0 witness_checkorder() at witness_checkorder+0xd23/frame 0xfffffe00c8f3d530 _sx_xlock() at _sx_xlock+0x75/frame 0xfffffe00c8f3d570 ufsdirhash_add() at ufsdirhash_add+0x3b/frame 0xfffffe00c8f3d5b0 ufs_direnter() at ufs_direnter+0x688/frame 0xfffffe00c8f3d670 ufs_makeinode() at ufs_makeinode+0x573/frame 0xfffffe00c8f3d830 ufs_symlink() at ufs_symlink+0x32/frame 0xfffffe00c8f3d880 VOP_SYMLINK_APV() at VOP_SYMLINK_APV+0xf0/frame 0xfffffe00c8f3d8b0 kern_symlinkat() at kern_symlinkat+0x23e/frame 0xfffffe00c8f3dae0 amd64_syscall() at amd64_syscall+0x265/frame 0xfffffe00c8f3dbf0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe00c8f3dbf0 --- syscall (57, FreeBSD ELF64, sys_symlink), rip = 0x800888ffa, rsp = 0x7fffffffca58, rbp = 0x7fffffffdc10 --- lock order reversal: 1st 0xfffff800881b9d50 ufs (ufs) @ /usr/src/sys/kern/vfs_mount.c:851 2nd 0xfffff800881b99a0 devfs (devfs) @ /usr/src/sys/kern/vfs_subr.c:2099 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00c8ed93d0 kdb_backtrace() at kdb_backtrace+0x39/frame 0xfffffe00c8ed9480 witness_checkorder() at witness_checkorder+0xd23/frame 0xfffffe00c8ed9510 __lockmgr_args() at __lockmgr_args+0x6f2/frame 0xfffffe00c8ed9640 vop_stdlock() at vop_stdlock+0x3c/frame 0xfffffe00c8ed9660 VOP_LOCK1_APV() at VOP_LOCK1_APV+0xf5/frame 0xfffffe00c8ed9690 _vn_lock() at _vn_lock+0xab/frame 0xfffffe00c8ed9700 vget() at vget+0x70/frame 0xfffffe00c8ed9750 devfs_allocv() at devfs_allocv+0xfd/frame 0xfffffe00c8ed97a0 devfs_root() at devfs_root+0x43/frame 0xfffffe00c8ed97d0 vfs_donmount() at vfs_donmount+0x115e/frame 0xfffffe00c8ed9aa0 sys_nmount() at sys_nmount+0x72/frame 0xfffffe00c8ed9ae0 amd64_syscall() at amd64_syscall+0x265/frame 0xfffffe00c8ed9bf0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe00c8ed9bf0 --- syscall (378, FreeBSD ELF64, sys_nmount), rip = 0x800a9dd7a, rsp = 0x7fffffffccb8, rbp = 0x7fffffffd220 --- ---- It comes up multi user OK, Do you already have enough lock order reversal to work on, or do you want me to run diagnostics ? what ? Cheers, Julian -- Julian Stacey, BSD Unix Linux C Sys Eng Consultant, Munich http://berklix.com Reply below not above, like a play script. Indent old text with "> ". Send plain text. No quoted-printable, HTML, base64, multipart/alternative.