From owner-freebsd-bugs@freebsd.org Fri Feb 23 16:48:38 2018 Return-Path: Delivered-To: freebsd-bugs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 9B040F05D6C for ; Fri, 23 Feb 2018 16:48:38 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 337E36A06B for ; Fri, 23 Feb 2018 16:48:38 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id 7F7112790B for ; Fri, 23 Feb 2018 16:48:37 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id w1NGmbZ0098026 for ; Fri, 23 Feb 2018 16:48:37 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id w1NGmbkJ098025 for freebsd-bugs@FreeBSD.org; Fri, 23 Feb 2018 16:48:37 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: freebsd-bugs@FreeBSD.org Subject: [Bug 226142] [bhyve] [panic] mtx_lock_spin: recursed on non-recursive mutex vcpu lock @ /usr/src/sys/amd64/vmm/vmm.c:2246 Date: Fri, 23 Feb 2018 16:48:37 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: new X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: dch@freebsd.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-bugs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_id short_desc product version rep_platform op_sys bug_status bug_severity priority component assigned_to reporter Message-ID: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-bugs@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Bug reports List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 23 Feb 2018 16:48:38 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D226142 Bug ID: 226142 Summary: [bhyve] [panic] mtx_lock_spin: recursed on non-recursive mutex vcpu lock @ /usr/src/sys/amd64/vmm/vmm.c:2246 Product: Base System Version: CURRENT Hardware: amd64 OS: Any Status: New Severity: Affects Only Me Priority: --- Component: kern Assignee: freebsd-bugs@FreeBSD.org Reporter: dch@freebsd.org # info - 100% reproducible on starting a bhyve-based vm using vmrun.sh - recent current r329831, also panics at r329531 - GENERIC + WITH_CTF=3D1 and DEBUG=3D-g - I'll bisect over the next few days to see if I can narrow the commits down - previously reported on current@ mailing list to no avail # panic dmesg [36984] panic: mtx_lock_spin: recursed on non-recursive mutex vcpu lock @ /usr/src/sys/amd64/vmm/vmm.c:2246 [36984]=20 [36984] cpuid =3D 3 [36984] time =3D 1519121280 [36984] KDB: stack backtrace: [36984] db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe020c272360 [36984] vpanic() at vpanic+0x18d/frame 0xfffffe020c2723c0 [36984] vpanic() at vpanic/frame 0xfffffe020c272440 [36984] __mtx_lock_spin_flags() at __mtx_lock_spin_flags+0x148/frame 0xfffffe020c272480 [36984] vcpu_get_state() at vcpu_get_state+0x44/frame 0xfffffe020c2724c0 [36984] vmx_pending_intr() at vmx_pending_intr+0xc6/frame 0xfffffe020c272500 [36984] vm_run() at vm_run+0x759/frame 0xfffffe020c272600 [36984] vmmdev_ioctl() at vmmdev_ioctl+0x86b/frame 0xfffffe020c2726a0 [36984] devfs_ioctl() at devfs_ioctl+0xcb/frame 0xfffffe020c2726f0 [36984] VOP_IOCTL_APV() at VOP_IOCTL_APV+0xd9/frame 0xfffffe020c272720 [36984] vn_ioctl() at vn_ioctl+0x124/frame 0xfffffe020c272830 [36984] devfs_ioctl_f() at devfs_ioctl_f+0x1f/frame 0xfffffe020c272850 [36984] kern_ioctl() at kern_ioctl+0x2b9/frame 0xfffffe020c2728b0 [36984] sys_ioctl() at sys_ioctl+0x15c/frame 0xfffffe020c272980 [36984] amd64_syscall() at amd64_syscall+0x79b/frame 0xfffffe020c272ab0 [36984] fast_syscall_common() at fast_syscall_common+0x101/frame 0x7fffddde= cee0 [36984] KDB: enter: panic # debugger db:0:kdb.enter.panic> run lockinfo db:1:lockinfo> show locks db:1:locks> show alllocks db:1:alllocks> show lockedvnods Locked vnodes db:0:kdb.enter.panic> show pcpu cpuid =3D 3 dynamic pcpu =3D 0xfffffe0084b95800 curthread =3D 0xfffff8017ad76560: pid 12951 tid 103324 "vcpu 0" curpcb =3D 0xfffffe020c272b80 fpcurthread =3D none idlethread =3D 0xfffff8010764f560: tid 100006 "idle: cpu3" curpmap =3D 0xfffff80dbaba5130 tssp =3D 0xffffffff81d8bfd8 commontssp =3D 0xffffffff81d8bfd8 rsp0 =3D 0xfffffe020c272b80 gs32p =3D 0xffffffff81d92c10 ldt =3D 0xffffffff81d92c50 tss =3D 0xffffffff81d92c40 curvnet =3D 0 spin locks held: db:0:kdb.enter.panic> bt Tracing pid 12951 tid 103324 td 0xfffff8017ad76560 kdb_enter() at kdb_enter+0x3b/frame 0xfffffe020c272360 vpanic() at vpanic+0x1aa/frame 0xfffffe020c2723c0 vpanic() at vpanic/frame 0xfffffe020c272440 __mtx_lock_spin_flags() at __mtx_lock_spin_flags+0x148/frame 0xfffffe020c27= 2480 vcpu_get_state() at vcpu_get_state+0x44/frame 0xfffffe020c2724c0 vmx_pending_intr() at vmx_pending_intr+0xc6/frame 0xfffffe020c272500 vm_run() at vm_run+0x759/frame 0xfffffe020c272600 vmmdev_ioctl() at vmmdev_ioctl+0x86b/frame 0xfffffe020c2726a0 devfs_ioctl() at devfs_ioctl+0xcb/frame 0xfffffe020c2726f0 VOP_IOCTL_APV() at VOP_IOCTL_APV+0xd9/frame 0xfffffe020c272720 vn_ioctl() at vn_ioctl+0x124/frame 0xfffffe020c272830 devfs_ioctl_f() at devfs_ioctl_f+0x1f/frame 0xfffffe020c272850 kern_ioctl() at kern_ioctl+0x2b9/frame 0xfffffe020c2728b0 sys_ioctl() at sys_ioctl+0x15c/frame 0xfffffe020c272980 amd64_syscall() at amd64_syscall+0x79b/frame 0xfffffe020c272ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0x7fffdddecee0 db:0:kdb.enter.panic> ps pid ppid pgrp uid state wmesg wchan cmd 18384 99134 12632 1002 S+ select 0xfffff80152b4e9c0 ssh 12951 53776 53776 0 R+ (threaded) bhyve 101692 S kqread 0xfffff81c41243400 mevent 102880 S uwait 0xfffff80d4915e500 blk-3:0:0-0 102881 S uwait 0xfffff8025b2c5800 blk-3:0:0-1 102982 S uwait 0xfffff802d198b680 blk-3:0:0-2 102985 S uwait 0xfffff8015fdb6a00 blk-3:0:0-3 102988 S uwait 0xfffff80721bbab00 blk-3:0:0-4 102990 S uwait 0xfffff806a1161b00 blk-3:0:0-5 102994 S uwait 0xfffff8010a0db480 blk-3:0:0-6 103009 S uwait 0xfffff80aae76f700 blk-3:0:0-7 103016 S uwait 0xfffff8073b79d980 blk-4:0-0 103018 S uwait 0xfffff8010a0d8900 blk-4:0-1 103020 S uwait 0xfffff80618184780 blk-4:0-2 103022 S uwait 0xfffff802d198ba00 blk-4:0-3 103024 S uwait 0xfffff807ac4e2800 blk-4:0-4 103320 S uwait 0xfffff807ac4e2180 blk-4:0-5 103321 S uwait 0xfffff8015fdb5b80 blk-4:0-6 103322 S uwait 0xfffff807473e9900 blk-4:0-7 103323 S uwait 0xfffff80721c41b80 vtnet-5:0 tx 103324 Run CPU 3 vcpu 0 100505 Run CPU 11 vcpu 1 53776 38209 53776 0 Ss+ wait 0xfffff80d4942da70 sh 38209 1 38209 0 Ss select 0xfffff80cca99d940 tmux ... # head of dmesg FreeBSD 12.0-CURRENT #6 r329611+f65afb3cfe82(master): Mon Feb 19 23:19:01 U= TC 2018 root@wintermute:/usr/obj/usr/src/amd64.amd64/sys/GENERIC amd64 FreeBSD clang version 6.0.0 (branches/release_60 325330) (based on LLVM 6.0= .0) WARNING: WITNESS option enabled, expect reduced performance. VT(efifb): resolution 1280x1024 module_register: cannot register mmc/mmcsd from kernel; already loaded from mmcsd.ko Module mmc/mmcsd failed to register: 17 CPU: Intel(R) Xeon(R) CPU E5-2667 v4 @ 3.20GHz (3200.07-MHz K8-class CPU) Origin=3D"GenuineIntel" Id=3D0x406f1 Family=3D0x6 Model=3D0x4f Steppi= ng=3D1 Features=3D0xbfebfbff Features2=3D0x7ffefbff AMD Features=3D0x2c100800 AMD Features2=3D0x121 Structured Extended Features=3D0x21cbfbb XSAVE Features=3D0x1 VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID,VID,PostIntr TSC: P-state invariant, performance statistics real memory =3D 137434759168 (131068 MB) avail memory =3D 133684940800 (127491 MB) Event timer "LAPIC" quality 600 ACPI APIC Table: FreeBSD/SMP: Multiprocessor System Detected: 16 CPUs FreeBSD/SMP: 1 package(s) x 8 core(s) x 2 hardware threads ... --=20 You are receiving this mail because: You are the assignee for the bug.=