From owner-freebsd-fs@freebsd.org Mon Sep 12 14:08:45 2016 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 7E8ABBD8205 for ; Mon, 12 Sep 2016 14:08:45 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 6D277884 for ; Mon, 12 Sep 2016 14:08:45 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id u8CE8hH0089726 for ; Mon, 12 Sep 2016 14:08:45 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 209158] node / npm triggering zfs rename deadlock Date: Mon, 12 Sep 2016 14:08:43 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: needs-qa, patch X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: peixoto.cassiano@gmail.com X-Bugzilla-Status: Closed X-Bugzilla-Resolution: FIXED X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: avg@FreeBSD.org X-Bugzilla-Flags: mfc-stable10? mfc-stable11? X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 12 Sep 2016 14:08:45 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D209158 Cassiano Peixoto changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |peixoto.cassiano@gmail.com --- Comment #44 from Cassiano Peixoto --- Hi, Sorry to post it after PR closed, but i'm having an issue that could be lin= ked to this problem related. My FreeBSD 11-RC2 with ZFS is crashing after some hours running with the same debug message. Let me know if i can help with m= ore info: # kgdb kernel.debug /var/crash/vmcore.last GNU gdb 6.1.1 [FreeBSD] Copyright 2004 Free Software Foundation, Inc. GDB is free software, covered by the GNU General Public License, and you are welcome to change it and/or distribute copies of it under certain condition= s. Type "show copying" to see the conditions. There is absolutely no warranty for GDB. Type "show warranty" for details. This GDB was configured as "amd64-marcel-freebsd"... Unread portion of the kernel message buffer: Fatal trap 12: page fault while in kernel mode cpuid =3D 7; apic id =3D 0e fault virtual address =3D 0xffffffffffffffc0 fault code =3D supervisor read data, page not present instruction pointer =3D 0x20:0xffffffff822cac63 stack pointer =3D 0x28:0xfffffe02370d02e0 frame pointer =3D 0x28:0xfffffe02370d0350 code segment =3D base 0x0, limit 0xfffff, type 0x1b =3D DPL 0, pres 1, long 1, def32 0, gran 1 processor eflags =3D interrupt enabled, resume, IOPL =3D 0 current process =3D 1174 (syslogd) trap number =3D 12 panic: page fault cpuid =3D 5 KDB: stack backtrace: #0 0xffffffff80b33417 at kdb_backtrace+0x67 #1 0xffffffff80ae8812 at vpanic+0x182 #2 0xffffffff80ae8683 at panic+0x43 #3 0xffffffff81036d31 at trap_fatal+0x351 #4 0xffffffff81036f23 at trap_pfault+0x1e3 #5 0xffffffff810364cc at trap+0x26c #6 0xffffffff810191d1 at calltrap+0x8 #7 0xffffffff822a360d at dmu_buf_hold_array_by_dnode+0x34d #8 0xffffffff822a4703 at dmu_write_uio_dnode+0x43 #9 0xffffffff822a46a2 at dmu_write_uio_dbuf+0x42 #10 0xffffffff82342c48 at zfs_freebsd_write+0x7b8 #11 0xffffffff811a1dc5 at VOP_WRITE_APV+0x125 #12 0xffffffff80bcffec at vn_write+0x25c #13 0xffffffff80bcd5b2 at vn_io_fault1+0x1c2 #14 0xffffffff80bcb5a7 at vn_io_fault+0x197 #15 0xffffffff80b50667 at dofilewrite+0x87 #16 0xffffffff80b50348 at kern_writev+0x68 #17 0xffffffff80b505b6 at sys_writev+0x36 Uptime: 4h30m39s Dumping 1031 out of 8142 MB: (CTRL-C to abort) ..2%..11%..21%..32%..41%..52%..61%..72%..81%..92% Reading symbols from /boot/kernel/zfs.ko...Reading symbols from /usr/lib/debug//boot/kernel/zfs.ko.debug...done. done. Loaded symbols for /boot/kernel/zfs.ko Reading symbols from /boot/kernel/opensolaris.ko...Reading symbols from /usr/lib/debug//boot/kernel/opensolaris.ko.debug...done. done. Loaded symbols for /boot/kernel/opensolaris.ko Reading symbols from /boot/kernel/ng_UI.ko...Reading symbols from /usr/lib/debug//boot/kernel/ng_UI.ko.debug...done. done. Loaded symbols for /boot/kernel/ng_UI.ko Reading symbols from /boot/kernel/netgraph.ko...Reading symbols from /usr/lib/debug//boot/kernel/netgraph.ko.debug...done. done. Loaded symbols for /boot/kernel/netgraph.ko Reading symbols from /boot/kernel/ng_async.ko...Reading symbols from /usr/lib/debug//boot/kernel/ng_async.ko.debug...done. done. Loaded symbols for /boot/kernel/ng_async.ko Reading symbols from /boot/kernel/ng_bpf.ko...Reading symbols from /usr/lib/debug//boot/kernel/ng_bpf.ko.debug...done. done. Loaded symbols for /boot/kernel/ng_bpf.ko Reading symbols from /boot/kernel/ng_cisco.ko...Reading symbols from /usr/lib/debug//boot/kernel/ng_cisco.ko.debug...done. done. Loaded symbols for /boot/kernel/ng_cisco.ko Reading symbols from /boot/kernel/ng_echo.ko...Reading symbols from /usr/lib/debug//boot/kernel/ng_echo.ko.debug...done. done. Loaded symbols for /boot/kernel/ng_echo.ko Reading symbols from /boot/kernel/ng_ether.ko...Reading symbols from /usr/lib/debug//boot/kernel/ng_ether.ko.debug...done. done. Loaded symbols for /boot/kernel/ng_ether.ko Reading symbols from /boot/kernel/ng_frame_relay.ko...Reading symbols from /usr/lib/debug//boot/kernel/ng_frame_relay.ko.debug...done. done. Loaded symbols for /boot/kernel/ng_frame_relay.ko Reading symbols from /boot/kernel/ng_hole.ko...Reading symbols from /usr/lib/debug//boot/kernel/ng_hole.ko.debug...done. done. Loaded symbols for /boot/kernel/ng_hole.ko Reading symbols from /boot/kernel/ng_iface.ko...Reading symbols from /usr/lib/debug//boot/kernel/ng_iface.ko.debug...done. done. Loaded symbols for /boot/kernel/ng_iface.ko Reading symbols from /boot/kernel/ng_ksocket.ko...Reading symbols from /usr/lib/debug//boot/kernel/ng_ksocket.ko.debug...done. done. Loaded symbols for /boot/kernel/ng_ksocket.ko Reading symbols from /boot/kernel/ng_l2tp.ko...Reading symbols from /usr/lib/debug//boot/kernel/ng_l2tp.ko.debug...done. done. Loaded symbols for /boot/kernel/ng_l2tp.ko Reading symbols from /boot/kernel/ng_lmi.ko...Reading symbols from /usr/lib/debug//boot/kernel/ng_lmi.ko.debug...done. done. Loaded symbols for /boot/kernel/ng_lmi.ko Reading symbols from /boot/kernel/ng_mppc.ko...Reading symbols from /usr/lib/debug//boot/kernel/ng_mppc.ko.debug...done. done. Loaded symbols for /boot/kernel/ng_mppc.ko Reading symbols from /boot/kernel/rc4.ko...Reading symbols from /usr/lib/debug//boot/kernel/rc4.ko.debug...done. done. Loaded symbols for /boot/kernel/rc4.ko Reading symbols from /boot/kernel/ng_netflow.ko...Reading symbols from /usr/lib/debug//boot/kernel/ng_netflow.ko.debug...done. done. Loaded symbols for /boot/kernel/ng_netflow.ko Reading symbols from /boot/kernel/ng_ppp.ko...Reading symbols from /usr/lib/debug//boot/kernel/ng_ppp.ko.debug...done. done. Loaded symbols for /boot/kernel/ng_ppp.ko Reading symbols from /boot/kernel/ng_pppoe.ko...Reading symbols from /usr/lib/debug//boot/kernel/ng_pppoe.ko.debug...done. done. Loaded symbols for /boot/kernel/ng_pppoe.ko Reading symbols from /boot/kernel/ng_pptpgre.ko...Reading symbols from /usr/lib/debug//boot/kernel/ng_pptpgre.ko.debug...done. done. Loaded symbols for /boot/kernel/ng_pptpgre.ko Reading symbols from /boot/kernel/ng_rfc1490.ko...Reading symbols from /usr/lib/debug//boot/kernel/ng_rfc1490.ko.debug...done. done. Loaded symbols for /boot/kernel/ng_rfc1490.ko Reading symbols from /boot/kernel/ng_socket.ko...Reading symbols from /usr/lib/debug//boot/kernel/ng_socket.ko.debug...done. done. Loaded symbols for /boot/kernel/ng_socket.ko Reading symbols from /boot/kernel/ng_tee.ko...Reading symbols from /usr/lib/debug//boot/kernel/ng_tee.ko.debug...done. done. Loaded symbols for /boot/kernel/ng_tee.ko Reading symbols from /boot/kernel/ng_tty.ko...Reading symbols from /usr/lib/debug//boot/kernel/ng_tty.ko.debug...done. done. Loaded symbols for /boot/kernel/ng_tty.ko Reading symbols from /boot/kernel/ng_vjc.ko...Reading symbols from /usr/lib/debug//boot/kernel/ng_vjc.ko.debug...done. done. Loaded symbols for /boot/kernel/ng_vjc.ko Reading symbols from /boot/kernel/coretemp.ko...Reading symbols from /usr/lib/debug//boot/kernel/coretemp.ko.debug...done. done. Loaded symbols for /boot/kernel/coretemp.ko Reading symbols from /boot/kernel/ng_tcpmss.ko...Reading symbols from /usr/lib/debug//boot/kernel/ng_tcpmss.ko.debug...done. done. Loaded symbols for /boot/kernel/ng_tcpmss.ko Reading symbols from /boot/kernel/ng_nat.ko...Reading symbols from /usr/lib/debug//boot/kernel/ng_nat.ko.debug...done. done. Loaded symbols for /boot/kernel/ng_nat.ko Reading symbols from /boot/kernel/ng_car.ko...Reading symbols from /usr/lib/debug//boot/kernel/ng_car.ko.debug...done. done. Loaded symbols for /boot/kernel/ng_car.ko #0 doadump (textdump=3D) at pcpu.h:221 221 pcpu.h: No such file or directory. in pcpu.h (kgdb) list *0xffffffff822cac63 0xffffffff822cac63 is in dmu_zfetch (/usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/dmu_zfetch.c:243). 238=20=20=20=20=20 239 rw_enter(&zf->zf_rwlock, RW_READER); 240=20=20=20=20=20 241 for (zs =3D list_head(&zf->zf_stream); zs !=3D NULL; 242 zs =3D list_next(&zf->zf_stream, zs)) { 243 if (blkid =3D=3D zs->zs_blkid) { 244 mutex_enter(&zs->zs_lock); 245 /* 246 * zs_blkid could have changed before we 247 * acquired zs_lock; re-check them here. Current language: auto; currently minimal (kgdb) bt #0 doadump (textdump=3D) at pcpu.h:221 #1 0xffffffff80ae8299 in kern_reboot (howto=3D260) at /usr/src/sys/kern/kern_shutdown.c:366 #2 0xffffffff80ae884b in vpanic (fmt=3D, ap=3D) at /usr/src/sys/kern/kern_shutdown.c:759 #3 0xffffffff80ae8683 in panic (fmt=3D0x0) at /usr/src/sys/kern/kern_shutdown.c:690 #4 0xffffffff81036d31 in trap_fatal (frame=3D0xfffffe02370d0230, eva=3D18446744073709551552) at /usr/src/sys/amd64/amd64/trap.c:841 #5 0xffffffff81036f23 in trap_pfault (frame=3D0xfffffe02370d0230, usermode= =3D0) at /usr/src/sys/amd64/amd64/trap.c:691 #6 0xffffffff810364cc in trap (frame=3D0xfffffe02370d0230) at /usr/src/sys/amd64/amd64/trap.c:442 #7 0xffffffff810191d1 in calltrap () at /usr/src/sys/amd64/amd64/exception.S:236 #8 0xffffffff822cac63 in dmu_zfetch (zf=3D, blkid=3D<= value optimized out>, nblks=3D, fetch_data=3D) at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/dmu_zfetch.c= :241 #9 0xffffffff822a360d in dmu_buf_hold_array_by_dnode (dn=3D, offset=3D, length=3D, read= =3D0, tag=3D0xffffffff8239f791,=20 numbufsp=3D, dbpp=3D0xffffffffffffffc0, flags=3D) at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/dmu.c:463 #10 0xffffffff822a4703 in dmu_write_uio_dnode (dn=3D0xfffff8001bc532c8, uio=3D0xfffff8010f1a1600, size=3D47, tx=3D0xfffff8010f16aa00) at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/dmu.c:1173 #11 0xffffffff822a46a2 in dmu_write_uio_dbuf (zdb=3D0xfffff8001bba4438, uio=3D0xfffff8010f1a1600, size=3D47, tx=3D0xfffff8010f16aa00) at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/dmu.c:1244 #12 0xffffffff82342c48 in zfs_freebsd_write (ap=3D) at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vnops.c:1117 #13 0xffffffff811a1dc5 in VOP_WRITE_APV (vop=3D, a=3D<= value optimized out>) at vnode_if.c:1000 #14 0xffffffff80bcffec in vn_write (fp=3D, uio=3D0xfffff8010f1a1600, active_cred=3D, flags=3D, td=3D0x0) at vnode_if.h:413 #15 0xffffffff80bcd5b2 in vn_io_fault1 () at /usr/src/sys/kern/vfs_vnops.c:= 1060 #16 0xffffffff80bcb5a7 in vn_io_fault (fp=3D, uio=3D, active_cred=3D, flags=3D,=20 td=3D) at /usr/src/sys/kern/vfs_vnops.c:1165 #17 0xffffffff80b50667 in dofilewrite (td=3D0xfffff8001ba19500, fd=3D19, fp=3D0xfffff8001b91cd70, auio=3D0xfffff8010f1a1600, offset=3D, flags=3D0) at file.h:311 #18 0xffffffff80b50348 in kern_writev (td=3D0xfffff8001ba19500, fd=3D19, auio=3D0xfffff8010f1a1600) at /usr/src/sys/kern/sys_generic.c:506 #19 0xffffffff80b505b6 in sys_writev (td=3D0xfffff8001ba19500, uap=3D0xfffffe02370d0b80) at /usr/src/sys/kern/sys_generic.c:491 #20 0xffffffff8103768e in amd64_syscall (td=3D, traced= =3D0) at subr_syscall.c:135 #21 0xffffffff810194bb in Xfast_syscall () at /usr/src/sys/amd64/amd64/exception.S:396 #22 0x0000000800b87f8a in ?? () Previous frame inner to this frame (corrupt stack?) (kgdb) --=20 You are receiving this mail because: You are on the CC list for the bug.=