Date: Wed, 20 Apr 2016 11:28:42 +0000 From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 204764] Filesystem deadlock, process in vodead state Message-ID: <bug-204764-3630-y8YeWtcELk@https.bugs.freebsd.org/bugzilla/> In-Reply-To: <bug-204764-3630@https.bugs.freebsd.org/bugzilla/> References: <bug-204764-3630@https.bugs.freebsd.org/bugzilla/>
next in thread | previous in thread | raw e-mail | index | archive | help
https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D204764 roel@qsp.nl changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |roel@qsp.nl --- Comment #22 from roel@qsp.nl --- And another +1. Deadlock occurs on a raidz1 pool with 4 1.2TB members. This system is running on r294572. The issue started after approximately 59 days= of production use with an average load of about 150 io transactions per second. The deadlock is on a directory, which is located on a +-600GB ZFS dataset a= nd contains 7 files and two subdirs, a few kb total. procstat -kk for a stuck du process: PID TID COMM TDNAME KSTACK=20=20=20=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20 97300 101745 du - mi_switch+0xe1 sleepq_wait+0= x3a _sleep+0x287 vnode_create_vobject+0x100 zfs_freebsd_open+0xf5 VOP_OPEN_APV+= 0xa1 vn_open_vnode+0x234 vn_open_cred+0x36a kern_openat+0x26f amd64_syscall+0x40f Xfast_syscall+0xfb=20 And here is an rsync that is stuck: 25689 101762 rsync-backup - mi_switch+0xe1 sleepq_wait+0= x3a _sleep+0x287 vnode_create_vobject+0x100 zfs_freebsd_open+0xf5 VOP_OPEN_APV+= 0xa1 vn_open_vnode+0x234 vn_open_cred+0x36a kern_openat+0x26f amd64_syscall+0x40f Xfast_syscall+0xfb This filesystem is exported through nfs. We have a few nfsd threads stuck as well: root@nfs01:/home/roel # procstat -kk 857 PID TID COMM TDNAME KSTACK=20=20=20=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20 857 100485 nfsd nfsd: master mi_switch+0xe1 sleepq_catch_signals+0xab sleepq_timedwait_sig+0x10 _cv_timedwait_sig_sbt+0= x18b svc_run_internal+0x46d svc_run+0x182 nfsrvd_nfsd+0x242 nfssvc_nfsd+0x107 sys_nfssvc+0x9c amd64_syscall+0x40f Xfast_syscall+0xfb=20 857 100505 nfsd nfsd: service mi_switch+0xe1 sleepq_catch_signals+0xab sleepq_wait_sig+0xf _cv_wait_sig+0x16a svc_run_internal+0x86e svc_thread_start+0xb fork_exit+0x9a fork_trampoline+= 0xe=20 ... lots of similar threads, except for: ... 857 100541 nfsd nfsd: service mi_switch+0xe1 sleepq_wait+0= x3a _sleep+0x287 vnode_create_vobject+0x100 zfs_fhtovp+0x45b nfsvno_fhtovp+0x7c nfsd_fhtovp+0xc8 nfsrvd_dorpc+0x12c nfssvc_program+0x54e svc_run_internal+0= xd2b svc_thread_start+0xb fork_exit+0x9a fork_trampoline+0xe=20 857 100588 nfsd nfsd: service mi_switch+0xe1 sleepq_wait+0= x3a _sleep+0x287 vnode_create_vobject+0x100 zfs_fhtovp+0x45b nfsvno_fhtovp+0x7c nfsd_fhtovp+0xc8 nfsrvd_dorpc+0x12c nfssvc_program+0x54e svc_run_internal+0= xd2b svc_thread_start+0xb fork_exit+0x9a fork_trampoline+0xe=20 Some kgdb output for one of the stuck du threads: [Switching to thread 555 (Thread 101720)]#0 sched_switch (td=3D0xfffff8033a17e000, newtd=3D<value optimized out>, flags=3D<value opt= imized out>) at /usr/src/sys/kern/sched_ule.c:1945 1945 cpuid =3D PCPU_GET(cpuid); (kgdb) bt #0 sched_switch (td=3D0xfffff8033a17e000, newtd=3D<value optimized out>, flags=3D<value optimized out>) at /usr/src/sys/kern/sched_ule.c:1945 #1 0xffffffff80959ff1 in mi_switch (flags=3D260, newtd=3D0x0) at /usr/src/sys/kern/kern_synch.c:491 #2 0xffffffff8099b31a in sleepq_wait (wchan=3D0x0, pri=3D0) at /usr/src/sys/kern/subr_sleepqueue.c:617 #3 0xffffffff80959a17 in _sleep (ident=3D<value optimized out>, lock=3D<va= lue optimized out>, priority=3D<value optimized out>, wmesg=3D<value optimized = out>, sbt=3D<value optimized out>, pr=3D<value optimized out>,=20 flags=3D<value optimized out>) at /usr/src/sys/kern/kern_synch.c:255 #4 0xffffffff80bed620 in vnode_create_vobject (vp=3D0xfffff801d3e11b10, isize=3D16, td=3D0xfffff8033a17e000) at /usr/src/sys/vm/vnode_pager.c:120 #5 0xffffffff81a7d5f5 in zfs_freebsd_open (ap=3D0xfffffe0466890658) at /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/z= fs_vnops.c:6076 #6 0xffffffff80e7e651 in VOP_OPEN_APV (vop=3D<value optimized out>, a=3D<v= alue optimized out>) at vnode_if.c:469 #7 0xffffffff80a05694 in vn_open_vnode (vp=3D0xfffff801d3e11b10, fmode=3D1= 179653, cred=3D0xfffff803682bd400, td=3D0xfffff8033a17e000, fp=3D0xfffff80240d403c0= ) at vnode_if.h:196 #8 0xffffffff80a0528a in vn_open_cred (ndp=3D0xfffffe0466890870, flagp=3D0xfffffe046689094c, cmode=3D<value optimized out>, vn_open_flags=3D= <value optimized out>, cred=3D0x0, fp=3D0xfffff80240d403c0) at /usr/src/sys/kern/vfs_vnops.c:268 #9 0xffffffff809fe44f in kern_openat (td=3D0xfffff8033a17e000, fd=3D-100, path=3D0x801422d48 <Error reading address 0x801422d48: Bad address>, pathseg=3DUIO_USERSPACE, flags=3D1179653, mode=3D<value optimized out>) at /usr/src/sys/kern/vfs_syscalls.c:1093 #10 0xffffffff80d55aff in amd64_syscall (td=3D0xfffff8033a17e000, traced=3D= 0) at subr_syscall.c:141 #11 0xffffffff80d3ad7b in Xfast_syscall () at /usr/src/sys/amd64/amd64/exception.S:396 #12 0x0000000800b7570a in ?? () Previous frame inner to this frame (corrupt stack?) (kgdb) frame 4 #4 0xffffffff80bed620 in vnode_create_vobject (vp=3D0xfffff801d3e11b10, isize=3D16, td=3D0xfffff8033a17e000) at /usr/src/sys/vm/vnode_pager.c:120 120 VM_OBJECT_SLEEP(object, object, PDROP | PVM, "vodea= d", 0); (kgdb) print vp $4 =3D (struct vnode *) 0xfffff801d3e11b10 (kgdb) print *vp $5 =3D {v_tag =3D 0xffffffff81aecb3b "zfs", v_op =3D 0xffffffff81aff790, v_= data =3D 0xfffff801a2d1ca10, v_mount =3D 0xfffff8011a46e660, v_nmntvnodes =3D {tqe_n= ext =3D 0xfffff801a53281d8, tqe_prev =3D 0xfffff801a6b8e5a8}, v_un =3D { vu_mount =3D 0x0, vu_socket =3D 0x0, vu_cdev =3D 0x0, vu_fifoinfo =3D 0= x0}, v_hashlist =3D {le_next =3D 0x0, le_prev =3D 0x0}, v_cache_src =3D {lh_firs= t =3D 0xfffff80019708850}, v_cache_dst =3D {tqh_first =3D 0xfffff80257063850,=20 tqh_last =3D 0xfffff80257063870}, v_cache_dd =3D 0xfffff80257063850, v_= lock =3D {lock_object =3D {lo_name =3D 0xffffffff81aecb3b "zfs", lo_flags =3D 117112= 832, lo_data =3D 0, lo_witness =3D 0x0}, lk_lock =3D 1, lk_exslpfail =3D 0,=20 lk_timo =3D 51, lk_pri =3D 96}, v_interlock =3D {lock_object =3D {lo_na= me =3D 0xffffffff80fe1a6c "vnode interlock", lo_flags =3D 16973824, lo_data =3D 0, lo_witness =3D 0x0}, mtx_lock =3D 4}, v_vnlock =3D 0xfffff801d3e11b78,=20 v_actfreelist =3D {tqe_next =3D 0xfffff801a6b8e588, tqe_prev =3D 0xfffff801a5328298}, v_bufobj =3D {bo_lock =3D {lock_object =3D {lo_name =3D 0xffffffff80fe1a7c "bufobj interlock", lo_flags =3D 86179840, lo_data =3D 0, lo_witness =3D 0x0},=20 rw_lock =3D 1}, bo_ops =3D 0xffffffff814b3900, bo_object =3D 0xfffff801fd0ea100, bo_synclist =3D {le_next =3D 0x0, le_prev =3D 0x0}, bo_= private =3D 0xfffff801d3e11b10, __bo_vnode =3D 0xfffff801d3e11b10, bo_clean =3D {bv_hd = =3D { tqh_first =3D 0x0, tqh_last =3D 0xfffff801d3e11c30}, bv_root =3D {p= t_root =3D 0}, bv_cnt =3D 0}, bo_dirty =3D {bv_hd =3D {tqh_first =3D 0x0, tqh_last =3D 0xfffff801d3e11c50}, bv_root =3D {pt_root =3D 0}, bv_cnt =3D 0}, bo_numoutp= ut =3D 0,=20 bo_flag =3D 0, bo_bsize =3D 131072}, v_pollinfo =3D 0x0, v_label =3D 0x= 0, v_lockf =3D 0x0, v_rl =3D {rl_waiters =3D {tqh_first =3D 0x0, tqh_last =3D 0xfffff801d3= e11c98}, rl_currdep =3D 0x0}, v_cstart =3D 0, v_lasta =3D 0, v_lastw =3D 0,=20 v_clen =3D 0, v_holdcnt =3D 127, v_usecount =3D 126, v_iflag =3D 512, v_v= flag =3D 0, v_writecount =3D 0, v_hash =3D 7955980, v_type =3D VDIR} (kgdb) print *td $6 =3D {td_lock =3D 0xffffffff81619670, td_proc =3D 0xfffff8006233f4f0, td_= plist =3D {tqe_next =3D 0x0, tqe_prev =3D 0xfffff8006233f500}, td_runq =3D {tqe_next = =3D 0x0, tqe_prev =3D 0xffffffff815e3998}, td_slpq =3D { tqe_next =3D 0xfffff803f7d36960, tqe_prev =3D 0xfffff802836ed030}, td_l= ockq =3D {tqe_next =3D 0x0, tqe_prev =3D 0xfffffe03e44e7908}, td_hash =3D {le_next = =3D 0x0, le_prev =3D 0xfffffe000087aac0}, td_cpuset =3D 0xfffff800083cd3a8,=20 td_sel =3D 0xfffff80039695e00, td_sleepqueue =3D 0x0, td_turnstile =3D 0xfffff8015b0cacc0, td_rlqe =3D 0xfffff80117ffa4d8, td_umtxq =3D 0xfffff802d770a780, td_tid =3D 101720, td_sigqueue =3D {sq_signals =3D {__b= its =3D {0, 0, 0, 0}},=20 sq_kill =3D {__bits =3D {0, 0, 0, 0}}, sq_list =3D {tqh_first =3D 0x0, = tqh_last =3D 0xfffff8033a17e0b8}, sq_proc =3D 0xfffff8006233f4f0, sq_flags =3D 1}, td_lend_user_pri =3D 255 '=C3=BF', td_flags =3D 133124, td_inhibitors =3D 2= ,=20 td_pflags =3D 0, td_dupfd =3D -1, td_sqqueue =3D 0, td_wchan =3D 0xfffff8= 01fd0ea100, td_wmesg =3D 0xffffffff81006e8d "vodead", td_lastcpu =3D 1 '\001', td_oncpu= =3D 255 '=C3=BF', td_owepreempt =3D 0 '\0', td_tsqueue =3D 0 '\0',=20 td_locks =3D 4348, td_rw_rlocks =3D 0, td_lk_slocks =3D 0, td_stopsched = =3D 0, td_blocked =3D 0x0, td_lockname =3D 0x0, td_contested =3D {lh_first =3D 0x0= }, td_sleeplocks =3D 0x0, td_intr_nesting_level =3D 0, td_pinned =3D 0,=20 td_ucred =3D 0xfffff803682bd400, td_estcpu =3D 0, td_slptick =3D 44424458= 4, td_blktick =3D 0, td_swvoltick =3D 444244584, td_cow =3D 39, td_ru =3D {ru_= utime =3D {tv_sec =3D 0, tv_usec =3D 0}, ru_stime =3D {tv_sec =3D 0, tv_usec =3D 0},= =20 ru_maxrss =3D 1656, ru_ixrss =3D 192, ru_idrss =3D 64, ru_isrss =3D 204= 8, ru_minflt =3D 119, ru_majflt =3D 0, ru_nswap =3D 0, ru_inblock =3D 749, ru_oublock = =3D 0, ru_msgsnd =3D 0, ru_msgrcv =3D 0, ru_nsignals =3D 0, ru_nvcsw =3D 739,=20 ru_nivcsw =3D 2}, td_rux =3D {rux_runtime =3D 514120625, rux_uticks =3D= 1, rux_sticks =3D 15, rux_iticks =3D 0, rux_uu =3D 12852, rux_su =3D 192791, r= ux_tu =3D 205644}, td_incruntime =3D 0, td_runtime =3D 514120625, td_pticks =3D 0,=20 td_sticks =3D 0, td_iticks =3D 0, td_uticks =3D 0, td_intrval =3D 0, td_o= ldsigmask =3D {__bits =3D {0, 0, 0, 0}}, td_generation =3D 741, td_sigstk =3D {ss_sp =3D = 0x0, ss_size =3D 0, ss_flags =3D 4}, td_xsig =3D 0, td_profil_addr =3D 0,=20 td_profil_ticks =3D 0, td_name =3D "du", '\0' <repeats 17 times>, td_fpop= =3D 0x0, td_dbgflags =3D 0, td_dbgksi =3D {ksi_link =3D {tqe_next =3D 0x0, tqe_prev = =3D 0x0}, ksi_info =3D {si_signo =3D 0, si_errno =3D 0, si_code =3D 0, si_pid =3D 0,= =20 si_uid =3D 0, si_status =3D 0, si_addr =3D 0x0, si_value =3D {sival_i= nt =3D 0, sival_ptr =3D 0x0, sigval_int =3D 0, sigval_ptr =3D 0x0}, _reason =3D {_fau= lt =3D {_trapno =3D 0}, _timer =3D {_timerid =3D 0, _overrun =3D 0}, _mesgq =3D {_= mqd =3D 0},=20 _poll =3D {_band =3D 0}, __spare__ =3D {__spare1__ =3D 0, __spare2_= _ =3D {0, 0, 0, 0, 0, 0, 0}}}}, ksi_flags =3D 0, ksi_sigq =3D 0x0}, td_ng_outbound =3D 0= , td_osd =3D {osd_nslots =3D 0, osd_slots =3D 0x0, osd_next =3D {le_next =3D 0x0,=20 le_prev =3D 0x0}}, td_map_def_user =3D 0x0, td_dbg_forked =3D 0, td_v= p_reserv =3D 0, td_no_sleeping =3D 0, td_dom_rr_idx =3D 0, td_sigmask =3D {__bits =3D {0= , 0, 0, 0}}, td_rqindex =3D 31 '\037', td_base_pri =3D 120 'x',=20 td_priority =3D 120 'x', td_pri_class =3D 3 '\003', td_user_pri =3D 126 '= ~', td_base_user_pri =3D 126 '~', td_pcb =3D 0xfffffe0466890b80, td_state =3D TDS_INHIBITED, td_retval =3D {0, 1}, td_slpcallout =3D {c_links =3D {le =3D= { le_next =3D 0x0, le_prev =3D 0xfffffe00008d0a10}, sle =3D {sle_next= =3D 0x0}, tqe =3D {tqe_next =3D 0x0, tqe_prev =3D 0xfffffe00008d0a10}}, c_time =3D 20354765951718809, c_precision =3D 268435437, c_arg =3D 0xfffff8033a17e000,= =20 c_func =3D 0xffffffff8099b0d0 <sleepq_timeout>, c_lock =3D 0x0, c_flags= =3D 0, c_iflags =3D 272, c_cpu =3D 2}, td_frame =3D 0xfffffe0466890ac0, td_kstack_= obj =3D 0xfffff803af9b7200, td_kstack =3D 18446741893586407424,=20 td_kstack_pages =3D 4, td_critnest =3D 1, td_md =3D {md_spinlock_count = =3D 1, md_saved_flags =3D 582, md_spurflt_addr =3D 0}, td_sched =3D 0xfffff8033a17= e480, td_ar =3D 0x0, td_lprof =3D {{lh_first =3D 0x0}, {lh_first =3D 0x0}},=20 td_dtrace =3D 0xfffff8037c56e700, td_errno =3D 0, td_vnet =3D 0x0, td_vne= t_lpush =3D 0x0, td_intr_frame =3D 0x0, td_rfppwait_p =3D 0xfffff802656e09e0, td_ma =3D= 0x0, td_ma_cnt =3D 0, td_su =3D 0x0, td_dbg_sc_code =3D 0, td_dbg_sc_narg =3D 0,= =20 td_emuldata =3D 0x0} And another stuck du process: (kgdb) thread 795 [Switching to thread 795 (Thread 101745)]#0 sched_switch (td=3D0xfffff8006f2e84b0, newtd=3D<value optimized out>, flags=3D<value opt= imized out>) at /usr/src/sys/kern/sched_ule.c:1945 1945 cpuid =3D PCPU_GET(cpuid); (kgdb) bt #0 sched_switch (td=3D0xfffff8006f2e84b0, newtd=3D<value optimized out>, flags=3D<value optimized out>) at /usr/src/sys/kern/sched_ule.c:1945 #1 0xffffffff80959ff1 in mi_switch (flags=3D260, newtd=3D0x0) at /usr/src/sys/kern/kern_synch.c:491 #2 0xffffffff8099b31a in sleepq_wait (wchan=3D0x0, pri=3D0) at /usr/src/sys/kern/subr_sleepqueue.c:617 #3 0xffffffff80959a17 in _sleep (ident=3D<value optimized out>, lock=3D<va= lue optimized out>, priority=3D<value optimized out>, wmesg=3D<value optimized = out>, sbt=3D<value optimized out>, pr=3D<value optimized out>,=20 flags=3D<value optimized out>) at /usr/src/sys/kern/kern_synch.c:255 #4 0xffffffff80bed620 in vnode_create_vobject (vp=3D0xfffff801d3e11b10, isize=3D16, td=3D0xfffff8006f2e84b0) at /usr/src/sys/vm/vnode_pager.c:120 #5 0xffffffff81a7d5f5 in zfs_freebsd_open (ap=3D0xfffffe046690d658) at /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/z= fs_vnops.c:6076 #6 0xffffffff80e7e651 in VOP_OPEN_APV (vop=3D<value optimized out>, a=3D<v= alue optimized out>) at vnode_if.c:469 #7 0xffffffff80a05694 in vn_open_vnode (vp=3D0xfffff801d3e11b10, fmode=3D1= 179653, cred=3D0xfffff802f6e2f000, td=3D0xfffff8006f2e84b0, fp=3D0xfffff80104fcc5a0= ) at vnode_if.h:196 #8 0xffffffff80a0528a in vn_open_cred (ndp=3D0xfffffe046690d870, flagp=3D0xfffffe046690d94c, cmode=3D<value optimized out>, vn_open_flags=3D= <value optimized out>, cred=3D0x0, fp=3D0xfffff80104fcc5a0) at /usr/src/sys/kern/vfs_vnops.c:268 #9 0xffffffff809fe44f in kern_openat (td=3D0xfffff8006f2e84b0, fd=3D-100, path=3D0x801422d48 <Error reading address 0x801422d48: Bad address>, pathseg=3DUIO_USERSPACE, flags=3D1179653, mode=3D<value optimized out>) at /usr/src/sys/kern/vfs_syscalls.c:1093 #10 0xffffffff80d55aff in amd64_syscall (td=3D0xfffff8006f2e84b0, traced=3D= 0) at subr_syscall.c:141 #11 0xffffffff80d3ad7b in Xfast_syscall () at /usr/src/sys/amd64/amd64/exception.S:396 #12 0x0000000800b7570a in ?? () Previous frame inner to this frame (corrupt stack?) (kgdb) frame 4 #4 0xffffffff80bed620 in vnode_create_vobject (vp=3D0xfffff801d3e11b10, isize=3D16, td=3D0xfffff8006f2e84b0) at /usr/src/sys/vm/vnode_pager.c:120 120 VM_OBJECT_SLEEP(object, object, PDROP | PVM, "vodea= d", 0); (kgdb) p *vp $7 =3D {v_tag =3D 0xffffffff81aecb3b "zfs", v_op =3D 0xffffffff81aff790, v_= data =3D 0xfffff801a2d1ca10, v_mount =3D 0xfffff8011a46e660, v_nmntvnodes =3D {tqe_n= ext =3D 0xfffff801a53281d8, tqe_prev =3D 0xfffff801a6b8e5a8}, v_un =3D { vu_mount =3D 0x0, vu_socket =3D 0x0, vu_cdev =3D 0x0, vu_fifoinfo =3D 0= x0}, v_hashlist =3D {le_next =3D 0x0, le_prev =3D 0x0}, v_cache_src =3D {lh_firs= t =3D 0xfffff80019708850}, v_cache_dst =3D {tqh_first =3D 0xfffff80257063850,=20 tqh_last =3D 0xfffff80257063870}, v_cache_dd =3D 0xfffff80257063850, v_= lock =3D {lock_object =3D {lo_name =3D 0xffffffff81aecb3b "zfs", lo_flags =3D 117112= 832, lo_data =3D 0, lo_witness =3D 0x0}, lk_lock =3D 1, lk_exslpfail =3D 0,=20 lk_timo =3D 51, lk_pri =3D 96}, v_interlock =3D {lock_object =3D {lo_na= me =3D 0xffffffff80fe1a6c "vnode interlock", lo_flags =3D 16973824, lo_data =3D 0, lo_witness =3D 0x0}, mtx_lock =3D 4}, v_vnlock =3D 0xfffff801d3e11b78,=20 v_actfreelist =3D {tqe_next =3D 0xfffff801a6b8e588, tqe_prev =3D 0xfffff801a5328298}, v_bufobj =3D {bo_lock =3D {lock_object =3D {lo_name =3D 0xffffffff80fe1a7c "bufobj interlock", lo_flags =3D 86179840, lo_data =3D 0, lo_witness =3D 0x0},=20 rw_lock =3D 1}, bo_ops =3D 0xffffffff814b3900, bo_object =3D 0xfffff801fd0ea100, bo_synclist =3D {le_next =3D 0x0, le_prev =3D 0x0}, bo_= private =3D 0xfffff801d3e11b10, __bo_vnode =3D 0xfffff801d3e11b10, bo_clean =3D {bv_hd = =3D { tqh_first =3D 0x0, tqh_last =3D 0xfffff801d3e11c30}, bv_root =3D {p= t_root =3D 0}, bv_cnt =3D 0}, bo_dirty =3D {bv_hd =3D {tqh_first =3D 0x0, tqh_last =3D 0xfffff801d3e11c50}, bv_root =3D {pt_root =3D 0}, bv_cnt =3D 0}, bo_numoutp= ut =3D 0,=20 bo_flag =3D 0, bo_bsize =3D 131072}, v_pollinfo =3D 0x0, v_label =3D 0x= 0, v_lockf =3D 0x0, v_rl =3D {rl_waiters =3D {tqh_first =3D 0x0, tqh_last =3D 0xfffff801d3= e11c98}, rl_currdep =3D 0x0}, v_cstart =3D 0, v_lasta =3D 0, v_lastw =3D 0,=20 v_clen =3D 0, v_holdcnt =3D 127, v_usecount =3D 126, v_iflag =3D 512, v_v= flag =3D 0, v_writecount =3D 0, v_hash =3D 7955980, v_type =3D VDIR} (kgdb) p *td $8 =3D {td_lock =3D 0xffffffff81619670, td_proc =3D 0xfffff80009eb59e0, td_= plist =3D {tqe_next =3D 0x0, tqe_prev =3D 0xfffff80009eb59f0}, td_runq =3D {tqe_next = =3D 0x0, tqe_prev =3D 0xffffffff815e87a8}, td_slpq =3D { tqe_next =3D 0xfffff803cfb27960, tqe_prev =3D 0xfffff8006f2e8990}, td_l= ockq =3D {tqe_next =3D 0x0, tqe_prev =3D 0xfffffe04662f90c8}, td_hash =3D {le_next = =3D 0x0, le_prev =3D 0xfffffe000087ab88}, td_cpuset =3D 0xfffff800083cd3a8,=20 td_sel =3D 0xfffff80290088500, td_sleepqueue =3D 0x0, td_turnstile =3D 0xfffff800b09c4840, td_rlqe =3D 0xfffff8015a73a910, td_umtxq =3D 0xfffff8012d91b280, td_tid =3D 101745, td_sigqueue =3D {sq_signals =3D {__b= its =3D {0, 0, 0, 0}},=20 sq_kill =3D {__bits =3D {0, 0, 0, 0}}, sq_list =3D {tqh_first =3D 0x0, = tqh_last =3D 0xfffff8006f2e8568}, sq_proc =3D 0xfffff80009eb59e0, sq_flags =3D 1}, td_lend_user_pri =3D 255 '=C3=BF', td_flags =3D 133124, td_inhibitors =3D 2= ,=20 td_pflags =3D 0, td_dupfd =3D -1, td_sqqueue =3D 0, td_wchan =3D 0xfffff8= 01fd0ea100, td_wmesg =3D 0xffffffff81006e8d "vodead", td_lastcpu =3D 7 '\a', td_oncpu = =3D 255 '=C3=BF', td_owepreempt =3D 0 '\0', td_tsqueue =3D 0 '\0', td_locks =3D 376= 8,=20 td_rw_rlocks =3D 0, td_lk_slocks =3D 0, td_stopsched =3D 0, td_blocked = =3D 0x0, td_lockname =3D 0x0, td_contested =3D {lh_first =3D 0x0}, td_sleeplocks =3D= 0x0, td_intr_nesting_level =3D 0, td_pinned =3D 0, td_ucred =3D 0xfffff802f6e2f0= 00,=20 td_estcpu =3D 0, td_slptick =3D 729400807, td_blktick =3D 0, td_swvoltick= =3D 729400807, td_cow =3D 41, td_ru =3D {ru_utime =3D {tv_sec =3D 0, tv_usec = =3D 0}, ru_stime =3D {tv_sec =3D 0, tv_usec =3D 0}, ru_maxrss =3D 1696, ru_ixrss =3D 312,=20 ru_idrss =3D 104, ru_isrss =3D 3328, ru_minflt =3D 121, ru_majflt =3D 0= , ru_nswap =3D 0, ru_inblock =3D 840, ru_oublock =3D 0, ru_msgsnd =3D 0, ru_msgrcv =3D 0, = ru_nsignals =3D 0, ru_nvcsw =3D 795, ru_nivcsw =3D 0}, td_rux =3D { rux_runtime =3D 547891773, rux_uticks =3D 1, rux_sticks =3D 25, rux_iti= cks =3D 0, rux_uu =3D 8428, rux_su =3D 210723, rux_tu =3D 219152}, td_incruntime =3D 0= , td_runtime =3D 547891773, td_pticks =3D 0, td_sticks =3D 0, td_iticks =3D 0,=20 td_uticks =3D 0, td_intrval =3D 0, td_oldsigmask =3D {__bits =3D {0, 0, 0= , 0}}, td_generation =3D 795, td_sigstk =3D {ss_sp =3D 0x0, ss_size =3D 0, ss_flag= s =3D 4}, td_xsig =3D 0, td_profil_addr =3D 0, td_profil_ticks =3D 0,=20 td_name =3D "du", '\0' <repeats 17 times>, td_fpop =3D 0x0, td_dbgflags = =3D 0, td_dbgksi =3D {ksi_link =3D {tqe_next =3D 0x0, tqe_prev =3D 0x0}, ksi_info = =3D {si_signo =3D 0, si_errno =3D 0, si_code =3D 0, si_pid =3D 0, si_uid =3D 0,=20 si_status =3D 0, si_addr =3D 0x0, si_value =3D {sival_int =3D 0, siva= l_ptr =3D 0x0, sigval_int =3D 0, sigval_ptr =3D 0x0}, _reason =3D {_fault =3D {_trapno =3D= 0}, _timer =3D {_timerid =3D 0, _overrun =3D 0}, _mesgq =3D {_mqd =3D 0}, _poll =3D { _band =3D 0}, __spare__ =3D {__spare1__ =3D 0, __spare2__ =3D {0,= 0, 0, 0, 0, 0, 0}}}}, ksi_flags =3D 0, ksi_sigq =3D 0x0}, td_ng_outbound =3D 0, td_osd = =3D {osd_nslots =3D 0, osd_slots =3D 0x0, osd_next =3D {le_next =3D 0x0,=20 le_prev =3D 0x0}}, td_map_def_user =3D 0x0, td_dbg_forked =3D 0, td_v= p_reserv =3D 0, td_no_sleeping =3D 0, td_dom_rr_idx =3D 0, td_sigmask =3D {__bits =3D {0= , 0, 0, 0}}, td_rqindex =3D 32 ' ', td_base_pri =3D 120 'x',=20 td_priority =3D 120 'x', td_pri_class =3D 3 '\003', td_user_pri =3D 130 '= \202', td_base_user_pri =3D 130 '\202', td_pcb =3D 0xfffffe046690db80, td_state =3D TDS_INHIBITED, td_retval =3D {0, 1}, td_slpcallout =3D {c_links =3D {le =3D= { le_next =3D 0x0, le_prev =3D 0xfffffe0000ac29b0}, sle =3D {sle_next= =3D 0x0}, tqe =3D {tqe_next =3D 0x0, tqe_prev =3D 0xfffffe0000ac29b0}}, c_time =3D 21579501454196634, c_precision =3D 268435437, c_arg =3D 0xfffff8006f2e84b0,= =20 c_func =3D 0xffffffff8099b0d0 <sleepq_timeout>, c_lock =3D 0x0, c_flags= =3D 0, c_iflags =3D 272, c_cpu =3D 9}, td_frame =3D 0xfffffe046690dac0, td_kstack_= obj =3D 0xfffff80198fc0e00, td_kstack =3D 18446741893586919424,=20 td_kstack_pages =3D 4, td_critnest =3D 1, td_md =3D {md_spinlock_count = =3D 1, md_saved_flags =3D 582, md_spurflt_addr =3D 0}, td_sched =3D 0xfffff8006f2e= 8930, td_ar =3D 0x0, td_lprof =3D {{lh_first =3D 0x0}, {lh_first =3D 0x0}},=20 td_dtrace =3D 0xfffff802a4f1fc00, td_errno =3D 0, td_vnet =3D 0x0, td_vne= t_lpush =3D 0x0, td_intr_frame =3D 0x0, td_rfppwait_p =3D 0xfffff803cb6dd4f0, td_ma =3D= 0x0, td_ma_cnt =3D 0, td_su =3D 0x0, td_dbg_sc_code =3D 0, td_dbg_sc_narg =3D 0,= =20 td_emuldata =3D 0x0} We are replicating this filesystem using incremental ZFS snapshots onto a secondary host (using zrep). I can mount the replicated fs and read the file there without issue. I am currently compiling the latest -STABLE kernel and am scheduling a rebo= ot tonight. --=20 You are receiving this mail because: You are the assignee for the bug.=
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?bug-204764-3630-y8YeWtcELk>