Date: Thu, 28 Jan 2021 07:23:12 +0000 From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 224292] processes are hanging in state ufs / possible deadlock in file system Message-ID: <bug-224292-3630-GUpvIlGPwz@https.bugs.freebsd.org/bugzilla/> In-Reply-To: <bug-224292-3630@https.bugs.freebsd.org/bugzilla/> References: <bug-224292-3630@https.bugs.freebsd.org/bugzilla/>
next in thread | previous in thread | raw e-mail | index | archive | help
https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D224292 Ali Abdallah <ali.abdallah@suse.com> changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |ali.abdallah@suse.com --- Comment #13 from Ali Abdallah <ali.abdallah@suse.com> --- While upgrading my FreeBSD 13-CURRENT box yesterday, I ran into this issue, when compiling the kernel and then world with -j8, I was ending up always w= ith all the cc processes stuck in biowr and ufs. At the end I've upgraded my box through NFS from my 13-CURRENT server (zfs based). But when upgrading ports from the same server, using pkg upgrade -f, it was also getting stuck with the same symptoms. I've managed to take a kernel du= mp, then booted into single user mode, disabled soft update journaling: (-j), = then booted the system and upgraded my packages, all went ok. Looking at the dump, I see lots of dd processes (launched by pkg I believe), that are in the following state: read 345 (Thread 100752 (PID=3D32594: dd)): #0 sched_switch (td=3D0xfffffe00fdd9be00, flags=3D<optimized out>) at /usr/src/sys/kern/sched_ule.c:2147 #1 0xffffffff803db4be in mi_switch (flags=3Dflags@entry=3D260) at /usr/src/sys/kern/kern_synch.c:542 #2 0xffffffff8042a43d in sleepq_switch (wchan=3Dwchan@entry=3D0x0, pri=3Dpri@entry=3D2122752) at /usr/src/sys/kern/subr_sleepqueue.c:608 #3 0xffffffff8042a327 in sleepq_wait (wchan=3D<unavailable>, pri=3D<unavai= lable>) at /usr/src/sys/kern/subr_sleepqueue.c:659 #4 0xffffffff803a9f7f in sleeplk (lk=3Dlk@entry=3D0xfffff8000535f810, flags=3Dflags@entry=3D2122752, ilk=3D<optimized out>, ilk@entry=3D0xfffff80= 00535f840, wmesg=3D<optimized out>, wmesg@entry=3D0xffffffff806c8ccb "ufs", pri=3D<opt= imized out>, pri@entry=3D96, timo=3Dtimo@entry=3D51, queue=3D1) at /usr/src/sys/kern/kern_lock.c:301 #5 0xffffffff803a88e2 in lockmgr_slock_hard (lk=3D0xfffff8000535f810, flags=3Dflags@entry=3D2122752, ilk=3D0xfffff8000535f840, ilk@entry=3D0xfffffe00fdaff658, file=3D<optimized out>, line=3D<optimized o= ut>, lwa=3Dlwa@entry=3D0x0) at /usr/src/sys/kern/kern_lock.c:696 #6 0xffffffff803a84e8 in lockmgr_lock_flags (lk=3D<optimized out>, lk@entry=3D0xfffff8000535f810, flags=3Dflags@entry=3D2122752, ilk=3Dilk@entry=3D0xfffff8000535f840, file=3D<unavailable>, line=3D<unavail= able>) at /usr/src/sys/kern/kern_lock.c:1056 #7 0xffffffff805c90e5 in ffs_lock (ap=3D0xfffffe00fdaff658, ap@entry=3D<er= ror reading variable: value is not available>) at /usr/src/sys/ufs/ffs/ffs_vnops.c:494 #8 0xffffffff804be098 in VOP_LOCK1 (vp=3D0xfffff8000535f7a0, flags=3D21063= 68, file=3D0xffffffff806fac3e "/usr/src/sys/kern/vfs_lookup.c", line=3D877) at ./vnode_if.h:1096 #9 _vn_lock (vp=3Dvp@entry=3D0xfffff8000535f7a0, flags=3D2106368, file=3D0xffffffff806fac3e "/usr/src/sys/kern/vfs_lookup.c", line=3Dline@ent= ry=3D877) at /usr/src/sys/kern/vfs_vnops.c:1741 #10 0xffffffff80497a18 in lookup (ndp=3Dndp@entry=3D0xfffffe00fdaff970) at /usr/src/sys/kern/vfs_lookup.c:875 #11 0xffffffff804973dd in namei (ndp=3Dndp@entry=3D0xfffffe00fdaff970) at /usr/src/sys/kern/vfs_lookup.c:631 --Type <RET> for more, q to quit, c to continue without paging-- #12 0xffffffff804bd590 in vn_open_cred (ndp=3Dndp@entry=3D0xfffffe00fdaff97= 0, flagp=3D<optimized out>, flagp@entry=3D0xfffffe00fdaffa94, cmode=3D<optimiz= ed out>, vn_open_flags=3Dvn_open_flags@entry=3D0, cred=3D<optimized out>, fp=3D0xfffff80003d49140) at /usr/src/sys/kern/vfs_vnops.c:252 #13 0xffffffff804bd44d in vn_open (ndp=3D<unavailable>, ndp@entry=3D0xfffffe00fdaff970, flagp=3D<unavailable>, flagp@entry=3D0xfffffe00fdaffa94, cmode=3D<unavailable>, fp=3D<unavailable>= ) at /usr/src/sys/kern/vfs_vnops.c:193 #14 0xffffffff804b3723 in kern_openat (td=3D0xfffffe00fdd9be00, fd=3D<optim= ized out>, path=3D<optimized out>, pathseg=3D<optimized out>, flags=3D1539, mode=3D<optimized out>) at /usr/src/sys/kern/vfs_syscalls.c:1143 #15 0xffffffff8068d5cc in syscallenter (td=3D0xfffffe00fdd9be00) at /usr/src/sys/amd64/amd64/../../kern/subr_syscall.c:189 #16 amd64_syscall (td=3D0xfffffe00fdd9be00, traced=3D0) at /usr/src/sys/amd64/amd64/trap.c:1156 I will enable back -j, and kernel deadlocks debugging features, to hopefully get more debugging information. --=20 You are receiving this mail because: You are the assignee for the bug.=
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?bug-224292-3630-GUpvIlGPwz>