Date: Thu, 28 Jan 2021 13:35:03 +0000 From: bugzilla-noreply@freebsd.org To: bugs@FreeBSD.org Subject: [Bug 253063] Hanging zfs processes after upgrade from 12.1 to 12.2-stable Message-ID: <bug-253063-227@https.bugs.freebsd.org/bugzilla/>
index | next in thread | raw e-mail
https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=253063 Bug ID: 253063 Summary: Hanging zfs processes after upgrade from 12.1 to 12.2-stable Product: Base System Version: 12.2-STABLE Hardware: Any OS: Any Status: New Severity: Affects Only Me Priority: --- Component: kern Assignee: bugs@FreeBSD.org Reporter: freebsd-bugs@virtualtec.ch After a recent upgrade from 12.1 to 12.2-stable (stable/12-c1-ge82353f84), several zfs processes hang in different wait channels. This is a system with short of 1000 zfs filesystems, making frequent snapshot based send/receive backups from a primary data pool to a backup pool using znapzend. ps axl | awk '/zfs / { print $9}' | sort | uniq -c 20 rrl->rr_ 28 tq_qdrai 4 tx->tx_s some sample for each: 0 95220 94050 23 28 0 13000 3372 rrl->rr_ D - 0:00.74 zfs recv -F backup1/servi 0 87914 85482 22 25 0 13000 3308 tq_qdrai D - 0:00.55 zfs recv -F backup1/servi 0 77834 77117 3 27 0 13000 2716 tx->tx_s D - 0:00.74 zfs recv -F backup1/servi PID TID COMM TDNAME KSTACK 95220 104268 zfs - mi_switch+0xd4 sleepq_wait+0x2c _cv_wait+0xf2 rrw_enter_read_impl+0x8b zfs_register_callbacks+0x1c6 zfsvfs_setup+0x18 zfs_resume_fs+0xc0 zfs_ioc_recv+0xb53 zfsdev_ioctl+0x62d devfs_ioctl+0xb0 VOP_IOCTL_APV+0x7b vn_ioctl+0x16a devfs_ioctl_f+0x1e kern_ioctl+0x2b7 sys_ioctl+0xfa amd64_syscall+0x387 fast_syscall_common+0xf8 87914 103712 zfs - mi_switch+0xd4 sleepq_wait+0x2c _sleep+0x253 taskqueue_drain_all+0xe1 zfsdev_ioctl+0x7e3 devfs_ioctl+0xb0 VOP_IOCTL_APV+0x7b vn_ioctl+0x16a devfs_ioctl_f+0x1e kern_ioctl+0x2b7 sys_ioctl+0xfa amd64_syscall+0x387 fast_syscall_common+0xf8 77834 104829 zfs - mi_switch+0xd4 sleepq_wait+0x2c _cv_wait+0xf2 txg_wait_synced_impl+0xa9 txg_wait_synced+0xb dsl_sync_task_common+0x230 dsl_sync_task+0x1a dmu_recv_end+0x67 zfs_ioc_recv+0xb3d zfsdev_ioctl+0x62d devfs_ioctl+0xb0 VOP_IOCTL_APV+0x7b vn_ioctl+0x16a devfs_ioctl_f+0x1e kern_ioctl+0x2b7 sys_ioctl+0xfa amd64_syscall+0x387 fast_syscall_common+0xf8 this starts to happen after a couple of hours of uptime, not immediately. I wanted to check my previous 12.1 version, but bectl hangs as well.. These processes are unkillable, and I'll be forced to reboot the system hard, because it won't shut down properly (at least not within reasonable amount of time). -- You are receiving this mail because: You are the assignee for the bug.home | help
Want to link to this message? Use this
URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?bug-253063-227>