Date: Tue, 27 Mar 2012 19:14:57 +0100 From: Tim Bishop <tim-lists@bishnet.net> To: freebsd-fs@freebsd.org Subject: ZFS: processes hanging when trying to access filesystems Message-ID: <20120327181457.GC24787@carrick-users.bishnet.net>
next in thread | raw e-mail | index | archive | help
I have a machine running 8-STABLE amd64 from the end of last week. I have a problem where the machine starts to freeze up. Any process accessing the ZFS filesystems hangs, which eventually causes more and more processes to be spawned (cronjobs, etc, never complete). Although the root filesystem is on UFS (the machine hosts jails on ZFS), eventually I can't log in anymore. The problem occurs when the frequently used part of the ARC gets too large. See this graph: http://dl.dropbox.com/u/318044/zfs_arc_utilization-day.png At the right of the graph things started to hang. At the same time I see a high amount of context switching. I picked a hanging process and procstat showed the following: PID TID COMM TDNAME KSTACK 24787 100303 mutt - mi_switch+0x176 sleepq_wait+0x42 _cv_wait+0x129 txg_wait_open+0x85 dmu_tx_assign+0x170 zfs_inactive+0xf1 zfs_freebsd_inactive+0x1a vinactive+0x71 vputx+0x2d8 null_reclaim+0xb3 vgonel+0x119 vrecycle+0x7b null_inactive+0x1f vinactive+0x71 vputx+0x2d8 vn_close+0xa1 vn_closefile+0x5a _fdrop+0x23 I'm running a reduced amount of jails on the machine at the moment which is limiting the speed at which the machine freezes up completely. I'd like to debug this problem further, so any advice on useful information to collect would be appreciated. I've had this problem on the machine before[1] but adding more RAM allievated the issue. Tim. [1] http://lists.freebsd.org/pipermail/freebsd-stable/2010-September/058541.html -- Tim Bishop http://www.bishnet.net/tim/ PGP Key: 0x5AE7D984
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?20120327181457.GC24787>