From owner-freebsd-fs@FreeBSD.ORG Wed Oct 6 18:51:53 2010 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 7650D106566B for ; Wed, 6 Oct 2010 18:51:53 +0000 (UTC) (envelope-from gallasch@free.de) Received: from smtp.free.de (smtp.free.de [91.204.6.103]) by mx1.freebsd.org (Postfix) with ESMTP id D324D8FC21 for ; Wed, 6 Oct 2010 18:51:52 +0000 (UTC) Received: (qmail 86282 invoked from network); 6 Oct 2010 20:51:51 +0200 Received: from smtp.free.de (HELO orwell.free.de) ([91.204.4.103]) (envelope-sender ) by smtp.free.de (qmail-ldap-1.03) with AES128-SHA encrypted SMTP for ; 6 Oct 2010 20:51:51 +0200 References: <39F05641-4E46-4BE0-81CA-4DEB175A5FBE@free.de> <201010061732.o96HW2Vi005945@higson.cam.lispworks.com> In-Reply-To: <201010061732.o96HW2Vi005945@higson.cam.lispworks.com> Mime-Version: 1.0 (Apple Message framework v1081) Content-Type: text/plain; charset=us-ascii Message-Id: Content-Transfer-Encoding: quoted-printable From: Kai Gallasch Date: Wed, 6 Oct 2010 20:51:49 +0200 To: freebsd-fs@freebsd.org X-Mailer: Apple Mail (2.1081) Subject: Re: Locked up processes after upgrade to ZFS v15 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 06 Oct 2010 18:51:53 -0000 Am 06.10.2010 um 19:32 schrieb Martin Simmons: >>>>>> On Wed, 6 Oct 2010 14:28:31 +0200, Kai Gallasch said: >>=20 >> How can I debug this and get further information? >=20 > procstat -k -k $pid will generate a backtrace (or replace $pid by -a = for all > processes). procstat for process 12111 (state: zfs) sonnenkraft:~ # procstat -k -k 12111 PID TID COMM TDNAME KSTACK = =20 12111 102385 httpd - mi_switch+0x21b = sleepq_switch+0x123 sleepq_wait+0x4d __lockmgr_args+0x7ae = vop_stdlock+0x39 VOP_LOCK1_APV+0x9b _vn_lock+0x57 vget+0x7b = cache_lookup+0x4e0 vfs_cache_lookup+0xc0 VOP_LOOKUP_APV+0xb7 = lookup+0x3d3 namei+0x457 vn_open_cred+0x1e3 kern_openat+0x181 = syscall+0x102 Xfast_syscall+0xe2 procstat for process 24731 (state: zfsmrb) # procstat -k -k 24731 PID TID COMM TDNAME KSTACK = =20 24731 102273 httpd - mi_switch+0x21b = sleepq_switch+0x123 sleepq_wait+0x4d _sleep+0x369 zfs_freebsd_read+0x2a6 = VOP_READ_APV+0xaf vnode_pager_generic_getpages+0x3ea = VOP_GETPAGES_APV+0xb5 vnode_pager_getpages+0x8c vm_fault+0x685 = trap_pfault+0x128 trap+0x52c calltrap+0x8 In my original post I wrote that only apache httpd processes would lock = up.. This is wrong. Several other non-httpd processes also got stuck in state = zfs or zfsmrb. -Kai.=