From owner-freebsd-fs@FreeBSD.ORG Sat Jan 26 01:30:01 2013 Return-Path: Delivered-To: freebsd-fs@smarthost.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.FreeBSD.org [8.8.178.115]) by hub.freebsd.org (Postfix) with ESMTP id 823212F6 for ; Sat, 26 Jan 2013 01:30:01 +0000 (UTC) (envelope-from gnats@FreeBSD.org) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2001:1900:2254:206c::16:87]) by mx1.freebsd.org (Postfix) with ESMTP id 758A8731 for ; Sat, 26 Jan 2013 01:30:01 +0000 (UTC) Received: from freefall.freebsd.org (localhost [127.0.0.1]) by freefall.freebsd.org (8.14.6/8.14.6) with ESMTP id r0Q1U1Om033349 for ; Sat, 26 Jan 2013 01:30:01 GMT (envelope-from gnats@freefall.freebsd.org) Received: (from gnats@localhost) by freefall.freebsd.org (8.14.6/8.14.6/Submit) id r0Q1U1QA033345; Sat, 26 Jan 2013 01:30:01 GMT (envelope-from gnats) Date: Sat, 26 Jan 2013 01:30:01 GMT Message-Id: <201301260130.r0Q1U1QA033345@freefall.freebsd.org> To: freebsd-fs@FreeBSD.org Cc: From: Harry Coin Subject: Re: kern/169480: [zfs] ZFS stalls on heavy I/O X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list Reply-To: Harry Coin List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 26 Jan 2013 01:30:01 -0000 The following reply was made to PR kern/169480; it has been noted by GNATS. From: Harry Coin To: bug-followup@FreeBSD.org, levent.serinol@mynet.com Cc: Subject: Re: kern/169480: [zfs] ZFS stalls on heavy I/O Date: Fri, 25 Jan 2013 19:26:10 -0600 I think I have an easier way to reproduce this problem on a very simple setup: Boot a 'nas4free' livecd version 573 (freebsd 9.1.0.1). Mount one zpool with no dedup, simple raidz 4 drive setup, 4GB memory. Don't enable any of the various features, just get a shell from the live cd prompt. Use dd to make a 20GB file on the pool writing from /dev/random. While that's going, go to another virtual console cd to the pool, and do an ls -l. It won't return. Of interest, long before wired memory explodes to the limit, ls not returning while dd is running, 'top' on another shell reports this: 99.7% idle, 2.6gb free ram, dd in tx->tx, zfskern in zio->i, and intr in WAIT Eventually disk activity as shown by the cheery little flickering lamp slows, then stops. Characters still echo on the ls -l command that hasn't returned, but no others. alt-tab strangely still works. The only way out is to power cycle the box. Details here: http://forums.nas4free.org/viewtopic.php?p=12519#p12519 Feels like completed io's are getting lost and the system just waits and waits until there are no more resources left to issue new commands or too many threads are locked waiting for what will never return. Harry