From owner-freebsd-fs@FreeBSD.ORG Fri Oct 17 03:43:10 2014 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 62555CD5; Fri, 17 Oct 2014 03:43:10 +0000 (UTC) Received: from mail.jrv.org (adsl-70-243-84-11.dsl.austtx.swbell.net [70.243.84.11]) by mx1.freebsd.org (Postfix) with ESMTP id 1A65CB08; Fri, 17 Oct 2014 03:43:09 +0000 (UTC) Received: from localhost (localhost.localdomain [127.0.0.1]) by mail.jrv.org (Postfix) with ESMTP id 47A551A336A; Thu, 16 Oct 2014 22:43:08 -0500 (CDT) Received: from mail.jrv.org ([127.0.0.1]) by localhost (zimbra64.housenet.jrv [127.0.0.1]) (amavisd-new, port 10032) with ESMTP id QL_N-UzTu8Zn; Thu, 16 Oct 2014 22:42:58 -0500 (CDT) Received: from localhost (localhost.localdomain [127.0.0.1]) by mail.jrv.org (Postfix) with ESMTP id 5A51B1A3365; Thu, 16 Oct 2014 22:42:58 -0500 (CDT) X-Virus-Scanned: amavisd-new at zimbra64.housenet.jrv Received: from mail.jrv.org ([127.0.0.1]) by localhost (zimbra64.housenet.jrv [127.0.0.1]) (amavisd-new, port 10026) with ESMTP id ssWaWlpx5cuS; Thu, 16 Oct 2014 22:42:58 -0500 (CDT) Received: from [192.168.138.128] (BMX.housenet.jrv [192.168.3.140]) by mail.jrv.org (Postfix) with ESMTPSA id 2EA611A3362; Thu, 16 Oct 2014 22:42:58 -0500 (CDT) Message-ID: <54409050.4070401@jrv.org> Date: Thu, 16 Oct 2014 22:43:12 -0500 From: "James R. Van Artsdalen" User-Agent: Mozilla/5.0 (Windows NT 5.0; rv:12.0) Gecko/20120428 Thunderbird/12.0.1 MIME-Version: 1.0 To: d@delphij.net Subject: Re: zfs recv hangs in kmem arena References: <54250AE9.6070609@jrv.org> <543FAB3C.4090503@jrv.org> <543FEE6F.5050007@delphij.net> In-Reply-To: <543FEE6F.5050007@delphij.net> Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: 7bit Cc: freebsd-fs@freebsd.org, "James R. Van Artsdalen" , current@freebsd.org X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 17 Oct 2014 03:43:10 -0000 On 10/16/2014 11:12 AM, Xin Li wrote: > > On 9/26/2014 1:42 AM, James R. Van Artsdalen wrote: > >> FreeBSD BLACKIE.housenet.jrv 10.1-BETA2 FreeBSD 10.1-BETA2 #2 > >> r272070M: Wed Sep 24 17:36:56 CDT 2014 > >> james@BLACKIE.housenet.jrv:/usr/obj/usr/src/sys/GENERIC amd64 > >> > >> With current STABLE10 I am unable to replicate a ZFS pool using > >> zfs send/recv without zfs hanging in state "kmem arena", within > >> the first 4TB or so (of a 23TB Pool). > What does procstat -kk 1176 (or the PID of your 'zfs' process that > stuck in that state) say? > > Cheers, > SUPERTEX:/root# ps -lp 866 UID PID PPID CPU PRI NI VSZ RSS MWCHAN STAT TT TIME COMMAND 0 866 863 0 52 0 66800 29716 kmem are D+ 1 57:40.82 zfs recv -duvF BIGTOX SUPERTEX:/root# procstat -kk 866 PID TID COMM TDNAME KSTACK 866 101573 zfs - mi_switch+0xe1 sleepq_wait+0x3a _cv_wait+0x16d vmem_xalloc+0x568 vmem_alloc+0x3d kmem_malloc+0x33 keg_alloc_slab+0xcd keg_fetch_slab+0x151 zone_fetch_slab+0x7e zone_import+0x40 uma_zalloc_arg+0x34e arc_get_data_buf+0x31a arc_buf_alloc+0xaa dmu_buf_will_fill+0x169 dmu_write+0xfc dmu_recv_stream+0xd40 zfs_ioc_recv+0x94e zfsdev_ioctl+0x5ca SUPERTEX:/root#