From owner-freebsd-fs@FreeBSD.ORG Thu Oct 16 15:25:11 2014 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 79082868 for ; Thu, 16 Oct 2014 15:25:11 +0000 (UTC) Received: from mail-yh0-x23f.google.com (mail-yh0-x23f.google.com [IPv6:2607:f8b0:4002:c01::23f]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 3B15B3EE for ; Thu, 16 Oct 2014 15:25:11 +0000 (UTC) Received: by mail-yh0-f63.google.com with SMTP id b6so486981yha.18 for ; Thu, 16 Oct 2014 08:25:10 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=date:from:to:cc:message-id:in-reply-to:references:subject :mime-version:content-type; bh=7jvGIqjUS/JqJ2m7r+vBiu3UjS+SbwFkb3EI5woAsTo=; b=VGvPcgfDnVVCVVV0yuEXiceolfCXg01XZLffCTfP4wyP3DfyebwxcSQ/H+xIT1kpoI huNPwp0n1cTZHYAly7QZ5B1X3mBDLQ6baKv1V+GYkWgw7WXwjIXlv1eUdat9JfccatzN y9DPCAL6sWhfbxxjktiLWoyriHuwMGsoCwBnW9APczPR98MbkpwnlZJyDht5zUUznwBY 2HMqemsbXAI6nuDf0LyilxuxYS8JpfHHWtQNAey0it8D+rHQUAdqusjwNlemtWdOvNRh gf9EaaAABeo1e/bxgk9ouzYECOtQP4du7nBdkkRMewmKuFm/Yhc22IZzdrbZwsIFkqd8 PQjQ== X-Received: by 10.140.22.239 with SMTP id 102mr30512qgn.1.1413473110345; Thu, 16 Oct 2014 08:25:10 -0700 (PDT) X-Google-Doc-Id: a19511c891300660 X-Google-Web-Client: true Date: Thu, 16 Oct 2014 08:25:09 -0700 (PDT) From: Richard To: zfs-discuss@zfsonlinux.org Message-Id: In-Reply-To: <543D6F65.4090205@kateley.com> References: <543D6F65.4090205@kateley.com> Subject: Re: Open-ZFS Bootcamp MIME-Version: 1.0 X-Google-Token: ENXG_6EF0Xtjzs-EGRI0 X-Google-IP: 84.24.160.143 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit X-Content-Filtered-By: Mailman/MimeDel 2.1.18-1 Cc: freebsd-fs@freebsd.org, zfs@lists.illumos.org, zfs-discuss@solaris-zfs.java.net, iloveosxzfs@gmail.com X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 16 Oct 2014 15:25:11 -0000 Hi, Thanks for this beginners course on ZFS. I ended up watching the whole session and learned some new things. Regards, Richard On Tuesday, October 14, 2014 8:46:01 PM UTC+2, Linda Kateley wrote: > > I just posted an Open-ZFS bootcamp. Thought people might be interested, if > you don't know zfs, give it a try. > > http://kateleyco.com/?page_id=783 > > Linda K > > From owner-freebsd-fs@FreeBSD.ORG Thu Oct 16 16:12:35 2014 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id E39B2B71; Thu, 16 Oct 2014 16:12:34 +0000 (UTC) Received: from anubis.delphij.net (anubis.delphij.net [64.62.153.212]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "anubis.delphij.net", Issuer "StartCom Class 1 Primary Intermediate Server CA" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id C20ABB92; Thu, 16 Oct 2014 16:12:34 +0000 (UTC) Received: from delphij-macbook.home.us.delphij.net (unknown [IPv6:2001:470:83bf:0:5da2:ad7b:ac1d:bf78]) (using TLSv1 with cipher ECDHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by anubis.delphij.net (Postfix) with ESMTPSA id B7168238C9; Thu, 16 Oct 2014 09:12:33 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=delphij.net; s=anubis; t=1413475954; x=1413490354; bh=wxT7FrlsPuEfeqYoRYbXS3edRIvGEGcpjiHDqajHzWQ=; h=Date:From:Reply-To:To:CC:Subject:References:In-Reply-To; b=bSoLNYyLiClWytm3+wGgBMKRWqHtrTgLmihkZepw0OvmyOtdi7qOB7rPzIcO5Z17m MHWJHtD6Exguf+syOCRuyTJbFF+jAiy3Z66ekZ4QOb2SccRQ3y4MhRDIlXUESiAjIm IghvsDp5uIjdtDXTJuyP+eCjwIM+ieyzq7ggmHfE= Message-ID: <543FEE6F.5050007@delphij.net> Date: Thu, 16 Oct 2014 09:12:31 -0700 From: Xin Li Reply-To: d@delphij.net Organization: The FreeBSD Project MIME-Version: 1.0 To: "James R. Van Artsdalen" Subject: Re: zfs recv hangs in kmem arena References: <54250AE9.6070609@jrv.org> <543FAB3C.4090503@jrv.org> In-Reply-To: <543FAB3C.4090503@jrv.org> Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: 7bit Cc: freebsd-fs@freebsd.org, current@freebsd.org X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 16 Oct 2014 16:12:35 -0000 -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA512 On 10/16/14 4:25 AM, James R. Van Artsdalen wrote: > The zfs recv / kmem arena hang happens with -CURRENT as well as > 10-STABLE, on two different systems, with 16GB or 32GB of RAM, > from memstick or normal multi-user environments, > > Hangs usually seem to hapeen 1TB to 3TB in, but last night one run > hung after only 4.35MB. > > On 9/26/2014 1:42 AM, James R. Van Artsdalen wrote: >> FreeBSD BLACKIE.housenet.jrv 10.1-BETA2 FreeBSD 10.1-BETA2 #2 >> r272070M: Wed Sep 24 17:36:56 CDT 2014 >> james@BLACKIE.housenet.jrv:/usr/obj/usr/src/sys/GENERIC amd64 >> >> With current STABLE10 I am unable to replicate a ZFS pool using >> zfs send/recv without zfs hanging in state "kmem arena", within >> the first 4TB or so (of a 23TB Pool). >> >> The most recent attempt used this command line >> >> SUPERTEX:/root# zfs send -R BIGTEX/UNIX@syssnap | ssh BLACKIE zfs >> recv -duvF BIGTOX >> >> though local replications fail in kmem arena too. >> >> The two machines I've been attempting this on have 16BG and 32GB >> of RAM each and are otherwise idle. >> >> Any suggestions on how to get around, or investigate, "kmem >> arena"? >> >> # top last pid: 3272; load averages: 0.22, 0.22, 0.23 >> up 0+08:25:02 01:32:07 34 processes: 1 running, 33 sleeping >> CPU: 0.0% user, 0.0% nice, 0.1% system, 0.0% interrupt, 99.9% >> idle Mem: 21M Active, 82M Inact, 15G Wired, 28M Cache, 450M Free >> ARC: 12G Total, 24M MFU, 12G MRU, 23M Anon, 216M Header, 47M >> Other Swap: 16G Total, 16G Free >> >> PID USERNAME THR PRI NICE SIZE RES STATE C TIME >> WCPU COMMAND 1173 root 1 52 0 86476K 7780K select >> 0 124:33 0.00% sshd 1176 root 1 46 0 87276K 47732K >> kmem a 3 48:36 0.00% zfs 968 root 32 20 0 12344K >> 1888K rpcsvc 0 0:13 0.00% nfsd 1009 root 1 20 0 >> 25452K 2864K select 3 0:01 0.00% ntpd ... What does procstat -kk 1176 (or the PID of your 'zfs' process that stuck in that state) say? Cheers, -----BEGIN PGP SIGNATURE----- iQIcBAEBCgAGBQJUP+5vAAoJEJW2GBstM+ns0v4P/31s7geR2j22etrRnfReUxbb lbex0VkmLGm23TbTj2vpVce+ogBeA4zo6h4WzF/yYt2372MpWOfnEoVX2yOuuGku AFapewXS3UMXLzaRWrdTWng1KQlOyQykAHI2rvQLlYlQNTLA5AbUm6uzNXaKpD8s PbckREQ6wHnpZOiRcMN695QstjBNCal+XJHgvrwTfyp9vdFrPVD4UHnsN7MU6QSO XobxOqbuw4Tq95mgYJqrjk+xEYMgzUy2zkVp2QTCBXZn3T3yroI2RcgUZQWaw5SO xRegPa5jfJqcQJAdSxl8oVs9Sz8+5YDeksAnjCOxIQzLZBbNho+SOAzi+kjnT6W7 ijTc20z5eioQVPekdJ4MBweBsAeS1aGi8VWppuP+ZDLoirmxB0LaZyRv/W/HRQDD j4CoZswkndh+J+9Crsa9SUkfNGNvVVNjhJUGyIfTGFUsMbWTAWwa4SMj7Ad04aqW yhg+Ab4H3Yc14TahtX0jrhD3sTBer6ZoMFKE3tl8aStGXHVMyPkj0PHg5xjZEWL2 XGF86eoIgx03A9sIdbdHEZpyTMksfNatDXZk5XpPGF/sVd6txUoYP4Ch2wD8YRFM O5Ny2r6ash2rZYmlyjf19n4gvKebdGo8d8NbzOJ3oYue6OI/88cu0rv6xLV9hHSF fwgIbPo5uK4hIpEm0Dk4 =qY45 -----END PGP SIGNATURE-----