From owner-freebsd-fs@freebsd.org Thu Jul 30 12:18:48 2015 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id EEC999AD4A7 for ; Thu, 30 Jul 2015 12:18:48 +0000 (UTC) (envelope-from kostikbel@gmail.com) Received: from kib.kiev.ua (kib.kiev.ua [IPv6:2001:470:d5e7:1::1]) (using TLSv1 with cipher DHE-RSA-CAMELLIA256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 6432AAFF; Thu, 30 Jul 2015 12:18:48 +0000 (UTC) (envelope-from kostikbel@gmail.com) Received: from tom.home (kostik@localhost [127.0.0.1]) by kib.kiev.ua (8.15.2/8.15.2) with ESMTPS id t6UCIeKu095846 (version=TLSv1 cipher=DHE-RSA-CAMELLIA256-SHA bits=256 verify=NO); Thu, 30 Jul 2015 15:18:40 +0300 (EEST) (envelope-from kostikbel@gmail.com) DKIM-Filter: OpenDKIM Filter v2.9.2 kib.kiev.ua t6UCIeKu095846 Received: (from kostik@localhost) by tom.home (8.15.2/8.15.2/Submit) id t6UCIeNZ095845; Thu, 30 Jul 2015 15:18:40 +0300 (EEST) (envelope-from kostikbel@gmail.com) X-Authentication-Warning: tom.home: kostik set sender to kostikbel@gmail.com using -f Date: Thu, 30 Jul 2015 15:18:40 +0300 From: Konstantin Belousov To: Lev Serebryakov Cc: freebsd-fs@freebsd.org Subject: Re: ZFS on 10-STABLE r281159: programs, accessing ZFS pauses for minutes in state [*kmem arena] Message-ID: <20150730121840.GS2072@kib.kiev.ua> References: <164833736.20150730143008@serebryakov.spb.ru> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <164833736.20150730143008@serebryakov.spb.ru> User-Agent: Mutt/1.5.23 (2014-03-12) X-Spam-Status: No, score=-2.0 required=5.0 tests=ALL_TRUSTED,BAYES_00, DKIM_ADSP_CUSTOM_MED,FREEMAIL_FROM,NML_ADSP_CUSTOM_MED autolearn=no autolearn_force=no version=3.4.1 X-Spam-Checker-Version: SpamAssassin 3.4.1 (2015-04-28) on tom.home X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 30 Jul 2015 12:18:49 -0000 On Thu, Jul 30, 2015 at 02:30:08PM +0300, Lev Serebryakov wrote: > Hello Freebsd-fs, > > > I'm migrating my NAS from geom_raid5 + UFS to ZFS raidz. My main storage > is 5x2Tb HDDs. Additionaly, I have 2x3Tb HDDs attached to hold my data when > I re-make my main storage. > > So, I have now two ZFS pools: > > ztemp mirror ada0 ada1 [both are 3Tb HDDS] > zstor raidz ada3 ada4 ada5 ada6 ada7 [all of them are 2Tb] > > ztemp contain one filesystem with 2.1Tb of my data. ztemp was populated > with my data from old geom_raid5 + UFS installation via "rsync" and it was > FAST (HDD-speed). > > zstor contains several empty file systems (one per user), like: > > zstor/home/lev > zstor/home/sveta > zstor/home/nsvn > zstor/home/torrents > zstor/home/storage > > Deduplication IS TURNED OFF. atime is turned off. Record size set to 1M as > I have a lot of big files (movies, RAW photo from DSLR, etc). Compression is > turned off. > > When I try to copy all my data from temporary HDDs (ztemp pool) to my new > shiny RIAD (zstor pool) with > > cd /ztemp/fs && rsync -avH lev sveta nsvn storage /usr/home/ > > rsync pauses for tens of minutes (!) after several hundreds of files. ^T > and top shows state "[*kmem arena]". When I stop rsync with ^C and try to do > "zfs list" it waits forever, in state "[*kmem arena]" again. Show the output of sysctl debug.vmem_check. > > This server is equipped with 6GiB of RAM. > > It looks FreeBSD contains bug about year ago which leads to this behavior, > but mailing lists says, that it was fixed in r272221, 10 months ago. > > -- > Best regards, > Lev mailto:lev@FreeBSD.org > > _______________________________________________ > freebsd-fs@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-fs > To unsubscribe, send any mail to "freebsd-fs-unsubscribe@freebsd.org"