Skip site navigation (1)Skip section navigation (2)
Date:      Thu, 30 Jul 2015 15:18:40 +0300
From:      Konstantin Belousov <kostikbel@gmail.com>
To:        Lev Serebryakov <lev@FreeBSD.org>
Cc:        freebsd-fs@freebsd.org
Subject:   Re: ZFS on 10-STABLE r281159: programs, accessing ZFS pauses for minutes in state [*kmem arena]
Message-ID:  <20150730121840.GS2072@kib.kiev.ua>
In-Reply-To: <164833736.20150730143008@serebryakov.spb.ru>
References:  <164833736.20150730143008@serebryakov.spb.ru>

next in thread | previous in thread | raw e-mail | index | archive | help
On Thu, Jul 30, 2015 at 02:30:08PM +0300, Lev Serebryakov wrote:
> Hello Freebsd-fs,
> 
> 
>   I'm migrating my NAS from geom_raid5 + UFS to ZFS raidz. My main storage
> is 5x2Tb HDDs. Additionaly, I have 2x3Tb HDDs attached to hold my data when
> I re-make my main storage.
> 
>  So, I have now two ZFS pools:
> 
> ztemp mirror ada0 ada1 [both are 3Tb HDDS]
> zstor raidz ada3 ada4 ada5 ada6 ada7 [all of them are 2Tb]
> 
>  ztemp contain one filesystem with 2.1Tb of my data. ztemp was populated
>  with my data from old geom_raid5 + UFS installation via "rsync" and it was
>  FAST (HDD-speed).
> 
>  zstor contains several empty file systems (one per user), like:
> 
> zstor/home/lev
> zstor/home/sveta
> zstor/home/nsvn
> zstor/home/torrents
> zstor/home/storage
> 
>  Deduplication IS TURNED OFF. atime is turned off. Record size set to 1M as
> I have a lot of big files (movies, RAW photo from DSLR, etc). Compression is
> turned off.
> 
>  When I try to copy all my data from temporary HDDs (ztemp pool) to my new
> shiny RIAD (zstor pool) with
> 
> cd /ztemp/fs && rsync -avH lev sveta nsvn storage /usr/home/
> 
>  rsync pauses for tens of minutes (!) after several hundreds of files. ^T
> and top shows state "[*kmem arena]". When I stop rsync with ^C and try to do
> "zfs list" it waits forever, in state "[*kmem arena]" again.
Show the output of sysctl debug.vmem_check.

> 
>  This server is equipped with 6GiB of RAM.
> 
>  It looks FreeBSD contains bug about year ago which leads to this behavior,
> but mailing lists says, that it was fixed in r272221, 10 months ago.
> 
> -- 
> Best regards,
>  Lev                          mailto:lev@FreeBSD.org
> 
> _______________________________________________
> freebsd-fs@freebsd.org mailing list
> http://lists.freebsd.org/mailman/listinfo/freebsd-fs
> To unsubscribe, send any mail to "freebsd-fs-unsubscribe@freebsd.org"



Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?20150730121840.GS2072>