From owner-freebsd-current@freebsd.org Sun Oct 2 19:25:13 2016 Return-Path: Delivered-To: freebsd-current@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 30D1CAF1CAC for ; Sun, 2 Oct 2016 19:25:13 +0000 (UTC) (envelope-from ohartman@zedat.fu-berlin.de) Received: from outpost1.zedat.fu-berlin.de (outpost1.zedat.fu-berlin.de [130.133.4.66]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id E83A2C20 for ; Sun, 2 Oct 2016 19:25:12 +0000 (UTC) (envelope-from ohartman@zedat.fu-berlin.de) Received: from inpost2.zedat.fu-berlin.de ([130.133.4.69]) by outpost.zedat.fu-berlin.de (Exim 4.85) for freebsd-current@freebsd.org with esmtps (TLSv1.2:DHE-RSA-AES256-GCM-SHA384:256) (envelope-from ) id <1bqmNq-002NWi-DI>; Sun, 02 Oct 2016 21:25:10 +0200 Received: from x55b386b3.dyn.telefonica.de ([85.179.134.179] helo=thor.walstatt.dynvpn.de) by inpost2.zedat.fu-berlin.de (Exim 4.85) for freebsd-current@freebsd.org with esmtpsa (TLSv1.2:AES256-GCM-SHA384:256) (envelope-from ) id <1bqmNq-002d79-39>; Sun, 02 Oct 2016 21:25:10 +0200 Date: Sun, 2 Oct 2016 21:25:04 +0200 From: "O. Hartmann" To: FreeBSD CURRENT Subject: ZFS - Abyssal slow on copying Message-ID: <20161002212504.2d782002.ohartman@zedat.fu-berlin.de> Organization: FU Berlin X-Mailer: Claws Mail 3.14.0 (GTK+ 2.24.29; amd64-portbld-freebsd12.0) MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha256; boundary="Sig_/c95QN/d2z8owdNRCc0aIWp5"; protocol="application/pgp-signature" X-Originating-IP: 85.179.134.179 X-ZEDAT-Hint: A X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 02 Oct 2016 19:25:13 -0000 --Sig_/c95QN/d2z8owdNRCc0aIWp5 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: quoted-printable Running 12-CURRENT (FreeBSD 12.0-CURRENT #32 r306579: Sun Oct 2 09:34:50 C= EST 2016 ), I have a NanoBSD setup which creates an image for a router device. The problem I face is related to ZFS. The system has a system's SSD (Samsun= g 850 Pro, 256GB) which has an UFS filesystem. Aditionally, I have also a backup and a= data HDD, both WD, one 3 TB WD RED Pro, on 4 TB WD RED (the backup device). Both the = sources for the NanoBSD and the object tree as well as the NANO_WORLDDIR are residing o= n the 3 TB data drive.=20 The box itself has 8 GB RAM. When it comes to create the memory disk, which= is ~ 1,3 GB in size, the NanoBSD script starts creating the memory disk and then instal= ling world into this memory disk. And this part is a kind of abyssal in terms of the s= peed. The drive sounds like hell, the heads are moving rapidly. The copy speed is= incredibly slow compared to another box I usually use in the lab with UFS filesystem o= nly (different type of HDD). The whole stuff the nanbsd is installed from and to is on a separate ZFS pa= rtition, but in the same pool as everything else. When I first setup the new partitions,= I switched on deduplication, but I quickly deactivated it, because it had a tremendous im= pact on the working speed and memory consumption on that box. But something seems not r= ight since then - as I initially described, the copy/initialisation speed/bandwith is = abyssal. Well, I also fear that I did something wrong when I firt initialised the HDD - th= ere is this 125bytes/4k block discussion and I do not know how to check whether I'm aff= ected to that or not (or even causing the problems) and how to check whether DEDUPLICATIO= N is definitely OFF (apart from the usual stuff list features via "zfs get all"). As an example: the nanbosd script takes ~ 1 minute to copy /boot/loader fro= m source to memory disk and the HDD makes sounds like hell and close to loosing the r/w= heads. On other boxes this task is done in a blink of an eye ... Thanks for your patience, Regards, oh --Sig_/c95QN/d2z8owdNRCc0aIWp5 Content-Type: application/pgp-signature Content-Description: OpenPGP digital signature -----BEGIN PGP SIGNATURE----- Version: GnuPG v2 iQEcBAEBCAAGBQJX8V8QAAoJEOgBcD7A/5N87TkIAJFFJQ+zdXjtmSXuY5G99b6l 6vcjyehU0gBOdpqhHdpVuzmJ5lg3Bt7RLndYhxkde1nDK3z+QOAAaqPIwBE4B2I+ 0pkWn14ZRta7ptRV9pwUDxi9OvrG9W4HmnP2jQSRddeTQ0HxxYHD/Zp6gTA8Ys7m 2YH2iOwAIM1LN2j5Bf0N4oV5NW1g3d+Y980egNkoUkhwPtoSE4MJlcZX/9t9uPdo BTHb/asCdtnxzp2jx1UJWVtUnO9PoLDggZFWbM3tax1+LC0E82nddwamno2w9PeT eadzKoNFh0l5HCEB9gAbZ4o41BC5v++3Qr+10uGe1Ma7znmCFcb0pOHJS+VBCos= =r9Na -----END PGP SIGNATURE----- --Sig_/c95QN/d2z8owdNRCc0aIWp5--