From owner-freebsd-current@FreeBSD.ORG Fri Jan 4 18:28:41 2013 Return-Path: Delivered-To: freebsd-current@freebsd.org Received: from mx1.freebsd.org (mx1.FreeBSD.org [8.8.178.115]) by hub.freebsd.org (Postfix) with ESMTP id 2EF58FFF for ; Fri, 4 Jan 2013 18:28:41 +0000 (UTC) (envelope-from freebsd-listen@fabiankeil.de) Received: from smtprelay02.ispgateway.de (smtprelay02.ispgateway.de [80.67.18.44]) by mx1.freebsd.org (Postfix) with ESMTP id BB03915D for ; Fri, 4 Jan 2013 18:28:40 +0000 (UTC) Received: from [78.35.174.75] (helo=fabiankeil.de) by smtprelay02.ispgateway.de with esmtpsa (SSLv3:AES128-SHA:128) (Exim 4.68) (envelope-from ) id 1TrC0O-0002KS-RY for freebsd-current@freebsd.org; Fri, 04 Jan 2013 19:28:32 +0100 Date: Fri, 4 Jan 2013 19:28:16 +0100 From: Fabian Keil To: freebsd-current@freebsd.org Subject: Re: ZFS/RAIDZ and SAMBA: abyssimal performance Message-ID: <20130104192816.560f5bf6@fabiankeil.de> In-Reply-To: <23BF8538-FB5A-4432-A4E1-721B5F566CA2@my.gd> References: <50E6DE91.7010404@zedat.fu-berlin.de> <1ADC2ECB-70FF-4DDD-9D62-16E2EEECDD8B@my.gd> <50E6F2FC.3060903@zedat.fu-berlin.de> <23BF8538-FB5A-4432-A4E1-721B5F566CA2@my.gd> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=PGP-SHA1; boundary="Sig_/YHk9yyAq5=oq4ZJM6O=gADJ"; protocol="application/pgp-signature" X-Df-Sender: Nzc1MDY3 X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 04 Jan 2013 18:28:41 -0000 --Sig_/YHk9yyAq5=oq4ZJM6O=gADJ Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: quoted-printable Fleuriot Damien wrote: >=20 > On Jan 4, 2013, at 4:19 PM, O. Hartmann wro= te: >=20 > > Am 01/04/13 15:45, schrieb Garrett Cooper: > >> On Fri, Jan 4, 2013 at 6:06 AM, Fleuriot Damien wrote: > >>=20 > >> ... > >>=20 > >>> And this is under [global] in /usr/local/etc/smb.conf: > >>> min receivefile size =3D 16384 > >>> aio read size =3D 16384 > >>> aio write size =3D 16384 > >>> aio write behind =3D yes > >>=20 > >> These are still pretty low, depending on what your networking/disk > >> setup is like; my important performance settings are: > >>=20 > >> socket options =3D SO_RCVBUF=3D64240 SO_SNDBUF=3D64240 TCP_NODE= LAY > >> IPTOS_LOWDELAY IPTOS_THROUGHPUT > >> write cache size =3D 65536 > >> aio read size =3D 65536 > >> aio write size =3D 65536 > >> directory name cache size =3D 0 > > Well, now I have peak values ~ 120 MB/s when copying. I applied Fleuriot > > Damien's values to /boot/loader.conf and yours to the smb.conf. > > Somewhere in the handbook this should be documented! it is to much > > efford to get SAMBA working properly with ZFS, if the tricks and > > problems are so widespread over several architectural aspects of the sy= stem. > >=20 > > It could save a lot of time for adminsitartors and those which try > > FreeBSD as a serving system instead of Linux. > >=20 > > Just for the record. I feel a bit confused about all the tricks and > > tweak now "published" for ZFS, its magic L2ARC, the kernel_vmem wizzardy > > thingis. The ZFS Wiki seems to be a bit outdated and confusing, it would > > be a great deal if all these things could be lined up a s a primer with > > a bit more explanations than "put this number there". > The problem, Oliver, is that these values are system dependant. While I agree that the values are system dependant the purpose of the tunables could still be documented together with a description of how to properly test that they have any effect at all and that it's an improvement compared to the defaults. Scarce ZFS tuning documentation is also a problem upstream which probably doesn't help. Fabian --Sig_/YHk9yyAq5=oq4ZJM6O=gADJ Content-Type: application/pgp-signature; name=signature.asc Content-Disposition: attachment; filename=signature.asc -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.19 (FreeBSD) iEYEARECAAYFAlDnH04ACgkQBYqIVf93VJ1hgwCggdVXWRVaoZe0OM9MzxTjW5pW MhEAn0UzjXYE07C+3pzigW+dTO+i11Yv =fAK9 -----END PGP SIGNATURE----- --Sig_/YHk9yyAq5=oq4ZJM6O=gADJ--