From owner-freebsd-current@FreeBSD.ORG Fri Jan 4 20:39:17 2013 Return-Path: Delivered-To: freebsd-current@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by hub.freebsd.org (Postfix) with ESMTP id 5A7252C3 for ; Fri, 4 Jan 2013 20:39:17 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) Received: from esa-annu.net.uoguelph.ca (esa-annu.mail.uoguelph.ca [131.104.91.36]) by mx1.freebsd.org (Postfix) with ESMTP id 24207812 for ; Fri, 4 Jan 2013 20:39:16 +0000 (UTC) X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: Ap8EABk951CDaFvO/2dsb2JhbABFhjm3KnOCHgEBBAEjVgUWDgoCAg0ZAlkGE4gOBqQ3j0KBIo5ggRMDiGGNKpBJgxKCCA X-IronPort-AV: E=Sophos;i="4.84,412,1355115600"; d="scan'208";a="7515925" Received: from erie.cs.uoguelph.ca (HELO zcs3.mail.uoguelph.ca) ([131.104.91.206]) by esa-annu.net.uoguelph.ca with ESMTP; 04 Jan 2013 15:39:15 -0500 Received: from zcs3.mail.uoguelph.ca (localhost.localdomain [127.0.0.1]) by zcs3.mail.uoguelph.ca (Postfix) with ESMTP id 144A0B3EE1; Fri, 4 Jan 2013 15:39:15 -0500 (EST) Date: Fri, 4 Jan 2013 15:39:15 -0500 (EST) From: Rick Macklem To: Fabian Keil Message-ID: <157811899.1684695.1357331955066.JavaMail.root@erie.cs.uoguelph.ca> In-Reply-To: <20130104192816.560f5bf6@fabiankeil.de> Subject: Re: ZFS/RAIDZ and SAMBA: abyssimal performance MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [172.17.91.202] X-Mailer: Zimbra 6.0.10_GA_2692 (ZimbraWebClient - FF3.0 (Win)/6.0.10_GA_2692) Cc: freebsd-current@freebsd.org X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 04 Jan 2013 20:39:17 -0000 Fabian Keil wrote: > Fleuriot Damien wrote: > > > > > On Jan 4, 2013, at 4:19 PM, O. Hartmann > > wrote: > > > > > Am 01/04/13 15:45, schrieb Garrett Cooper: > > >> On Fri, Jan 4, 2013 at 6:06 AM, Fleuriot Damien wrote: > > >> > > >> ... > > >> > > >>> And this is under [global] in /usr/local/etc/smb.conf: > > >>> min receivefile size = 16384 > > >>> aio read size = 16384 > > >>> aio write size = 16384 > > >>> aio write behind = yes > > >> > > >> These are still pretty low, depending on what your > > >> networking/disk > > >> setup is like; my important performance settings are: > > >> > > >> socket options = SO_RCVBUF=64240 SO_SNDBUF=64240 > > >> TCP_NODELAY > > >> IPTOS_LOWDELAY IPTOS_THROUGHPUT > > >> write cache size = 65536 > > >> aio read size = 65536 > > >> aio write size = 65536 > > >> directory name cache size = 0 > > > > Well, now I have peak values ~ 120 MB/s when copying. I applied > > > Fleuriot > > > Damien's values to /boot/loader.conf and yours to the smb.conf. > > > Somewhere in the handbook this should be documented! it is to much > > > efford to get SAMBA working properly with ZFS, if the tricks and > > > problems are so widespread over several architectural aspects of > > > the system. > > > > > > It could save a lot of time for adminsitartors and those which try > > > FreeBSD as a serving system instead of Linux. > > > > > > Just for the record. I feel a bit confused about all the tricks > > > and > > > tweak now "published" for ZFS, its magic L2ARC, the kernel_vmem > > > wizzardy > > > thingis. The ZFS Wiki seems to be a bit outdated and confusing, it > > > would > > > be a great deal if all these things could be lined up a s a primer > > > with > > > a bit more explanations than "put this number there". > > > The problem, Oliver, is that these values are system dependant. > > While I agree that the values are system dependant the purpose of > the tunables could still be documented together with a description > of how to properly test that they have any effect at all and that > it's an improvement compared to the defaults. > What about capturing a few examples, like this one for a system with 16Gb of Ram. Basically cases of: - this is my hardware config and here's what works well for me It's pretty easy for people to choose the example closest to their setup as a starting point. Then urls to where the docs are, so people can read/fine tune from there? rick rick > Scarce ZFS tuning documentation is also a problem upstream which > probably doesn't help. > > Fabian