From owner-freebsd-current@FreeBSD.ORG Fri Jan 4 18:10:32 2013 Return-Path: Delivered-To: freebsd-current@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by hub.freebsd.org (Postfix) with ESMTP id 38504A3C for ; Fri, 4 Jan 2013 18:10:32 +0000 (UTC) (envelope-from joh.hendriks@gmail.com) Received: from mail-bk0-f51.google.com (mail-bk0-f51.google.com [209.85.214.51]) by mx1.freebsd.org (Postfix) with ESMTP id C1274B9 for ; Fri, 4 Jan 2013 18:10:31 +0000 (UTC) Received: by mail-bk0-f51.google.com with SMTP id ik5so7333730bkc.24 for ; Fri, 04 Jan 2013 10:10:25 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=x-received:message-id:date:from:user-agent:mime-version:to:subject :references:in-reply-to:content-type:content-transfer-encoding; bh=Tpx/Q0jbqcelkDfyKzB0/cbEQWNS1RJHTX+sK4+CWCs=; b=k6cDS5KjKZ4s7sxaevRm3PtqdmHLY6UIX9Mgso3dZ6ddeibjcKXGZ7Abw2v1tCuuPW 4vIOXRi+1zsJ64kYlyccTjgNyqi022+4H+PlHOovx2svoO5HzXz5hbz7XFlN7MLz8jSU 7WX6M7VnsVwnrAnz8lN4XcmFwD4mbEKFPwqVGuXzlZU9Cqu6X84RmzD15bWF5C+LZLFa WbUuDM3evBtRREdt6BQiY+1qnf7yrepKoH0E0gz+bUpiaG/JTSvrWiSN4/WKR4yMsaJ/ dwlWFSs3Q591vhKNGFsKEk8NDEjPY1tE3M7wwKKDIV3XtYrhJQiydnGicedrHqQJRxTz fNmw== X-Received: by 10.204.9.3 with SMTP id j3mr25600754bkj.134.1357323025267; Fri, 04 Jan 2013 10:10:25 -0800 (PST) Received: from [192.168.1.15] (5ED0E470.cm-7-1d.dynamic.ziggo.nl. [94.208.228.112]) by mx.google.com with ESMTPS id hm8sm37532273bkc.10.2013.01.04.10.10.23 (version=SSLv3 cipher=OTHER); Fri, 04 Jan 2013 10:10:24 -0800 (PST) Message-ID: <50E71B0D.602@gmail.com> Date: Fri, 04 Jan 2013 19:10:21 +0100 From: Johan Hendriks User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:17.0) Gecko/17.0 Thunderbird/17.0 MIME-Version: 1.0 To: FreeBSD Subject: Re: ZFS/RAIDZ and SAMBA: abyssimal performance References: <50E6DE91.7010404@zedat.fu-berlin.de> <1ADC2ECB-70FF-4DDD-9D62-16E2EEECDD8B@my.gd> <50E6F2FC.3060903@zedat.fu-berlin.de> <23BF8538-FB5A-4432-A4E1-721B5F566CA2@my.gd> In-Reply-To: <23BF8538-FB5A-4432-A4E1-721B5F566CA2@my.gd> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 04 Jan 2013 18:10:32 -0000 Fleuriot Damien schreef: > On Jan 4, 2013, at 4:19 PM, O. Hartmann wrote: > >> Am 01/04/13 15:45, schrieb Garrett Cooper: >>> On Fri, Jan 4, 2013 at 6:06 AM, Fleuriot Damien wrote: >>> >>> ... >>> >>>> And this is under [global] in /usr/local/etc/smb.conf: >>>> min receivefile size = 16384 >>>> aio read size = 16384 >>>> aio write size = 16384 >>>> aio write behind = yes >>> These are still pretty low, depending on what your networking/disk >>> setup is like; my important performance settings are: >>> >>> socket options = SO_RCVBUF=64240 SO_SNDBUF=64240 TCP_NODELAY >>> IPTOS_LOWDELAY IPTOS_THROUGHPUT >>> write cache size = 65536 >>> aio read size = 65536 >>> aio write size = 65536 >>> directory name cache size = 0 >>> >>> HTH, >>> -Garrett >> Well, now I have peak values ~ 120 MB/s when copying. I applied Fleuriot >> Damien's values to /boot/loader.conf and yours to the smb.conf. >> Somewhere in the handbook this should be documented! it is to much >> efford to get SAMBA working properly with ZFS, if the tricks and >> problems are so widespread over several architectural aspects of the system. >> >> It could save a lot of time for adminsitartors and those which try >> FreeBSD as a serving system instead of Linux. >> >> Just for the record. I feel a bit confused about all the tricks and >> tweak now "published" for ZFS, its magic L2ARC, the kernel_vmem wizzardy >> thingis. The ZFS Wiki seems to be a bit outdated and confusing, it would >> be a great deal if all these things could be lined up a s a primer with >> a bit more explanations than "put this number there". >> >> And by the way, it is like changing from hell to heaven having now ~ 100 >> MB/s throughput compared to ~1/500! >> >> Thanks a lot, >> Oliver >> > > The problem, Oliver, is that these values are system dependant. > > Notice how Garret replied that these values are a bit low (and they might be indeed !). > > However, while you have 16gb RAM, my ZFS NAS only has 4gb. > > > > Basically and as Jeremy Chadwick pointed out at the time, there is no one set of correct values for 100% of the population. > > One has to adjust them step by step and decide what is best for them. > > > > @garret: I'll try with the values you posted, although I get 90-120mbytes/s most of the time so I pretty much saturate my 1gbs link. > > _______________________________________________ > freebsd-current@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-current > To unsubscribe, send any mail to "freebsd-current-unsubscribe@freebsd.org" The only zfs tunable i use in my /boot/loader.conf is vfs.zfs.arc_max= I leave 4 GB for the system itself in most cases. In my smb.conf i use the following socket options = TCP_NODELAY SO_RCVBUF=131072 SO_SNDBUF=131072 max protocol = SMB2 But if you set that then you can not use the aio settings as samba will crash then. if you use aio also make sure you load the aio module by setting the following in the /boot/loader.conf aio_load="YES" @Oliver I see you use one device for ZIL/log and L2ARC/cache. Be aware that you can lose the L2ARC/cache without data corruption, but losing the ZIL/log device might cause corrupted data. So always create a mirror for the ZIL/log device. gr Johan Hendriks