Date: Wed, 23 Oct 2013 12:30:52 -0700 From: aurfalien <aurfalien@gmail.com> To: Outback Dingo <outbackdingo@gmail.com> Cc: freebsd-questions@freebsd.org Subject: Re: FreeBSD, Centos and ZFS - SOLVED Message-ID: <66EE3A0C-8280-417C-99A7-5ADDC8E5E23D@gmail.com> In-Reply-To: <CAKYr3zzGeWJvkb94u6nbSigNdas=NJSfpyaMgPtjj=%2BZPcw1=g@mail.gmail.com> References: <CBA24BB3-4A57-428C-B342-4BEB678B8D43@gmail.com> <1381600575.18393.33219025.5D7B78D0@webmail.messagingengine.com> <8CA809B3-1692-4760-A63F-9D7451EB49BD@gmail.com> <525D143B.50202@gmail.com> <DF3E552D-D2E6-464C-88EA-7AF34E8329CC@gmail.com> <1382285088.2462.36238881.1AA6BB17@webmail.messagingengine.com> <25C055B9-4A19-46C8-B78E-AC8BD6E00CD9@gmail.com> <alpine.BSF.2.00.1310221957500.89571@wonkity.com> <583CD1A7-A2F8-410E-B0C0-0C562833E024@gmail.com> <CAKYr3zzGeWJvkb94u6nbSigNdas=NJSfpyaMgPtjj=%2BZPcw1=g@mail.gmail.com>
next in thread | previous in thread | raw e-mail | index | archive | help
On Oct 23, 2013, at 12:11 PM, Outback Dingo wrote: > > > > On Wed, Oct 23, 2013 at 1:53 PM, aurfalien <aurfalien@gmail.com> wrote: > > On Oct 22, 2013, at 6:59 PM, Warren Block wrote: > > > On Tue, 22 Oct 2013, aurfalien wrote: > > > >> > >> On Oct 20, 2013, at 9:04 AM, Mark Felder wrote: > >> > >>> On Sat, Oct 19, 2013, at 14:31, aurfalien wrote: > >>>> > >>>> ZoL comes with a little interesting feature; arc2 compression, which does > >>>> seem to enhance performance all around. I disabled this in CentOS to > >>>> level the playing field. > >>>> > >>> > >>> FreeBSD 10 also has L2ARC compression > >>> > >>> http://svnweb.freebsd.org/base?view=revision&revision=251478 > >> > >> OMG, what a relief... the ~30% diff in performance was due to a BIOS setting, in particular this one; > >> > >> Intel Turbo Boost Technology > >> Enhanced Intel SpeedStep Tech > >> > >> I disabled both. > > > > Enable them both and also enable powerd on FreeBSD in /etc/rc.conf so it can take advantage of the first. > > > >> In fact, FreeBSD is showing a tad better now then CentOS. I have files if any one is interested in viewing. > > > > With Turbo mode on, it may go even faster. > > Yep, confirmed, got about ~1000 IOPS more by doing this (via fio). > > So on to the other pots regarding tuning powerd. > > - aurf > > so curious what was the fio test on the command line....... my fio file; [global] description=Emulation of Intel IOmeter File Server Access Pattern [iometer] rw=randrw rwmixread=75 rwmixwrite=25 direct=0 size=700g ioengine=posixaio fallocate=none runtime=900 random_distribution=zipf:2.2 # IOMeter defines the server loads as the following: # iodepth=1 Linear # iodepth=4 Very Light # iodepth=8 Light # iodepth=64 Moderate # iodepth=256 Heavy iodepth=64 thread My results; iometer: (g=0): rw=randrw, bs=4K-4K/4K-4K/4K-4K, ioengine=posixaio, iodepth=32 fio-2.1.1 Starting 1 thread Jobs: 1 (f=1): [m] [100.0% done] [102.4MB/34795KB/0KB /s] [26.3K/8698/0 iops] [eta 00m:00s] iometer: (groupid=0, jobs=1): err= 0: pid=101195: Wed Oct 23 12:26:55 2013 Description : [Emulation of Intel IOmeter File Server Access Pattern] read : io=61266MB, bw=104561KB/s, iops=26140, runt=600001msec slat (usec): min=0, max=3643, avg= 7.73, stdev=13.20 clat (usec): min=7, max=707773, avg=707.63, stdev=1254.36 lat (usec): min=9, max=707777, avg=715.36, stdev=1254.22 clat percentiles (usec): | 1.00th=[ 32], 5.00th=[ 60], 10.00th=[ 93], 20.00th=[ 149], | 30.00th=[ 213], 40.00th=[ 286], 50.00th=[ 394], 60.00th=[ 548], | 70.00th=[ 788], 80.00th=[ 1128], 90.00th=[ 1720], 95.00th=[ 2352], | 99.00th=[ 3824], 99.50th=[ 4512], 99.90th=[ 6240], 99.95th=[ 7136], | 99.99th=[11968] bw (KB /s): min= 8755, max=112040, per=100.00%, avg=104619.14, stdev=3609.80 write: io=20415MB, bw=34842KB/s, iops=8710, runt=600001msec slat (usec): min=1, max=3586, avg= 8.68, stdev=13.75 clat (usec): min=9, max=708187, avg=1436.86, stdev=2013.35 lat (usec): min=21, max=708192, avg=1445.54, stdev=2013.23 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 96], 10.00th=[ 135], 20.00th=[ 203], | 30.00th=[ 286], 40.00th=[ 418], 50.00th=[ 676], 60.00th=[ 1080], | 70.00th=[ 1640], 80.00th=[ 2416], 90.00th=[ 3760], 95.00th=[ 5088], | 99.00th=[ 8256], 99.50th=[ 9664], 99.90th=[12992], 99.95th=[14528], | 99.99th=[19584] bw (KB /s): min= 2978, max=37584, per=100.00%, avg=34861.41, stdev=1227.92 lat (usec) : 10=0.01%, 20=0.10%, 50=2.69%, 100=6.81%, 250=23.36% lat (usec) : 500=20.88%, 750=10.72%, 1000=7.56% lat (msec) : 2=16.17%, 4=8.84%, 10=2.74%, 20=0.11%, 50=0.01% lat (msec) : 100=0.01%, 250=0.01%, 750=0.01% cpu : usr=12.20%, sys=39.70%, ctx=10290014, majf=0, minf=0 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=64.3%, 32=35.5%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=95.6%, 8=3.5%, 16=0.8%, 32=0.1%, 64=0.0%, >=64=0.0% issued : total=r=15684217/w=5226293/d=0, short=r=0/w=0/d=0 Run status group 0 (all jobs): READ: io=61266MB, aggrb=104561KB/s, minb=104561KB/s, maxb=104561KB/s, mint=600001msec, maxt=600001msec WRITE: io=20415MB, aggrb=34841KB/s, minb=34841KB/s, maxb=34841KB/s, mint=600001msec, maxt=600001msec - aurf
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?66EE3A0C-8280-417C-99A7-5ADDC8E5E23D>