Date: Tue, 9 Jul 2013 23:12:33 +0400 From: Lev Serebryakov <lev@FreeBSD.org> To: Mark Saad <nonesuch@longcount.org> Cc: freebsd-performance@freebsd.org Subject: Re: Samba server performance -- only 33MiB/s with one client on 1G network! Message-ID: <1783952055.20130709231233@serebryakov.spb.ru> In-Reply-To: <CAMXt9NY_AsMB0m%2Bkp4t%2BVU3yo67Tu7eovJRGUox65rPpZoeg0Q@mail.gmail.com> References: <866737084.20130707233704@serebryakov.spb.ru> <1885849141.20130708010224@serebryakov.spb.ru> <987136020.20130709201026@serebryakov.spb.ru> <CAMXt9NY_AsMB0m%2Bkp4t%2BVU3yo67Tu7eovJRGUox65rPpZoeg0Q@mail.gmail.com>
index | next in thread | previous in thread | raw e-mail
[-- Attachment #1 --]
Hello, Mark.
You wrote 9 июля 2013 г., 20:41:31:
MS> What can you tell us about the system tunings. Can you post a copy of your
I need to note, that system as tuned for (a) maximum local read/write speed
and (b) maximum TCP throughput in local network, as seen by "iperf".
Results of these separate tunings could be seen in very first message in
this thread (280MiB/s sustained local read from FS and 820Mbit/s of TCP
throughput to client in question).
MS> 1. sysctl.conf
net.inet.tcp.recvbuf_auto=1
net.inet.tcp.recvbuf_inc=131072
net.inet.tcp.recvbuf_max=1048576
net.inet.tcp.sendbuf_auto=1
net.inet.tcp.sendbuf_inc=131072
net.inet.tcp.sendbuf_max=1048576
net.inet.tcp.maxtcptw=102400
net.inet.tcp.mssdflt=8800
net.inet.tcp.recvspace=262144
net.inet.tcp.sendspace=262144
kern.ipc.nmbclusters=204800
kern.ipc.nmbjumbop=192000
kern.ipc.maxsockbuf=2097152
net.inet.ip.intr_queue_maxlen=8192
vfs.read_max=32
MS> 2. loader.conf
hw.em.rxd=4096
hw.em.txd=4096
net.link.ifqmaxlen=16384
MS> 3. smb.conf
Attached
MS> 4. /etc/fstab
# Device Mountpoint FStype Options Dump Pass#
/dev/label/swap none swap sw 0 0
/dev/ufs/root / ufs rw 1 1
/dev/ufs/tmp /tmp ufs rw 2 2
/dev/ufs/usr /usr ufs rw 2 2
/dev/ufs/var /var ufs rw 2 2
/dev/raid5/storage /usr/home ufs rw 2 2
linproc /compat/linux/proc linprocfs rw 0 0
/usr/home /backup/home nullfs rw 0 0
FS in question is "/usr/home" (exported as "storage" SMB share).
MS> Also the output from
MS> 1. pciconf -lv
attached.
MS> 2. dmidecode
dmidecode
MS> 3. ifconfig
ifconfig -v em0
em0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
options=4219b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,TSO4,WOL_MAGIC,VLAN_HWTSO>
ether 00:1e:8c:75:03:0d
inet 192.168.134.2 netmask 0xffffff00 broadcast 192.168.134.255
inet6 fe80::21e:8cff:fe75:30d%em0 prefixlen 64 scopeid 0x1
inet6 2001:470:923f:1:21e:8cff:fe75:30d prefixlen 64 autoconf
nd6 options=23<PERFORMNUD,ACCEPT_RTADV,AUTO_LINKLOCAL>
media: Ethernet 1000baseT <full-duplex>
status: active
MS> 4. mount
/dev/ufs/root on / (ufs, local, soft-updates)
devfs on /dev (devfs, local)
/dev/ufs/tmp on /tmp (ufs, local, journaled soft-updates)
/dev/ufs/usr on /usr (ufs, NFS exported, local, journaled soft-updates)
/dev/ufs/var on /var (ufs, local, journaled soft-updates)
/dev/raid5/storage on /usr/home (ufs, NFS exported, local, journaled soft-updates)
linprocfs on /usr/local/linux/proc (linprocfs, local)
/usr/home on /backup/home (nullfs, local)
--
// Black Lion AKA Lev Serebryakov <lev@FreeBSD.org>
[-- Attachment #2 --]
BZh91AY&SY Z_]Xg`xwܟ^ K꾽]_-lkF;lkCZtQӭ
tHM&M4z'ѣ@@2 )OQ螐z h i<SRzM FC@ L$҉5O5M4@4 H))hj 5OS5 hi=M BhLOH
1=@ RBl
E # b@Y# AHP1EGps3`*q
9s{|(]-nn/;@%!,L00t |} $p ɨ;:i lX1(}}w|Z46ly|eߥ =աsk7X9nFnG6y69UR
As:MԛǣUH_p@ 㜎 /
zt 6Vv.{%j Mu
ܕGzeX:G+mh sX@% ~]>{O~bytKF?,@LR:g2i;ǵ!鴬w
+ (*(xJXr k
|t 5D"g2CL`jZ q-jZC0"o{~{zwH8 aP!@RA} !mäJWZf8pS~ݸ/x u(@@2{ &ogT6 I FP!V=[9߾C
ÕWdF]zt]zw
2We߾с&<<7+L X \L {МAQEW 53y!%Ny@ buKۉAkKaa?̸ypT;Z}kny"C
(D
%pg5DDJ0@,8gn] HDz![A7a;|nrk rTk۞ 1sZ8zΙbÞY6<hΎ}k',L ѡ( !V 'w@A,$ VȤ`#Aʈ|p6.XQ9wjވvPh}quwۮHR6cEA'x^S&8`9,g1)kbM 4{0ADbUQ.l
?*s Eݥ F= ܭat@C,wRLBî79Ԑ {&g?gpbk*) &x"dq¢M(6k'Bur,+58DAGQ3j/ۊLWxvh8D+lH93T= 0_#R;<h8f72,,gB4Fd+eWNY Z3ګAS"wTbIGqV-' FZ<.luo&vtNݞy3\(>ۊta&,*m RQ<AA ^0$U^d`hxRؘɟEWA y,o F*q5M偀֫hg.d)
;1HTR+bB*wJ3 pI1'E)R`s#iKCI$@|#rv,`D 39>
,.t\Ѡ3?<C %A a
iHP8x:qDxg,&J PYΒﾁ" s)&@b@'8p~zYn4M l KIϳ~l`3Dy :;K`kH`NG< 9 }m>4 B ;Q:A͐A3%9 55L|qb"!˿|G^t oX p j!$((_&9kd S qٌ<nV 2HX'!*1z-I'SDKm9xj$)%)q1Eb]2D VeC7o0 &G3D H$a
dYNb2H"CdsL.95(]b`BA2)932@'n 'I Biv<<s @ӗ 2'Vck}I%U&(IJ78e{u&]`0\1k҃E;6gRfcM:(
аDH dc1҅U`M v"&m/_rJ a
O.|M:ٻ`V 02Q-Hf\u&K;E1b\|
(@҆/iWsPd.Rh#XP0B p~TJI
pp
ʍq ~ggs pU=n
s 0˛r_A`d2( M3`^c4vf),$8W=s HAà ." d5R~E̲A0Sy Aq@-}22!b .H)ZZۑ 50 F0~0V EY5ke#K b%#a605Af mBdpR$+AKX d bzd`Wz?.:)=ͬdϸrUJ`f0r/<p~ 絜xljat
20 $
H&ņ60[rX{ jG#_
"2 DZ@
4SLR G\Eӈ_cZ j\J@bw!V%+d|Ɲb>Q@]k\F@H3P, x/@(D8mG.bEKDa䆠r!!_8ᐶ3]?' \
NA BXYf`C53!C b]Q<Kg[xgP\$
z,]NP~L9DвE(;&\x!\yL* p;mqˏ Cm Z\y@soS$S D$HEI$C30fDʊ@h'Mijdi302>MG P4+3$I+ӷṾD9B *$7qɸ q1Mh`<>[{Ӆ~K^/*
h@L
M.<j#)ظc!Uɣk 6E8( a" ÓᴤLUR03h@ p$ V $($ :k"] B %@IvQoG ϐ7Uq}i'ˡқМ;26 y4p$ fTP+lE X4t >=n;,P* >Ϙ?4V B'A xn iRd!<lT*i;q$, [ۮ?d@D~p.ܪT\9
2 "0dX RA! ,
G=klR
[xPN)C
JDDΒPFRԐr6B 5Ӗ @D Ah SAOkBE.sn}j<h3 [ !qP;,kX rxC:CL3RYM1q4=4.[r'llXb< Lc@wVfVk+%$ [q2 `tnP^^M| lf@PYMz45Mnk~QoZT {价Sd 1b
AUU$U@UUUU!۴@Gnu7QQE,-pX$0 G ( /煆9\BN8Tf )9>
pU*۟~\!2LqH:E)|C.JŰsbJ :i=JK
UrJC
Zp&Ȩ$W<Cd_""(HJS
[-- Attachment #3 --]
BZh91AY&SY+- :_p0@ ?P:Q R 4Ѡ 昘0 L#"") L4 9&4# E$&IMM4y5!SF s^(w nl@V]pJE @u <D"/&*oܪ|;tdBRh3雕3WLƁPPi2i5 O!!7 a$ծ cIr 4@]Kn)dd1a6IA[ 5[h`4@QECUM3.1\yD/ddp6F\2
< C0$ACm+E2B [8
h,(iJ Yg}1.v `j mHu`2(5-DEnb- H3
p6Đz
?-46 5*Ȉ5pv0jBa
(kIxA o +7_Vގv,.2W +m9C\fFYVnz ҐaFH]x@잡t!\e
CCD, r,{24j(q ț썎D(GrŬ&8\С<FܢR
T5^ #5
xiD2B,L7<p
T꿉4+e <v栒Vj`g ޡ!&!] >s=k
T8BG/<1PYNARȬ:PR
Ɨ@!B& 4?
|cBLBdՙ$8PBrPBHH]B@
[-- Attachment #4 --]
BZh91AY&SYڍ $ PJ?G*@`DeOOSOS
T ҏ'zM
hb`00 $0)S@ 4 0c?i#}^!ɛN5DaGLVQW22G7 "W@dH*~uQ'`nemk'+jbEiw)a)u{9mRtUsMB:HE[' N4N+5ǰB.Ltt)W!ul|5"\#BgbI +-SD'&JA]>* +0B"`v;EcU|o 4zCJ jL,y uCK~ ,ǡD4
F9_BazHR
<;PgB cѷ]+)"cqʸ (
C8-b
ẽ0ba7[bv]'\2Z_6a& :mTT& _c]jw cO>EVeܠʌ3 b$J eWG,[o.0
qXJ[
&$B+dNq֖th 0e=
c[Ww5#)@34ت4{ɁdZbAiJrdF"E"gQ rE8Pڍ
help
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?1783952055.20130709231233>