From owner-freebsd-performance@FreeBSD.ORG Tue Jul 9 19:12:39 2013 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by hub.freebsd.org (Postfix) with ESMTP id 70E82AE9 for ; Tue, 9 Jul 2013 19:12:39 +0000 (UTC) (envelope-from lev@FreeBSD.org) Received: from onlyone.friendlyhosting.spb.ru (onlyone.friendlyhosting.spb.ru [IPv6:2a01:4f8:131:60a2::2]) by mx1.freebsd.org (Postfix) with ESMTP id CEFE6161E for ; Tue, 9 Jul 2013 19:12:38 +0000 (UTC) Received: from lion.home.serebryakov.spb.ru (unknown [IPv6:2001:470:923f:1:d1e6:17e6:7b26:3ee6]) (Authenticated sender: lev@serebryakov.spb.ru) by onlyone.friendlyhosting.spb.ru (Postfix) with ESMTPSA id 721244AC58; Tue, 9 Jul 2013 23:12:36 +0400 (MSK) Date: Tue, 9 Jul 2013 23:12:33 +0400 From: Lev Serebryakov Organization: FreeBSD X-Priority: 3 (Normal) Message-ID: <1783952055.20130709231233@serebryakov.spb.ru> To: Mark Saad Subject: Re: Samba server performance -- only 33MiB/s with one client on 1G network! In-Reply-To: References: <866737084.20130707233704@serebryakov.spb.ru> <1885849141.20130708010224@serebryakov.spb.ru> <987136020.20130709201026@serebryakov.spb.ru> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="----------03E0E102612CC4C43" Cc: freebsd-performance@freebsd.org X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list Reply-To: Lev Serebryakov List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 09 Jul 2013 19:12:39 -0000 ------------03E0E102612CC4C43 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Hello, Mark. You wrote 9 =D0=B8=D1=8E=D0=BB=D1=8F 2013 =D0=B3., 20:41:31: MS> What can you tell us about the system tunings. Can you post a copy of= your I need to note, that system as tuned for (a) maximum local read/write speed and (b) maximum TCP throughput in local network, as seen by "iperf". Results of these separate tunings could be seen in very first message in this thread (280MiB/s sustained local read from FS and 820Mbit/s of TCP throughput to client in question). MS> 1. sysctl.conf net.inet.tcp.recvbuf_auto=3D1 net.inet.tcp.recvbuf_inc=3D131072 net.inet.tcp.recvbuf_max=3D1048576 net.inet.tcp.sendbuf_auto=3D1 net.inet.tcp.sendbuf_inc=3D131072 net.inet.tcp.sendbuf_max=3D1048576 net.inet.tcp.maxtcptw=3D102400 net.inet.tcp.mssdflt=3D8800 net.inet.tcp.recvspace=3D262144 net.inet.tcp.sendspace=3D262144 kern.ipc.nmbclusters=3D204800 kern.ipc.nmbjumbop=3D192000 kern.ipc.maxsockbuf=3D2097152 net.inet.ip.intr_queue_maxlen=3D8192 vfs.read_max=3D32 MS> 2. loader.conf hw.em.rxd=3D4096 hw.em.txd=3D4096 net.link.ifqmaxlen=3D16384 MS> 3. smb.conf Attached MS> 4. /etc/fstab # Device Mountpoint FStype Options Dump Pas= s# /dev/label/swap none swap sw 0 0 /dev/ufs/root / ufs rw 1 1 /dev/ufs/tmp /tmp ufs rw 2 2 /dev/ufs/usr /usr ufs rw 2 2 /dev/ufs/var /var ufs rw 2 2 /dev/raid5/storage /usr/home ufs rw 2 2 linproc /compat/linux/proc linprocfs rw 0 = 0 /usr/home /backup/home nullfs rw 0 0 FS in question is "/usr/home" (exported as "storage" SMB share). MS> Also the output from MS> 1. pciconf -lv attached. MS> 2. dmidecode dmidecode MS> 3. ifconfig ifconfig -v em0 em0: flags=3D8843 metric 0 mtu 1500 options=3D4219b ether 00:1e:8c:75:03:0d inet 192.168.134.2 netmask 0xffffff00 broadcast 192.168.134.255 inet6 fe80::21e:8cff:fe75:30d%em0 prefixlen 64 scopeid 0x1 inet6 2001:470:923f:1:21e:8cff:fe75:30d prefixlen 64 autoconf nd6 options=3D23 media: Ethernet 1000baseT status: active MS> 4. mount /dev/ufs/root on / (ufs, local, soft-updates) devfs on /dev (devfs, local) /dev/ufs/tmp on /tmp (ufs, local, journaled soft-updates) /dev/ufs/usr on /usr (ufs, NFS exported, local, journaled soft-updates) /dev/ufs/var on /var (ufs, local, journaled soft-updates) /dev/raid5/storage on /usr/home (ufs, NFS exported, local, journaled soft-u= pdates) linprocfs on /usr/local/linux/proc (linprocfs, local) /usr/home on /backup/home (nullfs, local) --=20 // Black Lion AKA Lev Serebryakov ------------03E0E102612CC4C43 Content-Type: application/octet-stream; name="dmidecode.txt.bz2" Content-transfer-encoding: base64 Content-Disposition: attachment; filename="dmidecode.txt.bz2" QlpoOTFBWSZTWZXB/KYAB1pfgF3wWGf/8H//3/C//9/0YBWfeHcFGdyfXoaMHUu96r69s+9d 549fLfTvbL1rRs07nWxrkAdDqFp07ZpR060AGQ10EkhNARoGEZEmxE2gmTTUeieo0aNAA0DR MgAUxCmj1PJPUaHonpB6gABoAABppTxTUnpNHpGmRoaDQ0AAANAA0NNMJNKJE9E1T9A1TaI0 9IADQDTQAAAAEUgpp6SZoNQp+mjSah41T1M1DNJoabU9TQAACJIgE0JoyEyRp6EBT0gNH6ox PUAA9QOg/FIbQmyCmwpFCSMAjIEAYpIIgBEEBQiyCMJAWSMEIIxBBkjIERIIsVAUAjGBFUUB 5Z73n93i7g5H0NjLD6cW4hhwcxjAnDOIYKDLKsEPcQrExfD+/Dn+zeH7c+3Z6Pp7fL6/oM0Y xiiIifNdLW6JixOiz+pufy/jgPY7QCUhLP8CGQeGwPXxTP+kgasQlDC6+rwwhoTM1sbpdAl8 fR2HoyRwrbTzqCAbmMmoOzrxlWniHdXSbONYMSh9rX1333yWtFqq74E0uzZs+Xm6oqJ8tGWn 36UgHj3Vob9za8P6gTdYOaBuRm7q9dxHNnk22ufD1ewOORHAVVKzk5a9CkFzOodN49Sbx6P2 mv+mrVXqk8NIX3BABgzjnI6ux+MLFS8BoA2Ri3qgdAEMNrNWdi57gRklphL4auQeTbJ1DsEU 7fIKCwTD+tyVRwSremVYOpNHhwMr1W2lpmgec1gDgEDAJQYB+8CbHu+vD6vw7/d+XfgG/D57 T37ZYnl0s8KKA0v5RuE/xSxAsRlMUjrGEM3tZzLbaTvvie3HtYwh0Om0rOl3+xbv0vOgqqoK qKCM9RArABgoKiiiyeP5sBp49rBK+Fhyn/nC1h1r9Aj+6gp8i7t0rBw1haBEImcyQ59M4GBq gOjZWgUBwIMBowMAkwhxLWrXWpFDMCJve9B+jAa7exJ6jpKUuo2Alne8SJrQOCABIGGHvxb4 UCFAUoFBfbXD6QD4IbidbcOkShXOBPrmx/2D5ldaZoOwOOdwjlN+3biY1C/R1+mvxg7FAqKB r5PTA3inIAh1EpbF6+wQ1AgoGEDLQNQyoP+se/8a89XK3CAVJm9nVDYMSSBGsFAhmFbnpD1b sM7NObaVqQ4HBQjT375DwwrKGIXBDLHDlZb4V9lk8snbRhWVg/Vdyg+ZenTHXXp3vMH1DTL4 9ZDeBQVXZd++Bv3RgeHh6ybHwzzW7zzG3TcrkRFMIMYLiFggz1yBuJrmTAsH8sN70JxB7FGI RQ6lilceNTOf6HmutSEltxWgoE55wkCUINRi+HWuhEvbiUEYlelrS2ECYbODFD8a8PT58sy4 eXCjVDu2Wgd9/2tueQ4iQwooqqWERO6CmhYKJbewFgLQcMLW4Wc1GwX6RPNErqpKwzBA4Swa pa73pTjcwGfdAvfukG5dq4Qe3vCASBDhRHohFICA4ltB9uQ3Ya87fN9uq/e6cmsd2HJUv79r 7vKT256I+QPeG+ryin8evjHoc1oZOHqx0c6Zxvu9Yt/DnqTwxuFZ1DY8q4ho5M6Orn1rJyyX TByCgdGh+63CKAgJmyFWDskJJ3eUQEEsJK7F59wJVsikYAL0Ew8jshhByoiXfNAateFwNqYu iYAUi1hRuOjhvDmCpndq3oh2jrIB3OdQ+MjpuhID0fGaid5ojn24ccd1d9uumYXpSFI2tdXO Y61Fu9Xuja9BJ53veF6VU5zhB6qq2yaZOMCXp6zXYDkXLN9nMSlrYk0ckRsA0tELNJgbezBB 5UTqYgLBl1XOUebJLods1PYHsRzA4g0/KnMMt8d/wUXdpR79RvzE+z2cCdytYXRAQyzxd1JM lddCw67t0zc52dSQoB+TILEOsHsmZ7sRP2fOcGJrA/vij+uNA/7QKqqEARIpIIkYxgasJvUB hBei2QOYxXjEA4wDImSEcZvCok3rKLzhkTZrgCdCqrAIdXIs8xOPoffgK4ert4417a04tURB R6xRM2ov24pMV3h2aME4sgiRRPQrbEgSOcwzwKBUPQPOCwwwXyNSO5qgPGg4ZjcyLIuNGsjl LLxnE0I0l0bpZKMrZZ9X3uKSzU4TWaALWswz2qvEzUECElOrkSIExndUAqFiSYWkR7aGcVYZ pS2xJx5GDlo8sacuzmx19G8m4OZ2dPHHTt2eeTO0XCg+AduKdL+6YSbALLAqbQxSUTxB4ppB i/G+pqwFvADGGbAMXhYwm+EHF8GqkCQOVV7s7WRgaBnW5v5461LYmMmfAahFV0EceSxvC+Qb iItGwYsqccwPNe7mTeWBgNaraGcuqBFkogQphAqOArQ7Mee3SLFUUivNYkIGnvkqrrSsd/Lx yQGeSjPAIMFwzEkxf5mW/NEnRQUpUpARYHPhI99pS0NJJEB8vIPgmSPBl3J2LGC4oMQYRPgc h5QzAzmmPqsDyQ0sLph0XNGgMz8820Meua0l8kEJYRgKaUhQqqrS66049fR4Ovu113FEjN3C 43hnFCy0JvekSglQWc6S4u++++++gZiGwaUYIhxzgykmQGIPQCfOGbms0ek4cOF+elluBjSw 100JhsxsH4r0zkvfSebPs5J+bLtgM0TJeY4cOv7F7jsbwvy2jUvzE75glKS8a0gYhQUVBIyM EGBOr0ePvBY8sQwGOYiB1fbywuYLln2z6m2IPjSc4afxHJLEAqlCiQgICTuI/FE6tpXhuUGs q82QQTMlsznwIDWoNQ/WTBf8mnwYFgKpcZZiIsIhFO/pz8fX5cjyyMu/tpd8R14HdAtvDoVY A/wgiHAOt7DFIGohJLCEBCikgihfuya+OWvOf2QeUwxx2YzP7jwBbsbgjpJWCzKEgc/wSLSb xliTJyGNrCoZBYEVA9Ux6ePfepUt38r/SZ8nU8NEq8pLBrn2bck58854aiSTKRIWJSkEA9fR cTHpwkWKl2ICFAGS7l31MsREEwEJVmVDpjdvMB4mR6HAiBee4DPA+7BEC0gkYQIEiSANZPCH sesGuZsVWbRO+mK2CDJIkCJDnmQPGqD76ORzqYDXTC6HsDkBmAcV5tM1gqusBCiBXZgVmWKE 0mBCELHtQRGqjaIyKTkH1zOBrgKmMkAns+P27bbbbgyJJ0nN5h6mQmnCkYh2zoE8PLUD2O/I c4HfHUCJCMgB5dOXnxwDFjIniVbrCNJj54rY5muRffa/BuZJAiVVJvaypSgSygRJCEqik7w3 6Thlew6Y/e513/rNJooRAxddYDCw6lwxsLxrA93Sg6OPRfwW7zs26meym7hSZmNNuZk66SgK iCDQsKJESAgMhGRjBjGC0oVVYOQQgU0YBwx2IiYZba29tNYvmF8ZkXJKDBAQBRAUYRQJDU8u 7nyTTYShOrm/47DZu2BWCwUwhqneMlGDrbstSIVmk1x1Jou7S7mcO9xF2jGuYsBcGRSwfIfQ Dc0op4RAnhTShrMvaeS5V7Bzh5C9uFDAD2Qu91Kf8cpojiNYUNcw/UILcON++FQISkn3qYUK B+lww+lw2wrKjXHIHPp+Z2dzDHAPxVU96cluAaQNwHPhAPQwhcPLm8UCcl/SQbqjpGBkMijP ILpNM+QDvQHxYKFeY7s0oJK+1nYBZs0BKcksjYIkCAj8OFc9kLUB1XMepEh/QcOgHy4iH6Fk NQPzsvOJ9gRS+36E50WT38zMsohBMItTeQHcCUFxQIEtkX2zAxAyGzIhYgwM9rwuGQjUSCla WsT5iajbkQwGNQIwCRFGkjCXfjCTVgCyRVkUkDWWjWtlI0sAYiUjYTYwNUFmvCBtQmSscBKI Ut8kK0FLWABksB5ilrZ6ZIZgV5Gwej8uOimCwT3NrMlkvAKiz7ipna1yVYxKAQiloO8EGoHQ zPS2woED6geDYL6BZtUDMHLALzzlEnDA/34TC+e1nPcDeOqn92xqYXQKMogTMKGAFMEJABsk DUgmhATFhtw2stowz9r23+1bcljw9oB7H2rvwEcjX/7LDQkDoiLX4xflMgmARMfMWr1AtZHV CgfANK+GFRtTTFIJIEfQXEXTiKBf52OmWu0Mas5cSkC+YhUa9pSJAdPwdyFWFCWEK2QPfK/l t8adBJNilgE+71HCGMtA9LZdawJcjcxG8kCISPYO5zPYUCwPHIW5ABCG9HgvQChEOK7e5bVt 6kefwy6IYkUEg0sCRGGZ5IagciECBiHSXzj7j8vX0eGQtqMzpIv7XT8n7R1cBeD1CgVOQRxC 9hFY3FlmoZVgqAVDNTMhQwkE3vn34mKaXVE8S2cUmFuX3Hj7vGfr9+9Q6OtcJBIb0PrWCqvo IJDBqXqDLOgY8F2LTlB+TIM5m0TQspVFKDu7JodceCGRXIWEee8UTCoc4HA7weJtj6Bx7Qe4 scuPqhsdsMBDmIlt8+0J01pceddAc4FvlMhTJFOxBAkgRCRIRZFJJEMzMGb/mkQVFhjKikAG 7dvoaCcWTYBpaqBk+s5pwDPPMDI+rg5No5HVRxxQyAMa8480K8LI2wQz4Yv1JAVJBRIV94UQ K9O34bm+RDmE6QIGQqIdgiq4JDdxAcm4GRYQhCBxr90xw03NaKBgPOb8PlsOF/Z704XNfku3 XvovxMQqjoEKkYEgwGjgxECQhUwK+vVNLjxqIynYuGOaAhiIBCGEVRfHD6LJowKzawDKFQkf NkU4CIWYKB2CooJhjiKB8gzDk6LhtKTHTFVSihUwFzPREWiy7EDNFbKtywtwyCSyC1aAHtQk KLv6JB86Fmu4Iui5XR1C0AgMJcsEtrZASXbzUW9H4A4fz5A3glVx4H1p9JGRJ6n4o8uhiNKb 0Jw7D4e7uTKQNhy2GI6deTRwJB1mxVS0UCu8FLHFbBvERZiGIFjjNOh0Ce3lzD49bjssUCqQ oBD2iAmpPs+YPzRW444dugaiiUInQRoLeG4caVIPZPIh1BsVtoSKnKg8gmyLVKgqv2k7ntzL CHESELYk5izqhQvxW4e2264/ZP69qkATghfEROIYfnAuptyqVFw5vPUNMgwiMGRYxBHaygiS AILBUkEQBRghBCARCCwNR+49a2yDB7KQuIZS/AoB485beFBOKUMKSkSAkkSHzpK+s1CRRlKa AdSQcjZCw/sMNdOWAECERAgghkGf2ezzDmgcgxTuU0HZT8ADa0JFgC7rEQgQBIJz3G4FxH1q wTxoMwunW4YAIXGrrlA7qKgYLONrWBcJcqwHeEM6lBlDTDNS17XtWU0xjnE0PcHbNC5bcqrF wMgPAgUnosC4gmxsk1gUYjyDEx9MjAbwshRjgq9AdxkI0VYG+qBmBparpQIaplahayslpSSS lAsBgVu5cYmOMsYLiGCpdMFuoFBeXq1NFq4VfBvbIGxmQOuIUFkTTXqvvMA0NU2R96hu77Br mX4DUW8DhBKiWgFU6hoge+S7t1OYjIZkFIwgkjFiCAqqqrFBVVUkVUBVVVVV0OMRDiHbtIBA 9UeZ5G517+ew9DfonNvhUVHiRcQsErus3gEtcIKSrJimWCT8MBwQRxwFKCALnfHvL+eFhvQ5 AVyx10KgsE44j1QQ6BtmHeaD4imwvcvvOeI+vw3+sXASVSrbn36yF1whMkwF1gWCB3FIoDpF BCno+8Hwqefu83zo6udDg++C+gEuh0rFsHNiEkoYyQw6aZo9SqMEh4pLCoHln1Vy76K2SotD 4A0UWvXbF8bXcCahhxD7m8ioESQBA+K2V908lEPoB2RfIuf/i7kinChISuD+UwA= ------------03E0E102612CC4C43 Content-Type: application/octet-stream; name="pciconf.txt.bz2" Content-transfer-encoding: base64 Content-Disposition: attachment; filename="pciconf.txt.bz2" QlpoOTFBWSZTWSv8sC0ABjpfgHAwQOf/8n/n/wA/79/gUAP+OttRCaACElKDIADINNGg0AAA AADmmJgI0wIwjAAAAEwjASIiEKbxKaaep6ARghiaDEw0CaY5piYCNMCMIwAAABMIwEUkwgIm yUntTU2iNHk1B6jNIaeg01MTRqoAc6heKHcPgh9u+2xAB5/QVl1wSuPDxkUgjRBAdREMxDxE Ii8EJoHpFCqnb+uN3KqBp8p8O3TOZEIUEJeg9LPrUu7+aPnv3ffGM+mblTPBV0y3xoFQCAGi UGncMsNpEPqENdrOIBaCT6qQISE3HQWt87naBIEOt5IFYfgSJL764dWuDGOiScGI/IByk7Gq CzRA0F1Lbilky2ShMQZhNkmQQQ5bCzVbaIKnYDSPFQhAr5bmUbdFsUPvVU3jyjP1i68Ioe8u MVx5s5LawxeORC+Z0WSAZHA2Rlwytg0LPPKdEaEgkwGU8qPEQxXG3DAkG6hBQ72EmZSKEQIZ 6W0rlNsWgtdFMsxCo68LWzgNaCyVrShpSgvZWWd9MdMuf5XX4RKW2HbxAIFgaoIMbd9IdWCo MowoNS2BjERF5W6utWLL4swtrRIJmEiZmRS3M/gSDXAOgTaFxJB67g0AwD8toDQ2IJzLNfEa 2xjNKsiINXB2tYcFFDAHxmrkQmGlAwoIDr0fKJVrSXhBf3+1H2+B8CArN4qeqV8IVgPejna0 o/a56hCDLPYuMriNvle0Hyu1bTlDwAIPXGZGWYSAVm569QmztaeisQeUhtrSkGHmCBsYkEZI GO9deN0R9UDsnqF0Ie+aG1yhZQrJQ7VD6EQsHxUPcgeKhSx7iJ8yhOqhNJZqGChxHiCayJvs jY5EKEdyhVW7p8yGJuC/OPpcodChG/K4PIRG3KJSlAYKHs3c/FQ1hF4aCSM1DXhpRO7a/zKS zULKGuevLEy2EIE3qjzG9XD6qwpU6r+JgpWvNIErZQk899925qCSVmrmYKFn+ADeocDeIfYm If1dtxwUPsobcxE9t4hr8A1UOKvBQkcvPIQxUN4XqFlOQeFS48isgTpQ3RvBDlKQ7QoRihrG l0AhiEImHjQ/FA3V43xjh0KEoppMQmTVmSQOnQcEOBRQyUJyUKJCkkjeEuBIl/xdyRThQkCv 8sC0 ------------03E0E102612CC4C43 Content-Type: application/octet-stream; name="smb.conf.bz2" Content-transfer-encoding: base64 Content-Disposition: attachment; filename="smb.conf.bz2" QlpoOTFBWSZTWdqN39UAASR/gAAQAFBKA//yP0ffKr/v3/BAAq62rNFgoaaTRGVPyU9TT1Mg AAANDamjyQ0CVNMgk9KPJ6oaeoNNAA0A0BpoA5piYAEwATAACYAAmCSFMJoU8intU8JAADQA AbSNMGM/kbJppyOdB6V9Xr4hyZtONeJEYUdMmasPVlFXkoXZMjKcRzfdHiJXQIXdZIKiSJIO nPkqfnXc3Yy55cHrUSftYG7dZW1ritUnK8FqxsFixUWgaeB3KWEpFNl1jRfpezlt/VLEdBHr VXNN9UL5EYs6SBDG90UDWycJTueONKQX3k4OiuG3K+Y1avDMjAdC4C5M2HR03scp1leRIXUO bK98zfM1pSJcI5BCAvZnGGLqSY0LKy0TnVMaRCcmuo1KQV3HPsvL1yoYoQCigiuzMEIiD2Cg djtF/vj9Y44YxFV8bwyYNA/depyamEMFrJBKCfOIavBM/dnutrosoXnQDyB1iZ2C+gHc90NL 7hgVfhEdzsIslMeh7UQ0Ag2eRrQIOV8UQuRhehZIUtURqeQNE/4C1QKWPJk79lBnQhCYIBO0 Y9G3Xa0rKa3UE4OClSJjcZ3KuCAXECjzF6SyCkM4yC1iCmXMgzAa5PjbYmEQ+TfEW2J2XSdc MlpfmfYRmTZhJuv2EwwgOqltVJBUhiYgXwKb2GMEmNtd6PyZancLY08+RfUC51YbZdygyowz C7RiJIGU4krnCyBlibdXRyz4W9JvLjCy3vYKjHHgWL9KrIZbDcGWJpYkQiu07WROtwSYcZnW lr6GdGggzDCVZcDiPRYKY4BbV3fSNSMpl0DX8dMzozTYqro0u6N7F/TMyYGqZKxaGhiTGPNi QWlKxxRyiGSryUaEhiKuuq/XRZC3E7EiAhAUlGeG6VELEqH/F3JFOFCQ2o3f1Q== ------------03E0E102612CC4C43--