From owner-freebsd-net@freebsd.org Mon Jun 29 07:35:43 2015 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id CBA2B98F258 for ; Mon, 29 Jun 2015 07:35:43 +0000 (UTC) (envelope-from gerrit.kuehn@aei.mpg.de) Received: from umail.aei.mpg.de (umail.aei.mpg.de [194.94.224.6]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4996B1E22 for ; Mon, 29 Jun 2015 07:35:42 +0000 (UTC) (envelope-from gerrit.kuehn@aei.mpg.de) Received: from mailgate.aei.mpg.de (mailgate.aei.mpg.de [194.94.224.5]) by umail.aei.mpg.de (Postfix) with ESMTP id D42A62001C4; Mon, 29 Jun 2015 09:35:40 +0200 (CEST) Received: from mailgate.aei.mpg.de (localhost [127.0.0.1]) by localhost (Postfix) with SMTP id BD8B4405882; Mon, 29 Jun 2015 09:35:40 +0200 (CEST) Received: from intranet.aei.uni-hannover.de (ahin1.aei.uni-hannover.de [130.75.117.40]) by mailgate.aei.mpg.de (Postfix) with ESMTP id 9C8AF405881; Mon, 29 Jun 2015 09:35:40 +0200 (CEST) Received: from arc.aei.uni-hannover.de ([10.117.15.110]) by intranet.aei.uni-hannover.de (Lotus Domino Release 8.5.3FP6HF1691) with ESMTP id 2015062909353039-68019 ; Mon, 29 Jun 2015 09:35:30 +0200 Date: Mon, 29 Jun 2015 09:35:30 +0200 From: Gerrit =?ISO-8859-1?Q?K=FChn?= To: Rick Macklem Cc: freebsd-net@freebsd.org, carsten aulbert Subject: Re: NFS on 10G interface terribly slow Message-Id: <20150629093530.405ae6472b2ab50cba79513f@aei.mpg.de> In-Reply-To: <570481533.408618.1435363122433.JavaMail.zimbra@uoguelph.ca> References: <20150625145238.12cf9da3b368ef0b9a30f193@aei.mpg.de> <623856025.328424.1435279751389.JavaMail.zimbra@uoguelph.ca> <20150626115943.7d0b441cda2c6cc5b817b181@aei.mpg.de> <570481533.408618.1435363122433.JavaMail.zimbra@uoguelph.ca> Organization: Max Planck Gesellschaft X-Mailer: Sylpheed 3.4.2 (GTK+ 2.24.22; amd64-portbld-freebsd10.0) Mime-Version: 1.0 X-MIMETrack: Itemize by SMTP Server on intranet/aei-hannover(Release 8.5.3FP6HF1691 | May 7, 2015) at 29.06.2015 09:35:30, Serialize by Router on intranet/aei-hannover(Release 8.5.3FP6HF1691 | May 7, 2015) at 29.06.2015 09:35:40, Serialize complete at 29.06.2015 09:35:40 Content-Transfer-Encoding: 7bit Content-Type: text/plain; charset=US-ASCII X-PMX-Version: 6.0.2.2308539, Antispam-Engine: 2.7.2.2107409, Antispam-Data: 2015.6.29.72117 X-PerlMx-Spam: Gauge=IIIIIIIII, Probability=9%, Report=' MULTIPLE_RCPTS 0.1, HTML_00_01 0.05, HTML_00_10 0.05, MIME_LOWER_CASE 0.05, SUPERLONG_LINE 0.05, BODYTEXTP_SIZE_3000_LESS 0, BODY_SIZE_1300_1399 0, BODY_SIZE_2000_LESS 0, BODY_SIZE_5000_LESS 0, BODY_SIZE_7000_LESS 0, NO_URI_HTTPS 0, REFERENCES 0, __ANY_URI 0, __BOUNCE_CHALLENGE_SUBJ 0, __BOUNCE_NDR_SUBJ_EXEMPT 0, __C230066_P5 0, __CT 0, __CTE 0, __CT_TEXT_PLAIN 0, __HAS_FROM 0, __HAS_MSGID 0, __HAS_X_MAILER 0, __IN_REP_TO 0, __MIME_TEXT_ONLY 0, __MIME_VERSION 0, __MULTIPLE_RCPTS_CC_X2 0, __REFERENCES 0, __SANE_MSGID 0, __SUBJ_ALPHA_END 0, __SUBJ_ALPHA_NEGATE 0, __TO_MALFORMED_2 0, __URI_NO_PATH 0, __URI_NO_WWW 0, __URI_NS ' X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 29 Jun 2015 07:35:44 -0000 On Fri, 26 Jun 2015 19:58:42 -0400 (EDT) Rick Macklem wrote about Re: NFS on 10G interface terribly slow: RM> The default (auto tuned) value is reported by "nfsstat -m". RM> It can be set with a mount option (should be something in "man RM> mount_nfs"). If you are doing a test with 1 megabyte writes, I'd set RM> it to at least 1 megabyte. (Basically, writing will be slower for write RM> (2) syscalls that are larger than wcommitsize. After mav@'s patch, the RM> difference isn't nearly as noticable. His other commit makes the auto RM> tuned value more reasonable). RM> RM> If you set it large enough with the "wcommitsize=" mount option, you RM> don't need the updates stable/10. Ok, I set it way over 1MB now: hellpool:/samqfs/K1/Gerrit on /net/hellpool nfsv3,tcp,resvport,hard,cto,lockd,rdirplus,sec=sys,acdirmin=3,acdirmax=60,acregmin=5,acregmax=60,nametimeo=60,negnametimeo=60,rsize=65536,wsize=65536,readdirsize=8192,readahead=1,wcommitsize=2048576,timeout=120,retrans=2 However, this still gives me the same bad write performance: root@crest: # dd if=/dev/zero of=/net/hellpool/Z bs=1024k count=1000 1000+0 records in 1000+0 records out 1048576000 bytes transferred in 22.939049 secs (45711398 bytes/sec) So I guess I can postpone the update for now, and look for some other reason for this instead. cu Gerrit