From owner-freebsd-net@freebsd.org Tue Aug 2 08:55:09 2016 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 85715BACC7E for ; Tue, 2 Aug 2016 08:55:09 +0000 (UTC) (envelope-from gerrit.kuehn@aei.mpg.de) Received: from umail.aei.mpg.de (umail.aei.mpg.de [194.94.224.6]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4143A183C for ; Tue, 2 Aug 2016 08:55:08 +0000 (UTC) (envelope-from gerrit.kuehn@aei.mpg.de) Received: from mailgate.aei.mpg.de (mailgate.aei.mpg.de [194.94.224.5]) by umail.aei.mpg.de (Postfix) with ESMTP id B1B462001C3 for ; Tue, 2 Aug 2016 10:49:30 +0200 (CEST) Received: from mailgate.aei.mpg.de (localhost [127.0.0.1]) by localhost (Postfix) with SMTP id A1BCB406ADE for ; Tue, 2 Aug 2016 10:49:30 +0200 (CEST) Received: from intranet.aei.uni-hannover.de (ahin1.aei.uni-hannover.de [130.75.117.40]) by mailgate.aei.mpg.de (Postfix) with ESMTP id 86CC9406ADB for ; Tue, 2 Aug 2016 10:49:29 +0200 (CEST) Received: from arc.aei.uni-hannover.de ([130.75.117.1]) by intranet.aei.uni-hannover.de (IBM Domino Release 9.0.1FP5) with ESMTP id 2016080210492920-62483 ; Tue, 2 Aug 2016 10:49:29 +0200 Date: Tue, 2 Aug 2016 10:49:29 +0200 From: Gerrit =?ISO-8859-1?Q?K=FChn?= To: freebsd-net@freebsd.org Subject: NFS on 10G interfaces still painfully slow Message-Id: <20160802104929.a10602a4786c68b4547a45b9@aei.mpg.de> Organization: Max Planck Gesellschaft X-Mailer: Sylpheed 3.4.2 (GTK+ 2.24.22; amd64-portbld-freebsd10.0) Mime-Version: 1.0 X-MIMETrack: Itemize by SMTP Server on intranet/aei-hannover(Release 9.0.1FP5|November 22, 2015) at 02/08/2016 10:49:29, Serialize by Router on intranet/aei-hannover(Release 9.0.1FP5|November 22, 2015) at 02/08/2016 10:49:29, Serialize complete at 02/08/2016 10:49:29 X-TNEFEvaluated: 1 Content-Transfer-Encoding: 7bit Content-Type: text/plain; charset=US-ASCII X-PMX-Version: 6.0.2.2308539, Antispam-Engine: 2.7.2.2107409, Antispam-Data: 2016.8.2.83917 X-PerlMx-Spam: Gauge=IIIIIIII, Probability=8%, Report=' HTML_00_01 0.05, HTML_00_10 0.05, MIME_LOWER_CASE 0.05, BODYTEXTP_SIZE_3000_LESS 0, BODY_SIZE_1000_LESS 0, BODY_SIZE_2000_LESS 0, BODY_SIZE_5000_LESS 0, BODY_SIZE_7000_LESS 0, BODY_SIZE_700_799 0, NO_CTA_URI_FOUND 0, NO_URI_FOUND 0, NO_URI_HTTPS 0, __CT 0, __CTE 0, __CT_TEXT_PLAIN 0, __HAS_FROM 0, __HAS_MSGID 0, __HAS_X_MAILER 0, __MIME_TEXT_ONLY 0, __MIME_VERSION 0, __SANE_MSGID 0, __SUBJ_ALPHA_END 0, __TO_MALFORMED_2 0, __TO_NO_NAME 0' X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 02 Aug 2016 08:55:09 -0000 Hi all, I already reported this issue here a year ago and unfortunately was not able to fix it back then. Now I had another run at it, using two recent 10.3-machines with a direct 10G link. I still see nfs is painfully slow (around 20-80MB/s). I tried both nfsv3 and nfsv4, with almost the same results. Everything I tried so far (mtu size, wcommitsize, readahead...) only makes things worse or at least not much better. Moving data in different ways (scp, ggate) is much faster, so plain network speed should not be an issue. Is there anyone around here who can confirm that nfs can go faster over 10G links? Any hints for further tuning/debugging are greatly appreciated. cu Gerrit