From owner-freebsd-net@freebsd.org Tue Jan 19 09:04:02 2016 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 53CBDA87D60 for ; Tue, 19 Jan 2016 09:04:02 +0000 (UTC) (envelope-from gerrit.kuehn@aei.mpg.de) Received: from umail.aei.mpg.de (umail.aei.mpg.de [194.94.224.6]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 10F261EAD for ; Tue, 19 Jan 2016 09:04:01 +0000 (UTC) (envelope-from gerrit.kuehn@aei.mpg.de) Received: from mailgate.aei.mpg.de (mailgate.aei.mpg.de [194.94.224.5]) by umail.aei.mpg.de (Postfix) with ESMTP id 14D122001CF for ; Tue, 19 Jan 2016 10:03:53 +0100 (CET) Received: from mailgate.aei.mpg.de (localhost [127.0.0.1]) by localhost (Postfix) with SMTP id 49D12405882; Tue, 19 Jan 2016 10:03:51 +0100 (CET) Received: from intranet.aei.uni-hannover.de (ahin1.aei.uni-hannover.de [130.75.117.40]) by mailgate.aei.mpg.de (Postfix) with ESMTP id ADF0B405881; Tue, 19 Jan 2016 10:03:50 +0100 (CET) Received: from arc.aei.uni-hannover.de ([10.117.15.110]) by intranet.aei.uni-hannover.de (IBM Domino Release 9.0.1FP5) with ESMTP id 2016011910034232-108105 ; Tue, 19 Jan 2016 10:03:42 +0100 Date: Tue, 19 Jan 2016 10:03:42 +0100 From: Gerrit =?ISO-8859-1?Q?K=FChn?= To: freebsd-net@freebsd.org Cc: "carsten.aulbert@aei.mpg.de" Subject: ix hangs (almost) Message-Id: <20160119100342.7c458ee5406ba10362237cd0@aei.mpg.de> Organization: Max Planck Gesellschaft X-Mailer: Sylpheed 3.4.2 (GTK+ 2.24.22; amd64-portbld-freebsd10.0) Mime-Version: 1.0 X-MIMETrack: Itemize by SMTP Server on intranet/aei-hannover(Release 9.0.1FP5|November 22, 2015) at 19/01/2016 10:03:42, Serialize by Router on intranet/aei-hannover(Release 9.0.1FP5|November 22, 2015) at 19/01/2016 10:03:52, Serialize complete at 19/01/2016 10:03:52 X-TNEFEvaluated: 1 Content-Transfer-Encoding: 7bit Content-Type: text/plain; charset=US-ASCII X-PMX-Version: 6.0.2.2308539, Antispam-Engine: 2.7.2.2107409, Antispam-Data: 2016.1.19.85116 X-PerlMx-Spam: Gauge=IIIIIIII, Probability=8%, Report=' HTML_00_01 0.05, HTML_00_10 0.05, MIME_LOWER_CASE 0.05, BODYTEXTP_SIZE_3000_LESS 0, BODY_SIZE_1800_1899 0, BODY_SIZE_2000_LESS 0, BODY_SIZE_5000_LESS 0, BODY_SIZE_7000_LESS 0, ECARD_WORD 0, NO_URI_HTTPS 0, __ANY_URI 0, __CT 0, __CTE 0, __CT_TEXT_PLAIN 0, __HAS_FROM 0, __HAS_MSGID 0, __HAS_X_MAILER 0, __MIME_TEXT_ONLY 0, __MIME_VERSION 0, __SANE_MSGID 0, __TO_MALFORMED_2 0, __TO_NO_NAME 0, __URI_NO_PATH 0, __URI_NO_WWW 0, __URI_NS ' X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 19 Jan 2016 09:04:02 -0000 Hi all, Half a year ago we had reported here about issues with ix-interfaces when transporting data over nfs. We only got about 50MByte/s back then, and were not able to fix this issue. Instead, we went for rsyncd transport that gave us about 200MByte/s (still not the full bandwidth, but definitely better than nfs). Now we recognize strange "hangs" in these sessions: We do nightly backups on this link, and it works fine for days, sometimes even weeks. Then suddenly the whole network traffic slows down almost to a full halt. Write speeds (both rsyncd and nfs) go down to a few kByte/s. I see no error messages, no bad packets, nothing that would indicate a reason for this. The issue goes away (for some time) when doing ifconfig ix0 down/up, but comes back after some days. Any suggestions on how to debug this (when it happens next) are highly appreciated. If it looks like this is interface/driver-related, I'll also take suggestions on what different 10GE (copper) card to try instead. FreeBSD crest 10.2-RELEASE-p7 FreeBSD 10.2-RELEASE-p7 #0: Mon Nov 2 14:19:39 UTC 2015 root@amd64-builder.daemonology.net:/usr/obj/usr/src/sys/GENERIC amd64 ix0@pci0:5:0:0: class=0x020000 card=0x00028086 chip=0x15288086 rev=0x01 hdr=0x00 vendor = 'Intel Corporation' device = 'Ethernet Controller 10-Gigabit X540-AT2' class = network subclass = ethernet ix0: flags=8843 metric 0 mtu 1500 options=8404bb ether a0:36:9f:23:3d:b6 inet 192.168.6.2 netmask 0xffffff00 broadcast 192.168.6.255 nd6 options=29 media: Ethernet autoselect (10Gbase-T ) status: active cu Gerrit