From owner-freebsd-stable@freebsd.org Sun Sep 29 20:11:40 2019 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 51A10129363 for ; Sun, 29 Sep 2019 20:11:40 +0000 (UTC) (envelope-from petefrench@ingresso.co.uk) Received: from constantine.ingresso.co.uk (constantine.ingresso.co.uk [31.24.6.74]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 46hGrp5rd3z3QlB for ; Sun, 29 Sep 2019 20:11:38 +0000 (UTC) (envelope-from petefrench@ingresso.co.uk) Received: from [2a02:b90:3002:411::6] (helo=dilbert.ingresso.co.uk) by constantine.ingresso.co.uk with esmtpsa (TLSv1.3:TLS_AES_256_GCM_SHA384:256) (Exim 4.92.2 (FreeBSD)) (envelope-from ) id 1iEfXV-000K07-Sk for freebsd-stable@freebsd.org; Sun, 29 Sep 2019 20:11:29 +0000 Received: from petefrench by dilbert.ingresso.co.uk with local (Exim 4.92.2 (FreeBSD)) (envelope-from ) id 1iEfXV-0005xc-Pf for freebsd-stable@freebsd.org; Sun, 29 Sep 2019 21:11:29 +0100 To: freebsd-stable@freebsd.org Subject: Running iperf3 as a server drops all connections to a machine Message-Id: From: Pete French Date: Sun, 29 Sep 2019 21:11:29 +0100 X-Rspamd-Queue-Id: 46hGrp5rd3z3QlB X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=pass (policy=none) header.from=ingresso.co.uk; spf=pass (mx1.freebsd.org: domain of petefrench@ingresso.co.uk designates 31.24.6.74 as permitted sender) smtp.mailfrom=petefrench@ingresso.co.uk X-Spamd-Result: default: False [-3.54 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-0.999,0]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(0.00)[+ip4:31.24.6.74]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[text/plain]; TO_DN_NONE(0.00)[]; NEURAL_HAM_LONG(-1.00)[-0.999,0]; RCPT_COUNT_ONE(0.00)[1]; BAD_REP_POLICIES(0.10)[]; RCVD_COUNT_THREE(0.00)[3]; IP_SCORE(-3.04)[ip: (-9.65), ipnet: 31.24.0.0/21(-4.83), asn: 16082(-0.65), country: GB(-0.08)]; DMARC_POLICY_ALLOW(0.00)[ingresso.co.uk,none]; URIBL_XBL(1.50)[ingresso.co.uk]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:16082, ipnet:31.24.0.0/21, country:GB]; RCVD_TLS_LAST(0.00)[]; FROM_EQ_ENVFROM(0.00)[] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 29 Sep 2019 20:11:40 -0000 This is odd - I have six FreeBSD boxes on the local ether here. Five are HP Microservers, one is an AMD Ryzen. They are all running 12.1 r352847 built yesterday - and its one compilation I did which is rsynced out to all the machines, so an identical build. I was running iperf3 -s on one machine and iperf3 -c on another to measure TCp/IP rates as I am experimenting with the RACK version of the stack and using CUBIC as a congetion control algorithm. All goes well between the Intel boxes, and if I use the Ryzen box as a client ot the Intel boxes. But if I run the iperf3 server on the Ryzemn box and use one of the Intel boxes as a client then after a few seconds all the TCP connection on the Ryzen box are dropped. There is nothing in dmesg, no indication that I can find of anything going wrong, and I can immediately ssh back in. On the client side it looks like this: [webadmin@dogbert ~]$ iperf3 -c dilbert Connecting to host dilbert, port 5201 [ 5] local 10.64.50.50 port 41134 connected to 10.64.50.6 port 5201 [ ID] Interval Transfer Bitrate Retr Cwnd [ 5] 0.00-1.00 sec 112 MBytes 938 Mbits/sec 1 78.2 KBytes [ 5] 1.00-2.00 sec 112 MBytes 936 Mbits/sec 2 54.8 KBytes [ 5] 2.00-3.02 sec 14.7 MBytes 122 Mbits/sec 3 1.43 KBytes [ 5] 3.02-4.00 sec 0.00 Bytes 0.00 bits/sec 2 1.43 KBytes [ 5] 4.00-5.02 sec 0.00 Bytes 0.00 bits/sec 1 1.43 KBytes [ 5] 5.02-6.02 sec 0.00 Bytes 0.00 bits/sec 1 1.43 KBytes [ 5] 5.02-6.02 sec 0.00 Bytes 0.00 bits/sec 1 1.43 KBytes - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bitrate Retr [ 5] 0.00-6.02 sec 238 MBytes 332 Mbits/sec 10 sender [ 5] 0.00-6.02 sec 0.00 Bytes 0.00 bits/sec receiver iperf3: error - the server has terminated [webadmin@dogbert ~]$ ...and on the server side, this... petefrench@dilbert ~]$ iperf3 -s ----------------------------------------------------------- Server listening on 5201 ----------------------------------------------------------- Accepted connection from 10.64.50.50, port 41133 [ 5] local 10.64.50.6 port 5201 connected to 10.64.50.50 port 41134 [ ID] Interval Transfer Bitrate [ 5] 0.00-1.00 sec 105 MBytes 883 Mbits/sec [ 5] 1.00-2.00 sec 112 MBytes 936 Mbits/sec [ 5] 2.00-3.01 sec 21.3 MBytes 177 Mbits/sec Connection to dilbert.ingresso.co.uk closed by remote host. Connection to dilbert.ingresso.co.uk closed. This only happens on the Ryzen machine. It happens whether I am using the RACk stack or the default one, and whether I am using CUBIC or the default too. The system is build with CPUTYPE set to 'core2' and some modules skipped, but apart from that nothing special. Its a bit worrying to me that this can happen, especially in userland. Any opinions or things people would ike me to check ? Indeed, can anyone reproduce this ? cheers, -pete.