From owner-freebsd-net@freebsd.org Sat Jan 5 19:46:59 2019 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 7C483141F1C2 for ; Sat, 5 Jan 2019 19:46:59 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id 122BB69C2E for ; Sat, 5 Jan 2019 19:46:59 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.ysv.freebsd.org (Postfix) id C954A141F1B3; Sat, 5 Jan 2019 19:46:58 +0000 (UTC) Delivered-To: net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id A6BAA141F1B2 for ; Sat, 5 Jan 2019 19:46:58 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 444B369C2B for ; Sat, 5 Jan 2019 19:46:58 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id 6E9C31E890 for ; Sat, 5 Jan 2019 19:46:57 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id x05Jkv6L002234 for ; Sat, 5 Jan 2019 19:46:57 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id x05JkvTL002233 for net@FreeBSD.org; Sat, 5 Jan 2019 19:46:57 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 234624] FreeBSD 12.0 ix driver TX TSO vlan-tagged network regression from 11.2 Date: Sat, 05 Jan 2019 19:46:57 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: misc X-Bugzilla-Version: 12.0-RELEASE X-Bugzilla-Keywords: regression X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: freebsd@aoeu.uk X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: net@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 05 Jan 2019 19:46:59 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D234624 --- Comment #3 from Nick --- Hi, One further point of data: ipv6 testing shows the same results as ipv4, both for tagged and untagged interfaces. I've also discovered something odd: once TSO has been disabled on an interf= ace, or if it was disabled at boot, I'm unable to subsequently trigger the issue= on a tagged interface. Either turning TSO on after boot for some reason doesn= 't cause the problem, or my attempts to turn TSO on after boot are failing. I= 'm not really sure how to check for definite, but I do seee that the tsx_tx counters don't increase from 0 in this case, so I suspect TSO hasn't really been re-enabled for some reason: Booted with TSO disabled on ix0: 19:09:27 root@filer:/root/ sysctl dev.ix.0 | grep -i tso dev.ix.0.queue3.tso_tx: 0 dev.ix.0.queue2.tso_tx: 0 dev.ix.0.queue1.tso_tx: 0 dev.ix.0.queue0.tso_tx: 0 Enable TSO: 19:15:11 root@filer:/root/ ifconfig ix0 tso TX test shows good behaviour: 19:18:00 root@filer:/root/ iperf3 -c 10.21.10.4 Connecting to host 10.21.10.4, port 5201 [ 5] local 10.21.10.2 port 54437 connected to 10.21.10.4 port 5201 [ ID] Interval Transfer Bitrate Retr Cwnd [ 5] 0.00-1.00 sec 1.15 GBytes 9.90 Gbits/sec 0 1.09 MBytes=20= =20=20=20=20=20=20 [ 5] 1.00-2.00 sec 1.15 GBytes 9.88 Gbits/sec 0 1.09 MBytes=20= =20=20=20=20=20=20 [ 5] 2.00-3.00 sec 1.15 GBytes 9.89 Gbits/sec 0 1.09 MBytes=20= =20=20=20=20=20=20 [ 5] 3.00-4.00 sec 1.15 GBytes 9.90 Gbits/sec 0 1.09 MBytes=20= =20=20=20=20=20=20 [ 5] 4.00-5.00 sec 1.15 GBytes 9.90 Gbits/sec 0 1.09 MBytes=20= =20=20=20=20=20=20 [ 5] 5.00-6.00 sec 1.15 GBytes 9.89 Gbits/sec 0 1.09 MBytes=20= =20=20=20=20=20=20 [ 5] 6.00-7.00 sec 1.15 GBytes 9.89 Gbits/sec 0 1.09 MBytes=20= =20=20=20=20=20=20 [ 5] 7.00-8.00 sec 1.15 GBytes 9.88 Gbits/sec 0 1.09 MBytes=20= =20=20=20=20=20=20 [ 5] 8.00-9.00 sec 1.15 GBytes 9.90 Gbits/sec 0 1.09 MBytes=20= =20=20=20=20=20=20 [ 5] 9.00-10.00 sec 1.15 GBytes 9.90 Gbits/sec 0 1.09 MBytes=20= =20=20=20=20=20=20 - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bitrate Retr [ 5] 0.00-10.00 sec 11.5 GBytes 9.89 Gbits/sec 0 sender [ 5] 0.00-10.00 sec 11.5 GBytes 9.89 Gbits/sec recei= ver Re-check TSO counters, discover they haven't increased: 19:18:11 root@filer:/root/ sysctl dev.ix.0 | grep -i tso dev.ix.0.queue3.tso_tx: 0 dev.ix.0.queue2.tso_tx: 0 dev.ix.0.queue1.tso_tx: 0 dev.ix.0.queue0.tso_tx: 0 I'm pretty much out of ideas as to how to proceeed with diagnosis at this point. I'm happy to perform any further testing you may need, but disabling TSO seems to adequately solve the problem for me, so I'll just do that. If= you want to attempt to reproduce, I think our minimal config to reproduce is th= us: FreeBSD 12.0-Release (amd64) running with an X520-DA2 card installed, with = one port in a failover lagg, configured with a vlan-tagged interface on top, wi= th TSO enabled on ix in rc.conf. In case the platform is relevant, this machine is a Xeon E3-1245v3 (with HT disabled in BIOS), running on an ASRock C226WS with 4 x DDR3 ECC DIMMs installed. Kind regards, Nick --=20 You are receiving this mail because: You are the assignee for the bug.=