From owner-freebsd-stable@freebsd.org Wed Aug 7 16:27:20 2019 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 51BD0AF4D1 for ; Wed, 7 Aug 2019 16:27:20 +0000 (UTC) (envelope-from gcr+freebsd-stable@tharned.org) Received: from roadkill.tharned.org (tunnel294749-pt.tunnel.tserv9.chi1.ipv6.he.net [IPv6:2001:470:1f10:107f::2]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "tharned.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 463cNQ4t1dz3QfR for ; Wed, 7 Aug 2019 16:27:18 +0000 (UTC) (envelope-from gcr+freebsd-stable@tharned.org) Received: from flake.tharned.org ([IPv6:2001:470:1f11:107f:6e:6ea1:3618:4705]) (authenticated bits=0) by roadkill.tharned.org (8.15.2/8.15.2) with ESMTPSA id x77GRAwx012204 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NO); Wed, 7 Aug 2019 11:27:11 -0500 (CDT) (envelope-from gcr+freebsd-stable@tharned.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=tharned.org; s=2017; t=1565195232; bh=SzAnZJoacTFPz6NS07STjqP6oJ5aoW0rbQKHE/xd1bI=; h=From:To:Cc:Subject:Date:In-Reply-To:References; b=EaFAFLff9wL2t0vif4xyjXLLOqfNJxKM3UQuhbwJrmZ9nTbxZ3/EkplI5CSdA/rEU /tKN8yvSUiYEFOCgPsqBSiC6y2h3vsxWGrH3l2TZKZx391MOwf0JyBJkyOwTGbFyoT 1Zo3X3+RYpOeln/mSBDi71Z44HBErq5FQPEAoo0oEQxjr5N1AMGrUUn14+T7r4v8PZ 4Vs2YXgB8YntXcKj2826Ksy4Zpzp9+IQSt0BWF7i7NogPb8xQf3Az16raZP6i5vvQr uOY7/ebEgNhsYKYArRvfF7kbSYMvNlzLWRAZT7oNxzuXBj7iRLKS75m5Z7Du79tGZV A31lWudmV+2nQ== X-Authentication-Warning: roadkill.tharned.org: Host [IPv6:2001:470:1f11:107f:6e:6ea1:3618:4705] claimed to be flake.tharned.org From: Greg Rivers To: freebsd-stable@freebsd.org Cc: Sergey Akhmatov Subject: Re: Regression in IXGBE(4) on 12.0-RELEASE? Date: Wed, 07 Aug 2019 11:27:10 -0500 Message-ID: <1955050.cYikG52F1y@no.place.like.home> In-Reply-To: References: <15504838.vxEf1mJfsr@no.place.like.home> MIME-Version: 1.0 Content-Transfer-Encoding: 7Bit Content-Type: text/plain; charset="us-ascii" X-Greylist: Sender succeeded SMTP AUTH, not delayed by milter-greylist-4.6.2 (roadkill.tharned.org [IPv6:2001:470:1f10:107f:0:0:0:2]); Wed, 07 Aug 2019 11:27:12 -0500 (CDT) X-Rspamd-Queue-Id: 463cNQ4t1dz3QfR X-Spamd-Bar: ----- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=tharned.org header.s=2017 header.b=EaFAFLff; dmarc=none; spf=none (mx1.freebsd.org: domain of gcr@tharned.org has no SPF policy when checking 2001:470:1f10:107f::2) smtp.mailfrom=gcr@tharned.org X-Spamd-Result: default: False [-5.29 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_DKIM_ALLOW(-0.20)[tharned.org:s=2017]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; DWL_DNSWL_MED(-2.00)[tharned.org.dwl.dnswl.org : 127.0.6.2]; IP_SCORE(-1.49)[ipnet: 2001:470::/32(-4.49), asn: 6939(-2.93), country: US(-0.05)]; MIME_GOOD(-0.10)[text/plain]; HAS_XAW(0.00)[]; DMARC_NA(0.00)[tharned.org]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_TRACE(0.00)[0:+]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[tharned.org:+]; RCPT_COUNT_TWO(0.00)[2]; NEURAL_HAM_SHORT(-0.99)[-0.993,0]; R_SPF_NA(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; SUBJECT_ENDS_QUESTION(1.00)[]; CTE_CASE(0.50)[]; ASN(0.00)[asn:6939, ipnet:2001:470::/32, country:US]; TAGGED_FROM(0.00)[freebsd-stable]; RCVD_TLS_ALL(0.00)[]; RCVD_COUNT_TWO(0.00)[2] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 07 Aug 2019 16:27:20 -0000 On Wednesday, August 7, 2019 10:14:01 AM CDT Sergey Akhmatov wrote: > $ freebsd-version > 12.0-RELEASE-p7 > > $ pciconf -lvc ix0 > ix0@pci0:17:0:0: class=0x020000 card=0x7a128086 chip=0x10fb8086 > rev=0x01 hdr=0x00 > vendor = 'Intel Corporation' > device = '82599ES 10-Gigabit SFI/SFP+ Network Connection' > class = network > subclass = ethernet > cap 01[40] = powerspec 3 supports D0 D3 current D0 > cap 05[50] = MSI supports 1 message, 64 bit, vector masks > cap 11[70] = MSI-X supports 64 messages, enabled > Table in map 0x20[0x0], PBA in map 0x20[0x2000] > cap 10[a0] = PCI-Express 2 endpoint max data 256(512) FLR RO NS > link x8(x8) speed 5.0(5.0) ASPM disabled(L0s) > ecap 0001[100] = AER 1 0 fatal 0 non-fatal 1 corrected > ecap 0003[140] = Serial 1 90e2baffff809b08 > ecap 000e[150] = ARI 1 > ecap 0010[160] = SR-IOV 1 IOV disabled, Memory Space disabled, ARI > disabled > 0 VFs configured out of 64 supported > First VF RID Offset 0x0180, VF RID Stride 0x0002 > VF Device ID 0x10ed > Page Sizes: 4096 (enabled), 8192, 65536, 262144, > 1048576, 4194304 > Thank you Sergey. Good call adding -c to list capabilities. There are some differences between your card and mine (I also added -e to list errors): $ freebsd-version 12.0-RELEASE-p9 $ pciconf -lvce ix0 ix0@pci0:17:0:0: class=0x020000 card=0x17d3103c chip=0x10fb8086 rev=0x01 hdr=0x00 vendor = 'Intel Corporation' device = '82599ES 10-Gigabit SFI/SFP+ Network Connection' class = network subclass = ethernet cap 01[40] = powerspec 3 supports D0 D3 current D0 cap 05[50] = MSI supports 1 message, 64 bit, vector masks enabled with 1 message cap 11[70] = MSI-X supports 64 messages Table in map 0x1c[0x0], PBA in map 0x1c[0x2000] cap 10[a0] = PCI-Express 2 endpoint max data 256(512) FLR RO NS link x8(x8) speed 5.0(5.0) ASPM disabled(L0s) cap 03[e0] = VPD ecap 0001[100] = AER 1 0 fatal 0 non-fatal 1 corrected ecap 0003[140] = Serial 1 48df37ffff62be38 ecap 000e[150] = ARI 1 ecap 0010[160] = SR-IOV 1 IOV disabled, Memory Space disabled, ARI enabled 0 VFs configured out of 64 supported First VF RID Offset 0x0080, VF RID Stride 0x0002 VF Device ID 0x10ed Page Sizes: 4096 (enabled), 8192, 65536, 262144, 1048576, 4194304 PCI-e errors = Correctable Error Detected Unsupported Request Detected Corrected = Advisory Non-Fatal Error I confirmed that it's not just a difference between hosts; when I boot the 11.3-RELEASE memstick image on this very same machine the NIC is properly configured with all 8 queues. So it's almost certainly a difference between ixgbe driver versions. I don't know if it matters, but this is an HPE branded Intel NIC in a DL380 Gen10. -- Greg