From nobody Thu Aug 4 17:29:26 2022 X-Original-To: stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4LzG1g73vbz4YP6x for ; Thu, 4 Aug 2022 17:29:27 +0000 (UTC) (envelope-from mike@sentex.net) Received: from smarthost1.sentex.ca (smarthost1.sentex.ca [IPv6:2607:f3e0:0:1::12]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "smarthost1.sentex.ca", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4LzG1g1mv2z3YTT; Thu, 4 Aug 2022 17:29:27 +0000 (UTC) (envelope-from mike@sentex.net) Received: from pyroxene2a.sentex.ca (pyroxene19.sentex.ca [199.212.134.19]) by smarthost1.sentex.ca (8.16.1/8.16.1) with ESMTPS id 274HTQOa031115 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL); Thu, 4 Aug 2022 13:29:26 -0400 (EDT) (envelope-from mike@sentex.net) Received: from [IPV6:2607:f3e0:0:4:2d36:de3c:cb2a:e375] ([IPv6:2607:f3e0:0:4:2d36:de3c:cb2a:e375]) by pyroxene2a.sentex.ca (8.16.1/8.15.2) with ESMTPS id 274HTQ40083471 (version=TLSv1.3 cipher=TLS_AES_128_GCM_SHA256 bits=128 verify=NO); Thu, 4 Aug 2022 13:29:26 -0400 (EDT) (envelope-from mike@sentex.net) Message-ID: Date: Thu, 4 Aug 2022 13:29:26 -0400 List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:102.0) Gecko/20100101 Thunderbird/102.1.0 Subject: Re: igc problems with heavy traffic Content-Language: en-US From: mike tancsa To: Jim King , stable@freebsd.org, kbowling@FreeBSD.org References: <59b9cec0-d8c2-ce72-b5e9-99d1a1e807f8@sentex.net> In-Reply-To: <59b9cec0-d8c2-ce72-b5e9-99d1a1e807f8@sentex.net> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit X-Scanned-By: MIMEDefang 2.84 on 64.7.153.18 X-Rspamd-Queue-Id: 4LzG1g1mv2z3YTT X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of mike@sentex.net designates 2607:f3e0:0:1::12 as permitted sender) smtp.mailfrom=mike@sentex.net X-Spamd-Result: default: False [-3.40 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.999]; R_SPF_ALLOW(-0.20)[+ip6:2607:f3e0::/32]; MIME_GOOD(-0.10)[text/plain]; RCVD_IN_DNSWL_LOW(-0.10)[199.212.134.19:received]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_ALL(0.00)[]; MLMMJ_DEST(0.00)[stable@freebsd.org]; FROM_EQ_ENVFROM(0.00)[]; ASN(0.00)[asn:11647, ipnet:2607:f3e0::/32, country:CA]; R_DKIM_NA(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; MID_RHS_MATCH_FROM(0.00)[]; FROM_HAS_DN(0.00)[]; FREEFALL_USER(0.00)[mike]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; DMARC_NA(0.00)[sentex.net]; TO_DN_SOME(0.00)[]; ARC_NA(0.00)[] X-ThisMailContainsUnwantedMimeParts: N On 8/4/2022 1:12 PM, mike tancsa wrote: > On 7/31/2022 11:41 PM, Jim King wrote: >> I'm trying to use a Qnap dual port 2.5Gb NIC with FreeBSD 13.1. >> FreeBSD recognizes the NIC and I'm able to connect to my LAN at 1Gb.  >> However, trying to push heavy traffic through the NIC results in a >> temporary loss of connectivity:  traffic stops and the message "igc0: >> link state changed to DOWN" appears in the system log.  About 10 >> seconds later the message "igc0: link state changed to UP" is logged, >> followed by some messages from dhclient indicating that it has >> acquired a lease.  At that point network connectivity works normally, >> until I try to push a lot of traffic again.  I've been able to >> trigger this every time using iperf3 from another PC on my LAN, and >> by using Ookla's speedtest client (my Internet service is good for >> about 900 Mbps). >> > How long does it take to wedge the nic ? I have a pair of Topton > routers (4 IGC NICs) back to back and a simple iperf3 test seems to > work ok between the 2 units. > Actually, I was able to reproduce this too running iperf3 -P4 for about 60 seconds. Watching via sysutils/ifstat, it does indeed drop traffic when the link drops ifstat -b        igc0                igc1               pflog0  Kbps in  Kbps out   Kbps in  Kbps out   Kbps in  Kbps out     0.88      1.93      0.00      0.00      0.00      0.00     1.32      1.45      0.00      0.00      0.00      0.00     0.88      1.45      0.00      0.00      0.00      0.00     1.32      1.45      0.00      0.00      0.00      0.00     0.88      1.45      0.00      0.00      0.00      0.00     0.88      1.45      0.00      0.00      0.00      0.00     4.68     12.23   2497.66  395238.6      0.00      2.34     0.94      6.08  15036.53  2.31e+06      0.00      0.00     0.94      7.26  15076.75  2.31e+06      0.00      0.00     0.94      6.08  15014.83  2.31e+06      0.00      0.00     0.94      7.26  15054.63  2.31e+06      0.00      0.00     0.94      7.26  15022.16  2.31e+06      0.00      0.00     0.94      7.25  14928.42  2.31e+06      0.00      0.00     1.87      7.25  15000.98  2.31e+06      0.00      0.00     1.40      7.25  14960.84  2.31e+06      0.00      0.00     1.40      7.25  14919.44  2.31e+06      0.00      0.00     1.87      7.26  14789.44  2.31e+06      0.00      0.00     2.70      8.56   1168.12  178704.6      0.00      0.00     1.77      6.85      0.00      0.00      0.00      0.00     1.40      9.97      0.00      0.00      0.00      0.00     1.87      7.26  10732.92  1.83e+06      0.00      0.00     0.94      7.25  14166.38  2.32e+06      0.00      0.00     0.94      6.09  14269.06  2.31e+06      0.00      0.00     1.40      6.09  14402.47  2.31e+06      0.00      0.00 This is on 13.1-STABLE from Aug 3. igc0@pci0:2:0:0:        class=0x020000 rev=0x03 hdr=0x00 vendor=0x8086 device=0x15f3 subvendor=0x8086 subdevice=0x0000     vendor     = 'Intel Corporation'     device     = 'Ethernet Controller I225-V'     class      = network     subclass   = ethernet     bar   [10] = type Memory, range 32, base 0x80600000, size 1048576, enabled     bar   [1c] = type Memory, range 32, base 0x80700000, size 16384, enabled     cap 01[40] = powerspec 3  supports D0 D3  current D0     cap 05[50] = MSI supports 1 message, 64 bit, vector masks     cap 11[70] = MSI-X supports 5 messages, enabled                  Table in map 0x1c[0x0], PBA in map 0x1c[0x2000]     cap 10[a0] = PCI-Express 2 endpoint max data 256(512) FLR RO NS                  max read 512                  link x1(x1) speed 5.0(5.0) ASPM L1(L1)     ecap 0001[100] = AER 2 0 fatal 0 non-fatal 0 corrected     ecap 0003[140] = Serial 1 00e269ffff5a4be9     ecap 0018[1c0] = LTR 1     ecap 001f[1f0] = Precision Time Measurement 1     ecap 001e[1e0] = L1 PM Substates 1 Jasper Lake chipset N5105 CPU 2.00GHz     ---Mike