From nobody Thu Aug 4 17:12:48 2022 X-Original-To: stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4LzFfc4pMwz4YLXg for ; Thu, 4 Aug 2022 17:12:56 +0000 (UTC) (envelope-from mike@sentex.net) Received: from smarthost1.sentex.ca (smarthost1.sentex.ca [IPv6:2607:f3e0:0:1::12]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "smarthost1.sentex.ca", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4LzFfb6xLlz3WWS for ; Thu, 4 Aug 2022 17:12:55 +0000 (UTC) (envelope-from mike@sentex.net) Received: from pyroxene2a.sentex.ca (pyroxene19.sentex.ca [199.212.134.19]) by smarthost1.sentex.ca (8.16.1/8.16.1) with ESMTPS id 274HCm9O010296 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL); Thu, 4 Aug 2022 13:12:48 -0400 (EDT) (envelope-from mike@sentex.net) Received: from [IPV6:2607:f3e0:0:4:2d36:de3c:cb2a:e375] ([IPv6:2607:f3e0:0:4:2d36:de3c:cb2a:e375]) by pyroxene2a.sentex.ca (8.16.1/8.15.2) with ESMTPS id 274HCmoP077918 (version=TLSv1.3 cipher=TLS_AES_128_GCM_SHA256 bits=128 verify=NO); Thu, 4 Aug 2022 13:12:48 -0400 (EDT) (envelope-from mike@sentex.net) Message-ID: <59b9cec0-d8c2-ce72-b5e9-99d1a1e807f8@sentex.net> Date: Thu, 4 Aug 2022 13:12:48 -0400 List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:102.0) Gecko/20100101 Thunderbird/102.1.0 Subject: Re: igc problems with heavy traffic Content-Language: en-US To: Jim King , stable@freebsd.org References: From: mike tancsa In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit X-Scanned-By: MIMEDefang 2.84 on 64.7.153.18 X-Rspamd-Queue-Id: 4LzFfb6xLlz3WWS X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of mike@sentex.net designates 2607:f3e0:0:1::12 as permitted sender) smtp.mailfrom=mike@sentex.net X-Spamd-Result: default: False [-3.40 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-1.000]; R_SPF_ALLOW(-0.20)[+ip6:2607:f3e0::/32]; MIME_GOOD(-0.10)[text/plain]; RCVD_IN_DNSWL_LOW(-0.10)[199.212.134.19:received]; ASN(0.00)[asn:11647, ipnet:2607:f3e0::/32, country:CA]; MLMMJ_DEST(0.00)[stable@freebsd.org]; MIME_TRACE(0.00)[0:+]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_ALL(0.00)[]; R_DKIM_NA(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; FREEFALL_USER(0.00)[mike]; MID_RHS_MATCH_FROM(0.00)[]; FROM_HAS_DN(0.00)[]; DMARC_NA(0.00)[sentex.net]; TO_DN_SOME(0.00)[]; ARC_NA(0.00)[] X-ThisMailContainsUnwantedMimeParts: N On 7/31/2022 11:41 PM, Jim King wrote: > I'm trying to use a Qnap dual port 2.5Gb NIC with FreeBSD 13.1. > FreeBSD recognizes the NIC and I'm able to connect to my LAN at 1Gb.  > However, trying to push heavy traffic through the NIC results in a > temporary loss of connectivity:  traffic stops and the message "igc0: > link state changed to DOWN" appears in the system log.  About 10 > seconds later the message "igc0: link state changed to UP" is logged, > followed by some messages from dhclient indicating that it has > acquired a lease.  At that point network connectivity works normally, > until I try to push a lot of traffic again.  I've been able to trigger > this every time using iperf3 from another PC on my LAN, and by using > Ookla's speedtest client (my Internet service is good for about 900 > Mbps). > How long does it take to wedge the nic ? I have a pair of Topton routers (4 IGC NICs) back to back and a simple iperf3 test seems to work ok between the 2 units.  iperf3 -c 10.1.255.168 Connecting to host 10.1.255.168, port 5201 [  5] local 10.1.255.209 port 55168 connected to 10.1.255.168 port 5201 [ ID] Interval           Transfer     Bitrate         Retr  Cwnd [  5]   0.00-1.00   sec   282 MBytes  2.36 Gbits/sec    0   1.07 MBytes [  5]   1.00-2.00   sec   281 MBytes  2.35 Gbits/sec    0   1.07 MBytes [  5]   2.00-3.00   sec   281 MBytes  2.35 Gbits/sec    0   1.07 MBytes [  5]   3.00-4.00   sec   281 MBytes  2.35 Gbits/sec    0   1.07 MBytes [  5]   4.00-5.00   sec   281 MBytes  2.35 Gbits/sec    0   1.07 MBytes [  5]   5.00-6.00   sec   281 MBytes  2.35 Gbits/sec    0   1.07 MBytes [  5]   6.00-7.00   sec   281 MBytes  2.35 Gbits/sec    0   1.07 MBytes [  5]   7.00-8.00   sec   281 MBytes  2.35 Gbits/sec    0   1.07 MBytes [  5]   8.00-9.00   sec   281 MBytes  2.35 Gbits/sec    0   1.07 MBytes [  5]   9.00-10.00  sec   281 MBytes  2.35 Gbits/sec    0   1.07 MBytes - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval           Transfer     Bitrate         Retr [  5]   0.00-10.00  sec  2.74 GBytes  2.35 Gbits/sec 0             sender [  5]   0.00-10.00  sec  2.74 GBytes  2.35 Gbits/sec                  receiver iperf Done. Doing iperf3 -R -P4 -c 10.1.255.168 seems to work as well - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval           Transfer     Bitrate         Retr [  5]   0.00-10.00  sec   936 MBytes   785 Mbits/sec 0             sender [  5]   0.00-10.00  sec   935 MBytes   785 Mbits/sec                  receiver [  7]   0.00-10.00  sec   658 MBytes   552 Mbits/sec 0             sender [  7]   0.00-10.00  sec   658 MBytes   552 Mbits/sec                  receiver [  9]   0.00-10.00  sec   936 MBytes   785 Mbits/sec 0             sender [  9]   0.00-10.00  sec   935 MBytes   785 Mbits/sec                  receiver [ 11]   0.00-10.00  sec   278 MBytes   233 Mbits/sec 0             sender [ 11]   0.00-10.00  sec   278 MBytes   233 Mbits/sec                  receiver [SUM]   0.00-10.00  sec  2.74 GBytes  2.36 Gbits/sec 0             sender [SUM]   0.00-10.00  sec  2.74 GBytes  2.35 Gbits/sec                  receiver Similarly, just doing perf3 -t60  -c 10.1.255.168 seems to work ok too - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval           Transfer     Bitrate         Retr [  5]   0.00-60.06  sec  16.0 GBytes  2.29 Gbits/sec 4             sender [  5]   0.00-61.60  sec  16.0 GBytes  2.23 Gbits/sec                  receiver     ---Mike