From nobody Wed Jul 26 19:45:06 2023 X-Original-To: freebsd-net@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RB4B74TmXz4p9GL for ; Wed, 26 Jul 2023 19:45:19 +0000 (UTC) (envelope-from kevin.bowling@kev009.com) Received: from mail-pj1-x1032.google.com (mail-pj1-x1032.google.com [IPv6:2607:f8b0:4864:20::1032]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RB4B724HYz3MC4 for ; Wed, 26 Jul 2023 19:45:19 +0000 (UTC) (envelope-from kevin.bowling@kev009.com) Authentication-Results: mx1.freebsd.org; none Received: by mail-pj1-x1032.google.com with SMTP id 98e67ed59e1d1-26814e27a9eso156278a91.0 for ; Wed, 26 Jul 2023 12:45:19 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=kev009.com; s=google; t=1690400718; x=1691005518; h=content-transfer-encoding:cc:to:subject:message-id:date:from :in-reply-to:references:mime-version:from:to:cc:subject:date :message-id:reply-to; bh=yeYQzWTUJ6K+jFhCWf6osIQSYQOzd3cvY1J1DPoWf24=; b=pDIqYxsfqJXLHKId0rQP+MHKTdimbb7cJaS4p9lz6OPwsird5P0maptgvT+2vNJNxT g4T8kAez5CM4YawqQfkJIh+WUkyRIzsDjEFbWPQ0bxOPhMc0CSgrJSJEdO9iojK/dWrQ Ushqz1dhEWYUkSuZ2+sKS9TF9ACrpjPFv1ArQ= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20221208; t=1690400718; x=1691005518; h=content-transfer-encoding:cc:to:subject:message-id:date:from :in-reply-to:references:mime-version:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=yeYQzWTUJ6K+jFhCWf6osIQSYQOzd3cvY1J1DPoWf24=; b=FSgqJF9FR7/GqEVzekHzyIGnyeQwCDnCgfPQLtQickvCv3b2Qg6g7KvkDrcPSgYsn0 uWue2hxiI2Z/sw4vrHazG69G8U7WzGin5n8uxqpk+f0pbpQ+42rVQ6cg4T+TPn21lPva O+69IhBKlJn+uSuJeEIgfgCE2ybOlTQJ1DSh2EI3HbPXSgdAmSc8U9WsUAMLWdWMAk3k 5+8rUczB0Uz7Wy+KouD2DqZNgdB2x6L8UcfIriwnqurNYwpem5xeicStQzoG4ZiRkjrm iKuOiAqF2ru8FvWwoFb13JVlhDzSh5nInezlty1yS6mTv0w80C/IEAE/8lPgv3oWTH5C K6Uw== X-Gm-Message-State: ABy/qLahVeGRg+ga6n3hV9DN8oC35JQ4sk4ZUjj6jQ2jT1zvMqEY3GL6 coDKv0veF5fseh/73a8wMDXWPhq5lWzSM1ZidVcUrIx6zMAZvrCqMW0= X-Google-Smtp-Source: APBJJlEH+OLJuQ2iNN8mwB+8QdoEuHhQ0voJ2aE9nU2jDSsiNyPZ+18QoOFQpGwzLMW1S8B4SmMXx7D/bx/YN9jAtJ8= X-Received: by 2002:a17:90a:400e:b0:268:5bed:708e with SMTP id u14-20020a17090a400e00b002685bed708emr1388402pjc.24.1690400717763; Wed, 26 Jul 2023 12:45:17 -0700 (PDT) List-Id: Networking and TCP/IP with FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-net List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-net@freebsd.org MIME-Version: 1.0 References: In-Reply-To: From: Kevin Bowling Date: Wed, 26 Jul 2023 12:45:06 -0700 Message-ID: Subject: Re: tcp and udp traffic over IPv6 does not work from the latest e1000 git change 918c25677d To: Cheng Cui Cc: "freebsd-net@FreeBSD.org" Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Rspamd-Queue-Id: 4RB4B724HYz3MC4 X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US] X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated Hi Cheng, Have you applied https://reviews.freebsd.org/D41170? Can you also try 'ifconfig emXX -txcsum6' on the DUT? On Wed, Jul 26, 2023 at 12:37=E2=80=AFPM Cheng Cui wrote: > > Hello Kevin, > > TCP and UDP traffic over IPv4 are working, but not over IPv6. > On a pair of FreeBSD 14.0-CURRENT nodes that are using a kernel containin= g the latest e1000 git change 918c25677d: > > root@s1:~ # uname -a > FreeBSD s1.testsiftr.fbsd-transport.emulab.net 14.0-CURRENT FreeBSD 14.0-= CURRENT amd64 1400093 #0 main-918c25677d-dirty: Sat Jul 22 14:43:31 MDT 202= 3 cc@n1.buildbsd14.fbsd-transport.emulab.net:/usr/obj/usr/src/amd64.amd= 64/sys/TESTBED-GENERIC amd64 > root@s1:~ # > > root@s1:~ # ping6 -c 3 fd00::3 > PING6(56=3D40+8+8 bytes) fd00::2 --> fd00::3 > 16 bytes from fd00::3, icmp_seq=3D0 hlim=3D64 time=3D0.393 ms > 16 bytes from fd00::3, icmp_seq=3D1 hlim=3D64 time=3D0.171 ms > 16 bytes from fd00::3, icmp_seq=3D2 hlim=3D64 time=3D0.276 ms > > --- fd00::3 ping6 statistics --- > 3 packets transmitted, 3 packets received, 0.0% packet loss > round-trip min/avg/max/std-dev =3D 0.171/0.280/0.393/0.091 ms > > root@s1:~ # ifconfig em4 > em4: flags=3D1008843 met= ric 0 mtu 1500 > options=3D4e104bb > ether 00:04:23:b7:40:ac > inet 10.1.1.2 netmask 0xffffff00 broadcast 10.1.1.255 > inet6 fd00::2 prefixlen 64 > inet6 fe80::204:23ff:feb7:40ac%em4 prefixlen 64 scopeid 0x5 > media: Ethernet 1000baseT > status: active > nd6 options=3D21 > > root@s1:~ # dmesg | grep em4 > em4: port 0xacc0-0xacff me= m 0xdf3e0000-0xdf3fffff irq 101 at device 3.0 on pci10 > em4: EEPROM V15.255-15 > em4: Using 1024 TX descriptors and 1024 RX descriptors > em4: Ethernet address: 00:04:23:b7:40:ac > em4: netmap queues/slots: TX 1/1024, RX 1/1024 > > root@r1:~ # ifconfig em4 > em4: flags=3D1008843 met= ric 0 mtu 1500 > options=3D4e104bb > ether 00:04:23:b7:40:1c > inet 10.1.1.3 netmask 0xffffff00 broadcast 10.1.1.255 > inet6 fd00::3 prefixlen 64 > inet6 fe80::204:23ff:feb7:401c%em4 prefixlen 64 scopeid 0x5 > media: Ethernet 1000baseT > status: active > nd6 options=3D21 > > root@r1:~ # dmesg | grep em4 > em4: port 0xacc0-0xacff me= m 0xdf3e0000-0xdf3fffff irq 101 at device 3.0 on pci10 > em4: EEPROM V15.255-15 > em4: Using 1024 TX descriptors and 1024 RX descriptors > em4: Ethernet address: 00:04:23:b7:40:1c > em4: netmap queues/slots: TX 1/1024, RX 1/1024 > > > TCP connection timed out > root@s1:~ # iperf -Vc fd00::3 -n 2K > ------------------------------------------------------------ > Client connecting to fd00::3, TCP port 5001 > TCP window size: 32.0 KByte (default) > ------------------------------------------------------------ > tcp connect failed: Operation timed out > [ 1] local :: port 0 connected with fd00::3 port 5001 > > server side has no response: > root@r1:~ # iperf -VsB fd00::3 > ------------------------------------------------------------ > Server listening on TCP port 5001 > TCP window size: 64.0 KByte (default) > ------------------------------------------------------------ > > UDP traffic does not work either, and the UDP server has no response: > root@s1:~ # iperf -Vc fd00::3 --udp -n 2K > ------------------------------------------------------------ > Client connecting to fd00::3, UDP port 5001 > Sending 1450 byte datagrams, IPG target: 11062.62 us (kalman adjust) > UDP buffer size: 9.00 KByte (default) > ------------------------------------------------------------ > [ 1] local fd00::2 port 54362 connected with fd00::3 port 5001 > [ ID] Interval Transfer Bandwidth > [ 1] 0.00-0.01 sec 3.42 KBytes 2.36 Mbits/sec > [ 1] Sent 4 datagrams > [ 3] WARNING: did not receive ack of last datagram after 1 tries. > > root@r1:~ # iperf -VsB fd00::3 --udp > ------------------------------------------------------------ > Server listening on UDP port 5001 > UDP buffer size: 41.1 KByte (default) > ------------------------------------------------------------ > > > > On a new pair of nodes that use a kernel with backed out the latest em gi= t change 918c25677d. Same em chip 82546EB. > root@s1:~ # uname -a > FreeBSD s1.testem.fbsd-transport.emulab.net 14.0-CURRENT FreeBSD 14.0-CUR= RENT amd64 1400093 #0 22dca7acf7-dirty: Wed Jul 26 08:18:23 MDT 2023 cc= @n1.emtest.fbsd-transport.emulab.net:/usr/obj/usr/src/amd64.amd64/sys/TESTB= ED-GENERIC amd64 > > cc@s1:~ % ifconfig em2 > em2: flags=3D1008843 met= ric 0 mtu 1500 > options=3D481009b > ether 00:04:23:b7:12:be > inet 10.1.1.2 netmask 0xffffff00 broadcast 10.1.1.255 > inet6 fd00::2 prefixlen 64 > inet6 fe80::204:23ff:feb7:12be%em2 prefixlen 64 scopeid 0x3 > media: Ethernet 1000baseT > status: active > nd6 options=3D21 > > cc@r1:~ % ifconfig em2 > em2: flags=3D1008843 met= ric 0 mtu 1500 > options=3D481009b > ether 00:04:23:b7:15:58 > inet 10.1.1.3 netmask 0xffffff00 broadcast 10.1.1.255 > inet6 fd00::3 prefixlen 64 > inet6 fe80::204:23ff:feb7:1558%em2 prefixlen 64 scopeid 0x3 > media: Ethernet 1000baseT > status: active > nd6 options=3D21 > > cc@s1:~ % ping6 -c 3 fd00::3 > PING6(56=3D40+8+8 bytes) fd00::2 --> fd00::3 > 16 bytes from fd00::3, icmp_seq=3D0 hlim=3D64 time=3D0.637 ms > 16 bytes from fd00::3, icmp_seq=3D1 hlim=3D64 time=3D0.236 ms > 16 bytes from fd00::3, icmp_seq=3D2 hlim=3D64 time=3D0.290 ms > > --- fd00::3 ping6 statistics --- > 3 packets transmitted, 3 packets received, 0.0% packet loss > round-trip min/avg/max/std-dev =3D 0.236/0.388/0.637/0.178 ms > > TCP traffic works: > > root@s1:~ # iperf -Vc fd00::3 -n 2K > ------------------------------------------------------------ > Client connecting to fd00::3, TCP port 5001 > TCP window size: 32.3 KByte (default) > ------------------------------------------------------------ > [ 1] local fd00::2 port 27164 connected with fd00::3 port 5001 > [ ID] Interval Transfer Bandwidth > [ 1] 0.00-0.02 sec 2.00 KBytes 858 Kbits/sec > > cc@r1:~ % iperf -VsB fd00::3 > ------------------------------------------------------------ > Server listening on TCP port 5001 > TCP window size: 64.0 KByte (default) > ------------------------------------------------------------ > [ 1] local fd00::3 port 5001 connected with fd00::2 port 27164 > [ ID] Interval Transfer Bandwidth > [ 1] 0.00-0.00 sec 2.00 KBytes 0.000 bits/sec > > UDP traffic also works: > > root@s1:~ # iperf -Vc fd00::3 --udp -n 2K > ------------------------------------------------------------ > Client connecting to fd00::3, UDP port 5001 > Sending 1450 byte datagrams, IPG target: 11062.62 us (kalman adjust) > UDP buffer size: 9.00 KByte (default) > ------------------------------------------------------------ > [ 1] local fd00::2 port 64612 connected with fd00::3 port 5001 > [ ID] Interval Transfer Bandwidth > [ 1] 0.00-0.01 sec 3.42 KBytes 2.36 Mbits/sec > [ 1] Sent 4 datagrams > [ 1] Server Report: > [ ID] Interval Transfer Bandwidth Jitter Lost/Total Da= tagrams > [ 1] 0.00-0.01 sec 3.42 KBytes 2.38 Mbits/sec 0.010 ms 0/3 (0%) > > cc@r1:~ % iperf -VsB fd00::3 --udp > ------------------------------------------------------------ > Server listening on UDP port 5001 > UDP buffer size: 41.1 KByte (default) > ------------------------------------------------------------ > [ 1] local fd00::3 port 5001 connected with fd00::2 port 64612 > [ ID] Interval Transfer Bandwidth Jitter Lost/Total Da= tagrams > [ 1] 0.00-0.01 sec 3.42 KBytes 2.38 Mbits/sec 0.011 ms 0/3 (0%) > > Best Regards, > Cheng Cui