From owner-freebsd-net@freebsd.org Sun Mar 14 01:03:36 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id E0DBD56B572 for ; Sun, 14 Mar 2021 01:03:36 +0000 (UTC) (envelope-from bc979@lafn.org) Received: from mail.sermon-archive.info (sermon-archive.info [47.181.130.121]) by mx1.freebsd.org (Postfix) with ESMTP id 4DyhBb73vQz4QtQ for ; Sun, 14 Mar 2021 01:03:35 +0000 (UTC) (envelope-from bc979@lafn.org) Received: from [10.0.1.251] (mini [10.0.1.251]) by mail.sermon-archive.info (Postfix) with ESMTPSA id 4DyhBT4wL4z2fjQB for ; Sat, 13 Mar 2021 17:03:29 -0800 (PST) From: Doug Hardie Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable Mime-Version: 1.0 (Mac OS X Mail 14.0 \(3654.60.0.2.21\)) Subject: IPv6 Startup Message-Id: <06A12556-0C24-48AD-9D1C-C04491AADAF6@sermon-archive.info> Date: Sat, 13 Mar 2021 17:03:29 -0800 To: freebsd-net@freebsd.org X-Mailer: Apple Mail (2.3654.60.0.2.21) X-Virus-Scanned: clamav-milter 0.103.0 at mail X-Virus-Status: Clean X-Rspamd-Queue-Id: 4DyhBb73vQz4QtQ X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of bc979@lafn.org designates 47.181.130.121 as permitted sender) smtp.mailfrom=bc979@lafn.org X-Spamd-Result: default: False [-2.70 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FROM_HAS_DN(0.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[47.181.130.121:from]; MV_CASE(0.50)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[text/plain]; TO_DN_NONE(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-net@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; SPAMHAUS_ZRD(0.00)[47.181.130.121:from:127.0.2.255]; DMARC_NA(0.00)[lafn.org: no valid DMARC record]; R_SPF_ALLOW(-0.20)[+mx]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-1.000]; RCVD_NO_TLS_LAST(0.10)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:5650, ipnet:47.181.128.0/18, country:US]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[freebsd-net] X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 14 Mar 2021 01:03:36 -0000 I have two systems on the same ethernet. One is configured as a router, = the other as a host. rtadvd is running on the router, rtsold on the = host, and route6d on both. The router was up and running and I = initiated tcpdump of ip6 packets on the interface. Then I booted the = host. The results are interesting: 22:26:17.963393 IP6 (hlim 255, next-header ICMPv6 (58) payload length: = 16) fe80::aa60:b6ff:fe1d:8dbc > ff02::2: [icmp6 sum ok] ICMP6, router = solicitation, length 16 source link-address option (1), length 8 (1): = a8:60:b6:1d:8d:bc 0x0000: 6000 0000 0010 3aff fe80 0000 0000 0000 0x0010: aa60 b6ff fe1d 8dbc ff02 0000 0000 0000 0x0020: 0000 0000 0000 0002 8500 a2b8 0000 0000 0x0030: 0101 a860 b61d 8dbc 22:26:17.997455 IP6 (hlim 255, next-header ICMPv6 (58) payload length: = 56) fe80::3e18:a0ff:fe44:765b > ff02::1: [icmp6 sum ok] ICMP6, router = advertisement, length 56 hop limit 64, Flags [none], pref medium, router lifetime 1800s, = reachable time 0ms, retrans timer 0ms source link-address option (1), length 8 (1): = 3c:18:a0:44:76:5b prefix info option (3), length 32 (4): fec2::/64, Flags = [onlink, auto], valid time 2592000s, pref. time 604800s 0x0000: 6000 0000 0038 3aff fe80 0000 0000 0000 0x0010: 3e18 a0ff fe44 765b ff02 0000 0000 0000 0x0020: 0000 0000 0000 0001 8600 8356 4000 0708 0x0030: 0000 0000 0000 0000 0101 3c18 a044 765b 0x0040: 0304 40c0 0027 8d00 0009 3a80 0000 0000 0x0050: fec2 0000 0000 0000 0000 0000 0000 0000 22:26:18.011402 IP6 (hlim 255, next-header ICMPv6 (58) payload length: = 32) :: > ff02::1:ff00:210: [icmp6 sum ok] ICMP6, neighbor solicitation, = length 32, who has fec2::210 unknown option (14), length 8 (1):=20 0x0000: cc1a 5611 b76a 0x0000: 6000 0000 0020 3aff 0000 0000 0000 0000 0x0010: 0000 0000 0000 0000 ff02 0000 0000 0000 0x0020: 0000 0001 ff00 0210 8700 9025 0000 0000 0x0030: fec2 0000 0000 0000 0000 0000 0000 0210 0x0040: 0e01 cc1a 5611 b76a 22:26:18.098774 IP6 (hlim 255, next-header ICMPv6 (58) payload length: = 32) :: > ff02::1:ff1d:8dbc: [icmp6 sum ok] ICMP6, neighbor solicitation, = length 32, who has fec2::aa60:b6ff:fe1d:8dbc unknown option (14), length 8 (1):=20 0x0000: c983 4557 f1d3 0x0000: 6000 0000 0020 3aff 0000 0000 0000 0000 0x0010: 0000 0000 0000 0000 ff02 0000 0000 0000 0x0020: 0000 0001 ff1d 8dbc 8700 f218 0000 0000 0x0030: fec2 0000 0000 0000 aa60 b6ff fe1d 8dbc 0x0040: 0e01 c983 4557 f1d3 The first packet is the host sending a router solicitation. The second = is the router responding with the advertisement with the various routes = it has. The third and fourth packets appear to be the Duplicate Address = Detection packets for the two addresses on the host. There is no = response to either. After this, a number of other packets continue on = and on. The question is, why are the host addresses being used before DAD is = attempted? It appears there could be some really interesting problems = if the link-layer address actually was duplicated. The problems would = happen before DAD was even attempted? -- Doug -- Doug From owner-freebsd-net@freebsd.org Sun Mar 14 02:27:31 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 0441A56EE86 for ; Sun, 14 Mar 2021 02:27:31 +0000 (UTC) (envelope-from bc979@lafn.org) Received: from mail.sermon-archive.info (sermon-archive.info [47.181.130.121]) by mx1.freebsd.org (Postfix) with ESMTP id 4Dyk3P5F13z4X3v for ; Sun, 14 Mar 2021 02:27:29 +0000 (UTC) (envelope-from bc979@lafn.org) Received: from [10.0.1.251] (mini [10.0.1.251]) by mail.sermon-archive.info (Postfix) with ESMTPSA id 4Dyk3N1Jm8z2fjQB for ; Sat, 13 Mar 2021 18:27:28 -0800 (PST) From: Doug Hardie Mime-Version: 1.0 (Mac OS X Mail 14.0 \(3654.60.0.2.21\)) Subject: Re: IPv6 Startup Date: Sat, 13 Mar 2021 18:27:27 -0800 References: <06A12556-0C24-48AD-9D1C-C04491AADAF6@sermon-archive.info> To: freebsd-net@freebsd.org In-Reply-To: <06A12556-0C24-48AD-9D1C-C04491AADAF6@sermon-archive.info> Message-Id: <814C29EA-B4C0-4971-8A3B-91314DB01EBD@sermon-archive.info> X-Mailer: Apple Mail (2.3654.60.0.2.21) X-Virus-Scanned: clamav-milter 0.103.0 at mail X-Virus-Status: Clean X-Rspamd-Queue-Id: 4Dyk3P5F13z4X3v X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of bc979@lafn.org designates 47.181.130.121 as permitted sender) smtp.mailfrom=bc979@lafn.org X-Spamd-Result: default: False [-2.70 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[47.181.130.121:from]; ARC_NA(0.00)[]; FROM_HAS_DN(0.00)[]; MV_CASE(0.50)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; TO_DN_NONE(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-net@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; SPAMHAUS_ZRD(0.00)[47.181.130.121:from:127.0.2.255]; DMARC_NA(0.00)[lafn.org: no valid DMARC record]; R_SPF_ALLOW(-0.20)[+mx]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; RCVD_NO_TLS_LAST(0.10)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; ASN(0.00)[asn:5650, ipnet:47.181.128.0/18, country:US]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[freebsd-net] Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.34 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 14 Mar 2021 02:27:31 -0000 > On 13 March 2021, at 17:03, Doug Hardie = wrote: >=20 > I have two systems on the same ethernet. One is configured as a = router, the other as a host. rtadvd is running on the router, rtsold on = the host, and route6d on both. The router was up and running and I = initiated tcpdump of ip6 packets on the interface. Then I booted the = host. The results are interesting: >=20 > 22:26:17.963393 IP6 (hlim 255, next-header ICMPv6 (58) payload length: = 16) fe80::aa60:b6ff:fe1d:8dbc > ff02::2: [icmp6 sum ok] ICMP6, router = solicitation, length 16 > source link-address option (1), length 8 (1): = a8:60:b6:1d:8d:bc > 0x0000: 6000 0000 0010 3aff fe80 0000 0000 0000 > 0x0010: aa60 b6ff fe1d 8dbc ff02 0000 0000 0000 > 0x0020: 0000 0000 0000 0002 8500 a2b8 0000 0000 > 0x0030: 0101 a860 b61d 8dbc >=20 > 22:26:17.997455 IP6 (hlim 255, next-header ICMPv6 (58) payload length: = 56) fe80::3e18:a0ff:fe44:765b > ff02::1: [icmp6 sum ok] ICMP6, router = advertisement, length 56 > hop limit 64, Flags [none], pref medium, router lifetime 1800s, = reachable time 0ms, retrans timer 0ms > source link-address option (1), length 8 (1): = 3c:18:a0:44:76:5b > prefix info option (3), length 32 (4): fec2::/64, Flags = [onlink, auto], valid time 2592000s, pref. time 604800s > 0x0000: 6000 0000 0038 3aff fe80 0000 0000 0000 > 0x0010: 3e18 a0ff fe44 765b ff02 0000 0000 0000 > 0x0020: 0000 0000 0000 0001 8600 8356 4000 0708 > 0x0030: 0000 0000 0000 0000 0101 3c18 a044 765b > 0x0040: 0304 40c0 0027 8d00 0009 3a80 0000 0000 > 0x0050: fec2 0000 0000 0000 0000 0000 0000 0000 >=20 > 22:26:18.011402 IP6 (hlim 255, next-header ICMPv6 (58) payload length: = 32) :: > ff02::1:ff00:210: [icmp6 sum ok] ICMP6, neighbor solicitation, = length 32, who has fec2::210 > unknown option (14), length 8 (1):=20 > 0x0000: cc1a 5611 b76a > 0x0000: 6000 0000 0020 3aff 0000 0000 0000 0000 > 0x0010: 0000 0000 0000 0000 ff02 0000 0000 0000 > 0x0020: 0000 0001 ff00 0210 8700 9025 0000 0000 > 0x0030: fec2 0000 0000 0000 0000 0000 0000 0210 > 0x0040: 0e01 cc1a 5611 b76a >=20 > 22:26:18.098774 IP6 (hlim 255, next-header ICMPv6 (58) payload length: = 32) :: > ff02::1:ff1d:8dbc: [icmp6 sum ok] ICMP6, neighbor solicitation, = length 32, who has fec2::aa60:b6ff:fe1d:8dbc > unknown option (14), length 8 (1):=20 > 0x0000: c983 4557 f1d3 > 0x0000: 6000 0000 0020 3aff 0000 0000 0000 0000 > 0x0010: 0000 0000 0000 0000 ff02 0000 0000 0000 > 0x0020: 0000 0001 ff1d 8dbc 8700 f218 0000 0000 > 0x0030: fec2 0000 0000 0000 aa60 b6ff fe1d 8dbc > 0x0040: 0e01 c983 4557 f1d3 >=20 > The first packet is the host sending a router solicitation. The = second is the router responding with the advertisement with the various = routes it has. The third and fourth packets appear to be the Duplicate = Address Detection packets for the two addresses on the host. There is = no response to either. After this, a number of other packets continue = on and on. >=20 > The question is, why are the host addresses being used before DAD is = attempted? It appears there could be some really interesting problems = if the link-layer address actually was duplicated. The problems would = happen before DAD was even attempted? I reduced the configuration to the host settings: ifconfig_bge0_ipv6=3D"inet6 accept_rtadv" The router to: ifconfig_ue0_ipv6=3D"up" Ran tcpdump on the router (obviously not acting as a router) and = restarted the host. Got the following: tcpdump: listening on ue0, link-type EN10MB (Ethernet), capture size = 262144 bytes 19:05:00.048637 IP6 (hlim 1, next-header Options (0) payload length: 56) = fe80::aa60:b6ff:fe1d:8dbc > ff02::16: HBH (padn)(rtalert: 0x0000) = [icmp6 sum ok] ICMP6, multicast listener report v2, 2 group record(s) = [gaddr ff02::2:ec7d:574c to_ex, 0 source(s)] [gaddr ff02::2:ffec:7d57 = to_ex, 0 source(s)] 19:05:00.171029 IP6 (hlim 255, next-header ICMPv6 (58) payload length: = 16) fe80::aa60:b6ff:fe1d:8dbc > ff02::2: [icmp6 sum ok] ICMP6, router = solicitation, length 16 source link-address option (1), length 8 (1): = a8:60:b6:1d:8d:bc 19:05:04.198640 IP6 (hlim 255, next-header ICMPv6 (58) payload length: = 16) fe80::aa60:b6ff:fe1d:8dbc > ff02::2: [icmp6 sum ok] ICMP6, router = solicitation, length 16 source link-address option (1), length 8 (1): = a8:60:b6:1d:8d:bc 19:05:08.449844 IP6 (hlim 255, next-header ICMPv6 (58) payload length: = 16) fe80::aa60:b6ff:fe1d:8dbc > ff02::2: [icmp6 sum ok] ICMP6, router = solicitation, length 16 source link-address option (1), length 8 (1): = a8:60:b6:1d:8d:bc The first packet is a multicast listener report. However, as I = understand RFC 3590 section 3 = , That should have been = sent using the :: address, not the link-local address as the link-local = address is still tentative.=20 Then follows 3 packets that look like DAD. However, they also come from = the tentative link-local address. I believe they should come from :: = also, at least the first one. There is not a lot of time between the = first two. These two devices are the only ones on that LAN so nothing = is going to respond. Is this a bug in the software, or in my understanding? -- Doug From owner-freebsd-net@freebsd.org Sun Mar 14 07:24:53 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 37334575B2C for ; Sun, 14 Mar 2021 07:24:53 +0000 (UTC) (envelope-from ozkan.kirik@gmail.com) Received: from mail-vk1-xa29.google.com (mail-vk1-xa29.google.com [IPv6:2607:f8b0:4864:20::a29]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4DyrfX16dcz4t56 for ; Sun, 14 Mar 2021 07:24:51 +0000 (UTC) (envelope-from ozkan.kirik@gmail.com) Received: by mail-vk1-xa29.google.com with SMTP id w63so2176820vkf.11 for ; Sat, 13 Mar 2021 23:24:51 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=JBSUVQc+Rer7PFP2URRxh1dBH9WK4qw13Y20ycK7b3s=; b=K90z6GwdPhEX7VfeMA/J+pUV0TG3m4ZXv8+1Ti1MnYVsjVkahUkoyVoeByGScEK6dz LNKwkr51E7Gijvi1Pdo1Khw+OsjK+y4UCoBGYwv6JGXqsx5Mv+EklJvPqqzOw1mMFC+t MCICKAbtp/LWHWmLNjvX2122lB5tVcw+LhCBUbEX8ikKn22llNpjRdx06LEI9RjcNsMJ S1HxA5e+1DxBWyNHkoJkmcBv1aOb2KmrILraoLTFlUSygVI9CdY676irYFNYCEZ1QiBW 7YOWGfdmqHeFsH9VLhTwVgvT5PqEJF/R/YLyzldTgoEaEXjMtb2/qvtfMaWSjD3zPm+U g9WA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=JBSUVQc+Rer7PFP2URRxh1dBH9WK4qw13Y20ycK7b3s=; b=IIAz7JAgK7oaYU2QA4OWtEI0tduydwcin3moTv8lHfUZgYJrR/Wh7vChcW804DWGug ChOMJ9mgasXzQrsg96VaJ5PS8mzOKHYvc4dBYGPIRVuC6OHUcUZBtWE+fp7y7e2ZtDAv CGwPBNB8ZxfkUgxcMLKxhgdZB7V08RS+8UcwO/AqLTzcnUlY4f5Md5eb0JwsAtal+0xC yPGozImCNaCVtqfn1Xk+wd/JJweJDUzbKNPleunj8iCl2hF9BHPRv0RP1ljTtSADw9db IKUP/xly+5HIVrXpB8vsy02PNOU5n5QyGxxVtDwppCCIRMVkQXF5/a+eElt6jWYVMfsx 03nQ== X-Gm-Message-State: AOAM532ZWK0XcIIhylXokHaUrFArWjEEBx34/PuWhZDcDkksp05Wlgfw EV0137zut9DbL9gysQroPb0sTM6Ulw/wxkn7YD6NHyQL46Q= X-Google-Smtp-Source: ABdhPJzDEe5r2KjBOab3P77kdQnqytCJuhZsdDuNjbv1i03eq6f5h16Y4eW9UEWG+CzQ+64vwIz+RUSJlwPxQrbU3hI= X-Received: by 2002:a1f:2302:: with SMTP id j2mr11141921vkj.23.1615706691068; Sat, 13 Mar 2021 23:24:51 -0800 (PST) MIME-Version: 1.0 References: In-Reply-To: From: =?UTF-8?B?w5Z6a2FuIEtJUklL?= Date: Sun, 14 Mar 2021 10:24:40 +0300 Message-ID: Subject: Re: RSS on FreeBSD stable/12 gateway To: Adrian Chadd Cc: Hans Petter Selasky , FreeBSD Net X-Rspamd-Queue-Id: 4DyrfX16dcz4t56 X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=K90z6Gwd; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of ozkankirik@gmail.com designates 2607:f8b0:4864:20::a29 as permitted sender) smtp.mailfrom=ozkankirik@gmail.com X-Spamd-Result: default: False [-3.44 / 15.00]; FREEMAIL_FROM(0.00)[gmail.com]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; NEURAL_HAM_SHORT(-1.00)[-1.000]; FREEMAIL_TO(0.00)[gmail.com]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; R_MIXED_CHARSET(0.56)[subject]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; TAGGED_FROM(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; ARC_NA(0.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[2607:f8b0:4864:20::a29:from]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; NEURAL_HAM_LONG(-1.00)[-1.000]; TAGGED_RCPT(0.00)[]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-net@freebsd.org]; SPAMHAUS_ZRD(0.00)[2607:f8b0:4864:20::a29:from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::a29:from]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-net] Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.34 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 14 Mar 2021 07:24:53 -0000 Hello Adrian, I wonder if the current RSS code supports software mode. Is it possible to enforce software RSS? And what about Sender Side Scaling ? I want to assign a snort instance for each NIC queue. Snort is configured to use netmap mode. Needs and questions are below: - For a proper detection, both of request and response packets must enter into same snort instance so that same NIC queue. For example 3way handshake packets, TLS handshake packets and etc all must use same queue for both directions. - I'm afraid that, option RSS is only socket aware. But gateways/routers doesnt have sockets for all connections. Is it possible to perform such hashing and requeuing while forwarding packets? - On receive side, is it possible to hashing & requeuing before the netmap step? - On sender side, is it possible to hashing & queuing before pushing in NIC queue? What is the right way to do this? =C3=96zkan On Sun, Mar 14, 2021 at 7:02 AM Adrian Chadd wrote= : > On Sun, 7 Mar 2021 at 23:08, =C3=96zkan KIRIK wro= te: > > > > Thanks, > > > > I wonder that, why RSS and PCBGROUP options are not enabled in GENERIC > > kernel by default. > > Is there any performance or stability issues? > > I've been running it for years at home on my desktop machine with zero > issues. > However, I'm likely a special case because I hacked on it for a while. ;-= ) > > Hans - which iflib intel hardware corrupted it? It's possible someone > undid a bunch of work I did when figuring out what the heck RSS needed > to make it actually work work, or it could be the 10/40g hardware they > shipped that was actually really broken :( > > > > -adrian > > > > > On Mon, Mar 8, 2021 at 12:26 AM Hans Petter Selasky > wrote: > > > > > On 3/7/21 10:03 PM, =C3=96zkan KIRIK wrote: > > > > Any suggestions to enable RSS ? > > > > > > I found that RSS hardware computed checksums are not correct when usi= ng > > > iflib (intel hardware), compared to what the software expects, so > > > traffic goes on wrong queue and gets dropped simply. Maybe you see > > > something similar. > > > > > > --HPS > > > > > _______________________________________________ > > freebsd-net@freebsd.org mailing list > > https://lists.freebsd.org/mailman/listinfo/freebsd-net > > To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org" > From owner-freebsd-net@freebsd.org Sun Mar 14 04:02:46 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 7F087570894 for ; Sun, 14 Mar 2021 04:02:46 +0000 (UTC) (envelope-from adrian.chadd@gmail.com) Received: from mail-qt1-x82b.google.com (mail-qt1-x82b.google.com [IPv6:2607:f8b0:4864:20::82b]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Dym9K1tQgz4cHW for ; Sun, 14 Mar 2021 04:02:45 +0000 (UTC) (envelope-from adrian.chadd@gmail.com) Received: by mail-qt1-x82b.google.com with SMTP id a11so6933249qto.2 for ; Sat, 13 Mar 2021 20:02:45 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc:content-transfer-encoding; bh=5EZfveZ8U2eLZdEzuQ4pQqP0lcn9y0hFShZAlcbkdpI=; b=e0FvgIBuh+aswY+Dx9KseXpUZ4gN6he7ec4lU2VWc6zxA4hDMSCeGkX09AAQQXFeGD uvHUJ9jyn9MeFOVomdzxyu2+dkq1pK1MkABXmfxXVCgsJtTLpKrGz1AbaryWjFidzwpg OX1bcRYFpCAoVUfgCtUSRNuCaHhq6s7cUrvaLxNBUE5LDcf1/U/go0us/05Rdlevz4Ho 72CV660NFZkv1OqvqI6LgfG0NNcOqtkLTwflNTzLZsbRZ7MUw0CCv5YcvMg/TcgB13+B 25HvnaGX6grke+Uslhpp35EHdegToylhuXSbfN6ULbcW4BAkKlbY3XmKCtli/Q/dvGfz a8pA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc:content-transfer-encoding; bh=5EZfveZ8U2eLZdEzuQ4pQqP0lcn9y0hFShZAlcbkdpI=; b=JvT9WnzQnFtNUZ244Wu5bj94avLRogsGSDNEGI87br8cZiCvsY+Cv4zgHybEX2zjhk qx/doOL0MBLgvHsi5WvHLxXkhlzj+qBHrM0lTLZ+V0lT/6fyi2YCDtouKndk9lhmxI0D 93EFUelv3DLh9vDn9dFvivjklD8vDxAR8EpyI6MqX8UpVFs4aDSoOiOz4bUvudrhzbd3 wvGksOvwEfVGMahwDitB4925BuRszMBsCWyr+xHyBmItXz7c857ZCjGPmVfSOloH6vIS lNcJCnL2e5RwEgIqvhsrAoq0++GsDpqgR4JwfOs6wSzf8r21VK4HfIqyK9s8ALUbHjqE uOyg== X-Gm-Message-State: AOAM5320mh4FJHuIZHjYaFmm7Z8db6bSp57SgPP2QVzky9kxc5bTfYWS iaNcL5A4WH2yegMO3fyK03OLmJbwN1dv7NBGgQO4wfI6 X-Google-Smtp-Source: ABdhPJwBjYCh+d3UFFnAak5JoWzrvsFBVOIvRLjNtNfuhisKWm4cwWkVZoBC3Vrn8sfa2Tfj2mkuv7UfHz+GxIsJmcQ= X-Received: by 2002:ac8:6790:: with SMTP id b16mr4244418qtp.93.1615694563469; Sat, 13 Mar 2021 20:02:43 -0800 (PST) MIME-Version: 1.0 References: In-Reply-To: From: Adrian Chadd Date: Sat, 13 Mar 2021 20:02:31 -0800 Message-ID: Subject: Re: RSS on FreeBSD stable/12 gateway To: =?UTF-8?B?w5Z6a2FuIEtJUklL?= Cc: Hans Petter Selasky , FreeBSD Net Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Rspamd-Queue-Id: 4Dym9K1tQgz4cHW X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=e0FvgIBu; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of adrianchadd@gmail.com designates 2607:f8b0:4864:20::82b as permitted sender) smtp.mailfrom=adrianchadd@gmail.com X-Spamd-Result: default: False [-4.00 / 15.00]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36:c]; FREEMAIL_FROM(0.00)[gmail.com]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; NEURAL_HAM_SHORT(-1.00)[-1.000]; FREEMAIL_TO(0.00)[gmail.com]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; TAGGED_FROM(0.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[2607:f8b0:4864:20::82b:from]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; NEURAL_HAM_LONG(-1.00)[-1.000]; TAGGED_RCPT(0.00)[]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-net@freebsd.org]; SPAMHAUS_ZRD(0.00)[2607:f8b0:4864:20::82b:from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::82b:from]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-net] X-Mailman-Approved-At: Sun, 14 Mar 2021 09:25:04 +0000 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 14 Mar 2021 04:02:46 -0000 On Sun, 7 Mar 2021 at 23:08, =C3=96zkan KIRIK wrote= : > > Thanks, > > I wonder that, why RSS and PCBGROUP options are not enabled in GENERIC > kernel by default. > Is there any performance or stability issues? I've been running it for years at home on my desktop machine with zero issu= es. However, I'm likely a special case because I hacked on it for a while. ;-) Hans - which iflib intel hardware corrupted it? It's possible someone undid a bunch of work I did when figuring out what the heck RSS needed to make it actually work work, or it could be the 10/40g hardware they shipped that was actually really broken :( -adrian > > On Mon, Mar 8, 2021 at 12:26 AM Hans Petter Selasky wro= te: > > > On 3/7/21 10:03 PM, =C3=96zkan KIRIK wrote: > > > Any suggestions to enable RSS ? > > > > I found that RSS hardware computed checksums are not correct when using > > iflib (intel hardware), compared to what the software expects, so > > traffic goes on wrong queue and gets dropped simply. Maybe you see > > something similar. > > > > --HPS > > > _______________________________________________ > freebsd-net@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-net > To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org" From owner-freebsd-net@freebsd.org Sun Mar 14 15:56:51 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 669195AACCC for ; Sun, 14 Mar 2021 15:56:51 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 4Dz41H2HcGz3w6l for ; Sun, 14 Mar 2021 15:56:51 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 4E8535AACCB; Sun, 14 Mar 2021 15:56:51 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 4E4E05AAE12 for ; Sun, 14 Mar 2021 15:56:51 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Dz41H1dTzz3vnX for ; Sun, 14 Mar 2021 15:56:51 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 2B1F520411 for ; Sun, 14 Mar 2021 15:56:51 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 12EFuplc069349 for ; Sun, 14 Mar 2021 15:56:51 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 12EFupQu069348 for net@FreeBSD.org; Sun, 14 Mar 2021 15:56:51 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 254159] [tcp] Keepalive not working/tcp rst tolerance Date: Sun, 14 Mar 2021 15:56:51 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 12.2-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: ant_mail@inbox.ru X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: net@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 14 Mar 2021 15:56:51 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D254159 --- Comment #6 from ant2 --- After updating to 12.2-STABLE r369447 the error has gone away. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-net@freebsd.org Sun Mar 14 17:01:40 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id E14285AC426 for ; Sun, 14 Mar 2021 17:01:40 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 4Dz5S45sXjz4Tkn for ; Sun, 14 Mar 2021 17:01:40 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id C95155AC6C2; Sun, 14 Mar 2021 17:01:40 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id C91ED5AC425 for ; Sun, 14 Mar 2021 17:01:40 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Dz5S45H81z4TsG for ; Sun, 14 Mar 2021 17:01:40 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id A87DD20FA3 for ; Sun, 14 Mar 2021 17:01:40 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 12EH1eSu003094 for ; Sun, 14 Mar 2021 17:01:40 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 12EH1ejZ003093 for net@FreeBSD.org; Sun, 14 Mar 2021 17:01:40 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 254244] panics after upgrade to stable/13-n244861-b9773574371 Date: Sun, 14 Mar 2021 17:01:41 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-STABLE X-Bugzilla-Keywords: panic, regression X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: sergey.dyatko@gmail.com X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: net@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 14 Mar 2021 17:01:40 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D254244 Sergey V. Dyatko changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |sergey.dyatko@gmail.com --- Comment #3 from Sergey V. Dyatko --- http://freebsd.1045724.x6.nabble.com/13-0-CURRENT-r368448-panic-td6443146.h= tml --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-net@freebsd.org Sun Mar 14 17:02:35 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 097555AC54B for ; Sun, 14 Mar 2021 17:02:35 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 4Dz5T66hGRz4TtJ for ; Sun, 14 Mar 2021 17:02:34 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id E55C75AC169; Sun, 14 Mar 2021 17:02:34 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id E524D5AC368 for ; Sun, 14 Mar 2021 17:02:34 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Dz5T664mTz4VLX for ; Sun, 14 Mar 2021 17:02:34 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id C45B320F68 for ; Sun, 14 Mar 2021 17:02:34 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 12EH2Y3e005745 for ; Sun, 14 Mar 2021 17:02:34 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 12EH2YC0005744 for net@FreeBSD.org; Sun, 14 Mar 2021 17:02:34 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 254159] [tcp] Keepalive not working/tcp rst tolerance Date: Sun, 14 Mar 2021 17:02:33 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 12.2-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: tuexen@freebsd.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: FIXED X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: net@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_status resolution Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 14 Mar 2021 17:02:35 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D254159 Michael Tuexen changed: What |Removed |Added ---------------------------------------------------------------------------- Status|New |Closed Resolution|--- |FIXED --- Comment #7 from Michael Tuexen --- Thanks for testing and reporting. Will close the bug report. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-net@freebsd.org Sun Mar 14 17:28:39 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 1B37E5AD38B for ; Sun, 14 Mar 2021 17:28:39 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 4Dz63C058vz4Wjm for ; Sun, 14 Mar 2021 17:28:39 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 02F6F5AD1C0; Sun, 14 Mar 2021 17:28:39 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 02BD25AD321 for ; Sun, 14 Mar 2021 17:28:39 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Dz63B6Zq3z4Wgy for ; Sun, 14 Mar 2021 17:28:38 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id D50FF2124E for ; Sun, 14 Mar 2021 17:28:38 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 12EHScsw015373 for ; Sun, 14 Mar 2021 17:28:38 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 12EHScZA015372 for net@FreeBSD.org; Sun, 14 Mar 2021 17:28:38 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 203916] ethernet and wlan interfaces both have the same mac-address after upgrade to r289486 Date: Sun, 14 Mar 2021 17:28:38 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.0-STABLE X-Bugzilla-Keywords: regression X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: shuriku@shurik.kiev.ua X-Bugzilla-Status: Closed X-Bugzilla-Resolution: FIXED X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: net@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_status resolution Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 14 Mar 2021 17:28:39 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D203916 Oleksandr Kryvulia changed: What |Removed |Added ---------------------------------------------------------------------------- Status|New |Closed Resolution|--- |FIXED --- Comment #4 from Oleksandr Kryvulia --- Out of date, closed. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-net@freebsd.org Sun Mar 14 20:06:05 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 24E1B5B0B35 for ; Sun, 14 Mar 2021 20:06:05 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 4Dz9Xs0Gp5z4gg0 for ; Sun, 14 Mar 2021 20:06:05 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 093E15B0B34; Sun, 14 Mar 2021 20:06:05 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 08FE85B096F for ; Sun, 14 Mar 2021 20:06:05 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Dz9Xr6mVYz4gnL for ; Sun, 14 Mar 2021 20:06:04 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id DB809232EA for ; Sun, 14 Mar 2021 20:06:04 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 12EK64Z2096181 for ; Sun, 14 Mar 2021 20:06:04 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 12EK64bo096180 for net@FreeBSD.org; Sun, 14 Mar 2021 20:06:04 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 253790] if_wg(4) lacks persistent keepalive Date: Sun, 14 Mar 2021 20:06:05 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: crest@rlwinm.de X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: kevans@freebsd.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 14 Mar 2021 20:06:05 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D253790 --- Comment #3 from crest@rlwinm.de --- Will this be merged into FreeBSD 13.0 before RC3 (it's missing in the 13.0-RC3)? --=20 You are receiving this mail because: You are on the CC list for the bug.= From owner-freebsd-net@freebsd.org Sun Mar 14 20:07:57 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id EF9CA5B0BD7 for ; Sun, 14 Mar 2021 20:07:57 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 4Dz9b169CBz4gjv for ; Sun, 14 Mar 2021 20:07:57 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id D3A2D5B0B56; Sun, 14 Mar 2021 20:07:57 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id D369F5B0D58 for ; Sun, 14 Mar 2021 20:07:57 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Dz9b15SQyz4gtf for ; Sun, 14 Mar 2021 20:07:57 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id AA5A32377C for ; Sun, 14 Mar 2021 20:07:57 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 12EK7v45096497 for ; Sun, 14 Mar 2021 20:07:57 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 12EK7vUK096496 for net@FreeBSD.org; Sun, 14 Mar 2021 20:07:57 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 253790] if_wg(4) lacks persistent keepalive Date: Sun, 14 Mar 2021 20:07:57 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: kevans@freebsd.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: kevans@freebsd.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 14 Mar 2021 20:07:58 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D253790 --- Comment #4 from Kyle Evans --- (In reply to crest from comment #3) My current hope is to be able to merge a pile of WireGuard fixes in time for -RC3. --=20 You are receiving this mail because: You are on the CC list for the bug.= From owner-freebsd-net@freebsd.org Sun Mar 14 21:00:26 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 3D81F5B26BD for ; Sun, 14 Mar 2021 21:00:26 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 4DzBlY6fGcz4lFx for ; Sun, 14 Mar 2021 21:00:25 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: by mailman.nyi.freebsd.org (Postfix) id CFF905B2672; Sun, 14 Mar 2021 21:00:25 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id CF0345B255A for ; Sun, 14 Mar 2021 21:00:25 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4DzBlY4F4Bz4lD0 for ; Sun, 14 Mar 2021 21:00:25 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 5000E241E9 for ; Sun, 14 Mar 2021 21:00:25 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 12EL0PG7025004 for ; Sun, 14 Mar 2021 21:00:25 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 12EL0PFp025003 for net@FreeBSD.org; Sun, 14 Mar 2021 21:00:25 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Message-Id: <202103142100.12EL0PFp025003@kenobi.freebsd.org> X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@FreeBSD.org using -f From: bugzilla-noreply@FreeBSD.org To: net@FreeBSD.org Subject: Problem reports for net@FreeBSD.org that need special attention Date: Sun, 14 Mar 2021 21:00:25 +0000 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.34 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 14 Mar 2021 21:00:26 -0000 To view an individual PR, use: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=(Bug Id). The following is a listing of current problems submitted by FreeBSD users, which need special attention. These represent problem reports covering all versions including experimental development code and obsolete releases. Status | Bug Id | Description ------------+-----------+--------------------------------------------------- In Progress | 221146 | [ixgbe] Problem with second laggport In Progress | 235700 | oce(4) driver causes fatal trap 12 on boot with e New | 204438 | setsockopt() handling of kern.ipc.maxsockbuf limi New | 213410 | [carp] service netif restart causes hang only whe Open | 7556 | ppp: sl_compress_init() will fail if called anyth Open | 166724 | if_re(4): watchdog timeout Open | 193452 | Dell PowerEdge 210 II -- Kernel panic bce (broadc Open | 194453 | dummynet(4): pipe config bw parameter limited to Open | 200319 | Bridge+CARP crashes/freezes Open | 202510 | [CARP] advertisements sourced from CARP IP cause Open | 207261 | netmap: Doesn't do TX sync with kqueue Open | 217978 | dhclient: Support supersede statement for option Open | 220468 | libfetch: Does not handle 407 (proxy auth) when c Open | 222273 | igb(4): Kernel panic (fatal trap 12) due to netwo Open | 225438 | panic in6_unlink_ifa() due to race Open | 225792 | ECMP is broken since tryforward() Open | 227720 | Kernel panic in ppp server Open | 230807 | if_alc(4): Driver not working for Killer Networki Open | 236888 | ppp daemon: Allow MTU to be overridden for PPPoE Open | 236983 | bnxt(4) VLAN not operational unless explicit "ifc Open | 237072 | netgraph(4): performance issue [on HardenedBSD]? Open | 237840 | Removed dummynet dependency on ipfw Open | 240944 | em(4): Crash with Intel 82571EB NIC with AMD Pile Open | 240969 | netinet6: Neighbour reachability detection broken Open | 241106 | tun/ppp: panic: vm_fault: fault on nofault entry Open | 241162 | Panic in closefp() triggered by nginx (uwsgi with Open | 243463 | ix0: Watchdog timeout Open | 244066 | divert: Add sysctls for divert socket send and re Open | 118111 | rc: network.subr Add MAC address based interface 29 problems total for which you should take action. From owner-freebsd-net@freebsd.org Mon Mar 15 09:38:49 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 0435C5764B2 for ; Mon, 15 Mar 2021 09:38:49 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 4DzWZc6X4dz4ZqL for ; Mon, 15 Mar 2021 09:38:48 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id DE51A5764B1; Mon, 15 Mar 2021 09:38:48 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id DE14D57650F for ; Mon, 15 Mar 2021 09:38:48 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4DzWZc5p0Qz4ZQ7 for ; Mon, 15 Mar 2021 09:38:48 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id B5F7F63CF for ; Mon, 15 Mar 2021 09:38:48 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 12F9cmvu005313 for ; Mon, 15 Mar 2021 09:38:48 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 12F9cmUj005312 for net@FreeBSD.org; Mon, 15 Mar 2021 09:38:48 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 254303] Fatal trap 12: page fault while in kernel mode ((frr 7.5_1 + Freebsd 13 Beta3) zebra crashes server when routes are populated) Date: Mon, 15 Mar 2021 09:38:49 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: Unspecified X-Bugzilla-Keywords: panic X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: linimon@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: net@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: keywords assigned_to Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 15 Mar 2021 09:38:49 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D254303 Mark Linimon changed: What |Removed |Added ---------------------------------------------------------------------------- Keywords| |panic Assignee|bugs@FreeBSD.org |net@FreeBSD.org --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-net@freebsd.org Mon Mar 15 10:14:33 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 938B157741D for ; Mon, 15 Mar 2021 10:14:33 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 4DzXMs3bCWz4cYy for ; Mon, 15 Mar 2021 10:14:33 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 7958657741C; Mon, 15 Mar 2021 10:14:33 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 77ECD5773AA for ; Mon, 15 Mar 2021 10:14:33 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4DzXMs2nTZz4cTw for ; Mon, 15 Mar 2021 10:14:33 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 481FD6943 for ; Mon, 15 Mar 2021 10:14:33 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 12FAEX69026840 for ; Mon, 15 Mar 2021 10:14:33 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 12FAEXnM026839 for net@FreeBSD.org; Mon, 15 Mar 2021 10:14:33 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 254303] Fatal trap 12: page fault while in kernel mode ((frr 7.5_1 + Freebsd 13 Beta3) zebra crashes server when routes are populated) Date: Mon, 15 Mar 2021 10:14:33 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: Unspecified X-Bugzilla-Keywords: panic X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: a.ivanov@veesp.com X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: net@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 15 Mar 2021 10:14:33 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D254303 --- Comment #1 from Aleks --- Same issue on Freebsd 13 RC2 13.0-RC2 #0 releng/13.0-n244684-13c22f74953: Fri Mar 12 04:05:19 UTC 2021= =20=20=20=20 root@releng1.nyi.freebsd.org:/usr/obj/usr/src/amd64.amd64/sys/GENERIC amd64 Frr same :=20 frr7-7.5_1 Name : frr7 Version : 7.5_1 --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-net@freebsd.org Mon Mar 15 10:46:41 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 3DA0F577BBB for ; Mon, 15 Mar 2021 10:46:41 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 4DzY4x14NFz4f6p for ; Mon, 15 Mar 2021 10:46:41 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 22E93577BBA; Mon, 15 Mar 2021 10:46:41 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 22AB1577BB9 for ; Mon, 15 Mar 2021 10:46:41 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4DzY4x0NbGz4djh for ; Mon, 15 Mar 2021 10:46:41 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 004B3730E for ; Mon, 15 Mar 2021 10:46:41 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 12FAkeaW042083 for ; Mon, 15 Mar 2021 10:46:40 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 12FAke6k042082 for net@FreeBSD.org; Mon, 15 Mar 2021 10:46:40 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 254303] Fatal trap 12: page fault while in kernel mode ((frr 7.5_1 + Freebsd 13 Beta3) zebra crashes server when routes are populated) Date: Mon, 15 Mar 2021 10:46:41 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: Unspecified X-Bugzilla-Keywords: panic X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: zarychtam@plan-b.pwste.edu.pl X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: net@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 15 Mar 2021 10:46:41 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D254303 Marek Zarychta changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |zarychtam@plan-b.pwste.edu. | |pl --- Comment #2 from Marek Zarychta --- Can you upgrade and test 13.0-RC2? Does it also happen with sysctl net.route.multipath=3D0 set? --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-net@freebsd.org Mon Mar 15 10:55:45 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 61E29577C5C for ; Mon, 15 Mar 2021 10:55:45 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 4DzYHP27zHz4fJp for ; Mon, 15 Mar 2021 10:55:45 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 47A2957801C; Mon, 15 Mar 2021 10:55:45 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 47649578188 for ; Mon, 15 Mar 2021 10:55:45 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4DzYHP1VdVz4fj5 for ; Mon, 15 Mar 2021 10:55:45 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 2293F74A0 for ; Mon, 15 Mar 2021 10:55:45 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 12FAtjx2046060 for ; Mon, 15 Mar 2021 10:55:45 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 12FAtjI4046059 for net@FreeBSD.org; Mon, 15 Mar 2021 10:55:45 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 254303] Fatal trap 12: page fault while in kernel mode ((frr 7.5_1 + Freebsd 13 Beta3) zebra crashes server when routes are populated) Date: Mon, 15 Mar 2021 10:55:45 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: Unspecified X-Bugzilla-Keywords: panic X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: a.ivanov@veesp.com X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: net@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 15 Mar 2021 10:55:45 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D254303 --- Comment #3 from Aleks --- (In reply to Marek Zarychta from comment #2) It does happen on 13.0-RC2 too with default sysctl settings. (multipath=3D1) With sysctl net.route.multipath=3D0 it doesn't crash. (on RC2) --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-net@freebsd.org Mon Mar 15 16:37:55 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 7F7F45A82DC for ; Mon, 15 Mar 2021 16:37:55 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 4DzhtC30qYz3KwD for ; Mon, 15 Mar 2021 16:37:55 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 670905A86B1; Mon, 15 Mar 2021 16:37:55 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 65B845A81D0 for ; Mon, 15 Mar 2021 16:37:55 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4DzhtC2PPcz3LC5 for ; Mon, 15 Mar 2021 16:37:55 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 45E941365B for ; Mon, 15 Mar 2021 16:37:55 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 12FGbtBu021674 for ; Mon, 15 Mar 2021 16:37:55 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 12FGbtjN021673 for net@FreeBSD.org; Mon, 15 Mar 2021 16:37:55 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 254309] [tcp] frequent panics in tcp_output Date: Mon, 15 Mar 2021 16:37:54 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-STABLE X-Bugzilla-Keywords: panic X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: linimon@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: net@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: keywords assigned_to Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 15 Mar 2021 16:37:55 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D254309 Mark Linimon changed: What |Removed |Added ---------------------------------------------------------------------------- Keywords| |panic Assignee|bugs@FreeBSD.org |net@FreeBSD.org --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-net@freebsd.org Mon Mar 15 16:50:35 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 99A975A8652 for ; Mon, 15 Mar 2021 16:50:35 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 4Dzj8q3mldz3LwM for ; Mon, 15 Mar 2021 16:50:35 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 7FADE5A88BA; Mon, 15 Mar 2021 16:50:35 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 7F77D5A8B82 for ; Mon, 15 Mar 2021 16:50:35 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Dzj8q38Hdz3LTX for ; Mon, 15 Mar 2021 16:50:35 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 5D3E61410E for ; Mon, 15 Mar 2021 16:50:35 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 12FGoZ3H026277 for ; Mon, 15 Mar 2021 16:50:35 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 12FGoZeQ026276 for net@FreeBSD.org; Mon, 15 Mar 2021 16:50:35 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 254309] [tcp] frequent panics in tcp_output Date: Mon, 15 Mar 2021 16:50:35 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-STABLE X-Bugzilla-Keywords: panic X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: tuexen@freebsd.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: net@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 15 Mar 2021 16:50:35 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D254309 Michael Tuexen changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |tuexen@freebsd.org --- Comment #2 from Michael Tuexen --- It would be great to see the panic message and to have a way to reproduce i= t. Can you describe how to reproduce the issue? Does the same problem occur wh= en you are using CURRENT? --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-net@freebsd.org Mon Mar 15 16:57:43 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 95E585A8DFD for ; Mon, 15 Mar 2021 16:57:43 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 4DzjK33fJzz3Md3 for ; Mon, 15 Mar 2021 16:57:43 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 7B77C5A8E89; Mon, 15 Mar 2021 16:57:43 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 7B45B5A8CC0 for ; Mon, 15 Mar 2021 16:57:43 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4DzjK331Zzz3MRN for ; Mon, 15 Mar 2021 16:57:43 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 5AC6413CD7 for ; Mon, 15 Mar 2021 16:57:43 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 12FGvh5U032017 for ; Mon, 15 Mar 2021 16:57:43 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 12FGvheF032016 for net@FreeBSD.org; Mon, 15 Mar 2021 16:57:43 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 254244] panics after upgrade to stable/13-n244861-b9773574371 Date: Mon, 15 Mar 2021 16:57:43 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-STABLE X-Bugzilla-Keywords: panic, regression X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: zarychtam@plan-b.pwste.edu.pl X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: net@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: attachments.created Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 15 Mar 2021 16:57:43 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D254244 --- Comment #4 from Marek Zarychta --- Created attachment 223294 --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=3D223294&action= =3Dedit backtrace 1 Here's fresh backtrace --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-net@freebsd.org Mon Mar 15 17:08:02 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 97CC15A90BB for ; Mon, 15 Mar 2021 17:08:02 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 4DzjXy3flrz3MpM for ; Mon, 15 Mar 2021 17:08:02 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 7D7475A8F5D; Mon, 15 Mar 2021 17:08:02 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 7D35C5A8F5C for ; Mon, 15 Mar 2021 17:08:02 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4DzjXy34h2z3MxT for ; Mon, 15 Mar 2021 17:08:02 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 583FE14329 for ; Mon, 15 Mar 2021 17:08:02 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 12FH82cq036673 for ; Mon, 15 Mar 2021 17:08:02 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 12FH827L036672 for net@FreeBSD.org; Mon, 15 Mar 2021 17:08:02 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 254309] [tcp] frequent panics in tcp_output Date: Mon, 15 Mar 2021 17:08:02 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-STABLE X-Bugzilla-Keywords: panic X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: rozhuk.im@gmail.com X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: net@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: attachments.created Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 15 Mar 2021 17:08:02 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D254309 --- Comment #3 from rozhuk.im@gmail.com --- Created attachment 223295 --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=3D223295&action= =3Dedit crash log http://www.netlab.linkpc.net/download/software/os_cfg/FBSD/13/base/usr/src/= sys/amd64/conf/ srv+base http://www.netlab.linkpc.net/download/software/os_cfg/FBSD/13/base/etc/sysc= tl.conf Other configs available: http://www.netlab.linkpc.net/download/software/os_cfg/FBSD/13/ base+srv This is home NAS+++ server, with web server, samba, rtorrent, etc that connected to inet via IPv4 + IPv6. This happen few times, once per day. I can not reproduce this. FreeBSD 13 amd64, few days old sources build. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-net@freebsd.org Mon Mar 15 17:08:21 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 7DC355A9347 for ; Mon, 15 Mar 2021 17:08:21 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 4DzjYK2rcBz3N16 for ; Mon, 15 Mar 2021 17:08:21 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 619825A9426; Mon, 15 Mar 2021 17:08:21 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 6137C5A9490 for ; Mon, 15 Mar 2021 17:08:21 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4DzjYK1x5jz3N5p for ; Mon, 15 Mar 2021 17:08:21 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 2A4F313EEC for ; Mon, 15 Mar 2021 17:08:21 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 12FH8LRn036769 for ; Mon, 15 Mar 2021 17:08:21 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 12FH8Lcx036768 for net@FreeBSD.org; Mon, 15 Mar 2021 17:08:21 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 254309] [tcp] frequent panics in tcp_output Date: Mon, 15 Mar 2021 17:08:21 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-STABLE X-Bugzilla-Keywords: panic X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: rozhuk.im@gmail.com X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: net@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: attachments.created Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 15 Mar 2021 17:08:21 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D254309 --- Comment #4 from rozhuk.im@gmail.com --- Created attachment 223296 --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=3D223296&action= =3Dedit log 2 --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-net@freebsd.org Mon Mar 15 17:09:51 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id E6B6F5A9251 for ; Mon, 15 Mar 2021 17:09:51 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 4Dzjb361Cfz3NH4 for ; Mon, 15 Mar 2021 17:09:51 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id CE4775A9250; Mon, 15 Mar 2021 17:09:51 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id CE0DD5A9456 for ; Mon, 15 Mar 2021 17:09:51 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Dzjb35RXWz3NH3 for ; Mon, 15 Mar 2021 17:09:51 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id AE01713FF7 for ; Mon, 15 Mar 2021 17:09:51 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 12FH9pWm037028 for ; Mon, 15 Mar 2021 17:09:51 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 12FH9pQx037027 for net@FreeBSD.org; Mon, 15 Mar 2021 17:09:51 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 254309] [tcp] frequent panics in tcp_output Date: Mon, 15 Mar 2021 17:09:52 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-STABLE X-Bugzilla-Keywords: panic X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: rozhuk.im@gmail.com X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: net@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 15 Mar 2021 17:09:52 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D254309 --- Comment #5 from rozhuk.im@gmail.com --- igb0: flags=3D8863 metric 0 mtu 9000 =20=20=20=20=20=20=20 options=3D4e527bb ether *********** media: Ethernet autoselect (1000baseT ) status: active nd6 options=3D9 --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-net@freebsd.org Mon Mar 15 18:33:52 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id A04B65AB87D for ; Mon, 15 Mar 2021 18:33:52 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 4DzlS03yVFz3lHw for ; Mon, 15 Mar 2021 18:33:52 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 87B565AB762; Mon, 15 Mar 2021 18:33:52 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 877935AB8D3 for ; Mon, 15 Mar 2021 18:33:52 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4DzlS03MDqz3lFj for ; Mon, 15 Mar 2021 18:33:52 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 665C3153CF for ; Mon, 15 Mar 2021 18:33:52 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 12FIXqUX084728 for ; Mon, 15 Mar 2021 18:33:52 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 12FIXqLd084727 for net@FreeBSD.org; Mon, 15 Mar 2021 18:33:52 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 254244] panics after upgrade to stable/13-n244861-b9773574371 Date: Mon, 15 Mar 2021 18:33:52 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-STABLE X-Bugzilla-Keywords: panic, regression X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: hselasky@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: net@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 15 Mar 2021 18:33:52 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D254244 --- Comment #5 from Hans Petter Selasky --- Hi, I looks to me like iflib's rxeof has produced an invalid chain of mbufs. I only see one bug in there, and that is, if iflib_fixup_rx() gets a new mb= uf header, the m_nextpkt field doesn't get zeroed. If this is easy to reproduce, can you try the attached patch, meanwhile? --HPS --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-net@freebsd.org Mon Mar 15 18:34:20 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 23DE95AB8F1 for ; Mon, 15 Mar 2021 18:34:20 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 4DzlSX04WYz3lhr for ; Mon, 15 Mar 2021 18:34:20 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 028845ABB06; Mon, 15 Mar 2021 18:34:20 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 024E35ABA75 for ; Mon, 15 Mar 2021 18:34:20 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4DzlSW6bNgz3lnQ for ; Mon, 15 Mar 2021 18:34:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id D563415068 for ; Mon, 15 Mar 2021 18:34:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 12FIYJcN084877 for ; Mon, 15 Mar 2021 18:34:19 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 12FIYJZm084876 for net@FreeBSD.org; Mon, 15 Mar 2021 18:34:19 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 254244] panics after upgrade to stable/13-n244861-b9773574371 Date: Mon, 15 Mar 2021 18:34:19 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-STABLE X-Bugzilla-Keywords: panic, regression X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: hselasky@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: net@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: attachments.created Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 15 Mar 2021 18:34:20 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D254244 --- Comment #6 from Hans Petter Selasky --- Created attachment 223301 --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=3D223301&action= =3Dedit Patch to try --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-net@freebsd.org Mon Mar 15 18:35:15 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 541B95ABD14 for ; Mon, 15 Mar 2021 18:35:15 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 4DzlTb1cQ2z3ljZ for ; Mon, 15 Mar 2021 18:35:15 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 373AE5ABB95; Mon, 15 Mar 2021 18:35:15 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 370065ABB94 for ; Mon, 15 Mar 2021 18:35:15 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4DzlTb10tPz3lX3 for ; Mon, 15 Mar 2021 18:35:15 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 158FD153D1 for ; Mon, 15 Mar 2021 18:35:15 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 12FIZFhu085104 for ; Mon, 15 Mar 2021 18:35:15 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 12FIZFbD085103 for net@FreeBSD.org; Mon, 15 Mar 2021 18:35:15 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 254244] panics after upgrade to stable/13-n244861-b9773574371 Date: Mon, 15 Mar 2021 18:35:15 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-STABLE X-Bugzilla-Keywords: panic, regression X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: hselasky@FreeBSD.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: net@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_status Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 15 Mar 2021 18:35:15 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D254244 Hans Petter Selasky changed: What |Removed |Added ---------------------------------------------------------------------------- Status|New |In Progress --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-net@freebsd.org Mon Mar 15 18:46:12 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 7F8C65ABE48 for ; Mon, 15 Mar 2021 18:46:12 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 4DzlkD312Jz3lwv for ; Mon, 15 Mar 2021 18:46:12 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 654805ABBED; Mon, 15 Mar 2021 18:46:12 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 650F65ABB71 for ; Mon, 15 Mar 2021 18:46:12 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4DzlkD2DZCz3m2k for ; Mon, 15 Mar 2021 18:46:12 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 37D5115574 for ; Mon, 15 Mar 2021 18:46:12 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 12FIkBjV089902 for ; Mon, 15 Mar 2021 18:46:11 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 12FIkBuX089901 for net@FreeBSD.org; Mon, 15 Mar 2021 18:46:11 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 254244] panics after upgrade to stable/13-n244861-b9773574371 Date: Mon, 15 Mar 2021 18:46:12 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-STABLE X-Bugzilla-Keywords: panic, regression X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: hselasky@FreeBSD.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: net@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 15 Mar 2021 18:46:12 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D254244 --- Comment #7 from Hans Petter Selasky --- Looks like I'm wrong. m_init() clears m_nextpkt, must be something else. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-net@freebsd.org Mon Mar 15 19:02:56 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 7F4165AC23F for ; Mon, 15 Mar 2021 19:02:56 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 4Dzm5X30Txz3mvQ for ; Mon, 15 Mar 2021 19:02:56 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 66DF95AC5A2; Mon, 15 Mar 2021 19:02:56 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 66A895AC3E8 for ; Mon, 15 Mar 2021 19:02:56 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Dzm5X2PYhz3mvP for ; Mon, 15 Mar 2021 19:02:56 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4588D15B49 for ; Mon, 15 Mar 2021 19:02:56 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 12FJ2uEh097906 for ; Mon, 15 Mar 2021 19:02:56 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 12FJ2utZ097905 for net@FreeBSD.org; Mon, 15 Mar 2021 19:02:56 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 254244] panics after upgrade to stable/13-n244861-b9773574371 Date: Mon, 15 Mar 2021 19:02:56 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-STABLE X-Bugzilla-Keywords: panic, regression X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: markj@FreeBSD.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: net@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 15 Mar 2021 19:02:56 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D254244 --- Comment #8 from Mark Johnston --- There's a number of similar-looking reports on stable/13. I wonder if some= MFC was missed. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-net@freebsd.org Mon Mar 15 19:04:42 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 5B5785AC60B for ; Mon, 15 Mar 2021 19:04:42 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 4Dzm7Z1v6Mz3myR for ; Mon, 15 Mar 2021 19:04:42 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 3F1B75AC0FF; Mon, 15 Mar 2021 19:04:42 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 3EE375AC60A for ; Mon, 15 Mar 2021 19:04:42 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Dzm7Z1C9Xz3n1d for ; Mon, 15 Mar 2021 19:04:42 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 18E4015BBA for ; Mon, 15 Mar 2021 19:04:42 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 12FJ4g4F098321 for ; Mon, 15 Mar 2021 19:04:42 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 12FJ4gQj098320 for net@FreeBSD.org; Mon, 15 Mar 2021 19:04:42 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 254244] panics after upgrade to stable/13-n244861-b9773574371 Date: Mon, 15 Mar 2021 19:04:42 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-STABLE X-Bugzilla-Keywords: panic, regression X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: zarychtam@plan-b.pwste.edu.pl X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: net@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 15 Mar 2021 19:04:42 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D254244 --- Comment #9 from Marek Zarychta --- (In reply to Hans Petter Selasky from comment #7) Too late, the patch was applied and the new kernel is installed. I will rev= ert it then. Could it be LRO issue? I have here LRO enabled on two igb(4)s aggregated wi= th LACP lagg(4) and this lagg(4) is a parent for some vlan(4) interfaces. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-net@freebsd.org Mon Mar 15 19:11:52 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id ACB775AC727 for ; Mon, 15 Mar 2021 19:11:52 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 4DzmHr1NlJz3ndl for ; Mon, 15 Mar 2021 19:11:52 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 2F8F05AC62D; Mon, 15 Mar 2021 19:11:52 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 2F5475AC7B3 for ; Mon, 15 Mar 2021 19:11:52 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4DzmHr0j79z3nWq for ; Mon, 15 Mar 2021 19:11:52 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 0B38A15F64 for ; Mon, 15 Mar 2021 19:11:52 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 12FJBpGU003737 for ; Mon, 15 Mar 2021 19:11:51 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 12FJBpkN003736 for net@FreeBSD.org; Mon, 15 Mar 2021 19:11:51 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 254244] panics after upgrade to stable/13-n244861-b9773574371 Date: Mon, 15 Mar 2021 19:11:52 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-STABLE X-Bugzilla-Keywords: panic, regression X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: markj@FreeBSD.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: net@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 15 Mar 2021 19:11:52 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D254244 --- Comment #10 from Mark Johnston --- (In reply to Marek Zarychta from comment #9) Yes, disabling LRO would be a reasonable first step. I looked at the commi= ts between the problematic revision and the known-good revision and nothing re= ally stands out. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-net@freebsd.org Mon Mar 15 19:20:26 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id E17275AC64D for ; Mon, 15 Mar 2021 19:20:26 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 4DzmTk5sjTz3nn3 for ; Mon, 15 Mar 2021 19:20:26 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id C71A75AC760; Mon, 15 Mar 2021 19:20:26 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id C6E6B5AC75F for ; Mon, 15 Mar 2021 19:20:26 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4DzmTk4kw8z3nlB for ; Mon, 15 Mar 2021 19:20:26 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 91A4715CFB for ; Mon, 15 Mar 2021 19:20:26 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 12FJKQDH006208 for ; Mon, 15 Mar 2021 19:20:26 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 12FJKQf2006207 for net@FreeBSD.org; Mon, 15 Mar 2021 19:20:26 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 254244] panics after upgrade to stable/13-n244861-b9773574371 Date: Mon, 15 Mar 2021 19:20:26 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-STABLE X-Bugzilla-Keywords: panic, regression X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: zarychtam@plan-b.pwste.edu.pl X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: net@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 15 Mar 2021 19:20:26 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D254244 --- Comment #11 from Marek Zarychta --- I have been running 13.0-STABLE on this machine since 8 Feb 2021 and upgrad= ing once or twice a week without issues. The machine was running production cod= e: firewall (PF + IPFW with dummynet), HTTP proxy, some VPN solutions etc. and never experienced panics there. Like I have mentioned above, the last non-panicking build was stable/13-n244798-05083436a6e from Sun Mar 7. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-net@freebsd.org Mon Mar 15 19:22:38 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id AAB6F5ACE5B for ; Mon, 15 Mar 2021 19:22:38 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 4DzmXG4Fr7z3pTG for ; Mon, 15 Mar 2021 19:22:38 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 91F3C5ACEB2; Mon, 15 Mar 2021 19:22:38 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 91AF15ACBEE for ; Mon, 15 Mar 2021 19:22:38 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4DzmXG3fZ9z3pKN for ; Mon, 15 Mar 2021 19:22:38 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 7015F15E33 for ; Mon, 15 Mar 2021 19:22:38 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 12FJMcEj009123 for ; Mon, 15 Mar 2021 19:22:38 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 12FJMc55009122 for net@FreeBSD.org; Mon, 15 Mar 2021 19:22:38 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 254244] panics after upgrade to stable/13-n244861-b9773574371 Date: Mon, 15 Mar 2021 19:22:38 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-STABLE X-Bugzilla-Keywords: panic, regression X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: hselasky@FreeBSD.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: net@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: attachments.isobsolete attachments.created Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 15 Mar 2021 19:22:38 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D254244 Hans Petter Selasky changed: What |Removed |Added ---------------------------------------------------------------------------- Attachment #223301|0 |1 is obsolete| | --- Comment #12 from Hans Petter Selasky --- Created attachment 223304 --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=3D223304&action= =3Dedit Patch to try #2 Try this patch instead. @markj: There are some things I don't understand. Why is tcp_lro_queue_mbuf= () not used when tcp_lro_flush_all() is? Looks buggy to me. Also I see that the lro_possible flag may be stale, I.E. the value from previous mbuf is used for new mbuf. --HPS --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-net@freebsd.org Mon Mar 15 19:29:16 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 8CAE75AD309 for ; Mon, 15 Mar 2021 19:29:16 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 4Dzmgw3LDkz3pYx for ; Mon, 15 Mar 2021 19:29:16 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 727BB5AD1C0; Mon, 15 Mar 2021 19:29:16 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 722B05AD288 for ; Mon, 15 Mar 2021 19:29:16 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Dzmgw2WGHz3pfR for ; Mon, 15 Mar 2021 19:29:16 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 49D201628C for ; Mon, 15 Mar 2021 19:29:16 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 12FJTG9u010478 for ; Mon, 15 Mar 2021 19:29:16 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 12FJTG5D010477 for net@FreeBSD.org; Mon, 15 Mar 2021 19:29:16 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 254244] panics after upgrade to stable/13-n244861-b9773574371 Date: Mon, 15 Mar 2021 19:29:16 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-STABLE X-Bugzilla-Keywords: panic, regression X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: hselasky@FreeBSD.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: net@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 15 Mar 2021 19:29:16 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D254244 Hans Petter Selasky changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |shurd@FreeBSD.org --- Comment #13 from Hans Petter Selasky --- The last commit that touched this code path was: commit 35e4e998d8187c1d4d413bdc13a79a6415a30a18 Author: Stephen Hurd Date: Mon Nov 6 16:23:21 2017 +0000 Only chain non-LRO mbufs when LRO is not possible Preserve packet order between tcp_lro_rx() and if_input() to avoid creating extra corner cases. If no packets can be LROed, combine them into one chain for submission via if_input(). If any packet can potentially be LROed however, retain old behaviour and call if_input() for each packet. This should keep the 12% improvement for small packet forwarding intact, but mostly avoids impacting the LRO case. Reviewed by: cem, sbruno Approved by: sbruno (mentor) Sponsored by: Limelight Networks Differential Revision: https://reviews.freebsd.org/D12876 Notes: svn path=3D/head/; revision=3D325487 --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-net@freebsd.org Mon Mar 15 19:38:34 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 129F55AD2E3 for ; Mon, 15 Mar 2021 19:38:34 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 4Dzmtd6y24z3qfB for ; Mon, 15 Mar 2021 19:38:33 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id EE9025AD430; Mon, 15 Mar 2021 19:38:33 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id EE5AD5AD4E2 for ; Mon, 15 Mar 2021 19:38:33 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Dzmtd6M7Lz3qc0 for ; Mon, 15 Mar 2021 19:38:33 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id CD553163AC for ; Mon, 15 Mar 2021 19:38:33 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 12FJcXWs015424 for ; Mon, 15 Mar 2021 19:38:33 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 12FJcXmD015423 for net@FreeBSD.org; Mon, 15 Mar 2021 19:38:33 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 254244] panics after upgrade to stable/13-n244861-b9773574371 Date: Mon, 15 Mar 2021 19:38:32 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-STABLE X-Bugzilla-Keywords: panic, regression X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: hselasky@FreeBSD.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: net@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 15 Mar 2021 19:38:34 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D254244 --- Comment #14 from Hans Petter Selasky --- Comment on attachment 223294 --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=3D223294 backtrace 1 In the debug (kgdb prompt) you can try to dump this mbuf: print ((struct mbuf *)0xfffff802b067d590)[0] Then try to follow m_nextpkt: print ((struct mbuf *)0xfffff802b067d590)[0].m_nextpkt[0] And see where you end up. --HPS --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-net@freebsd.org Mon Mar 15 19:49:09 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 0ECE25ADC08 for ; Mon, 15 Mar 2021 19:49:09 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 4Dzn6r6qfYz3r1v for ; Mon, 15 Mar 2021 19:49:08 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id E82BD5ADBA5; Mon, 15 Mar 2021 19:49:08 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id E7F435ADC07 for ; Mon, 15 Mar 2021 19:49:08 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Dzn6r69XKz3rDg for ; Mon, 15 Mar 2021 19:49:08 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id C3A89161E5 for ; Mon, 15 Mar 2021 19:49:08 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 12FJn8Bb020235 for ; Mon, 15 Mar 2021 19:49:08 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 12FJn8Eb020234 for net@FreeBSD.org; Mon, 15 Mar 2021 19:49:08 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 254244] panics after upgrade to stable/13-n244861-b9773574371 Date: Mon, 15 Mar 2021 19:49:08 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-STABLE X-Bugzilla-Keywords: panic, regression X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: zarychtam@plan-b.pwste.edu.pl X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: net@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 15 Mar 2021 19:49:09 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D254244 --- Comment #15 from Marek Zarychta --- (In reply to Hans Petter Selasky from comment #12) I am sorry, I can't test it. The patch doesn't apply on last stable/13 sour= ces: Rejected hunk #2. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-net@freebsd.org Mon Mar 15 19:56:15 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id B05D25ADAE0 for ; Mon, 15 Mar 2021 19:56:15 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 4DznH34R2hz3rX6 for ; Mon, 15 Mar 2021 19:56:15 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 9828E5ADD1F; Mon, 15 Mar 2021 19:56:15 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 97F2C5ADD9F for ; Mon, 15 Mar 2021 19:56:15 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4DznH32rMmz3rVF for ; Mon, 15 Mar 2021 19:56:15 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 414BD16713 for ; Mon, 15 Mar 2021 19:56:15 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 12FJuF6V026009 for ; Mon, 15 Mar 2021 19:56:15 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 12FJuFZc026008 for net@FreeBSD.org; Mon, 15 Mar 2021 19:56:15 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 254244] panics after upgrade to stable/13-n244861-b9773574371 Date: Mon, 15 Mar 2021 19:56:14 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-STABLE X-Bugzilla-Keywords: panic, regression X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: hselasky@FreeBSD.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: net@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 15 Mar 2021 19:56:15 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D254244 --- Comment #16 from Hans Petter Selasky --- Did you revert the previous patch? Works fine here: cat iflib.diff | patch -p1 Hmm... Looks like a unified diff to me... The text leading up to this was: -------------------------- |diff --git a/sys/net/iflib.c b/sys/net/iflib.c |index 05e99ba318d..c6a8ec9e25e 100644 |--- a/sys/net/iflib.c |+++ b/sys/net/iflib.c -------------------------- Patching file sys/net/iflib.c using Plan A... Hunk #1 succeeded at 2888 (offset -13 lines). Hunk #2 succeeded at 2975 (offset -13 lines). done commit 763fb2fda0144e3630de74b918d06a96b7968ee2 (HEAD -> stable/13, freebsd/stable/13) Author: Mark Johnston Date: Mon Mar 8 12:39:05 2021 -0500 dumpon.8: Ask DDB to call doadump() rather than calling it directly Sponsored by: The FreeBSD Foundation (cherry picked from commit af06ff55535d9b2de253103e974558104e0a3d97) --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-net@freebsd.org Mon Mar 15 20:55:15 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id E99315AFB95 for ; Mon, 15 Mar 2021 20:55:15 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 4Dzpb764TDz4RQW for ; Mon, 15 Mar 2021 20:55:15 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id CE9BB5AF929; Mon, 15 Mar 2021 20:55:15 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id CE6195AFB94 for ; Mon, 15 Mar 2021 20:55:15 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Dzpb75NFrz4RQV for ; Mon, 15 Mar 2021 20:55:15 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id ABDDB17335 for ; Mon, 15 Mar 2021 20:55:15 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 12FKtFXg055701 for ; Mon, 15 Mar 2021 20:55:15 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 12FKtFbA055700 for net@FreeBSD.org; Mon, 15 Mar 2021 20:55:15 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 254244] panics after upgrade to stable/13-n244861-b9773574371 Date: Mon, 15 Mar 2021 20:55:15 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-STABLE X-Bugzilla-Keywords: panic, regression X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: zarychtam@plan-b.pwste.edu.pl X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: net@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 15 Mar 2021 20:55:16 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D254244 --- Comment #17 from Marek Zarychta --- (In reply to Hans Petter Selasky from comment #14) I am sorry for borking this patch, downloaded the wrong patch (diff to the previous diff). The patch was applied and the system rebooted. To meet initial conditions L= RO is still enabled.=20 I am getting this: (kgdb) print ((struct mbuf *)0xfffff802b067d590)[0] $1 =3D {{m_next =3D 0xd266469b94fc022a, m_slist =3D {sle_next =3D 0xd266469= b94fc022a}, m_stailq =3D {stqe_next =3D 0xd266469b94fc022a}}, {m_nextpkt =3D 0xd9d8353f= 106f5dcf, m_slistpkt =3D { sle_next =3D 0xd9d8353f106f5dcf}, m_stailqpkt =3D {stqe_next =3D 0xd9d8353f106f5dcf}}, m_data =3D 0x4bf25f3f2b29ab25 ,=20 m_len =3D -75255363, m_type =3D 63, m_flags =3D 7210736, {{{m_pkthdr =3D = {{snd_tag =3D 0xf2fa50cacc9239d9, rcvif =3D 0xf2fa50cacc9239d9}, tags =3D {slh_first =3D 0xcce1f9cb1f09b95b},=20 len =3D -750803441, flowid =3D 2961906515, csum_flags =3D 2906213= 133, fibnum =3D 45135, numa_domain =3D 18 '\022', rsstype =3D 165 '\245', {rcv_t= stmp =3D 12294156060680234325, { l2hlen =3D 85 'U', l3hlen =3D 165 '\245', l4hlen =3D 15 '\017= ', l5hlen =3D 202 '\312', inner_l2hlen =3D 204 '\314', inner_l3hlen =3D 157 '\235', inner_l4hlen =3D 157 '\235',=20 inner_l5hlen =3D 170 '\252'}}, PH_per =3D {eight =3D "\365\333\365=C9=87\231\337*", sixteen =3D {56309, 51701, 39303, 10975}, th= irtytwo =3D {3388333045, 719296903}, sixtyfour =3D { 3089356677887417333}, unintptr =3D {3089356677887417333}, ptr= =3D 0x2adf9987c9f5dbf5}, PH_loc =3D {eight =3D "a\375\325)\366{\277\206", sixte= en =3D {64865, 10709, 31734, 34495},=20 thirtytwo =3D {701889889, 2260696054}, sixtyfour =3D {9709615618828139873}, unintptr =3D {9709615618828139873}, ptr =3D 0x86bf7bf629d5fd61}}, {m_epg_npgs =3D 217 '\331',=20 m_epg_nrdy =3D 57 '9', m_epg_hdrlen =3D 146 '\222', m_epg_trllen = =3D 204 '\314', m_epg_1st_off =3D 20682, m_epg_last_len =3D 62202, m_epg_flags =3D = 91 '[',=20 m_epg_record_type =3D 185 '\271', __spare =3D "\t\037", m_epg_enc= _cnt =3D -857605685, m_epg_tls =3D 0xb08b1b53d33fa60f, m_epg_so =3D 0xa512b04fad394b= 0d,=20 m_epg_seqno =3D 12294156060680234325, m_epg_stailq =3D {stqe_next= =3D 0x2adf9987c9f5dbf5}}}, {m_ext =3D {{ext_count =3D 0, ext_cnt =3D 0x0}, ext_= size =3D 0, ext_type =3D 0, ext_flags =3D 0, { {ext_buf =3D 0x7ea3057a88b7afb5 , ext_arg2 =3D 0x0}, {extpg_pa =3D {912514329382= 0645301, 0, 0, 18446735289166059064,=20 60129542144},=20 extpg_trail =3D "\024\000\000\000\000\000\000\000\a\000\000\000.\304\033;>]0\212\000\000\00= 0\000\000\000\000\017\000\000\377\202\000\000\000\000\000\000\000\000\a@\00= 0\000\377\377\000\000\000\000\000\000\000\000\000\000\001\000\000\000\000\0= 00@", extpg_hdr =3D "\000\020\000\000\003\001\000\000\000 9\233\002\370\377\377\000\000\000\000\000\000"}},=20 ext_free =3D 0xa92482001880, ext_arg1 =3D 0x4214bea60a080101}, m_= pktdat =3D 0xfffff802b067d5e8 ""}},=20 m_dat =3D 0xfffff802b067d5b0 "\331\071\222\314\312P\372\362[\271\t\037\313\371\341\314\017\246?\323S\033= \213\260\rK9\255O\260\022\245U\245\017\312=CC=9D\235\252\365\333\365=C9=87\= 231\337*a\375\325)\366{\277\206"}} (kgdb) print ((struct mbuf *)0xfffff802b067d590)[0].m_nextpkt[0] Cannot access memory at address 0xd9d8353f106f5dcf --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-net@freebsd.org Mon Mar 15 21:37:42 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id AF6F6568D84 for ; Mon, 15 Mar 2021 21:37:42 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 4DzqX64Q0zz4V8f for ; Mon, 15 Mar 2021 21:37:42 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 95B15568C13; Mon, 15 Mar 2021 21:37:42 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 9577C568B97 for ; Mon, 15 Mar 2021 21:37:42 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4DzqX63lwrz4Tw1 for ; Mon, 15 Mar 2021 21:37:42 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 73A8517E01 for ; Mon, 15 Mar 2021 21:37:42 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 12FLbgVT076890 for ; Mon, 15 Mar 2021 21:37:42 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 12FLbgWp076889 for net@FreeBSD.org; Mon, 15 Mar 2021 21:37:42 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 254309] [tcp] frequent panics in tcp_output Date: Mon, 15 Mar 2021 21:37:42 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-STABLE X-Bugzilla-Keywords: panic X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: ae@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: net@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: see_also cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 15 Mar 2021 21:37:42 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D254309 Andrey V. Elsukov changed: What |Removed |Added ---------------------------------------------------------------------------- See Also| |https://bugs.freebsd.org/bu | |gzilla/show_bug.cgi?id=3D2= 542 | |44 CC| |ae@FreeBSD.org --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-net@freebsd.org Mon Mar 15 21:37:43 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 7EE3D568C17 for ; Mon, 15 Mar 2021 21:37:43 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 4DzqX72y70z4Ty3 for ; Mon, 15 Mar 2021 21:37:43 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 65583568C15; Mon, 15 Mar 2021 21:37:43 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 652A2568D04 for ; Mon, 15 Mar 2021 21:37:43 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4DzqX72NSNz4TnX for ; Mon, 15 Mar 2021 21:37:43 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 443B3179D0 for ; Mon, 15 Mar 2021 21:37:43 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 12FLbhmq076936 for ; Mon, 15 Mar 2021 21:37:43 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 12FLbh2N076935 for net@FreeBSD.org; Mon, 15 Mar 2021 21:37:43 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 254244] panics after upgrade to stable/13-n244861-b9773574371 Date: Mon, 15 Mar 2021 21:37:42 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-STABLE X-Bugzilla-Keywords: panic, regression X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: ae@FreeBSD.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: net@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: see_also Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 15 Mar 2021 21:37:43 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D254244 Andrey V. Elsukov changed: What |Removed |Added ---------------------------------------------------------------------------- See Also| |https://bugs.freebsd.org/bu | |gzilla/show_bug.cgi?id=3D2= 543 | |09 --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-net@freebsd.org Mon Mar 15 23:19:03 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 1EA6356B5BD for ; Mon, 15 Mar 2021 23:19:03 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 4Dzsn30BM1z4bdP for ; Mon, 15 Mar 2021 23:19:03 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 0664956B80E; Mon, 15 Mar 2021 23:19:03 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 0630056B43D for ; Mon, 15 Mar 2021 23:19:03 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Dzsn26dgzz4brn for ; Mon, 15 Mar 2021 23:19:02 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id D6CD419197 for ; Mon, 15 Mar 2021 23:19:02 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 12FNJ2Sl031692 for ; Mon, 15 Mar 2021 23:19:02 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 12FNJ2Eg031691 for net@FreeBSD.org; Mon, 15 Mar 2021 23:19:02 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 243833] netgraph: If queue is full, don't enqueue in ng_source_rcvdata() Date: Mon, 15 Mar 2021 23:19:03 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: patch X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: nc@FreeBSD.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: FIXED X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: net@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_status resolution Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 15 Mar 2021 23:19:03 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D243833 Neel Chauhan changed: What |Removed |Added ---------------------------------------------------------------------------- Status|New |Closed Resolution|--- |FIXED --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-net@freebsd.org Mon Mar 15 23:23:20 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id DE4B156BC21 for ; Mon, 15 Mar 2021 23:23:20 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 4Dzst05mMzz4c0y for ; Mon, 15 Mar 2021 23:23:20 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id C5DCF56B9C4; Mon, 15 Mar 2021 23:23:20 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id C5AB356B9C2 for ; Mon, 15 Mar 2021 23:23:20 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Dzst059Ssz4cG2 for ; Mon, 15 Mar 2021 23:23:20 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id A257F19363 for ; Mon, 15 Mar 2021 23:23:20 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 12FNNKmE035114 for ; Mon, 15 Mar 2021 23:23:20 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 12FNNKEe035113 for net@FreeBSD.org; Mon, 15 Mar 2021 23:23:20 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 241121] netinet: In multicast/broadcast udp(6)_input(), compare the IP details after we lock inp as well Date: Mon, 15 Mar 2021 23:23:20 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: patch X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: nc@FreeBSD.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: Not Accepted X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: net@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: resolution bug_status Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 15 Mar 2021 23:23:20 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D241121 Neel Chauhan changed: What |Removed |Added ---------------------------------------------------------------------------- Resolution|--- |Not Accepted Status|New |Closed --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-net@freebsd.org Tue Mar 16 00:30:04 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 695D256D1FB for ; Tue, 16 Mar 2021 00:30:04 +0000 (UTC) (envelope-from bc979@lafn.org) Received: from mail.sermon-archive.info (sermon-archive.info [47.181.130.121]) by mx1.freebsd.org (Postfix) with ESMTP id 4DzvLz2jPhz4hL6 for ; Tue, 16 Mar 2021 00:30:02 +0000 (UTC) (envelope-from bc979@lafn.org) Received: from [10.0.1.251] (mini [10.0.1.251]) by mail.sermon-archive.info (Postfix) with ESMTPSA id 4DzvLr03tSz2fjQB for ; Mon, 15 Mar 2021 17:29:55 -0700 (PDT) From: Doug Hardie Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable Mime-Version: 1.0 (Mac OS X Mail 14.0 \(3654.60.0.2.21\)) Subject: Re: IPv6 Startup Date: Mon, 15 Mar 2021 17:29:55 -0700 References: <06A12556-0C24-48AD-9D1C-C04491AADAF6@sermon-archive.info> To: freebsd-net@freebsd.org In-Reply-To: <06A12556-0C24-48AD-9D1C-C04491AADAF6@sermon-archive.info> Message-Id: <5EDD7B95-A25C-4414-B0CA-8A245A8FA920@sermon-archive.info> X-Mailer: Apple Mail (2.3654.60.0.2.21) X-Virus-Scanned: clamav-milter 0.103.0 at mail X-Virus-Status: Clean X-Rspamd-Queue-Id: 4DzvLz2jPhz4hL6 X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of bc979@lafn.org designates 47.181.130.121 as permitted sender) smtp.mailfrom=bc979@lafn.org X-Spamd-Result: default: False [-2.70 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FROM_HAS_DN(0.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[47.181.130.121:from]; MV_CASE(0.50)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[text/plain]; TO_DN_NONE(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-net@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; SPAMHAUS_ZRD(0.00)[47.181.130.121:from:127.0.2.255]; DMARC_NA(0.00)[lafn.org: no valid DMARC record]; R_SPF_ALLOW(-0.20)[+mx]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-1.000]; RCVD_NO_TLS_LAST(0.10)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:5650, ipnet:47.181.128.0/18, country:US]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[freebsd-net] X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 16 Mar 2021 00:30:04 -0000 >=20 > On 13 March 2021, at 17:03, Doug Hardie = wrote: >=20 > I have two systems on the same ethernet. One is configured as a = router, the other as a host. rtadvd is running on the router, rtsold on = the host, and route6d on both. The router was up and running and I = initiated tcpdump of ip6 packets on the interface. Then I booted the = host. The results are interesting: >=20 > 22:26:17.963393 IP6 (hlim 255, next-header ICMPv6 (58) payload length: = 16) fe80::aa60:b6ff:fe1d:8dbc > ff02::2: [icmp6 sum ok] ICMP6, router = solicitation, length 16 > source link-address option (1), length 8 (1): = a8:60:b6:1d:8d:bc > 0x0000: 6000 0000 0010 3aff fe80 0000 0000 0000 > 0x0010: aa60 b6ff fe1d 8dbc ff02 0000 0000 0000 > 0x0020: 0000 0000 0000 0002 8500 a2b8 0000 0000 > 0x0030: 0101 a860 b61d 8dbc >=20 > 22:26:17.997455 IP6 (hlim 255, next-header ICMPv6 (58) payload length: = 56) fe80::3e18:a0ff:fe44:765b > ff02::1: [icmp6 sum ok] ICMP6, router = advertisement, length 56 > hop limit 64, Flags [none], pref medium, router lifetime 1800s, = reachable time 0ms, retrans timer 0ms > source link-address option (1), length 8 (1): = 3c:18:a0:44:76:5b > prefix info option (3), length 32 (4): fec2::/64, Flags = [onlink, auto], valid time 2592000s, pref. time 604800s > 0x0000: 6000 0000 0038 3aff fe80 0000 0000 0000 > 0x0010: 3e18 a0ff fe44 765b ff02 0000 0000 0000 > 0x0020: 0000 0000 0000 0001 8600 8356 4000 0708 > 0x0030: 0000 0000 0000 0000 0101 3c18 a044 765b > 0x0040: 0304 40c0 0027 8d00 0009 3a80 0000 0000 > 0x0050: fec2 0000 0000 0000 0000 0000 0000 0000 >=20 > 22:26:18.011402 IP6 (hlim 255, next-header ICMPv6 (58) payload length: = 32) :: > ff02::1:ff00:210: [icmp6 sum ok] ICMP6, neighbor solicitation, = length 32, who has fec2::210 > unknown option (14), length 8 (1):=20 > 0x0000: cc1a 5611 b76a > 0x0000: 6000 0000 0020 3aff 0000 0000 0000 0000 > 0x0010: 0000 0000 0000 0000 ff02 0000 0000 0000 > 0x0020: 0000 0001 ff00 0210 8700 9025 0000 0000 > 0x0030: fec2 0000 0000 0000 0000 0000 0000 0210 > 0x0040: 0e01 cc1a 5611 b76a >=20 > 22:26:18.098774 IP6 (hlim 255, next-header ICMPv6 (58) payload length: = 32) :: > ff02::1:ff1d:8dbc: [icmp6 sum ok] ICMP6, neighbor solicitation, = length 32, who has fec2::aa60:b6ff:fe1d:8dbc > unknown option (14), length 8 (1):=20 > 0x0000: c983 4557 f1d3 > 0x0000: 6000 0000 0020 3aff 0000 0000 0000 0000 > 0x0010: 0000 0000 0000 0000 ff02 0000 0000 0000 > 0x0020: 0000 0001 ff1d 8dbc 8700 f218 0000 0000 > 0x0030: fec2 0000 0000 0000 aa60 b6ff fe1d 8dbc > 0x0040: 0e01 c983 4557 f1d3 >=20 > The first packet is the host sending a router solicitation. The = second is the router responding with the advertisement with the various = routes it has. The third and fourth packets appear to be the Duplicate = Address Detection packets for the two addresses on the host. There is = no response to either. After this, a number of other packets continue = on and on. >=20 > The question is, why are the host addresses being used before DAD is = attempted? It appears there could be some really interesting problems = if the link-layer address actually was duplicated. The problems would = happen before DAD was even attempted? I reduced the configuration to the host settings: ifconfig_bge0_ipv6=3D"inet6 accept_rtadv" The router to: ifconfig_ue0_ipv6=3D"up" Ran tcpdump on the router (obviously not acting as a router) and = restarted the host. Got the following: tcpdump: listening on ue0, link-type EN10MB (Ethernet), capture size = 262144 bytes 19:05:00.048637 IP6 (hlim 1, next-header Options (0) payload length: 56) = fe80::aa60:b6ff:fe1d:8dbc > ff02::16: HBH (padn)(rtalert: 0x0000) = [icmp6 sum ok] ICMP6, multicast listener report v2, 2 group record(s) = [gaddr ff02::2:ec7d:574c to_ex, 0 source(s)] [gaddr ff02::2:ffec:7d57 = to_ex, 0 source(s)] 19:05:00.171029 IP6 (hlim 255, next-header ICMPv6 (58) payload length: = 16) fe80::aa60:b6ff:fe1d:8dbc > ff02::2: [icmp6 sum ok] ICMP6, router = solicitation, length 16 source link-address option (1), length 8 (1): = a8:60:b6:1d:8d:bc 19:05:04.198640 IP6 (hlim 255, next-header ICMPv6 (58) payload length: = 16) fe80::aa60:b6ff:fe1d:8dbc > ff02::2: [icmp6 sum ok] ICMP6, router = solicitation, length 16 source link-address option (1), length 8 (1): = a8:60:b6:1d:8d:bc 19:05:08.449844 IP6 (hlim 255, next-header ICMPv6 (58) payload length: = 16) fe80::aa60:b6ff:fe1d:8dbc > ff02::2: [icmp6 sum ok] ICMP6, router = solicitation, length 16 source link-address option (1), length 8 (1): = a8:60:b6:1d:8d:bc The first packet is a multicast listener report. However, as I = understand RFC 3590 section 3, That should have been sent using the :: = address, not the link-local address as the link-local address is still = tentative.=20 Then follows 3 packets that look like DAD. However, they also come from = the tentative link-local address. I believe they should come from :: = also, at least the first one. There is not a lot of time between the = first two. These two devices are the only ones on that LAN so nothing = is going to respond. Is this a bug in the software, or in my understanding? -- Doug= From owner-freebsd-net@freebsd.org Mon Mar 15 11:56:58 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id A0E6B57948F for ; Mon, 15 Mar 2021 11:56:58 +0000 (UTC) (envelope-from contact@blakehartshorn.com) Received: from mail-qk1-x733.google.com (mail-qk1-x733.google.com [IPv6:2607:f8b0:4864:20::733]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4DzZf10kVzz4k7C for ; Mon, 15 Mar 2021 11:56:56 +0000 (UTC) (envelope-from contact@blakehartshorn.com) Received: by mail-qk1-x733.google.com with SMTP id l132so31280490qke.7 for ; Mon, 15 Mar 2021 04:56:56 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=blakehartshorn-com.20150623.gappssmtp.com; s=20150623; h=from:to:subject:date:message-id:mime-version :content-transfer-encoding; bh=1JZWF5NjQE+mfkycYN0xSo+E1O4obKClbFmT2DmzcsQ=; b=HGOvFEZl2mmDVuSq2R2+h0/5Q1ANcam1bOOFOjA0GQqR52qpVLGPcxZYXzh8Bz5liI BIRbgIVX3dHw4PgDbOMN1Xu/McKty/vdvRV0y+TSm1YdrPJn0kzaL7gZCjDw2/qR5ZZT PFyVZ7DFdPrwRCATt0G/VCPdVRYy1nVLLb7ojHheQcf/Nku2KEe0R+Dah1zJcxxHdePu MdonneB0YtscHffzMmWi7Ii23ync75ywRPG0PjSdv5WMy3vGhnpLqHYlQMlBxTsEIgLA rjB6iKKR1dnzqSpkeUOthLhetFUnSN4m/NGaYIewhDv6qMrS5QQXvYdsj8E/AaD0wU1H ydGg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:subject:date:message-id:mime-version :content-transfer-encoding; bh=1JZWF5NjQE+mfkycYN0xSo+E1O4obKClbFmT2DmzcsQ=; b=ndjehm17yYQn6WgcqKnZuMI79Zx8NpK/sE7hIGNEDHbkdTAjC/htJRBJEYCTX7oX6M CpMf2pqdhrTpoz+vOuguFnNnjtoKqOExFK8RBlTuL18pgZEgVPvGXzfKjwSPL8SMnSck D9Qjo/cT4c4ZZymsIO4hglkDtZ3y22NNXgzs6OXq0mrXUV25dhQN/uG+MJwsj6kS1Bau UqebJTOHZvBPEy66Wd+LXVwUrnVe+qpUF5vCsDOESjWEASMnEcpbD/IsUPuHFpn2ABXg DyT/AR0S8THtpPXWOncfeaE1KD2vDEoZx9M7z8B6OZNOku+nAOjwG1zlK8dJWUhdJsf6 0abw== X-Gm-Message-State: AOAM533kuGOaGiYKYzeVxJLlFNqIhs18QYE6WfxKjJvqkeTQHg419Asp oZi7yFY2uXOgwEOo5hTJjdLSIMrRblWJAvEK X-Google-Smtp-Source: ABdhPJyzl4JPsEX+oWY0Qi5uxjasFiKCFLZ4yiwR0tslh22Ipj93qKNUTiDL58jQ3LCxe15xw3KVeQ== X-Received: by 2002:a37:a211:: with SMTP id l17mr25127319qke.195.1615809415824; Mon, 15 Mar 2021 04:56:55 -0700 (PDT) Received: from thinkbook.localnet ([2601:18d:97f:d245:19c8:c0c6:3e30:58d8]) by smtp.gmail.com with ESMTPSA id y13sm10462251qto.39.2021.03.15.04.56.54 for (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Mon, 15 Mar 2021 04:56:55 -0700 (PDT) From: Blake Hartshorn To: freebsd-net@freebsd.org Subject: Severe IPv6 TCP transfer issues on 13.0-RC1 and RC2 Date: Mon, 15 Mar 2021 07:56:54 -0400 Message-ID: <5753280.1HxCrU2fYu@thinkbook> MIME-Version: 1.0 Content-Transfer-Encoding: 7Bit Content-Type: text/plain; charset="us-ascii" X-Rspamd-Queue-Id: 4DzZf10kVzz4k7C X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=blakehartshorn-com.20150623.gappssmtp.com header.s=20150623 header.b=HGOvFEZl; dmarc=none; spf=none (mx1.freebsd.org: domain of contact@blakehartshorn.com has no SPF policy when checking 2607:f8b0:4864:20::733) smtp.mailfrom=contact@blakehartshorn.com X-Spamd-Result: default: False [-2.10 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_DN_NONE(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; DKIM_TRACE(0.00)[blakehartshorn-com.20150623.gappssmtp.com:+]; NEURAL_HAM_SHORT(-0.80)[-0.802]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RBL_DBL_DONT_QUERY_IPS(0.00)[2607:f8b0:4864:20::733:from]; CTE_CASE(0.50)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[blakehartshorn-com.20150623.gappssmtp.com:s=20150623]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-net@freebsd.org]; DMARC_NA(0.00)[blakehartshorn.com]; RCPT_COUNT_ONE(0.00)[1]; SPAMHAUS_ZRD(0.00)[2607:f8b0:4864:20::733:from:127.0.2.255]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::733:from]; R_SPF_NA(0.00)[no SPF record]; MID_RHS_NOT_FQDN(0.50)[]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-net] X-Mailman-Approved-At: Tue, 16 Mar 2021 06:19:29 +0000 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 15 Mar 2021 11:56:58 -0000 The short version, when I use FreeBSD 13, delivering data can take 5 minutes for 1MB over SSH or HTTP when using IPv6. This problem does not happen with IPv4. I installed FreeBSD 12 and Linux on that same device, neither had the problem. Did some troubleshooting with Linode, have ultimately ruled the network itself out at this point. When the server is on FreeBSD 13, it can download quickly over IPv6, but not deliver. Started investigating after noticing my SSH session was lagging when cat'ing large files or running builds. This problem even occurs between VMs in the same datacenter. I generated a 1MB file of base64 garbage served by nginx for testing. IPv6 is being configured by SLAAC and on both 12 and 13 installs was setup by the installer. Linode uses Linux/KVM hosts for their virtual machines so it's running on that virtual adapter. I asked on the forums, another user recommended going to the mailing lists instead. Does anyone know if config settings need to be different on 13? Did I maybe just find a real issue? I can provide any requested details. Thanks! From owner-freebsd-net@freebsd.org Tue Mar 16 07:37:07 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 6895157A296 for ; Tue, 16 Mar 2021 07:37:07 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 4F04ql2LT3z3Q85 for ; Tue, 16 Mar 2021 07:37:07 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 5065257A164; Tue, 16 Mar 2021 07:37:07 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 5023C57A163 for ; Tue, 16 Mar 2021 07:37:07 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4F04ql1m0kz3QB7 for ; Tue, 16 Mar 2021 07:37:07 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 2E5AA1FB99 for ; Tue, 16 Mar 2021 07:37:07 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 12G7b7l8092827 for ; Tue, 16 Mar 2021 07:37:07 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 12G7b7JG092826 for net@FreeBSD.org; Tue, 16 Mar 2021 07:37:07 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 254244] panics after upgrade to stable/13-n244861-b9773574371 Date: Tue, 16 Mar 2021 07:37:06 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-STABLE X-Bugzilla-Keywords: panic, regression X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: sergey.dyatko@gmail.com X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: net@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 16 Mar 2021 07:37:07 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D254244 --- Comment #18 from Sergey V. Dyatko --- (In reply to Mark Johnston from comment #10) i've already tried disabing LRO on r368448 - without luck, + I can't get du= mp on host with netdumpd running. Last Friday I've tried to use net/intel-ix-kmod and got a panic again, and again without dump :( Unfortunately, since December 2020, I still haven't learned how to reproduce this problem. next step I plan to test - add 'nodevice iflib' and re-install kernel BTW last known (by me) revision w/o this panic is head@r360004 Hope this helps --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-net@freebsd.org Tue Mar 16 08:16:26 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id D43D057B54D for ; Tue, 16 Mar 2021 08:16:26 +0000 (UTC) (envelope-from tuexen@freebsd.org) Received: from drew.franken.de (drew.ipv6.franken.de [IPv6:2001:638:a02:a001:20e:cff:fe4a:feaa]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "*.franken.de", Issuer "Sectigo RSA Domain Validation Secure Server CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4F05j63qBtz3j47 for ; Tue, 16 Mar 2021 08:16:26 +0000 (UTC) (envelope-from tuexen@freebsd.org) Received: from [IPv6:2a02:8109:1140:c3d:98e:1307:de88:8980] (unknown [IPv6:2a02:8109:1140:c3d:98e:1307:de88:8980]) (Authenticated sender: macmic) by mail-n.franken.de (Postfix) with ESMTPSA id 7992877101730; Tue, 16 Mar 2021 09:16:16 +0100 (CET) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 14.0 \(3654.60.0.2.21\)) Subject: Re: Severe IPv6 TCP transfer issues on 13.0-RC1 and RC2 From: tuexen@freebsd.org In-Reply-To: <5753280.1HxCrU2fYu@thinkbook> Date: Tue, 16 Mar 2021 09:16:15 +0100 Cc: freebsd-net@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: References: <5753280.1HxCrU2fYu@thinkbook> To: Blake Hartshorn X-Mailer: Apple Mail (2.3654.60.0.2.21) X-Spam-Status: No, score=-2.9 required=5.0 tests=ALL_TRUSTED,BAYES_00, URIBL_BLOCKED autolearn=disabled version=3.4.1 X-Spam-Checker-Version: SpamAssassin 3.4.1 (2015-04-28) on mail-n.franken.de X-Rspamd-Queue-Id: 4F05j63qBtz3j47 X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [0.00 / 15.00]; local_wl_from(0.00)[freebsd.org]; ASN(0.00)[asn:680, ipnet:2001:638::/32, country:DE] X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 16 Mar 2021 08:16:26 -0000 > On 15. Mar 2021, at 12:56, Blake Hartshorn = wrote: >=20 > The short version, when I use FreeBSD 13, delivering data can take 5 = minutes for 1MB over SSH or HTTP when using IPv6. This problem does not = happen with IPv4. I installed FreeBSD 12 and Linux on that same device, = neither had the problem. >=20 > Did some troubleshooting with Linode, have ultimately ruled the = network itself out at this point. When the server is on FreeBSD 13, it = can download quickly over IPv6, but not deliver. Started investigating = after noticing my SSH session was lagging when cat'ing large files or = running builds. This problem even occurs between VMs in the same = datacenter. I generated a 1MB file of base64 garbage served by nginx for = testing. IPv6 is being configured by SLAAC and on both 12 and 13 = installs was setup by the installer. Linode uses Linux/KVM hosts for = their virtual machines so it's running on that virtual adapter. >=20 > I asked on the forums, another user recommended going to the mailing = lists instead. Does anyone know if config settings need to be different = on 13? Did I maybe just find a real issue? I can provide any requested = details. Thanks! Could you prove a .pcap tracefile, one from the sender, one from the = recevier, of a TCP/IPv6 connection, which doesn't work as expected. For example, use = your 1MB base64 garbage transfer. Best regardes Michael >=20 >=20 > _______________________________________________ > freebsd-net@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-net > To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org" From owner-freebsd-net@freebsd.org Tue Mar 16 10:32:46 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 1E5E457FF84 for ; Tue, 16 Mar 2021 10:32:46 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 4F08kP6vyrz3rhr for ; Tue, 16 Mar 2021 10:32:45 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id ED14A57FEA8; Tue, 16 Mar 2021 10:32:45 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id EBADC57FE33 for ; Tue, 16 Mar 2021 10:32:45 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4F08kP5l4Cz3rfG for ; Tue, 16 Mar 2021 10:32:45 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id B81CB21F32 for ; Tue, 16 Mar 2021 10:32:45 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 12GAWjlH089516 for ; Tue, 16 Mar 2021 10:32:45 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 12GAWj1S089515 for net@FreeBSD.org; Tue, 16 Mar 2021 10:32:45 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 254333] sysctl net.inet.tcp.hostcache.list hangs Date: Tue, 16 Mar 2021 10:32:46 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.4-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: linimon@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: net@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: assigned_to Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 16 Mar 2021 10:32:46 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D254333 Mark Linimon changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|bugs@FreeBSD.org |net@FreeBSD.org --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-net@freebsd.org Tue Mar 16 10:55:05 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 820B45A89BE for ; Tue, 16 Mar 2021 10:55:05 +0000 (UTC) (envelope-from lutz@iks-jena.de) Received: from annwfn.iks-jena.de (annwfn.iks-jena.de [IPv6:2001:4bd8::19]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4F09D83xTZz3tWG for ; Tue, 16 Mar 2021 10:55:04 +0000 (UTC) (envelope-from lutz@iks-jena.de) X-SMTP-Sender: IPv6:2001:4bd8:0:666:248:54ff:fe12:ee3f Received: from belenus.iks-jena.de (belenus.iks-jena.de [IPv6:2001:4bd8:0:666:248:54ff:fe12:ee3f]) by annwfn.iks-jena.de (8.15.2/8.15.2) with ESMTPS id 12GAsiCX007415 (version=TLSv1 cipher=DHE-RSA-AES256-SHA bits=256 verify=NOT); Tue, 16 Mar 2021 11:54:45 +0100 X-MSA-Host: belenus.iks-jena.de Received: (from lutz@localhost) by belenus.iks-jena.de (8.14.3/8.14.1/Submit) id 12GAsiWc016040; Tue, 16 Mar 2021 11:54:44 +0100 Date: Tue, 16 Mar 2021 11:54:44 +0100 From: Lutz Donnerhacke To: Doug Hardie Cc: freebsd-net@freebsd.org Subject: Re: IPv6 Startup Message-ID: <20210316105444.GA15531@belenus.iks-jena.de> References: <06A12556-0C24-48AD-9D1C-C04491AADAF6@sermon-archive.info> <5EDD7B95-A25C-4414-B0CA-8A245A8FA920@sermon-archive.info> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <5EDD7B95-A25C-4414-B0CA-8A245A8FA920@sermon-archive.info> X-message-flag: Please send plain text messages only. Thank you. User-Agent: Mutt/1.5.17 (2007-11-01) X-Rspamd-Queue-Id: 4F09D83xTZz3tWG X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of lutz@iks-jena.de designates 2001:4bd8::19 as permitted sender) smtp.mailfrom=lutz@iks-jena.de X-Spamd-Result: default: False [-3.00 / 15.00]; RCVD_TLS_ALL(0.00)[]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2001:4bd8::/48]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[donnerhacke.de]; RBL_DBL_DONT_QUERY_IPS(0.00)[2001:4bd8::19:from]; SPAMHAUS_ZRD(0.00)[2001:4bd8::19:from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; NEURAL_HAM_SHORT(-1.00)[-0.999]; RCPT_COUNT_TWO(0.00)[2]; FORGED_SENDER(0.30)[lutz@donnerhacke.de,lutz@iks-jena.de]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:15725, ipnet:2001:4bd8::/29, country:DE]; FROM_NEQ_ENVFROM(0.00)[lutz@donnerhacke.de,lutz@iks-jena.de]; MAILMAN_DEST(0.00)[freebsd-net]; RCVD_COUNT_TWO(0.00)[2] X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 16 Mar 2021 10:55:05 -0000 On Mon, Mar 15, 2021 at 05:29:55PM -0700, Doug Hardie wrote: > I reduced the configuration to the host settings: > ifconfig_bge0_ipv6="inet6 accept_rtadv" > > The router to: > ifconfig_ue0_ipv6="up" > > Ran tcpdump on the router (obviously not acting as a router) and restarted the host. Got the following: > > tcpdump: listening on ue0, link-type EN10MB (Ethernet), capture size 262144 bytes The device is using a EUI-64 link local address, which is unique by definition. Therefore no DAD is necessary, the address can be used immediatly. If you use a manually generated address, even if it has a EUI-64 form, DAD is required. DAD consists of Neighbour Solication messages. I understand your point, questioning if DAD should be done in any case or not. That's a complicated topic, which requires a lot of RFC exegesis, studying interop tests results from the IETF and IPv6 certificate organisations, and practical market dominance. > 19:05:00.048637 IP6 (hlim 1, next-header Options (0) payload length: 56) fe80::aa60:b6ff:fe1d:8dbc > ff02::16: HBH (padn)(rtalert: 0x0000) [icmp6 sum ok] ICMP6, multicast listener report v2, 2 group record(s) [gaddr ff02::2:ec7d:574c to_ex, 0 source(s)] [gaddr ff02::2:ffec:7d57 to_ex, 0 source(s)] Because IPv6 uses unicast and multicast only, the device registers itself for the necessary link local multicast groups. > 19:05:00.171029 IP6 (hlim 255, next-header ICMPv6 (58) payload length: 16) fe80::aa60:b6ff:fe1d:8dbc > ff02::2: [icmp6 sum ok] ICMP6, router solicitation, length 16 > source link-address option (1), length 8 (1): a8:60:b6:1d:8d:bc The device will use SLAAC for address configuration, but do not want to wait for the next Router Advertisement, so it asks for an immediate response from the router. > 19:05:04.198640 IP6 (hlim 255, next-header ICMPv6 (58) payload length: 16) fe80::aa60:b6ff:fe1d:8dbc > ff02::2: [icmp6 sum ok] ICMP6, router solicitation, length 16 > source link-address option (1), length 8 (1): a8:60:b6:1d:8d:bc No router answered, maybe the packet was lost. So the device ask again for a router in order to complete SLAAC. > 19:05:08.449844 IP6 (hlim 255, next-header ICMPv6 (58) payload length: 16) fe80::aa60:b6ff:fe1d:8dbc > ff02::2: [icmp6 sum ok] ICMP6, router solicitation, length 16 > source link-address option (1), length 8 (1): a8:60:b6:1d:8d:bc No router answered, maybe the packet was lost. So the device ask again for a router in order to complete SLAAC. From owner-freebsd-net@freebsd.org Tue Mar 16 11:00:58 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 600A35A8B5C for ; Tue, 16 Mar 2021 11:00:58 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 4F09Ly1tqfz3tvL for ; Tue, 16 Mar 2021 11:00:58 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 1B7D05A8D1B; Tue, 16 Mar 2021 11:00:58 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 104C15A8BBA for ; Tue, 16 Mar 2021 11:00:58 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4F09Lx0X8Hz3tvH for ; Tue, 16 Mar 2021 11:00:57 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id E131A222FA for ; Tue, 16 Mar 2021 11:00:56 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 12GB0u83000992 for ; Tue, 16 Mar 2021 11:00:56 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 12GB0uRI000991 for net@FreeBSD.org; Tue, 16 Mar 2021 11:00:56 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 254333] [tcp] sysctl net.inet.tcp.hostcache.list hangs Date: Tue, 16 Mar 2021 11:00:57 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.4-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: tuexen@freebsd.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: net@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc short_desc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 16 Mar 2021 11:00:58 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D254333 Michael Tuexen changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |tuexen@freebsd.org Summary|sysctl |[tcp] sysctl |net.inet.tcp.hostcache.list |net.inet.tcp.hostcache.list |hangs |hangs --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-net@freebsd.org Tue Mar 16 11:50:10 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id DF22F5A9D21 for ; Tue, 16 Mar 2021 11:50:10 +0000 (UTC) (envelope-from tuexen@freebsd.org) Received: from drew.franken.de (mail-n.franken.de [193.175.24.27]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "*.franken.de", Issuer "Sectigo RSA Domain Validation Secure Server CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4F0BRk52Fbz4RZg for ; Tue, 16 Mar 2021 11:50:10 +0000 (UTC) (envelope-from tuexen@freebsd.org) Received: from [IPv6:2a02:8109:1140:c3d:98e:1307:de88:8980] (unknown [IPv6:2a02:8109:1140:c3d:98e:1307:de88:8980]) (Authenticated sender: macmic) by mail-n.franken.de (Postfix) with ESMTPSA id 670D97755F8E7; Tue, 16 Mar 2021 12:50:06 +0100 (CET) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 14.0 \(3654.60.0.2.21\)) Subject: Re: Severe IPv6 TCP transfer issues on 13.0-RC1 and RC2 From: tuexen@freebsd.org In-Reply-To: <10847992.4GmZMkJedg@thinkbook> Date: Tue, 16 Mar 2021 12:50:05 +0100 Cc: freebsd-net@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: <2808496E-C2B5-4B6F-8FDB-310B7F69E540@freebsd.org> References: <5753280.1HxCrU2fYu@thinkbook> <10847992.4GmZMkJedg@thinkbook> To: Blake Hartshorn X-Mailer: Apple Mail (2.3654.60.0.2.21) X-Spam-Status: No, score=-2.9 required=5.0 tests=ALL_TRUSTED,BAYES_00, URIBL_BLOCKED autolearn=disabled version=3.4.1 X-Spam-Checker-Version: SpamAssassin 3.4.1 (2015-04-28) on mail-n.franken.de X-Rspamd-Queue-Id: 4F0BRk52Fbz4RZg X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[] X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 16 Mar 2021 11:50:10 -0000 > On 16. Mar 2021, at 11:55, Blake Hartshorn = wrote: >=20 > Hi Michael, >=20 > I've attached tcpdumps for port 80 on both sides of a bad transfer, = using 2 VMs in the same datacenter, FreeBSD 13 serving and 12 as a = client. A friend of mine suggested I also run some tests with iperf3, so = pasting those results below. You'll see it going fast in one direction = and crawling in the other on TCP. There's also some disparity on UDP.=20 The problem is that the server provides TCP segments larger than the MTU to the NIC. These are dropped and needs to be retransmitted. That is why it takes so long. So I guess TSO is enabled on the NIC and not working = correctly. What is the output of ifconfig? Can you disable TSO? Does that work = around the problem? Best regards Michael >=20 > TCP: > [ ID][Role] Interval Transfer Bitrate Retr Cwnd > [ 5][TX-C] 0.00-1.00 sec 27.7 MBytes 233 Mbits/sec 342 26.7 = KBytes =20 > [ 7][RX-C] 0.00-1.00 sec 4.18 KBytes 34.3 Kbits/sec = =20 > [ 5][TX-C] 1.00-2.00 sec 15.8 MBytes 132 Mbits/sec 249 52.0 = KBytes =20 > [ 7][RX-C] 1.00-2.00 sec 4.18 KBytes 34.3 Kbits/sec = =20 > [ 5][TX-C] 2.00-3.00 sec 13.7 MBytes 115 Mbits/sec 307 15.4 = KBytes =20 > [ 7][RX-C] 2.00-3.00 sec 4.18 KBytes 34.3 Kbits/sec = =20 > [ 5][TX-C] 3.00-4.00 sec 14.5 MBytes 121 Mbits/sec 260 22.4 = KBytes =20 > [ 7][RX-C] 3.00-4.00 sec 4.18 KBytes 34.3 Kbits/sec = =20 > [ 5][TX-C] 4.00-5.00 sec 14.3 MBytes 120 Mbits/sec 240 37.9 = KBytes =20 > [ 7][RX-C] 4.00-5.00 sec 5.58 KBytes 45.7 Kbits/sec = =20 > [ 5][TX-C] 5.00-6.00 sec 17.7 MBytes 149 Mbits/sec 363 15.4 = KBytes =20 > [ 7][RX-C] 5.00-6.00 sec 4.18 KBytes 34.3 Kbits/sec = =20 > [ 5][TX-C] 6.00-7.00 sec 14.8 MBytes 124 Mbits/sec 287 8.38 = KBytes =20 > [ 7][RX-C] 6.00-7.00 sec 5.58 KBytes 45.7 Kbits/sec = =20 > [ 5][TX-C] 7.00-8.00 sec 14.7 MBytes 123 Mbits/sec 293 28.1 = KBytes =20 > [ 7][RX-C] 7.00-8.00 sec 4.18 KBytes 34.3 Kbits/sec = =20 > [ 5][TX-C] 8.00-9.00 sec 11.9 MBytes 100 Mbits/sec 325 18.3 = KBytes =20 > [ 7][RX-C] 8.00-9.00 sec 4.18 KBytes 34.3 Kbits/sec = =20 > [ 5][TX-C] 9.00-10.00 sec 14.3 MBytes 120 Mbits/sec 315 39.3 = KBytes =20 > [ 7][RX-C] 9.00-10.00 sec 4.18 KBytes 34.3 Kbits/sec = =20 > - - - - - - - - - - - - - - - - - - - - - - - - - > [ ID][Role] Interval Transfer Bitrate Retr > [ 5][TX-C] 0.00-10.00 sec 159 MBytes 134 Mbits/sec 2981 = sender > [ 5][TX-C] 0.00-10.00 sec 159 MBytes 134 Mbits/sec = receiver > [ 7][RX-C] 0.00-10.00 sec 77.0 KBytes 63.1 Kbits/sec 65 = sender > [ 7][RX-C] 0.00-10.00 sec 44.6 KBytes 36.6 Kbits/sec = receiver > = --------------------------------------------------------------------------= --------------------------------- >=20 >=20 > UDP: > [ ID][Role] Interval Transfer Bitrate Jitter = Lost/Total Datagrams > [ 5][TX-C] 0.00-1.00 sec 81.6 MBytes 685 Mbits/sec = 67798 =20 > [ 7][RX-C] 0.00-1.00 sec 8.80 MBytes 73.8 Mbits/sec 0.255 ms = 54070/60475 (89%) =20 > [ 5][TX-C] 1.00-2.00 sec 72.7 MBytes 610 Mbits/sec = 64802 =20 > [ 7][RX-C] 1.00-2.00 sec 8.52 MBytes 71.5 Mbits/sec 0.154 ms = 68912/75116 (92%) =20 > [ 5][TX-C] 2.00-3.00 sec 73.7 MBytes 618 Mbits/sec = 64158 =20 > [ 7][RX-C] 2.00-3.00 sec 8.52 MBytes 71.5 Mbits/sec 0.276 ms = 67738/73945 (92%) =20 > [ 5][TX-C] 3.00-4.00 sec 76.6 MBytes 643 Mbits/sec = 63521 =20 > [ 7][RX-C] 3.00-4.00 sec 8.55 MBytes 71.8 Mbits/sec 0.160 ms = 68647/74874 (92%) =20 > [ 5][TX-C] 4.00-5.00 sec 76.1 MBytes 638 Mbits/sec = 64614 =20 > [ 7][RX-C] 4.00-5.00 sec 8.55 MBytes 71.7 Mbits/sec 0.461 ms = 67542/73767 (92%) =20 > [ 5][TX-C] 5.00-6.00 sec 75.9 MBytes 637 Mbits/sec = 64834 =20 > [ 7][RX-C] 5.00-6.00 sec 8.57 MBytes 71.9 Mbits/sec 0.297 ms = 71565/77806 (92%) =20 > [ 5][TX-C] 6.00-7.00 sec 73.0 MBytes 613 Mbits/sec = 63639 =20 > [ 7][RX-C] 6.00-7.00 sec 8.40 MBytes 70.5 Mbits/sec 0.199 ms = 69545/75663 (92%) =20 > [ 5][TX-C] 7.00-8.00 sec 74.6 MBytes 626 Mbits/sec = 65030 =20 > [ 7][RX-C] 7.00-8.00 sec 8.78 MBytes 73.6 Mbits/sec 0.254 ms = 67173/73566 (91%) =20 > [ 5][TX-C] 8.00-9.00 sec 75.0 MBytes 629 Mbits/sec = 64848 =20 > [ 7][RX-C] 8.00-9.00 sec 8.77 MBytes 73.5 Mbits/sec 0.298 ms = 70932/77315 (92%) =20 > [ 5][TX-C] 9.00-10.00 sec 74.5 MBytes 625 Mbits/sec = 64487 =20 > [ 7][RX-C] 9.00-10.00 sec 8.71 MBytes 73.1 Mbits/sec 0.185 ms = 68268/74612 (91%) =20 > - - - - - - - - - - - - - - - - - - - - - - - - - > [ ID][Role] Interval Transfer Bitrate Jitter = Lost/Total Datagrams > [ 5][TX-C] 0.00-10.00 sec 754 MBytes 632 Mbits/sec 0.000 ms = 0/647731 (0%) sender > [ 5][TX-C] 0.00-10.12 sec 105 MBytes 87.2 Mbits/sec 0.245 ms = 571090/647649 (88%) receiver > [ 7][RX-C] 0.00-10.00 sec 1009 MBytes 846 Mbits/sec 0.000 ms = 0/761013 (0%) sender > [ 7][RX-C] 0.00-10.12 sec 86.2 MBytes 71.4 Mbits/sec 0.185 ms = 674392/737139 (91%) receiver >=20 >=20 >=20 >=20 > On Tuesday, March 16, 2021 4:16:15 AM EDT tuexen@freebsd.org wrote: >>> On 15. Mar 2021, at 12:56, Blake Hartshorn = wrote: >>>=20 >>> The short version, when I use FreeBSD 13, delivering data can take 5 = minutes for 1MB over SSH or HTTP when using IPv6. This problem does not = happen with IPv4. I installed FreeBSD 12 and Linux on that same device, = neither had the problem. >>>=20 >>> Did some troubleshooting with Linode, have ultimately ruled the = network itself out at this point. When the server is on FreeBSD 13, it = can download quickly over IPv6, but not deliver. Started investigating = after noticing my SSH session was lagging when cat'ing large files or = running builds. This problem even occurs between VMs in the same = datacenter. I generated a 1MB file of base64 garbage served by nginx for = testing. IPv6 is being configured by SLAAC and on both 12 and 13 = installs was setup by the installer. Linode uses Linux/KVM hosts for = their virtual machines so it's running on that virtual adapter. >>>=20 >>> I asked on the forums, another user recommended going to the mailing = lists instead. Does anyone know if config settings need to be different = on 13? Did I maybe just find a real issue? I can provide any requested = details. Thanks! >> Could you prove a .pcap tracefile, one from the sender, one from the = recevier, of >> a TCP/IPv6 connection, which doesn't work as expected. For example, = use your 1MB >> base64 garbage transfer. >>=20 >> Best regardes >> Michael >>>=20 >>>=20 >>> _______________________________________________ >>> freebsd-net@freebsd.org mailing list >>> https://lists.freebsd.org/mailman/listinfo/freebsd-net >>> To unsubscribe, send any mail to = "freebsd-net-unsubscribe@freebsd.org" >>=20 >>=20 > From owner-freebsd-net@freebsd.org Tue Mar 16 11:52:49 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 87B065A9D4F for ; Tue, 16 Mar 2021 11:52:49 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 4F0BVn3D0Nz4SKs for ; Tue, 16 Mar 2021 11:52:49 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 6E6DB5AA042; Tue, 16 Mar 2021 11:52:49 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 6E33F5A9E88 for ; Tue, 16 Mar 2021 11:52:49 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4F0BVn2cB0z4S44 for ; Tue, 16 Mar 2021 11:52:49 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4AEC723504 for ; Tue, 16 Mar 2021 11:52:49 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 12GBqnab030733 for ; Tue, 16 Mar 2021 11:52:49 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 12GBqnar030732 for net@FreeBSD.org; Tue, 16 Mar 2021 11:52:49 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 254309] [tcp] frequent panics in tcp_output Date: Tue, 16 Mar 2021 11:52:49 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-STABLE X-Bugzilla-Keywords: panic X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: rozhuk.im@gmail.com X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: net@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 16 Mar 2021 11:52:49 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D254309 --- Comment #6 from rozhuk.im@gmail.com --- Got first crash (@m_copydata (m=3D0x0, m@entry=3D0xfffff80576236400, off=3D= 0, len=3D1, cp=3D) at /usr/src/sys/kern/uipc_mbuf.c:656) on 2 different installations. Suspect that it caused by some changes in last 1-2 month or by me: I add=20 options RATELIMIT #o TX rate limiting support --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-net@freebsd.org Tue Mar 16 10:56:02 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 9D4B05A897B for ; Tue, 16 Mar 2021 10:56:02 +0000 (UTC) (envelope-from contact@blakehartshorn.com) Received: from mail-qk1-x734.google.com (mail-qk1-x734.google.com [IPv6:2607:f8b0:4864:20::734]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4F09FF5ZpCz3tcr for ; Tue, 16 Mar 2021 10:56:01 +0000 (UTC) (envelope-from contact@blakehartshorn.com) Received: by mail-qk1-x734.google.com with SMTP id f124so34679973qkj.5 for ; Tue, 16 Mar 2021 03:56:01 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=blakehartshorn-com.20150623.gappssmtp.com; s=20150623; h=from:to:cc:subject:date:message-id:in-reply-to:references :mime-version:content-transfer-encoding; bh=wJsnDVZ+/YJQjV5yOMFjdc9VgNkToFHSWA+Y/+219fk=; b=WMxtPKc53UVfnn9pP5HRsSxaTpKdH1wWZrizdDmmVgqn1lc5uBbA7JJqvd1RTa9qUn i6T0NdNMEkAvYdGTTkFhJ8kQqSegkQNVT9tPImczl5TALd4ywv0UQion4G4wvs9F9Wjd /B/UKlZa6URB5I6gWxO+3JXm/6V1fOdIoZnJpEt1Be4WHN0dySo2ZoQc7lc6B+ya3Qdh B/tSwP1JD8R9v5NVw8tr4WcFzG6CQzaY3E3awATk6vRm4oMFpJj/zcV5tqtLA4JpSct6 TXLnIqnD9+Gzi8KZlYflb/VwrnosrHU9tLsRrYpPJ6kApH2PJStna2N+YchoCbcrWg7H MnDA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:cc:subject:date:message-id:in-reply-to :references:mime-version:content-transfer-encoding; bh=wJsnDVZ+/YJQjV5yOMFjdc9VgNkToFHSWA+Y/+219fk=; b=G+X0Oxfr/46QonlS6q1C04cfc3u2TWxfKL0p9rLBcsw6ZdFBfGS2x7R/bthlA8avZC YxfXs6nGFGNCPsRKd7SlAhMITUZRnbK7YTnaLF2B/CXYqp6aXhh/aqJOpVgtq08ESKgn 4psZcHleQC9FFWfoCkHiKpQaCt9c9Y+QAT2cYMUKKZxdFqYrEcV7P8PtjJ6Q37xk0l7F MdfncnTvyicn6LKRAS2ZsoRcEbeA2mLj5Y2YGnrVvdbF5nQ3dlP8kxZ81tmhbFWC26f5 cPU0u619fXU76itpMBTwiAHwHlx7cLeT4zXm8E3WnO7VIRpcfFyTEWw8aHeipEFMFMED o7GQ== X-Gm-Message-State: AOAM531RhFfPMa3Kuw9aXmPQKRNIRwLKV5IDWKmHHUGyVI8u7OJNtUN8 e/UedZ9KdEsukkZbv8B3EKRhcjTAKDVW8xQn X-Google-Smtp-Source: ABdhPJxXfiIBMwKVzqDq9hzUduUoekIObiv9f6LAePqTzM1yBukUvvHWBYZqkqqIBA+ORbu7Uf1CBw== X-Received: by 2002:a37:a44:: with SMTP id 65mr28685131qkk.479.1615892159773; Tue, 16 Mar 2021 03:55:59 -0700 (PDT) Received: from thinkbook.localnet ([2601:18d:97f:d245:5328:24df:14af:ed29]) by smtp.gmail.com with ESMTPSA id e2sm12959282qto.50.2021.03.16.03.55.54 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Tue, 16 Mar 2021 03:55:55 -0700 (PDT) From: Blake Hartshorn To: tuexen@freebsd.org Cc: freebsd-net@freebsd.org Subject: Re: Severe IPv6 TCP transfer issues on 13.0-RC1 and RC2 Date: Tue, 16 Mar 2021 06:55:54 -0400 Message-ID: <10847992.4GmZMkJedg@thinkbook> In-Reply-To: References: <5753280.1HxCrU2fYu@thinkbook> MIME-Version: 1.0 X-Rspamd-Queue-Id: 4F09FF5ZpCz3tcr X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=blakehartshorn-com.20150623.gappssmtp.com header.s=20150623 header.b=WMxtPKc5; dmarc=none; spf=none (mx1.freebsd.org: domain of contact@blakehartshorn.com has no SPF policy when checking 2607:f8b0:4864:20::734) smtp.mailfrom=contact@blakehartshorn.com X-Spamd-Result: default: False [-2.30 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; HAS_ATTACHMENT(0.00)[]; TO_DN_NONE(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; DKIM_TRACE(0.00)[blakehartshorn-com.20150623.gappssmtp.com:+]; RCPT_COUNT_TWO(0.00)[2]; NEURAL_HAM_SHORT(-1.00)[-1.000]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~,3:~]; RBL_DBL_DONT_QUERY_IPS(0.00)[2607:f8b0:4864:20::734:from]; CTE_CASE(0.50)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[blakehartshorn-com.20150623.gappssmtp.com:s=20150623]; FROM_HAS_DN(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[multipart/mixed,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-net@freebsd.org]; DMARC_NA(0.00)[blakehartshorn.com]; SPAMHAUS_ZRD(0.00)[2607:f8b0:4864:20::734:from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::734:from]; R_SPF_NA(0.00)[no SPF record]; MID_RHS_NOT_FQDN(0.50)[]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-net] X-Mailman-Approved-At: Tue, 16 Mar 2021 13:02:42 +0000 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7Bit X-Content-Filtered-By: Mailman/MimeDel 2.1.34 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 16 Mar 2021 10:56:02 -0000 Hi Michael, I've attached tcpdumps for port 80 on both sides of a bad transfer, using 2 VMs in the same datacenter, FreeBSD 13 serving and 12 as a client. A friend of mine suggested I also run some tests with iperf3, so pasting those results below. You'll see it going fast in one direction and crawling in the other on TCP. There's also some disparity on UDP. TCP: [ ID][Role] Interval Transfer Bitrate Retr Cwnd [ 5][TX-C] 0.00-1.00 sec 27.7 MBytes 233 Mbits/sec 342 26.7 KBytes [ 7][RX-C] 0.00-1.00 sec 4.18 KBytes 34.3 Kbits/sec [ 5][TX-C] 1.00-2.00 sec 15.8 MBytes 132 Mbits/sec 249 52.0 KBytes [ 7][RX-C] 1.00-2.00 sec 4.18 KBytes 34.3 Kbits/sec [ 5][TX-C] 2.00-3.00 sec 13.7 MBytes 115 Mbits/sec 307 15.4 KBytes [ 7][RX-C] 2.00-3.00 sec 4.18 KBytes 34.3 Kbits/sec [ 5][TX-C] 3.00-4.00 sec 14.5 MBytes 121 Mbits/sec 260 22.4 KBytes [ 7][RX-C] 3.00-4.00 sec 4.18 KBytes 34.3 Kbits/sec [ 5][TX-C] 4.00-5.00 sec 14.3 MBytes 120 Mbits/sec 240 37.9 KBytes [ 7][RX-C] 4.00-5.00 sec 5.58 KBytes 45.7 Kbits/sec [ 5][TX-C] 5.00-6.00 sec 17.7 MBytes 149 Mbits/sec 363 15.4 KBytes [ 7][RX-C] 5.00-6.00 sec 4.18 KBytes 34.3 Kbits/sec [ 5][TX-C] 6.00-7.00 sec 14.8 MBytes 124 Mbits/sec 287 8.38 KBytes [ 7][RX-C] 6.00-7.00 sec 5.58 KBytes 45.7 Kbits/sec [ 5][TX-C] 7.00-8.00 sec 14.7 MBytes 123 Mbits/sec 293 28.1 KBytes [ 7][RX-C] 7.00-8.00 sec 4.18 KBytes 34.3 Kbits/sec [ 5][TX-C] 8.00-9.00 sec 11.9 MBytes 100 Mbits/sec 325 18.3 KBytes [ 7][RX-C] 8.00-9.00 sec 4.18 KBytes 34.3 Kbits/sec [ 5][TX-C] 9.00-10.00 sec 14.3 MBytes 120 Mbits/sec 315 39.3 KBytes [ 7][RX-C] 9.00-10.00 sec 4.18 KBytes 34.3 Kbits/sec - - - - - - - - - - - - - - - - - - - - - - - - - [ ID][Role] Interval Transfer Bitrate Retr [ 5][TX-C] 0.00-10.00 sec 159 MBytes 134 Mbits/sec 2981 sender [ 5][TX-C] 0.00-10.00 sec 159 MBytes 134 Mbits/sec receiver [ 7][RX-C] 0.00-10.00 sec 77.0 KBytes 63.1 Kbits/sec 65 sender [ 7][RX-C] 0.00-10.00 sec 44.6 KBytes 36.6 Kbits/sec receiver ----------------------------------------------------------------------------------------------------------- UDP: [ ID][Role] Interval Transfer Bitrate Jitter Lost/Total Datagrams [ 5][TX-C] 0.00-1.00 sec 81.6 MBytes 685 Mbits/sec 67798 [ 7][RX-C] 0.00-1.00 sec 8.80 MBytes 73.8 Mbits/sec 0.255 ms 54070/60475 (89%) [ 5][TX-C] 1.00-2.00 sec 72.7 MBytes 610 Mbits/sec 64802 [ 7][RX-C] 1.00-2.00 sec 8.52 MBytes 71.5 Mbits/sec 0.154 ms 68912/75116 (92%) [ 5][TX-C] 2.00-3.00 sec 73.7 MBytes 618 Mbits/sec 64158 [ 7][RX-C] 2.00-3.00 sec 8.52 MBytes 71.5 Mbits/sec 0.276 ms 67738/73945 (92%) [ 5][TX-C] 3.00-4.00 sec 76.6 MBytes 643 Mbits/sec 63521 [ 7][RX-C] 3.00-4.00 sec 8.55 MBytes 71.8 Mbits/sec 0.160 ms 68647/74874 (92%) [ 5][TX-C] 4.00-5.00 sec 76.1 MBytes 638 Mbits/sec 64614 [ 7][RX-C] 4.00-5.00 sec 8.55 MBytes 71.7 Mbits/sec 0.461 ms 67542/73767 (92%) [ 5][TX-C] 5.00-6.00 sec 75.9 MBytes 637 Mbits/sec 64834 [ 7][RX-C] 5.00-6.00 sec 8.57 MBytes 71.9 Mbits/sec 0.297 ms 71565/77806 (92%) [ 5][TX-C] 6.00-7.00 sec 73.0 MBytes 613 Mbits/sec 63639 [ 7][RX-C] 6.00-7.00 sec 8.40 MBytes 70.5 Mbits/sec 0.199 ms 69545/75663 (92%) [ 5][TX-C] 7.00-8.00 sec 74.6 MBytes 626 Mbits/sec 65030 [ 7][RX-C] 7.00-8.00 sec 8.78 MBytes 73.6 Mbits/sec 0.254 ms 67173/73566 (91%) [ 5][TX-C] 8.00-9.00 sec 75.0 MBytes 629 Mbits/sec 64848 [ 7][RX-C] 8.00-9.00 sec 8.77 MBytes 73.5 Mbits/sec 0.298 ms 70932/77315 (92%) [ 5][TX-C] 9.00-10.00 sec 74.5 MBytes 625 Mbits/sec 64487 [ 7][RX-C] 9.00-10.00 sec 8.71 MBytes 73.1 Mbits/sec 0.185 ms 68268/74612 (91%) - - - - - - - - - - - - - - - - - - - - - - - - - [ ID][Role] Interval Transfer Bitrate Jitter Lost/Total Datagrams [ 5][TX-C] 0.00-10.00 sec 754 MBytes 632 Mbits/sec 0.000 ms 0/647731 (0%) sender [ 5][TX-C] 0.00-10.12 sec 105 MBytes 87.2 Mbits/sec 0.245 ms 571090/647649 (88%) receiver [ 7][RX-C] 0.00-10.00 sec 1009 MBytes 846 Mbits/sec 0.000 ms 0/761013 (0%) sender [ 7][RX-C] 0.00-10.12 sec 86.2 MBytes 71.4 Mbits/sec 0.185 ms 674392/737139 (91%) receiver On Tuesday, March 16, 2021 4:16:15 AM EDT tuexen@freebsd.org wrote: > > On 15. Mar 2021, at 12:56, Blake Hartshorn wrote: > > > > The short version, when I use FreeBSD 13, delivering data can take 5 minutes for 1MB over SSH or HTTP when using IPv6. This problem does not happen with IPv4. I installed FreeBSD 12 and Linux on that same device, neither had the problem. > > > > Did some troubleshooting with Linode, have ultimately ruled the network itself out at this point. When the server is on FreeBSD 13, it can download quickly over IPv6, but not deliver. Started investigating after noticing my SSH session was lagging when cat'ing large files or running builds. This problem even occurs between VMs in the same datacenter. I generated a 1MB file of base64 garbage served by nginx for testing. IPv6 is being configured by SLAAC and on both 12 and 13 installs was setup by the installer. Linode uses Linux/KVM hosts for their virtual machines so it's running on that virtual adapter. > > > > I asked on the forums, another user recommended going to the mailing lists instead. Does anyone know if config settings need to be different on 13? Did I maybe just find a real issue? I can provide any requested details. Thanks! > Could you prove a .pcap tracefile, one from the sender, one from the recevier, of > a TCP/IPv6 connection, which doesn't work as expected. For example, use your 1MB > base64 garbage transfer. > > Best regardes > Michael > > > > > > _______________________________________________ > > freebsd-net@freebsd.org mailing list > > https://lists.freebsd.org/mailman/listinfo/freebsd-net > > To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org" > > From owner-freebsd-net@freebsd.org Tue Mar 16 14:18:48 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 4561C5AF430 for ; Tue, 16 Mar 2021 14:18:48 +0000 (UTC) (envelope-from zarychtam@plan-b.pwste.edu.pl) Received: from plan-b.pwste.edu.pl (plan-b.pwste.edu.pl [IPv6:2001:678:618::40]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "plan-b.pwste.edu.pl", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4F0FlB5Bjwz4cD6; Tue, 16 Mar 2021 14:18:46 +0000 (UTC) (envelope-from zarychtam@plan-b.pwste.edu.pl) Received: from fomalhaut.potoki.eu ([IPv6:2001:678:618:c2:2:0:0:1]) (authenticated bits=0) by plan-b.pwste.edu.pl (8.16.1/8.16.1) with ESMTPSA id 12GEIYt1009239 (version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128 verify=NO); Tue, 16 Mar 2021 15:18:35 +0100 (CET) (envelope-from zarychtam@plan-b.pwste.edu.pl) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=plan-b.pwste.edu.pl; s=plan-b-mailer; t=1615904315; bh=LEB2a8YZukv1z0L/mUL87rLCaen1w/kJqpqgqx4ljog=; h=To:Cc:References:From:Subject:Date:In-Reply-To; b=HActbdLgG3sg++Gpd9sIeSFSx9hJaxZ05PN9i7LuepMh0vbGZCQYgmkQpsbaqrjDO Fo4q1Ocy3Nfsc3cgD2gsrULg61zEz3ewwsSC3z9xvXbZKp6IWL4QKf80yzEhLQ9REM okjfhBHzONxdPQDD7DcG5BFA5A60GkR8KbxjAzdxgT3BykknUgINcBHRKgZOzEhzEw 7uHgjvWhV4abCxOPTi5bDs+CzRtPUfX/OwXtwpnRKQofdAxJK1TXlrcz/wdF5db059 pl2Ne9HEpKETcZBxW0XO2lLrMu+ayJK7D1EgXNlwWPpMrjS/Fol0ldn1JV4yEXLjue a/Jp0A+CO3qXA== X-Authentication-Warning: plan-b.pwste.edu.pl: Host [IPv6:2001:678:618:c2:2:0:0:1] claimed to be fomalhaut.potoki.eu To: tuexen@freebsd.org, Blake Hartshorn Cc: freebsd-net@freebsd.org References: <5753280.1HxCrU2fYu@thinkbook> <10847992.4GmZMkJedg@thinkbook> <2808496E-C2B5-4B6F-8FDB-310B7F69E540@freebsd.org> From: Marek Zarychta Subject: Re: Severe IPv6 TCP transfer issues on 13.0-RC1 and RC2 Message-ID: Date: Tue, 16 Mar 2021 15:18:33 +0100 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:78.0) Gecko/20100101 Thunderbird/78.8.0 MIME-Version: 1.0 In-Reply-To: <2808496E-C2B5-4B6F-8FDB-310B7F69E540@freebsd.org> Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="aGGnVIZwMR5UCA0W97ECtZo5jud9vtNg4" X-Rspamd-Queue-Id: 4F0FlB5Bjwz4cD6 X-Spamd-Bar: ------- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=plan-b.pwste.edu.pl header.s=plan-b-mailer header.b=HActbdLg; dmarc=pass (policy=none) header.from=plan-b.pwste.edu.pl; spf=none (mx1.freebsd.org: domain of zarychtam@plan-b.pwste.edu.pl has no SPF policy when checking 2001:678:618::40) smtp.mailfrom=zarychtam@plan-b.pwste.edu.pl X-Spamd-Result: default: False [-7.90 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_DN_SOME(0.00)[]; HAS_ATTACHMENT(0.00)[]; HAS_XAW(0.00)[]; DKIM_TRACE(0.00)[plan-b.pwste.edu.pl:+]; DMARC_POLICY_ALLOW(-0.50)[plan-b.pwste.edu.pl,none]; NEURAL_HAM_SHORT(-1.00)[-1.000]; SIGNED_PGP(-2.00)[]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:+,3:~]; RBL_DBL_DONT_QUERY_IPS(0.00)[2001:678:618::40:from]; ASN(0.00)[asn:206006, ipnet:2001:678:618::/48, country:PL]; MID_RHS_MATCH_FROM(0.00)[]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[plan-b.pwste.edu.pl:s=plan-b-mailer]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; DWL_DNSWL_MED(-2.00)[pwste.edu.pl:dkim]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.20)[multipart/signed,multipart/mixed,text/plain]; SPAMHAUS_ZRD(0.00)[2001:678:618::40:from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; R_SPF_NA(0.00)[no SPF record]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-net] X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 16 Mar 2021 14:18:48 -0000 This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --aGGnVIZwMR5UCA0W97ECtZo5jud9vtNg4 Content-Type: multipart/mixed; boundary="J4fBDqdWX9uGzCu8zZ3iITrbO2Uz1hLcV"; protected-headers="v1" From: Marek Zarychta To: tuexen@freebsd.org, Blake Hartshorn Cc: freebsd-net@freebsd.org Message-ID: Subject: Re: Severe IPv6 TCP transfer issues on 13.0-RC1 and RC2 References: <5753280.1HxCrU2fYu@thinkbook> <10847992.4GmZMkJedg@thinkbook> <2808496E-C2B5-4B6F-8FDB-310B7F69E540@freebsd.org> In-Reply-To: <2808496E-C2B5-4B6F-8FDB-310B7F69E540@freebsd.org> --J4fBDqdWX9uGzCu8zZ3iITrbO2Uz1hLcV Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: quoted-printable W dniu 16.03.2021 o=C2=A012:50, tuexen@freebsd.org pisze: >> On 16. Mar 2021, at 11:55, Blake Hartshorn wrote: >> >> Hi Michael, >> >> I've attached tcpdumps for port 80 on both sides of a bad transfer, us= ing 2 VMs in the same datacenter, FreeBSD 13 serving and 12 as a client. = A friend of mine suggested I also run some tests with iperf3, so pasting = those results below. You'll see it going fast in one direction and crawli= ng in the other on TCP. There's also some disparity on UDP.=20 > The problem is that the server provides TCP segments larger than the MT= U > to the NIC. These are dropped and needs to be retransmitted. That is wh= y > it takes so long. So I guess TSO is enabled on the NIC and not working = correctly. >=20 > What is the output of ifconfig? Can you disable TSO? Does that work aro= und > the problem? >=20 > Best regards > Michael >> >> TCP: >> [ ID][Role] Interval Transfer Bitrate Retr Cwnd= >> [ 5][TX-C] 0.00-1.00 sec 27.7 MBytes 233 Mbits/sec 342 26.7= KBytes =20 >> [ 7][RX-C] 0.00-1.00 sec 4.18 KBytes 34.3 Kbits/sec = =20 >> [ 5][TX-C] 1.00-2.00 sec 15.8 MBytes 132 Mbits/sec 249 52.0= KBytes =20 >> [ 7][RX-C] 1.00-2.00 sec 4.18 KBytes 34.3 Kbits/sec = =20 >> [ 5][TX-C] 2.00-3.00 sec 13.7 MBytes 115 Mbits/sec 307 15.4= KBytes =20 >> [ 7][RX-C] 2.00-3.00 sec 4.18 KBytes 34.3 Kbits/sec = =20 >> [ 5][TX-C] 3.00-4.00 sec 14.5 MBytes 121 Mbits/sec 260 22.4= KBytes =20 >> [ 7][RX-C] 3.00-4.00 sec 4.18 KBytes 34.3 Kbits/sec = =20 >> [ 5][TX-C] 4.00-5.00 sec 14.3 MBytes 120 Mbits/sec 240 37.9= KBytes =20 >> [ 7][RX-C] 4.00-5.00 sec 5.58 KBytes 45.7 Kbits/sec = =20 >> [ 5][TX-C] 5.00-6.00 sec 17.7 MBytes 149 Mbits/sec 363 15.4= KBytes =20 >> [ 7][RX-C] 5.00-6.00 sec 4.18 KBytes 34.3 Kbits/sec = =20 >> [ 5][TX-C] 6.00-7.00 sec 14.8 MBytes 124 Mbits/sec 287 8.38= KBytes =20 >> [ 7][RX-C] 6.00-7.00 sec 5.58 KBytes 45.7 Kbits/sec = =20 >> [ 5][TX-C] 7.00-8.00 sec 14.7 MBytes 123 Mbits/sec 293 28.1= KBytes =20 >> [ 7][RX-C] 7.00-8.00 sec 4.18 KBytes 34.3 Kbits/sec = =20 >> [ 5][TX-C] 8.00-9.00 sec 11.9 MBytes 100 Mbits/sec 325 18.3= KBytes =20 >> [ 7][RX-C] 8.00-9.00 sec 4.18 KBytes 34.3 Kbits/sec = =20 >> [ 5][TX-C] 9.00-10.00 sec 14.3 MBytes 120 Mbits/sec 315 39.3= KBytes =20 >> [ 7][RX-C] 9.00-10.00 sec 4.18 KBytes 34.3 Kbits/sec = =20 >> - - - - - - - - - - - - - - - - - - - - - - - - - >> [ ID][Role] Interval Transfer Bitrate Retr >> [ 5][TX-C] 0.00-10.00 sec 159 MBytes 134 Mbits/sec 2981 = sender >> [ 5][TX-C] 0.00-10.00 sec 159 MBytes 134 Mbits/sec = receiver >> [ 7][RX-C] 0.00-10.00 sec 77.0 KBytes 63.1 Kbits/sec 65 = sender >> [ 7][RX-C] 0.00-10.00 sec 44.6 KBytes 36.6 Kbits/sec = receiver >> ----------------------------------------------------------------------= ------------------------------------- >> >> >> UDP: >> [ ID][Role] Interval Transfer Bitrate Jitter = Lost/Total Datagrams >> [ 5][TX-C] 0.00-1.00 sec 81.6 MBytes 685 Mbits/sec = 67798 =20 >> [ 7][RX-C] 0.00-1.00 sec 8.80 MBytes 73.8 Mbits/sec 0.255 ms = 54070/60475 (89%) =20 >> [ 5][TX-C] 1.00-2.00 sec 72.7 MBytes 610 Mbits/sec = 64802 =20 >> [ 7][RX-C] 1.00-2.00 sec 8.52 MBytes 71.5 Mbits/sec 0.154 ms = 68912/75116 (92%) =20 >> [ 5][TX-C] 2.00-3.00 sec 73.7 MBytes 618 Mbits/sec = 64158 =20 >> [ 7][RX-C] 2.00-3.00 sec 8.52 MBytes 71.5 Mbits/sec 0.276 ms = 67738/73945 (92%) =20 >> [ 5][TX-C] 3.00-4.00 sec 76.6 MBytes 643 Mbits/sec = 63521 =20 >> [ 7][RX-C] 3.00-4.00 sec 8.55 MBytes 71.8 Mbits/sec 0.160 ms = 68647/74874 (92%) =20 >> [ 5][TX-C] 4.00-5.00 sec 76.1 MBytes 638 Mbits/sec = 64614 =20 >> [ 7][RX-C] 4.00-5.00 sec 8.55 MBytes 71.7 Mbits/sec 0.461 ms = 67542/73767 (92%) =20 >> [ 5][TX-C] 5.00-6.00 sec 75.9 MBytes 637 Mbits/sec = 64834 =20 >> [ 7][RX-C] 5.00-6.00 sec 8.57 MBytes 71.9 Mbits/sec 0.297 ms = 71565/77806 (92%) =20 >> [ 5][TX-C] 6.00-7.00 sec 73.0 MBytes 613 Mbits/sec = 63639 =20 >> [ 7][RX-C] 6.00-7.00 sec 8.40 MBytes 70.5 Mbits/sec 0.199 ms = 69545/75663 (92%) =20 >> [ 5][TX-C] 7.00-8.00 sec 74.6 MBytes 626 Mbits/sec = 65030 =20 >> [ 7][RX-C] 7.00-8.00 sec 8.78 MBytes 73.6 Mbits/sec 0.254 ms = 67173/73566 (91%) =20 >> [ 5][TX-C] 8.00-9.00 sec 75.0 MBytes 629 Mbits/sec = 64848 =20 >> [ 7][RX-C] 8.00-9.00 sec 8.77 MBytes 73.5 Mbits/sec 0.298 ms = 70932/77315 (92%) =20 >> [ 5][TX-C] 9.00-10.00 sec 74.5 MBytes 625 Mbits/sec = 64487 =20 >> [ 7][RX-C] 9.00-10.00 sec 8.71 MBytes 73.1 Mbits/sec 0.185 ms = 68268/74612 (91%) =20 >> - - - - - - - - - - - - - - - - - - - - - - - - - >> [ ID][Role] Interval Transfer Bitrate Jitter = Lost/Total Datagrams >> [ 5][TX-C] 0.00-10.00 sec 754 MBytes 632 Mbits/sec 0.000 ms = 0/647731 (0%) sender >> [ 5][TX-C] 0.00-10.12 sec 105 MBytes 87.2 Mbits/sec 0.245 ms = 571090/647649 (88%) receiver >> [ 7][RX-C] 0.00-10.00 sec 1009 MBytes 846 Mbits/sec 0.000 ms = 0/761013 (0%) sender >> [ 7][RX-C] 0.00-10.12 sec 86.2 MBytes 71.4 Mbits/sec 0.185 ms = 674392/737139 (91%) receiver >> >> Taking a look at this iperf output I recalled that 80% of my setups suffered from similar issue after transitioning from 1{1,2}-STABLE to 13-STABLE about a mounth ago. I have asked on IRC but nobody confirmed similar problems so I have reduced MTU to 8900 from the original 9000 on some vlan(4) interfaces to solve the issue. I am using mostly vlan(4)s over LACP lagg(4)s created on NICs. So far (for FreeBSD 11 and 12) setting MTU 9000 on physical NIC was sufficient to make it work, now I have set MTU 9000 on NICs and reduced MTU 8900 on vlan(4)s. >> >> >> On Tuesday, March 16, 2021 4:16:15 AM EDT tuexen@freebsd.org wrote: >>>> On 15. Mar 2021, at 12:56, Blake Hartshorn wrote: >>>> >>>> The short version, when I use FreeBSD 13, delivering data can take 5= minutes for 1MB over SSH or HTTP when using IPv6. This problem does not = happen with IPv4. I installed FreeBSD 12 and Linux on that same device, n= either had the problem. >>>> >>>> Did some troubleshooting with Linode, have ultimately ruled the netw= ork itself out at this point. When the server is on FreeBSD 13, it can do= wnload quickly over IPv6, but not deliver. Started investigating after no= ticing my SSH session was lagging when cat'ing large files or running bui= lds. This problem even occurs between VMs in the same datacenter. I gener= ated a 1MB file of base64 garbage served by nginx for testing. IPv6 is be= ing configured by SLAAC and on both 12 and 13 installs was setup by the i= nstaller. Linode uses Linux/KVM hosts for their virtual machines so it's = running on that virtual adapter. >>>> >>>> I asked on the forums, another user recommended going to the mailing= lists instead. Does anyone know if config settings need to be different = on 13? Did I maybe just find a real issue? I can provide any requested de= tails. Thanks! >>> Could you prove a .pcap tracefile, one from the sender, one from the = recevier, of >>> a TCP/IPv6 connection, which doesn't work as expected. For example, u= se your 1MB >>> base64 garbage transfer. >>> >>> Best regardes >>> Michael >>>> >>>> >>>> _______________________________________________ >>>> freebsd-net@freebsd.org mailing list >>>> https://lists.freebsd.org/mailman/listinfo/freebsd-net >>>> To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.or= g" >>> >>> >> >=20 > _______________________________________________ > freebsd-net@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-net > To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org" >=20 --=20 Marek Zarychta --J4fBDqdWX9uGzCu8zZ3iITrbO2Uz1hLcV-- --aGGnVIZwMR5UCA0W97ECtZo5jud9vtNg4 Content-Type: application/pgp-signature; name="OpenPGP_signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="OpenPGP_signature" -----BEGIN PGP SIGNATURE----- wsB5BAABCAAjFiEEMOqvKm6wKvS1/ZeCdZ/s//1SjSwFAmBQvjkFAwAAAAAACgkQdZ/s//1SjSxn 7wf+MhimjJ6ZtsEjkshNAz4ZRAqL5a3tMQHrRIuda9elIgVmXkbSloUqqlDt3jBNkj31pGKtBB9E GuLemV19r82w0X9jxiypS0WYk1fdXZDDrrXHcDI5VGfVUabGbwJ1z884gzpmXw6GZiI543YfvByO HJ5tjpKbuWHWreNlymiX4DjG/noFbB5GrvXODJY2chqB/RfWh93yfrjBsqQyUJHv/57g8paNjH4j WesZnAQPp8PF+FolAxMB/wRAJ6h2p2CGfuGhP0galVGvXJevsNw9GmcGwYosiizzlPmq6VZiHX8J LZDo/vAOTpUrs88JZpjAF4rjZLj1Q2kFXo64HqOGVA== =gutX -----END PGP SIGNATURE----- --aGGnVIZwMR5UCA0W97ECtZo5jud9vtNg4-- From owner-freebsd-net@freebsd.org Tue Mar 16 14:35:32 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 8A5EE5AFDC9 for ; Tue, 16 Mar 2021 14:35:32 +0000 (UTC) (envelope-from tuexen@freebsd.org) Received: from drew.franken.de (drew.ipv6.franken.de [IPv6:2001:638:a02:a001:20e:cff:fe4a:feaa]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "*.franken.de", Issuer "Sectigo RSA Domain Validation Secure Server CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4F0G6X2Pbvz4d18 for ; Tue, 16 Mar 2021 14:35:32 +0000 (UTC) (envelope-from tuexen@freebsd.org) Received: from [IPv6:2a02:8109:1140:c3d:98e:1307:de88:8980] (unknown [IPv6:2a02:8109:1140:c3d:98e:1307:de88:8980]) (Authenticated sender: macmic) by mail-n.franken.de (Postfix) with ESMTPSA id E295476938665; Tue, 16 Mar 2021 15:35:25 +0100 (CET) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 14.0 \(3654.60.0.2.21\)) Subject: Re: Severe IPv6 TCP transfer issues on 13.0-RC1 and RC2 From: tuexen@freebsd.org In-Reply-To: Date: Tue, 16 Mar 2021 15:35:25 +0100 Cc: Blake Hartshorn , freebsd-net@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: <947D1E51-CCB0-4A1E-B671-708F70420DA1@freebsd.org> References: <5753280.1HxCrU2fYu@thinkbook> <10847992.4GmZMkJedg@thinkbook> <2808496E-C2B5-4B6F-8FDB-310B7F69E540@freebsd.org> To: Marek Zarychta X-Mailer: Apple Mail (2.3654.60.0.2.21) X-Spam-Status: No, score=-2.9 required=5.0 tests=ALL_TRUSTED,BAYES_00, URIBL_BLOCKED autolearn=disabled version=3.4.1 X-Spam-Checker-Version: SpamAssassin 3.4.1 (2015-04-28) on mail-n.franken.de X-Rspamd-Queue-Id: 4F0G6X2Pbvz4d18 X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[] X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 16 Mar 2021 14:35:32 -0000 > On 16. Mar 2021, at 15:18, Marek Zarychta = wrote: >=20 > W dniu 16.03.2021 o 12:50, tuexen@freebsd.org pisze: >>> On 16. Mar 2021, at 11:55, Blake Hartshorn = wrote: >>>=20 >>> Hi Michael, >>>=20 >>> I've attached tcpdumps for port 80 on both sides of a bad transfer, = using 2 VMs in the same datacenter, FreeBSD 13 serving and 12 as a = client. A friend of mine suggested I also run some tests with iperf3, so = pasting those results below. You'll see it going fast in one direction = and crawling in the other on TCP. There's also some disparity on UDP.=20 >> The problem is that the server provides TCP segments larger than the = MTU >> to the NIC. These are dropped and needs to be retransmitted. That is = why >> it takes so long. So I guess TSO is enabled on the NIC and not = working correctly. >>=20 >> What is the output of ifconfig? Can you disable TSO? Does that work = around >> the problem? >>=20 >> Best regards >> Michael >>>=20 >>> TCP: >>> [ ID][Role] Interval Transfer Bitrate Retr = Cwnd >>> [ 5][TX-C] 0.00-1.00 sec 27.7 MBytes 233 Mbits/sec 342 = 26.7 KBytes =20 >>> [ 7][RX-C] 0.00-1.00 sec 4.18 KBytes 34.3 Kbits/sec = =20 >>> [ 5][TX-C] 1.00-2.00 sec 15.8 MBytes 132 Mbits/sec 249 = 52.0 KBytes =20 >>> [ 7][RX-C] 1.00-2.00 sec 4.18 KBytes 34.3 Kbits/sec = =20 >>> [ 5][TX-C] 2.00-3.00 sec 13.7 MBytes 115 Mbits/sec 307 = 15.4 KBytes =20 >>> [ 7][RX-C] 2.00-3.00 sec 4.18 KBytes 34.3 Kbits/sec = =20 >>> [ 5][TX-C] 3.00-4.00 sec 14.5 MBytes 121 Mbits/sec 260 = 22.4 KBytes =20 >>> [ 7][RX-C] 3.00-4.00 sec 4.18 KBytes 34.3 Kbits/sec = =20 >>> [ 5][TX-C] 4.00-5.00 sec 14.3 MBytes 120 Mbits/sec 240 = 37.9 KBytes =20 >>> [ 7][RX-C] 4.00-5.00 sec 5.58 KBytes 45.7 Kbits/sec = =20 >>> [ 5][TX-C] 5.00-6.00 sec 17.7 MBytes 149 Mbits/sec 363 = 15.4 KBytes =20 >>> [ 7][RX-C] 5.00-6.00 sec 4.18 KBytes 34.3 Kbits/sec = =20 >>> [ 5][TX-C] 6.00-7.00 sec 14.8 MBytes 124 Mbits/sec 287 = 8.38 KBytes =20 >>> [ 7][RX-C] 6.00-7.00 sec 5.58 KBytes 45.7 Kbits/sec = =20 >>> [ 5][TX-C] 7.00-8.00 sec 14.7 MBytes 123 Mbits/sec 293 = 28.1 KBytes =20 >>> [ 7][RX-C] 7.00-8.00 sec 4.18 KBytes 34.3 Kbits/sec = =20 >>> [ 5][TX-C] 8.00-9.00 sec 11.9 MBytes 100 Mbits/sec 325 = 18.3 KBytes =20 >>> [ 7][RX-C] 8.00-9.00 sec 4.18 KBytes 34.3 Kbits/sec = =20 >>> [ 5][TX-C] 9.00-10.00 sec 14.3 MBytes 120 Mbits/sec 315 = 39.3 KBytes =20 >>> [ 7][RX-C] 9.00-10.00 sec 4.18 KBytes 34.3 Kbits/sec = =20 >>> - - - - - - - - - - - - - - - - - - - - - - - - - >>> [ ID][Role] Interval Transfer Bitrate Retr >>> [ 5][TX-C] 0.00-10.00 sec 159 MBytes 134 Mbits/sec 2981 = sender >>> [ 5][TX-C] 0.00-10.00 sec 159 MBytes 134 Mbits/sec = receiver >>> [ 7][RX-C] 0.00-10.00 sec 77.0 KBytes 63.1 Kbits/sec 65 = sender >>> [ 7][RX-C] 0.00-10.00 sec 44.6 KBytes 36.6 Kbits/sec = receiver >>> = --------------------------------------------------------------------------= --------------------------------- >>>=20 >>>=20 >>> UDP: >>> [ ID][Role] Interval Transfer Bitrate Jitter = Lost/Total Datagrams >>> [ 5][TX-C] 0.00-1.00 sec 81.6 MBytes 685 Mbits/sec = 67798 =20 >>> [ 7][RX-C] 0.00-1.00 sec 8.80 MBytes 73.8 Mbits/sec 0.255 ms = 54070/60475 (89%) =20 >>> [ 5][TX-C] 1.00-2.00 sec 72.7 MBytes 610 Mbits/sec = 64802 =20 >>> [ 7][RX-C] 1.00-2.00 sec 8.52 MBytes 71.5 Mbits/sec 0.154 ms = 68912/75116 (92%) =20 >>> [ 5][TX-C] 2.00-3.00 sec 73.7 MBytes 618 Mbits/sec = 64158 =20 >>> [ 7][RX-C] 2.00-3.00 sec 8.52 MBytes 71.5 Mbits/sec 0.276 ms = 67738/73945 (92%) =20 >>> [ 5][TX-C] 3.00-4.00 sec 76.6 MBytes 643 Mbits/sec = 63521 =20 >>> [ 7][RX-C] 3.00-4.00 sec 8.55 MBytes 71.8 Mbits/sec 0.160 ms = 68647/74874 (92%) =20 >>> [ 5][TX-C] 4.00-5.00 sec 76.1 MBytes 638 Mbits/sec = 64614 =20 >>> [ 7][RX-C] 4.00-5.00 sec 8.55 MBytes 71.7 Mbits/sec 0.461 ms = 67542/73767 (92%) =20 >>> [ 5][TX-C] 5.00-6.00 sec 75.9 MBytes 637 Mbits/sec = 64834 =20 >>> [ 7][RX-C] 5.00-6.00 sec 8.57 MBytes 71.9 Mbits/sec 0.297 ms = 71565/77806 (92%) =20 >>> [ 5][TX-C] 6.00-7.00 sec 73.0 MBytes 613 Mbits/sec = 63639 =20 >>> [ 7][RX-C] 6.00-7.00 sec 8.40 MBytes 70.5 Mbits/sec 0.199 ms = 69545/75663 (92%) =20 >>> [ 5][TX-C] 7.00-8.00 sec 74.6 MBytes 626 Mbits/sec = 65030 =20 >>> [ 7][RX-C] 7.00-8.00 sec 8.78 MBytes 73.6 Mbits/sec 0.254 ms = 67173/73566 (91%) =20 >>> [ 5][TX-C] 8.00-9.00 sec 75.0 MBytes 629 Mbits/sec = 64848 =20 >>> [ 7][RX-C] 8.00-9.00 sec 8.77 MBytes 73.5 Mbits/sec 0.298 ms = 70932/77315 (92%) =20 >>> [ 5][TX-C] 9.00-10.00 sec 74.5 MBytes 625 Mbits/sec = 64487 =20 >>> [ 7][RX-C] 9.00-10.00 sec 8.71 MBytes 73.1 Mbits/sec 0.185 ms = 68268/74612 (91%) =20 >>> - - - - - - - - - - - - - - - - - - - - - - - - - >>> [ ID][Role] Interval Transfer Bitrate Jitter = Lost/Total Datagrams >>> [ 5][TX-C] 0.00-10.00 sec 754 MBytes 632 Mbits/sec 0.000 ms = 0/647731 (0%) sender >>> [ 5][TX-C] 0.00-10.12 sec 105 MBytes 87.2 Mbits/sec 0.245 ms = 571090/647649 (88%) receiver >>> [ 7][RX-C] 0.00-10.00 sec 1009 MBytes 846 Mbits/sec 0.000 ms = 0/761013 (0%) sender >>> [ 7][RX-C] 0.00-10.12 sec 86.2 MBytes 71.4 Mbits/sec 0.185 ms = 674392/737139 (91%) receiver >>>=20 >>>=20 >=20 > Taking a look at this iperf output I recalled that 80% of my setups > suffered from similar issue after transitioning from 1{1,2}-STABLE to > 13-STABLE about a mounth ago. I have asked on IRC but nobody confirmed > similar problems so I have reduced MTU to 8900 from the original 9000 = on > some vlan(4) interfaces to solve the issue. I am using mostly vlan(4)s > over LACP lagg(4)s created on NICs. So far (for FreeBSD 11 and 12) > setting MTU 9000 on physical NIC was sufficient to make it work, now I > have set MTU 9000 on NICs and reduced MTU 8900 on vlan(4)s. TCP announces an MSS of 1440, which corresponds to an MTU of 1500 byte. So I guess your problem is different. Is your physical MTU 9000 bytes? Best regards Michael >=20 >>>=20 >>>=20 >>> On Tuesday, March 16, 2021 4:16:15 AM EDT tuexen@freebsd.org wrote: >>>>> On 15. Mar 2021, at 12:56, Blake Hartshorn = wrote: >>>>>=20 >>>>> The short version, when I use FreeBSD 13, delivering data can take = 5 minutes for 1MB over SSH or HTTP when using IPv6. This problem does = not happen with IPv4. I installed FreeBSD 12 and Linux on that same = device, neither had the problem. >>>>>=20 >>>>> Did some troubleshooting with Linode, have ultimately ruled the = network itself out at this point. When the server is on FreeBSD 13, it = can download quickly over IPv6, but not deliver. Started investigating = after noticing my SSH session was lagging when cat'ing large files or = running builds. This problem even occurs between VMs in the same = datacenter. I generated a 1MB file of base64 garbage served by nginx for = testing. IPv6 is being configured by SLAAC and on both 12 and 13 = installs was setup by the installer. Linode uses Linux/KVM hosts for = their virtual machines so it's running on that virtual adapter. >>>>>=20 >>>>> I asked on the forums, another user recommended going to the = mailing lists instead. Does anyone know if config settings need to be = different on 13? Did I maybe just find a real issue? I can provide any = requested details. Thanks! >>>> Could you prove a .pcap tracefile, one from the sender, one from = the recevier, of >>>> a TCP/IPv6 connection, which doesn't work as expected. For example, = use your 1MB >>>> base64 garbage transfer. >>>>=20 >>>> Best regardes >>>> Michael >>>>>=20 >>>>>=20 >>>>> _______________________________________________ >>>>> freebsd-net@freebsd.org mailing list >>>>> https://lists.freebsd.org/mailman/listinfo/freebsd-net >>>>> To unsubscribe, send any mail to = "freebsd-net-unsubscribe@freebsd.org" >>>>=20 >>>>=20 >>> >>=20 >> _______________________________________________ >> freebsd-net@freebsd.org mailing list >> https://lists.freebsd.org/mailman/listinfo/freebsd-net >> To unsubscribe, send any mail to = "freebsd-net-unsubscribe@freebsd.org" >>=20 >=20 >=20 > --=20 > Marek Zarychta >=20 From owner-freebsd-net@freebsd.org Tue Mar 16 14:53:02 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 5872F5B05D3 for ; Tue, 16 Mar 2021 14:53:02 +0000 (UTC) (envelope-from zarychtam@plan-b.pwste.edu.pl) Received: from plan-b.pwste.edu.pl (plan-b.pwste.edu.pl [IPv6:2001:678:618::40]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "plan-b.pwste.edu.pl", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4F0GVj3bYMz4f54; Tue, 16 Mar 2021 14:53:01 +0000 (UTC) (envelope-from zarychtam@plan-b.pwste.edu.pl) Received: from fomalhaut.potoki.eu ([IPv6:2001:678:618:c2:2:0:0:1]) (authenticated bits=0) by plan-b.pwste.edu.pl (8.16.1/8.16.1) with ESMTPSA id 12GEq2Gq016273 (version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128 verify=NO); Tue, 16 Mar 2021 15:52:13 +0100 (CET) (envelope-from zarychtam@plan-b.pwste.edu.pl) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=plan-b.pwste.edu.pl; s=plan-b-mailer; t=1615906348; bh=f+PInN9np8nQIE5h+CZl9yEix0t0My2pkBWgrsd+xs8=; h=To:Cc:References:From:Subject:Date:In-Reply-To; b=PeaeZvaRU0rS8L3whe6jKaAs3UIA3TGzqG90DoIhdWlCf/6RMvkFh7Lw5IETY7gU4 2Rqzo1RRAfSBlhfYanq6WDtNfrmGvZh80u2zkfhRF2xHsBNs7aFat1KunAO8rbmsWY v6r9pFPm8O3HjiN0tRc+/VWA9xWXTCASUyimUMgLJh/6unSCp0xXZVYTURcVrhFvfE 6JnztsUdurK/S4U4yZEUiBoBL+y4PxXrzluq/VHJn98wFB9F6/K+s1ZCnDFh9VLiwQ a5O9MohkUrscvzeKCvZDFNUyYzHb8du3IlumzmlruIioM/BTSGcqy7Eug9GpENC2F6 o6KmfpdFEFfkg== X-Authentication-Warning: plan-b.pwste.edu.pl: Host [IPv6:2001:678:618:c2:2:0:0:1] claimed to be fomalhaut.potoki.eu To: tuexen@freebsd.org Cc: Blake Hartshorn , freebsd-net@freebsd.org References: <5753280.1HxCrU2fYu@thinkbook> <10847992.4GmZMkJedg@thinkbook> <2808496E-C2B5-4B6F-8FDB-310B7F69E540@freebsd.org> <947D1E51-CCB0-4A1E-B671-708F70420DA1@freebsd.org> From: Marek Zarychta Subject: Re: Severe IPv6 TCP transfer issues on 13.0-RC1 and RC2 Message-ID: Date: Tue, 16 Mar 2021 15:51:52 +0100 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:78.0) Gecko/20100101 Thunderbird/78.8.0 MIME-Version: 1.0 In-Reply-To: <947D1E51-CCB0-4A1E-B671-708F70420DA1@freebsd.org> Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="qMLh9QWrbst0hZe7ZMrmKN8QG9pvAfcx5" X-Rspamd-Queue-Id: 4F0GVj3bYMz4f54 X-Spamd-Bar: ------- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=plan-b.pwste.edu.pl header.s=plan-b-mailer header.b=PeaeZvaR; dmarc=pass (policy=none) header.from=plan-b.pwste.edu.pl; spf=none (mx1.freebsd.org: domain of zarychtam@plan-b.pwste.edu.pl has no SPF policy when checking 2001:678:618::40) smtp.mailfrom=zarychtam@plan-b.pwste.edu.pl X-Spamd-Result: default: False [-7.90 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_DN_SOME(0.00)[]; HAS_ATTACHMENT(0.00)[]; HAS_XAW(0.00)[]; DKIM_TRACE(0.00)[plan-b.pwste.edu.pl:+]; DMARC_POLICY_ALLOW(-0.50)[plan-b.pwste.edu.pl,none]; NEURAL_HAM_SHORT(-1.00)[-1.000]; SIGNED_PGP(-2.00)[]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:+,3:~]; RBL_DBL_DONT_QUERY_IPS(0.00)[2001:678:618::40:from]; ASN(0.00)[asn:206006, ipnet:2001:678:618::/48, country:PL]; MID_RHS_MATCH_FROM(0.00)[]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[plan-b.pwste.edu.pl:s=plan-b-mailer]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; DWL_DNSWL_MED(-2.00)[pwste.edu.pl:dkim]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.20)[multipart/signed,multipart/mixed,text/plain]; SPAMHAUS_ZRD(0.00)[2001:678:618::40:from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; R_SPF_NA(0.00)[no SPF record]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-net] X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 16 Mar 2021 14:53:02 -0000 This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --qMLh9QWrbst0hZe7ZMrmKN8QG9pvAfcx5 Content-Type: multipart/mixed; boundary="J3sia0MV05ZtZmHbnbTrGyi8A4wcOA5yg"; protected-headers="v1" From: Marek Zarychta To: tuexen@freebsd.org Cc: Blake Hartshorn , freebsd-net@freebsd.org Message-ID: Subject: Re: Severe IPv6 TCP transfer issues on 13.0-RC1 and RC2 References: <5753280.1HxCrU2fYu@thinkbook> <10847992.4GmZMkJedg@thinkbook> <2808496E-C2B5-4B6F-8FDB-310B7F69E540@freebsd.org> <947D1E51-CCB0-4A1E-B671-708F70420DA1@freebsd.org> In-Reply-To: <947D1E51-CCB0-4A1E-B671-708F70420DA1@freebsd.org> --J3sia0MV05ZtZmHbnbTrGyi8A4wcOA5yg Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: quoted-printable W dniu 16.03.2021 o=C2=A015:35, tuexen@freebsd.org pisze: >> On 16. Mar 2021, at 15:18, Marek Zarychta wrote: >> >> W dniu 16.03.2021 o 12:50, tuexen@freebsd.org pisze: >>>> On 16. Mar 2021, at 11:55, Blake Hartshorn wrote: >>>> >>>> Hi Michael, >>>> >>>> I've attached tcpdumps for port 80 on both sides of a bad transfer, = using 2 VMs in the same datacenter, FreeBSD 13 serving and 12 as a client= =2E A friend of mine suggested I also run some tests with iperf3, so past= ing those results below. You'll see it going fast in one direction and cr= awling in the other on TCP. There's also some disparity on UDP.=20 >>> The problem is that the server provides TCP segments larger than the = MTU >>> to the NIC. These are dropped and needs to be retransmitted. That is = why >>> it takes so long. So I guess TSO is enabled on the NIC and not workin= g correctly. >>> >>> What is the output of ifconfig? Can you disable TSO? Does that work a= round >>> the problem? >>> >>> Best regards >>> Michael >>>> >>>> TCP: >>>> [ ID][Role] Interval Transfer Bitrate Retr Cw= nd >>>> [ 5][TX-C] 0.00-1.00 sec 27.7 MBytes 233 Mbits/sec 342 26= =2E7 KBytes =20 >>>> [ 7][RX-C] 0.00-1.00 sec 4.18 KBytes 34.3 Kbits/sec = =20 >>>> [ 5][TX-C] 1.00-2.00 sec 15.8 MBytes 132 Mbits/sec 249 52= =2E0 KBytes =20 >>>> [ 7][RX-C] 1.00-2.00 sec 4.18 KBytes 34.3 Kbits/sec = =20 >>>> [ 5][TX-C] 2.00-3.00 sec 13.7 MBytes 115 Mbits/sec 307 15= =2E4 KBytes =20 >>>> [ 7][RX-C] 2.00-3.00 sec 4.18 KBytes 34.3 Kbits/sec = =20 >>>> [ 5][TX-C] 3.00-4.00 sec 14.5 MBytes 121 Mbits/sec 260 22= =2E4 KBytes =20 >>>> [ 7][RX-C] 3.00-4.00 sec 4.18 KBytes 34.3 Kbits/sec = =20 >>>> [ 5][TX-C] 4.00-5.00 sec 14.3 MBytes 120 Mbits/sec 240 37= =2E9 KBytes =20 >>>> [ 7][RX-C] 4.00-5.00 sec 5.58 KBytes 45.7 Kbits/sec = =20 >>>> [ 5][TX-C] 5.00-6.00 sec 17.7 MBytes 149 Mbits/sec 363 15= =2E4 KBytes =20 >>>> [ 7][RX-C] 5.00-6.00 sec 4.18 KBytes 34.3 Kbits/sec = =20 >>>> [ 5][TX-C] 6.00-7.00 sec 14.8 MBytes 124 Mbits/sec 287 8.= 38 KBytes =20 >>>> [ 7][RX-C] 6.00-7.00 sec 5.58 KBytes 45.7 Kbits/sec = =20 >>>> [ 5][TX-C] 7.00-8.00 sec 14.7 MBytes 123 Mbits/sec 293 28= =2E1 KBytes =20 >>>> [ 7][RX-C] 7.00-8.00 sec 4.18 KBytes 34.3 Kbits/sec = =20 >>>> [ 5][TX-C] 8.00-9.00 sec 11.9 MBytes 100 Mbits/sec 325 18= =2E3 KBytes =20 >>>> [ 7][RX-C] 8.00-9.00 sec 4.18 KBytes 34.3 Kbits/sec = =20 >>>> [ 5][TX-C] 9.00-10.00 sec 14.3 MBytes 120 Mbits/sec 315 39= =2E3 KBytes =20 >>>> [ 7][RX-C] 9.00-10.00 sec 4.18 KBytes 34.3 Kbits/sec = =20 >>>> - - - - - - - - - - - - - - - - - - - - - - - - - >>>> [ ID][Role] Interval Transfer Bitrate Retr >>>> [ 5][TX-C] 0.00-10.00 sec 159 MBytes 134 Mbits/sec 2981 = sender >>>> [ 5][TX-C] 0.00-10.00 sec 159 MBytes 134 Mbits/sec = receiver >>>> [ 7][RX-C] 0.00-10.00 sec 77.0 KBytes 63.1 Kbits/sec 65 = sender >>>> [ 7][RX-C] 0.00-10.00 sec 44.6 KBytes 36.6 Kbits/sec = receiver >>>> --------------------------------------------------------------------= --------------------------------------- >>>> >>>> >>>> UDP: >>>> [ ID][Role] Interval Transfer Bitrate Jitter = Lost/Total Datagrams >>>> [ 5][TX-C] 0.00-1.00 sec 81.6 MBytes 685 Mbits/sec = 67798 =20 >>>> [ 7][RX-C] 0.00-1.00 sec 8.80 MBytes 73.8 Mbits/sec 0.255 ms= 54070/60475 (89%) =20 >>>> [ 5][TX-C] 1.00-2.00 sec 72.7 MBytes 610 Mbits/sec = 64802 =20 >>>> [ 7][RX-C] 1.00-2.00 sec 8.52 MBytes 71.5 Mbits/sec 0.154 ms= 68912/75116 (92%) =20 >>>> [ 5][TX-C] 2.00-3.00 sec 73.7 MBytes 618 Mbits/sec = 64158 =20 >>>> [ 7][RX-C] 2.00-3.00 sec 8.52 MBytes 71.5 Mbits/sec 0.276 ms= 67738/73945 (92%) =20 >>>> [ 5][TX-C] 3.00-4.00 sec 76.6 MBytes 643 Mbits/sec = 63521 =20 >>>> [ 7][RX-C] 3.00-4.00 sec 8.55 MBytes 71.8 Mbits/sec 0.160 ms= 68647/74874 (92%) =20 >>>> [ 5][TX-C] 4.00-5.00 sec 76.1 MBytes 638 Mbits/sec = 64614 =20 >>>> [ 7][RX-C] 4.00-5.00 sec 8.55 MBytes 71.7 Mbits/sec 0.461 ms= 67542/73767 (92%) =20 >>>> [ 5][TX-C] 5.00-6.00 sec 75.9 MBytes 637 Mbits/sec = 64834 =20 >>>> [ 7][RX-C] 5.00-6.00 sec 8.57 MBytes 71.9 Mbits/sec 0.297 ms= 71565/77806 (92%) =20 >>>> [ 5][TX-C] 6.00-7.00 sec 73.0 MBytes 613 Mbits/sec = 63639 =20 >>>> [ 7][RX-C] 6.00-7.00 sec 8.40 MBytes 70.5 Mbits/sec 0.199 ms= 69545/75663 (92%) =20 >>>> [ 5][TX-C] 7.00-8.00 sec 74.6 MBytes 626 Mbits/sec = 65030 =20 >>>> [ 7][RX-C] 7.00-8.00 sec 8.78 MBytes 73.6 Mbits/sec 0.254 ms= 67173/73566 (91%) =20 >>>> [ 5][TX-C] 8.00-9.00 sec 75.0 MBytes 629 Mbits/sec = 64848 =20 >>>> [ 7][RX-C] 8.00-9.00 sec 8.77 MBytes 73.5 Mbits/sec 0.298 ms= 70932/77315 (92%) =20 >>>> [ 5][TX-C] 9.00-10.00 sec 74.5 MBytes 625 Mbits/sec = 64487 =20 >>>> [ 7][RX-C] 9.00-10.00 sec 8.71 MBytes 73.1 Mbits/sec 0.185 ms= 68268/74612 (91%) =20 >>>> - - - - - - - - - - - - - - - - - - - - - - - - - >>>> [ ID][Role] Interval Transfer Bitrate Jitter = Lost/Total Datagrams >>>> [ 5][TX-C] 0.00-10.00 sec 754 MBytes 632 Mbits/sec 0.000 ms= 0/647731 (0%) sender >>>> [ 5][TX-C] 0.00-10.12 sec 105 MBytes 87.2 Mbits/sec 0.245 ms= 571090/647649 (88%) receiver >>>> [ 7][RX-C] 0.00-10.00 sec 1009 MBytes 846 Mbits/sec 0.000 ms= 0/761013 (0%) sender >>>> [ 7][RX-C] 0.00-10.12 sec 86.2 MBytes 71.4 Mbits/sec 0.185 ms= 674392/737139 (91%) receiver >>>> >>>> >> >> Taking a look at this iperf output I recalled that 80% of my setups >> suffered from similar issue after transitioning from 1{1,2}-STABLE to >> 13-STABLE about a mounth ago. I have asked on IRC but nobody confirmed= >> similar problems so I have reduced MTU to 8900 from the original 9000 = on >> some vlan(4) interfaces to solve the issue. I am using mostly vlan(4)s= >> over LACP lagg(4)s created on NICs. So far (for FreeBSD 11 and 12) >> setting MTU 9000 on physical NIC was sufficient to make it work, now I= >> have set MTU 9000 on NICs and reduced MTU 8900 on vlan(4)s. > TCP announces an MSS of 1440, which corresponds to an MTU of 1500 byte.= > So I guess your problem is different. > Is your physical MTU 9000 bytes? >=20 > Best regards > Michael Yes, MTU for some VLANs in this network is 9000 bytes and I performed only software upgrades, hardware was untouched. I haven't had similar issues while running 11.4-STABLE or 12.2-STABLE. The aforementioned 8900 is not a critical value, but the reduction from an original 9000 was mandatory. With kind regards, Marek >>>> >>>> >>>> On Tuesday, March 16, 2021 4:16:15 AM EDT tuexen@freebsd.org wrote: >>>>>> On 15. Mar 2021, at 12:56, Blake Hartshorn wrote: >>>>>> >>>>>> The short version, when I use FreeBSD 13, delivering data can take= 5 minutes for 1MB over SSH or HTTP when using IPv6. This problem does no= t happen with IPv4. I installed FreeBSD 12 and Linux on that same device,= neither had the problem. >>>>>> >>>>>> Did some troubleshooting with Linode, have ultimately ruled the ne= twork itself out at this point. When the server is on FreeBSD 13, it can = download quickly over IPv6, but not deliver. Started investigating after = noticing my SSH session was lagging when cat'ing large files or running b= uilds. This problem even occurs between VMs in the same datacenter. I gen= erated a 1MB file of base64 garbage served by nginx for testing. IPv6 is = being configured by SLAAC and on both 12 and 13 installs was setup by the= installer. Linode uses Linux/KVM hosts for their virtual machines so it'= s running on that virtual adapter. >>>>>> >>>>>> I asked on the forums, another user recommended going to the maili= ng lists instead. Does anyone know if config settings need to be differen= t on 13? Did I maybe just find a real issue? I can provide any requested = details. Thanks! >>>>> Could you prove a .pcap tracefile, one from the sender, one from th= e recevier, of >>>>> a TCP/IPv6 connection, which doesn't work as expected. For example,= use your 1MB >>>>> base64 garbage transfer. >>>>> >>>>> Best regardes >>>>> Michael >>>>>> >>>>>> >>>>>> _______________________________________________ >>>>>> freebsd-net@freebsd.org mailing list >>>>>> https://lists.freebsd.org/mailman/listinfo/freebsd-net >>>>>> To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.= org" >>>>> >>>>> >>>> >>> >>> _______________________________________________ >>> freebsd-net@freebsd.org mailing list >>> https://lists.freebsd.org/mailman/listinfo/freebsd-net >>> To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org= " >>> >> >> >> --=20 >> Marek Zarychta >> >=20 >=20 --=20 Marek Zarychta --J3sia0MV05ZtZmHbnbTrGyi8A4wcOA5yg-- --qMLh9QWrbst0hZe7ZMrmKN8QG9pvAfcx5 Content-Type: application/pgp-signature; name="OpenPGP_signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="OpenPGP_signature" -----BEGIN PGP SIGNATURE----- wsB5BAABCAAjFiEEMOqvKm6wKvS1/ZeCdZ/s//1SjSwFAmBQxggFAwAAAAAACgkQdZ/s//1SjSw2 CAf+LfNwxhHnBBzKAxhvaR4FZwYZYvfFlVNjX25sEIl1wILs+0KqXeKWjpdAnKGKsO5znLhasocV s2BdCwmf5LI8yAtN7VzAZuZCkkXU3yBbKVldYYaAFvMfXQaL/DQZ/nYABn3hMtLNZsNQA+lcQmsz 4ah/uBG4l6cCffnTLmXKCTK2SmTCcdJBFggppuP/ez1gVezofZFRP1J6B/38kSI07OsLAgoDv3hn gc947WYsuyDTMO1blzwkPZnryJfuwVjrZpzy+iwi35UBO9c3ozXTLBCYlyykKBsSDjOsll8SWWKV 7/6MpZAHDdbhmp6OzoWOJHOYElsQ/gUUsq01EnsYYQ== =BoOn -----END PGP SIGNATURE----- --qMLh9QWrbst0hZe7ZMrmKN8QG9pvAfcx5-- From owner-freebsd-net@freebsd.org Tue Mar 16 15:07:57 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 1BFF45B0F80 for ; Tue, 16 Mar 2021 15:07:57 +0000 (UTC) (envelope-from mtrm79@gmail.com) Received: from mail-ot1-x329.google.com (mail-ot1-x329.google.com [IPv6:2607:f8b0:4864:20::329]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4F0Gqx00lLz4frH; Tue, 16 Mar 2021 15:07:56 +0000 (UTC) (envelope-from mtrm79@gmail.com) Received: by mail-ot1-x329.google.com with SMTP id t23-20020a0568301e37b02901b65ab30024so7012080otr.4; Tue, 16 Mar 2021 08:07:56 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=jEQU127UXyNDW7/efPrEQJc9qq+vnNfXz+gMNmrJIIw=; b=F3XFABQpZDbfGtVpYnnJQvl3ZdLPFCLRLWyfkP1ePEP7zdgTpdw0kJ7gUfvzD/SmP1 CUj+Hv1ifDp1zvWAQ2Wp3vRKddQhFGCZQy/+CbBFwxohntOzmUfJicmByiTmsMm/VA8o tFIK0dLDQ6sq+Z9ULE7cL2qksYznnZ94+FeTEgLdvwDskhqo1M1hVied4tW+k5YDxLWQ 8piaBiCX7Ono9eBiCrMBgBh8blGNsQLLUkOegYcHaXx69LiqCwjUsTq+xt6I8zpGHNZ3 4my/qftA7YVPFpH3eGN+LsprJZGbJBJ4cK2vt0UK9D11i+V4CPvv2oEsGfgvKDzWsnxI biCQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=jEQU127UXyNDW7/efPrEQJc9qq+vnNfXz+gMNmrJIIw=; b=rZcCWGurkPFTKn1hocJDMgWrEk0gVvbCDtbKGEPCdWjg47hF21LU4SROXzMuMiMl0d g2rRn08HvzkRA14EHcV7/0+UijFiWebR9t+BfearG1rfLn7YX31SwcKNJn2boEGn3D2L Geunzh3CE7u7l0K2Ov+uDGXfImOPVRpnGtGM4J5/vdWDarnYCSRShyJn2/WdcBT6H5Rp rK0JTjhnxet/2DLqbauy2viU9oJcZ68W+KH9Hc6FTH9K0BbM2GJ+A27Hno8DSTw6i3ge AHuHXPhYhvP73hjZob8zp1xo2I++2GbIAFTkeJwfLZzaJYz6kVm1/A49FidrnIU5bZ9A jHeg== X-Gm-Message-State: AOAM532KLsfQwOr9/0jP6GRigXjBccU3uGUGCPRwRE4Q8TQeswRDdfIB CgnRioiHzj8UMdN0kQQGxo4mEN8ji5EY1NPAXn0BlR39OMNulA== X-Google-Smtp-Source: ABdhPJyXqwLvyPV+G2r720hv/fMVx0DE1/SwE59YcFBkX/UrWCo/vF3dY+HUKcPjuASzs+bnCczM611a8bLuTdRi3Hk= X-Received: by 2002:a9d:4048:: with SMTP id o8mr4029158oti.152.1615907275218; Tue, 16 Mar 2021 08:07:55 -0700 (PDT) MIME-Version: 1.0 Received: by 2002:a4a:d5c8:0:0:0:0:0 with HTTP; Tue, 16 Mar 2021 08:07:54 -0700 (PDT) In-Reply-To: References: <5753280.1HxCrU2fYu@thinkbook> <10847992.4GmZMkJedg@thinkbook> <2808496E-C2B5-4B6F-8FDB-310B7F69E540@freebsd.org> <947D1E51-CCB0-4A1E-B671-708F70420DA1@freebsd.org> From: mtrm79 Date: Tue, 16 Mar 2021 08:07:54 -0700 Message-ID: Subject: Re: Severe IPv6 TCP transfer issues on 13.0-RC1 and RC2 To: Marek Zarychta Cc: "tuexen@freebsd.org" , Blake Hartshorn , "freebsd-net@freebsd.org" X-Rspamd-Queue-Id: 4F0Gqx00lLz4frH X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[] Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.34 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 16 Mar 2021 15:07:57 -0000 On Tuesday, March 16, 2021, Marek Zarychta wrote: > W dniu 16.03.2021 o 15:35, tuexen@freebsd.org pisze: > >> On 16. Mar 2021, at 15:18, Marek Zarychta < > zarychtam@plan-b.pwste.edu.pl> wrote: > >> > >> W dniu 16.03.2021 o 12:50, tuexen@freebsd.org pisze: > >>>> On 16. Mar 2021, at 11:55, Blake Hartshorn < > contact@blakehartshorn.com> wrote: > >>>> > >>>> Hi Michael, > >>>> > >>>> I've attached tcpdumps for port 80 on both sides of a bad transfer, > using 2 VMs in the same datacenter, FreeBSD 13 serving and 12 as a client= . > A friend of mine suggested I also run some tests with iperf3, so pasting > those results below. You'll see it going fast in one direction and crawli= ng > in the other on TCP. There's also some disparity on UDP. > >>> The problem is that the server provides TCP segments larger than the > MTU > >>> to the NIC. These are dropped and needs to be retransmitted. That is > why > >>> it takes so long. So I guess TSO is enabled on the NIC and not workin= g > correctly. > >>> > >>> What is the output of ifconfig? Can you disable TSO? Does that work > around > >>> the problem? > >>> > >>> Best regards > >>> Michael > >>>> > >>>> TCP: > >>>> [ ID][Role] Interval Transfer Bitrate Retr Cw= nd > >>>> [ 5][TX-C] 0.00-1.00 sec 27.7 MBytes 233 Mbits/sec 342 > 26.7 KBytes > >>>> [ 7][RX-C] 0.00-1.00 sec 4.18 KBytes 34.3 Kbits/sec > > >>>> [ 5][TX-C] 1.00-2.00 sec 15.8 MBytes 132 Mbits/sec 249 > 52.0 KBytes > >>>> [ 7][RX-C] 1.00-2.00 sec 4.18 KBytes 34.3 Kbits/sec > > >>>> [ 5][TX-C] 2.00-3.00 sec 13.7 MBytes 115 Mbits/sec 307 > 15.4 KBytes > >>>> [ 7][RX-C] 2.00-3.00 sec 4.18 KBytes 34.3 Kbits/sec > > >>>> [ 5][TX-C] 3.00-4.00 sec 14.5 MBytes 121 Mbits/sec 260 > 22.4 KBytes > >>>> [ 7][RX-C] 3.00-4.00 sec 4.18 KBytes 34.3 Kbits/sec > > >>>> [ 5][TX-C] 4.00-5.00 sec 14.3 MBytes 120 Mbits/sec 240 > 37.9 KBytes > >>>> [ 7][RX-C] 4.00-5.00 sec 5.58 KBytes 45.7 Kbits/sec > > >>>> [ 5][TX-C] 5.00-6.00 sec 17.7 MBytes 149 Mbits/sec 363 > 15.4 KBytes > >>>> [ 7][RX-C] 5.00-6.00 sec 4.18 KBytes 34.3 Kbits/sec > > >>>> [ 5][TX-C] 6.00-7.00 sec 14.8 MBytes 124 Mbits/sec 287 > 8.38 KBytes > >>>> [ 7][RX-C] 6.00-7.00 sec 5.58 KBytes 45.7 Kbits/sec > > >>>> [ 5][TX-C] 7.00-8.00 sec 14.7 MBytes 123 Mbits/sec 293 > 28.1 KBytes > >>>> [ 7][RX-C] 7.00-8.00 sec 4.18 KBytes 34.3 Kbits/sec > > >>>> [ 5][TX-C] 8.00-9.00 sec 11.9 MBytes 100 Mbits/sec 325 > 18.3 KBytes > >>>> [ 7][RX-C] 8.00-9.00 sec 4.18 KBytes 34.3 Kbits/sec > > >>>> [ 5][TX-C] 9.00-10.00 sec 14.3 MBytes 120 Mbits/sec 315 > 39.3 KBytes > >>>> [ 7][RX-C] 9.00-10.00 sec 4.18 KBytes 34.3 Kbits/sec > > >>>> - - - - - - - - - - - - - - - - - - - - - - - - - > >>>> [ ID][Role] Interval Transfer Bitrate Retr > >>>> [ 5][TX-C] 0.00-10.00 sec 159 MBytes 134 Mbits/sec 2981 > sender > >>>> [ 5][TX-C] 0.00-10.00 sec 159 MBytes 134 Mbits/sec > receiver > >>>> [ 7][RX-C] 0.00-10.00 sec 77.0 KBytes 63.1 Kbits/sec 65 > sender > >>>> [ 7][RX-C] 0.00-10.00 sec 44.6 KBytes 36.6 Kbits/sec > receiver > >>>> ------------------------------------------------------------ > ----------------------------------------------- > >>>> > >>>> > >>>> UDP: > >>>> [ ID][Role] Interval Transfer Bitrate Jitter > Lost/Total Datagrams > >>>> [ 5][TX-C] 0.00-1.00 sec 81.6 MBytes 685 Mbits/sec > 67798 > >>>> [ 7][RX-C] 0.00-1.00 sec 8.80 MBytes 73.8 Mbits/sec 0.255 ms > 54070/60475 (89%) > >>>> [ 5][TX-C] 1.00-2.00 sec 72.7 MBytes 610 Mbits/sec > 64802 > >>>> [ 7][RX-C] 1.00-2.00 sec 8.52 MBytes 71.5 Mbits/sec 0.154 ms > 68912/75116 (92%) > >>>> [ 5][TX-C] 2.00-3.00 sec 73.7 MBytes 618 Mbits/sec > 64158 > >>>> [ 7][RX-C] 2.00-3.00 sec 8.52 MBytes 71.5 Mbits/sec 0.276 ms > 67738/73945 (92%) > >>>> [ 5][TX-C] 3.00-4.00 sec 76.6 MBytes 643 Mbits/sec > 63521 > >>>> [ 7][RX-C] 3.00-4.00 sec 8.55 MBytes 71.8 Mbits/sec 0.160 ms > 68647/74874 (92%) > >>>> [ 5][TX-C] 4.00-5.00 sec 76.1 MBytes 638 Mbits/sec > 64614 > >>>> [ 7][RX-C] 4.00-5.00 sec 8.55 MBytes 71.7 Mbits/sec 0.461 ms > 67542/73767 (92%) > >>>> [ 5][TX-C] 5.00-6.00 sec 75.9 MBytes 637 Mbits/sec > 64834 > >>>> [ 7][RX-C] 5.00-6.00 sec 8.57 MBytes 71.9 Mbits/sec 0.297 ms > 71565/77806 (92%) > >>>> [ 5][TX-C] 6.00-7.00 sec 73.0 MBytes 613 Mbits/sec > 63639 > >>>> [ 7][RX-C] 6.00-7.00 sec 8.40 MBytes 70.5 Mbits/sec 0.199 ms > 69545/75663 (92%) > >>>> [ 5][TX-C] 7.00-8.00 sec 74.6 MBytes 626 Mbits/sec > 65030 > >>>> [ 7][RX-C] 7.00-8.00 sec 8.78 MBytes 73.6 Mbits/sec 0.254 ms > 67173/73566 (91%) > >>>> [ 5][TX-C] 8.00-9.00 sec 75.0 MBytes 629 Mbits/sec > 64848 > >>>> [ 7][RX-C] 8.00-9.00 sec 8.77 MBytes 73.5 Mbits/sec 0.298 ms > 70932/77315 (92%) > >>>> [ 5][TX-C] 9.00-10.00 sec 74.5 MBytes 625 Mbits/sec > 64487 > >>>> [ 7][RX-C] 9.00-10.00 sec 8.71 MBytes 73.1 Mbits/sec 0.185 ms > 68268/74612 (91%) > >>>> - - - - - - - - - - - - - - - - - - - - - - - - - > >>>> [ ID][Role] Interval Transfer Bitrate Jitter > Lost/Total Datagrams > >>>> [ 5][TX-C] 0.00-10.00 sec 754 MBytes 632 Mbits/sec 0.000 ms > 0/647731 (0%) sender > >>>> [ 5][TX-C] 0.00-10.12 sec 105 MBytes 87.2 Mbits/sec 0.245 ms > 571090/647649 (88%) receiver > >>>> [ 7][RX-C] 0.00-10.00 sec 1009 MBytes 846 Mbits/sec 0.000 ms > 0/761013 (0%) sender > >>>> [ 7][RX-C] 0.00-10.12 sec 86.2 MBytes 71.4 Mbits/sec 0.185 ms > 674392/737139 (91%) receiver > >>>> > >>>> > >> > >> Taking a look at this iperf output I recalled that 80% of my setups > >> suffered from similar issue after transitioning from 1{1,2}-STABLE to > >> 13-STABLE about a mounth ago. I have asked on IRC but nobody confirmed > >> similar problems so I have reduced MTU to 8900 from the original 9000 = on > >> some vlan(4) interfaces to solve the issue. I am using mostly vlan(4)s > >> over LACP lagg(4)s created on NICs. So far (for FreeBSD 11 and 12) > >> setting MTU 9000 on physical NIC was sufficient to make it work, now I > >> have set MTU 9000 on NICs and reduced MTU 8900 on vlan(4)s. > > TCP announces an MSS of 1440, which corresponds to an MTU of 1500 byte. > > So I guess your problem is different. > > Is your physical MTU 9000 bytes? > > > > Best regards > > Michael > > Yes, MTU for some VLANs in this network is 9000 bytes and I performed > only software upgrades, hardware was untouched. I haven't had similar > issues while running 11.4-STABLE or 12.2-STABLE. The aforementioned 8900 > is not a critical value, but the reduction from an original 9000 was > mandatory. > > With kind regards, > Marek > > I also experienced that same issue with 13.0-RC2 after upgrading some VMs. The same issue also exists in Beta4. It only affects IPv6. For me it is extremely slow in both directions if both VMs are on the same host and are running 13.0-RC2. It is easy to reproduce. Simply setup two VMs using virt-manager or proxmox running FreeBSD 13.0-RC2. Configure the network to use virtio and setup IPv6. Run iperf using IPv6 and we are down to modem speeds. :-( If you test using ipv4 no issues at all. To only way to get better speeds is to disable tso6. ifconfig vtnet0 -tso6 The host-host speeds after that are still not as good as IPv4 but at least it=E2=80=99s in multiple Gbps vs just some Kbps. FreeBSD 12.2 has none of t= hose issues. Could it have something to do with the if_vtnet changes on 2021-01-19 committed by Bryan Venteicher https://reviews.freebsd.org/D27904 https://cgit.freebsd.org/src/log/sys/dev/virtio/network?h=3Dreleng/13.0 Haven=E2=80=99t had time to compile a kernel before those changes or right = after to see if the issue goes away. I only tested the ipv6 slowness on virtio. Don=E2=80=99t know if the issue = exists on bare metal hardware as well. Thanks, Michael Tratz > >>>> > >>>> > >>>> On Tuesday, March 16, 2021 4:16:15 AM EDT tuexen@freebsd.org wrote: > >>>>>> On 15. Mar 2021, at 12:56, Blake Hartshorn < > contact@blakehartshorn.com> wrote: > >>>>>> > >>>>>> The short version, when I use FreeBSD 13, delivering data can take > 5 minutes for 1MB over SSH or HTTP when using IPv6. This problem does not > happen with IPv4. I installed FreeBSD 12 and Linux on that same device, > neither had the problem. > >>>>>> > >>>>>> Did some troubleshooting with Linode, have ultimately ruled the > network itself out at this point. When the server is on FreeBSD 13, it ca= n > download quickly over IPv6, but not deliver. Started investigating after > noticing my SSH session was lagging when cat'ing large files or running > builds. This problem even occurs between VMs in the same datacenter. I > generated a 1MB file of base64 garbage served by nginx for testing. IPv6 = is > being configured by SLAAC and on both 12 and 13 installs was setup by the > installer. Linode uses Linux/KVM hosts for their virtual machines so it's > running on that virtual adapter. > >>>>>> > >>>>>> I asked on the forums, another user recommended going to the > mailing lists instead. Does anyone know if config settings need to be > different on 13? Did I maybe just find a real issue? I can provide any > requested details. Thanks! > >>>>> Could you prove a .pcap tracefile, one from the sender, one from th= e > recevier, of > >>>>> a TCP/IPv6 connection, which doesn't work as expected. For example, > use your 1MB > >>>>> base64 garbage transfer. > >>>>> > >>>>> Best regardes > >>>>> Michael > >>>>>> > >>>>>> > >>>>>> _______________________________________________ > >>>>>> freebsd-net@freebsd.org mailing list > >>>>>> https://lists.freebsd.org/mailman/listinfo/freebsd-net > >>>>>> To unsubscribe, send any mail to "freebsd-net-unsubscribe@ > freebsd.org" > >>>>> > >>>>> > >>>> > >>> > >>> _______________________________________________ > >>> freebsd-net@freebsd.org mailing list > >>> https://lists.freebsd.org/mailman/listinfo/freebsd-net > >>> To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org= " > >>> > >> > >> > >> -- > >> Marek Zarychta > >> > > > > > > > -- > Marek Zarychta > > From owner-freebsd-net@freebsd.org Tue Mar 16 16:25:13 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 8BDC95B3CC2 for ; Tue, 16 Mar 2021 16:25:13 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 4F0JY53Fc1z4lKG for ; Tue, 16 Mar 2021 16:25:13 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 6F57E5B428B; Tue, 16 Mar 2021 16:25:13 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 6F1AF5B3E5F for ; Tue, 16 Mar 2021 16:25:13 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4F0JY52cqCz4lMf for ; Tue, 16 Mar 2021 16:25:13 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4B44B26D9C for ; Tue, 16 Mar 2021 16:25:13 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 12GGPDW4075196 for ; Tue, 16 Mar 2021 16:25:13 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 12GGPDfc075195 for net@FreeBSD.org; Tue, 16 Mar 2021 16:25:13 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 254244] panics after upgrade to stable/13-n244861-b9773574371 Date: Tue, 16 Mar 2021 16:25:13 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-STABLE X-Bugzilla-Keywords: panic, regression X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: zarychtam@plan-b.pwste.edu.pl X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: net@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: attachments.created Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 16 Mar 2021 16:25:13 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D254244 --- Comment #19 from Marek Zarychta --- Created attachment 223325 --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=3D223325&action= =3Dedit backtrace 2 The kernel with patch 2 applied still finds a way to panic. Please compare = the new backtrace. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-net@freebsd.org Tue Mar 16 17:04:14 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 852255B5737 for ; Tue, 16 Mar 2021 17:04:14 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 4F0KQ637T7z4pYt for ; Tue, 16 Mar 2021 17:04:14 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 6B6E25B55EA; Tue, 16 Mar 2021 17:04:14 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 6B3855B5736 for ; Tue, 16 Mar 2021 17:04:14 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4F0KQ62TBTz4pTL for ; Tue, 16 Mar 2021 17:04:14 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 47F8C27667 for ; Tue, 16 Mar 2021 17:04:14 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 12GH4Ecs097526 for ; Tue, 16 Mar 2021 17:04:14 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 12GH4Eeo097525 for net@FreeBSD.org; Tue, 16 Mar 2021 17:04:14 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 254244] panics after upgrade to stable/13-n244861-b9773574371 Date: Tue, 16 Mar 2021 17:04:13 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-STABLE X-Bugzilla-Keywords: panic, regression X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: hselasky@FreeBSD.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: net@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 16 Mar 2021 17:04:14 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D254244 --- Comment #20 from Hans Petter Selasky --- Comment on attachment 223325 --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=3D223325 backtrace 2 Can you type in kgdb101 (please install using GDB from ports or pkg): frame 27 print *m --HPS --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-net@freebsd.org Tue Mar 16 17:31:27 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 576155B664A for ; Tue, 16 Mar 2021 17:31:27 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 4F0L1W1frwz4rvR for ; Tue, 16 Mar 2021 17:31:27 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 38D465B6718; Tue, 16 Mar 2021 17:31:27 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 387E65B656C for ; Tue, 16 Mar 2021 17:31:27 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4F0L1W0z4Nz4rvN for ; Tue, 16 Mar 2021 17:31:27 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 12F642794D for ; Tue, 16 Mar 2021 17:31:27 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 12GHVQSk009023 for ; Tue, 16 Mar 2021 17:31:26 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 12GHVQXb009022 for net@FreeBSD.org; Tue, 16 Mar 2021 17:31:26 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 254244] panics after upgrade to stable/13-n244861-b9773574371 Date: Tue, 16 Mar 2021 17:31:27 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-STABLE X-Bugzilla-Keywords: panic, regression X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: zarychtam@plan-b.pwste.edu.pl X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: net@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 16 Mar 2021 17:31:27 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D254244 --- Comment #21 from Marek Zarychta --- (In reply to Hans Petter Selasky from comment #20) I am happy to serve with this dump. (kgdb) frame 27 #27 0xffffffff80cfbac9 in ether_input (ifp=3D, m=3D0xfffff8025a85aa00) at /usr/src/sys/net/if_ethersubr.c:827 827 netisr_dispatch(NETISR_ETHER, m); (kgdb) print *m $1 =3D {{m_next =3D 0x0, m_slist =3D {sle_next =3D 0x0}, m_stailq =3D {stqe= _next =3D 0x0}}, {m_nextpkt =3D 0x0, m_slistpkt =3D { sle_next =3D 0x0}, m_stailqpkt =3D {stqe_next =3D 0x0}}, m_data =3D 0xfffff8025a85aa66 "E", m_len =3D 40, m_type =3D 1,=20 m_flags =3D 2, {{{m_pkthdr =3D {{snd_tag =3D 0xfffff80045091000, rcvif =3D 0xfffff80045091000}, tags =3D {slh_first =3D 0x0},=20 len =3D 40, flowid =3D 3264704486, csum_flags =3D 251658240, fibn= um =3D 0, numa_domain =3D 255 '\377', rsstype =3D 130 '\202',=20 {rcv_tstmp =3D 0, {l2hlen =3D 0 '\000', l3hlen =3D 0 '\000', l4hl= en =3D 0 '\000', l5hlen =3D 0 '\000',=20 inner_l2hlen =3D 0 '\000', inner_l3hlen =3D 0 '\000', inner_l= 4hlen =3D 0 '\000', inner_l5hlen =3D 0 '\000'}},=20 PH_per =3D {eight =3D "\002\000\000\000\377\377\000", sixteen =3D= {2, 0, 65535, 0}, thirtytwo =3D {2, 65535}, sixtyfour =3D { 281470681743362}, unintptr =3D {281470681743362}, ptr =3D 0xffff00000002}, PH_loc =3D { eight =3D "\000\000\000\000\000\000\000", sixteen =3D {0, 0, 0,= 0}, thirtytwo =3D {0, 0}, sixtyfour =3D {0}, unintptr =3D { 0}, ptr =3D 0x0}}, {m_epg_npgs =3D 0 '\000', m_epg_nrdy =3D 1= 6 '\020', m_epg_hdrlen =3D 9 '\t', m_epg_trllen =3D 69 'E',=20 m_epg_1st_off =3D 63488, m_epg_last_len =3D 65535, m_epg_flags = =3D 0 '\000', m_epg_record_type =3D 0 '\000',=20 __spare =3D "\000", m_epg_enc_cnt =3D 0, m_epg_tls =3D 0xc2976fe6= 00000028, m_epg_so =3D 0x82ff00000f000000,=20 m_epg_seqno =3D 0, m_epg_stailq =3D {stqe_next =3D 0xffff00000002= }}}, {m_ext =3D {{ext_count =3D 40574892,=20 ext_cnt =3D 0x1fac88a6026b1fac}, ext_size =3D 3634365035, ext_t= ype =3D 8, ext_flags =3D 17664, {{ ext_buf =3D 0x67a0040c27a2800 ,=20 ext_arg2 =3D 0xbc592715801f3f1a}, {extpg_pa =3D {466685789526= 960128, 13571921925355028250, 6125337632998583261,=20 1175541087717038345, 258},=20 extpg_trail =3D "\232\265\000\000\001\001\b\n\220\324a\240\322\343z\325\000\000\367}\317\35= 1\347\361\026^\271\217\270\000=D3=89X[G\002t\225pT\032\003g\201\327y%\200\2= 40\022/u\363D|:\220\211\257\325\023,>\265",=20 extpg_hdr =3D "\275gp\205#\027\003\363=C5=8C\216\212\v\261\000\000\273\233\272t=DF=BE\236= "}},=20 ext_free =3D 0xce60062281102bfe, ext_arg1 =3D 0x1facc45091565000}= ,=20 m_pktdat =3D 0xfffff8025a85aa58 "\254\037k\002\246\210\254\037k\002\240\330\b"}}, m_dat =3D 0xfffff8025a85a= a20 ""}} --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-net@freebsd.org Tue Mar 16 18:02:11 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 52C5A5B78F4 for ; Tue, 16 Mar 2021 18:02:11 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 4F0Lhz1fNpz4v7h for ; Tue, 16 Mar 2021 18:02:11 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 388505B73F0; Tue, 16 Mar 2021 18:02:11 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 384565B75FE for ; Tue, 16 Mar 2021 18:02:11 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4F0Lhz0zw6z4v2x for ; Tue, 16 Mar 2021 18:02:11 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 14D4028387 for ; Tue, 16 Mar 2021 18:02:11 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 12GI2Brw025750 for ; Tue, 16 Mar 2021 18:02:11 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 12GI2B8D025749 for net@FreeBSD.org; Tue, 16 Mar 2021 18:02:11 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 254244] panics after upgrade to stable/13-n244861-b9773574371 Date: Tue, 16 Mar 2021 18:02:10 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-STABLE X-Bugzilla-Keywords: panic, regression X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: hselasky@FreeBSD.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: net@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 16 Mar 2021 18:02:11 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D254244 --- Comment #22 from Hans Petter Selasky --- Further try in frame 27: print /x *(uint8_t [128] *)((struct mbuf *)m)->m_data That will hopefully dump the packet. --HPS --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-net@freebsd.org Tue Mar 16 20:40:12 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 8448B56CD5C for ; Tue, 16 Mar 2021 20:40:12 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 4F0QCJ38B8z3NvR for ; Tue, 16 Mar 2021 20:40:12 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 6A0BD56CF38; Tue, 16 Mar 2021 20:40:12 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 69CE956CDC9 for ; Tue, 16 Mar 2021 20:40:12 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4F0QCJ2WFBz3P0p for ; Tue, 16 Mar 2021 20:40:12 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 498782A1CE for ; Tue, 16 Mar 2021 20:40:12 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 12GKeCJg026689 for ; Tue, 16 Mar 2021 20:40:12 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 12GKeCaJ026688 for net@FreeBSD.org; Tue, 16 Mar 2021 20:40:12 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 254309] [tcp] frequent panics in tcp_output Date: Tue, 16 Mar 2021 20:40:12 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-STABLE X-Bugzilla-Keywords: panic X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: rozhuk.im@gmail.com X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: net@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 16 Mar 2021 20:40:12 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D254309 --- Comment #7 from rozhuk.im@gmail.com --- #10 0xffffffff8076ec3a in tcp_output (tp=3D0xfffffe01137c60c0) at /usr/src/sys/netinet/tcp_output.c:1068 1068 m_copydata(mb, moff, len, (kgdb) info locals moff =3D 0 mb =3D 0xfffff802a20ba800 msb =3D opt =3D "\001\001\b\n\325\035\060\267+\223/\264\001\376\377\377\001M\373\267\000\00= 0\000\000\340`|\023\001\376\377\377\250\005\000\000\000\000\000" to =3D {to_flags =3D 16, to_tsval =3D 3073383893, to_tsecr =3D 3023016747, = to_sacks =3D 0xfffffe001eacac00 "\300P\254\036",=20 to_signature =3D 0x11ea8d0c0 , to_tfo_cookie =3D 0xfe ,=20 to_mss =3D 8288, to_wscale =3D 229 '\345', to_nsacks =3D 197 '\305', to_t= fo_len =3D 0 '\000', to_spare =3D 3535675904} hw_tls =3D false isipv6 =3D ip6 =3D 0x0 dont_sendalot =3D 0 wanted_cookie =3D 0 ip =3D 0xfffff8020e774668 if_hw_tsomaxsegsize =3D 0 if_hw_tsomaxsegcount =3D 0 error =3D so =3D idle =3D 0 sendalot =3D 1 tso =3D 0 flags =3D 17 recwin =3D 2098020 sack_rxmit =3D 1 p =3D 0xfffff802a256ef20 off =3D 32622 mtu =3D 0 sendwin =3D sack_bytes_rxmt =3D len =3D 1 ipoptlen =3D optlen =3D hdrlen =3D curticks =3D m =3D 0xfffff8020eecec00 th =3D --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-net@freebsd.org Tue Mar 16 21:58:32 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id E485056FA05 for ; Tue, 16 Mar 2021 21:58:32 +0000 (UTC) (envelope-from bc979@lafn.org) Received: from mail.sermon-archive.info (sermon-archive.info [47.181.130.121]) by mx1.freebsd.org (Postfix) with ESMTP id 4F0Rxg5dPPz3lhY for ; Tue, 16 Mar 2021 21:58:31 +0000 (UTC) (envelope-from bc979@lafn.org) Received: from [10.0.1.251] (mini [10.0.1.251]) by mail.sermon-archive.info (Postfix) with ESMTPSA id 4F0Rxf3yZ8z2fjRk for ; Tue, 16 Mar 2021 14:58:30 -0700 (PDT) From: Doug Hardie Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable Mime-Version: 1.0 (Mac OS X Mail 14.0 \(3654.60.0.2.21\)) Subject: Re: IPv6 Startup Date: Tue, 16 Mar 2021 14:58:30 -0700 References: <06A12556-0C24-48AD-9D1C-C04491AADAF6@sermon-archive.info> <5EDD7B95-A25C-4414-B0CA-8A245A8FA920@sermon-archive.info> <20210316105444.GA15531@belenus.iks-jena.de> To: freebsd-net@freebsd.org In-Reply-To: <20210316105444.GA15531@belenus.iks-jena.de> Message-Id: X-Mailer: Apple Mail (2.3654.60.0.2.21) X-Virus-Scanned: clamav-milter 0.103.0 at mail X-Virus-Status: Clean X-Rspamd-Queue-Id: 4F0Rxg5dPPz3lhY X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of bc979@lafn.org designates 47.181.130.121 as permitted sender) smtp.mailfrom=bc979@lafn.org X-Spamd-Result: default: False [-2.70 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FROM_HAS_DN(0.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[47.181.130.121:from]; MV_CASE(0.50)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[text/plain]; TO_DN_NONE(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-net@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; SPAMHAUS_ZRD(0.00)[47.181.130.121:from:127.0.2.255]; DMARC_NA(0.00)[lafn.org: no valid DMARC record]; R_SPF_ALLOW(-0.20)[+mx]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-1.000]; RCVD_NO_TLS_LAST(0.10)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:5650, ipnet:47.181.128.0/18, country:US]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[freebsd-net] X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 16 Mar 2021 21:58:33 -0000 -- Doug > On 16 March 2021, at 03:54, Lutz Donnerhacke = wrote: >=20 > On Mon, Mar 15, 2021 at 05:29:55PM -0700, Doug Hardie wrote: >> I reduced the configuration to the host settings: >> ifconfig_bge0_ipv6=3D"inet6 accept_rtadv" >>=20 >> The router to: >> ifconfig_ue0_ipv6=3D"up" >>=20 >> Ran tcpdump on the router (obviously not acting as a router) and = restarted the host. Got the following: >>=20 >> tcpdump: listening on ue0, link-type EN10MB (Ethernet), capture size = 262144 bytes >=20 > The device is using a EUI-64 link local address, which is unique by > definition. Therefore no DAD is necessary, the address can be used > immediatly. If you use a manually generated address, even if it has a > EUI-64 form, DAD is required. DAD consists of Neighbour Solication > messages. >=20 > I understand your point, questioning if DAD should be done in any case = or > not. That's a complicated topic, which requires a lot of RFC = exegesis, > studying interop tests results from the IETF and IPv6 certificate > organisations, and practical market dominance. I think there is more to that than is immediately obvious. Many of the = cable internet providers in CA control the number of devices you can = connect by tracking the MAC addresses. Some of them will force you to = wait a time period if you change the modem. Others require you to call = in and get it changed. People have a tendency to just go ahead and = change the MAC on the new device to match the old to avoid those = problems. Windows used to have the software to change the MAC addresses. I = haven't used Windows in quite a few years so I don't know if it still = does. If I want to mess with you, there is a very easy way to create a denial = of service issue for you. Your MAC addresses are easily found from the = IP EUI value. I simply build a small device that uses that MAC address = and mail it to you requesting you "evaluate" a new product. Since most = people will be using link-local addresses, it will effectively cause = problems on their computers. Granted, that is probably not a very = common occurance, until it happens to you. >=20 >> 19:05:00.048637 IP6 (hlim 1, next-header Options (0) payload length: = 56) fe80::aa60:b6ff:fe1d:8dbc > ff02::16: HBH (padn)(rtalert: 0x0000) = [icmp6 sum ok] ICMP6, multicast listener report v2, 2 group record(s) = [gaddr ff02::2:ec7d:574c to_ex, 0 source(s)] [gaddr ff02::2:ffec:7d57 = to_ex, 0 source(s)] >=20 > Because IPv6 uses unicast and multicast only, the device registers = itself > for the necessary link local multicast groups. Interesting. That must be registering with the router. All the routers = except for one are quite old and I doubt they have that functionality. = It will be interesting to see how that works in practice. >=20 >> 19:05:00.171029 IP6 (hlim 255, next-header ICMPv6 (58) payload = length: 16) fe80::aa60:b6ff:fe1d:8dbc > ff02::2: [icmp6 sum ok] ICMP6, = router solicitation, length 16 >> source link-address option (1), length 8 (1): = a8:60:b6:1d:8d:bc >=20 > The device will use SLAAC for address configuration, but do not want = to wait > for the next Router Advertisement, so it asks for an immediate = response from > the router. But it uses the link-local address that has not been checked. Thats not = in accordance with at least one of the RFCs. Unless, there is a = replacement section in some other RFC. Right now, the RFC situation is = a colossal mess. The "requirements" are distributed through numerous = RFCs, notes, etc. They contradict each other often, and they claim to = replace sections of others. It is quite difficult to keep up with the = current thinking. >=20 >> 19:05:04.198640 IP6 (hlim 255, next-header ICMPv6 (58) payload = length: 16) fe80::aa60:b6ff:fe1d:8dbc > ff02::2: [icmp6 sum ok] ICMP6, = router solicitation, length 16 >> source link-address option (1), length 8 (1): = a8:60:b6:1d:8d:bc >=20 > No router answered, maybe the packet was lost. So the device ask again = for a > router in order to complete SLAAC. Then that probably was not a DAD packet. There was no "router" on the = network. Both devices were configured as hosts. >=20 >> 19:05:08.449844 IP6 (hlim 255, next-header ICMPv6 (58) payload = length: 16) fe80::aa60:b6ff:fe1d:8dbc > ff02::2: [icmp6 sum ok] ICMP6, = router solicitation, length 16 >> source link-address option (1), length 8 (1): = a8:60:b6:1d:8d:bc >=20 > No router answered, maybe the packet was lost. So the device ask again = for a > router in order to complete SLAAC. From owner-freebsd-net@freebsd.org Wed Mar 17 06:35:28 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 35B5C57BEB0 for ; Wed, 17 Mar 2021 06:35:28 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 4F0gQ80rpjz4k4d for ; Wed, 17 Mar 2021 06:35:28 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 1B6FF57BEAF; Wed, 17 Mar 2021 06:35:28 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 1B37C57BAE0 for ; Wed, 17 Mar 2021 06:35:28 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4F0gQ80CD1z4kD1 for ; Wed, 17 Mar 2021 06:35:28 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id EDB5D1D5B for ; Wed, 17 Mar 2021 06:35:27 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 12H6ZRTu051148 for ; Wed, 17 Mar 2021 06:35:27 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 12H6ZRUr051147 for net@FreeBSD.org; Wed, 17 Mar 2021 06:35:27 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 254244] panics after upgrade to stable/13-n244861-b9773574371 Date: Wed, 17 Mar 2021 06:35:27 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-STABLE X-Bugzilla-Keywords: panic, regression X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: zarychtam@plan-b.pwste.edu.pl X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: net@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 17 Mar 2021 06:35:28 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D254244 --- Comment #23 from Marek Zarychta --- (In reply to Hans Petter Selasky from comment #22) I am not willing to disclose it here, will send in the message. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-net@freebsd.org Wed Mar 17 08:20:58 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 4DD8F57E737 for ; Wed, 17 Mar 2021 08:20:58 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 4F0jlt1Jnmz4qwV for ; Wed, 17 Mar 2021 08:20:58 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 2CC5F57E736; Wed, 17 Mar 2021 08:20:58 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 2C65857E2FC for ; Wed, 17 Mar 2021 08:20:58 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4F0jlt0TMFz4qyS for ; Wed, 17 Mar 2021 08:20:58 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 01EC12FE6 for ; Wed, 17 Mar 2021 08:20:58 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 12H8KvjQ007258 for ; Wed, 17 Mar 2021 08:20:57 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 12H8KvhY007257 for net@FreeBSD.org; Wed, 17 Mar 2021 08:20:57 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 254303] Fatal trap 12: page fault while in kernel mode ((frr 7.5_1 + Freebsd 13 Beta3) zebra crashes server when routes are populated) Date: Wed, 17 Mar 2021 08:20:58 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: Unspecified X-Bugzilla-Keywords: panic X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: zarychtam@plan-b.pwste.edu.pl X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: net@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 17 Mar 2021 08:20:58 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D254303 --- Comment #4 from Marek Zarychta --- (In reply to Aleks from comment #3) If you can build a custom kernel with "options FIB_ALGO", install it and a= fter reboot load the module dpdk_lpm4 (and dpdk_lpm6 if appropriate), then plea= se give it a try. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-net@freebsd.org Wed Mar 17 11:26:45 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 028D55AAD7D for ; Wed, 17 Mar 2021 11:26:45 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 4F0ntD6Txvz3NMV for ; Wed, 17 Mar 2021 11:26:44 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id DCEAC5AAD7B; Wed, 17 Mar 2021 11:26:44 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id DCB285AB094 for ; Wed, 17 Mar 2021 11:26:44 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4F0ntD5q1Cz3N1Q for ; Wed, 17 Mar 2021 11:26:44 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id BABAA5CC3 for ; Wed, 17 Mar 2021 11:26:44 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 12HBQiuQ002593 for ; Wed, 17 Mar 2021 11:26:44 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 12HBQi04002592 for net@FreeBSD.org; Wed, 17 Mar 2021 11:26:44 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 254309] [tcp] frequent panics in tcp_output Date: Wed, 17 Mar 2021 11:26:45 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-STABLE X-Bugzilla-Keywords: panic X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: rozhuk.im@gmail.com X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: net@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 17 Mar 2021 11:26:45 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D254309 --- Comment #8 from rozhuk.im@gmail.com --- I try kernel without: options RATELIMIT #o TX rate limiting support options TCP_OFFLOAD #o TCP offload options TCP_BLACKBOX #o Enhanced TCP event logging options TCP_HHOOK #o hhook(9) framework for TCP options TCP_RFC7413 #o Server-side implementation of TCP Fast Open (TFO) [RFC7413] options TCP_RFC7413_MAX_KEYS=3D2 #o=20 options TCPHPTS #o high precision timer system for = tcp. not help. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-net@freebsd.org Wed Mar 17 12:01:06 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 535D25ABF4A for ; Wed, 17 Mar 2021 12:01:06 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 4F0pdt1LS9z3QGs for ; Wed, 17 Mar 2021 12:01:06 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 2DF435AC21C; Wed, 17 Mar 2021 12:01:06 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 2DB215AC0AC for ; Wed, 17 Mar 2021 12:01:06 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4F0pdt0QNlz3QKJ for ; Wed, 17 Mar 2021 12:01:06 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id EF96B6517 for ; Wed, 17 Mar 2021 12:01:05 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 12HC15q9020701 for ; Wed, 17 Mar 2021 12:01:05 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 12HC15Qq020700 for net@FreeBSD.org; Wed, 17 Mar 2021 12:01:05 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 254303] Fatal trap 12: page fault while in kernel mode ((frr 7.5_1 + Freebsd 13 Beta3) zebra crashes server when routes are populated) Date: Wed, 17 Mar 2021 12:01:05 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: Unspecified X-Bugzilla-Keywords: panic X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: a.ivanov@veesp.com X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: net@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 17 Mar 2021 12:01:06 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D254303 --- Comment #5 from Aleks --- (In reply to Marek Zarychta from comment #4) So, I took kernel src from https://download.freebsd.org/ftp/releases/amd64/13.0-RC2/src.txz Build with "options FIB_ALGO" FreeBSD 13.0-RC2 FreeBSD 13.0-RC2 #0: Wed Mar 17 13:23:47 EET 2021=20=20=20= =20 :/usr/obj/usr/src/amd64.amd64/sys/CUSTOM amd64 Disabled FRR autostart and rebooted the server. After reboot I've set multipath=3D1 and loaded dpdk_lpm4/6, and after that started FRR. [fib_algo] inet.0 (bsearch4#13) rebuild_fd: switching algo to radix4_lockle= ss [fib_algo] fib_module_register: attaching dpdk_lpm4 to inet [fib_algo] fib_module_register: attaching dpdk_lpm6 to inet6 [fib_algo] inet.0 (radix4_lockless#114) rebuild_fd: switching algo to dpdk_= lpm4 After bringing up second BGP FullView session servers still crashed. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-net@freebsd.org Wed Mar 17 12:09:20 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id B5E565AC922 for ; Wed, 17 Mar 2021 12:09:20 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 4F0pqN4TSHz3RCc for ; Wed, 17 Mar 2021 12:09:20 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 96D565AC744; Wed, 17 Mar 2021 12:09:20 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 9490C5AC921 for ; Wed, 17 Mar 2021 12:09:20 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4F0pqN3YJSz3R0x for ; Wed, 17 Mar 2021 12:09:20 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 698CD66BA for ; Wed, 17 Mar 2021 12:09:20 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 12HC9KXi022897 for ; Wed, 17 Mar 2021 12:09:20 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 12HC9KaI022896 for net@FreeBSD.org; Wed, 17 Mar 2021 12:09:20 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 254309] [tcp] frequent panics in tcp_output Date: Wed, 17 Mar 2021 12:09:20 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-STABLE X-Bugzilla-Keywords: panic X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: hselasky@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: net@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 17 Mar 2021 12:09:20 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D254309 Hans Petter Selasky changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |hselasky@FreeBSD.org --- Comment #9 from Hans Petter Selasky --- Hi, Try to set: sysctl net.inet.tcp.sack.enable=3D0 For now. --HPS --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-net@freebsd.org Wed Mar 17 13:52:30 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 65E4B568882 for ; Wed, 17 Mar 2021 13:52:30 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 4F0s6Q2HdTz3qnb for ; Wed, 17 Mar 2021 13:52:30 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 4E8FB5687DC; Wed, 17 Mar 2021 13:52:30 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 4E556568802 for ; Wed, 17 Mar 2021 13:52:30 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4F0s6Q1cJ4z3qWG for ; Wed, 17 Mar 2021 13:52:30 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 2A5B57DA3 for ; Wed, 17 Mar 2021 13:52:30 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 12HDqUf9079506 for ; Wed, 17 Mar 2021 13:52:30 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 12HDqUmX079490 for net@FreeBSD.org; Wed, 17 Mar 2021 13:52:30 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 254333] [tcp] sysctl net.inet.tcp.hostcache.list hangs Date: Wed, 17 Mar 2021 13:52:30 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.4-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: tuexen@freebsd.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: net@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 17 Mar 2021 13:52:30 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D254333 --- Comment #1 from Michael Tuexen --- What is the output of procstat -kk PID, where PID is the PID of a hanging sysctl process? --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-net@freebsd.org Wed Mar 17 15:05:36 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id D94FF56BD6C for ; Wed, 17 Mar 2021 15:05:36 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 4F0tkm5bNNz4Vfc for ; Wed, 17 Mar 2021 15:05:36 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id BFD1956BE73; Wed, 17 Mar 2021 15:05:36 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id BF8C356BE71 for ; Wed, 17 Mar 2021 15:05:36 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4F0tkm50MDz4VXN for ; Wed, 17 Mar 2021 15:05:36 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 9AB3610BE8 for ; Wed, 17 Mar 2021 15:05:36 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 12HF5aK7016167 for ; Wed, 17 Mar 2021 15:05:36 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 12HF5afu016166 for net@FreeBSD.org; Wed, 17 Mar 2021 15:05:36 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 254309] [tcp] frequent panics in tcp_output Date: Wed, 17 Mar 2021 15:05:36 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-STABLE X-Bugzilla-Keywords: panic X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: rscheff@freebsd.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: net@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 17 Mar 2021 15:05:36 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D254309 Richard Scheffenegger changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |rscheff@freebsd.org --- Comment #10 from Richard Scheffenegger --- Better, disable net.inet.tcp.rfc6675_pipe=3D0 while retaining SACK. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-net@freebsd.org Wed Mar 17 15:30:16 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 703FD56CA5B for ; Wed, 17 Mar 2021 15:30:16 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 4F0vHD2Z3Hz4Xnw for ; Wed, 17 Mar 2021 15:30:16 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 5802856CD64; Wed, 17 Mar 2021 15:30:16 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 57CDB56CA5A for ; Wed, 17 Mar 2021 15:30:16 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4F0vHD1xDKz4XgZ for ; Wed, 17 Mar 2021 15:30:16 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 34A5B11580 for ; Wed, 17 Mar 2021 15:30:16 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 12HFUGxw027946 for ; Wed, 17 Mar 2021 15:30:16 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 12HFUGrD027945 for net@FreeBSD.org; Wed, 17 Mar 2021 15:30:16 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 254309] [tcp] frequent panics in tcp_output Date: Wed, 17 Mar 2021 15:30:16 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-STABLE X-Bugzilla-Keywords: panic X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: rscheff@freebsd.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: rscheff@freebsd.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: assigned_to bug_status Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 17 Mar 2021 15:30:16 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D254309 Richard Scheffenegger changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|net@FreeBSD.org |rscheff@freebsd.org Status|New |In Progress --- Comment #11 from Richard Scheffenegger --- See https://reviews.freebsd.org/D29315=20 flags =3D 17 -> 0x11, 0x10 is TF_SENTFIN, TF_ACKNOW and 6675pipe is enabled, enabling the new rescue-retransmission. Further, this is stated to be a web server, where it is likely that http/1.0 tcp sessions are closed right after an object was sent, and if the very last segment with the FIN is dropped by the network, the rescue retransmission c= ode tried to include the "data byte" of the FIN (which doesn't exist really, on= ly as the last octet in the sequence space stream). --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-net@freebsd.org Wed Mar 17 15:41:35 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 1E60256D60E for ; Wed, 17 Mar 2021 15:41:35 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 4F0vXH0BT7z4Yp8 for ; Wed, 17 Mar 2021 15:41:35 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 0657256D457; Wed, 17 Mar 2021 15:41:35 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 0608556D3E4 for ; Wed, 17 Mar 2021 15:41:35 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4F0vXG6hrDz4YrL for ; Wed, 17 Mar 2021 15:41:34 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id D9261117AC for ; Wed, 17 Mar 2021 15:41:34 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 12HFfYBM034767 for ; Wed, 17 Mar 2021 15:41:34 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 12HFfYNb034766 for net@FreeBSD.org; Wed, 17 Mar 2021 15:41:34 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 254244] panics after upgrade to stable/13-n244861-b9773574371 Date: Wed, 17 Mar 2021 15:41:35 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-STABLE X-Bugzilla-Keywords: panic, regression X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: rscheff@freebsd.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: net@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 17 Mar 2021 15:41:35 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D254244 Richard Scheffenegger changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |rscheff@freebsd.org --- Comment #24 from Richard Scheffenegger --- The tp->t_flags in the BT mentioned earlier here decodes to 6130 03F4 TF_NODELAY TF_SENTFIN TF_REQSCALE TF_RCVDSCALE TF_REQ_TSTMP TF_RCVD_TSTMP TF_SACK_PERMIT TF_FASTRECOVERY TF_WASFRECOVERY TF_TSO TF_CONGRECOVERY TF_WASCRECOVERY Is net.inet.tcp.rfc6675_pipe enabled? If yes, see https://reviews.freebsd.org/D29315 --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-net@freebsd.org Wed Mar 17 15:48:19 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id C937056DB01 for ; Wed, 17 Mar 2021 15:48:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 4F0vh34fHbz4ZML for ; Wed, 17 Mar 2021 15:48:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 97F9F56DB00; Wed, 17 Mar 2021 15:48:19 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 97B3156D8AA for ; Wed, 17 Mar 2021 15:48:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4F0vh10fsHz4ZQx for ; Wed, 17 Mar 2021 15:48:14 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id C49F71174F for ; Wed, 17 Mar 2021 15:48:13 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 12HFmDwq036304 for ; Wed, 17 Mar 2021 15:48:13 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 12HFmDvU036303 for net@FreeBSD.org; Wed, 17 Mar 2021 15:48:13 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 250922] no packet received by ix(4) card when system booted Date: Wed, 17 Mar 2021 15:48:13 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 12.2-RELEASE X-Bugzilla-Keywords: IntelNetworking X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: sdalu@sdalu.com X-Bugzilla-Status: Closed X-Bugzilla-Resolution: Overcome By Events X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: net@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: resolution bug_status Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 17 Mar 2021 15:48:19 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D250922 St=C3=A9phane D'Alu changed: What |Removed |Added ---------------------------------------------------------------------------- Resolution|--- |Overcome By Events Status|New |Closed --- Comment #5 from St=C3=A9phane D'Alu --- Problem is not reproduced in 13.0-rc2 --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-net@freebsd.org Wed Mar 17 15:58:35 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 137E356E79F for ; Wed, 17 Mar 2021 15:58:35 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 4F0vvt6zcFz4c7f for ; Wed, 17 Mar 2021 15:58:34 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id EF91356E88E; Wed, 17 Mar 2021 15:58:34 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id EF55F56E65F for ; Wed, 17 Mar 2021 15:58:34 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4F0vvt6FLtz4c7c for ; Wed, 17 Mar 2021 15:58:34 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id C9686117FA for ; Wed, 17 Mar 2021 15:58:34 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 12HFwYhk042958 for ; Wed, 17 Mar 2021 15:58:34 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 12HFwYAi042957 for net@FreeBSD.org; Wed, 17 Mar 2021 15:58:34 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 254244] panics after upgrade to stable/13-n244861-b9773574371 Date: Wed, 17 Mar 2021 15:58:34 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-STABLE X-Bugzilla-Keywords: panic, regression X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: zarychtam@plan-b.pwste.edu.pl X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: net@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 17 Mar 2021 15:58:35 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D254244 --- Comment #25 from Marek Zarychta --- (In reply to Richard Scheffenegger from comment #24) Hans, Richard, thank you for the deep insight into this. Yes, net.inet.tcp.rfc6675_pipe=3D1 is set on this machine probably since ea= rly FreeBSD 11. The patch from D29315 was applied and the system rebooted with = the original sysctl settings (net.inet.tcp.sack.enable=3D1,net.inet.tcp.rfc6675_pipe1=3D1 ). --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-net@freebsd.org Wed Mar 17 16:05:41 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 7372456EF0C for ; Wed, 17 Mar 2021 16:05:41 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 4F0w452Scjz4dBf for ; Wed, 17 Mar 2021 16:05:41 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 5470056EE4A; Wed, 17 Mar 2021 16:05:41 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 5437156EB4D for ; Wed, 17 Mar 2021 16:05:41 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4F0w451kWNz4dBd for ; Wed, 17 Mar 2021 16:05:41 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 2EB3611A43 for ; Wed, 17 Mar 2021 16:05:41 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 12HG5fco046964 for ; Wed, 17 Mar 2021 16:05:41 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 12HG5f1L046963 for net@FreeBSD.org; Wed, 17 Mar 2021 16:05:41 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 254244] panics after upgrade to stable/13-n244861-b9773574371 Date: Wed, 17 Mar 2021 16:05:40 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-STABLE X-Bugzilla-Keywords: panic, regression X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: rscheff@freebsd.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: net@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 17 Mar 2021 16:05:41 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D254244 --- Comment #26 from Richard Scheffenegger --- Not so sure if this really is due to Rescue Retransmissions;=20 The linked dump ( http://freebsd.1045724.x6.nabble.com/13-0-CURRENT-r368448-panic-td6443146.h= tml ) is from Jan 20, but SACK rescue retransmission was only checked in to stable/13 on March 2 with=20 https://reviews.freebsd.org/R10:15a7c88058d419e3347673ab891ae77ba28ae1bd. So there might be more to this here? --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-net@freebsd.org Wed Mar 17 16:44:19 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 3534E570542 for ; Wed, 17 Mar 2021 16:44:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 4F0wwf3SJSz4hQX for ; Wed, 17 Mar 2021 16:44:18 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 528D05705B3; Wed, 17 Mar 2021 16:44:18 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 4DF9F57037D for ; Wed, 17 Mar 2021 16:44:18 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4F0wwd1VCCz4hbZ for ; Wed, 17 Mar 2021 16:44:16 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id C7C2E11E7F for ; Wed, 17 Mar 2021 16:44:15 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 12HGiFbS069731 for ; Wed, 17 Mar 2021 16:44:15 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 12HGiFmk069730 for net@FreeBSD.org; Wed, 17 Mar 2021 16:44:15 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 254244] panics after upgrade to stable/13-n244861-b9773574371 Date: Wed, 17 Mar 2021 16:44:15 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-STABLE X-Bugzilla-Keywords: panic, regression X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: commit-hook@FreeBSD.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: net@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 17 Mar 2021 16:44:19 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D254244 --- Comment #27 from commit-hook@FreeBSD.org --- A commit in branch main references this bug: URL: https://cgit.FreeBSD.org/src/commit/?id=3De9f029831fa5747ae1b405f5716c52cb4= ebf1e04 commit e9f029831fa5747ae1b405f5716c52cb4ebf1e04 Author: Richard Scheffenegger AuthorDate: 2021-03-17 15:44:29 +0000 Commit: Richard Scheffenegger CommitDate: 2021-03-17 16:12:04 +0000 fix panic when rescue retransmission and FIN overlap PR: 254244 PR: 254309 Reviewed By: #transport, hselasky, tuexen MFC after: 3 days Sponsored By: NetApp, Inc. Differential Revision: https://reviews.freebsd.org/D29315 sys/netinet/tcp_sack.c | 14 ++++++++++++-- 1 file changed, 12 insertions(+), 2 deletions(-) --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-net@freebsd.org Wed Mar 17 17:17:57 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id A5F5E5712D8 for ; Wed, 17 Mar 2021 17:17:57 +0000 (UTC) (envelope-from jbreitman@tildenparkcapital.com) Received: from us-smtp-delivery-145.mimecast.com (us-smtp-delivery-145.mimecast.com [216.205.24.145]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-SHA384 (256/256 bits)) (Client CN "*.mimecast.com", Issuer "DigiCert TLS RSA SHA256 2020 CA1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4F0xgS4NmYz4lD6 for ; Wed, 17 Mar 2021 17:17:56 +0000 (UTC) (envelope-from jbreitman@tildenparkcapital.com) Received: from zmcc-3-mta-2.zmailcloud.com (zmcc-3-mta-2.zmailcloud.com [35.238.170.66]) (Using TLS) by relay.mimecast.com with ESMTP id us-mta-465-sGD8Mj3cONu-kHD97twkig-1; Wed, 17 Mar 2021 13:17:53 -0400 X-MC-Unique: sGD8Mj3cONu-kHD97twkig-1 Received: from zmcc-3-mta-2.zmailcloud.com (localhost [127.0.0.1]) by zmcc-3-mta-2.zmailcloud.com (Postfix) with ESMTPS id 166CAE0E18 for ; Wed, 17 Mar 2021 12:17:53 -0500 (CDT) Received: from localhost (localhost [127.0.0.1]) by zmcc-3-mta-2.zmailcloud.com (Postfix) with ESMTP id 087CFE0E07 for ; Wed, 17 Mar 2021 12:17:53 -0500 (CDT) X-Virus-Scanned: amavisd-new at zmcc-3-mta-2.zmailcloud.com Received: from zmcc-3-mta-2.zmailcloud.com ([127.0.0.1]) by localhost (zmcc-3-mta-2.zmailcloud.com [127.0.0.1]) (amavisd-new, port 10026) with ESMTP id kAvn3S2H6QBc for ; Wed, 17 Mar 2021 12:17:52 -0500 (CDT) Received: from jbreitman-mac.zxcvm.com (unknown [72.22.182.150]) by zmcc-3-mta-2.zmailcloud.com (Postfix) with ESMTPSA id CA246E0D63 for ; Wed, 17 Mar 2021 12:17:52 -0500 (CDT) From: Jason Breitman Mime-Version: 1.0 (Mac OS X Mail 13.4 \(3608.120.23.2.4\)) Subject: NFS Mount Hangs Date: Wed, 17 Mar 2021 13:17:52 -0400 References: <3750001D-3F1C-4D9A-A9D9-98BCA6CA65A4@tildenparkcapital.com> To: freebsd-net@freebsd.org In-Reply-To: <3750001D-3F1C-4D9A-A9D9-98BCA6CA65A4@tildenparkcapital.com> Message-Id: <33693DE3-7FF8-4FAB-9A75-75576B88A566@tildenparkcapital.com> X-Mailer: Apple Mail (2.3608.120.23.2.4) X-Mimecast-Spam-Score: 0 X-Mimecast-Originator: tildenparkcapital.com Content-Type: text/plain; charset=WINDOWS-1252 Content-Transfer-Encoding: quoted-printable X-Rspamd-Queue-Id: 4F0xgS4NmYz4lD6 X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of jbreitman@tildenparkcapital.com designates 216.205.24.145 as permitted sender) smtp.mailfrom=jbreitman@tildenparkcapital.com X-Spamd-Result: default: False [-2.90 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; RWL_MAILSPIKE_VERYGOOD(0.00)[216.205.24.145:from]; RCVD_COUNT_FIVE(0.00)[6]; MID_RHS_MATCH_FROM(0.00)[]; FROM_HAS_DN(0.00)[]; MV_CASE(0.50)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-net@freebsd.org]; TO_DN_NONE(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_LONG(-1.00)[-1.000]; ARC_NA(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:216.205.24.0/24]; NEURAL_HAM_SHORT(-1.00)[-1.000]; DMARC_NA(0.00)[tildenparkcapital.com: no valid DMARC record]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:30031, ipnet:216.205.24.0/24, country:US]; RCVD_TLS_LAST(0.00)[]; MAILMAN_DEST(0.00)[freebsd-net]; RCVD_IN_DNSWL_LOW(-0.10)[216.205.24.145:from] X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 17 Mar 2021 17:17:57 -0000 Please review the details below and let me know if there is a setting that = I should apply to my FreeBSD NFS Server or if there is a bug fix that I can= apply to resolve my issue. I shared this information with the linux-nfs mailing list and they believe = the issue is on the server side. Issue NFSv4 mounts periodically hang on the NFS Client. During this time, it is possible to manually mount from another NFS Server = on the NFS Client having issues. Also, other NFS Clients are successfully mounting from the NFS Server in qu= estion. Rebooting the NFS Client appears to be the only solution. Environment NFS Server OS: FreeBSD 12.1-RELEASE-p5 NFS Client OS: =09=09Debian Buster 10.8 Kernel:=094.19.171-2 Protocol:=09NFSv4 with Kerberos Security Mount Options:=09nfs-server.domain.com:/data=09/mnt/data=09nfs4=09lookupcac= he=3Dpos,noresvport,sec=3Dkrb5,hard,rsize=3D1048576,wsize=3D1048576=0900 Output from the NFS Client when the issue occurs # netstat -an | grep NFS.Server.IP.X tcp 0 0 NFS.Client.IP.X:46896 NFS.Server.IP.X:2049 F= IN_WAIT2 # cat /sys/kernel/debug/sunrpc/rpc_xprt/*/info netid: tcp addr: NFS.Server.IP.X port: 2049 state: 0x51=20 syslog Mar 4 10:29:27 hostname kernel: [437414.131978] -pid- flgs status -client-= --rqstp- -timeout ---ops-- Mar 4 10:29:27 hostname kernel: [437414.133158] 57419 40a1 0 9b723c73= 143cfadf 30000 4ca953b5 nfsv4 OPEN_NOATTR a:call_connect_status [sunrpc= ] q:xprt_pending Mar 4 10:29:27 hostname kernel: [437414.135211] 57420 4081 -11 9b723c73= (null) 0 4ca953b5 nfsv4 OPEN_NOATTR a:call_reserveresult [sunrpc]= q:xprt_sending Mar 4 10:29:27 hostname kernel: [437414.137250] 57421 4081 -11 9b723c73= (null) 0 4ca953b5 nfsv4 OPEN_NOATTR a:call_reserveresult [sunrpc]= q:xprt_sending Mar 4 10:29:27 hostname kernel: [437414.139345] 57422 4081 -11 9b723c73= (null) 0 4ca953b5 nfsv4 OPEN_NOATTR a:call_reserveresult [sunrpc]= q:xprt_sending Mar 4 10:29:27 hostname kernel: [437414.141496] 57423 4081 -11 9b723c73= (null) 0 4ca953b5 nfsv4 OPEN_NOATTR a:call_reserveresult [sunrpc]= q:xprt_sending Mar 4 10:29:27 hostname kernel: [437414.143712] 57424 4081 -11 9b723c73= (null) 0 4ca953b5 nfsv4 OPEN_NOATTR a:call_reserveresult [sunrpc]= q:xprt_sending Mar 4 10:29:27 hostname kernel: [437414.145940] 57425 4081 -11 9b723c73= (null) 0 4ca953b5 nfsv4 OPEN_NOATTR a:call_reserveresult [sunrpc]= q:xprt_sending Mar 4 10:29:27 hostname kernel: [437414.148227] 57426 4081 -11 9b723c73= (null) 0 4ca953b5 nfsv4 OPEN_NOATTR a:call_reserveresult [sunrpc]= q:xprt_sending Mar 4 10:29:27 hostname kernel: [437414.150575] 57427 4081 -11 9b723c73= (null) 0 4ca953b5 nfsv4 OPEN_NOATTR a:call_reserveresult [sunrpc]= q:xprt_sending Mar 4 10:29:27 hostname kernel: [437414.152938] 57428 4080 -11 9b723c73= (null) 0 fb0400d nfsv4 LOOKUP a:call_reserveresult [sunrpc] q:xp= rt_sending Mar 4 10:29:27 hostname kernel: [437414.154478] 57433 4080 -11 27bf33c1= (null) 0 fb0400d nfsv4 GETATTR a:call_reserveresult [sunrpc] q:x= prt_sending Mar 4 10:29:27 hostname kernel: [437414.156023] 57434 4080 -11 27bf33c1= (null) 0 fb0400d nfsv4 GETATTR a:call_reserveresult [sunrpc] q:x= prt_sending Mar 4 10:29:27 hostname kernel: [437414.157549] 57435 4080 -11 27bf33c1= (null) 0 fb0400d nfsv4 GETATTR a:call_reserveresult [sunrpc] q:x= prt_sending Mar 4 10:29:27 hostname kernel: [437414.159073] 57436 4080 -11 27bf33c1= (null) 0 fb0400d nfsv4 GETATTR a:call_reserveresult [sunrpc] q:x= prt_sending Mar 4 10:29:27 hostname kernel: [437414.160587] 57437 4080 -11 27bf33c1= (null) 0 fb0400d nfsv4 GETATTR a:call_reserveresult [sunrpc] q:x= prt_sending Mar 4 10:29:27 hostname kernel: [437414.162094] 57438 4080 -11 27bf33c1= (null) 0 fb0400d nfsv4 GETATTR a:call_reserveresult [sunrpc] q:x= prt_sending Mar 4 10:29:27 hostname kernel: [437414.163597] 57431 4080 -11 3118865a= (null) 0 fb0400d nfsv4 GETATTR a:call_reserveresult [sunrpc] q:x= prt_sending Mar 4 10:29:27 hostname kernel: [437414.165100] 57432 4080 -11 3118865a= (null) 0 fb0400d nfsv4 GETATTR a:call_reserveresult [sunrpc] q:x= prt_sending Mar 4 10:29:27 hostname kernel: [437414.166598] 57439 4080 -11 3118865a= (null) 0 fb0400d nfsv4 GETATTR a:call_reserveresult [sunrpc] q:x= prt_sending Mar 4 10:29:27 hostname kernel: [437414.168088] 57440 4080 -11 3118865a= (null) 0 fb0400d nfsv4 GETATTR a:call_reserveresult [sunrpc] q:x= prt_sending Mar 4 10:29:27 hostname kernel: [437414.169573] 57441 4080 -11 3118865a= (null) 0 fb0400d nfsv4 GETATTR a:call_reserveresult [sunrpc] q:x= prt_sending Mar 4 10:29:27 hostname kernel: [437414.171058] 57442 4080 -11 3118865a= (null) 0 fb0400d nfsv4 GETATTR a:call_reserveresult [sunrpc] q:x= prt_sending Mar 4 10:29:27 hostname kernel: [437414.172532] 57443 4080 -11 3118865a= (null) 0 fb0400d nfsv4 GETATTR a:call_reserveresult [sunrpc] q:x= prt_sending Mar 4 10:29:27 hostname kernel: [437414.173991] 57444 4080 -11 3118865a= (null) 0 fb0400d nfsv4 GETATTR a:call_reserveresult [sunrpc] q:x= prt_sending Mar 4 10:29:27 hostname kernel: [437414.175452] 57445 4080 -11 3118865a= (null) 0 fb0400d nfsv4 GETATTR a:call_reserveresult [sunrpc] q:x= prt_sending Mar 4 10:29:27 hostname kernel: [437414.176906] 57446 4080 -11 3118865a= (null) 0 fb0400d nfsv4 GETATTR a:call_reserveresult [sunrpc] q:x= prt_sending Mar 4 10:29:27 hostname kernel: [437414.178349] 57447 4080 -11 3118865a= (null) 0 fb0400d nfsv4 GETATTR a:call_reserveresult [sunrpc] q:x= prt_sending Mar 4 10:29:27 hostname kernel: [437414.179792] 57448 4080 -11 3118865a= (null) 0 fb0400d nfsv4 GETATTR a:call_reserveresult [sunrpc] q:x= prt_sending Mar 4 10:29:27 hostname kernel: [437414.181227] 57449 4080 -11 3118865a= (null) 0 fb0400d nfsv4 GETATTR a:call_reserveresult [sunrpc] q:x= prt_sending Mar 4 10:29:27 hostname kernel: [437414.182655] 57450 4080 -11 3118865a= (null) 0 fb0400d nfsv4 GETATTR a:call_reserveresult [sunrpc] q:x= prt_sending Mar 4 10:29:27 hostname kernel: [437414.184081] 57451 4080 -11 3118865a= (null) 0 fb0400d nfsv4 GETATTR a:call_reserveresult [sunrpc] q:x= prt_sending Mar 4 10:29:27 hostname kernel: [437414.185494] 57418 4880 -11 d42d6144= ab8b1696 0 fb0400d nfsv4 STATFS a:call_connect_status [sunrpc] q:x= prt_sending Mar 4 10:29:27 hostname kernel: [437414.186905] 57430 4080 -11 d42d6144= (null) 0 fb0400d nfsv4 STATFS a:call_reserveresult [sunrpc] q:xp= rt_sending Mar 4 10:29:27 hostname kernel: [437414.188310] 57429 5281 -11 907fb25c= (null) 0 5fa6554c nfsv4 SEQUENCE a:call_reserveresult [sunrpc] q:= xprt_sending Mar 4 10:29:30 hostname kernel: [437417.110517] RPC: 57419 xprt_connect_st= atus: connect attempt timed out Mar 4 10:29:30 hostname kernel: [437417.112172] RPC: 57419 call_connect_st= atus (status -110) Mar 4 10:29:30 hostname kernel: [437417.113337] RPC: 57419 call_timeout (m= ajor) Mar 4 10:29:30 hostname kernel: [437417.114385] RPC: 57419 call_bind (stat= us 0) Mar 4 10:29:30 hostname kernel: [437417.115402] RPC: 57419 call_connect xp= rt 00000000e061831b is not connected Mar 4 10:29:30 hostname kernel: [437417.116547] RPC: 57419 xprt_connect xp= rt 00000000e061831b is not connected Mar 4 10:30:31 hostname kernel: [437478.551090] RPC: 57419 xprt_connect_st= atus: connect attempt timed out Mar 4 10:30:31 hostname kernel: [437478.552396] RPC: 57419 call_connect_st= atus (status -110) Mar 4 10:30:31 hostname kernel: [437478.553417] RPC: 57419 call_timeout (m= inor) Mar 4 10:30:31 hostname kernel: [437478.554327] RPC: 57419 call_bind (stat= us 0) Mar 4 10:30:31 hostname kernel: [437478.555220] RPC: 57419 call_connect xp= rt 00000000e061831b is not connected Mar 4 10:30:31 hostname kernel: [437478.556254] RPC: 57419 xprt_connect xp= rt 00000000e061831b is not connected Jason Breitman From owner-freebsd-net@freebsd.org Wed Mar 17 19:33:57 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 5A99D57670A for ; Wed, 17 Mar 2021 19:33:57 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 4F10hP1kD3z3Db7 for ; Wed, 17 Mar 2021 19:33:57 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 397F65764AD; Wed, 17 Mar 2021 19:33:57 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 38E23576631 for ; Wed, 17 Mar 2021 19:33:57 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4F10hP0bZ5z3DhB for ; Wed, 17 Mar 2021 19:33:57 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 0572C14B00 for ; Wed, 17 Mar 2021 19:33:57 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 12HJXuMF061387 for ; Wed, 17 Mar 2021 19:33:56 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 12HJXumg061386 for net@FreeBSD.org; Wed, 17 Mar 2021 19:33:56 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 254244] panics after upgrade to stable/13-n244861-b9773574371 Date: Wed, 17 Mar 2021 19:33:57 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-STABLE X-Bugzilla-Keywords: panic, regression X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: commit-hook@FreeBSD.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: net@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 17 Mar 2021 19:33:57 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D254244 --- Comment #28 from commit-hook@FreeBSD.org --- A commit in branch stable/13 references this bug: URL: https://cgit.FreeBSD.org/src/commit/?id=3D703419774f86525a2441d615733993a6f= ddcd047 commit 703419774f86525a2441d615733993a6fddcd047 Author: Richard Scheffenegger AuthorDate: 2021-03-17 15:44:29 +0000 Commit: Richard Scheffenegger CommitDate: 2021-03-17 19:05:33 +0000 fix panic when rescue retransmission and FIN overlap PR: 254244 PR: 254309 Reviewed By: #transport, hselasky, tuexen Approved by: re (cperciva) MFC after: immediately Sponsored By: NetApp, Inc. Differential Revision: https://reviews.freebsd.org/D29315 (cherry picked from commit e9f029831fa5747ae1b405f5716c52cb4ebf1e04) sys/netinet/tcp_sack.c | 14 ++++++++++++-- 1 file changed, 12 insertions(+), 2 deletions(-) --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-net@freebsd.org Wed Mar 17 21:37:24 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 38512579657 for ; Wed, 17 Mar 2021 21:37:24 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) Received: from CAN01-QB1-obe.outbound.protection.outlook.com (mail-qb1can01on0620.outbound.protection.outlook.com [IPv6:2a01:111:f400:fe5c::620]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "DigiCert Cloud Services CA-1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4F13Qq31wBz3MXh for ; Wed, 17 Mar 2021 21:37:23 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=fiasquyav1BqWNDuyqRerc6vGkKuAj1UPH4wv5rm7nin2nqEepyfYKm7Gw2JZV6MXclJqzDK4kIuD8sKrwEKVxCMMnA/kvvge9Id2rmUQATKVb3KxGKQBTkggODA7SCmUM4Nq40es2hHxgOSFi2/j/sR1jv24HWkzUwH59ZUE5NEqLzfAU+4xsKWt1YORX/w17D6pkcPpB/yVvUGldQibymRdpH+bJwzzARP/cgdVQHS+xdvCnQ4qrbbI/hVvELuLH7eLeEU60Q7Kk3aLtzQnuMYJ6iCWyuW63GP9fQ0IpgsQpHiYisITEDai03DRFA+VKjDPa2twrT2Xo48REUJ9g== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=mJFShkCYwL5vmMg6nBSVfwkgucwpjzNXBju8+PQkaJQ=; b=BS8AhXXn4OrGCH5yKnGTpPZetlkUBZH/s2LPrYVQBA9GvDyiYjrbKOT5T5NmXeMAI25DtX6opMof8HoHs1HVI64AJaxJWMfNdRdLgrEwWe9UfTL6VJbkfgXtePLA76ljG/PLCrXXtmpEx0hwjOSSm37oRH/PKY1cbrdJuqUjRbFeaMjOTmUlYy1ymBiG78gFTPsffIkavrmzwp0izv/BbsnG6wT5UeNBGZdA6isNJoVRwehOj4OSn6MkYYiDgOKtVTUcsifrRhTk7gYEe6Qy+suWt9FvqiW09XlNhUGlsGbtq9wSl3t6Y6UdlojYe7hk9Tf/bsaQNHFH2DDcTygEEw== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=uoguelph.ca; dmarc=pass action=none header.from=uoguelph.ca; dkim=pass header.d=uoguelph.ca; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=uoguelph.ca; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=mJFShkCYwL5vmMg6nBSVfwkgucwpjzNXBju8+PQkaJQ=; b=KFVOdLm3XN0euuDkEjBJr1z2cwGHNLdsv3ulN03SSgmd0K/FMiI2uKlZqqjMs7sJKDYKvKL6MrVLTglwnxsOVAugEegqN3zr8CNEToYzMgNbpdiSAXmd50xI36k/d6QM7V6QZfT2xRm9Z5XDinHluWmqrjggaGBQPBgBFElZGFxbGOsC/ce3WmjX6qLxPUfpHUcYngEa3kuyVrNOp+ZtAO7t9Yx32IFReE5n7ODZzbrCPjgHOA/wUsy3fSilHt6h5FH5TXKQ62BqtO2VRXJ06zQXtFdx58Tm0jhL0RWtJhqRVtbRgZcrMxLUnXO4T3C8uTzgV1HcKO41owLG36GSKQ== Received: from YQXPR0101MB0968.CANPRD01.PROD.OUTLOOK.COM (2603:10b6:c00:19::29) by YQXPR01MB4359.CANPRD01.PROD.OUTLOOK.COM (2603:10b6:c01:7::22) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3933.32; Wed, 17 Mar 2021 21:37:20 +0000 Received: from YQXPR0101MB0968.CANPRD01.PROD.OUTLOOK.COM ([fe80::6073:6fc0:5ddf:dc8a]) by YQXPR0101MB0968.CANPRD01.PROD.OUTLOOK.COM ([fe80::6073:6fc0:5ddf:dc8a%7]) with mapi id 15.20.3933.032; Wed, 17 Mar 2021 21:37:20 +0000 From: Rick Macklem To: Jason Breitman , "freebsd-net@freebsd.org" Subject: Re: NFS Mount Hangs Thread-Topic: NFS Mount Hangs Thread-Index: AQHXG1G2D7AHBwtmAkS1jBAqNNo2I6qIqQ+S Date: Wed, 17 Mar 2021 21:37:20 +0000 Message-ID: References: <3750001D-3F1C-4D9A-A9D9-98BCA6CA65A4@tildenparkcapital.com>, <33693DE3-7FF8-4FAB-9A75-75576B88A566@tildenparkcapital.com> In-Reply-To: <33693DE3-7FF8-4FAB-9A75-75576B88A566@tildenparkcapital.com> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-ms-publictraffictype: Email x-ms-office365-filtering-correlation-id: 7f1e19ba-84fe-403b-e364-08d8e98cd865 x-ms-traffictypediagnostic: YQXPR01MB4359: x-microsoft-antispam-prvs: x-ms-oob-tlc-oobclassifiers: OLM:10000; x-ms-exchange-senderadcheck: 1 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: J5vjtmr6uHgcG3gzHj1kFBITVJ2JLYsn7uDHCc6QXEilLexc9BfMop6kZXfZN4vo/qeq8E6+6OI9Mfa+C85J5vfUs04NCBczJcd82hTod6DP8UjXryoHQM8kz8dFgG/RELsC+UsX++s5mGdF9svcS+sGQM1ZqCYhxS4io9QiI86MQjwcir+n4kkrItaIRVFDXq/5up9ghvR4l6BpkId2IrAju11LzjncdwOidNCUqqoSRlDKU1kTbwFvB4pfpFSECs84YLnQEIDLGr7BubhVCeH1pof7X4+ufODlBQMPe8rnrRCu5r+taz95YCdY2UJfdTl+1APxGUaHFXIMm8CoTcF8KHzyAZ37TH4+cj8ccZmXKxPfRR4rubxzRvMITBdJJzUwJss6lCuJ4b6Uk5z6ugXBTnDa9gt7kdGSMHEgJ8yD/iEjtH/Q64Sv3KItXNtAN0XVLgCdYyhfCX/WkhAJdrAWnRa0FCaqxUPigiuTKiKgBKXUjzzofkfr6zcYsmigfTN3XR1blA2TVOj4aGlWtRQtK/Nd9rSJAPXSK5c7Ul5uT7b+JVcUadcbxyXZic4UNuXOu5ivdlsZdxq2yhISCXB1yxpF6qgSIGZ8z/ZJYiI/hLWkwiWhp0ngwAwHIPYzP7W01xFAu7oHG+aNcmfpRg== x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:YQXPR0101MB0968.CANPRD01.PROD.OUTLOOK.COM; PTR:; CAT:NONE; SFS:(366004)(136003)(376002)(346002)(396003)(39860400002)(55016002)(64756008)(7116003)(316002)(9686003)(110136005)(186003)(478600001)(86362001)(33656002)(8676002)(3480700007)(966005)(66556008)(786003)(8936002)(71200400001)(91956017)(66476007)(5660300002)(66446008)(6506007)(83380400001)(2906002)(76116006)(52536014)(7696005)(66946007); DIR:OUT; SFP:1101; x-ms-exchange-antispam-messagedata: =?iso-8859-1?Q?o2J1RPtvzSjtnllnhbkUCsRsoyJzdEGm5EbdUwixBk25inR1qV6FCkxsy2?= =?iso-8859-1?Q?kKNjsI4t6tJ2tGhjjAz6R80jKp5gF4meB/L1X8GoIBF5JLSVc7m+Csfbhi?= =?iso-8859-1?Q?NxMcjkIgyLGW0lH0rrn4QiLaqLGKP4v4TgsMSuG2eiKu1qb5JswEpn+ldk?= =?iso-8859-1?Q?sp58oZCYbCOH+afbrqX+vAvDIurbLSPuvAIsXWr4eZxDPZDOYm4ZpNr4Tz?= =?iso-8859-1?Q?TPt6uJBad5itKVpSNq1/UNfNtMTyeU1fIehQOESGkGP8Lz9OQzxTy13o/m?= =?iso-8859-1?Q?A8+XpyohFA9cQrwXDjCY5uJy+IfmfCujACVORa8LTkjM86C4tC5IeUJdnc?= =?iso-8859-1?Q?a7OzUC9+zijIOi1Jvs1ysowxckUONAEq0oxOhrcRxGKVwu2orKaqxtpyne?= =?iso-8859-1?Q?1h9OpNbKwEmlWqAGoFLLyfMgf8X6qUIWmAlIG+ZReb3VUoSgzeeywE2jGp?= =?iso-8859-1?Q?ynpc2ycKlP58MMX6ala1LGoxEvIFh6zZzIoD1dXTGXCiJ7AkaMQEYMyylO?= =?iso-8859-1?Q?AkfFYimZI6TDA6OSvSvY5GwCXmiWlGEgdLQMFU4PXl782G7OiCHhp8t9rf?= =?iso-8859-1?Q?GywblaB2K14UJDjKa5ceR0xepPpnXjKP7UGiMNtpS12Xn9CqzsouCze1gK?= =?iso-8859-1?Q?h/rj3/fdItrG3WaB3HxADlHmeJoFI9OniXquTQ26XVbDIDM4Gxjz2f0oHe?= =?iso-8859-1?Q?s8Ott7xTzak+HAU+LgnkxSxvyaM+BKgmP1cUihI7HzMYsSahBLlmk0jY6D?= =?iso-8859-1?Q?ZG5en7Qud0mv1k2NNggUp1RdV27Es2klMxGGIDJhKnFdBMDud6kzYT+yMg?= =?iso-8859-1?Q?Cms7fzhlQnH51f5VrJDDN6fG22fWYq4MOIp/V+oqTf20CEW1h/xChuzXr8?= =?iso-8859-1?Q?j8pIJKTgWjqu7Y7f2uTfSSXo2hKij4UN5VNOjR1lbWT0C5EtxR+6Qv2fVH?= =?iso-8859-1?Q?CYpFaAmWXESVSJ+DBiglFcczvEIdWUagqg3YmZbMNKF5ladR2slIZe0bxn?= =?iso-8859-1?Q?sqO2GghCxOQhU1yErld+5vzsqy88FJo5k7Vz9EjIcgeoE6Xq//0KFpIfQQ?= =?iso-8859-1?Q?zYkUfG5HyJvU9eUggRCEqoc+9kIO85RwHrWEELe6qD3KMN7TN6lFEXzdZ5?= =?iso-8859-1?Q?FEHqNRNfXotZMG3ZuMZHYUS+LrK8+bpPQU7/fC8MbDa41amUFQoGVynMlh?= =?iso-8859-1?Q?DiqH8K5P1lVtWkPiBa8B4hnWYaiNxlO+6I5GCnT7B56HnYuwkR0iVxdNuM?= =?iso-8859-1?Q?rDccoEF3uTSou2BrEJ7xcPQjpBNOpRqiz5O9SsvQiu+cbbfbaQBRj7r4XR?= =?iso-8859-1?Q?9RRmhq1FrI4WjPAFUti0/NelTaTBbobsHS6xf4P9zTbvDjtzOngm+C1E17?= =?iso-8859-1?Q?8T1lnTtggu8Je9qzVVXy04PpmAONHfCeXFOljOFdyz5KLhXRikYHs=3D?= x-ms-exchange-transport-forked: True Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-OriginatorOrg: uoguelph.ca X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: YQXPR0101MB0968.CANPRD01.PROD.OUTLOOK.COM X-MS-Exchange-CrossTenant-Network-Message-Id: 7f1e19ba-84fe-403b-e364-08d8e98cd865 X-MS-Exchange-CrossTenant-originalarrivaltime: 17 Mar 2021 21:37:20.6235 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: be62a12b-2cad-49a1-a5fa-85f4f3156a7d X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: ps0AUfr+9bkJVYyiz8BpNDaYQLq6AobLGJRyE83zPWTJEA22KPvqApJE0nudKost/3W0KtDFjlxYR4f7soL0Fg== X-MS-Exchange-Transport-CrossTenantHeadersStamped: YQXPR01MB4359 X-Rspamd-Queue-Id: 4F13Qq31wBz3MXh X-Spamd-Bar: ----- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=uoguelph.ca header.s=selector1 header.b=KFVOdLm3; arc=pass (microsoft.com:s=arcselector9901:i=1); dmarc=pass (policy=none) header.from=uoguelph.ca; spf=pass (mx1.freebsd.org: domain of rmacklem@uoguelph.ca designates 2a01:111:f400:fe5c::620 as permitted sender) smtp.mailfrom=rmacklem@uoguelph.ca X-Spamd-Result: default: False [-6.00 / 15.00]; TO_DN_EQ_ADDR_SOME(0.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[2a01:111:f400:fe5c::620:from]; R_DKIM_ALLOW(-0.20)[uoguelph.ca:s=selector1]; FREEFALL_USER(0.00)[rmacklem]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2a01:111:f400::/48]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; DWL_DNSWL_LOW(-1.00)[uoguelph.ca:dkim]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; SPAMHAUS_ZRD(0.00)[2a01:111:f400:fe5c::620:from:127.0.2.255]; DKIM_TRACE(0.00)[uoguelph.ca:+]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[uoguelph.ca,none]; NEURAL_HAM_SHORT(-1.00)[-1.000]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:8075, ipnet:2a01:111:f000::/36, country:US]; ARC_ALLOW(-1.00)[microsoft.com:s=arcselector9901:i=1]; MAILMAN_DEST(0.00)[freebsd-net] X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 17 Mar 2021 21:37:24 -0000 Jason Breitman wrote:=0A= >Please review the details below and let me know if there is a setting that= I should >apply to my FreeBSD NFS Server or if there is a bug fix that I c= an apply to resolve my >issue.=0A= >I shared this information with the linux-nfs mailing list and they believe= the issue is >on the server side.=0A= I actually lurk there and saw your post. I'll admit I smiled when Trond arg= ued=0A= that a hung Linux system is the result of a server failing to send a fin/ac= k for=0A= a closing TCP connection. But, here's a few comments..=0A= =0A= >Issue=0A= >NFSv4 mounts periodically hang on the NFS Client.=0A= >=0A= >During this time, it is possible to manually mount from another NFS Server= on the >NFS Client having issues.=0A= >Also, other NFS Clients are successfully mounting from the NFS Server in q= uestion.=0A= >Rebooting the NFS Client appears to be the only solution.=0A= >=0A= >Environment=0A= >NFS Server=0A= >OS: FreeBSD 12.1-RELEASE-p5=0A= >=0A= >NFS Client=0A= >OS: Debian Buster 10.8=0A= >Kernel: 4.19.171-2=0A= >Protocol: NFSv4 with Kerberos Security=0A= >Mount Options: nfs-server.domain.com:/data /mnt/data nfs4 >l= ookupcache=3Dpos,noresvport,sec=3Dkrb5,hard,rsize=3D1048576,wsize=3D1048576= 00=0A= The maximum I/O size supported by FreeBSD is 128K.=0A= The client should acquire the attributes that indicate that and set rsize/w= size=0A= to that. "# nfsstat -m" on the client should show you what the client=0A= is actually using. If it is larger than 128K, set both rsize and wsize to 1= 28K.=0A= =0A= >Output from the NFS Client when the issue occurs=0A= ># netstat -an | grep NFS.Server.IP.X=0A= >tcp 0 0 NFS.Client.IP.X:46896 NFS.Server.IP.X:2049 = FIN_WAIT2=0A= I'm no TCP guy. Hopefully others might know why the client would be=0A= stuck in FIN_WAIT2 (I vaguely recall this means it is waiting for a fin/ack= ,=0A= but could be wrong?)=0A= =0A= ># cat /sys/kernel/debug/sunrpc/rpc_xprt/*/info=0A= >netid: tcp=0A= >addr: NFS.Server.IP.X=0A= >port: 2049=0A= >state: 0x51=0A= >=0A= >syslog=0A= >Mar 4 10:29:27 hostname kernel: [437414.131978] -pid- flgs status -client= - --rqstp- ->timeout ---ops--=0A= >Mar 4 10:29:27 hostname kernel: [437414.133158] 57419 40a1 0 9b723c7= 3 >143cfadf 30000 4ca953b5 nfsv4 OPEN_NOATTR a:call_connect_status [sunr= pc] >q:xprt_pending=0A= I don't know what OPEN_NOATTR means, but I assume it is some variant=0A= of NFSv4 Open operation.=0A= [stuff snipped]=0A= >Mar 4 10:29:30 hostname kernel: [437417.110517] RPC: 57419 xprt_connect_s= tatus: >connect attempt timed out=0A= >Mar 4 10:29:30 hostname kernel: [437417.112172] RPC: 57419 call_connect_s= tatus =0A= >(status -110)=0A= I have no idea what status -110 means?=0A= >Mar 4 10:29:30 hostname kernel: [437417.113337] RPC: 57419 call_timeout (= major)=0A= >Mar 4 10:29:30 hostname kernel: [437417.114385] RPC: 57419 call_bind (sta= tus 0)=0A= >Mar 4 10:29:30 hostname kernel: [437417.115402] RPC: 57419 call_connect x= prt >00000000e061831b is not connected=0A= >Mar 4 10:29:30 hostname kernel: [437417.116547] RPC: 57419 xprt_connect x= prt >00000000e061831b is not connected=0A= >Mar 4 10:30:31 hostname kernel: [437478.551090] RPC: 57419 xprt_connect_s= tatus: >connect attempt timed out=0A= >Mar 4 10:30:31 hostname kernel: [437478.552396] RPC: 57419 call_connect_s= tatus >(status -110)=0A= >Mar 4 10:30:31 hostname kernel: [437478.553417] RPC: 57419 call_timeout (= minor)=0A= >Mar 4 10:30:31 hostname kernel: [437478.554327] RPC: 57419 call_bind (sta= tus 0)=0A= >Mar 4 10:30:31 hostname kernel: [437478.555220] RPC: 57419 call_connect x= prt >00000000e061831b is not connected=0A= >Mar 4 10:30:31 hostname kernel: [437478.556254] RPC: 57419 xprt_connect x= prt >00000000e061831b is not connected=0A= Is it possible that the client is trying to (re)connect using the same clie= nt port#?=0A= I would normally expect the client to create a new TCP connection using a= =0A= different client port# and then retry the outstanding RPCs.=0A= --> Capturing packets when this happens would show us what is going on.=0A= =0A= If there is a problem on the FreeBSD end, it is most likely a broken=0A= network device driver.=0A= --> Try disabling TSO , LRO.=0A= --> Try a different driver for the net hardware on the server.=0A= --> Try a different net chip on the server.=0A= If you can capture packets when (not after) the hang=0A= occurs, then you can look at them in wireshark and see=0A= what is actually happening. (Ideally on both client and=0A= server, to check that your network hasn't dropped anything.)=0A= --> I know, if the hangs aren't easily reproducible, this isn't=0A= easily done.=0A= --> Try a newer Linux kernel and see if the problem persists.=0A= The Linux folk will get more interested if you can reproduce=0A= the problem on 5.12. (Recent bakeathon testing of the 5.12=0A= kernel against the FreeBSD server did not find any issues.)=0A= =0A= Hopefully the network folk have some insight w.r.t. why=0A= the TCP connection is sitting in FIN_WAIT2.=0A= =0A= rick=0A= =0A= =0A= =0A= Jason Breitman=0A= =0A= =0A= =0A= =0A= =0A= =0A= _______________________________________________=0A= freebsd-net@freebsd.org mailing list=0A= https://lists.freebsd.org/mailman/listinfo/freebsd-net=0A= To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org"=0A= =0A= From owner-freebsd-net@freebsd.org Wed Mar 17 21:46:01 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 596A3579BC1 for ; Wed, 17 Mar 2021 21:46:01 +0000 (UTC) (envelope-from asomers@gmail.com) Received: from mail-oi1-f182.google.com (mail-oi1-f182.google.com [209.85.167.182]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4F13cl640Zz3N99 for ; Wed, 17 Mar 2021 21:45:59 +0000 (UTC) (envelope-from asomers@gmail.com) Received: by mail-oi1-f182.google.com with SMTP id w195so493897oif.11 for ; Wed, 17 Mar 2021 14:45:59 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=bTrD6c+z+tEBq8e1nKdwFXKQ8pGBWcwQGcCT+shZ53c=; b=oAa3HEClU1xSZujxd1nXwEyVM69aiUP49CpJD12ITYZFYjCRTmb3kYTEj9B/Jecif0 ocQ4dmlKIeN1OQ4vTHT6v5XU8S+YdlRCKAMcPIJrspylBRrGHYXB2griBW0drbA4Ek1L d9fOR57dpMp2mBJtgTbNoVgG3SBOYl4CHJd7Nf6zu4nKVowfX5qTs00FG78ky7y+yfxk NUP6W3oZWDBJBavkaSF+d7FRYKeDwnKZOtPVxRD/nIqQcILKm2ZEOqbJIzfIY1xK/3wm 1so0/la8FE4Fzz1j4a2DnF+EguwRHayFoaK6cwQdyfNHA1g+E3PCyURty/W3rQKYQkl/ wPPQ== X-Gm-Message-State: AOAM530BIWW/CH9kHWGdTFx+Isx29eJi1IANgLndhwI0IkVn8j78J6cl fe1QKqsji958lnBr85LbbsBUD3Sf9A4/y5qgBTk= X-Google-Smtp-Source: ABdhPJzBHDfb7YJ67wYCzzZ+bvh3Prbq8v01rqN75hmwaBB0ORl3eB92Elwr6ijOIPPrQY3+4KXW3HTAlqU+CiyKPns= X-Received: by 2002:aca:4f0b:: with SMTP id d11mr692797oib.73.1616017558272; Wed, 17 Mar 2021 14:45:58 -0700 (PDT) MIME-Version: 1.0 References: <3750001D-3F1C-4D9A-A9D9-98BCA6CA65A4@tildenparkcapital.com> <33693DE3-7FF8-4FAB-9A75-75576B88A566@tildenparkcapital.com> In-Reply-To: From: Alan Somers Date: Wed, 17 Mar 2021 15:45:47 -0600 Message-ID: Subject: Re: NFS Mount Hangs To: Rick Macklem Cc: Jason Breitman , "freebsd-net@freebsd.org" X-Rspamd-Queue-Id: 4F13cl640Zz3N99 X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of asomers@gmail.com designates 209.85.167.182 as permitted sender) smtp.mailfrom=asomers@gmail.com X-Spamd-Result: default: False [-3.00 / 15.00]; TO_DN_EQ_ADDR_SOME(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:209.85.128.0/17]; NEURAL_HAM_SHORT(-1.00)[-1.000]; FORGED_SENDER(0.30)[asomers@freebsd.org,asomers@gmail.com]; MIME_TRACE(0.00)[0:+,1:+,2:~]; RBL_DBL_DONT_QUERY_IPS(0.00)[209.85.167.182:from]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:209.85.128.0/17, country:US]; FROM_NEQ_ENVFROM(0.00)[asomers@freebsd.org,asomers@gmail.com]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-0.999]; FREEFALL_USER(0.00)[asomers]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-net@freebsd.org]; DMARC_NA(0.00)[freebsd.org]; SPAMHAUS_ZRD(0.00)[209.85.167.182:from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[209.85.167.182:from]; R_DKIM_NA(0.00)[]; RWL_MAILSPIKE_POSSIBLE(0.00)[209.85.167.182:from]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-net] Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.34 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 17 Mar 2021 21:46:01 -0000 On Wed, Mar 17, 2021 at 3:37 PM Rick Macklem wrote: > Jason Breitman wrote: > >Please review the details below and let me know if there is a setting > that I should >apply to my FreeBSD NFS Server or if there is a bug fix that > I can apply to resolve my >issue. > >I shared this information with the linux-nfs mailing list and they > believe the issue is >on the server side. > I actually lurk there and saw your post. I'll admit I smiled when Trond > argued > that a hung Linux system is the result of a server failing to send a > fin/ack for > a closing TCP connection. But, here's a few comments.. > > >Issue > >NFSv4 mounts periodically hang on the NFS Client. > > > >During this time, it is possible to manually mount from another NFS > Server on the >NFS Client having issues. > >Also, other NFS Clients are successfully mounting from the NFS Server in > question. > >Rebooting the NFS Client appears to be the only solution. > > > >Environment > >NFS Server > >OS: FreeBSD 12.1-RELEASE-p5 > > > >NFS Client > >OS: Debian Buster 10.8 > >Kernel: 4.19.171-2 > >Protocol: NFSv4 with Kerberos Security > >Mount Options: nfs-server.domain.com:/data /mnt/data nfs4 > >lookupcache=pos,noresvport,sec=krb5,hard,rsize=1048576,wsize=1048576 00 > The maximum I/O size supported by FreeBSD is 128K. > Is the 128K limit related to MAXPHYS? If so, it should be greater in 13.0. > The client should acquire the attributes that indicate that and set > rsize/wsize > to that. "# nfsstat -m" on the client should show you what the client > is actually using. If it is larger than 128K, set both rsize and wsize to > 128K. > > >Output from the NFS Client when the issue occurs > ># netstat -an | grep NFS.Server.IP.X > >tcp 0 0 NFS.Client.IP.X:46896 NFS.Server.IP.X:2049 > FIN_WAIT2 > I'm no TCP guy. Hopefully others might know why the client would be > stuck in FIN_WAIT2 (I vaguely recall this means it is waiting for a > fin/ack, > but could be wrong?) > > ># cat /sys/kernel/debug/sunrpc/rpc_xprt/*/info > >netid: tcp > >addr: NFS.Server.IP.X > >port: 2049 > >state: 0x51 > > > >syslog > >Mar 4 10:29:27 hostname kernel: [437414.131978] -pid- flgs status > -client- --rqstp- ->timeout ---ops-- > >Mar 4 10:29:27 hostname kernel: [437414.133158] 57419 40a1 0 > 9b723c73 >143cfadf 30000 4ca953b5 nfsv4 OPEN_NOATTR > a:call_connect_status [sunrpc] >q:xprt_pending > I don't know what OPEN_NOATTR means, but I assume it is some variant > of NFSv4 Open operation. > [stuff snipped] > >Mar 4 10:29:30 hostname kernel: [437417.110517] RPC: 57419 > xprt_connect_status: >connect attempt timed out > >Mar 4 10:29:30 hostname kernel: [437417.112172] RPC: 57419 > call_connect_status > >(status -110) > I have no idea what status -110 means? > >Mar 4 10:29:30 hostname kernel: [437417.113337] RPC: 57419 call_timeout > (major) > >Mar 4 10:29:30 hostname kernel: [437417.114385] RPC: 57419 call_bind > (status 0) > >Mar 4 10:29:30 hostname kernel: [437417.115402] RPC: 57419 call_connect > xprt >00000000e061831b is not connected > >Mar 4 10:29:30 hostname kernel: [437417.116547] RPC: 57419 xprt_connect > xprt >00000000e061831b is not connected > >Mar 4 10:30:31 hostname kernel: [437478.551090] RPC: 57419 > xprt_connect_status: >connect attempt timed out > >Mar 4 10:30:31 hostname kernel: [437478.552396] RPC: 57419 > call_connect_status >(status -110) > >Mar 4 10:30:31 hostname kernel: [437478.553417] RPC: 57419 call_timeout > (minor) > >Mar 4 10:30:31 hostname kernel: [437478.554327] RPC: 57419 call_bind > (status 0) > >Mar 4 10:30:31 hostname kernel: [437478.555220] RPC: 57419 call_connect > xprt >00000000e061831b is not connected > >Mar 4 10:30:31 hostname kernel: [437478.556254] RPC: 57419 xprt_connect > xprt >00000000e061831b is not connected > Is it possible that the client is trying to (re)connect using the same > client port#? > I would normally expect the client to create a new TCP connection using a > different client port# and then retry the outstanding RPCs. > --> Capturing packets when this happens would show us what is going on. > > If there is a problem on the FreeBSD end, it is most likely a broken > network device driver. > --> Try disabling TSO , LRO. > --> Try a different driver for the net hardware on the server. > --> Try a different net chip on the server. > If you can capture packets when (not after) the hang > occurs, then you can look at them in wireshark and see > what is actually happening. (Ideally on both client and > server, to check that your network hasn't dropped anything.) > --> I know, if the hangs aren't easily reproducible, this isn't > easily done. > --> Try a newer Linux kernel and see if the problem persists. > The Linux folk will get more interested if you can reproduce > the problem on 5.12. (Recent bakeathon testing of the 5.12 > kernel against the FreeBSD server did not find any issues.) > > Hopefully the network folk have some insight w.r.t. why > the TCP connection is sitting in FIN_WAIT2. > > rick > > > > Jason Breitman > > > > > > > _______________________________________________ > freebsd-net@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-net > To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org" > > _______________________________________________ > freebsd-net@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-net > To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org" > From owner-freebsd-net@freebsd.org Wed Mar 17 21:58:29 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id BAA8E57A3E0 for ; Wed, 17 Mar 2021 21:58:29 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) Received: from CAN01-QB1-obe.outbound.protection.outlook.com (mail-qb1can01on0616.outbound.protection.outlook.com [IPv6:2a01:111:f400:fe5c::616]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "DigiCert Cloud Services CA-1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4F13v81Rqqz3NvQ; Wed, 17 Mar 2021 21:58:27 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=WpawpshanpM0MP2Ox9LQzMI8q44YREB2S/syAGvgeJ9VLTVTFbAQAOPpykLGtCk5abcW4KpGajm7Lceclc4RtCk8a0qQrqQiFDOkFCmSwbroLar16r8JdBNVo7d5Ld5HMUNV4/RXZVMSViluQ9RZmJti12gnKYO4/7rNVg/Fdq2XJvo6lrYszz5EU46vdpeHqmWtG2i8Ge2pjLB0F8zfMNS8d7POR35EPswAvRkbuPqiI8UtSPzbRw0mVR/eQSzdKY1Y7gbbF+gmG65LIvFHvK7GN4Fm3d8wxfN/cbMxTQemWDUPVHShOxXRI2wzJdSAk3flydPvZnEsQfVKX4kEFQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=MCrgBCPgo6EwFLhs/Z5l+E2CzpUdhmpUWFFTvRGl+Ys=; b=N76FFyd36GOUiMn6Z1qbnA9waQ37sINu+60ontmbsIHT9/DerQftTqSX5JjlC5n+x1FQ7coFe9xh7cf3MgZusPbzSngIl8PHh1GHNW1A9+enEk2LxIUfnSvU0ke3syugdVbYP4SnW+uppUCPi+GuDiiyW262UK0djRyfymAIB3PW55x2iSozvCpHNFSxOoAnqc0abZhdoC7+hxiXjUndLrbi4yiXC1MjJCL8aHnLPWr8ADZMGp5M/2dENTbnlRCJBlgE8dkLTVNUZLjsl8yUOVhEqmP83nAL7hDCo1JyZuBYdDXksWDLoDqCh+TypnVDqIbtanmpZLHk9qu4mgQvOA== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=uoguelph.ca; dmarc=pass action=none header.from=uoguelph.ca; dkim=pass header.d=uoguelph.ca; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=uoguelph.ca; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=MCrgBCPgo6EwFLhs/Z5l+E2CzpUdhmpUWFFTvRGl+Ys=; b=Oh+cEwujwYr/R2lQmFp5pI4eIZoDFDOi4cA6moRcNmzY7LnjChabN+wmviT9uOqvufpkwlTe+LcGgwcXxFRP0cXh83SUFIlIhs3P7M8uJakbeA+5uge7VuAUr5Xtx4MnflFTG4IbJUkrKH7h9MtSaD3tLIwGGrCTM1M5m98eo3nl6qXQslGZu1IC6yIzrH9Ka77sVB0lzjoUWGxOWfeLiVqYsZDA23vqaJxujttZGyR2bNWKU0XTwP7qvHbDkFehJ7nHAb6P0HcR2IDhhPjbsGqylDP+akThRJ+zs3Tg8aJnk/qxriNs1fGwBjH3hF3/Yie7KpkTi3wEXmmr+erJYA== Received: from YQXPR0101MB0968.CANPRD01.PROD.OUTLOOK.COM (2603:10b6:c00:19::29) by QB1PR01MB3473.CANPRD01.PROD.OUTLOOK.COM (2603:10b6:c00:37::17) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3933.32; Wed, 17 Mar 2021 21:58:25 +0000 Received: from YQXPR0101MB0968.CANPRD01.PROD.OUTLOOK.COM ([fe80::6073:6fc0:5ddf:dc8a]) by YQXPR0101MB0968.CANPRD01.PROD.OUTLOOK.COM ([fe80::6073:6fc0:5ddf:dc8a%7]) with mapi id 15.20.3933.032; Wed, 17 Mar 2021 21:58:25 +0000 From: Rick Macklem To: Alan Somers CC: Jason Breitman , "freebsd-net@freebsd.org" Subject: Re: NFS Mount Hangs Thread-Topic: NFS Mount Hangs Thread-Index: AQHXG1G2D7AHBwtmAkS1jBAqNNo2I6qIqQ+SgAAOFICAAAENXg== Date: Wed, 17 Mar 2021 21:58:25 +0000 Message-ID: References: <3750001D-3F1C-4D9A-A9D9-98BCA6CA65A4@tildenparkcapital.com> <33693DE3-7FF8-4FAB-9A75-75576B88A566@tildenparkcapital.com> , In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-ms-publictraffictype: Email x-ms-office365-filtering-correlation-id: 8f897760-8ef4-42e0-9b1a-08d8e98fca5f x-ms-traffictypediagnostic: QB1PR01MB3473: x-microsoft-antispam-prvs: x-ms-oob-tlc-oobclassifiers: OLM:10000; x-ms-exchange-senderadcheck: 1 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: EP084E3rq72/8Vqolcx/CLJYJEWdRpYwh0svitAUkNQxcZ9JxQtbFsa9OiEeD7UOERMb023xdR4JbnMLpj6jdHeR0XE6j2qBix8fLNRgCZ9aeV/IR57HKlic1aMTKDn0IxMXUyE71972MaAYPwT+H7g/l2kIAaE39htFj/xqQAd36/+afM7DlZ1yrxX8CBM/BYLdQuKqdjSAKBS9glMZtoH5owmg81ZRcshtoPkrwipVBrHiOdZJgCTZvj7H3UxJwUMy6u5eoSz9Qiblv7noLU3v0ya77bVuipLRzw5sFgpMuSmtOQAFq0dIjFWk9usWzrAnn8n6w3gcrJzpCLv4AZ8n1kkRxPr7pEAU+h1hBQKGaakPd9hee3Dp1LVOhI7FAipZKOD13gsKp14EbZuuJlQLAHWyrtZa9IfRI/b+ulmJ6ez/wmrGZa7fzBtdG20bQEhuPCAbUX8yxC2qGvkwsUGMlZxpHaFKlodkymD3MmAkb8dEGWITZiuSmd3oPrxgdYMmgKZBFnTILPnDIKW+xiea1ZIU7sb2tO61jghOQMSuym2tURRyL/Ez1rSRmp3wEIHTryp7lPOguU4aPp9k/Ln3GNgk9O8JSPOOzy0Jsm/hn1UrfnLmPCfFQAmvwnZEjN9YRaZEnSq/ZLUNh4DDIA== x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:YQXPR0101MB0968.CANPRD01.PROD.OUTLOOK.COM; PTR:; CAT:NONE; SFS:(136003)(366004)(376002)(39860400002)(346002)(396003)(8936002)(5660300002)(52536014)(66946007)(9686003)(478600001)(64756008)(55016002)(7696005)(6916009)(966005)(8676002)(66476007)(6506007)(7116003)(4326008)(66446008)(3480700007)(91956017)(54906003)(786003)(83380400001)(2906002)(71200400001)(186003)(66556008)(86362001)(33656002)(76116006)(316002); DIR:OUT; SFP:1101; x-ms-exchange-antispam-messagedata: =?iso-8859-1?Q?UODmeGRcVdHXF64xjTzjBbwxvnyOe6lYNt3DJhqrLKbOCGnsjEq+dOAZP4?= =?iso-8859-1?Q?clUdAAaabL50SSKPBPNe7clZQehEZpgHRmu+PtgItb3H6/QckgAY670Z8S?= =?iso-8859-1?Q?VfKz0I1z1470JEhmwcu28qHn07pJjaaVz/yc9dsxj5yoot6ghcJa3uf78b?= =?iso-8859-1?Q?vKBF95F1cbYTFb72zejAMXrQr9wOGyB2fe8hvVQmLGAbclQDRnqgad57Cn?= =?iso-8859-1?Q?CW8VpeesS442+9PS6LbLEq+chYh2Kb2+vmgPFZ8KDqwhaZyn8ChVJm6cGI?= =?iso-8859-1?Q?XR8WYHaYYzSmv6qeClbOiTIhNP+l2i8VcWtQ6+NiTmq4THH8I6FUYDlF50?= =?iso-8859-1?Q?y34VJWqhapdaskzQw/6bhXClj+xGT0BpWMEImz4QAmkthFKwpytsmc7zrw?= =?iso-8859-1?Q?FULJZb3F08h4F3SlCKT5JMEGrHIJmJXKR/u7zhKXA9MvUio8V3VQ+aFOj5?= =?iso-8859-1?Q?pnFb0kZioOdPKTuofngQxkhQITo/YT6NUT5cZZleIPiZjVVfzWE/8GqR7/?= =?iso-8859-1?Q?ge/B+C+lFcBFVZ3MhFeFbMdr6g2t37h+DpP2WxhM6b065rG0H/1lqc2mI2?= =?iso-8859-1?Q?3FOGjgkJq30qZ6JYNB37mxjeo4GNZdEt0yPbfhL3HH3v3BIfOqz8mNg2s2?= =?iso-8859-1?Q?aLgse6coXOxRUmysaKxunWufZx9ASJU7b2e10SY8x0FhpqHHU3txKNh7ue?= =?iso-8859-1?Q?JANzuaQ/9gpbHl/ZdYA/rVLNudwEX1dCIzQdamJESxUDls6a0booGyTRd4?= =?iso-8859-1?Q?wjz6bwXURZgRChZa2wnTeSI4mZpBbUk/4U6RRB0uuwCy4V6AxU1OQoSaVA?= =?iso-8859-1?Q?ha+X11IiLwKNqKdqnY80JhZz+DfUjFLKGUXbKGbVu0dyhl4VMN+EoT3hYS?= =?iso-8859-1?Q?LnVRoAeIEosFSarFgg9Jf/+9oD96h/D48mm4bmHofZ0rFCxNeS6R1RCxyT?= =?iso-8859-1?Q?VbWCys11JA5a6YPaTtajI4ZL+B0lOs81OkAVpztiZgzPuMwyAoZcVqBUnA?= =?iso-8859-1?Q?nGw/2+qO4pEG6HI77iNB+s8YcnsrQ6B5dSJ5mqVFlc5ByOaiJRtQ95rVZE?= =?iso-8859-1?Q?135lRkYDnPZf82TB5gSXLjM14tQX+Tn7E1nNb+FP/+IBjEMfpROd6X5bp+?= =?iso-8859-1?Q?ONqNx2RZthORJwMMkqYcMNoNjVXcuQ7dh/k/mUBhs5BLcxrZSIqThmAoG3?= =?iso-8859-1?Q?Rj7g3Gwn+WoRzL9TIArwhmTjN2d8LPR2V71gAmTa7jMRxXrS6oP8ek9hjx?= =?iso-8859-1?Q?P4W98B052MdkHnEUTt7CNBT4Nhi1BT7TisqGEqQY9FJW8yP9K48FqkmcES?= =?iso-8859-1?Q?50pPn1X7KP7Yw2sLbwon0BE3ad3gJ2f2AlmCKEIW03i4YMPzbqwRcNZRPC?= =?iso-8859-1?Q?zUg67B8qN2d9lVv/3Ptj2m3qCU0Svx6LT0vXN+TeaaHk3iQ2lIdgI=3D?= x-ms-exchange-transport-forked: True Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-OriginatorOrg: uoguelph.ca X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: YQXPR0101MB0968.CANPRD01.PROD.OUTLOOK.COM X-MS-Exchange-CrossTenant-Network-Message-Id: 8f897760-8ef4-42e0-9b1a-08d8e98fca5f X-MS-Exchange-CrossTenant-originalarrivaltime: 17 Mar 2021 21:58:25.7463 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: be62a12b-2cad-49a1-a5fa-85f4f3156a7d X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: uLFglPLZiWr0/8reO3RGz1rXnWXW6bwotuborZw1Db1BijzO9al2kto2pSeHkDfj+DC3YmMqYXPiKPUHo0X/yA== X-MS-Exchange-Transport-CrossTenantHeadersStamped: QB1PR01MB3473 X-Rspamd-Queue-Id: 4F13v81Rqqz3NvQ X-Spamd-Bar: ------ Authentication-Results: mx1.freebsd.org; dkim=pass header.d=uoguelph.ca header.s=selector1 header.b=Oh+cEwuj; arc=pass (microsoft.com:s=arcselector9901:i=1); dmarc=pass (policy=none) header.from=uoguelph.ca; spf=pass (mx1.freebsd.org: domain of rmacklem@uoguelph.ca designates 2a01:111:f400:fe5c::616 as permitted sender) smtp.mailfrom=rmacklem@uoguelph.ca X-Spamd-Result: default: False [-6.00 / 15.00]; TO_DN_EQ_ADDR_SOME(0.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[2a01:111:f400:fe5c::616:from]; R_DKIM_ALLOW(-0.20)[uoguelph.ca:s=selector1]; FREEFALL_USER(0.00)[rmacklem]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2a01:111:f400::/48]; MIME_GOOD(-0.10)[text/plain]; NEURAL_HAM_LONG(-1.00)[-1.000]; DWL_DNSWL_LOW(-1.00)[uoguelph.ca:dkim]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; SPAMHAUS_ZRD(0.00)[2a01:111:f400:fe5c::616:from:127.0.2.255]; DKIM_TRACE(0.00)[uoguelph.ca:+]; DMARC_POLICY_ALLOW(-0.50)[uoguelph.ca,none]; NEURAL_HAM_SHORT(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:8075, ipnet:2a01:111:f000::/36, country:US]; ARC_ALLOW(-1.00)[microsoft.com:s=arcselector9901:i=1]; MAILMAN_DEST(0.00)[freebsd-net] X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 17 Mar 2021 21:58:29 -0000 Alan Somers wrote:=0A= [stuff snipped]=0A= >Is the 128K limit related to MAXPHYS? If so, it should be greater in 13.0= .=0A= For the client, yes. For the server, no.=0A= For the server, it is just a compile time constant NFS_SRVMAXIO.=0A= =0A= It's mainly related to the fact that I haven't gotten around to testing lar= ger=0A= sizes yet.=0A= - kern.ipc.maxsockbuf needs to be several times the limit, which means it w= ould=0A= have to increase for 1Mbyte.=0A= - The session code must negotiate a maximum RPC size > 1 Mbyte.=0A= (I think the server code does do this, but it needs to be tested.)=0A= And, yes, the client is limited to MAXPHYS.=0A= =0A= Doing this is on my todo list, rick=0A= =0A= The client should acquire the attributes that indicate that and set rsize/w= size=0A= to that. "# nfsstat -m" on the client should show you what the client=0A= is actually using. If it is larger than 128K, set both rsize and wsize to 1= 28K.=0A= =0A= >Output from the NFS Client when the issue occurs=0A= ># netstat -an | grep NFS.Server.IP.X=0A= >tcp 0 0 NFS.Client.IP.X:46896 NFS.Server.IP.X:2049 = FIN_WAIT2=0A= I'm no TCP guy. Hopefully others might know why the client would be=0A= stuck in FIN_WAIT2 (I vaguely recall this means it is waiting for a fin/ack= ,=0A= but could be wrong?)=0A= =0A= ># cat /sys/kernel/debug/sunrpc/rpc_xprt/*/info=0A= >netid: tcp=0A= >addr: NFS.Server.IP.X=0A= >port: 2049=0A= >state: 0x51=0A= >=0A= >syslog=0A= >Mar 4 10:29:27 hostname kernel: [437414.131978] -pid- flgs status -client= - --rqstp- ->timeout ---ops--=0A= >Mar 4 10:29:27 hostname kernel: [437414.133158] 57419 40a1 0 9b723c7= 3 >143cfadf 30000 4ca953b5 nfsv4 OPEN_NOATTR a:call_connect_status [sunr= pc] >q:xprt_pending=0A= I don't know what OPEN_NOATTR means, but I assume it is some variant=0A= of NFSv4 Open operation.=0A= [stuff snipped]=0A= >Mar 4 10:29:30 hostname kernel: [437417.110517] RPC: 57419 xprt_connect_s= tatus: >connect attempt timed out=0A= >Mar 4 10:29:30 hostname kernel: [437417.112172] RPC: 57419 call_connect_s= tatus=0A= >(status -110)=0A= I have no idea what status -110 means?=0A= >Mar 4 10:29:30 hostname kernel: [437417.113337] RPC: 57419 call_timeout (= major)=0A= >Mar 4 10:29:30 hostname kernel: [437417.114385] RPC: 57419 call_bind (sta= tus 0)=0A= >Mar 4 10:29:30 hostname kernel: [437417.115402] RPC: 57419 call_connect x= prt >00000000e061831b is not connected=0A= >Mar 4 10:29:30 hostname kernel: [437417.116547] RPC: 57419 xprt_connect x= prt >00000000e061831b is not connected=0A= >Mar 4 10:30:31 hostname kernel: [437478.551090] RPC: 57419 xprt_connect_s= tatus: >connect attempt timed out=0A= >Mar 4 10:30:31 hostname kernel: [437478.552396] RPC: 57419 call_connect_s= tatus >(status -110)=0A= >Mar 4 10:30:31 hostname kernel: [437478.553417] RPC: 57419 call_timeout (= minor)=0A= >Mar 4 10:30:31 hostname kernel: [437478.554327] RPC: 57419 call_bind (sta= tus 0)=0A= >Mar 4 10:30:31 hostname kernel: [437478.555220] RPC: 57419 call_connect x= prt >00000000e061831b is not connected=0A= >Mar 4 10:30:31 hostname kernel: [437478.556254] RPC: 57419 xprt_connect x= prt >00000000e061831b is not connected=0A= Is it possible that the client is trying to (re)connect using the same clie= nt port#?=0A= I would normally expect the client to create a new TCP connection using a= =0A= different client port# and then retry the outstanding RPCs.=0A= --> Capturing packets when this happens would show us what is going on.=0A= =0A= If there is a problem on the FreeBSD end, it is most likely a broken=0A= network device driver.=0A= --> Try disabling TSO , LRO.=0A= --> Try a different driver for the net hardware on the server.=0A= --> Try a different net chip on the server.=0A= If you can capture packets when (not after) the hang=0A= occurs, then you can look at them in wireshark and see=0A= what is actually happening. (Ideally on both client and=0A= server, to check that your network hasn't dropped anything.)=0A= --> I know, if the hangs aren't easily reproducible, this isn't=0A= easily done.=0A= --> Try a newer Linux kernel and see if the problem persists.=0A= The Linux folk will get more interested if you can reproduce=0A= the problem on 5.12. (Recent bakeathon testing of the 5.12=0A= kernel against the FreeBSD server did not find any issues.)=0A= =0A= Hopefully the network folk have some insight w.r.t. why=0A= the TCP connection is sitting in FIN_WAIT2.=0A= =0A= rick=0A= =0A= =0A= =0A= Jason Breitman=0A= =0A= =0A= =0A= =0A= =0A= =0A= _______________________________________________=0A= freebsd-net@freebsd.org mailing list=0A= https://lists.freebsd.org/mailman/listinfo/freebsd-net=0A= To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org"=0A= =0A= _______________________________________________=0A= freebsd-net@freebsd.org mailing list=0A= https://lists.freebsd.org/mailman/listinfo/freebsd-net=0A= To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org"=0A= From owner-freebsd-net@freebsd.org Wed Mar 17 22:17:18 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id E14C657AC90 for ; Wed, 17 Mar 2021 22:17:18 +0000 (UTC) (envelope-from jbreitman@tildenparkcapital.com) Received: from us-smtp-delivery-145.mimecast.com (us-smtp-delivery-145.mimecast.com [216.205.24.145]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "*.mimecast.com", Issuer "DigiCert TLS RSA SHA256 2020 CA1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4F14Jt5bfwz3Ptj for ; Wed, 17 Mar 2021 22:17:18 +0000 (UTC) (envelope-from jbreitman@tildenparkcapital.com) Received: from zmcc-3-mta-2.zmailcloud.com (zmcc-3-mta-2.zmailcloud.com [35.238.170.66]) (Using TLS) by relay.mimecast.com with ESMTP id us-mta-105-ApcE-Gr2P36g0GmK4rSN-g-1; Wed, 17 Mar 2021 18:17:16 -0400 X-MC-Unique: ApcE-Gr2P36g0GmK4rSN-g-1 Received: from zmcc-3-mta-2.zmailcloud.com (localhost [127.0.0.1]) by zmcc-3-mta-2.zmailcloud.com (Postfix) with ESMTPS id D2E37E0E18; Wed, 17 Mar 2021 17:17:15 -0500 (CDT) Received: from localhost (localhost [127.0.0.1]) by zmcc-3-mta-2.zmailcloud.com (Postfix) with ESMTP id C279CE0E07; Wed, 17 Mar 2021 17:17:15 -0500 (CDT) X-Virus-Scanned: amavisd-new at zmcc-3-mta-2.zmailcloud.com Received: from zmcc-3-mta-2.zmailcloud.com ([127.0.0.1]) by localhost (zmcc-3-mta-2.zmailcloud.com [127.0.0.1]) (amavisd-new, port 10026) with ESMTP id Unbdpfl8Ri5T; Wed, 17 Mar 2021 17:17:15 -0500 (CDT) Received: from jbreitman-mac.zxcvm.com (unknown [72.22.182.150]) by zmcc-3-mta-2.zmailcloud.com (Postfix) with ESMTPSA id 7CBCDE0D63; Wed, 17 Mar 2021 17:17:15 -0500 (CDT) From: Jason Breitman Mime-Version: 1.0 (Mac OS X Mail 13.4 \(3608.120.23.2.4\)) Subject: Re: NFS Mount Hangs Date: Wed, 17 Mar 2021 18:17:14 -0400 References: <3750001D-3F1C-4D9A-A9D9-98BCA6CA65A4@tildenparkcapital.com> <33693DE3-7FF8-4FAB-9A75-75576B88A566@tildenparkcapital.com> To: Rick Macklem , Alan Somers , "freebsd-net@freebsd.org" In-Reply-To: Message-Id: <789BCFA9-D6BC-4C5A-AEA2-E6F7C6E26CB5@tildenparkcapital.com> X-Mailer: Apple Mail (2.3608.120.23.2.4) X-Mimecast-Spam-Score: 0 X-Mimecast-Originator: tildenparkcapital.com Content-Type: text/plain; charset=WINDOWS-1252 Content-Transfer-Encoding: quoted-printable X-Rspamd-Queue-Id: 4F14Jt5bfwz3Ptj X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[] X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 17 Mar 2021 22:17:18 -0000 Thank you for the responses. The NFS Client does properly negotiate down to 128K for the rsize and wsize= . The client port should be changing as we are using the noresvport option. On the NFS Client cat /proc/mounts nfs-server.domain.com:/data /mnt/data nfs4 rw,relatime,vers=3D4.1,rsize=3D1= 31072,wsize=3D131072,namlen=3D255,hard,noresvport,proto=3Dtcp,timeo=3D600,r= etrans=3D2,sec=3Dkrb5,clientaddr=3DNFS.Client.IP.X,lookupcache=3Dpos,local_= lock=3Dnone,addr=3DNFS.Server.IP.X 0 0 When the issue occurs, this is what I see on the NFS Server. tcp4 0 0 NFS.Server.IP.X.2049 NFS.Client.IP.X.51550 CLO= SE_WAIT =20 Capturing packets right before the issue is a great idea, but I am concerne= d about running tcpdump for such an extended period of time on an active se= rver. I have gone 9 days with no issue which would be a lot of data and overhead. I will look into disabling the TSO and LRO options and let the group know h= ow it goes. Below are the current options on the NFS Server. lagg0: flags=3D8943 metric = 0 mtu 1500 =09options=3De507bb Please share other ideas if you have them. Jason Breitman On Mar 17, 2021, at 5:58 PM, Rick Macklem wrote: Alan Somers wrote: [stuff snipped] >Is the 128K limit related to MAXPHYS? If so, it should be greater in 13.0. For the client, yes. For the server, no. For the server, it is just a compile time constant NFS_SRVMAXIO. It's mainly related to the fact that I haven't gotten around to testing lar= ger sizes yet. - kern.ipc.maxsockbuf needs to be several times the limit, which means it w= ould have to increase for 1Mbyte. - The session code must negotiate a maximum RPC size > 1 Mbyte. (I think the server code does do this, but it needs to be tested.) And, yes, the client is limited to MAXPHYS. Doing this is on my todo list, rick The client should acquire the attributes that indicate that and set rsize/w= size to that. "# nfsstat -m" on the client should show you what the client is actually using. If it is larger than 128K, set both rsize and wsize to 1= 28K. >Output from the NFS Client when the issue occurs ># netstat -an | grep NFS.Server.IP.X >tcp 0 0 NFS.Client.IP.X:46896 NFS.Server.IP.X:2049 FIN_WAIT2 I'm no TCP guy. Hopefully others might know why the client would be stuck in FIN_WAIT2 (I vaguely recall this means it is waiting for a fin/ack= , but could be wrong?) ># cat /sys/kernel/debug/sunrpc/rpc_xprt/*/info >netid: tcp >addr: NFS.Server.IP.X >port: 2049 >state: 0x51 > >syslog >Mar 4 10:29:27 hostname kernel: [437414.131978] -pid- flgs status -client-= --rqstp- ->timeout ---ops-- >Mar 4 10:29:27 hostname kernel: [437414.133158] 57419 40a1 0 9b723c73 >143= cfadf 30000 4ca953b5 nfsv4 OPEN_NOATTR a:call_connect_status [sunrpc] >q:xp= rt_pending I don't know what OPEN_NOATTR means, but I assume it is some variant of NFSv4 Open operation. [stuff snipped] >Mar 4 10:29:30 hostname kernel: [437417.110517] RPC: 57419 xprt_connect_st= atus: >connect attempt timed out >Mar 4 10:29:30 hostname kernel: [437417.112172] RPC: 57419 call_connect_st= atus >(status -110) I have no idea what status -110 means? >Mar 4 10:29:30 hostname kernel: [437417.113337] RPC: 57419 call_timeout (m= ajor) >Mar 4 10:29:30 hostname kernel: [437417.114385] RPC: 57419 call_bind (stat= us 0) >Mar 4 10:29:30 hostname kernel: [437417.115402] RPC: 57419 call_connect xp= rt >00000000e061831b is not connected >Mar 4 10:29:30 hostname kernel: [437417.116547] RPC: 57419 xprt_connect xp= rt >00000000e061831b is not connected >Mar 4 10:30:31 hostname kernel: [437478.551090] RPC: 57419 xprt_connect_st= atus: >connect attempt timed out >Mar 4 10:30:31 hostname kernel: [437478.552396] RPC: 57419 call_connect_st= atus >(status -110) >Mar 4 10:30:31 hostname kernel: [437478.553417] RPC: 57419 call_timeout (m= inor) >Mar 4 10:30:31 hostname kernel: [437478.554327] RPC: 57419 call_bind (stat= us 0) >Mar 4 10:30:31 hostname kernel: [437478.555220] RPC: 57419 call_connect xp= rt >00000000e061831b is not connected >Mar 4 10:30:31 hostname kernel: [437478.556254] RPC: 57419 xprt_connect xp= rt >00000000e061831b is not connected Is it possible that the client is trying to (re)connect using the same clie= nt port#? I would normally expect the client to create a new TCP connection using a different client port# and then retry the outstanding RPCs. --> Capturing packets when this happens would show us what is going on. If there is a problem on the FreeBSD end, it is most likely a broken network device driver. --> Try disabling TSO , LRO. --> Try a different driver for the net hardware on the server. --> Try a different net chip on the server. If you can capture packets when (not after) the hang occurs, then you can look at them in wireshark and see what is actually happening. (Ideally on both client and server, to check that your network hasn't dropped anything.) --> I know, if the hangs aren't easily reproducible, this isn't easily done. --> Try a newer Linux kernel and see if the problem persists. The Linux folk will get more interested if you can reproduce the problem on 5.12. (Recent bakeathon testing of the 5.12 kernel against the FreeBSD server did not find any issues.) Hopefully the network folk have some insight w.r.t. why the TCP connection is sitting in FIN_WAIT2. rick Jason Breitman _______________________________________________ freebsd-net@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-net To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org" _______________________________________________ freebsd-net@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-net To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org" From owner-freebsd-net@freebsd.org Wed Mar 17 22:48:52 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 14BC957BB3D for ; Wed, 17 Mar 2021 22:48:52 +0000 (UTC) (envelope-from pen@lysator.liu.se) Received: from mail.lysator.liu.se (mail.lysator.liu.se [IPv6:2001:6b0:17:f0a0::3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4F151H64gkz3kB3 for ; Wed, 17 Mar 2021 22:48:51 +0000 (UTC) (envelope-from pen@lysator.liu.se) Received: from mail.lysator.liu.se (localhost [127.0.0.1]) by mail.lysator.liu.se (Postfix) with ESMTP id AF5C540021 for ; Wed, 17 Mar 2021 23:48:42 +0100 (CET) Received: by mail.lysator.liu.se (Postfix, from userid 1004) id 9DFBE40020; Wed, 17 Mar 2021 23:48:42 +0100 (CET) X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on bernadotte.lysator.liu.se X-Spam-Level: X-Spam-Status: No, score=-1.0 required=5.0 tests=ALL_TRUSTED, AWL, HTML_MESSAGE autolearn=disabled version=3.4.2 X-Spam-Score: -1.0 Received: from [192.168.1.132] (h-201-113.A785.priv.bahnhof.se [98.128.201.113]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.lysator.liu.se (Postfix) with ESMTPSA id DD3644000E; Wed, 17 Mar 2021 23:48:40 +0100 (CET) From: Peter Eriksson Message-Id: <3CF50285-AD1F-4D0C-B298-0B6263B4AB45@lysator.liu.se> Mime-Version: 1.0 (Mac OS X Mail 14.0 \(3654.60.0.2.21\)) Subject: Re: NFS Mount Hangs Date: Wed, 17 Mar 2021 23:48:40 +0100 In-Reply-To: <789BCFA9-D6BC-4C5A-AEA2-E6F7C6E26CB5@tildenparkcapital.com> Cc: "freebsd-net@freebsd.org" To: Jason Breitman References: <3750001D-3F1C-4D9A-A9D9-98BCA6CA65A4@tildenparkcapital.com> <33693DE3-7FF8-4FAB-9A75-75576B88A566@tildenparkcapital.com> <789BCFA9-D6BC-4C5A-AEA2-E6F7C6E26CB5@tildenparkcapital.com> X-Mailer: Apple Mail (2.3654.60.0.2.21) X-Virus-Scanned: ClamAV using ClamSMTP X-Rspamd-Queue-Id: 4F151H64gkz3kB3 X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[] Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.34 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 17 Mar 2021 22:48:52 -0000 CLOSE_WAIT on the server side usually indicates that the kernel has sent = the ACK to the clients FIN (start of a shutdown) packet but hasn=E2=80=99t= sent it=E2=80=99s own FIN packet - something that usually happens when = the server has read all data queued up from the client and taken what = actions it need to shutdown down it=E2=80=99s service=E2=80=A6 Here=E2=80=99s a fine ASCII art. Probably needs to be viewed using a = monospaced font :-) Client > ESTABLISHED --> FIN-WAIT-1 +-----> FIN-WAIT-2 +-----> TIME-WAIT = ---> CLOSED > : ^ ^ : > FIN : : ACK FIN : ACK : > v : : v > ESTABLISHED +--> CLOSE-WAIT --....---> LAST-ACK = +--------> CLOSED Server TSO/LRO and/or =E2=80=9Cintelligence=E2=80=9D in some smart network = cards can cause all kinds of interesting bugs. What ethernet cards are = you using? (TSO/LRO seems to be working better these days for our Intel X710 cards, = but a couple of years ago they would freeze up on us so we had to = disable it) Hmm.. Perhaps the NFS server is waiting for some locks to be released = before it can close down it=E2=80=99s end of the TCP link? Reservations?=20= But I=E2=80=99d suspect something else since we=E2=80=99ve been running = NFSv4.1/Kerberos on our FreeBSD 11.3/12.2 servers for a long time with = many Linux clients and most issues (the last couple of years) we=E2=80=99v= e seen have been on the Linux end of things=E2=80=A6 Like the bugs in = the Linux gss daemons or their single-threaded mount() sys call, or = automounter freezing up... and other fun bugs. - Peter > On 17 Mar 2021, at 23:17, Jason Breitman = wrote: >=20 > Thank you for the responses. > The NFS Client does properly negotiate down to 128K for the rsize and = wsize. >=20 > The client port should be changing as we are using the noresvport = option. >=20 > On the NFS Client > cat /proc/mounts > nfs-server.domain.com:/data /mnt/data nfs4 = rw,relatime,vers=3D4.1,rsize=3D131072,wsize=3D131072,namlen=3D255,hard,nor= esvport,proto=3Dtcp,timeo=3D600,retrans=3D2,sec=3Dkrb5,clientaddr=3DNFS.Cl= ient.IP.X,lookupcache=3Dpos,local_lock=3Dnone,addr=3DNFS.Server.IP.X 0 0 >=20 > When the issue occurs, this is what I see on the NFS Server. > tcp4 0 0 NFS.Server.IP.X.2049 NFS.Client.IP.X.51550 = CLOSE_WAIT =20 >=20 > Capturing packets right before the issue is a great idea, but I am = concerned about running tcpdump for such an extended period of time on = an active server. > I have gone 9 days with no issue which would be a lot of data and = overhead. >=20 > I will look into disabling the TSO and LRO options and let the group = know how it goes. > Below are the current options on the NFS Server. > lagg0: flags=3D8943 = metric 0 mtu 1500 > = options=3De507bb >=20 > Please share other ideas if you have them. >=20 > Jason Breitman >=20 >=20 > On Mar 17, 2021, at 5:58 PM, Rick Macklem = wrote: >=20 > Alan Somers wrote: > [stuff snipped] >> Is the 128K limit related to MAXPHYS? If so, it should be greater in = 13.0. > For the client, yes. For the server, no. > For the server, it is just a compile time constant NFS_SRVMAXIO. >=20 > It's mainly related to the fact that I haven't gotten around to = testing larger > sizes yet. > - kern.ipc.maxsockbuf needs to be several times the limit, which means = it would > have to increase for 1Mbyte. > - The session code must negotiate a maximum RPC size > 1 Mbyte. > (I think the server code does do this, but it needs to be tested.) > And, yes, the client is limited to MAXPHYS. >=20 > Doing this is on my todo list, rick >=20 > The client should acquire the attributes that indicate that and set = rsize/wsize > to that. "# nfsstat -m" on the client should show you what the client > is actually using. If it is larger than 128K, set both rsize and wsize = to 128K. >=20 >> Output from the NFS Client when the issue occurs >> # netstat -an | grep NFS.Server.IP.X >> tcp 0 0 NFS.Client.IP.X:46896 NFS.Server.IP.X:2049 FIN_WAIT2 > I'm no TCP guy. Hopefully others might know why the client would be > stuck in FIN_WAIT2 (I vaguely recall this means it is waiting for a = fin/ack, > but could be wrong?) >=20 >> # cat /sys/kernel/debug/sunrpc/rpc_xprt/*/info >> netid: tcp >> addr: NFS.Server.IP.X >> port: 2049 >> state: 0x51 >>=20 >> syslog >> Mar 4 10:29:27 hostname kernel: [437414.131978] -pid- flgs status = -client- --rqstp- ->timeout ---ops-- >> Mar 4 10:29:27 hostname kernel: [437414.133158] 57419 40a1 0 9b723c73 = >143cfadf 30000 4ca953b5 nfsv4 OPEN_NOATTR a:call_connect_status = [sunrpc] >q:xprt_pending > I don't know what OPEN_NOATTR means, but I assume it is some variant > of NFSv4 Open operation. > [stuff snipped] >> Mar 4 10:29:30 hostname kernel: [437417.110517] RPC: 57419 = xprt_connect_status: >connect attempt timed out >> Mar 4 10:29:30 hostname kernel: [437417.112172] RPC: 57419 = call_connect_status >> (status -110) > I have no idea what status -110 means? >> Mar 4 10:29:30 hostname kernel: [437417.113337] RPC: 57419 = call_timeout (major) >> Mar 4 10:29:30 hostname kernel: [437417.114385] RPC: 57419 call_bind = (status 0) >> Mar 4 10:29:30 hostname kernel: [437417.115402] RPC: 57419 = call_connect xprt >00000000e061831b is not connected >> Mar 4 10:29:30 hostname kernel: [437417.116547] RPC: 57419 = xprt_connect xprt >00000000e061831b is not connected >> Mar 4 10:30:31 hostname kernel: [437478.551090] RPC: 57419 = xprt_connect_status: >connect attempt timed out >> Mar 4 10:30:31 hostname kernel: [437478.552396] RPC: 57419 = call_connect_status >(status -110) >> Mar 4 10:30:31 hostname kernel: [437478.553417] RPC: 57419 = call_timeout (minor) >> Mar 4 10:30:31 hostname kernel: [437478.554327] RPC: 57419 call_bind = (status 0) >> Mar 4 10:30:31 hostname kernel: [437478.555220] RPC: 57419 = call_connect xprt >00000000e061831b is not connected >> Mar 4 10:30:31 hostname kernel: [437478.556254] RPC: 57419 = xprt_connect xprt >00000000e061831b is not connected > Is it possible that the client is trying to (re)connect using the same = client port#? > I would normally expect the client to create a new TCP connection = using a > different client port# and then retry the outstanding RPCs. > --> Capturing packets when this happens would show us what is going = on. >=20 > If there is a problem on the FreeBSD end, it is most likely a broken > network device driver. > --> Try disabling TSO , LRO. > --> Try a different driver for the net hardware on the server. > --> Try a different net chip on the server. > If you can capture packets when (not after) the hang > occurs, then you can look at them in wireshark and see > what is actually happening. (Ideally on both client and > server, to check that your network hasn't dropped anything.) > --> I know, if the hangs aren't easily reproducible, this isn't > easily done. > --> Try a newer Linux kernel and see if the problem persists. > The Linux folk will get more interested if you can reproduce > the problem on 5.12. (Recent bakeathon testing of the 5.12 > kernel against the FreeBSD server did not find any issues.) >=20 > Hopefully the network folk have some insight w.r.t. why > the TCP connection is sitting in FIN_WAIT2. >=20 > rick >=20 >=20 >=20 > Jason Breitman >=20 >=20 >=20 >=20 >=20 >=20 > _______________________________________________ > freebsd-net@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-net > To unsubscribe, send any mail to = "freebsd-net-unsubscribe@freebsd.org" >=20 > _______________________________________________ > freebsd-net@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-net > To unsubscribe, send any mail to = "freebsd-net-unsubscribe@freebsd.org" >=20 > _______________________________________________ > freebsd-net@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-net > To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org" From owner-freebsd-net@freebsd.org Wed Mar 17 23:16:03 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id B045157C4FB for ; Wed, 17 Mar 2021 23:16:03 +0000 (UTC) (envelope-from jbreitman@tildenparkcapital.com) Received: from us-smtp-delivery-145.mimecast.com (us-smtp-delivery-145.mimecast.com [63.128.21.145]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-SHA384 (256/256 bits)) (Client CN "*.mimecast.com", Issuer "DigiCert TLS RSA SHA256 2020 CA1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4F15cg0FNjz3m3G for ; Wed, 17 Mar 2021 23:16:02 +0000 (UTC) (envelope-from jbreitman@tildenparkcapital.com) Received: from zmcc-3-mta-2.zmailcloud.com (zmcc-3-mta-2.zmailcloud.com [35.238.170.66]) (Using TLS) by relay.mimecast.com with ESMTP id us-mta-464-1kXTYh_7MOCYl1amNkZuJQ-1; Wed, 17 Mar 2021 19:16:00 -0400 X-MC-Unique: 1kXTYh_7MOCYl1amNkZuJQ-1 Received: from zmcc-3-mta-2.zmailcloud.com (localhost [127.0.0.1]) by zmcc-3-mta-2.zmailcloud.com (Postfix) with ESMTPS id BFA53E0D63; Wed, 17 Mar 2021 18:15:59 -0500 (CDT) Received: from localhost (localhost [127.0.0.1]) by zmcc-3-mta-2.zmailcloud.com (Postfix) with ESMTP id AF0E0E0E07; Wed, 17 Mar 2021 18:15:59 -0500 (CDT) X-Virus-Scanned: amavisd-new at zmcc-3-mta-2.zmailcloud.com Received: from zmcc-3-mta-2.zmailcloud.com ([127.0.0.1]) by localhost (zmcc-3-mta-2.zmailcloud.com [127.0.0.1]) (amavisd-new, port 10026) with ESMTP id 7Vs3wg4aSBxf; Wed, 17 Mar 2021 18:15:59 -0500 (CDT) Received: from jbreitman-mac.zxcvm.com (unknown [72.22.182.150]) by zmcc-3-mta-2.zmailcloud.com (Postfix) with ESMTPSA id 72699E0D63; Wed, 17 Mar 2021 18:15:59 -0500 (CDT) Mime-Version: 1.0 (Mac OS X Mail 13.4 \(3608.120.23.2.4\)) Subject: Re: NFS Mount Hangs From: Jason Breitman In-Reply-To: <3CF50285-AD1F-4D0C-B298-0B6263B4AB45@lysator.liu.se> Date: Wed, 17 Mar 2021 19:15:58 -0400 Cc: "freebsd-net@freebsd.org" Message-Id: <347EB906-A830-4E97-AC2E-328B6EA7E8B9@tildenparkcapital.com> References: <3750001D-3F1C-4D9A-A9D9-98BCA6CA65A4@tildenparkcapital.com> <33693DE3-7FF8-4FAB-9A75-75576B88A566@tildenparkcapital.com> <789BCFA9-D6BC-4C5A-AEA2-E6F7C6E26CB5@tildenparkcapital.com> <3CF50285-AD1F-4D0C-B298-0B6263B4AB45@lysator.liu.se> To: Peter Eriksson X-Mailer: Apple Mail (2.3608.120.23.2.4) X-Mimecast-Spam-Score: 0 X-Mimecast-Originator: tildenparkcapital.com Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable X-Rspamd-Queue-Id: 4F15cg0FNjz3m3G X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of jbreitman@tildenparkcapital.com designates 63.128.21.145 as permitted sender) smtp.mailfrom=jbreitman@tildenparkcapital.com X-Spamd-Result: default: False [-2.90 / 15.00]; TO_DN_EQ_ADDR_SOME(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; RCVD_COUNT_FIVE(0.00)[6]; MID_RHS_MATCH_FROM(0.00)[]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+ip4:63.128.21.0/24]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[tildenparkcapital.com: no valid DMARC record]; ARC_NA(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; RWL_MAILSPIKE_EXCELLENT(0.00)[63.128.21.145:from]; TO_MATCH_ENVRCPT_SOME(0.00)[]; NEURAL_HAM_SHORT(-1.00)[-1.000]; RCPT_COUNT_TWO(0.00)[2]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:30031, ipnet:63.128.21.0/24, country:US]; RCVD_TLS_LAST(0.00)[]; MAILMAN_DEST(0.00)[freebsd-net]; RCVD_IN_DNSWL_LOW(-0.10)[63.128.21.145:from] X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 17 Mar 2021 23:16:03 -0000 We are using the Intel Ethernet Network Adapter X722. Jason Breitman On Mar 17, 2021, at 6:48 PM, Peter Eriksson wrote: CLOSE_WAIT on the server side usually indicates that the kernel has sent th= e ACK to the clients FIN (start of a shutdown) packet but hasn=E2=80=99t se= nt it=E2=80=99s own FIN packet - something that usually happens when the se= rver has read all data queued up from the client and taken what actions it = need to shutdown down it=E2=80=99s service=E2=80=A6 Here=E2=80=99s a fine ASCII art. Probably needs to be viewed using a monosp= aced font :-) Client > ESTABLISHED --> FIN-WAIT-1 +-----> FIN-WAIT-2 +-----> TIME-WAIT ---> = CLOSED > : ^ ^ : > FIN : : ACK FIN : ACK : > v : : v > ESTABLISHED +--> CLOSE-WAIT --....---> LAST-ACK +--------> = CLOSED Server TSO/LRO and/or =E2=80=9Cintelligence=E2=80=9D in some smart network cards c= an cause all kinds of interesting bugs. What ethernet cards are you using? (TSO/LRO seems to be working better these days for our Intel X710 cards, bu= t a couple of years ago they would freeze up on us so we had to disable it) Hmm.. Perhaps the NFS server is waiting for some locks to be released befor= e it can close down it=E2=80=99s end of the TCP link? Reservations?=20 But I=E2=80=99d suspect something else since we=E2=80=99ve been running NFS= v4.1/Kerberos on our FreeBSD 11.3/12.2 servers for a long time with many Li= nux clients and most issues (the last couple of years) we=E2=80=99ve seen h= ave been on the Linux end of things=E2=80=A6 Like the bugs in the Linux gss= daemons or their single-threaded mount() sys call, or automounter freezing= up... and other fun bugs. - Peter > On 17 Mar 2021, at 23:17, Jason Breitman wrote: >=20 > Thank you for the responses. > The NFS Client does properly negotiate down to 128K for the rsize and wsi= ze. >=20 > The client port should be changing as we are using the noresvport option. >=20 > On the NFS Client > cat /proc/mounts > nfs-server.domain.com:/data /mnt/data nfs4 rw,relatime,vers=3D4.1,rsize= =3D131072,wsize=3D131072,namlen=3D255,hard,noresvport,proto=3Dtcp,timeo=3D6= 00,retrans=3D2,sec=3Dkrb5,clientaddr=3DNFS.Client.IP.X,lookupcache=3Dpos,lo= cal_lock=3Dnone,addr=3DNFS.Server.IP.X 0 0 >=20 > When the issue occurs, this is what I see on the NFS Server. > tcp4 0 0 NFS.Server.IP.X.2049 NFS.Client.IP.X.51550 C= LOSE_WAIT =20 >=20 > Capturing packets right before the issue is a great idea, but I am concer= ned about running tcpdump for such an extended period of time on an active = server. > I have gone 9 days with no issue which would be a lot of data and overhea= d. >=20 > I will look into disabling the TSO and LRO options and let the group know= how it goes. > Below are the current options on the NFS Server. > lagg0: flags=3D8943 metri= c 0 mtu 1500 > =09options=3De507bb >=20 > Please share other ideas if you have them. >=20 > Jason Breitman >=20 >=20 > On Mar 17, 2021, at 5:58 PM, Rick Macklem wrote: >=20 > Alan Somers wrote: > [stuff snipped] >> Is the 128K limit related to MAXPHYS? If so, it should be greater in 13.= 0. > For the client, yes. For the server, no. > For the server, it is just a compile time constant NFS_SRVMAXIO. >=20 > It's mainly related to the fact that I haven't gotten around to testing l= arger > sizes yet. > - kern.ipc.maxsockbuf needs to be several times the limit, which means it= would > have to increase for 1Mbyte. > - The session code must negotiate a maximum RPC size > 1 Mbyte. > (I think the server code does do this, but it needs to be tested.) > And, yes, the client is limited to MAXPHYS. >=20 > Doing this is on my todo list, rick >=20 > The client should acquire the attributes that indicate that and set rsize= /wsize > to that. "# nfsstat -m" on the client should show you what the client > is actually using. If it is larger than 128K, set both rsize and wsize to= 128K. >=20 >> Output from the NFS Client when the issue occurs >> # netstat -an | grep NFS.Server.IP.X >> tcp 0 0 NFS.Client.IP.X:46896 NFS.Server.IP.X:2049 FIN_WAIT2 > I'm no TCP guy. Hopefully others might know why the client would be > stuck in FIN_WAIT2 (I vaguely recall this means it is waiting for a fin/a= ck, > but could be wrong?) >=20 >> # cat /sys/kernel/debug/sunrpc/rpc_xprt/*/info >> netid: tcp >> addr: NFS.Server.IP.X >> port: 2049 >> state: 0x51 >>=20 >> syslog >> Mar 4 10:29:27 hostname kernel: [437414.131978] -pid- flgs status -clien= t- --rqstp- ->timeout ---ops-- >> Mar 4 10:29:27 hostname kernel: [437414.133158] 57419 40a1 0 9b723c73 >1= 43cfadf 30000 4ca953b5 nfsv4 OPEN_NOATTR a:call_connect_status [sunrpc] >q:= xprt_pending > I don't know what OPEN_NOATTR means, but I assume it is some variant > of NFSv4 Open operation. > [stuff snipped] >> Mar 4 10:29:30 hostname kernel: [437417.110517] RPC: 57419 xprt_connect_= status: >connect attempt timed out >> Mar 4 10:29:30 hostname kernel: [437417.112172] RPC: 57419 call_connect_= status >> (status -110) > I have no idea what status -110 means? >> Mar 4 10:29:30 hostname kernel: [437417.113337] RPC: 57419 call_timeout = (major) >> Mar 4 10:29:30 hostname kernel: [437417.114385] RPC: 57419 call_bind (st= atus 0) >> Mar 4 10:29:30 hostname kernel: [437417.115402] RPC: 57419 call_connect = xprt >00000000e061831b is not connected >> Mar 4 10:29:30 hostname kernel: [437417.116547] RPC: 57419 xprt_connect = xprt >00000000e061831b is not connected >> Mar 4 10:30:31 hostname kernel: [437478.551090] RPC: 57419 xprt_connect_= status: >connect attempt timed out >> Mar 4 10:30:31 hostname kernel: [437478.552396] RPC: 57419 call_connect_= status >(status -110) >> Mar 4 10:30:31 hostname kernel: [437478.553417] RPC: 57419 call_timeout = (minor) >> Mar 4 10:30:31 hostname kernel: [437478.554327] RPC: 57419 call_bind (st= atus 0) >> Mar 4 10:30:31 hostname kernel: [437478.555220] RPC: 57419 call_connect = xprt >00000000e061831b is not connected >> Mar 4 10:30:31 hostname kernel: [437478.556254] RPC: 57419 xprt_connect = xprt >00000000e061831b is not connected > Is it possible that the client is trying to (re)connect using the same cl= ient port#? > I would normally expect the client to create a new TCP connection using a > different client port# and then retry the outstanding RPCs. > --> Capturing packets when this happens would show us what is going on. >=20 > If there is a problem on the FreeBSD end, it is most likely a broken > network device driver. > --> Try disabling TSO , LRO. > --> Try a different driver for the net hardware on the server. > --> Try a different net chip on the server. > If you can capture packets when (not after) the hang > occurs, then you can look at them in wireshark and see > what is actually happening. (Ideally on both client and > server, to check that your network hasn't dropped anything.) > --> I know, if the hangs aren't easily reproducible, this isn't > easily done. > --> Try a newer Linux kernel and see if the problem persists. > The Linux folk will get more interested if you can reproduce > the problem on 5.12. (Recent bakeathon testing of the 5.12 > kernel against the FreeBSD server did not find any issues.) >=20 > Hopefully the network folk have some insight w.r.t. why > the TCP connection is sitting in FIN_WAIT2. >=20 > rick >=20 >=20 >=20 > Jason Breitman >=20 >=20 >=20 >=20 >=20 >=20 > _______________________________________________ > freebsd-net@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-net > To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org" >=20 > _______________________________________________ > freebsd-net@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-net > To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org" >=20 > _______________________________________________ > freebsd-net@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-net > To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org" From owner-freebsd-net@freebsd.org Thu Mar 18 03:35:15 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 02BD75AD01C for ; Thu, 18 Mar 2021 03:35:15 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 4F1CMk6Tzfz4Y5G for ; Thu, 18 Mar 2021 03:35:14 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id DCCF05AD01B; Thu, 18 Mar 2021 03:35:14 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id DC95C5ACBDF for ; Thu, 18 Mar 2021 03:35:14 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4F1CMk5qFLz4YLs for ; Thu, 18 Mar 2021 03:35:14 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id B76201AAEE for ; Thu, 18 Mar 2021 03:35:14 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 12I3ZEaR020493 for ; Thu, 18 Mar 2021 03:35:14 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 12I3ZEgO020492 for net@FreeBSD.org; Thu, 18 Mar 2021 03:35:14 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 254303] Fatal trap 12: page fault while in kernel mode ((frr 7.5_1 + Freebsd 13 Beta3) zebra crashes server when routes are populated) Date: Thu, 18 Mar 2021 03:35:14 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: Unspecified X-Bugzilla-Keywords: panic X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: zlei.huang@gmail.com X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: net@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 18 Mar 2021 03:35:15 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D254303 --- Comment #6 from Zhenlei Huang --- CC Alexander V. Chernikov --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-net@freebsd.org Thu Mar 18 08:06:50 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 081FD5B167F for ; Thu, 18 Mar 2021 08:06:50 +0000 (UTC) (envelope-from gerrit.kuehn@aei.mpg.de) Received: from mailgate2.uni-hannover.de (mailgate2.uni-hannover.de [130.75.2.114]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4F1KP50wW3z4mf3 for ; Thu, 18 Mar 2021 08:06:48 +0000 (UTC) (envelope-from gerrit.kuehn@aei.mpg.de) Received: from intranet.aei.uni-hannover.de (ahin1.aei.uni-hannover.de [130.75.117.40]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mailgate2.uni-hannover.de (Postfix) with ESMTPS id 75337A7C for ; Thu, 18 Mar 2021 09:06:46 +0100 (CET) Received: from comet2.terra.ger ([87.146.73.224]) by intranet.aei.uni-hannover.de (IBM Domino Release 9.0.1FP8) with ESMTP id 2021031809064567-163323 ; Thu, 18 Mar 2021 09:06:45 +0100 Date: Thu, 18 Mar 2021 09:06:45 +0100 From: Gerrit Kuehn To: freebsd-net@freebsd.org Subject: Re: NFS Mount Hangs Message-ID: <20210318090645.2e0d992f@comet2.terra.ger> In-Reply-To: <789BCFA9-D6BC-4C5A-AEA2-E6F7C6E26CB5@tildenparkcapital.com> References: <3750001D-3F1C-4D9A-A9D9-98BCA6CA65A4@tildenparkcapital.com> <33693DE3-7FF8-4FAB-9A75-75576B88A566@tildenparkcapital.com> <789BCFA9-D6BC-4C5A-AEA2-E6F7C6E26CB5@tildenparkcapital.com> X-Mailer: Claws Mail 3.17.8 (GTK+ 2.24.33; amd64-portbld-freebsd12.1) MIME-Version: 1.0 X-MIMETrack: Itemize by SMTP Server on intranet/aei-hannover(Release 9.0.1FP8|February 23, 2017) at 18/03/2021 09:06:45, Serialize by Router on intranet/aei-hannover(Release 9.0.1FP8|February 23, 2017) at 18/03/2021 09:06:45, Serialize complete at 18/03/2021 09:06:45 X-TNEFEvaluated: 1 Content-Transfer-Encoding: 7bit Content-Type: text/plain; charset=US-ASCII X-Virus-Scanned: clamav-milter 0.102.4 at mailgate2 X-Virus-Status: Clean X-Rspamd-Queue-Id: 4F1KP50wW3z4mf3 X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=none (mx1.freebsd.org: domain of gerrit.kuehn@aei.mpg.de has no SPF policy when checking 130.75.2.114) smtp.mailfrom=gerrit.kuehn@aei.mpg.de X-Spamd-Result: default: False [-2.30 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FROM_HAS_DN(0.00)[]; RWL_MAILSPIKE_GOOD(0.00)[130.75.2.114:from]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; TO_DN_NONE(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-net@freebsd.org]; AUTH_NA(1.00)[]; RCPT_COUNT_ONE(0.00)[1]; RCVD_COUNT_THREE(0.00)[3]; DMARC_NA(0.00)[mpg.de]; RCVD_IN_DNSWL_MED(-0.20)[130.75.2.114:from]; NEURAL_HAM_SHORT(-1.00)[-1.000]; R_SPF_NA(0.00)[no SPF record]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:680, ipnet:130.75.0.0/16, country:DE]; RCVD_TLS_LAST(0.00)[]; MAILMAN_DEST(0.00)[freebsd-net]; RECEIVED_SPAMHAUS_PBL(0.00)[87.146.73.224:received] X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 18 Mar 2021 08:06:50 -0000 On Wed, 17 Mar 2021 18:17:14 -0400 Jason Breitman wrote: > I will look into disabling the TSO and LRO options and let the group > know how it goes. Below are the current options on the NFS Server. > lagg0: flags=8943 > metric 0 mtu 1500 > options=e507bb What laggproto are you using, and what kind of switch is connected on the other end? cu Gerrit From owner-freebsd-net@freebsd.org Thu Mar 18 12:42:26 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 1613E573CC7 for ; Thu, 18 Mar 2021 12:42:26 +0000 (UTC) (envelope-from Richard.Scheffenegger@netapp.com) Received: from NAM11-DM6-obe.outbound.protection.outlook.com (mail-dm6nam11on2064.outbound.protection.outlook.com [40.107.223.64]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "DigiCert Cloud Services CA-1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4F1RW436cnz3PhL for ; Thu, 18 Mar 2021 12:42:24 +0000 (UTC) (envelope-from Richard.Scheffenegger@netapp.com) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=b3pSgi197LJ7Ff7a/MG3ZUOqfs5TzUNuxFk9/nF55m6dDdV/MIjBtCu3RJbrLIGK3oKwd2XQf6WnviJPObGqobc0eby3WGChE1qC0ICHqX5MDbEmh2AgCTGB5xOgY50YFcsL2pSkDkKly00aVtYxtFRRDBqrwVjYdxtXs/ANj1aK0BcRygyC8zGbSguEztA0Vr/hA3ttqvtZ/tTIGHMPEZcmPGPyi/bm9A88ixnjbhv/XJ2KrMvdOriBppioo500p6C/dSRVZvneTyl/MIrRnEKU1MzMKxWTx89zKZKz5n2/EykFPTRImnktMfw9ZUlaX5pQ+4176gHsazlwZZ+ZCQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=xsp8LHPzOuxjNv+aVk8fDJh/XkiZMOsAoDSTgmRBT4c=; b=VaeFHCa3lUHiyJpz7JEMkyyVR9n+gWP26MtUqLdhLCCVKraFOPfWYkAURJ3/Dx3ivsBzbmmGcokgBZqFfffRcvl9BY4kujXaO4+nrCzfju7ao9LOIZb2+UqFohB6yEmtFTniO26dOqT0nWsdv4nMm3XzHkZMePF/H5Znl1xk61nz05uLs0LUP7fpUEVcflYl3OHP75+kTdlC8e0Sv1c6d+uyfjtqDA1kcKuD4Ye/kdi+JKDmVcZdN3mJoUEL7CCWmKZPRPLviGSWZA4vqCn6A/uE0py7EwdduNcCKZ11AMBVLozotVxLSedlugkzIfRVcwv/oocuAuSovHaPnHMmmQ== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=netapp.com; dmarc=pass action=none header.from=netapp.com; dkim=pass header.d=netapp.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=netapp.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=xsp8LHPzOuxjNv+aVk8fDJh/XkiZMOsAoDSTgmRBT4c=; b=L8hAJ+JRkANYodH3ON76kB8wAdFZxdmsCEonG8cJbt9FivG3El+urYt86FM6fQ6R4v6dVLrpbLIdFx9D/7rZVDlQvVusZ5UBgVX1E4gJ87S0d6Vu1VBRTuOkCjk9PYhK6S0PgIWZFeCNaH09OoiYCSFTQ1k8cNcMLsC8vSeCMSHpECUUh5W7Hpsa3t9EXLff6i+ycf/QWincVpH3jMDc+hsMWspkIqs59/5U1M1ysCRU+uu5FyBCfRz2XYurZxmkrvtJw3Ikd8t1D0PuTay7ibrXkNiALKyOD//MO5qCeQFz81Q2I0It6thbfy85hzoBD69z2FBU06o+ar2oT9zwmA== Received: from SN4PR0601MB3728.namprd06.prod.outlook.com (2603:10b6:803:51::24) by SN7PR06MB7309.namprd06.prod.outlook.com (2603:10b6:806:f6::19) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3955.18; Thu, 18 Mar 2021 12:42:21 +0000 Received: from SN4PR0601MB3728.namprd06.prod.outlook.com ([fe80::ccb:944d:e270:63ef]) by SN4PR0601MB3728.namprd06.prod.outlook.com ([fe80::ccb:944d:e270:63ef%6]) with mapi id 15.20.3955.018; Thu, 18 Mar 2021 12:42:21 +0000 From: "Scheffenegger, Richard" To: Rick Macklem , Jason Breitman , "freebsd-net@freebsd.org" Subject: AW: NFS Mount Hangs Thread-Topic: NFS Mount Hangs Thread-Index: AQHXG1GB6agsoGWN0UqRoZFo/qoHTaqItMcAgAD7PVA= Date: Thu, 18 Mar 2021 12:42:21 +0000 Message-ID: References: <3750001D-3F1C-4D9A-A9D9-98BCA6CA65A4@tildenparkcapital.com>, <33693DE3-7FF8-4FAB-9A75-75576B88A566@tildenparkcapital.com> In-Reply-To: Accept-Language: de-AT, en-US Content-Language: de-DE X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [185.236.167.136] x-ms-publictraffictype: Email x-ms-office365-filtering-correlation-id: 45acea10-86ca-4f6f-1835-08d8ea0b463f x-ms-traffictypediagnostic: SN7PR06MB7309: x-microsoft-antispam-prvs: x-ms-oob-tlc-oobclassifiers: OLM:8273; x-ms-exchange-senderadcheck: 1 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: Vs2GBcidVwFLEBAXyN6HdblF48gOh6CR1s6Ybs2is1DJYuJAeH5v9DOAOl+yEfFJqi4zXdTUVXsMqeiqO1Ld3aowxqnC7JxI7A9woeHCcSG9NOA4vn3g5q+EBKJeYzXtPSUVqxd2I3xXcDkU7eSdBcVvlmjJ4A5mOBaERLBwkCtd6mAypYcKAwxIMGhK+aFGjsg95iWyXEJWKQeqQRLNs2PwFEhol4Dt8f//hLKdTIPi3DUo3ksNeDuIPl9FjVngv+d13wrXtD9XEgvDC66JBq0oViw/KdwtoHXJ4wh7KQHtBKzbbWllcUZdkmZewS/+62z6m1oAvi1IXzs+YfnXb9U/0FHYqg4FbdCi/JCpbUbz2Y4NSj7Ncdpuajyk7lN7iA9N+FO7y4sPRy0eAitSUggSVSvQaEsXfjfs049NOEq6jzIU8e9sm1QP1A7G6VC3qwqv9NnTQYQWD9ymBWK9ZeWbvu+Asq4Aj99gd2ChXBlHo1PPRVeMItzSvHOrxAmW4f4/enmkhoX6Kq70BiFXMG/9Ougfl+exab1/LAlZ40vefDUgqGQo2n3DHJat6MTPlrCmpiMAa1MnUnUTWJzFUqQSvXHFzysbu6jN3kKG3G5tehxMUK7gGujWL6wR1aOn x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:SN4PR0601MB3728.namprd06.prod.outlook.com; PTR:; CAT:NONE; SFS:(4636009)(396003)(136003)(376002)(39860400002)(346002)(366004)(64756008)(4744005)(66946007)(5660300002)(9686003)(296002)(7696005)(316002)(33656002)(83380400001)(66476007)(110136005)(71200400001)(55016002)(66446008)(66556008)(76116006)(6506007)(26005)(186003)(7116003)(8936002)(8676002)(86362001)(52536014)(2906002)(38100700001)(478600001); DIR:OUT; SFP:1101; x-ms-exchange-antispam-messagedata: =?us-ascii?Q?0ZilYZ/mv7Z/Kue0UnnGQUPCXwtGI1MazAwds+cAI11FSXhDzk1TYHZdWOv2?= =?us-ascii?Q?u74TqFKYcA9F0cD+MxMiiBx9NRq1u8mIGXWoC+riCGe3mmpDsQEmu23o9gAC?= =?us-ascii?Q?7K65H2itJJ3/CbmwHYW/BSTnzkaYztS3kU9QiC9o86I74HpyODD/kwJjsYau?= =?us-ascii?Q?9a2oEv+WCSSwAi6Kh1kvmMU7CL8w5tdA1qVpk6xYpXNiPjY/kk1TxzjLPRbl?= =?us-ascii?Q?vp1YI1LP0T3yrcROBG7II0wG+A4fi4Ge/zaK87qe/DzDVVwexUx12EAQKAH2?= =?us-ascii?Q?lVSP4ZuIC0ksyEBfyUxiiMSYUWs0Hiq0Iqh8Rk4mS0YKWKhfBwOdMH+/ShJC?= =?us-ascii?Q?eJ88z1h55yE721M3kTUVM8b9r9IcRTZwyUUnS+aPoR30pgIqGou1lntUBupy?= =?us-ascii?Q?iwhYjjqUbqC2s+L663T+D0UScHFh3QrQMxrDA7TUjMWHvCi2CfbVUmUDP/0B?= =?us-ascii?Q?U59wc7CcxuMVeuAultZrxZkvn1OIljQJy3JC/CE/gWqUuy1t8yhnXtXqbjl2?= =?us-ascii?Q?zMHXR3Ko6sbXJHUCeeh1ct1QUMyW6U9u7POz7dHHp9l42t92UR/anNeYV8JB?= =?us-ascii?Q?6S6JXIEe3ekwJ+12jJuA6HElXJU6B73AQPbPDo6R8U/VEhHRxD1Uf9opdHU7?= =?us-ascii?Q?R7bFx65eWRCoh0fef3kMN3rA8/wHZZhqH3bWQOjAJy7+nXHWeA3EmpogkfOp?= =?us-ascii?Q?OTMsv57jtnD8JLlLiyep1RTAdb9KBHbKCfBpRlMCRASsGk8AEyXNwa9KRvLM?= =?us-ascii?Q?xpr0I6nrTYQ2ebotx8N31U+qoGYyB7SXJJ37gmiZuvJ/+LxePAWWAw6UU9GP?= =?us-ascii?Q?ar+/y2jZIAypFmMIkTKrcEp2e2YGri6NLtEPO6R1dIUcu7cmfaLLeE6U6VAI?= =?us-ascii?Q?pYw6YBocotKxS2Wl1meZ4+iUkau/B/JMnbni+3ZEM3HNuNbDTs5Kp4xLmBCY?= =?us-ascii?Q?VebObvjnZg0VgcZCL024TmLe4NucG8bo3pELKTvwVSIMRllhg4fZLoBqOY0T?= =?us-ascii?Q?XUliCmXmD87M8duDKF5C9GQWdlcQmJrgcbNleW0j9o15kL4yboUpT/Y2nUZd?= =?us-ascii?Q?8+IZMk8OSX1E9s7Ee/jpNZLD2U7NAY17AL6eSD49PPmOIBliXCNfN8MX1hdm?= =?us-ascii?Q?QgDlO579VBiY3+1V8jvU20z9ytOyktxJWZr6o6gzlKSPplP0CxBsA1P9kEV/?= =?us-ascii?Q?Cs8Gf6pROfRYHoxKzsb8Qn9S0eJjtw2Ev6zq8m5YyJMlX9f41onbipLGesY6?= =?us-ascii?Q?Tj5E9+qgs9CM0ABLfC/LrwK2mO0rp3W9PjnrOtn7azahK6WWVvL61rXziNCc?= =?us-ascii?Q?G3z6TMWAoIYi1P573Hih5f51?= x-ms-exchange-transport-forked: True Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-OriginatorOrg: netapp.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: SN4PR0601MB3728.namprd06.prod.outlook.com X-MS-Exchange-CrossTenant-Network-Message-Id: 45acea10-86ca-4f6f-1835-08d8ea0b463f X-MS-Exchange-CrossTenant-originalarrivaltime: 18 Mar 2021 12:42:21.5575 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 4b0911a0-929b-4715-944b-c03745165b3a X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: msiLCIylhMbbeWYX45urp1bbW7LOqlj3u5FOnC2pZCFsre87fS5VqTCJc443gHCooN25a6eUpZkyStyeOUOrpg== X-MS-Exchange-Transport-CrossTenantHeadersStamped: SN7PR06MB7309 X-Rspamd-Queue-Id: 4F1RW436cnz3PhL X-Spamd-Bar: ------ Authentication-Results: mx1.freebsd.org; dkim=pass header.d=netapp.com header.s=selector1 header.b=L8hAJ+JR; arc=pass (microsoft.com:s=arcselector9901:i=1); dmarc=pass (policy=none) header.from=netapp.com; spf=pass (mx1.freebsd.org: domain of Richard.Scheffenegger@netapp.com designates 40.107.223.64 as permitted sender) smtp.mailfrom=Richard.Scheffenegger@netapp.com X-Spamd-Result: default: False [-6.00 / 15.00]; TO_DN_EQ_ADDR_SOME(0.00)[]; HAS_XOIP(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:40.107.0.0/16]; RCVD_COUNT_THREE(0.00)[3]; DKIM_TRACE(0.00)[netapp.com:+]; DMARC_POLICY_ALLOW(-0.50)[netapp.com,none]; NEURAL_HAM_SHORT(-1.00)[-1.000]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[40.107.223.64:from]; ARC_ALLOW(-1.00)[microsoft.com:s=arcselector9901:i=1]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:8075, ipnet:40.104.0.0/14, country:US]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[netapp.com:s=selector1]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; SPAMHAUS_ZRD(0.00)[40.107.223.64:from:127.0.2.255]; DWL_DNSWL_LOW(-1.00)[netapp.com:dkim]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[40.107.223.64:from]; RWL_MAILSPIKE_POSSIBLE(0.00)[40.107.223.64:from]; MAILMAN_DEST(0.00)[freebsd-net] X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 18 Mar 2021 12:42:26 -0000 >>Output from the NFS Client when the issue occurs # netstat -an | grep=20 >>NFS.Server.IP.X >>tcp 0 0 NFS.Client.IP.X:46896 NFS.Server.IP.X:2049 = FIN_WAIT2 >I'm no TCP guy. Hopefully others might know why the client would be stuck = in FIN_WAIT2 (I vaguely recall this means it is waiting for a fin/ack, but = could be wrong?) When the client is in Fin-Wait2 this is the state you end up when the Clien= t side actively close() the tcp session, and then the server also ACKed the= FIN.=20 This will last for ~2 min or so, but is asynchronous. However, the same 4-t= uple can not be reused during this time. With other words, from the socket / TCP, a properly executed active close()= will end up in this state. (If the other side initiated the close, a passi= ve close, will not end in this state) From owner-freebsd-net@freebsd.org Thu Mar 18 12:53:19 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 6142D573D67 for ; Thu, 18 Mar 2021 12:53:19 +0000 (UTC) (envelope-from freebsd-rwg@gndrsh.dnsmgr.net) Received: from gndrsh.dnsmgr.net (br1.CN84in.dnsmgr.net [69.59.192.140]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4F1Rlf6d9wz3Q7t; Thu, 18 Mar 2021 12:53:18 +0000 (UTC) (envelope-from freebsd-rwg@gndrsh.dnsmgr.net) Received: from gndrsh.dnsmgr.net (localhost [127.0.0.1]) by gndrsh.dnsmgr.net (8.13.3/8.13.3) with ESMTP id 12ICrFN8016816; Thu, 18 Mar 2021 05:53:15 -0700 (PDT) (envelope-from freebsd-rwg@gndrsh.dnsmgr.net) Received: (from freebsd-rwg@localhost) by gndrsh.dnsmgr.net (8.13.3/8.13.3/Submit) id 12ICrF35016815; Thu, 18 Mar 2021 05:53:15 -0700 (PDT) (envelope-from freebsd-rwg) From: "Rodney W. Grimes" Message-Id: <202103181253.12ICrF35016815@gndrsh.dnsmgr.net> Subject: Re: NFS Mount Hangs In-Reply-To: To: Rick Macklem Date: Thu, 18 Mar 2021 05:53:15 -0700 (PDT) CC: Alan Somers , "freebsd-net@freebsd.org" X-Mailer: ELM [version 2.4ME+ PL121h (25)] MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Type: text/plain; charset=US-ASCII X-Rspamd-Queue-Id: 4F1Rlf6d9wz3Q7t X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[] X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 18 Mar 2021 12:53:19 -0000 Note I am NOT a TCP expert, but know enough about it to add a comment... > Alan Somers wrote: > [stuff snipped] > >Is the 128K limit related to MAXPHYS? If so, it should be greater in 13.0. > For the client, yes. For the server, no. > For the server, it is just a compile time constant NFS_SRVMAXIO. > > It's mainly related to the fact that I haven't gotten around to testing larger > sizes yet. > - kern.ipc.maxsockbuf needs to be several times the limit, which means it would > have to increase for 1Mbyte. > - The session code must negotiate a maximum RPC size > 1 Mbyte. > (I think the server code does do this, but it needs to be tested.) > And, yes, the client is limited to MAXPHYS. > > Doing this is on my todo list, rick > > The client should acquire the attributes that indicate that and set rsize/wsize > to that. "# nfsstat -m" on the client should show you what the client > is actually using. If it is larger than 128K, set both rsize and wsize to 128K. > > >Output from the NFS Client when the issue occurs > ># netstat -an | grep NFS.Server.IP.X > >tcp 0 0 NFS.Client.IP.X:46896 NFS.Server.IP.X:2049 FIN_WAIT2 > I'm no TCP guy. Hopefully others might know why the client would be > stuck in FIN_WAIT2 (I vaguely recall this means it is waiting for a fin/ack, > but could be wrong?) The most common way to get stuck in FIN_WAIT2 is to call shutdown(2) on a socket, but never following up with a close(2) after some timeout period. The "client" is still connected to the socket and can stay in this shutdown state for ever, the kernel well not reap the socket as it is associated with a processes, aka not orphaned. I suspect that the Linux client has a corner condition that is leading to this socket leak. If on the Linux client you can look at the sockets to see if these are still associated with a process, ala fstat or what ever Linux tool does this that would be helpfull. If they are infact connected to a process it is that process that must call close(2) to clean these up. IIRC the server side socket would be gone at this point and there is nothing the server can do that would allow a FIN_WAIT2 to close down. The real TCP experts can now correct my 30 year old TCP stack understanding... > > ># cat /sys/kernel/debug/sunrpc/rpc_xprt/*/info > >netid: tcp > >addr: NFS.Server.IP.X > >port: 2049 > >state: 0x51 > > > >syslog > >Mar 4 10:29:27 hostname kernel: [437414.131978] -pid- flgs status -client- --rqstp- ->timeout ---ops-- > >Mar 4 10:29:27 hostname kernel: [437414.133158] 57419 40a1 0 9b723c73 >143cfadf 30000 4ca953b5 nfsv4 OPEN_NOATTR a:call_connect_status [sunrpc] >q:xprt_pending > I don't know what OPEN_NOATTR means, but I assume it is some variant > of NFSv4 Open operation. > [stuff snipped] > >Mar 4 10:29:30 hostname kernel: [437417.110517] RPC: 57419 xprt_connect_status: >connect attempt timed out > >Mar 4 10:29:30 hostname kernel: [437417.112172] RPC: 57419 call_connect_status > >(status -110) > I have no idea what status -110 means? > >Mar 4 10:29:30 hostname kernel: [437417.113337] RPC: 57419 call_timeout (major) > >Mar 4 10:29:30 hostname kernel: [437417.114385] RPC: 57419 call_bind (status 0) > >Mar 4 10:29:30 hostname kernel: [437417.115402] RPC: 57419 call_connect xprt >00000000e061831b is not connected > >Mar 4 10:29:30 hostname kernel: [437417.116547] RPC: 57419 xprt_connect xprt >00000000e061831b is not connected > >Mar 4 10:30:31 hostname kernel: [437478.551090] RPC: 57419 xprt_connect_status: >connect attempt timed out > >Mar 4 10:30:31 hostname kernel: [437478.552396] RPC: 57419 call_connect_status >(status -110) > >Mar 4 10:30:31 hostname kernel: [437478.553417] RPC: 57419 call_timeout (minor) > >Mar 4 10:30:31 hostname kernel: [437478.554327] RPC: 57419 call_bind (status 0) > >Mar 4 10:30:31 hostname kernel: [437478.555220] RPC: 57419 call_connect xprt >00000000e061831b is not connected > >Mar 4 10:30:31 hostname kernel: [437478.556254] RPC: 57419 xprt_connect xprt >00000000e061831b is not connected > Is it possible that the client is trying to (re)connect using the same client port#? > I would normally expect the client to create a new TCP connection using a > different client port# and then retry the outstanding RPCs. > --> Capturing packets when this happens would show us what is going on. > > If there is a problem on the FreeBSD end, it is most likely a broken > network device driver. > --> Try disabling TSO , LRO. > --> Try a different driver for the net hardware on the server. > --> Try a different net chip on the server. > If you can capture packets when (not after) the hang > occurs, then you can look at them in wireshark and see > what is actually happening. (Ideally on both client and > server, to check that your network hasn't dropped anything.) > --> I know, if the hangs aren't easily reproducible, this isn't > easily done. > --> Try a newer Linux kernel and see if the problem persists. > The Linux folk will get more interested if you can reproduce > the problem on 5.12. (Recent bakeathon testing of the 5.12 > kernel against the FreeBSD server did not find any issues.) > > Hopefully the network folk have some insight w.r.t. why > the TCP connection is sitting in FIN_WAIT2. > > rick > > > > Jason Breitman > > > > > > > _______________________________________________ > freebsd-net@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-net > To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org" > > _______________________________________________ > freebsd-net@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-net > To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org" > _______________________________________________ > freebsd-net@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-net > To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org" > -- Rod Grimes rgrimes@freebsd.org From owner-freebsd-net@freebsd.org Thu Mar 18 12:54:59 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 9D7595743D0 for ; Thu, 18 Mar 2021 12:54:59 +0000 (UTC) (envelope-from michael.tuexen@lurchi.franken.de) Received: from drew.franken.de (drew.ipv6.franken.de [IPv6:2001:638:a02:a001:20e:cff:fe4a:feaa]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "*.franken.de", Issuer "Sectigo RSA Domain Validation Secure Server CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4F1RnZ66knz3Pxm for ; Thu, 18 Mar 2021 12:54:58 +0000 (UTC) (envelope-from michael.tuexen@lurchi.franken.de) Received: from [IPv6:2a02:8109:1140:c3d:51d6:b5cf:58db:3d5e] (unknown [IPv6:2a02:8109:1140:c3d:51d6:b5cf:58db:3d5e]) (Authenticated sender: lurchi) by mail-n.franken.de (Postfix) with ESMTPSA id 46EC977A91A8A; Thu, 18 Mar 2021 13:54:54 +0100 (CET) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 14.0 \(3654.60.0.2.21\)) Subject: Re: NFS Mount Hangs From: Michael Tuexen In-Reply-To: Date: Thu, 18 Mar 2021 13:54:53 +0100 Cc: Rick Macklem , Jason Breitman , "freebsd-net@freebsd.org" Content-Transfer-Encoding: quoted-printable Message-Id: <2890D243-AF46-43A4-A1AD-CB0C3481511D@lurchi.franken.de> References: <3750001D-3F1C-4D9A-A9D9-98BCA6CA65A4@tildenparkcapital.com> <33693DE3-7FF8-4FAB-9A75-75576B88A566@tildenparkcapital.com> To: "Scheffenegger, Richard" X-Mailer: Apple Mail (2.3654.60.0.2.21) X-Spam-Status: No, score=-2.9 required=5.0 tests=ALL_TRUSTED,BAYES_00 autolearn=disabled version=3.4.1 X-Spam-Checker-Version: SpamAssassin 3.4.1 (2015-04-28) on mail-n.franken.de X-Rspamd-Queue-Id: 4F1RnZ66knz3Pxm X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=none (mx1.freebsd.org: domain of michael.tuexen@lurchi.franken.de has no SPF policy when checking 2001:638:a02:a001:20e:cff:fe4a:feaa) smtp.mailfrom=michael.tuexen@lurchi.franken.de X-Spamd-Result: default: False [-1.60 / 15.00]; TO_DN_EQ_ADDR_SOME(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; RCVD_TLS_ALL(0.00)[]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[4]; MV_CASE(0.50)[]; MID_RHS_MATCH_FROM(0.00)[]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[franken.de]; ARC_NA(0.00)[]; TO_DN_SOME(0.00)[]; SPAMHAUS_ZRD(0.00)[2001:638:a02:a001:20e:cff:fe4a:feaa:from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[2001:638:a02:a001:20e:cff:fe4a:feaa:from]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-1.000]; AUTH_NA(1.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_SPF_NA(0.00)[no SPF record]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:680, ipnet:2001:638::/32, country:DE]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[freebsd-net] X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 18 Mar 2021 12:54:59 -0000 > On 18. Mar 2021, at 13:42, Scheffenegger, Richard = wrote: >=20 >>> Output from the NFS Client when the issue occurs # netstat -an | = grep=20 >>> NFS.Server.IP.X >>> tcp 0 0 NFS.Client.IP.X:46896 NFS.Server.IP.X:2049 = FIN_WAIT2 >> I'm no TCP guy. Hopefully others might know why the client would be = stuck in FIN_WAIT2 (I vaguely recall this means it is waiting for a = fin/ack, but could be wrong?) >=20 > When the client is in Fin-Wait2 this is the state you end up when the = Client side actively close() the tcp session, and then the server also = ACKed the FIN.=20 Jason noted: When the issue occurs, this is what I see on the NFS Server. tcp4 0 0 NFS.Server.IP.X.2049 NFS.Client.IP.X.51550 = CLOSE_WAIT =20 which corresponds to the state on the client side. The server received = the FIN from the client and acked it. The server is waiting for a close call to = happen. So the question is: Is the server also closing the connection? Best regards Michael > This will last for ~2 min or so, but is asynchronous. However, the = same 4-tuple can not be reused during this time. >=20 > With other words, from the socket / TCP, a properly executed active = close() will end up in this state. (If the other side initiated the = close, a passive close, will not end in this state) >=20 >=20 > _______________________________________________ > freebsd-net@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-net > To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org" From owner-freebsd-net@freebsd.org Thu Mar 18 12:58:33 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id B8B195745A1 for ; Thu, 18 Mar 2021 12:58:33 +0000 (UTC) (envelope-from tuexen@freebsd.org) Received: from drew.franken.de (drew.ipv6.franken.de [IPv6:2001:638:a02:a001:20e:cff:fe4a:feaa]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "*.franken.de", Issuer "Sectigo RSA Domain Validation Secure Server CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4F1Rsj425yz3Q1h; Thu, 18 Mar 2021 12:58:33 +0000 (UTC) (envelope-from tuexen@freebsd.org) Received: from [IPv6:2a02:8109:1140:c3d:51d6:b5cf:58db:3d5e] (unknown [IPv6:2a02:8109:1140:c3d:51d6:b5cf:58db:3d5e]) (Authenticated sender: macmic) by mail-n.franken.de (Postfix) with ESMTPSA id 927A877A91A8E; Thu, 18 Mar 2021 13:58:30 +0100 (CET) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 14.0 \(3654.60.0.2.21\)) Subject: Re: NFS Mount Hangs From: tuexen@freebsd.org In-Reply-To: <202103181253.12ICrF35016815@gndrsh.dnsmgr.net> Date: Thu, 18 Mar 2021 13:58:30 +0100 Cc: Rick Macklem , Alan Somers , "freebsd-net@freebsd.org" Content-Transfer-Encoding: quoted-printable Message-Id: References: <202103181253.12ICrF35016815@gndrsh.dnsmgr.net> To: "Rodney W. Grimes" X-Mailer: Apple Mail (2.3654.60.0.2.21) X-Spam-Status: No, score=-2.9 required=5.0 tests=ALL_TRUSTED,BAYES_00 autolearn=disabled version=3.4.1 X-Spam-Checker-Version: SpamAssassin 3.4.1 (2015-04-28) on mail-n.franken.de X-Rspamd-Queue-Id: 4F1Rsj425yz3Q1h X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[] X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 18 Mar 2021 12:58:33 -0000 > On 18. Mar 2021, at 13:53, Rodney W. Grimes = wrote: >=20 > Note I am NOT a TCP expert, but know enough about it to add a = comment... >=20 >> Alan Somers wrote: >> [stuff snipped] >>> Is the 128K limit related to MAXPHYS? If so, it should be greater = in 13.0. >> For the client, yes. For the server, no. >> For the server, it is just a compile time constant NFS_SRVMAXIO. >>=20 >> It's mainly related to the fact that I haven't gotten around to = testing larger >> sizes yet. >> - kern.ipc.maxsockbuf needs to be several times the limit, which = means it would >> have to increase for 1Mbyte. >> - The session code must negotiate a maximum RPC size > 1 Mbyte. >> (I think the server code does do this, but it needs to be tested.) >> And, yes, the client is limited to MAXPHYS. >>=20 >> Doing this is on my todo list, rick >>=20 >> The client should acquire the attributes that indicate that and set = rsize/wsize >> to that. "# nfsstat -m" on the client should show you what the client >> is actually using. If it is larger than 128K, set both rsize and = wsize to 128K. >>=20 >>> Output from the NFS Client when the issue occurs >>> # netstat -an | grep NFS.Server.IP.X >>> tcp 0 0 NFS.Client.IP.X:46896 NFS.Server.IP.X:2049 = FIN_WAIT2 >> I'm no TCP guy. Hopefully others might know why the client would be >> stuck in FIN_WAIT2 (I vaguely recall this means it is waiting for a = fin/ack, >> but could be wrong?) >=20 > The most common way to get stuck in FIN_WAIT2 is to call > shutdown(2) on a socket, but never following up with a > close(2) after some timeout period. The "client" is still > connected to the socket and can stay in this shutdown state > for ever, the kernel well not reap the socket as it is > associated with a processes, aka not orphaned. I suspect > that the Linux client has a corner condition that is leading > to this socket leak. >=20 > If on the Linux client you can look at the sockets to see > if these are still associated with a process, ala fstat or > what ever Linux tool does this that would be helpfull. > If they are infact connected to a process it is that > process that must call close(2) to clean these up. >=20 > IIRC the server side socket would be gone at this point > and there is nothing the server can do that would allow > a FIN_WAIT2 to close down. Jason reported that the server is in CLOSE-WAIT. This would mean the the server received the FIN, ACKed it, but has not initiated the teardown of the Server->Client direction. So the server side socket is still there and close has not be called yet. >=20 > The real TCP experts can now correct my 30 year old TCP > stack understanding... I wouldn't count myself as a real TCP expert, but the behaviour hasn't changed in the last 30 years, I think... Best regards Michael >=20 >>=20 >>> # cat /sys/kernel/debug/sunrpc/rpc_xprt/*/info >>> netid: tcp >>> addr: NFS.Server.IP.X >>> port: 2049 >>> state: 0x51 >>>=20 >>> syslog >>> Mar 4 10:29:27 hostname kernel: [437414.131978] -pid- flgs status = -client- --rqstp- ->timeout ---ops-- >>> Mar 4 10:29:27 hostname kernel: [437414.133158] 57419 40a1 0 = 9b723c73 >143cfadf 30000 4ca953b5 nfsv4 OPEN_NOATTR = a:call_connect_status [sunrpc] >q:xprt_pending >> I don't know what OPEN_NOATTR means, but I assume it is some variant >> of NFSv4 Open operation. >> [stuff snipped] >>> Mar 4 10:29:30 hostname kernel: [437417.110517] RPC: 57419 = xprt_connect_status: >connect attempt timed out >>> Mar 4 10:29:30 hostname kernel: [437417.112172] RPC: 57419 = call_connect_status >>> (status -110) >> I have no idea what status -110 means? >>> Mar 4 10:29:30 hostname kernel: [437417.113337] RPC: 57419 = call_timeout (major) >>> Mar 4 10:29:30 hostname kernel: [437417.114385] RPC: 57419 = call_bind (status 0) >>> Mar 4 10:29:30 hostname kernel: [437417.115402] RPC: 57419 = call_connect xprt >00000000e061831b is not connected >>> Mar 4 10:29:30 hostname kernel: [437417.116547] RPC: 57419 = xprt_connect xprt >00000000e061831b is not connected >>> Mar 4 10:30:31 hostname kernel: [437478.551090] RPC: 57419 = xprt_connect_status: >connect attempt timed out >>> Mar 4 10:30:31 hostname kernel: [437478.552396] RPC: 57419 = call_connect_status >(status -110) >>> Mar 4 10:30:31 hostname kernel: [437478.553417] RPC: 57419 = call_timeout (minor) >>> Mar 4 10:30:31 hostname kernel: [437478.554327] RPC: 57419 = call_bind (status 0) >>> Mar 4 10:30:31 hostname kernel: [437478.555220] RPC: 57419 = call_connect xprt >00000000e061831b is not connected >>> Mar 4 10:30:31 hostname kernel: [437478.556254] RPC: 57419 = xprt_connect xprt >00000000e061831b is not connected >> Is it possible that the client is trying to (re)connect using the = same client port#? >> I would normally expect the client to create a new TCP connection = using a >> different client port# and then retry the outstanding RPCs. >> --> Capturing packets when this happens would show us what is going = on. >>=20 >> If there is a problem on the FreeBSD end, it is most likely a broken >> network device driver. >> --> Try disabling TSO , LRO. >> --> Try a different driver for the net hardware on the server. >> --> Try a different net chip on the server. >> If you can capture packets when (not after) the hang >> occurs, then you can look at them in wireshark and see >> what is actually happening. (Ideally on both client and >> server, to check that your network hasn't dropped anything.) >> --> I know, if the hangs aren't easily reproducible, this isn't >> easily done. >> --> Try a newer Linux kernel and see if the problem persists. >> The Linux folk will get more interested if you can reproduce >> the problem on 5.12. (Recent bakeathon testing of the 5.12 >> kernel against the FreeBSD server did not find any issues.) >>=20 >> Hopefully the network folk have some insight w.r.t. why >> the TCP connection is sitting in FIN_WAIT2. >>=20 >> rick >>=20 >>=20 >>=20 >> Jason Breitman >>=20 >>=20 >>=20 >>=20 >>=20 >>=20 >> _______________________________________________ >> freebsd-net@freebsd.org mailing list >> https://lists.freebsd.org/mailman/listinfo/freebsd-net >> To unsubscribe, send any mail to = "freebsd-net-unsubscribe@freebsd.org" >>=20 >> _______________________________________________ >> freebsd-net@freebsd.org mailing list >> https://lists.freebsd.org/mailman/listinfo/freebsd-net >> To unsubscribe, send any mail to = "freebsd-net-unsubscribe@freebsd.org" >> _______________________________________________ >> freebsd-net@freebsd.org mailing list >> https://lists.freebsd.org/mailman/listinfo/freebsd-net >> To unsubscribe, send any mail to = "freebsd-net-unsubscribe@freebsd.org" >>=20 >=20 > --=20 > Rod Grimes = rgrimes@freebsd.org > _______________________________________________ > freebsd-net@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-net > To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org" From owner-freebsd-net@freebsd.org Thu Mar 18 14:14:15 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 69D3B5767C6 for ; Thu, 18 Mar 2021 14:14:15 +0000 (UTC) (envelope-from jbreitman@tildenparkcapital.com) Received: from us-smtp-delivery-145.mimecast.com (us-smtp-delivery-145.mimecast.com [216.205.24.145]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-SHA384 (256/256 bits)) (Client CN "*.mimecast.com", Issuer "DigiCert TLS RSA SHA256 2020 CA1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4F1TY25MYRz3lHK for ; Thu, 18 Mar 2021 14:14:14 +0000 (UTC) (envelope-from jbreitman@tildenparkcapital.com) Received: from zmcc-3-mta-2.zmailcloud.com (zmcc-3-mta-2.zmailcloud.com [35.238.170.66]) (Using TLS) by relay.mimecast.com with ESMTP id us-mta-529-XuEsoBEkMiepxLzPqW7eSQ-1; Thu, 18 Mar 2021 10:14:12 -0400 X-MC-Unique: XuEsoBEkMiepxLzPqW7eSQ-1 Received: from zmcc-3-mta-2.zmailcloud.com (localhost [127.0.0.1]) by zmcc-3-mta-2.zmailcloud.com (Postfix) with ESMTPS id B0023E351E; Thu, 18 Mar 2021 09:14:11 -0500 (CDT) Received: from localhost (localhost [127.0.0.1]) by zmcc-3-mta-2.zmailcloud.com (Postfix) with ESMTP id A0ACFE351C; Thu, 18 Mar 2021 09:14:11 -0500 (CDT) X-Virus-Scanned: amavisd-new at zmcc-3-mta-2.zmailcloud.com Received: from zmcc-3-mta-2.zmailcloud.com ([127.0.0.1]) by localhost (zmcc-3-mta-2.zmailcloud.com [127.0.0.1]) (amavisd-new, port 10026) with ESMTP id B0TrdZ-3GgMh; Thu, 18 Mar 2021 09:14:11 -0500 (CDT) Received: from jbreitman-mac.zxcvm.com (unknown [72.22.182.150]) by zmcc-3-mta-2.zmailcloud.com (Postfix) with ESMTPSA id 6D0B6E2B3C; Thu, 18 Mar 2021 09:14:11 -0500 (CDT) Mime-Version: 1.0 (Mac OS X Mail 13.4 \(3608.120.23.2.4\)) Subject: Re: NFS Mount Hangs From: Jason Breitman In-Reply-To: <20210318090645.2e0d992f@comet2.terra.ger> Date: Thu, 18 Mar 2021 10:14:10 -0400 Cc: freebsd-net@freebsd.org Message-Id: References: <3750001D-3F1C-4D9A-A9D9-98BCA6CA65A4@tildenparkcapital.com> <33693DE3-7FF8-4FAB-9A75-75576B88A566@tildenparkcapital.com> <789BCFA9-D6BC-4C5A-AEA2-E6F7C6E26CB5@tildenparkcapital.com> <20210318090645.2e0d992f@comet2.terra.ger> To: Gerrit Kuehn X-Mailer: Apple Mail (2.3608.120.23.2.4) X-Mimecast-Spam-Score: 0 X-Mimecast-Originator: tildenparkcapital.com Content-Type: text/plain; charset=WINDOWS-1252 Content-Transfer-Encoding: quoted-printable X-Rspamd-Queue-Id: 4F1TY25MYRz3lHK X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of jbreitman@tildenparkcapital.com designates 216.205.24.145 as permitted sender) smtp.mailfrom=jbreitman@tildenparkcapital.com X-Spamd-Result: default: False [-2.90 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; RWL_MAILSPIKE_VERYGOOD(0.00)[216.205.24.145:from]; RCVD_COUNT_FIVE(0.00)[6]; MID_RHS_MATCH_FROM(0.00)[]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+ip4:216.205.24.0/24]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[tildenparkcapital.com: no valid DMARC record]; ARC_NA(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; TO_MATCH_ENVRCPT_SOME(0.00)[]; NEURAL_HAM_SHORT(-1.00)[-1.000]; RCPT_COUNT_TWO(0.00)[2]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:30031, ipnet:216.205.24.0/24, country:US]; RCVD_TLS_LAST(0.00)[]; MAILMAN_DEST(0.00)[freebsd-net]; RCVD_IN_DNSWL_LOW(-0.10)[216.205.24.145:from] X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 18 Mar 2021 14:14:15 -0000 The laggproto is lacp and the switch is made by Extreme Networks. Jason Breitman On Mar 18, 2021, at 4:06 AM, Gerrit Kuehn wrote: On Wed, 17 Mar 2021 18:17:14 -0400 Jason Breitman wrote: > I will look into disabling the TSO and LRO options and let the group > know how it goes. Below are the current options on the NFS Server. > lagg0: flags=3D8943 > metric 0 mtu 1500 > options=3De507bb What laggproto are you using, and what kind of switch is connected on the other end? cu Gerrit _______________________________________________ freebsd-net@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-net To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org" From owner-freebsd-net@freebsd.org Thu Mar 18 14:31:57 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id EDE0E576DD9 for ; Thu, 18 Mar 2021 14:31:57 +0000 (UTC) (envelope-from freebsd-rwg@gndrsh.dnsmgr.net) Received: from gndrsh.dnsmgr.net (br1.CN84in.dnsmgr.net [69.59.192.140]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4F1TxS4n1Yz3mD9 for ; Thu, 18 Mar 2021 14:31:56 +0000 (UTC) (envelope-from freebsd-rwg@gndrsh.dnsmgr.net) Received: from gndrsh.dnsmgr.net (localhost [127.0.0.1]) by gndrsh.dnsmgr.net (8.13.3/8.13.3) with ESMTP id 12IEVsOH017289; Thu, 18 Mar 2021 07:31:54 -0700 (PDT) (envelope-from freebsd-rwg@gndrsh.dnsmgr.net) Received: (from freebsd-rwg@localhost) by gndrsh.dnsmgr.net (8.13.3/8.13.3/Submit) id 12IEVsQ6017288; Thu, 18 Mar 2021 07:31:54 -0700 (PDT) (envelope-from freebsd-rwg) From: "Rodney W. Grimes" Message-Id: <202103181431.12IEVsQ6017288@gndrsh.dnsmgr.net> Subject: Re: AW: NFS Mount Hangs In-Reply-To: To: "Scheffenegger, Richard" Date: Thu, 18 Mar 2021 07:31:54 -0700 (PDT) CC: Rick Macklem , Jason Breitman , "freebsd-net@freebsd.org" X-Mailer: ELM [version 2.4ME+ PL121h (25)] MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Type: text/plain; charset=US-ASCII X-Rspamd-Queue-Id: 4F1TxS4n1Yz3mD9 X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=none (mx1.freebsd.org: domain of freebsd-rwg@gndrsh.dnsmgr.net has no SPF policy when checking 69.59.192.140) smtp.mailfrom=freebsd-rwg@gndrsh.dnsmgr.net X-Spamd-Result: default: False [-1.59 / 15.00]; TO_DN_EQ_ADDR_SOME(0.00)[]; ARC_NA(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[4]; TO_DN_SOME(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; RCVD_TLS_LAST(0.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[69.59.192.140:from]; AUTH_NA(1.00)[]; DMARC_NA(0.00)[dnsmgr.net]; SPAMHAUS_ZRD(0.00)[69.59.192.140:from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; NEURAL_HAM_SHORT(-0.49)[-0.486]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_SPF_NA(0.00)[no SPF record]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:13868, ipnet:69.59.192.0/19, country:US]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[freebsd-net] X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 18 Mar 2021 14:31:58 -0000 > >>Output from the NFS Client when the issue occurs # netstat -an | grep > >>NFS.Server.IP.X > >>tcp 0 0 NFS.Client.IP.X:46896 NFS.Server.IP.X:2049 FIN_WAIT2 > >I'm no TCP guy. Hopefully others might know why the client would be stuck in FIN_WAIT2 (I vaguely recall this means it is waiting for a fin/ack, but could be wrong?) > > When the client is in Fin-Wait2 this is the state you end up when the Client side actively close() the tcp session, and then the server also ACKed the FIN. > This will last for ~2 min or so, but is asynchronous. However, the same 4-tuple can not be reused during this time. I do not think this is the full story. If infact the Client did call close() you are correct, you would end up in FIN_WAIT2 for upto what ever the timeout is set to, IIRC default on that is 60 seconds, further in this case the socket is disconnected from the application and only the kernel has knowledge of it. The socket can stay in FIN_WAIT2 indefanitly if the application calls shutdown(2) on it, and never follows up with a close(2). Which situation exists can be determined by looking at fstat to see if the socket has an associted PID or not, not sure if that works on Linux though. > > With other words, from the socket / TCP, a properly executed active close() will end up in this state. (If the other side initiated the close, a passive close, will not end in this state) But only for a brief period. Stuck in this state indicates close(2) was not called, but shutdown(2) was. I believe it is also possible to get sockets stuck in this state when a client side port number reuse colides with a server side socket that is still in s CLOSE_WAIT state, oh wait, that ends up in no response to the SYN, hummmm... > freebsd-net@freebsd.org mailing list -- Rod Grimes rgrimes@freebsd.org From owner-freebsd-net@freebsd.org Thu Mar 18 17:32:17 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 60EC757E1C8 for ; Thu, 18 Mar 2021 17:32:17 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 4F1YxY21GTz4V7Q for ; Thu, 18 Mar 2021 17:32:17 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 44EF357E343; Thu, 18 Mar 2021 17:32:17 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 44B5C57E434 for ; Thu, 18 Mar 2021 17:32:17 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4F1YxY1Q6nz4VRw for ; Thu, 18 Mar 2021 17:32:17 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 226C525ACB for ; Thu, 18 Mar 2021 17:32:17 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 12IHWHvC054551 for ; Thu, 18 Mar 2021 17:32:17 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 12IHWHTR054550 for net@FreeBSD.org; Thu, 18 Mar 2021 17:32:17 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 254333] [tcp] sysctl net.inet.tcp.hostcache.list hangs Date: Thu, 18 Mar 2021 17:32:17 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.4-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: maxim.shalomikhin@kaspersky.com X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: net@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 18 Mar 2021 17:32:17 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D254333 --- Comment #2 from Maxim Shalomikhin --- It will take some time to reproduce the issue. Plese let me now if there any other information I can collect when sysctl hangs again. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-net@freebsd.org Thu Mar 18 19:42:36 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 124B25AA799 for ; Thu, 18 Mar 2021 19:42:36 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 4F1cqv6x9wz4fRv for ; Thu, 18 Mar 2021 19:42:35 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id EE0AA5AA6A8; Thu, 18 Mar 2021 19:42:35 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id EDD7E5AA811 for ; Thu, 18 Mar 2021 19:42:35 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4F1cqv6L8Xz4fpL for ; Thu, 18 Mar 2021 19:42:35 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id CB6FE27743 for ; Thu, 18 Mar 2021 19:42:35 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 12IJgZvo025743 for ; Thu, 18 Mar 2021 19:42:35 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 12IJgZuS025742 for net@FreeBSD.org; Thu, 18 Mar 2021 19:42:35 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 254366] Severe IPv6 TCP transfer issues on 13.0-RC2 with virtio network adapter Date: Thu, 18 Mar 2021 19:42:35 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: tuexen@freebsd.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: tuexen@freebsd.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: assigned_to bug_status cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 18 Mar 2021 19:42:36 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D254366 Michael Tuexen changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|bugs@FreeBSD.org |tuexen@freebsd.org Status|New |In Progress CC| |net@FreeBSD.org --=20 You are receiving this mail because: You are on the CC list for the bug.= From owner-freebsd-net@freebsd.org Thu Mar 18 19:45:16 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id C44125AA667 for ; Thu, 18 Mar 2021 19:45:16 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 4F1cv04yc1z4fsM for ; Thu, 18 Mar 2021 19:45:16 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id AA5595AA75B; Thu, 18 Mar 2021 19:45:16 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id AA23C5AA7B7 for ; Thu, 18 Mar 2021 19:45:16 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4F1cv04MyLz4fvt for ; Thu, 18 Mar 2021 19:45:16 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 8967F27A20 for ; Thu, 18 Mar 2021 19:45:16 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 12IJjGt1026277 for ; Thu, 18 Mar 2021 19:45:16 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 12IJjGZj026276 for net@FreeBSD.org; Thu, 18 Mar 2021 19:45:16 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 254366] Severe IPv6 TCP transfer issues on 13.0-RC2 with virtio network adapter Date: Thu, 18 Mar 2021 19:45:16 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: michael@esosoft.com X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: tuexen@freebsd.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 18 Mar 2021 19:45:16 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D254366 --- Comment #16 from Michael Tratz --- Thank you so much Michael for the quick fix. Everything is back to normal. = IPv6 is speedy again. --=20 You are receiving this mail because: You are on the CC list for the bug.= From owner-freebsd-net@freebsd.org Thu Mar 18 20:00:54 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id A25515AACB5 for ; Thu, 18 Mar 2021 20:00:54 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 4F1dF23yTZz4gX2 for ; Thu, 18 Mar 2021 20:00:54 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 87E775AAF88; Thu, 18 Mar 2021 20:00:54 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 87B355AABCD for ; Thu, 18 Mar 2021 20:00:54 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4F1dF23KnLz4gTD for ; Thu, 18 Mar 2021 20:00:54 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 6437F27D1D for ; Thu, 18 Mar 2021 20:00:54 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 12IK0sbn031823 for ; Thu, 18 Mar 2021 20:00:54 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 12IK0sci031822 for net@FreeBSD.org; Thu, 18 Mar 2021 20:00:54 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 254366] Severe IPv6 TCP transfer issues on 13.0-RC2 with virtio network adapter Date: Thu, 18 Mar 2021 20:00:54 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: tuexen@freebsd.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: tuexen@freebsd.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 18 Mar 2021 20:00:54 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D254366 --- Comment #17 from Michael Tuexen --- (In reply to Michael Tratz from comment #16) Thanks for reporting back! The path is under review: https://reviews.freebsd.org/D29331 --=20 You are receiving this mail because: You are on the CC list for the bug.= From owner-freebsd-net@freebsd.org Thu Mar 18 20:09:38 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 0C0565AB495 for ; Thu, 18 Mar 2021 20:09:38 +0000 (UTC) (envelope-from tuexen@freebsd.org) Received: from drew.franken.de (mail-n.franken.de [193.175.24.27]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "*.franken.de", Issuer "Sectigo RSA Domain Validation Secure Server CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4F1dR56STnz4hJN for ; Thu, 18 Mar 2021 20:09:37 +0000 (UTC) (envelope-from tuexen@freebsd.org) Received: from [IPv6:2a02:8109:1140:c3d:b916:ac9d:67ca:1dbe] (unknown [IPv6:2a02:8109:1140:c3d:b916:ac9d:67ca:1dbe]) (Authenticated sender: macmic) by mail-n.franken.de (Postfix) with ESMTPSA id 93DCC762A0D29; Thu, 18 Mar 2021 21:09:35 +0100 (CET) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 14.0 \(3654.60.0.2.21\)) Subject: Re: Severe IPv6 TCP transfer issues on 13.0-RC1 and RC2 From: Michael Tuexen In-Reply-To: <5753280.1HxCrU2fYu@thinkbook> Date: Thu, 18 Mar 2021 21:09:34 +0100 Cc: freebsd-net@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: <9D504CF5-BF17-439F-9298-E743D9566691@freebsd.org> References: <5753280.1HxCrU2fYu@thinkbook> To: Blake Hartshorn X-Mailer: Apple Mail (2.3654.60.0.2.21) X-Spam-Status: No, score=-2.9 required=5.0 tests=ALL_TRUSTED,BAYES_00 autolearn=disabled version=3.4.1 X-Spam-Checker-Version: SpamAssassin 3.4.1 (2015-04-28) on mail-n.franken.de X-Rspamd-Queue-Id: 4F1dR56STnz4hJN X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [0.00 / 15.00]; local_wl_from(0.00)[freebsd.org]; ASN(0.00)[asn:680, ipnet:193.174.0.0/15, country:DE] X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 18 Mar 2021 20:09:38 -0000 > On 15. Mar 2021, at 12:56, Blake Hartshorn = wrote: >=20 > The short version, when I use FreeBSD 13, delivering data can take 5 = minutes for 1MB over SSH or HTTP when using IPv6. This problem does not = happen with IPv4. I installed FreeBSD 12 and Linux on that same device, = neither had the problem. >=20 > Did some troubleshooting with Linode, have ultimately ruled the = network itself out at this point. When the server is on FreeBSD 13, it = can download quickly over IPv6, but not deliver. Started investigating = after noticing my SSH session was lagging when cat'ing large files or = running builds. This problem even occurs between VMs in the same = datacenter. I generated a 1MB file of base64 garbage served by nginx for = testing. IPv6 is being configured by SLAAC and on both 12 and 13 = installs was setup by the installer. Linode uses Linux/KVM hosts for = their virtual machines so it's running on that virtual adapter. >=20 > I asked on the forums, another user recommended going to the mailing = lists instead. Does anyone know if config settings need to be different = on 13? Did I maybe just find a real issue? I can provide any requested = details. Thanks! I was able to reproduce the issue locally. A fix is under review: https://reviews.freebsd.org/D29331 Best regards Michael >=20 >=20 > _______________________________________________ > freebsd-net@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-net > To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org" From owner-freebsd-net@freebsd.org Thu Mar 18 20:33:19 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id F0EB65ABDF8 for ; Thu, 18 Mar 2021 20:33:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 4F1dyR6Hz5z4kFs for ; Thu, 18 Mar 2021 20:33:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id D81545ABF3E; Thu, 18 Mar 2021 20:33:19 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id D7D875ABEEE for ; Thu, 18 Mar 2021 20:33:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4F1dyR5j2rz4jxR for ; Thu, 18 Mar 2021 20:33:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id B6EA5152 for ; Thu, 18 Mar 2021 20:33:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 12IKXJAf053451 for ; Thu, 18 Mar 2021 20:33:19 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 12IKXJEg053450 for net@FreeBSD.org; Thu, 18 Mar 2021 20:33:19 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 254366] Severe IPv6 TCP transfer issues on 13.0-RC2 with virtio network adapter Date: Thu, 18 Mar 2021 20:33:19 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: commit-hook@FreeBSD.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: tuexen@freebsd.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 18 Mar 2021 20:33:20 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D254366 --- Comment #18 from commit-hook@FreeBSD.org --- A commit in branch main references this bug: URL: https://cgit.FreeBSD.org/src/commit/?id=3Dd4697a6b56168876fc0ffec1a0bb1b24d= 25b198e commit d4697a6b56168876fc0ffec1a0bb1b24d25b198e Author: Michael Tuexen AuthorDate: 2021-03-18 20:25:47 +0000 Commit: Michael Tuexen CommitDate: 2021-03-18 20:32:20 +0000 vtnet: fix TSO for TCP/IPv6 The decision whether a TCP packet is sent over IPv4 or IPv6 was based on ethertype, which works correctly. In D27926 the criteria was changed to checking if the CSUM_IP_TSO flag is set in the csum-flags and then considering it to be TCP/IPv4. However, the TCP stack sets the flag to CSUM_TSO for IPv4 and IPv6, where CSUM_TSO is defined as CSUM_IP_TSO|CSUM_IP6_TSO. Therefore TCP/IPv6 packets gets mis-classified as TCP/IPv4, which breaks TSO for TCP/IPv6. This patch bases the check again on the ethertype. This fix will be MFC instantly as discussed with re(gjb). MFC after: instantly PR: 254366 Sponsored by: Netflix, Inc. Differential Revision: https://reviews.freebsd.org/D29331 sys/dev/virtio/network/if_vtnet.c | 8 ++++---- 1 file changed, 4 insertions(+), 4 deletions(-) --=20 You are receiving this mail because: You are on the CC list for the bug.= From owner-freebsd-net@freebsd.org Thu Mar 18 20:35:22 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 8D68E5AC501 for ; Thu, 18 Mar 2021 20:35:22 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 4F1f0p2xFyz4khf for ; Thu, 18 Mar 2021 20:35:22 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 58EB05AC341; Thu, 18 Mar 2021 20:35:22 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 54C7C5AC33F for ; Thu, 18 Mar 2021 20:35:22 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4F1f0n6P7jz4kZV for ; Thu, 18 Mar 2021 20:35:21 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id C7D8934F for ; Thu, 18 Mar 2021 20:35:21 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 12IKZLEv053837 for ; Thu, 18 Mar 2021 20:35:21 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 12IKZLaM053836 for net@FreeBSD.org; Thu, 18 Mar 2021 20:35:21 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 254366] Severe IPv6 TCP transfer issues on 13.0-RC2 with virtio network adapter Date: Thu, 18 Mar 2021 20:35:21 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: commit-hook@FreeBSD.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: tuexen@freebsd.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 18 Mar 2021 20:35:22 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D254366 --- Comment #19 from commit-hook@FreeBSD.org --- A commit in branch stable/13 references this bug: URL: https://cgit.FreeBSD.org/src/commit/?id=3D6064ea8172f078c54954bc6e8865625fe= b7979fe commit 6064ea8172f078c54954bc6e8865625feb7979fe Author: Michael Tuexen AuthorDate: 2021-03-18 20:25:47 +0000 Commit: Michael Tuexen CommitDate: 2021-03-18 20:33:32 +0000 vtnet: fix TSO for TCP/IPv6 The decision whether a TCP packet is sent over IPv4 or IPv6 was based on ethertype, which works correctly. In D27926 the criteria was changed to checking if the CSUM_IP_TSO flag is set in the csum-flags and then considering it to be TCP/IPv4. However, the TCP stack sets the flag to CSUM_TSO for IPv4 and IPv6, where CSUM_TSO is defined as CSUM_IP_TSO|CSUM_IP6_TSO. Therefore TCP/IPv6 packets gets mis-classified as TCP/IPv4, which breaks TSO for TCP/IPv6. This patch bases the check again on the ethertype. This fix is instantly MFCed. Approved by: re(gjb) PR: 254366 Sponsored by: Netflix, Inc. Differential Revision: https://reviews.freebsd.org/D29331 (cherry picked from commit d4697a6b56168876fc0ffec1a0bb1b24d25b198e) sys/dev/virtio/network/if_vtnet.c | 8 ++++---- 1 file changed, 4 insertions(+), 4 deletions(-) --=20 You are receiving this mail because: You are on the CC list for the bug.= From owner-freebsd-net@freebsd.org Thu Mar 18 20:41:24 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 8D91B5AC83C for ; Thu, 18 Mar 2021 20:41:24 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 4F1f7m3Mvcz4l7c for ; Thu, 18 Mar 2021 20:41:24 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 71B805ACA41; Thu, 18 Mar 2021 20:41:24 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 6EF095ACA3F for ; Thu, 18 Mar 2021 20:41:24 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4F1f7m2fbhz4lC7 for ; Thu, 18 Mar 2021 20:41:24 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4E18936D for ; Thu, 18 Mar 2021 20:41:24 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 12IKfOVn055843 for ; Thu, 18 Mar 2021 20:41:24 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 12IKfOnn055842 for net@FreeBSD.org; Thu, 18 Mar 2021 20:41:24 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 254366] Severe IPv6 TCP transfer issues on 13.0-RC2 with virtio network adapter Date: Thu, 18 Mar 2021 20:41:24 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: commit-hook@FreeBSD.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: tuexen@freebsd.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 18 Mar 2021 20:41:24 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D254366 --- Comment #20 from commit-hook@FreeBSD.org --- A commit in branch releng/13.0 references this bug: URL: https://cgit.FreeBSD.org/src/commit/?id=3D11660fa28fd39a644cb7d30a4378cf475= 1b89f15 commit 11660fa28fd39a644cb7d30a4378cf4751b89f15 Author: Michael Tuexen AuthorDate: 2021-03-18 20:25:47 +0000 Commit: Michael Tuexen CommitDate: 2021-03-18 20:35:49 +0000 vtnet: fix TSO for TCP/IPv6 The decision whether a TCP packet is sent over IPv4 or IPv6 was based on ethertype, which works correctly. In D27926 the criteria was changed to checking if the CSUM_IP_TSO flag is set in the csum-flags and then considering it to be TCP/IPv4. However, the TCP stack sets the flag to CSUM_TSO for IPv4 and IPv6, where CSUM_TSO is defined as CSUM_IP_TSO|CSUM_IP6_TSO. Therefore TCP/IPv6 packets gets mis-classified as TCP/IPv4, which breaks TSO for TCP/IPv6. This patch bases the check again on the ethertype. This fix is instantly MFCed. Approved by: re(gjb) PR: 254366 Sponsored by: Netflix, Inc. Differential Revision: https://reviews.freebsd.org/D29331 (cherry picked from commit d4697a6b56168876fc0ffec1a0bb1b24d25b198e) (cherry picked from commit 6064ea8172f078c54954bc6e8865625feb7979fe) sys/dev/virtio/network/if_vtnet.c | 8 ++++---- 1 file changed, 4 insertions(+), 4 deletions(-) --=20 You are receiving this mail because: You are on the CC list for the bug.= From owner-freebsd-net@freebsd.org Thu Mar 18 20:50:20 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 1ECF85ACCF1 for ; Thu, 18 Mar 2021 20:50:20 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 4F1fL407S0z4ll4 for ; Thu, 18 Mar 2021 20:50:20 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 02B1C5ACCF0; Thu, 18 Mar 2021 20:50:20 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 027B65ACCEF for ; Thu, 18 Mar 2021 20:50:20 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4F1fL36Zpzz4lYb for ; Thu, 18 Mar 2021 20:50:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id D575A88E for ; Thu, 18 Mar 2021 20:50:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 12IKoJvo059499 for ; Thu, 18 Mar 2021 20:50:19 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 12IKoJJU059498 for net@FreeBSD.org; Thu, 18 Mar 2021 20:50:19 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 254366] Severe IPv6 TCP transfer issues on 13.0-RC2 with virtio network adapter Date: Thu, 18 Mar 2021 20:50:19 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: tuexen@freebsd.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: tuexen@freebsd.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 18 Mar 2021 20:50:20 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D254366 --- Comment #21 from Michael Tuexen --- This will be in the upcoming RC3. --=20 You are receiving this mail because: You are on the CC list for the bug.= From owner-freebsd-net@freebsd.org Thu Mar 18 20:52:58 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id C6B135ACF9A for ; Thu, 18 Mar 2021 20:52:58 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 4F1fP652Hlz4m8H for ; Thu, 18 Mar 2021 20:52:58 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id ACB1D5ACF98; Thu, 18 Mar 2021 20:52:58 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id AC7725AD2B1 for ; Thu, 18 Mar 2021 20:52:58 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4F1fP64Qv9z4mKQ for ; Thu, 18 Mar 2021 20:52:58 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 8B291853 for ; Thu, 18 Mar 2021 20:52:58 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 12IKqw5S064371 for ; Thu, 18 Mar 2021 20:52:58 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 12IKqw2b064370 for net@FreeBSD.org; Thu, 18 Mar 2021 20:52:58 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 254366] Severe IPv6 TCP transfer issues on 13.0-RC2 with virtio network adapter Date: Thu, 18 Mar 2021 20:52:58 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: tuexen@freebsd.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: FIXED X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: tuexen@freebsd.org X-Bugzilla-Flags: mfc-stable13+ X-Bugzilla-Changed-Fields: bug_status resolution flagtypes.name Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 18 Mar 2021 20:52:58 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D254366 Michael Tuexen changed: What |Removed |Added ---------------------------------------------------------------------------- Status|In Progress |Closed Resolution|--- |FIXED Flags| |mfc-stable13+ --=20 You are receiving this mail because: You are on the CC list for the bug.= From owner-freebsd-net@freebsd.org Thu Mar 18 20:55:07 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 8B8155AD327 for ; Thu, 18 Mar 2021 20:55:07 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) Received: from CAN01-TO1-obe.outbound.protection.outlook.com (mail-eopbgr670046.outbound.protection.outlook.com [40.107.67.46]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "DigiCert Cloud Services CA-1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4F1fRZ5Cjlz4mcK for ; Thu, 18 Mar 2021 20:55:06 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=Z181yS3RMQpLPF3gVF41MVegFHodwqllMhdKStCNJk+LCty+t4W/dZKqU151FXtpoEsxEGnB+Y20ea+gKVR4E3J++jbm7Cb/J4KKSgyileZPvaxt2OurEFTTyafKOrEPTvhw4T1Ih9ydgKImGNeiJwuM7rShANa8GBp/goZhwPl6uRMffD02bxAI1VgybvUios3t3xH9gejjWHEfh7GYXtYGJLeG3aWMSbOOGHJ8THfRci3Baz50Mw+2LKHZeP82GLNCvLp+eoS/QrEQyeNHfggp3Auyi+ktigxr8hpVSszjRpFrqkFh2UB8OeZ8wdLRzogmcWqnMd2Nb8FIcGE27Q== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=h1+Y7dUTw816tZRoYHWFLpLo91Xr4wUfI/SCT4WMAZg=; b=R8nSNTMZn7ROi93NslcZMgLNudu/n6uwHVcxfwDDs1MywLLf+XQ3u/hwOsx/VE/Jpp/SuXufvlA/+Sn1Xeek/Xc4FhMCIs0jUfbYRlXD06Bb9TkQSfO3djgKxjW4TE5ahIOWCc14M735wKKsWDlMMBmAeOr29zYf0Us/6/AJDcxkOnI6cpdFbb4SPnANPfHQ0dNwfJRP5pqFBs9hPeZklz5Mg28RpsrKUoDyPryZ6wp0DJWMN3G2sRq2E+KzP7EUTETXk+DZuyHhP3mc0IccVQed1zdNPQxTmLlCc8VRB2uyswmeWaB1FwVM9aHh+88GWYE+b3jH9cDHce+Z1I0AkQ== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=uoguelph.ca; dmarc=pass action=none header.from=uoguelph.ca; dkim=pass header.d=uoguelph.ca; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=uoguelph.ca; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=h1+Y7dUTw816tZRoYHWFLpLo91Xr4wUfI/SCT4WMAZg=; b=dOhEtic5yoeV6oaswCC9BVFg/ARYdQRC5KxOywTpm5X7xOStYODuNIYtRFOZUtGSftstAzyAPOZ6Ca5PZB6284lgfdVtvBY9OgC8MlPPmMKdH1ETTwPil9tYmBIrU2uugZpkRORWCDt/oE2btZEN8zF2aHt7qxX6LgDUziGAWvyRTQqIvVGL9rDfOsMnd/g3+fXcoX8JgOuZFasYntNiZhmlWxjNdU3qsxgoDuT9Kp6gVKdR+rUjf37W2wLQgC+8OXln5eEH4LNSGQgtPpqCFFEgaRZAU91U5D1UZQvKdRXdUIvIpqm/dMK6o3r7q1Cb/0yru8AaGsGLVKPA0pduDg== Received: from YQXPR0101MB0968.CANPRD01.PROD.OUTLOOK.COM (2603:10b6:c00:19::29) by YQXPR0101MB0743.CANPRD01.PROD.OUTLOOK.COM (2603:10b6:c00:1c::13) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3890.28; Thu, 18 Mar 2021 20:55:05 +0000 Received: from YQXPR0101MB0968.CANPRD01.PROD.OUTLOOK.COM ([fe80::6073:6fc0:5ddf:dc8a]) by YQXPR0101MB0968.CANPRD01.PROD.OUTLOOK.COM ([fe80::6073:6fc0:5ddf:dc8a%7]) with mapi id 15.20.3933.032; Thu, 18 Mar 2021 20:55:05 +0000 From: Rick Macklem To: Michael Tuexen , "Scheffenegger, Richard" CC: Jason Breitman , "freebsd-net@freebsd.org" Subject: Re: NFS Mount Hangs Thread-Topic: NFS Mount Hangs Thread-Index: AQHXG1G2D7AHBwtmAkS1jBAqNNo2I6qIqQ+SgAEIlICAAAOAgIAAhBk7 Date: Thu, 18 Mar 2021 20:55:05 +0000 Message-ID: References: <3750001D-3F1C-4D9A-A9D9-98BCA6CA65A4@tildenparkcapital.com> <33693DE3-7FF8-4FAB-9A75-75576B88A566@tildenparkcapital.com> , <2890D243-AF46-43A4-A1AD-CB0C3481511D@lurchi.franken.de> In-Reply-To: <2890D243-AF46-43A4-A1AD-CB0C3481511D@lurchi.franken.de> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-ms-publictraffictype: Email x-ms-office365-filtering-correlation-id: 52ed7b2e-6d57-437e-fd01-08d8ea501b64 x-ms-traffictypediagnostic: YQXPR0101MB0743: x-microsoft-antispam-prvs: x-ms-oob-tlc-oobclassifiers: OLM:10000; x-ms-exchange-senderadcheck: 1 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: SWRhHOcCanjf8U15AlG9HkE7YvfeviM3qnUiIr5ewr8edgHlMBz/tOLmz/4gN13FkqhiEAIcRVpUXGBCH67MFOHH64w+ryxpBwbEr9t5oj3tT2Y6XYr/L4SWUN2S1LORA5zULbAv2xGRUN8tWCYjVK88AJW/G67UVT0c1Ok/qqi56WkcFZ58GRVOo0RIjSPYH3GVoxYNl6bjXbiKWnmJHso8mnAEP/87/aqAGx1zB9QFqPbjrf0pjTEqoskbTPe73otOBAc38dxjMfRFrirNvn5CJto1Fzb0wdvaKhX25WVzFqpaHZBBzLuy+lR96q2Nrs95h/RYho00FeAJbEa4QHreAUqSdw7M2jw/kSe4evDXtOpyYcEVE5gCMPal5FUf+i6hoLCayrpDgQdNTBxf8r9xbXF0TmbPwAOAT5Dc7iKfeusSd0/j0cKbiaGk3yAwmWYc0Tz1ukGQByHQbhWI0d5Toeyry6vZGAahu+Pgns6LL2sWaajMWwVRsYoMZ0ab452h2+JF9XujNu0xIEJW48ijfzTcZtWz/6HLAczpuhxye0GVpgqDhK21zeS/KUNPmkvLcnfsH6VMJlYek14p7i7IxVTeDTLra+tUD9z1HslaPkLwt0PYUc2R0AeJlfwhdd28eLHo/KFPt7GNdNApwSthJhGXmqa7p3J3NMO5IhQ= x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:YQXPR0101MB0968.CANPRD01.PROD.OUTLOOK.COM; PTR:; CAT:NONE; SFS:(396003)(376002)(366004)(346002)(136003)(39860400002)(54906003)(66556008)(110136005)(7116003)(186003)(2906002)(3480700007)(83380400001)(8676002)(86362001)(316002)(71200400001)(8936002)(38100700001)(55016002)(478600001)(33656002)(64756008)(52536014)(4326008)(6506007)(66946007)(66446008)(91956017)(76116006)(9686003)(7696005)(66476007)(786003)(5660300002)(966005); DIR:OUT; SFP:1101; x-ms-exchange-antispam-messagedata: =?iso-8859-1?Q?hFbN+AydQfS6pB7c32bULwLQSj1rv+fWne4Zf26iKDIYnC5wE5to20ud2A?= =?iso-8859-1?Q?lqG11F2bdK8SoDKCSbpihCMY7yoiB94KilgZ8iuE+VonSWfeBjesBbi1pr?= =?iso-8859-1?Q?tfaki9+QjBpwL37N3soK3Enchk+MoO57RmT1HXdCY0j+n12rFa9RcSxJj/?= =?iso-8859-1?Q?OyM0UcF2KMts2fa0LdhzR4Xmg5weeF+v6+nB4sDsWJXp8Pyl/w4DDJHLA0?= =?iso-8859-1?Q?G/xbpgU3lFUxtBuSib7mxuF7K2Mc/mWMzCApmcZKSNrTBXKZhwVwQ0qJ2B?= =?iso-8859-1?Q?VJHAEOAmaxKOX1XnWf8ahnz3QycWhVFxv3GsSMG0umIA8uC1HztmaWpIUD?= =?iso-8859-1?Q?e6DwIvhOEf6SIPsGF0KwM6ccFnZIs5OMUe32AzMXI7hGZ8WjqaJ8ctj8rl?= =?iso-8859-1?Q?PRNm0Zu3FudI7CoyExB0CW6iP645WZaZ/+Gz2bk289qq/RK2qMjAHqY6AT?= =?iso-8859-1?Q?+Ajbvof6mWajzeNFSvNgfwFH9M7NoKmDxokPv+PJR/OwbgSchuX9FlQmma?= =?iso-8859-1?Q?ZsGXtXVm3RzgkLO+brc5jwdYomylJwNcaD2lM1R7/WRKb+ieFUYhrDhxwE?= =?iso-8859-1?Q?YTP4Pg8BiGMMYoFr5LZ/A6cHvS0xmp1EJDPSWdwY6gCLZytb8OE+ajCORx?= =?iso-8859-1?Q?9BS2pd8m6OslCbgDHS6r85MY1p6PAQ3r/k6eRK7Ji86UD7l9xOARa7G8Ln?= =?iso-8859-1?Q?J+S8pR7ejo478hzM0lLDaHAhXOlhncu0mnte4fCprHfCN7XgkcsE9RWF+X?= =?iso-8859-1?Q?BQri3SE7b8xFwI9B5b+EvB7osnvGEkO12bLaSwkFPAVL3CyWMNaeJrUQCq?= =?iso-8859-1?Q?4rH4qykBojRC6vkwkaxElrkWk2VZIpoKOH6ob0BG87hfcpKFND3SaM/6uO?= =?iso-8859-1?Q?6mYvqiiRlYbDJi3gzXOWZC9Au+DHjQ4k44z1HRTorxZJ0KhPC9VwzEpyZ7?= =?iso-8859-1?Q?DZmueP3wSbG2UAfaZkNzuAPtuXprkOyqPgx3P6HBybAuyhCpM9wsgjybiN?= =?iso-8859-1?Q?fXPwH5GNAFdqHRM4sjVpavkeFouIPy4fH/c+g6gwjIds43R2svq71J6nZD?= =?iso-8859-1?Q?u/2A2yeKZiz6sGvtYTCPXDTULIE9PX56mosPNIZjSnFeb84Lw6YwMw3W6z?= =?iso-8859-1?Q?Q2gKK8sKw2YBeuyl56T6QS92OmT4SQYwe43DXS4NTx/w1JXBraxtl03dbQ?= =?iso-8859-1?Q?cSLcM9eaveBptMbEnG+iA5RiQytlNADLEfYCQFeplfhoCunyBwzHeyfWBc?= =?iso-8859-1?Q?KugD7zReV1vwCydgZruwgwu1V8DUx1K5K/ZtvwxWBTxzvNUmYnEp8nVlId?= =?iso-8859-1?Q?pM1UYXKdug4rwnMnwbpKyQ5S/KyIZyW3FuLL7GeoWaDwiZJ9gDylEkW1CT?= =?iso-8859-1?Q?aELRNRNsFZE52I3qbff4h04I4LiadNGpYq84yNk8oUnOU0J+Cg7vk=3D?= x-ms-exchange-transport-forked: True Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-OriginatorOrg: uoguelph.ca X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: YQXPR0101MB0968.CANPRD01.PROD.OUTLOOK.COM X-MS-Exchange-CrossTenant-Network-Message-Id: 52ed7b2e-6d57-437e-fd01-08d8ea501b64 X-MS-Exchange-CrossTenant-originalarrivaltime: 18 Mar 2021 20:55:05.0361 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: be62a12b-2cad-49a1-a5fa-85f4f3156a7d X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: ojlZnKNyq7M97ZGv6vTvFc1hk5Nx18GKCkRdH6s0ahm5bZflkLaurmUySw9aI5UurBKwEKUf4zLgMOT07A5V1A== X-MS-Exchange-Transport-CrossTenantHeadersStamped: YQXPR0101MB0743 X-Rspamd-Queue-Id: 4F1fRZ5Cjlz4mcK X-Spamd-Bar: ------ Authentication-Results: mx1.freebsd.org; dkim=pass header.d=uoguelph.ca header.s=selector1 header.b=dOhEtic5; arc=pass (microsoft.com:s=arcselector9901:i=1); dmarc=pass (policy=none) header.from=uoguelph.ca; spf=pass (mx1.freebsd.org: domain of rmacklem@uoguelph.ca designates 40.107.67.46 as permitted sender) smtp.mailfrom=rmacklem@uoguelph.ca X-Spamd-Result: default: False [-6.10 / 15.00]; TO_DN_EQ_ADDR_SOME(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:40.107.0.0/16]; RCVD_COUNT_THREE(0.00)[3]; DKIM_TRACE(0.00)[uoguelph.ca:+]; DMARC_POLICY_ALLOW(-0.50)[uoguelph.ca,none]; NEURAL_HAM_SHORT(-1.00)[-1.000]; RCVD_IN_DNSWL_LOW(-0.10)[40.107.67.46:from]; RCVD_TLS_LAST(0.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[40.107.67.46:from]; ARC_ALLOW(-1.00)[microsoft.com:s=arcselector9901:i=1]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:8075, ipnet:40.104.0.0/14, country:US]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[uoguelph.ca:s=selector1]; FREEFALL_USER(0.00)[rmacklem]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[4]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; SPAMHAUS_ZRD(0.00)[40.107.67.46:from:127.0.2.255]; DWL_DNSWL_LOW(-1.00)[uoguelph.ca:dkim]; TO_MATCH_ENVRCPT_SOME(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; RWL_MAILSPIKE_POSSIBLE(0.00)[40.107.67.46:from]; MAILMAN_DEST(0.00)[freebsd-net] X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 18 Mar 2021 20:55:07 -0000 Michael Tuexen wrote:=0A= >> On 18. Mar 2021, at 13:42, Scheffenegger, Richard wrote:=0A= >>=0A= >>>> Output from the NFS Client when the issue occurs # netstat -an | grep= =0A= >>>> NFS.Server.IP.X=0A= >>>> tcp 0 0 NFS.Client.IP.X:46896 NFS.Server.IP.X:2049 = FIN_WAIT2=0A= >>> I'm no TCP guy. Hopefully others might know why the client would be stu= ck in FIN_WAIT2 (I vaguely recall this means it is waiting for a fin/ack, b= ut could be wrong?)=0A= >>=0A= >> When the client is in Fin-Wait2 this is the state you end up when the Cl= ient side actively close() the tcp session, and then the server also ACKed = the FIN.=0A= Jason noted:=0A= =0A= >When the issue occurs, this is what I see on the NFS Server.=0A= >tcp4 0 0 NFS.Server.IP.X.2049 NFS.Client.IP.X.51550 CL= OSE_WAIT=0A= >=0A= >which corresponds to the state on the client side. The server received the= FIN=0A= >from the client and acked it.=0A= >The server is waiting for a close call to happen.=0A= >So the question is: Is the server also closing the connection?=0A= Did you mean to say "client closing the connection here?"=0A= =0A= The server should call soclose() { it never calls soshutdown() } when=0A= soreceive(with MSG_WAIT) returns 0 bytes or an error that indicates=0A= the socket is broken.=0A= --> The soreceive() call is triggered by an upcall for the rcv side of the = socket.=0A= So, are you saying the FreeBSD NFS server did not call soclose() for this c= ase?=0A= =0A= rick=0A= =0A= Best regards=0A= Michael=0A= > This will last for ~2 min or so, but is asynchronous. However, the same 4= -tuple can not be reused during this time.=0A= >=0A= > With other words, from the socket / TCP, a properly executed active close= () will end up in this state. (If the other side initiated the close, a pas= sive close, will not end in this state)=0A= >=0A= >=0A= > _______________________________________________=0A= > freebsd-net@freebsd.org mailing list=0A= > https://lists.freebsd.org/mailman/listinfo/freebsd-net=0A= > To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org"=0A= =0A= =0A= From owner-freebsd-net@freebsd.org Thu Mar 18 20:56:42 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 28B785AD26A for ; Thu, 18 Mar 2021 20:56:42 +0000 (UTC) (envelope-from tuexen@freebsd.org) Received: from drew.franken.de (mail-n.franken.de [193.175.24.27]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "*.franken.de", Issuer "Sectigo RSA Domain Validation Secure Server CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4F1fTP6yltz4mVD for ; Thu, 18 Mar 2021 20:56:41 +0000 (UTC) (envelope-from tuexen@freebsd.org) Received: from [IPv6:2a02:8109:1140:c3d:8eb:a851:167b:7a08] (unknown [IPv6:2a02:8109:1140:c3d:8eb:a851:167b:7a08]) (Authenticated sender: macmic) by mail-n.franken.de (Postfix) with ESMTPSA id 45DE2762A0D40; Thu, 18 Mar 2021 21:56:37 +0100 (CET) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 14.0 \(3654.60.0.2.21\)) Subject: Re: Severe IPv6 TCP transfer issues on 13.0-RC1 and RC2 From: tuexen@freebsd.org In-Reply-To: <9D504CF5-BF17-439F-9298-E743D9566691@freebsd.org> Date: Thu, 18 Mar 2021 21:56:36 +0100 Cc: freebsd-net@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: <870338FC-CA03-4D75-B9E5-B2867608E8B4@freebsd.org> References: <5753280.1HxCrU2fYu@thinkbook> <9D504CF5-BF17-439F-9298-E743D9566691@freebsd.org> To: Blake Hartshorn X-Mailer: Apple Mail (2.3654.60.0.2.21) X-Spam-Status: No, score=-2.9 required=5.0 tests=ALL_TRUSTED,BAYES_00 autolearn=disabled version=3.4.1 X-Spam-Checker-Version: SpamAssassin 3.4.1 (2015-04-28) on mail-n.franken.de X-Rspamd-Queue-Id: 4F1fTP6yltz4mVD X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [0.00 / 15.00]; local_wl_from(0.00)[freebsd.org]; ASN(0.00)[asn:680, ipnet:193.174.0.0/15, country:DE] X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 18 Mar 2021 20:56:42 -0000 > On 18. Mar 2021, at 21:09, Michael Tuexen wrote: >=20 >> On 15. Mar 2021, at 12:56, Blake Hartshorn = wrote: >>=20 >> The short version, when I use FreeBSD 13, delivering data can take 5 = minutes for 1MB over SSH or HTTP when using IPv6. This problem does not = happen with IPv4. I installed FreeBSD 12 and Linux on that same device, = neither had the problem. >>=20 >> Did some troubleshooting with Linode, have ultimately ruled the = network itself out at this point. When the server is on FreeBSD 13, it = can download quickly over IPv6, but not deliver. Started investigating = after noticing my SSH session was lagging when cat'ing large files or = running builds. This problem even occurs between VMs in the same = datacenter. I generated a 1MB file of base64 garbage served by nginx for = testing. IPv6 is being configured by SLAAC and on both 12 and 13 = installs was setup by the installer. Linode uses Linux/KVM hosts for = their virtual machines so it's running on that virtual adapter. >>=20 >> I asked on the forums, another user recommended going to the mailing = lists instead. Does anyone know if config settings need to be different = on 13? Did I maybe just find a real issue? I can provide any requested = details. Thanks! > I was able to reproduce the issue locally. A fix is under review: > https://reviews.freebsd.org/D29331 The fix is now committed in main, stable/13, releng/13.0, and will be = included in the upcoming RC3. Best regards Michael >=20 > Best regards > Michael >>=20 >>=20 >> _______________________________________________ >> freebsd-net@freebsd.org mailing list >> https://lists.freebsd.org/mailman/listinfo/freebsd-net >> To unsubscribe, send any mail to = "freebsd-net-unsubscribe@freebsd.org" >=20 > _______________________________________________ > freebsd-net@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-net > To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org" From owner-freebsd-net@freebsd.org Thu Mar 18 21:02:23 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id EAF7B5AD5C7 for ; Thu, 18 Mar 2021 21:02:23 +0000 (UTC) (envelope-from tuexen@freebsd.org) Received: from drew.franken.de (drew.ipv6.franken.de [IPv6:2001:638:a02:a001:20e:cff:fe4a:feaa]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "*.franken.de", Issuer "Sectigo RSA Domain Validation Secure Server CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4F1fbz5JcDz4n6v for ; Thu, 18 Mar 2021 21:02:23 +0000 (UTC) (envelope-from tuexen@freebsd.org) Received: from [IPv6:2a02:8109:1140:c3d:8eb:a851:167b:7a08] (unknown [IPv6:2a02:8109:1140:c3d:8eb:a851:167b:7a08]) (Authenticated sender: macmic) by mail-n.franken.de (Postfix) with ESMTPSA id B7B3E762A0D40; Thu, 18 Mar 2021 22:02:19 +0100 (CET) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 14.0 \(3654.60.0.2.21\)) Subject: Re: NFS Mount Hangs From: tuexen@freebsd.org In-Reply-To: Date: Thu, 18 Mar 2021 22:02:19 +0100 Cc: "Scheffenegger, Richard" , "freebsd-net@freebsd.org" Content-Transfer-Encoding: quoted-printable Message-Id: <9EE3DFAC-72B0-4256-B57C-DE6AA811413C@freebsd.org> References: <3750001D-3F1C-4D9A-A9D9-98BCA6CA65A4@tildenparkcapital.com> <33693DE3-7FF8-4FAB-9A75-75576B88A566@tildenparkcapital.com> <2890D243-AF46-43A4-A1AD-CB0C3481511D@lurchi.franken.de> To: Rick Macklem X-Mailer: Apple Mail (2.3654.60.0.2.21) X-Spam-Status: No, score=-2.9 required=5.0 tests=ALL_TRUSTED,BAYES_00 autolearn=disabled version=3.4.1 X-Spam-Checker-Version: SpamAssassin 3.4.1 (2015-04-28) on mail-n.franken.de X-Rspamd-Queue-Id: 4F1fbz5JcDz4n6v X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [0.00 / 15.00]; ASN(0.00)[asn:680, ipnet:2001:638::/32, country:DE]; local_wl_from(0.00)[freebsd.org] X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 18 Mar 2021 21:02:24 -0000 > On 18. Mar 2021, at 21:55, Rick Macklem wrote: >=20 > Michael Tuexen wrote: >>> On 18. Mar 2021, at 13:42, Scheffenegger, Richard = wrote: >>>=20 >>>>> Output from the NFS Client when the issue occurs # netstat -an | = grep >>>>> NFS.Server.IP.X >>>>> tcp 0 0 NFS.Client.IP.X:46896 = NFS.Server.IP.X:2049 FIN_WAIT2 >>>> I'm no TCP guy. Hopefully others might know why the client would be = stuck in FIN_WAIT2 (I vaguely recall this means it is waiting for a = fin/ack, but could be wrong?) >>>=20 >>> When the client is in Fin-Wait2 this is the state you end up when = the Client side actively close() the tcp session, and then the server = also ACKed the FIN. > Jason noted: >=20 >> When the issue occurs, this is what I see on the NFS Server. >> tcp4 0 0 NFS.Server.IP.X.2049 NFS.Client.IP.X.51550 = CLOSE_WAIT >>=20 >> which corresponds to the state on the client side. The server = received the FIN >> from the client and acked it. >> The server is waiting for a close call to happen. >> So the question is: Is the server also closing the connection? > Did you mean to say "client closing the connection here?" Yes. >=20 > The server should call soclose() { it never calls soshutdown() } when > soreceive(with MSG_WAIT) returns 0 bytes or an error that indicates > the socket is broken. > --> The soreceive() call is triggered by an upcall for the rcv side of = the socket. > So, are you saying the FreeBSD NFS server did not call soclose() for = this case? Yes. If the state at the server side is CLOSE_WAIT, no close call has = happened yet. The FIN from the client was received, it was ACKED, but no close() call (or shutdown(..., SHUT_WR) or shutdown(..., SHUT_RDWR)) was issued. = Therefore, no FIN was sent and the client should be in the FINWAIT-2 state. This = was also reported. So the reported states are consistent. Best regards Michael >=20 > rick >=20 > Best regards > Michael >> This will last for ~2 min or so, but is asynchronous. However, the = same 4-tuple can not be reused during this time. >>=20 >> With other words, from the socket / TCP, a properly executed active = close() will end up in this state. (If the other side initiated the = close, a passive close, will not end in this state) >>=20 >>=20 >> _______________________________________________ >> freebsd-net@freebsd.org mailing list >> https://lists.freebsd.org/mailman/listinfo/freebsd-net >> To unsubscribe, send any mail to = "freebsd-net-unsubscribe@freebsd.org" >=20 >=20 > _______________________________________________ > freebsd-net@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-net > To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org" From owner-freebsd-net@freebsd.org Thu Mar 18 21:17:38 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 504565ADB46 for ; Thu, 18 Mar 2021 21:17:38 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 4F1fxZ1fY1z4nlL for ; Thu, 18 Mar 2021 21:17:38 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 389C55ADCE9; Thu, 18 Mar 2021 21:17:38 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 3865A5ADBC1 for ; Thu, 18 Mar 2021 21:17:38 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4F1fxZ1368z4ngq for ; Thu, 18 Mar 2021 21:17:38 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 1739AE89 for ; Thu, 18 Mar 2021 21:17:38 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 12ILHcBP074037 for ; Thu, 18 Mar 2021 21:17:38 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 12ILHchk074036 for net@FreeBSD.org; Thu, 18 Mar 2021 21:17:38 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 254244] panics after upgrade to stable/13-n244861-b9773574371 Date: Thu, 18 Mar 2021 21:17:37 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-STABLE X-Bugzilla-Keywords: panic, regression X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: rscheff@freebsd.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: FIXED X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: net@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: resolution bug_status Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 18 Mar 2021 21:17:38 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D254244 Richard Scheffenegger changed: What |Removed |Added ---------------------------------------------------------------------------- Resolution|--- |FIXED Status|In Progress |Closed --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-net@freebsd.org Fri Mar 19 13:26:57 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 2A4FC5741BF for ; Fri, 19 Mar 2021 13:26:57 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 4F24S10WsZz4m5Q for ; Fri, 19 Mar 2021 13:26:57 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 120645741BD; Fri, 19 Mar 2021 13:26:57 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 11D4A573ED2 for ; Fri, 19 Mar 2021 13:26:57 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4F24S071W2z4m9t for ; Fri, 19 Mar 2021 13:26:56 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id E41BB1585F for ; Fri, 19 Mar 2021 13:26:56 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 12JDQuqB073388 for ; Fri, 19 Mar 2021 13:26:56 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 12JDQu3W073387 for net@FreeBSD.org; Fri, 19 Mar 2021 13:26:56 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 237441] Virtio net consistently truncates last byte of a fetch xfer with > 8956 bytes of payload Date: Fri, 19 Mar 2021 13:26:56 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 12.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: jrtc27@freebsd.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: Not A Bug X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc resolution Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 19 Mar 2021 13:26:57 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D237441 Jessica Clarke changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |jrtc27@freebsd.org Resolution|FIXED |Not A Bug --- Comment #10 from Jessica Clarke --- (In reply to Adam Chappell from comment #9) There wasn't one, it's still broken, we've independently been trying to work out what on earth was going on causing us to see the same thing (without realising it was only affecting macOS hosts) until we stumbled upon this report. Not a bug in FreeBSD (well, unless MSG_OOB should be enforced, but then eve= ry OS has the same bug), just POLLPRI being extremely ill-defined, SLiRP tryin= g to be helpful and TCP urgent being ubiquitously misunderstood all interacting together to result in this unfortunate outcome. Should no longer occur once QEMU pulls in https://gitlab.freedesktop.org/slirp/libslirp/-/commit/7271345efe182199acae= ae602cb78a94a7c6dc9d; thanks for figuring that one out so we didn't have to. --=20 You are receiving this mail because: You are on the CC list for the bug.= From owner-freebsd-net@freebsd.org Fri Mar 19 13:58:52 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 39B7A575609 for ; Fri, 19 Mar 2021 13:58:52 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 4F258r0yBtz4p7W for ; Fri, 19 Mar 2021 13:58:52 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 1EC935751F3; Fri, 19 Mar 2021 13:58:52 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 1E8B5574EE5 for ; Fri, 19 Mar 2021 13:58:52 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4F258q6rjvz4p7V for ; Fri, 19 Mar 2021 13:58:51 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id DEADC16344 for ; Fri, 19 Mar 2021 13:58:51 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 12JDwpGa088778 for ; Fri, 19 Mar 2021 13:58:51 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 12JDwpwx088777 for net@FreeBSD.org; Fri, 19 Mar 2021 13:58:51 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 237441] Virtio net consistently truncates last byte of a fetch xfer with > 8956 bytes of payload Date: Fri, 19 Mar 2021 13:58:51 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 12.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: arichardson@FreeBSD.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: Not A Bug X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 19 Mar 2021 13:58:52 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D237441 --- Comment #11 from Alex Richardson --- It appears this is a libslirp issue on macOS. Rebuilding QEMU with slirp updated to include https://gitlab.freedesktop.org/slirp/libslirp/-/commit/7271345efe182199acae= ae602cb78a94a7c6dc9d fixes this issue for me. See also https://gitlab.freedesktop.org/slirp/libslirp/-/issues/35 I've filed https://github.com/Homebrew/homebrew-core/issues/73517 --=20 You are receiving this mail because: You are on the CC list for the bug.= From owner-freebsd-net@freebsd.org Fri Mar 19 15:58:05 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 9D1E4578F62 for ; Fri, 19 Mar 2021 15:58:05 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) Received: from CAN01-TO1-obe.outbound.protection.outlook.com (mail-eopbgr670073.outbound.protection.outlook.com [40.107.67.73]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "DigiCert Cloud Services CA-1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4F27pN3cL4z3DS5; Fri, 19 Mar 2021 15:58:03 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=Y2WPs3IhEaGA/iH0Jj33jGPoIkzmdWsBH6ZjhmlJVLEls++gkvGC5+fzOJ8fL0sUW6xuKrGRZ2O7JFH0BdX2DGU/+Jc4pBmX1YYYB6poiw0966GcSyJSqiOty3bTl2Qr0SNc4rm99ADPZNfroeAlc9zGt4/T9ZPgshOPt60uahlavoqhFZQ/3Lj3HGOKddqe8AF5P5kuAcrMXqr/S7f2vtkSYgq5R1WdbsEfbzVhgp8fJJipZcmudP4g34n9Tne0j1CQ1QmC/VTU3FdQNhXTwIyaDX0Mv+yLJ5EhKXTVu49qGR4rrCKi3T5EaXLEoIIe5d1Jgrtr6xryTnxgTfplGQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=8J2Yrj4xVoKWlqCLPSRviHtVLOngwbvu0KjGSmYL2Ag=; b=J9bRuUDCjZilEplVO0GEqZwPFYTMlo+8PSRNT2IEVFjs1bhg2Ut25Kn/RCaucXqZdoWGt8YszdrgxPGk2ex6R4SNtIdUZfxlE/Tmbe2paNp7iU6WZ2OrSl8A0ZsCHmbihPYoXOjVGQj0F3KpZ492/YdhdNQEy9CP1h/8pm/8LicPXSJMlMn0AzaZ0w4ZIbBKUf6O7K6xFN1VCALT1TXDiZiWcpnZrN9yzneI+ieYvc85DL7oUInzTwq9djsWDtwgklbZ640dMz7yO9Qc1dbC6lKG7MJ3mR1px/O75BEfevu2flGu9qQCQVvmh67t7X9qqiO2VwlMFfhUgZFrejHweA== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=uoguelph.ca; dmarc=pass action=none header.from=uoguelph.ca; dkim=pass header.d=uoguelph.ca; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=uoguelph.ca; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=8J2Yrj4xVoKWlqCLPSRviHtVLOngwbvu0KjGSmYL2Ag=; b=pFpbay64jZaT6wRZsZhwrwiRfI13mVvBubBxd+JjSfdJRuXUSBeNncJFX49qkUgrGSLhmWy8uMsLd1oogXJywffNN0v3/4F+cmvvCdVw4rv0m89Y87L3WsbqxFWe4Vp4lCKl/jQMvXB7WGWdydsiJdGjpOrNu/L1GUXBoybzBP0e/l2JcuDI+9OHJBjM9pF1QaC9PsdLEHPl+69U1mnEMkE4r6SAOB9QKz/1M+dLb61vQuyc85a+uQk5aO3Wf35b1Gn7UpLhvPIxrCGeWwVisXE8ylbBtcDI+bozKjLi/EGaxWX0wZY3epQJN4H1MSB4f1FQi37eDPsGVxNAPWTC+w== Received: from YQXPR0101MB0968.CANPRD01.PROD.OUTLOOK.COM (2603:10b6:c00:19::29) by YQXPR01MB4328.CANPRD01.PROD.OUTLOOK.COM (2603:10b6:c01:10::15) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3933.32; Fri, 19 Mar 2021 15:58:02 +0000 Received: from YQXPR0101MB0968.CANPRD01.PROD.OUTLOOK.COM ([fe80::6073:6fc0:5ddf:dc8a]) by YQXPR0101MB0968.CANPRD01.PROD.OUTLOOK.COM ([fe80::6073:6fc0:5ddf:dc8a%7]) with mapi id 15.20.3933.033; Fri, 19 Mar 2021 15:58:02 +0000 From: Rick Macklem To: "tuexen@freebsd.org" CC: "Scheffenegger, Richard" , "freebsd-net@freebsd.org" , Alexander Motin Subject: Re: NFS Mount Hangs Thread-Topic: NFS Mount Hangs Thread-Index: AQHXG1G2D7AHBwtmAkS1jBAqNNo2I6qIqQ+SgAEIlICAAAOAgIAAhBk7gAAEF4CAATUdPQ== Date: Fri, 19 Mar 2021 15:58:02 +0000 Message-ID: References: <3750001D-3F1C-4D9A-A9D9-98BCA6CA65A4@tildenparkcapital.com> <33693DE3-7FF8-4FAB-9A75-75576B88A566@tildenparkcapital.com> <2890D243-AF46-43A4-A1AD-CB0C3481511D@lurchi.franken.de> , <9EE3DFAC-72B0-4256-B57C-DE6AA811413C@freebsd.org> In-Reply-To: <9EE3DFAC-72B0-4256-B57C-DE6AA811413C@freebsd.org> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: yes X-MS-TNEF-Correlator: x-ms-publictraffictype: Email x-ms-office365-filtering-correlation-id: 24327320-8994-4686-0064-08d8eaefc6c4 x-ms-traffictypediagnostic: YQXPR01MB4328: x-microsoft-antispam-prvs: x-ms-oob-tlc-oobclassifiers: OLM:4502; x-ms-exchange-senderadcheck: 1 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: ow2EeCHMPoDeLFomg8gQzRhk/2feiqYChlzF2moQJsSbbrFiDKo+wSOcI+6NXjpcUIkYfy4K17+h3Xm/hpQNfDqtBclq4t0ZYcWi2WVQH008C6FqgrBHu1z3Pj5N0P5Wljl9V/i/AQBlt4QaZm9Al7CgHOE83TGYyymrwpJH7WJs4ctoD28y48F1uPduaHfAqM1wJfl2t1BEjsolFf9abOLzSo0lIeNjmO1HkDxhmJ5mrJZZ4rFnUe17yQrMdCEczRv/ltO9UAwvFnVQEpvtcR4vD4gM69I0h5n3VbVBEdXPGkjq38lR5qjXOfKEdmNbwzO0RDvbgWaSLbdTFico25BrEUiv2JQ+NYkzySCq2X76qy5JQirQWS4IXn84wY0Qs8GQ2HHQjp/kIUH9jBZAXLiTN3mEh/LajEkqn1LTfGzKA119naDBR+HVLwAjMgMWD3BDRLdKfXlKEuiRxEGx4f2793UCDriC1KrPUC14BnvFIf6MxHTR3BzP1OKDJQWc4c0gPNLWwhk3qrJr7vRImUNYAcTM2o54IZvK4GVtznc4tUrvHf2aytTHbRG2SG5Hcw31ZHZ42tjEfUX+VL0FzGGAjnpFpLOs+Gv1aXN57vmKcsLWS4f2903NM6U1Q3GiZfOi+Ipf6a6AZN2rxvXiFiHJ/0hoTLAiZz7W9/WpA4DXwzhMi6MsFlWwJXTl3GePyZb4x4exPNrbmz/X8EGqUAPWjxaveDHjPYbzN7ud30Y= x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:YQXPR0101MB0968.CANPRD01.PROD.OUTLOOK.COM; PTR:; CAT:NONE; SFS:(136003)(346002)(376002)(39860400002)(396003)(366004)(66616009)(83380400001)(66946007)(66476007)(76116006)(66556008)(186003)(478600001)(6506007)(38100700001)(2906002)(64756008)(33656002)(54906003)(66446008)(99936003)(316002)(966005)(52536014)(86362001)(7696005)(55016002)(4326008)(6916009)(3480700007)(71200400001)(5660300002)(7116003)(8676002)(9686003)(786003)(8936002)(91956017); DIR:OUT; SFP:1101; x-ms-exchange-antispam-messagedata: =?iso-8859-1?Q?Eurzpm0Az0tn0nRs+z1M78w/ZYW+YQNoQQX2Qe7cfwr/IrHGOy9MIEjPW1?= =?iso-8859-1?Q?6NwrLHUjQ23Tgedlg7YREJBo9/djtdKzZ7KaJO5f7+NFblr2dVXUpd37bz?= =?iso-8859-1?Q?Ugfsh4KdWTOwtWro927tSnnXvvl9wIkjHECgvbuLf6Rpepez3x2oxBcFy2?= =?iso-8859-1?Q?IWmsigdGOZC9pHY5y52W+RKQXaUfXxzxTB7rdBKKLC6Nm2JOvn9JzrsXZW?= =?iso-8859-1?Q?OkWCyIpOVidujpPsWVSCgJq0bPswz2svSgQi1lSU5xQ6MNcbGIe8HtDK0+?= =?iso-8859-1?Q?8DFAQioM/2T959J/dR8wmyANiT0xgbQcMgmkI2ZNFxvhFC2kbYsqI4JGnR?= =?iso-8859-1?Q?oD3v3al+m8rrKMIIs1Tsr+hGFq3dKPnbdaD9o+J5APQHzAnVR8OtaWRIa7?= =?iso-8859-1?Q?f4qM02RVtBSfVRm4HJABt0tC1Os25UBVGt4oOMLGievSysgd5+u8qyfocf?= =?iso-8859-1?Q?BARL7abThn0fF7bsotjKOkx6H0dFAHwvbs7Vyua/YemoJIKTd1T3208wDQ?= =?iso-8859-1?Q?nKYmzOdaL4VwMuPD4vWeAcUOQoA+1q+5T2Eh95iitMxbTq6hkmKURI9HkV?= =?iso-8859-1?Q?ukiWFecs+dOj0wQpTfdXGeK6t3GFjzyGRg4HEWxrOnNI6u7kNmzV4cl4mf?= =?iso-8859-1?Q?/2XHHgVRUOhoOE7fq7yQWkG2c0WwVqi+m1QRMILLKhI8+h1gzT9YVBNL+m?= =?iso-8859-1?Q?rrmt8sfKnzC/MrAfbwS2r46V6XAT8uP9sGPKD7gO/DEwWKtnt3LUpuP6H1?= =?iso-8859-1?Q?vB4wGFOEt1GoX1MM/be/YXTbPm7iaw/BYQFtsz2O0lvCL90pKEAXzYQT1n?= =?iso-8859-1?Q?G47+kKtuofTpc2J6pTM0Zbhl6ySWaEgw5Yop5ZUxyWC+Y9EIeGJBLHPD/z?= =?iso-8859-1?Q?rBPYAXTqTtmzwL03/r0O0TImpJrmoF874WtZ4dluLJLmdu2PmA1kn3tz9V?= =?iso-8859-1?Q?0f8DBMAg/bYCZM1was3qpYgbUcwKSjL5VixTzZEGtDLvpR+YDtiGGd1x4Y?= =?iso-8859-1?Q?rRKFsZjBefLz38W1ZVI+RW365WL/J9aMeh5WAt6pvzbro49cBf00ccbdaz?= =?iso-8859-1?Q?tXcU9b3rXrCglukKoz2pnZVJLTX2ELx6j6QhexEy/2gYV8/f6K2h0iZCrP?= =?iso-8859-1?Q?T0d1Dv8umurMCMieMvDz2S09ldoo8zyzbZ8TqbnA+GYonQUBSMX7/vcavS?= =?iso-8859-1?Q?aclptr7QkAbTvTNcCz21Q4cY4l47tVBp7xcHSEUITCpgRHjyhAkc7UYcOl?= =?iso-8859-1?Q?hRGoRrz0B/T171xIFCgaq7IxRXfNvih2OJm3wZTldPkrSeydKhJ3DbO8Wn?= =?iso-8859-1?Q?+1NFgCqfhmnWdax1VeCphpZCSK0VktYKvwUpU1hrSyH5MpLsMpyL4nVjzu?= =?iso-8859-1?Q?1T8t2wRiNEYru03aQtBUNsj9JqhJxiZkPLKi8DaIx8qkPWFeNqXJw=3D?= x-ms-exchange-transport-forked: True Content-Type: multipart/mixed; boundary="_002_YQXPR0101MB0968E1537E26CDBDC31C58E5DD689YQXPR0101MB0968_" MIME-Version: 1.0 X-OriginatorOrg: uoguelph.ca X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: YQXPR0101MB0968.CANPRD01.PROD.OUTLOOK.COM X-MS-Exchange-CrossTenant-Network-Message-Id: 24327320-8994-4686-0064-08d8eaefc6c4 X-MS-Exchange-CrossTenant-originalarrivaltime: 19 Mar 2021 15:58:02.5012 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: be62a12b-2cad-49a1-a5fa-85f4f3156a7d X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: 1h4pxIbnCEldZCwgefqeYFS+y1SegT4mIm3g45oHAJ+FBvDfs0mqw0pdIDsYRTkKVcCZuyMQlQXc0BD6JKJvlA== X-MS-Exchange-Transport-CrossTenantHeadersStamped: YQXPR01MB4328 X-Rspamd-Queue-Id: 4F27pN3cL4z3DS5 X-Spamd-Bar: ------ Authentication-Results: mx1.freebsd.org; dkim=pass header.d=uoguelph.ca header.s=selector1 header.b=pFpbay64; arc=pass (microsoft.com:s=arcselector9901:i=1); dmarc=pass (policy=none) header.from=uoguelph.ca; spf=pass (mx1.freebsd.org: domain of rmacklem@uoguelph.ca designates 40.107.67.73 as permitted sender) smtp.mailfrom=rmacklem@uoguelph.ca X-Spamd-Result: default: False [-6.10 / 15.00]; TO_DN_EQ_ADDR_SOME(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:40.107.0.0/16]; HAS_ATTACHMENT(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; DKIM_TRACE(0.00)[uoguelph.ca:+]; DMARC_POLICY_ALLOW(-0.50)[uoguelph.ca,none]; NEURAL_HAM_SHORT(-1.00)[-1.000]; RCVD_IN_DNSWL_LOW(-0.10)[40.107.67.73:from]; RCVD_TLS_LAST(0.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[40.107.67.73:from]; ARC_ALLOW(-1.00)[microsoft.com:s=arcselector9901:i=1]; MIME_TRACE(0.00)[0:+,1:+,2:~]; ASN(0.00)[asn:8075, ipnet:40.104.0.0/14, country:US]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[uoguelph.ca:s=selector1]; FROM_EQ_ENVFROM(0.00)[]; FREEFALL_USER(0.00)[rmacklem]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[4]; MIME_GOOD(-0.10)[multipart/mixed,text/plain]; NEURAL_HAM_LONG(-1.00)[-1.000]; SPAMHAUS_ZRD(0.00)[40.107.67.73:from:127.0.2.255]; DWL_DNSWL_LOW(-1.00)[uoguelph.ca:dkim]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RWL_MAILSPIKE_POSSIBLE(0.00)[40.107.67.73:from]; MAILMAN_DEST(0.00)[freebsd-net] X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 19 Mar 2021 15:58:05 -0000 --_002_YQXPR0101MB0968E1537E26CDBDC31C58E5DD689YQXPR0101MB0968_ Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable Michael Tuexen wrote:=0A= >> On 18. Mar 2021, at 21:55, Rick Macklem wrote:=0A= >>=0A= >> Michael Tuexen wrote:=0A= >>>> On 18. Mar 2021, at 13:42, Scheffenegger, Richard wrote:=0A= >>>>=0A= >>>>>> Output from the NFS Client when the issue occurs # netstat -an | gre= p=0A= >>>>>> NFS.Server.IP.X=0A= >>>>>> tcp 0 0 NFS.Client.IP.X:46896 NFS.Server.IP.X:2049 = FIN_WAIT2=0A= >>>>> I'm no TCP guy. Hopefully others might know why the client would be s= tuck in FIN_WAIT2 (I vaguely recall this means it is waiting for a fin/ack,= but could be wrong?)=0A= >>>>=0A= >>>> When the client is in Fin-Wait2 this is the state you end up when the = Client side actively close() the tcp session, and then the server also ACKe= d the FIN.=0A= >> Jason noted:=0A= >>=0A= >>> When the issue occurs, this is what I see on the NFS Server.=0A= >>> tcp4 0 0 NFS.Server.IP.X.2049 NFS.Client.IP.X.51550 = CLOSE_WAIT=0A= >>>=0A= >>> which corresponds to the state on the client side. The server received = the FIN=0A= >>> from the client and acked it.=0A= >>> The server is waiting for a close call to happen.=0A= >>> So the question is: Is the server also closing the connection?=0A= >> Did you mean to say "client closing the connection here?"=0A= >Yes.=0A= >>=0A= >> The server should call soclose() { it never calls soshutdown() } when=0A= >> soreceive(with MSG_WAIT) returns 0 bytes or an error that indicates=0A= >> the socket is broken.=0A= Btw, I looked and the soreceive() is done with MSG_DONTWAIT, but the=0A= EWOULDBLOCK is handled appropriately.=0A= =0A= >> --> The soreceive() call is triggered by an upcall for the rcv side of t= he socket.=0A= >> So, are you saying the FreeBSD NFS server did not call soclose() for thi= s case?=0A= >Yes. If the state at the server side is CLOSE_WAIT, no close call has happ= ened yet.=0A= >The FIN from the client was received, it was ACKED, but no close() call=0A= >(or shutdown(..., SHUT_WR) or shutdown(..., SHUT_RDWR)) was issued. Theref= ore,=0A= >no FIN was sent and the client should be in the FINWAIT-2 state. This was = also=0A= >reported. So the reported states are consistent.=0A= For a test, I commented out the soclose() call in the server side krpc and,= when I=0A= dismounted, it did leave the server socket in CLOSE_WAIT.=0A= For the FreeBSD client, it did the dismount and the socket was in FIN_WAIT2= =0A= for a little while and then disappeared (someone mentioned a short timeout= =0A= and that seems to be the case).=0A= I might argue that the Linux client should not get hung when this occurs,= =0A= but there does appear to be an issue on the FreeBSD end.=0A= =0A= So it does appear you have a case where the soclose() call is not happening= =0A= on the FreeBSD NFS server. I am a little surprised since I don't think I've= =0A= heard of this before and the code is at least 10years old (at least the par= ts=0A= related to this).=0A= =0A= For the soclose() to not happen, the reference count on the socket=0A= structure cannot have gone to zero. (ie a SVC_RELEASE() was missed)=0A= Upon code inspection, I was not able to spot a reference counting bug.=0A= (Not too surprising, since a reference counting bug should have shown=0A= up long ago.)=0A= =0A= The only thing I spotted that could conceivably explain this is that the=0A= function svc_vc_stat() which returns the indication that the socket has=0A= been closed at the other end did not bother to do any locking when=0A= it checked the status. (I am not yet sure if this could result in the=0A= status of XPRT_DIED being missed by the call, but if so, that would=0A= result in the soclose() call not happening.)=0A= =0A= I have attached a small patch, which I think is safe, that adds locking=0A= to svc_vc_stat(),which I am hoping you can try at some point.=0A= (I realize this is difficult for a production server, but...)=0A= I have tested it a little and will test it some more, to try and ensure=0A= it does not break anything.=0A= =0A= I have also cc'd mav@, since he's the guy who last worked on this=0A= code, in case he has any insight w.r.t. how the soclose() might get=0A= missed (or any other way the server socket gets stuck in CLOSE_WAIT).=0A= =0A= rick=0A= ps: I'll create a PR for this, so that it doesn't get forgotten.=0A= =0A= Best regards=0A= Michael=0A= =0A= >=0A= > rick=0A= >=0A= > Best regards=0A= > Michael=0A= >> This will last for ~2 min or so, but is asynchronous. However, the same = 4-tuple can not be reused during this time.=0A= >>=0A= >> With other words, from the socket / TCP, a properly executed active clos= e() will end up in this state. (If the other side initiated the close, a pa= ssive close, will not end in this state)=0A= >>=0A= >>=0A= >> _______________________________________________=0A= >> freebsd-net@freebsd.org mailing list=0A= >> https://lists.freebsd.org/mailman/listinfo/freebsd-net=0A= >> To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org"= =0A= >=0A= >=0A= > _______________________________________________=0A= > freebsd-net@freebsd.org mailing list=0A= > https://lists.freebsd.org/mailman/listinfo/freebsd-net=0A= > To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org"=0A= =0A= _______________________________________________=0A= freebsd-net@freebsd.org mailing list=0A= https://lists.freebsd.org/mailman/listinfo/freebsd-net=0A= To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org"=0A= =0A= --_002_YQXPR0101MB0968E1537E26CDBDC31C58E5DD689YQXPR0101MB0968_ Content-Type: application/octet-stream; name="xprtdied.patch" Content-Description: xprtdied.patch Content-Disposition: attachment; filename="xprtdied.patch"; size=921; creation-date="Fri, 19 Mar 2021 15:50:41 GMT"; modification-date="Fri, 19 Mar 2021 15:50:41 GMT" Content-Transfer-Encoding: base64 LS0tIHN5cy9ycGMvc3ZjX3ZjLmMueHBydGRpZWQJMjAyMS0wMy0xOSAwNjozNDowNi4yOTc1NDUw MDAgLTA3MDAKKysrIHN5cy9ycGMvc3ZjX3ZjLmMJMjAyMS0wMy0xOSAwNzowMjozOS45OTcyMTIw MDAgLTA3MDAKQEAgLTU1OSwxOSArNTU5LDI2IEBAIHN0YXRpYyBlbnVtIHhwcnRfc3RhdAogc3Zj X3ZjX3N0YXQoU1ZDWFBSVCAqeHBydCkKIHsKIAlzdHJ1Y3QgY2ZfY29ubiAqY2Q7CisJZW51bSB4 cHJ0X3N0YXQgcnN0YXQ7CiAKIAljZCA9IChzdHJ1Y3QgY2ZfY29ubiAqKSh4cHJ0LT54cF9wMSk7 CiAKKwlyc3RhdCA9IFhQUlRfSURMRTsKKwlzeF94bG9jaygmeHBydC0+eHBfbG9jayk7CiAJaWYg KGNkLT5zdHJtX3N0YXQgPT0gWFBSVF9ESUVEKQotCQlyZXR1cm4gKFhQUlRfRElFRCk7CisJCXJz dGF0ID0gWFBSVF9ESUVEOworCWVsc2UgaWYgKGNkLT5tcmVxICE9IE5VTEwgJiYgY2QtPnJlc2lk ID09IDAgJiYgY2QtPmVvcikKKwkJcnN0YXQgPSBYUFJUX01PUkVSRVFTOwogCi0JaWYgKGNkLT5t cmVxICE9IE5VTEwgJiYgY2QtPnJlc2lkID09IDAgJiYgY2QtPmVvcikKLQkJcmV0dXJuIChYUFJU X01PUkVSRVFTKTsKKwlpZiAocnN0YXQgPT0gWFBSVF9JRExFKSB7CisJCVNPQ0tCVUZfTE9DSygm eHBydC0+eHBfc29ja2V0LT5zb19yY3YpOworCQlpZiAoc29yZWFkYWJsZSh4cHJ0LT54cF9zb2Nr ZXQpKQorCQkJcnN0YXQgPSBYUFJUX01PUkVSRVFTOworCQlTT0NLQlVGX1VOTE9DSygmeHBydC0+ eHBfc29ja2V0LT5zb19yY3YpOworCX0KKwlzeF94dW5sb2NrKCZ4cHJ0LT54cF9sb2NrKTsKIAot CWlmIChzb3JlYWRhYmxlKHhwcnQtPnhwX3NvY2tldCkpCi0JCXJldHVybiAoWFBSVF9NT1JFUkVR Uyk7Ci0KLQlyZXR1cm4gKFhQUlRfSURMRSk7CisJcmV0dXJuIChyc3RhdCk7CiB9CiAKIHN0YXRp YyBib29sX3QK --_002_YQXPR0101MB0968E1537E26CDBDC31C58E5DD689YQXPR0101MB0968_-- From owner-freebsd-net@freebsd.org Fri Mar 19 16:07:55 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id BB14E579167 for ; Fri, 19 Mar 2021 16:07:55 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 4F281l4lQRz3Dv1 for ; Fri, 19 Mar 2021 16:07:55 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id A2F6F5792CD; Fri, 19 Mar 2021 16:07:55 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id A2C0F579166 for ; Fri, 19 Mar 2021 16:07:55 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4F281l49L2z3F6Q for ; Fri, 19 Mar 2021 16:07:55 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 7E3A117F97 for ; Fri, 19 Mar 2021 16:07:55 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 12JG7t6D054260 for ; Fri, 19 Mar 2021 16:07:55 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 12JG7tq4054259 for net@FreeBSD.org; Fri, 19 Mar 2021 16:07:55 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 236983] bnxt(4) VLAN not operational unless explicit "ifconfig promisc" is used on the physical IF Date: Fri, 19 Mar 2021 16:07:55 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.2-STABLE X-Bugzilla-Keywords: needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: bra@fsn.hu X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: Normal X-Bugzilla-Assigned-To: net@FreeBSD.org X-Bugzilla-Flags: mfc-stable12? mfc-stable11? X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 19 Mar 2021 16:07:55 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D236983 bra@fsn.hu changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |bra@fsn.hu --- Comment #21 from bra@fsn.hu --- I can see the same with fresh versions of stable/12 and /13. dev.bnxt.0.ver.hwrm_fw: 214.4.91 --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-net@freebsd.org Fri Mar 19 16:14:04 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 7F91A579884 for ; Fri, 19 Mar 2021 16:14:04 +0000 (UTC) (envelope-from Richard.Scheffenegger@netapp.com) Received: from NAM02-SN1-obe.outbound.protection.outlook.com (mail-eopbgr770049.outbound.protection.outlook.com [40.107.77.49]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "DigiCert Cloud Services CA-1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4F288r20gKz3FbZ; Fri, 19 Mar 2021 16:14:03 +0000 (UTC) (envelope-from Richard.Scheffenegger@netapp.com) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=W1yzdKyNYxlp9vCuGiS9E2qYcCJk43bMfuFIwgkQ1RVLupNaupme50cm0FtCeRBDffHYsufshJbI2RxKD6vKTqvW8/uabUIHAnm5JGSz2Z0blWYfGJHIJDWACgeBfrDzID3n/FPbZMCsqVRqCA6oe6gk0j0sxEFFWIy9vJKEJzjlOXji25o2ZUHX7oJLAku8m2qld1GCJVQfvgUcVUpVHN/79MhALc/aXMhq6A9QckvgXVOgVwkGkXBpBY+mzv++0rtezFCWXwTlut9HhYZM6KUASSvGM3PkXTgyTxkCHUpL5jAjKam7ox8G6QmHMuTMgr3WFnKOCOONO/K5cw2EDA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=vF2ATi1WINpDmQxzuBaZ3PCKKx9UKLJuJm5LsTZNmXU=; b=A0LjWyaXmHv111Mo3r0+DyGyT1alz5WCF8O+s0wFhD3GyR6dDJj7zr+9ZGWBKpZy/IHtazqNSydBSF0KjVtUGafVWdpqXSombF72TmYb143bpRWK+uatDZwF1TF8I9XvHj17/mj2Ftsz1X09I0T+lb16bj4eywwFV2o7Bg5yHKoIMKfnN0XfVHgARDGrlaaVdozA9mLMQ6ABuLGHckBfXSb6xPITnnuSCA7YGEOAatmmGazC4b7vLc6+7+yyHoODG3J031zbXa5+ug2DBtgsSd1k33Tz/WnAiVb3VUlcYao0C339yZ2AF/j4LI9TzoS8LWWrRbMPJ1bwmjt2f8+YQA== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=netapp.com; dmarc=pass action=none header.from=netapp.com; dkim=pass header.d=netapp.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=netapp.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=vF2ATi1WINpDmQxzuBaZ3PCKKx9UKLJuJm5LsTZNmXU=; b=Q6mgdXH+KX8I8mBXhRq0NYHmQJQ03wlGFhZSM8KCt5bbVRILAtUvOfrNtuqbPEu3h6Gz/WPHAnIatbc0477cu/9zt2PnxZipPHrV2rMUhXAvvRx916TKiNdPKkfs5y0y9qrPoflFRUpZIuJbYFg9rt0T4TrC435DszP+aOgBWKiTECd8eOg+ILWcjNgRPskiHO3kwcn7Wd5lxWDHPzVsSkLN6jAx++Lic8A+IKcP97PqncicvWBIVsPQ2tyIoP2lqfyBr1bIgXJ53oJp0F2GGp6GSTJ9T2wXZ1O/6kLmqgQ8Rlyq9UZdwrsGNtEeOAs5ceR+iiuhCy0CwG74SuQLAQ== Received: from SN4PR0601MB3728.namprd06.prod.outlook.com (2603:10b6:803:51::24) by SN6PR06MB3952.namprd06.prod.outlook.com (2603:10b6:805:1f::16) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3890.19; Fri, 19 Mar 2021 16:14:01 +0000 Received: from SN4PR0601MB3728.namprd06.prod.outlook.com ([fe80::ccb:944d:e270:63ef]) by SN4PR0601MB3728.namprd06.prod.outlook.com ([fe80::ccb:944d:e270:63ef%6]) with mapi id 15.20.3955.018; Fri, 19 Mar 2021 16:14:01 +0000 From: "Scheffenegger, Richard" To: Rick Macklem , "tuexen@freebsd.org" CC: "freebsd-net@freebsd.org" , Alexander Motin Subject: AW: NFS Mount Hangs Thread-Topic: NFS Mount Hangs Thread-Index: AQHXG1GB6agsoGWN0UqRoZFo/qoHTaqItMcAgAD7PVCAAAUggIAAhiqAgAACBoCAAT1QAIAAAnhQ Date: Fri, 19 Mar 2021 16:14:01 +0000 Message-ID: References: <3750001D-3F1C-4D9A-A9D9-98BCA6CA65A4@tildenparkcapital.com> <33693DE3-7FF8-4FAB-9A75-75576B88A566@tildenparkcapital.com> <2890D243-AF46-43A4-A1AD-CB0C3481511D@lurchi.franken.de> , <9EE3DFAC-72B0-4256-B57C-DE6AA811413C@freebsd.org> In-Reply-To: Accept-Language: de-AT, en-US Content-Language: de-DE X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [77.119.130.93] x-ms-publictraffictype: Email x-ms-office365-filtering-correlation-id: 0614c1c5-f13a-401a-f160-08d8eaf20256 x-ms-traffictypediagnostic: SN6PR06MB3952: x-microsoft-antispam-prvs: x-ms-oob-tlc-oobclassifiers: OLM:5236; x-ms-exchange-senderadcheck: 1 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: B3sjzok58fEvcj72ZuQie39FGpzAuEkxryIpstZ7AZTPHFesOB7OjA59ROzdBCpF3rFEL9h7U74khELAcfqv4X27qe9oRTQ7fq6heALCRQNpfboFak4vtcc+Jkj7qPpznMs0PeRE97iMK9Mt9YWEfdRQboX0h44hWHFnPJgVBB/wvigjMGgkVj1sq+CyOt99cDss+lyItkqZdzQqAeMQ4AbCZW36MY23qOGHmpAPSR0JvV2MxcLS8w6a6ZqmynTBNZXcDPUYdwxJsbYzOUO95HNq3C/5BeEdOUh9e8w4q9GkdMe482IF+Wd0CcoOSFAUefcqNOLKyOukt8YR7Aj83HaFscoaoGbw+29ceM7L+ekCWz9HpnbOjehFs5Znb+E2DG7E7lWieGQpG22JGajh9VJfqgor1Kr3VEs/JwS4MywyHenFvnoS2sqfEy4GyyCwweMOTo3OHJxPJa/Xrn7mGSvXZEJb2CN+MxcZJgSF445PHujNHHItLlp2alXyZXlmGb0ngqUaE7Lwhf3O7wVUZZWDCjzSfbg3N0pywN9hm7dMyG6gMSj/eyHyn/UXPVnveV30EIsix59RwxV2w0xyS3NJuS7qiyBhzF3E6FIUdUDMxk6JWX3U79IndIpEYl6o2o1qdI+O+t08H1+xJrf0tYzktqhS+keYsO5SDzgxbyI= x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:SN4PR0601MB3728.namprd06.prod.outlook.com; PTR:; CAT:NONE; SFS:(4636009)(366004)(136003)(39860400002)(376002)(346002)(396003)(54906003)(186003)(6506007)(8936002)(86362001)(26005)(110136005)(71200400001)(33656002)(66446008)(7116003)(76116006)(4326008)(38100700001)(296002)(64756008)(8676002)(66574015)(478600001)(83380400001)(66556008)(316002)(66946007)(52536014)(966005)(55016002)(7696005)(2906002)(66476007)(5660300002)(9686003); DIR:OUT; SFP:1101; x-ms-exchange-antispam-messagedata: =?iso-8859-1?Q?kYL/q9x6RZDnIPIFvTwcJnUuYAh5e/W5xhqUAYL0Twr2ucjTwwygnY8l2D?= =?iso-8859-1?Q?JShVdv3UeF5JKACH6l+EFa5yQGyCYY1seSuVeCv00GvMIdQOjvzQgmbwxv?= =?iso-8859-1?Q?/pxqF6EIXwtfGOw0vgH4SUWR+btD5NjTTmNd2dZ0a0M2zgsPEd+ze7WX7Z?= =?iso-8859-1?Q?XOMY5atRC3tlGwyQfNPEhq6lLgXQc60gaKhNM/YxSkfQeLOlqchK1369qh?= =?iso-8859-1?Q?5LdtPyQrtnC37e1cjJoOlOj2GKaIVuTblcrY7Kkgg5Ey8gfxBmJNYoqZDq?= =?iso-8859-1?Q?enVsSAatr59sKmz5LSw6i7pd4ZlfavozInq6DUQtRHwBxJFmPfjU2qtyQV?= =?iso-8859-1?Q?rS9tCiSBNMtP/gULsPsR+iRyvC9+VEOTRPTCgCJ1xQxkL7YqV76mPfc7RX?= =?iso-8859-1?Q?4thK1SJu0BxLZxvTXr7P/itQF/wXn5JOIR7UL0QKTrGU8fW4uUw1gyi5Ok?= =?iso-8859-1?Q?dbs9cVBiuti04ZHNc+eSxSDzOF+E7vi/v8pR9D5g6YQuH8Miyd/ytDFTMQ?= =?iso-8859-1?Q?I5F11nXW3Pz7PrfG2yEwHf1yJDF5EzUxBGCNjeYKuTxuvDc+jgfVEEXn6v?= =?iso-8859-1?Q?e63055yMrQg9fPd8r2XHWF+Z6BI+ojJb3l4n6aBjLMyb2RXVNkBcFcvWQa?= =?iso-8859-1?Q?b85sUQqFX7HYLCTYGpKhzCkIuheld8WakVNjewbi6rqgHSBnlHRUABuEc/?= =?iso-8859-1?Q?smsXBLTzyDtwLgJE0hu0NMfsFyk6qjoKmwcgwOXRXZD2sqtbhRO36z7OtS?= =?iso-8859-1?Q?E7ayqklOCcOBLAWPIaDkSaZi2LS5G8FW+FRPv0ZuICUVmc6Z1x3RqEhUQE?= =?iso-8859-1?Q?Hh8SWVCvQFDB8jmzAHxUoBxw8SIeQYvT/wsFQwJiwQK5yB4D0JfDc0a34w?= =?iso-8859-1?Q?n1MoSp+Nrx80Vgfsg8TS4qI13Z0fPzlSwyU6T64X32vn0EtbTb5BahpSjw?= =?iso-8859-1?Q?8Xdn22HS3oaq+5RL7zRg6oMd1VAiOHZD7CBPC6L4e4+4rXbyM7gKB2Y4Dw?= =?iso-8859-1?Q?LrRNiJWQN7bBOh21rTmuUqNv3XmxPdhMM6F47DCBZ1LrZ6txqAuO4MmJgN?= =?iso-8859-1?Q?WIiAzeRnV/AQ+Q+JJQo5cLCDV1D1nZsWPjsRWICtzdk3p3v3nxPK5UHr0n?= =?iso-8859-1?Q?xHlt70BxnX67Fiyi20/OucgnPmimFbgp3KAA3uQSnaknwmqesUc9cMfg0a?= =?iso-8859-1?Q?KjlWQU5IyRLj3SipXjhu4Fxct1D+YBiQfCglSFJN0YufefYPb9gTuaV6jn?= =?iso-8859-1?Q?SZsgazpfh9M/mlk5JXHzt2jkkls/FRt1FZ+YEFMVxcd4iSU+7D6svU+2dr?= =?iso-8859-1?Q?jcNN8TJM4ObP3BWsDlKmK2y1tkiNToCPq5GYy8ooPpgwHzledL0fQnkFCS?= =?iso-8859-1?Q?LjOjzEy9pm?= x-ms-exchange-transport-forked: True Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-OriginatorOrg: netapp.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: SN4PR0601MB3728.namprd06.prod.outlook.com X-MS-Exchange-CrossTenant-Network-Message-Id: 0614c1c5-f13a-401a-f160-08d8eaf20256 X-MS-Exchange-CrossTenant-originalarrivaltime: 19 Mar 2021 16:14:01.3773 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 4b0911a0-929b-4715-944b-c03745165b3a X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: yWDMbuaV8ig8aSVmgoyEhSiFa8lLeBhWjsKvbKChSf9NDk6fV3IeBr0+Rkve2L6+dH5JyaXFtDVv0oR15B3mtg== X-MS-Exchange-Transport-CrossTenantHeadersStamped: SN6PR06MB3952 X-Rspamd-Queue-Id: 4F288r20gKz3FbZ X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[] X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 19 Mar 2021 16:14:04 -0000 Hi Rick, I did some reshuffling of socket-upcalls recently in the TCP stack, to prev= ent some race conditions with our $work in-kernel NFS server implementation= . Just mentioning this, as this may slightly change the timing (mostly delay = the upcall until TCP processing is all done, while before an in-kernel cons= umer could register for a socket upcall, do some fancy stuff with the data = sitting in the socket bufferes, before returning to the tcp processing). But I think there is no socket data handling being done in the upstream in-= kernel NFS server (and I have not even checked, if it actually registers an= socket-upcall handler). https://reviews.freebsd.org/R10:4d0770f1725f84e8bcd059e6094b6bd29bed6cc3 If you can reproduce this easily, perhaps back out this change and see if t= hat has an impact... NFS server is to my knowledge the only upstream in-kernel TCP consumer whic= h may be impacted by this. Richard Scheffenegger -----Urspr=FCngliche Nachricht----- Von: owner-freebsd-net@freebsd.org Im Auftr= ag von Rick Macklem Gesendet: Freitag, 19. M=E4rz 2021 16:58 An: tuexen@freebsd.org Cc: Scheffenegger, Richard ; freebsd-net@= freebsd.org; Alexander Motin Betreff: Re: NFS Mount Hangs NetApp Security WARNING: This is an external email. Do not click links or o= pen attachments unless you recognize the sender and know the content is saf= e. Michael Tuexen wrote: >> On 18. Mar 2021, at 21:55, Rick Macklem wrote: >> >> Michael Tuexen wrote: >>>> On 18. Mar 2021, at 13:42, Scheffenegger, Richard wrote: >>>> >>>>>> Output from the NFS Client when the issue occurs # netstat -an |=20 >>>>>> grep NFS.Server.IP.X >>>>>> tcp 0 0 NFS.Client.IP.X:46896 NFS.Server.IP.X:2049 = FIN_WAIT2 >>>>> I'm no TCP guy. Hopefully others might know why the client would=20 >>>>> be stuck in FIN_WAIT2 (I vaguely recall this means it is waiting=20 >>>>> for a fin/ack, but could be wrong?) >>>> >>>> When the client is in Fin-Wait2 this is the state you end up when the = Client side actively close() the tcp session, and then the server also ACKe= d the FIN. >> Jason noted: >> >>> When the issue occurs, this is what I see on the NFS Server. >>> tcp4 0 0 NFS.Server.IP.X.2049 NFS.Client.IP.X.51550 = CLOSE_WAIT >>> >>> which corresponds to the state on the client side. The server=20 >>> received the FIN from the client and acked it. >>> The server is waiting for a close call to happen. >>> So the question is: Is the server also closing the connection? >> Did you mean to say "client closing the connection here?" >Yes. >> >> The server should call soclose() { it never calls soshutdown() } when=20 >> soreceive(with MSG_WAIT) returns 0 bytes or an error that indicates=20 >> the socket is broken. Btw, I looked and the soreceive() is done with MSG_DONTWAIT, but the EWOULD= BLOCK is handled appropriately. >> --> The soreceive() call is triggered by an upcall for the rcv side of t= he socket. >> So, are you saying the FreeBSD NFS server did not call soclose() for thi= s case? >Yes. If the state at the server side is CLOSE_WAIT, no close call has happ= ened yet. >The FIN from the client was received, it was ACKED, but no close() call=20 >(or shutdown(..., SHUT_WR) or shutdown(..., SHUT_RDWR)) was issued.=20 >Therefore, no FIN was sent and the client should be in the FINWAIT-2=20 >state. This was also reported. So the reported states are consistent. For a test, I commented out the soclose() call in the server side krpc and,= when I dismounted, it did leave the server socket in CLOSE_WAIT. For the FreeBSD client, it did the dismount and the socket was in FIN_WAIT2= for a little while and then disappeared (someone mentioned a short timeout= and that seems to be the case). I might argue that the Linux client should not get hung when this occurs, b= ut there does appear to be an issue on the FreeBSD end. So it does appear you have a case where the soclose() call is not happening= on the FreeBSD NFS server. I am a little surprised since I don't think I'v= e heard of this before and the code is at least 10years old (at least the p= arts related to this). For the soclose() to not happen, the reference count on the socket structur= e cannot have gone to zero. (ie a SVC_RELEASE() was missed) Upon code inspe= ction, I was not able to spot a reference counting bug. (Not too surprising, since a reference counting bug should have shown up l= ong ago.) The only thing I spotted that could conceivably explain this is that the fu= nction svc_vc_stat() which returns the indication that the socket has been = closed at the other end did not bother to do any locking when it checked th= e status. (I am not yet sure if this could result in the status of XPRT_DIE= D being missed by the call, but if so, that would result in the soclose() c= all not happening.) I have attached a small patch, which I think is safe, that adds locking to = svc_vc_stat(),which I am hoping you can try at some point. (I realize this is difficult for a production server, but...) I have tested= it a little and will test it some more, to try and ensure it does not brea= k anything. I have also cc'd mav@, since he's the guy who last worked on this code, in = case he has any insight w.r.t. how the soclose() might get missed (or any o= ther way the server socket gets stuck in CLOSE_WAIT). rick ps: I'll create a PR for this, so that it doesn't get forgotten. Best regards Michael > > rick > > Best regards > Michael >> This will last for ~2 min or so, but is asynchronous. However, the same = 4-tuple can not be reused during this time. >> >> With other words, from the socket / TCP, a properly executed active=20 >> close() will end up in this state. (If the other side initiated the=20 >> close, a passive close, will not end in this state) >> >> >> _______________________________________________ >> freebsd-net@freebsd.org mailing list >> https://lists.freebsd.org/mailman/listinfo/freebsd-net >> To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org" > > > _______________________________________________ > freebsd-net@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-net > To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org" _______________________________________________ freebsd-net@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-net To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org" From owner-freebsd-net@freebsd.org Fri Mar 19 16:53:32 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 6900157AC86 for ; Fri, 19 Mar 2021 16:53:32 +0000 (UTC) (envelope-from jbreitman@tildenparkcapital.com) Received: from us-smtp-delivery-145.mimecast.com (us-smtp-delivery-145.mimecast.com [216.205.24.145]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "*.mimecast.com", Issuer "DigiCert TLS RSA SHA256 2020 CA1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4F292N23gNz3J2r for ; Fri, 19 Mar 2021 16:53:31 +0000 (UTC) (envelope-from jbreitman@tildenparkcapital.com) Received: from zmcc-3-mta-2.zmailcloud.com (zmcc-3-mta-2.zmailcloud.com [35.238.170.66]) (Using TLS) by relay.mimecast.com with ESMTP id us-mta-151-ZeLltvz5OIqM1jlVV-9hnA-1; Fri, 19 Mar 2021 12:53:30 -0400 X-MC-Unique: ZeLltvz5OIqM1jlVV-9hnA-1 Received: from zmcc-3-mta-2.zmailcloud.com (localhost [127.0.0.1]) by zmcc-3-mta-2.zmailcloud.com (Postfix) with ESMTPS id 43CCBE2902; Fri, 19 Mar 2021 11:53:29 -0500 (CDT) Received: from localhost (localhost [127.0.0.1]) by zmcc-3-mta-2.zmailcloud.com (Postfix) with ESMTP id 30AF5E2906; Fri, 19 Mar 2021 11:53:29 -0500 (CDT) X-Virus-Scanned: amavisd-new at zmcc-3-mta-2.zmailcloud.com Received: from zmcc-3-mta-2.zmailcloud.com ([127.0.0.1]) by localhost (zmcc-3-mta-2.zmailcloud.com [127.0.0.1]) (amavisd-new, port 10026) with ESMTP id RKIbng46NIFH; Fri, 19 Mar 2021 11:53:29 -0500 (CDT) Received: from jbreitman-mac.zxcvm.com (unknown [72.22.182.150]) by zmcc-3-mta-2.zmailcloud.com (Postfix) with ESMTPSA id CC59AE2902; Fri, 19 Mar 2021 11:53:28 -0500 (CDT) Mime-Version: 1.0 (Mac OS X Mail 13.4 \(3608.120.23.2.4\)) Subject: Re: NFS Mount Hangs From: Jason Breitman In-Reply-To: Date: Fri, 19 Mar 2021 12:53:28 -0400 Cc: "tuexen@freebsd.org" , "Scheffenegger, Richard" , "freebsd-net@freebsd.org" , Alexander Motin Message-Id: References: <3750001D-3F1C-4D9A-A9D9-98BCA6CA65A4@tildenparkcapital.com> <33693DE3-7FF8-4FAB-9A75-75576B88A566@tildenparkcapital.com> <2890D243-AF46-43A4-A1AD-CB0C3481511D@lurchi.franken.de> <9EE3DFAC-72B0-4256-B57C-DE6AA811413C@freebsd.org> To: Rick Macklem X-Mailer: Apple Mail (2.3608.120.23.2.4) X-Mimecast-Spam-Score: 0 X-Mimecast-Originator: tildenparkcapital.com Content-Type: text/plain; charset=WINDOWS-1252 Content-Transfer-Encoding: quoted-printable X-Rspamd-Queue-Id: 4F292N23gNz3J2r X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[] X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 19 Mar 2021 16:53:32 -0000 Thank you for your focus on the issue I am having and I look forward to see= ing your patch ported to FreeBSD 12.X. I also appreciate that you understand the difficulties in testing changes o= n a core piece of infrastructure. I will let the group know if the issue occurs following the change that dis= abled TSO and LRO on my FreeBSD NFS Server NICs. Those types of settings are less disruptive and pose less risk to apply in = production, so I am happy to do so. That change was made on 3/17/2021. My hope is that this issue is a race condition specific to my NIC handling = certain TCP operations. I am happy that you are approaching the issue from multiple angles. Thanks. Jason Breitman On Mar 19, 2021, at 11:58 AM, Rick Macklem wrote: Michael Tuexen wrote: >> On 18. Mar 2021, at 21:55, Rick Macklem wrote: >> >> Michael Tuexen wrote: >>>> On 18. Mar 2021, at 13:42, Scheffenegger, Richard wrote: >>>> >>>>>> Output from the NFS Client when the issue occurs # netstat -an | gre= p >>>>>> NFS.Server.IP.X >>>>>> tcp 0 0 NFS.Client.IP.X:46896 NFS.Server.IP.X:2049 FIN_WAIT2 >>>>> I'm no TCP guy. Hopefully others might know why the client would be s= tuck in FIN_WAIT2 (I vaguely recall this means it is waiting for a fin/ack,= but could be wrong?) >>>> >>>> When the client is in Fin-Wait2 this is the state you end up when the = Client side actively close() the tcp session, and then the server also ACKe= d the FIN. >> Jason noted: >> >>> When the issue occurs, this is what I see on the NFS Server. >>> tcp4 0 0 NFS.Server.IP.X.2049 NFS.Client.IP.X.51550 CLOSE_WAIT >>> >>> which corresponds to the state on the client side. The server received = the FIN >>> from the client and acked it. >>> The server is waiting for a close call to happen. >>> So the question is: Is the server also closing the connection? >> Did you mean to say "client closing the connection here?" >Yes. >> >> The server should call soclose() { it never calls soshutdown() } when >> soreceive(with MSG_WAIT) returns 0 bytes or an error that indicates >> the socket is broken. Btw, I looked and the soreceive() is done with MSG_DONTWAIT, but the EWOULDBLOCK is handled appropriately. >> --> The soreceive() call is triggered by an upcall for the rcv side of t= he socket. >> So, are you saying the FreeBSD NFS server did not call soclose() for thi= s case? >Yes. If the state at the server side is CLOSE_WAIT, no close call has happ= ened yet. >The FIN from the client was received, it was ACKED, but no close() call >(or shutdown(..., SHUT_WR) or shutdown(..., SHUT_RDWR)) was issued. Theref= ore, >no FIN was sent and the client should be in the FINWAIT-2 state. This was = also >reported. So the reported states are consistent. For a test, I commented out the soclose() call in the server side krpc and,= when I dismounted, it did leave the server socket in CLOSE_WAIT. For the FreeBSD client, it did the dismount and the socket was in FIN_WAIT2 for a little while and then disappeared (someone mentioned a short timeout and that seems to be the case). I might argue that the Linux client should not get hung when this occurs, but there does appear to be an issue on the FreeBSD end. So it does appear you have a case where the soclose() call is not happening on the FreeBSD NFS server. I am a little surprised since I don't think I've heard of this before and the code is at least 10years old (at least the par= ts related to this). For the soclose() to not happen, the reference count on the socket structure cannot have gone to zero. (ie a SVC_RELEASE() was missed) Upon code inspection, I was not able to spot a reference counting bug. (Not too surprising, since a reference counting bug should have shown up long ago.) The only thing I spotted that could conceivably explain this is that the function svc_vc_stat() which returns the indication that the socket has been closed at the other end did not bother to do any locking when it checked the status. (I am not yet sure if this could result in the status of XPRT_DIED being missed by the call, but if so, that would result in the soclose() call not happening.) I have attached a small patch, which I think is safe, that adds locking to svc_vc_stat(),which I am hoping you can try at some point. (I realize this is difficult for a production server, but...) I have tested it a little and will test it some more, to try and ensure it does not break anything. I have also cc'd mav@, since he's the guy who last worked on this code, in case he has any insight w.r.t. how the soclose() might get missed (or any other way the server socket gets stuck in CLOSE_WAIT). rick ps: I'll create a PR for this, so that it doesn't get forgotten. Best regards Michael > > rick > > Best regards > Michael >> This will last for ~2 min or so, but is asynchronous. However, the same = 4-tuple can not be reused during this time. >> >> With other words, from the socket / TCP, a properly executed active clos= e() will end up in this state. (If the other side initiated the close, a pa= ssive close, will not end in this state) >> >> >> _______________________________________________ >> freebsd-net@freebsd.org mailing list >> https://lists.freebsd.org/mailman/listinfo/freebsd-net >> To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org" > > > _______________________________________________ > freebsd-net@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-net > To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org" _______________________________________________ freebsd-net@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-net To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org" _______________________________________________ freebsd-net@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-net To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org" From owner-freebsd-net@freebsd.org Fri Mar 19 18:09:34 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 3C22557D4A7 for ; Fri, 19 Mar 2021 18:09:34 +0000 (UTC) (envelope-from tuexen@freebsd.org) Received: from drew.franken.de (mail-n.franken.de [193.175.24.27]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "*.franken.de", Issuer "Sectigo RSA Domain Validation Secure Server CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4F2Bk60MQmz3P3d; Fri, 19 Mar 2021 18:09:33 +0000 (UTC) (envelope-from tuexen@freebsd.org) Received: from [IPv6:2a02:8109:1140:c3d:e919:4da4:f4f6:be3b] (unknown [IPv6:2a02:8109:1140:c3d:e919:4da4:f4f6:be3b]) (Authenticated sender: macmic) by drew.franken.de (Postfix) with ESMTPSA id 3B2F7708C57C1; Fri, 19 Mar 2021 19:09:30 +0100 (CET) Content-Type: text/plain; charset=utf-8 Mime-Version: 1.0 (Mac OS X Mail 14.0 \(3654.60.0.2.21\)) Subject: Re: NFS Mount Hangs From: tuexen@freebsd.org In-Reply-To: Date: Fri, 19 Mar 2021 19:09:29 +0100 Cc: Rick Macklem , "freebsd-net@freebsd.org" , Alexander Motin Content-Transfer-Encoding: quoted-printable Message-Id: <03DE00F1-B60D-49AE-AC53-C83BA9F0F5C7@freebsd.org> References: <3750001D-3F1C-4D9A-A9D9-98BCA6CA65A4@tildenparkcapital.com> <33693DE3-7FF8-4FAB-9A75-75576B88A566@tildenparkcapital.com> <2890D243-AF46-43A4-A1AD-CB0C3481511D@lurchi.franken.de> <9EE3DFAC-72B0-4256-B57C-DE6AA811413C@freebsd.org> To: "Scheffenegger, Richard" X-Mailer: Apple Mail (2.3654.60.0.2.21) X-Spam-Status: No, score=-2.9 required=5.0 tests=ALL_TRUSTED,BAYES_00, URIBL_BLOCKED autolearn=disabled version=3.4.1 X-Spam-Checker-Version: SpamAssassin 3.4.1 (2015-04-28) on mail-n.franken.de X-Rspamd-Queue-Id: 4F2Bk60MQmz3P3d X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[] X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 19 Mar 2021 18:09:34 -0000 > On 19. Mar 2021, at 17:14, Scheffenegger, Richard = wrote: >=20 > Hi Rick, >=20 > I did some reshuffling of socket-upcalls recently in the TCP stack, to = prevent some race conditions with our $work in-kernel NFS server = implementation. Are these changes in 12.1p5? This is the OS version used by the reporter = of the bug. Best regards Michael >=20 > Just mentioning this, as this may slightly change the timing (mostly = delay the upcall until TCP processing is all done, while before an = in-kernel consumer could register for a socket upcall, do some fancy = stuff with the data sitting in the socket bufferes, before returning to = the tcp processing). >=20 > But I think there is no socket data handling being done in the = upstream in-kernel NFS server (and I have not even checked, if it = actually registers an socket-upcall handler). >=20 > = https://reviews.freebsd.org/R10:4d0770f1725f84e8bcd059e6094b6bd29bed6cc3 >=20 > If you can reproduce this easily, perhaps back out this change and see = if that has an impact... >=20 > NFS server is to my knowledge the only upstream in-kernel TCP consumer = which may be impacted by this. >=20 > Richard Scheffenegger >=20 >=20 > -----Urspr=C3=BCngliche Nachricht----- > Von: owner-freebsd-net@freebsd.org Im = Auftrag von Rick Macklem > Gesendet: Freitag, 19. M=C3=A4rz 2021 16:58 > An: tuexen@freebsd.org > Cc: Scheffenegger, Richard ; = freebsd-net@freebsd.org; Alexander Motin > Betreff: Re: NFS Mount Hangs >=20 > NetApp Security WARNING: This is an external email. Do not click links = or open attachments unless you recognize the sender and know the content = is safe. >=20 >=20 >=20 >=20 > Michael Tuexen wrote: >>> On 18. Mar 2021, at 21:55, Rick Macklem = wrote: >>>=20 >>> Michael Tuexen wrote: >>>>> On 18. Mar 2021, at 13:42, Scheffenegger, Richard = wrote: >>>>>=20 >>>>>>> Output from the NFS Client when the issue occurs # netstat -an |=20= >>>>>>> grep NFS.Server.IP.X >>>>>>> tcp 0 0 NFS.Client.IP.X:46896 = NFS.Server.IP.X:2049 FIN_WAIT2 >>>>>> I'm no TCP guy. Hopefully others might know why the client would=20= >>>>>> be stuck in FIN_WAIT2 (I vaguely recall this means it is waiting=20= >>>>>> for a fin/ack, but could be wrong?) >>>>>=20 >>>>> When the client is in Fin-Wait2 this is the state you end up when = the Client side actively close() the tcp session, and then the server = also ACKed the FIN. >>> Jason noted: >>>=20 >>>> When the issue occurs, this is what I see on the NFS Server. >>>> tcp4 0 0 NFS.Server.IP.X.2049 NFS.Client.IP.X.51550 = CLOSE_WAIT >>>>=20 >>>> which corresponds to the state on the client side. The server=20 >>>> received the FIN from the client and acked it. >>>> The server is waiting for a close call to happen. >>>> So the question is: Is the server also closing the connection? >>> Did you mean to say "client closing the connection here?" >> Yes. >>>=20 >>> The server should call soclose() { it never calls soshutdown() } = when=20 >>> soreceive(with MSG_WAIT) returns 0 bytes or an error that indicates=20= >>> the socket is broken. > Btw, I looked and the soreceive() is done with MSG_DONTWAIT, but the = EWOULDBLOCK is handled appropriately. >=20 >>> --> The soreceive() call is triggered by an upcall for the rcv side = of the socket. >>> So, are you saying the FreeBSD NFS server did not call soclose() for = this case? >> Yes. If the state at the server side is CLOSE_WAIT, no close call has = happened yet. >> The FIN from the client was received, it was ACKED, but no close() = call=20 >> (or shutdown(..., SHUT_WR) or shutdown(..., SHUT_RDWR)) was issued.=20= >> Therefore, no FIN was sent and the client should be in the FINWAIT-2=20= >> state. This was also reported. So the reported states are consistent. > For a test, I commented out the soclose() call in the server side krpc = and, when I dismounted, it did leave the server socket in CLOSE_WAIT. > For the FreeBSD client, it did the dismount and the socket was in = FIN_WAIT2 for a little while and then disappeared (someone mentioned a = short timeout and that seems to be the case). > I might argue that the Linux client should not get hung when this = occurs, but there does appear to be an issue on the FreeBSD end. >=20 > So it does appear you have a case where the soclose() call is not = happening on the FreeBSD NFS server. I am a little surprised since I = don't think I've heard of this before and the code is at least 10years = old (at least the parts related to this). >=20 > For the soclose() to not happen, the reference count on the socket = structure cannot have gone to zero. (ie a SVC_RELEASE() was missed) Upon = code inspection, I was not able to spot a reference counting bug. > (Not too surprising, since a reference counting bug should have shown = up long ago.) >=20 > The only thing I spotted that could conceivably explain this is that = the function svc_vc_stat() which returns the indication that the socket = has been closed at the other end did not bother to do any locking when = it checked the status. (I am not yet sure if this could result in the = status of XPRT_DIED being missed by the call, but if so, that would = result in the soclose() call not happening.) >=20 > I have attached a small patch, which I think is safe, that adds = locking to svc_vc_stat(),which I am hoping you can try at some point. > (I realize this is difficult for a production server, but...) I have = tested it a little and will test it some more, to try and ensure it does = not break anything. >=20 > I have also cc'd mav@, since he's the guy who last worked on this = code, in case he has any insight w.r.t. how the soclose() might get = missed (or any other way the server socket gets stuck in CLOSE_WAIT). >=20 > rick > ps: I'll create a PR for this, so that it doesn't get forgotten. >=20 > Best regards > Michael >=20 >>=20 >> rick >>=20 >> Best regards >> Michael >>> This will last for ~2 min or so, but is asynchronous. However, the = same 4-tuple can not be reused during this time. >>>=20 >>> With other words, from the socket / TCP, a properly executed active=20= >>> close() will end up in this state. (If the other side initiated the=20= >>> close, a passive close, will not end in this state) >>>=20 >>>=20 >>> _______________________________________________ >>> freebsd-net@freebsd.org mailing list >>> https://lists.freebsd.org/mailman/listinfo/freebsd-net >>> To unsubscribe, send any mail to = "freebsd-net-unsubscribe@freebsd.org" >>=20 >>=20 >> _______________________________________________ >> freebsd-net@freebsd.org mailing list >> https://lists.freebsd.org/mailman/listinfo/freebsd-net >> To unsubscribe, send any mail to = "freebsd-net-unsubscribe@freebsd.org" >=20 > _______________________________________________ > freebsd-net@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-net > To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org" >=20 > _______________________________________________ > freebsd-net@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-net > To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org" From owner-freebsd-net@freebsd.org Fri Mar 19 18:22:54 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 85D1957DF83 for ; Fri, 19 Mar 2021 18:22:54 +0000 (UTC) (envelope-from Richard.Scheffenegger@netapp.com) Received: from NAM12-BN8-obe.outbound.protection.outlook.com (mail-bn8nam12on2077.outbound.protection.outlook.com [40.107.237.77]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "DigiCert Cloud Services CA-1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4F2C1T34c8z3Q5v; Fri, 19 Mar 2021 18:22:53 +0000 (UTC) (envelope-from Richard.Scheffenegger@netapp.com) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=aHw9RHAFe8gGXX3ZWqRQFfQSOthlwibNQQ5LQqHkjy0qnBxTC+ALnszOOltEF/XJ+44LRsZpnp6HuhS6+BB0nLKhPKTsWpeEp+lVhsFTQn/eqyD9bvVHlvYnbtBVxKRehkmy90CodgPaGSpHTzSiSZCtC2yi653s5w9XbPWYSt0Zfvii8pwT6S1xrHyh35uuDCLpoCOLJryNIlUyKkNkkFejAgjLZyZP9bxRwa6fb5juJkGi0Rp3d7Ij1VWeMf9uxU1AtbSnl/V7Bh75D9zyZa3F182QIKyVEdLGD/pa4X1d07JXNtn323i2s+64F0QiK68Ks51a2prUB7jdChcO8A== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=qy43xiHeuuJn+HeKsp/5NHZqV17RNuVWB12HjhAqmbE=; b=LAjXeprU/IuTDw10NwGzoBF9hdPRkFTNzQyX4O+F3R429tZbUTgM/u4/joLOuFuDj69mXlfkbH8UrE0VmSlUkFULjHXNzXjXJw12rJYd79z92k9FNCPsIHrrA2csrepPKu+AMEJdGW58jRJw4O9FUngMjz+VaeGN8tWVV0ZM1TYVE1NxZle6Yy0jtdncHUa4wTSm+3EnQgi6sNkgg+dl4tudlAq3bhoLkDNS18H6G84z40vk2SgF8ha4pF70x8qAYOVzUHZhDTrk0pYDjguWashnGI2XlC2jgXSdEpxQ/J51lBp8d+tvRKM8vX9xEn6cCeqKkeid7/cCjhiE+XmGHA== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=netapp.com; dmarc=pass action=none header.from=netapp.com; dkim=pass header.d=netapp.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=netapp.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=qy43xiHeuuJn+HeKsp/5NHZqV17RNuVWB12HjhAqmbE=; b=PmmXwcIzZNRWY/vBEscMG+6zcrJqRvk+7M/2ecfcQW30xAsmYKFX735JM6OqIcYdvAQ8QNKd4GYhszq6Dhdxdrsb4o3yABeVtj4zJ7A9RTau2+LA8smbwGF7CJZmSe/xnK95eVjAi9Gr46+UAAFVVvBkSBHQwO9C6zmmwcL856vRpwDLk3wxSfI3xmx5/ImNZFpYkSCFFHzZ5nfSzmC/3By8qtewNCWgOSSCiNQM5sbrEOOrUiw54lHLhCpt2njTssKyX2b38gmWMU8otDzRvybcbhOL3C/0jv/MT1OUX88jFvx2cSSJ57t5wIBKSaNIdgyCexFw8/dl3WlkjXuE7A== Received: from SN4PR0601MB3728.namprd06.prod.outlook.com (2603:10b6:803:51::24) by SN6PR06MB5280.namprd06.prod.outlook.com (2603:10b6:805:f7::32) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3955.18; Fri, 19 Mar 2021 18:22:52 +0000 Received: from SN4PR0601MB3728.namprd06.prod.outlook.com ([fe80::ccb:944d:e270:63ef]) by SN4PR0601MB3728.namprd06.prod.outlook.com ([fe80::ccb:944d:e270:63ef%6]) with mapi id 15.20.3955.018; Fri, 19 Mar 2021 18:22:51 +0000 From: "Scheffenegger, Richard" To: "tuexen@freebsd.org" CC: Rick Macklem , "freebsd-net@freebsd.org" , Alexander Motin Subject: AW: NFS Mount Hangs Thread-Topic: NFS Mount Hangs Thread-Index: AQHXG1GB6agsoGWN0UqRoZFo/qoHTaqItMcAgAD7PVCAAAUggIAAhiqAgAACBoCAAT1QAIAAAnhQgAAiQoCAAAM48A== Date: Fri, 19 Mar 2021 18:22:51 +0000 Message-ID: References: <3750001D-3F1C-4D9A-A9D9-98BCA6CA65A4@tildenparkcapital.com> <33693DE3-7FF8-4FAB-9A75-75576B88A566@tildenparkcapital.com> <2890D243-AF46-43A4-A1AD-CB0C3481511D@lurchi.franken.de> <9EE3DFAC-72B0-4256-B57C-DE6AA811413C@freebsd.org> <03DE00F1-B60D-49AE-AC53-C83BA9F0F5C7@freebsd.org> In-Reply-To: <03DE00F1-B60D-49AE-AC53-C83BA9F0F5C7@freebsd.org> Accept-Language: de-AT, en-US Content-Language: de-DE X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [77.119.130.93] x-ms-publictraffictype: Email x-ms-office365-filtering-correlation-id: b5779387-b1c3-4cac-85f2-08d8eb040210 x-ms-traffictypediagnostic: SN6PR06MB5280: x-microsoft-antispam-prvs: x-ms-oob-tlc-oobclassifiers: OLM:6430; x-ms-exchange-senderadcheck: 1 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: 0lM7ZybZTJ8f9p9FpcgA6ljhp9kesp+pEubDmprhehBkfvomvlP3YMOJQfvq5lJHsvAbSz+ph1KPiWTD9p5yBityUoQCvFdb4fKyi7qUbwW44XdvSuh9KrVzDN0edI6EcE++t/C8iBIPNkLhIEf9i1nH1zbqs3j4ma1yAlD+B0qKG0sTkKZQg9l851mrf72OXafRPS7NO+PIs0M+DkSRiiOC/xr1jASbcpKv35tfo2hmj2s3UXWRtkv36XH06nfQk1Au/qjDyNle9x75gBw9jm34xICw9jg5foEBEZhXYpJKTzUV6VxUFV9XsNkvpNOJzhdt8gD0I5//P/FLtLctmAysXzWEfy8Ze/4Vi2LdbSrGsl/cW1jvj3XpXHIYFBCzJFRX27b8cF/enLTlEl4GxcJmUyK46UAeOk4yK+u2YsCu6+MA05fREovDVVFGmgnd0nYM6Phb2dxZ52qUqBaxBgf4GYlsMFGQKy3nWyQK4zJpwjBnOBzINhGDUWF46u7Ug0vR2aK+DjBSXE4GiHIyga0/tfGJzLNGYv/ix+43vvhSUOaglQSEZa1Ni0e3kVW15t4HzKt+23V3qjFPUuSH+b1FB+yBTgPTPersobF90o6hRRlaKn6ZC6mSqvLaY/FXDi3aCsnuBd0nAvUdANn3Pw== x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:SN4PR0601MB3728.namprd06.prod.outlook.com; PTR:; CAT:NONE; SFS:(4636009)(136003)(39860400002)(366004)(396003)(376002)(346002)(4326008)(6506007)(186003)(86362001)(26005)(52536014)(9686003)(2906002)(6916009)(33656002)(38100700001)(54906003)(7116003)(76116006)(83380400001)(55016002)(66476007)(66556008)(66446008)(64756008)(8936002)(71200400001)(7696005)(8676002)(66946007)(478600001)(4744005)(316002)(5660300002); DIR:OUT; SFP:1101; x-ms-exchange-antispam-messagedata: =?utf-8?B?bkZvazV0Z01KTU82eVZWcmJUbm1SSE5iK0QxbXpPcFEwbXJXQ3NnU2laMmM0?= =?utf-8?B?WkRDd0c4SE9DYmhBZW5FQjNpZE41bnhkY2lQbW00OFJheS81WnMxRGdQNldt?= =?utf-8?B?YS9Qb3djRVl5cXMxY042aFVocnd1a1pTNFMvZWFkbWFrUThaVEF3WG1NTS8y?= =?utf-8?B?NmJ5dEIrWHA4YXBQLzkvNVJOb1NNK3J0bEdzTTQvSll4cGdYYWNMOXFZc3lZ?= =?utf-8?B?MHM2SmxjWWpqZnJCNG1CczIwdm5Rc1ZJaThMTkxkZlV5SWgwaE9BMUpqUXlM?= =?utf-8?B?M0dNVnJoa2hDUGdjNTg1b0ZTaHlmZ1hXekRBN08xTHRDcHoxQld1aHJHdE8w?= =?utf-8?B?THRzVm9BWmZoVnFyRTVEZ0tVeDM0M3FCbm15Nm45c0ZVNXBxYmpPdHNqWURQ?= =?utf-8?B?NzZZUDRJYXdvUUFyRUtYWmxRVXBOakxLeDlGNElZMlQ0RTg4US9mOXErbHZ1?= =?utf-8?B?T0ZYdHN6NWNzdkZsV21WVkFHWjA5eEVWUEVlMW0xc05NTktlWlM1V3R0WHlW?= =?utf-8?B?aFRCUG9wZ1R1d05obWdrd0dUbUtreE9WajRjMmt6SnhNWEkrNFFUVURObnla?= =?utf-8?B?SnNXcCtFR3VQbHB2bzRnRmZSL1M5U2NPZjQ3Mzh4VU01azk2MDJ4VjNnR2dR?= =?utf-8?B?eTFEMUxFY1dOcXF6KzNVb0dmWXBiNFZlZ1htaTBIaDhiQWJXSWoxK1Q4cklH?= =?utf-8?B?SWV2aStNWWZneVJDQUFrOFRWYjF2cGk3TUlEbWt6cnQ5Ui9pYmRqeXlRRm1W?= =?utf-8?B?VThvRHZ5TVBGUHA2UlB3MS9LTThiMEZqVEI5QVIxdzVIblQyc0dHcmJITU9s?= =?utf-8?B?TXRyMzlHbjF5WnI2QTRta3VOU3RaSE1SM3BhS2ZWamZjbmQ0MWtNcFY4VGp6?= =?utf-8?B?WG8yMTRPNkRBSzIxdktDaGpFbE1NWXVmY1NqZDAxN0JubXh4Tkg2YXIwdWlW?= =?utf-8?B?L2llZE5uRmNmdTE4eDFSTEU5bmpRZkFYVTdKa2VidVVab3YyRzRmdWpncGxi?= =?utf-8?B?RzRzd0FVc3FQSUdoU2gyMzlrWkRWazUyak12bWpaWmpiKzlKbEx1ZW9nM2Zj?= =?utf-8?B?Qm9SVFFYZXdUZWIvc2h6Sk5QaW9ISGxOTCszUDA5UVFBa3h3MXhUSWwwc25B?= =?utf-8?B?RWdIRjYvN0REMVo1UGgydkFOa0RTdHVsV05kR2xXS1NBbkROYUZvQWRLK2po?= =?utf-8?B?NGtFb1krVW04UC9wOG9xbDgxT05zWmVqN1JBTHdNb0crZUlsdHhjZENLQnl0?= =?utf-8?B?OVU5R0tRYktJOE1GU2M4RnZEZ3hjckxyQXQvakNXTWdEMW94SlJRR05wWStj?= =?utf-8?B?TVkybnF1SU1aU2Z6Z1RGNTFJdTBoaVZKdTcrYk00K202STYvMUExMU14QUJj?= =?utf-8?B?Z3VMbnF2WkcwUXJHQWtxTFRheEZKOUErTit1RU91VWhScHZjMEZOQ0hTR1lk?= =?utf-8?B?bHpzMjlDakhTY3BkcVE4TkxScXRRK1JnWVlZSHRsWXBqdUJvbE1pVWFzKzNr?= =?utf-8?B?UjNMZXVYWlhiRDFScTg5L3JibG1QeG5XWk8rV3hvSVVkYVY1SDhVUmQ2MDUw?= =?utf-8?B?c2FYUUJSOGNpbGRxV1UwK1cxVHlRMHluT3BnL0JiVUpKa0xXcS94dzhxM2xT?= =?utf-8?B?bnpJdGdKc0JvWHgxVDQrb2dzZXVmN1dDZ1M1bzFIeG8zN2E1TC8xWUtEQm5T?= =?utf-8?B?V0UycVQ0U2JTSURlamxGYzN5Uk9NNmFwbW9xckVLeGNpcGt6QWZZZEV3L2ht?= =?utf-8?Q?BtxJo8UdLr/ljRJRwogb55ijj4vUJRlmoRlkSdk?= x-ms-exchange-transport-forked: True Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: base64 MIME-Version: 1.0 X-OriginatorOrg: netapp.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: SN4PR0601MB3728.namprd06.prod.outlook.com X-MS-Exchange-CrossTenant-Network-Message-Id: b5779387-b1c3-4cac-85f2-08d8eb040210 X-MS-Exchange-CrossTenant-originalarrivaltime: 19 Mar 2021 18:22:51.8499 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 4b0911a0-929b-4715-944b-c03745165b3a X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: Wvdw9bMe3gtWe6NsQSB1QbLourFAyiTODyVfg/JMeJqVmul/hJCzEDPQKgZzd49xBIWKAoysrluyRtluQV8NiA== X-MS-Exchange-Transport-CrossTenantHeadersStamped: SN6PR06MB5280 X-Rspamd-Queue-Id: 4F2C1T34c8z3Q5v X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=netapp.com header.s=selector1 header.b=PmmXwcIz; arc=pass (microsoft.com:s=arcselector9901:i=1); dmarc=pass (policy=none) header.from=netapp.com; spf=pass (mx1.freebsd.org: domain of Richard.Scheffenegger@netapp.com designates 40.107.237.77 as permitted sender) smtp.mailfrom=Richard.Scheffenegger@netapp.com X-Spamd-Result: default: False [-4.90 / 15.00]; TO_DN_EQ_ADDR_SOME(0.00)[]; HAS_XOIP(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:40.107.0.0/16]; MIME_BASE64_TEXT_BOGUS(1.00)[]; RCVD_COUNT_THREE(0.00)[3]; DKIM_TRACE(0.00)[netapp.com:+]; MIME_BASE64_TEXT(0.10)[]; DMARC_POLICY_ALLOW(-0.50)[netapp.com,none]; NEURAL_HAM_SHORT(-1.00)[-1.000]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[40.107.237.77:from]; ARC_ALLOW(-1.00)[microsoft.com:s=arcselector9901:i=1]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:8075, ipnet:40.104.0.0/14, country:US]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[netapp.com:s=selector1]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[4]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; SPAMHAUS_ZRD(0.00)[40.107.237.77:from:127.0.2.255]; DWL_DNSWL_LOW(-1.00)[netapp.com:dkim]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[40.107.237.77:from]; RWL_MAILSPIKE_POSSIBLE(0.00)[40.107.237.77:from]; MAILMAN_DEST(0.00)[freebsd-net] X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 19 Mar 2021 18:22:54 -0000 U29ycnksIEkgdGhvdWdoIHRoaXMgd2FzIGEgcHJvYmxlbSBvbiBzdGFibGUvMTMuDQoNClRoaXMg aXMgb25seSBpbiBIRUFELCBzdGFibGUvMTMgYW5kIDEzLjAgLSBuZXZlciBNRkMnZCB0byBzdGFi bGUvMTIgb3IgYmFja3BvcnRlZCB0byAxMi4xDQoNCj4gSSBkaWQgc29tZSByZXNodWZmbGluZyBv ZiBzb2NrZXQtdXBjYWxscyByZWNlbnRseSBpbiB0aGUgVENQIHN0YWNrLCB0byBwcmV2ZW50IHNv bWUgcmFjZSBjb25kaXRpb25zIHdpdGggb3VyICR3b3JrIGluLWtlcm5lbCBORlMgc2VydmVyIGlt cGxlbWVudGF0aW9uLg0KQXJlIHRoZXNlIGNoYW5nZXMgaW4gMTIuMXA1PyBUaGlzIGlzIHRoZSBP UyB2ZXJzaW9uIHVzZWQgYnkgdGhlIHJlcG9ydGVyIG9mIHRoZSBidWcuDQoNCkJlc3QgcmVnYXJk cw0KTWljaGFlbA0KDQo= From owner-freebsd-net@freebsd.org Fri Mar 19 21:17:37 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id E797D5AC916 for ; Fri, 19 Mar 2021 21:17:37 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) Received: from CAN01-TO1-obe.outbound.protection.outlook.com (mail-eopbgr670081.outbound.protection.outlook.com [40.107.67.81]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "DigiCert Cloud Services CA-1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4F2Gv55DWpz3vVt; Fri, 19 Mar 2021 21:17:37 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=kvyYu75XVqjqyqPqEyRizBlQt/YVL9AipENCpNeAiRVQd6r8ZIVk506Wl+kZmT9Zyf8bqAF4a0Kouom0ECy7ZvnrTKNCmIi15/QLQ5MOP2EQweWOdsbTTL6+u2szUAD/SpQnNbiSX1v3IpDYHsbsr13ewMMLEl15Q3KYz5KzcDmLYQmKdQNzi/BQLkWJJ4hq03O7v2Uxuc2/wsF11IAM8/9JySsKzspUnVDw4AzjvrwnHzkct+obTQS/NSuSOrBQQ0xNhx9ryA23IQfIWkYLzxToNqIfkFNyxv+E3dlxW4l3ECsKPkA9dhwklKBFhqaKrZsbP4VNNPqyrzew2UEL3A== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=1CyomNUWJSwWeoD4/IFaKIhWNqZrt1SuhqsH/wdzDYY=; b=HIAFfEUPnwOqN/RbBae7szAG2YyKUeT5XzegiDJFUycaBPJTuxq02cW+EiA8dYRdVNctPoJ8X4zuHsuxHIbjjh0vA360uSB3jHbQ+/tK8VvgYdjZ+Yh+aLPnxvwBz7aQEuyN0GD0mUAVxSSujBrq2UOqnDe1pkH+324L7nXAS2DieQG7yllP+geSKfZY6b7A8vut+DgYB9E/aC3VA3hNftnqf7zZemFT4c2UPP9MtOrjePUYg68bbsNcZYtxUEFxMKVnUHcNianAz6vW9a+8nnRg85MJE0adTb+Jj3Ls/6VJIy0+K/ILiBrmnpwr+7grGUO0lReJ3DlpHpIzdpoHBQ== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=uoguelph.ca; dmarc=pass action=none header.from=uoguelph.ca; dkim=pass header.d=uoguelph.ca; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=uoguelph.ca; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=1CyomNUWJSwWeoD4/IFaKIhWNqZrt1SuhqsH/wdzDYY=; b=Bbm3RDSThu8UVtSTMZJyKgS4I7/1dERO0RjtBifBDaKVN9BD8LbkTtxbfbkUF+8MadewOXYB31+x/7ZUHRvFbjDxlePr35kHnUk3JCfmO2iNjHCZh+yEVbp3THOaBpU4IzOeyFDTr0LG156qKSlG+PRqkbHE6pcqR5omax7MuFHbAxGsY2SI5lavCDFeaIZ+34ABdo+PLdo+oVjLrP1ZMXQu48j5obrJHZwPKb0LbHn5TGJACphVtI9ziPvuNQuyqFOCbLkKWC7XGtIMPhCZt7hJhy3AfUFgvJgJcWXUd9yXJQRbxE+euCpiLWoEM9E3+aZCXZx5uyk0AP97hk4Dpg== Received: from YQXPR0101MB0968.CANPRD01.PROD.OUTLOOK.COM (2603:10b6:c00:19::29) by YQXPR01MB3845.CANPRD01.PROD.OUTLOOK.COM (2603:10b6:c00:50::27) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3890.28; Fri, 19 Mar 2021 21:17:35 +0000 Received: from YQXPR0101MB0968.CANPRD01.PROD.OUTLOOK.COM ([fe80::6073:6fc0:5ddf:dc8a]) by YQXPR0101MB0968.CANPRD01.PROD.OUTLOOK.COM ([fe80::6073:6fc0:5ddf:dc8a%7]) with mapi id 15.20.3933.033; Fri, 19 Mar 2021 21:17:35 +0000 From: Rick Macklem To: Jason Breitman CC: "tuexen@freebsd.org" , "Scheffenegger, Richard" , "freebsd-net@freebsd.org" , Alexander Motin Subject: Re: NFS Mount Hangs Thread-Topic: NFS Mount Hangs Thread-Index: AQHXG1G2D7AHBwtmAkS1jBAqNNo2I6qIqQ+SgAEIlICAAAOAgIAAhBk7gAAEF4CAATUdPYAAF7EAgABGifg= Date: Fri, 19 Mar 2021 21:17:35 +0000 Message-ID: References: <3750001D-3F1C-4D9A-A9D9-98BCA6CA65A4@tildenparkcapital.com> <33693DE3-7FF8-4FAB-9A75-75576B88A566@tildenparkcapital.com> <2890D243-AF46-43A4-A1AD-CB0C3481511D@lurchi.franken.de> <9EE3DFAC-72B0-4256-B57C-DE6AA811413C@freebsd.org> , In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-ms-publictraffictype: Email x-ms-office365-filtering-correlation-id: 701b6427-d4e8-40f1-ded1-08d8eb1c6ab6 x-ms-traffictypediagnostic: YQXPR01MB3845: x-microsoft-antispam-prvs: x-ms-oob-tlc-oobclassifiers: OLM:4714; x-ms-exchange-senderadcheck: 1 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: s7E6H3RmJbsrv3Vlbj80HtvOh1nzhJfYI+JZPpeUKzjH7RFV/aDjXUK82OVnZkFIs0kCrJm46qWcwSyF/TmhWUrCo/U35K0oV8WoBYsvYUCzUIdfkToqv6zA6vyGHB08YoBy/NQBWtPm6nGLzoKegeoa7qTQiz4eUGTl4rPn/oeDqb0mXQN5p25ZyetPccoFa+sEE5LECJHAPPYYRsLCnbFZsZcwtoeYlLgQluLK8Hd1ojgv2KcEcmxlDssljojZhrcD9VjQL0U8KWv8WFaSmfQjWwx0T42aVkDezZFDFK4sZAXozu+LaWKG1KjvAcY9iHusjvktH/V4D9+l8eq80DoqBL2C/bKmi9GvHyQKllzhA9JWOZONcft5acuO+PJFvkjd5jrCYIncUYiYJwyyytkGoQJiexGJSX8Jb791bBFF06UCBU7xtQ1Yv1+cdyqg4zwGYR2U2xvEfLUYM5++4SeqYYZW5JpDR+KdK3IliBujbi3EuuHFXXhF3CJC0Zbm7WCbwYye7beTkjQOZbUBOZY3KbUnUMfWYQS7rlQmLvH7rKfWLnybis6kDCLWRG+wOXuTsHSth7AoxeDc1u7jN9xLXJK8szygrgF2E12UKO2/MSXQNk+iW/InwfL1UC8v0Ss0dNTjjVw8vSQ7xoDxmIILBTpzX3VDyc+Ew2ficmI= x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:YQXPR0101MB0968.CANPRD01.PROD.OUTLOOK.COM; PTR:; CAT:NONE; SFS:(346002)(39850400004)(366004)(396003)(136003)(376002)(966005)(53546011)(55016002)(66556008)(71200400001)(83380400001)(66446008)(86362001)(8676002)(2906002)(64756008)(66476007)(478600001)(786003)(33656002)(186003)(9686003)(38100700001)(5660300002)(91956017)(7696005)(3480700007)(54906003)(316002)(66946007)(4326008)(7116003)(8936002)(6916009)(52536014)(76116006)(6506007); DIR:OUT; SFP:1101; x-ms-exchange-antispam-messagedata: =?iso-8859-1?Q?VKnkfMvZhfZqDujSQ8wFEX4MmWvJzh5DMnIx0BqlYcP2BNS/22ppAM+UDY?= =?iso-8859-1?Q?R4hNv58Ms+1ITQpC3XlJksKrBYFMkLF3G98+OXOFA80/4oNdB9R3f2Xt4T?= =?iso-8859-1?Q?OcCnjhghEpv1xW20siFQIItMJPMahJURBYniG/9AaKpHWt3aIlRE8ix3Jn?= =?iso-8859-1?Q?9vtCkq/HL1pNypoTUTNioUgvPorj31ub+jqTTOFH9MuAEjkekBmFR7n/1p?= =?iso-8859-1?Q?gGlJpxO9SlLY055EwH3tYOsJfacDTwbPcjBk/ivsOuc/Y+7BP9aHl4fuiy?= =?iso-8859-1?Q?+LrLoHgh0ynnQtnyjRW1/eDdI+tA13k1azNB/LTy1+HABA0Y6ztw4y8rqH?= =?iso-8859-1?Q?mxK5aV44SLJ28YjUmj18rrrE7Ie/p/QYw9yvKsPXVhTJUeqeleqcrBlZP0?= =?iso-8859-1?Q?8blGxWTBo7pHqL1MKAsdzwXdRpORvswEfEzJl9gz1yezXSZtHmKWxGzsBj?= =?iso-8859-1?Q?d8LnBagkxJJXTNT2Z1YcNnSZVXNNNMYVGlq7UJgw5RJND3oSAQsliawiRw?= =?iso-8859-1?Q?8SE3tUPoD4ppLvQUoTyQwI5vPUDUzvvOk1M4UHcW5XvT7PB6vw/KFvvGQw?= =?iso-8859-1?Q?RyB7xo2P+CFXk1EiMRWx4TdcVLFHoq0rJxXpWOWAQVVG4UZ3Ow/tL+JSvo?= =?iso-8859-1?Q?IAfltGh14zU0gx5DAuvW7m0nmBjeYe3S4SOVGLuv8xHjwsnxs/8CXV4vnQ?= =?iso-8859-1?Q?7CuCJ12crN3uRsTklCapl/RAOQTgqedCsEelZ+KOBEt1YTGKpBTOoa1zuu?= =?iso-8859-1?Q?hM2IIJfj6KBTG7KdM+5M8cM1wbYmBaDKYaiN7oIk/0mrovRNyOqPFpRlhE?= =?iso-8859-1?Q?qjUabsturFqbVdQDOeNrY7Hoz9th1t7m36yueMQNYe2wdjvxPMkaMxxzlv?= =?iso-8859-1?Q?xky7DKxRTSGW86YSMH6NkMqwUBpiA91CSiGZElj+QsoCrpau4e3ZH/cDwA?= =?iso-8859-1?Q?Ks9kgkUERov2+D1wVub1yPyEs7P8Hm2SOd5dH+d7hwFAZtQ0AJuuW0Zuz1?= =?iso-8859-1?Q?wCvZkqYh8/BzBsH/NvpMimCKodzch5sm9Qy3q0x9JLxRKhocheUQdXpkx9?= =?iso-8859-1?Q?Dm86hMjDVTGRITSQv+qsOAqlxEXFhepagfd8fIg7Lz4CcNeqdQ+tmlYvsa?= =?iso-8859-1?Q?l1b36GFBxiR/d/2NjNjuT+zzVLkYPvAZiEJiWOWOAgQ7cNjaOq1GvDxE5J?= =?iso-8859-1?Q?fHDjkdKl6DGlx7p0eQxdpS6d8mugn4m54a392khekHyhCccao/YDQ4ZVNn?= =?iso-8859-1?Q?fFRR9+WY7ut8xDk5WMUpyiJj+oW+HfaPWFTBv9L9WqcZ8dE5XvfUqXIxEs?= =?iso-8859-1?Q?OKSmBXP73t+UtDVZvsZ67szbBVCt4QJ6qafc2Ul5taBcbudo2ssP3K+4j+?= =?iso-8859-1?Q?K0lzpRgJU5s6k8h39leuZn0fhAICEKu8fpbCaVg4pOXDutuce1m1E=3D?= x-ms-exchange-transport-forked: True Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-OriginatorOrg: uoguelph.ca X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: YQXPR0101MB0968.CANPRD01.PROD.OUTLOOK.COM X-MS-Exchange-CrossTenant-Network-Message-Id: 701b6427-d4e8-40f1-ded1-08d8eb1c6ab6 X-MS-Exchange-CrossTenant-originalarrivaltime: 19 Mar 2021 21:17:35.4456 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: be62a12b-2cad-49a1-a5fa-85f4f3156a7d X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: gZAPjKwdm6kW2oII3yBUrQwwUs8POXr2OSV+Bm3VBWD4t90XJ1K0/RtvU+/dd8eJbxe/PKtOdm0+i8WdIkhcQw== X-MS-Exchange-Transport-CrossTenantHeadersStamped: YQXPR01MB3845 X-Rspamd-Queue-Id: 4F2Gv55DWpz3vVt X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[] X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 19 Mar 2021 21:17:38 -0000 Jason Breitman wrote:=0A= >Thank you for your focus on the issue I am having and I look forward to se= eing your >patch ported to FreeBSD 12.X.=0A= I'll only be committing the patch I am convinced it actually fixes somethin= g.=0A= I'll be looking more closely at it and seeing what mav@ thinks aboutm it.= =0A= =0A= >I also appreciate that you understand the difficulties in testing changes = on a core >piece of infrastructure.=0A= >=0A= >I will let the group know if the issue occurs following the change that di= sabled TSO >and LRO on my FreeBSD NFS Server NICs.=0A= >Those types of settings are less disruptive and pose less risk to apply in= production, >so I am happy to do so. That change was made on 3/17/2021.= =0A= >My hope is that this issue is a race condition specific to my NIC handling= certain TCP >operations.=0A= >=0A= >I am happy that you are approaching the issue from multiple angles.=0A= Well, another angle would be a nfsd thread that is "stuck" while doing=0A= an RPC. If that happens, it won't call svc_freereq(), which derefs the=0A= structure.=0A= If it happens again and you can do, please go onto the FreeBSD server=0A= and perform the following commands a few times, a few minutes apart,=0A= capturing the output:=0A= # ps axHl=0A= # procstat -kk I'll be looking for an nfsd thread that is sleeping on the same thing= =0A= without cpu increasing (except for rpcsvc, which is just a thread wait= ing=0A= for an RPC to work on).=0A= --> The procstat -kk gives more information w.r.t what the thread is up to.= =0A= =0A= Good luck with it, rick=0A= =0A= Thanks.=0A= =0A= Jason Breitman=0A= =0A= =0A= On Mar 19, 2021, at 11:58 AM, Rick Macklem wrote:=0A= =0A= Michael Tuexen wrote:=0A= >> On 18. Mar 2021, at 21:55, Rick Macklem wrote:=0A= >>=0A= >> Michael Tuexen wrote:=0A= >>>> On 18. Mar 2021, at 13:42, Scheffenegger, Richard wrote:=0A= >>>>=0A= >>>>>> Output from the NFS Client when the issue occurs # netstat -an | gre= p=0A= >>>>>> NFS.Server.IP.X=0A= >>>>>> tcp 0 0 NFS.Client.IP.X:46896 NFS.Server.IP.X:2049 FIN_WAIT2=0A= >>>>> I'm no TCP guy. Hopefully others might know why the client would be s= tuck in FIN_WAIT2 (I vaguely recall this means it is waiting for a fin/ack,= but could be wrong?)=0A= >>>>=0A= >>>> When the client is in Fin-Wait2 this is the state you end up when the = Client side actively close() the tcp session, and then the server also ACKe= d the FIN.=0A= >> Jason noted:=0A= >>=0A= >>> When the issue occurs, this is what I see on the NFS Server.=0A= >>> tcp4 0 0 NFS.Server.IP.X.2049 NFS.Client.IP.X.51550 CLOSE_WAIT=0A= >>>=0A= >>> which corresponds to the state on the client side. The server received = the FIN=0A= >>> from the client and acked it.=0A= >>> The server is waiting for a close call to happen.=0A= >>> So the question is: Is the server also closing the connection?=0A= >> Did you mean to say "client closing the connection here?"=0A= >Yes.=0A= >>=0A= >> The server should call soclose() { it never calls soshutdown() } when=0A= >> soreceive(with MSG_WAIT) returns 0 bytes or an error that indicates=0A= >> the socket is broken.=0A= Btw, I looked and the soreceive() is done with MSG_DONTWAIT, but the=0A= EWOULDBLOCK is handled appropriately.=0A= =0A= >> --> The soreceive() call is triggered by an upcall for the rcv side of t= he socket.=0A= >> So, are you saying the FreeBSD NFS server did not call soclose() for thi= s case?=0A= >Yes. If the state at the server side is CLOSE_WAIT, no close call has happ= ened yet.=0A= >The FIN from the client was received, it was ACKED, but no close() call=0A= >(or shutdown(..., SHUT_WR) or shutdown(..., SHUT_RDWR)) was issued. Theref= ore,=0A= >no FIN was sent and the client should be in the FINWAIT-2 state. This was = also=0A= >reported. So the reported states are consistent.=0A= For a test, I commented out the soclose() call in the server side krpc and,= when I=0A= dismounted, it did leave the server socket in CLOSE_WAIT.=0A= For the FreeBSD client, it did the dismount and the socket was in FIN_WAIT2= =0A= for a little while and then disappeared (someone mentioned a short timeout= =0A= and that seems to be the case).=0A= I might argue that the Linux client should not get hung when this occurs,= =0A= but there does appear to be an issue on the FreeBSD end.=0A= =0A= So it does appear you have a case where the soclose() call is not happening= =0A= on the FreeBSD NFS server. I am a little surprised since I don't think I've= =0A= heard of this before and the code is at least 10years old (at least the par= ts=0A= related to this).=0A= =0A= For the soclose() to not happen, the reference count on the socket=0A= structure cannot have gone to zero. (ie a SVC_RELEASE() was missed)=0A= Upon code inspection, I was not able to spot a reference counting bug.=0A= (Not too surprising, since a reference counting bug should have shown=0A= up long ago.)=0A= =0A= The only thing I spotted that could conceivably explain this is that the=0A= function svc_vc_stat() which returns the indication that the socket has=0A= been closed at the other end did not bother to do any locking when=0A= it checked the status. (I am not yet sure if this could result in the=0A= status of XPRT_DIED being missed by the call, but if so, that would=0A= result in the soclose() call not happening.)=0A= =0A= I have attached a small patch, which I think is safe, that adds locking=0A= to svc_vc_stat(),which I am hoping you can try at some point.=0A= (I realize this is difficult for a production server, but...)=0A= I have tested it a little and will test it some more, to try and ensure=0A= it does not break anything.=0A= =0A= I have also cc'd mav@, since he's the guy who last worked on this=0A= code, in case he has any insight w.r.t. how the soclose() might get=0A= missed (or any other way the server socket gets stuck in CLOSE_WAIT).=0A= =0A= rick=0A= ps: I'll create a PR for this, so that it doesn't get forgotten.=0A= =0A= Best regards=0A= Michael=0A= =0A= >=0A= > rick=0A= >=0A= > Best regards=0A= > Michael=0A= >> This will last for ~2 min or so, but is asynchronous. However, the same = 4-tuple can not be reused during this time.=0A= >>=0A= >> With other words, from the socket / TCP, a properly executed active clos= e() will end up in this state. (If the other side initiated the close, a pa= ssive close, will not end in this state)=0A= >>=0A= >>=0A= >> _______________________________________________=0A= >> freebsd-net@freebsd.org mailing list=0A= >> https://lists.freebsd.org/mailman/listinfo/freebsd-net=0A= >> To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org"= =0A= >=0A= >=0A= > _______________________________________________=0A= > freebsd-net@freebsd.org mailing list=0A= > https://lists.freebsd.org/mailman/listinfo/freebsd-net=0A= > To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org"=0A= =0A= _______________________________________________=0A= freebsd-net@freebsd.org mailing list=0A= https://lists.freebsd.org/mailman/listinfo/freebsd-net=0A= To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org"=0A= =0A= _______________________________________________=0A= freebsd-net@freebsd.org mailing list=0A= https://lists.freebsd.org/mailman/listinfo/freebsd-net=0A= To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org"=0A= =0A= =0A= From owner-freebsd-net@freebsd.org Fri Mar 19 21:25:37 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id E8BE65AD1A4 for ; Fri, 19 Mar 2021 21:25:37 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) Received: from CAN01-TO1-obe.outbound.protection.outlook.com (mail-eopbgr670059.outbound.protection.outlook.com [40.107.67.59]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "DigiCert Cloud Services CA-1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4F2H4K57JZz3wPH; Fri, 19 Mar 2021 21:25:37 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=EkPm9lBUbCPEsnde4/l0JsypIbwPgU4zdE2upeHFEXPqFZe/fUeuy5RocZl1dpxQZnDpgrqG6uf/x5FC5kUAiCEPaqsOjkjqkiEfGpb7luVbclY0cUeMX9EVzpaSNYSc4C+nY092XA2Y3iyqEzEF09Y7Rak7M2CfBQagCBK1xHB9ClF0SDUNHriKtPzDfkXQu/vKDAQDFcVTULYP4oAuSzvPwsCwFPwSHy7JuahmVLAdGnSDF1zi2ycRNmmCRYlTgmC5ICHau6fYi9XTBtdfzNED/fiCsAfvNGq8QjWSNoYUEmJtxaqXZgcoJ7AO75SbavdF3whs8LSoT0s/TWWC2A== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=V1azCSMSs1Y0vAAeywVsdSxqpUaIDPNa/GPjdk0dG5U=; b=COrnsCPmSMXQac2FiUmNYIX7fXN8p5fq8LwHXiy33s5+FVvLNorcG+rpGUKPr551OTrqgnRDrkSx8Tsky24sOaavB6SPjEW1PvuGbFHjdKlQm/ID9oA/95o244y5DzLT7+8gmc8+hEize6recWMWNGnyeLlDZZlfIW17VsDkaQb0Hy47/e9dvyILX4gndYn+NmbD3clforsgC9XKoRJUZJbNS4ytUyqlsnriyDILLhju3Fn9Bm1TE6atP6RBZsL0f2yE1houyiCjTa778jJHjmTyn67B7F3lLq2pAVzn9koIrpc56JygvL/UEVUp4cHOSAku2uyha619W2F6NoE6nw== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=uoguelph.ca; dmarc=pass action=none header.from=uoguelph.ca; dkim=pass header.d=uoguelph.ca; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=uoguelph.ca; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=V1azCSMSs1Y0vAAeywVsdSxqpUaIDPNa/GPjdk0dG5U=; b=LmXVTWY0p7ul+QWYo0f4AZ4irWT+pwYBYELEBoe+LMIXR0poYes5TTUe5aG+1CmdShR3JeXOTUNjI4m+SyHE4xdWqsrVQvDVjGCp9XpsclPmr9YiJU9PQ+RlPFUZvA0cEgh/yO3Lwzx3aGJGB/vID6H0D939C3sjM46/cj6Wy/wCjXD4suPDy5QAokYR7N37rE9WEWQ0/WEW5I46vkmNZKyaTWdnLsqFQvWzxOHvwn65zWAi48ki78hLjlDKfk4lhFnDnpe5pOsEfWVi6iwMobm5Talyazta10LZNVI0NlVnQEwh9quY9RQQ6+DdxSJO2dvVlREC/Qs/eo01lzGH7A== Received: from YQXPR0101MB0968.CANPRD01.PROD.OUTLOOK.COM (2603:10b6:c00:19::29) by YQXPR01MB4309.CANPRD01.PROD.OUTLOOK.COM (2603:10b6:c01:7::21) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3933.32; Fri, 19 Mar 2021 21:25:36 +0000 Received: from YQXPR0101MB0968.CANPRD01.PROD.OUTLOOK.COM ([fe80::6073:6fc0:5ddf:dc8a]) by YQXPR0101MB0968.CANPRD01.PROD.OUTLOOK.COM ([fe80::6073:6fc0:5ddf:dc8a%7]) with mapi id 15.20.3933.033; Fri, 19 Mar 2021 21:25:36 +0000 From: Rick Macklem To: "Scheffenegger, Richard" , "tuexen@freebsd.org" CC: "freebsd-net@freebsd.org" , Alexander Motin Subject: Re: NFS Mount Hangs Thread-Topic: NFS Mount Hangs Thread-Index: AQHXG1G2D7AHBwtmAkS1jBAqNNo2I6qIqQ+SgAEIlICAAAOAgIAAhBk7gAAEF4CAATUdPYAADKuAgAAgQ4CAAAO8gIAAMQoG Date: Fri, 19 Mar 2021 21:25:35 +0000 Message-ID: References: <3750001D-3F1C-4D9A-A9D9-98BCA6CA65A4@tildenparkcapital.com> <33693DE3-7FF8-4FAB-9A75-75576B88A566@tildenparkcapital.com> <2890D243-AF46-43A4-A1AD-CB0C3481511D@lurchi.franken.de> <9EE3DFAC-72B0-4256-B57C-DE6AA811413C@freebsd.org> <03DE00F1-B60D-49AE-AC53-C83BA9F0F5C7@freebsd.org>, In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-ms-publictraffictype: Email x-ms-office365-filtering-correlation-id: 9d089dd4-1bbd-4c1f-c559-08d8eb1d892f x-ms-traffictypediagnostic: YQXPR01MB4309: x-microsoft-antispam-prvs: x-ms-oob-tlc-oobclassifiers: OLM:9508; x-ms-exchange-senderadcheck: 1 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: adXktSQH7dw4Y463Z0e6B8ldb7wQHFU3Qugy4e6e1G3p8vK8F8pFSdBsA4RNUPFz3HzKNb/cpiuyUqqkDE7hXZJIPIWvKEW31McmPp25j7x5iRJeqjDmNh+xYzcP2Je9xhzdOM/JYKZ4O4CqrX91WXZLLMzqQbgj1+/JZ5AQoBXboi744Hh7H5F3oyAkPR8N2yRCdObQbedkWxtjyuoZB8oWY++nH+aUuiCkUuiryGpZYfLDalS3usEdPsnt2OB9RgXmYo9BzgIIXWafNYOlyZCaAXQJwQ3fV06EumMjtB/gzjbjYEX7HBJ8CfH3/T/32seM9/MNISYYa4ahZopHO5W6Zwkzev8okb+v5Ip8IJieA6qFr2SQ7tQ349T59SahzJ5/G9TibLymJrYXMVLfuL6ELv9mUWPAXr9ZNozanxWJNA5twqOPB0HG23nb5Wb/jSKBvJ2P8KSyL50zUWE0yaOgAdCdFbh3gx8Zv9ID9R68C1LPAZ0HMKK5UuJL+/rVVP2L5/l8veK3Dy1Rg8tJWabqF4yiWuGl09UhA2DEsZt8Xa6Kbo2rGLivprB1s+9rsoNMtTYGYkEzBfiN14L9Mb92GHyixI+XWPBxeTUKSwtor/pWHE8J+VLnOM4LzBx3xVA8hNt8aNMpdnPVDzQdDrjXJiLioFxFhhH6MF0TTIs= x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:YQXPR0101MB0968.CANPRD01.PROD.OUTLOOK.COM; PTR:; CAT:NONE; SFS:(136003)(376002)(366004)(39860400002)(396003)(346002)(71200400001)(186003)(66946007)(7116003)(76116006)(66476007)(64756008)(52536014)(66446008)(33656002)(5660300002)(4744005)(86362001)(91956017)(66556008)(3480700007)(9686003)(478600001)(38100700001)(4326008)(6506007)(83380400001)(8676002)(110136005)(55016002)(54906003)(8936002)(316002)(7696005)(2906002)(786003); DIR:OUT; SFP:1101; x-ms-exchange-antispam-messagedata: =?iso-8859-1?Q?6rxxLuFP7C0Lc1IxWQ+unR3YmIXypDgVyRqnkH2TBzqkqyfrtdz1rnstlM?= =?iso-8859-1?Q?3vxH3Nd4hzw3ix4i//bz9y3tdV+FagPXfunW/6WA0SzCblW0YyKKZCuSuP?= =?iso-8859-1?Q?JQEVkUarRDLYyTSb8bzao3y/yG5fnOLa//rcZVsZb/d9vLm7EWuJX3Uh99?= =?iso-8859-1?Q?1903vf6wovQbHFP04kK2YwQPfh40X7CB6Q8qI07ieFvpHd0QLjlWuzzrPS?= =?iso-8859-1?Q?13kSgS2RO+z6TW0Lk/Hio5Ask5+vxScLW3A10kZuemUpJHFxOkmCYDf0ke?= =?iso-8859-1?Q?rtI/U3VGjm8p9ECBdRVV0Af67be7OVHSrNn9+l2kwCp5f3GcAV5+/mgrdD?= =?iso-8859-1?Q?R/dY9AHjUZPPLkm/6Tphk3IyEwOXeylvbndOSw3YMH7GlUCNROSEbFdGZZ?= =?iso-8859-1?Q?KWDmBNi2ExFIGj2GkRaJGWQ0Sht1o8mU0b7ujTm0NVIFecNwkGYZDXAKj7?= =?iso-8859-1?Q?HSanqGI+T1421s0SDOBJWkGCDkUO+uLei96tj1WwqKtUd/ZJelhQfjcfpR?= =?iso-8859-1?Q?S/fvh3cow6EHXl/f0cec+nBxB6IB2XMHkD+YBvQgWPy3PRCg6kpqlNN7Kf?= =?iso-8859-1?Q?ZD0FxJEyIKJwj9xbTqJNFXlcqwfjFLpLEy5Ouff0irFMRPYFhcW040zpCH?= =?iso-8859-1?Q?vTRz6FG4NeRUXHOlCN1pw90ddZNxVS14fPCvLmWbygVNkw7Vaicp26AC68?= =?iso-8859-1?Q?lxQSATPLjPmHOIELJO39Kn2NLAdmiPQnjxm3J8cVRsGCIJDqcWV32l/kXo?= =?iso-8859-1?Q?cyNqoneV6vIUvoLRo6Wt5ZuAxWv6LuT3prMinHYDjp8SHjsclybF7W3QyU?= =?iso-8859-1?Q?n4IOhjG0ifrEygwlxtbm6f6oDNNMCAxWM2LMJ2CPFglATo/5Plwjucn6oi?= =?iso-8859-1?Q?vq3TfsjAR66NEnpem8JUylqPoLSqgdODhvbYKohp/EPYOyQHcN7NkhsOUS?= =?iso-8859-1?Q?GFrWFrsLpbyfT9L/z9OE5+nhC1g0OCwomSjq9dhJmr5A6wKOyJ6OmcUagA?= =?iso-8859-1?Q?Z6KcYjfkJBZ3TrqqiZN6mIn3GSOHBfCoVZ6dJMgQ1TlGBm4tupdnHlMPLd?= =?iso-8859-1?Q?OImDTL7sdPbc7n4cZXkM90U2DccIPh7xNG2DVV++Jb6tA5DbhP7Q2QS/YR?= =?iso-8859-1?Q?vuoHTJ+ECjZ7o4wktRqG9ohDLrszAIFdrDq6QD4vn7RyoY5WTiOe0sLO+o?= =?iso-8859-1?Q?XnOk0b1Ug1t08iuH5kiv17dxhMEScw8Q8U1G1YcMkIEfJlkgOhhrhpNgHu?= =?iso-8859-1?Q?dGn3AdEcCKET+tIN3fF+08WX3CtRBqntPPnI4EgJH+xmRYk82Ln/zPu/DV?= =?iso-8859-1?Q?rJFXytifpuuyeEoGpN57IlYSLekfBXLpgMSAKh98NJmeK3xakflKBttbRo?= =?iso-8859-1?Q?gO8Ei3qUxFE/Cqr29ABsYmreXdq+8XjIP6oK7bUBqX9kNbYATLUEM40n/Q?= =?iso-8859-1?Q?fv0e45SOXi59oEI5?= x-ms-exchange-transport-forked: True Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-OriginatorOrg: uoguelph.ca X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: YQXPR0101MB0968.CANPRD01.PROD.OUTLOOK.COM X-MS-Exchange-CrossTenant-Network-Message-Id: 9d089dd4-1bbd-4c1f-c559-08d8eb1d892f X-MS-Exchange-CrossTenant-originalarrivaltime: 19 Mar 2021 21:25:35.9964 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: be62a12b-2cad-49a1-a5fa-85f4f3156a7d X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: 6VYU6765gw7vqX7fu5lakg0sDVu1666vyXBXpThQ/6YbqniLiiHgXb34Tj5WG+8xXBGyQOvHTDWxnOr+8HvXPg== X-MS-Exchange-Transport-CrossTenantHeadersStamped: YQXPR01MB4309 X-Rspamd-Queue-Id: 4F2H4K57JZz3wPH X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[] X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 19 Mar 2021 21:25:38 -0000 Scheffenegger, Richard wrote:=0A= >Sorry, I though this was a problem on stable/13.=0A= >=0A= >This is only in HEAD, stable/13 and 13.0 - never MFC'd to stable/12 or bac= kported to >12.1=0A= >=0A= >> I did some reshuffling of socket-upcalls recently in the TCP stack, to p= revent some race conditions with our $work in-kernel NFS server implementat= ion.=0A= The FreeBSD krpc/nfs definitely uses upcalls. On the server side the upcall= just=0A= "activates" a thread to service the socket (soreceive() etc).=0A= The client side upcall does quite a bit more, including soreceive().=0A= Timing shouldn't be a problem, so long as upcalls happen when there is data= =0A= to be received or the socket has been closed at the other end.=0A= I test with pretty current sources and haven't seen issues.=0A= If I do see problems, I'll be sure to let you know.;-)=0A= =0A= rick=0A= =0A= =0A= Are these changes in 12.1p5? This is the OS version used by the reporter of= the bug.=0A= =0A= Best regards=0A= Michael=0A= =0A= From owner-freebsd-net@freebsd.org Sat Mar 20 00:01:18 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 5B4815B130E for ; Sat, 20 Mar 2021 00:01:18 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 4F2LWy1LMCz4bT6 for ; Sat, 20 Mar 2021 00:01:18 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 87F6F5B1392; Sat, 20 Mar 2021 00:01:17 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 848735B129B for ; Sat, 20 Mar 2021 00:01:17 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4F2LWx2SQjz4bL3 for ; Sat, 20 Mar 2021 00:01:17 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id E2A921E305 for ; Sat, 20 Mar 2021 00:01:14 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 12K01EHY007985 for ; Sat, 20 Mar 2021 00:01:14 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 12K01E3e007984 for net@FreeBSD.org; Sat, 20 Mar 2021 00:01:14 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 246705] [re] RTL8111/8168/8411 PCI Express Gigabit Ethernet Controller (rev 04) dosesn't work Date: Sat, 20 Mar 2021 00:01:15 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 12.1-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: menelkir@itroll.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: FIXED X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: net@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: resolution bug_status Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 20 Mar 2021 00:01:18 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D246705 Daniel Menelkir changed: What |Removed |Added ---------------------------------------------------------------------------- Resolution|--- |FIXED Status|New |Closed --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-net@freebsd.org Sat Mar 20 00:40:22 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 9F0425B2E7C for ; Sat, 20 Mar 2021 00:40:22 +0000 (UTC) (envelope-from prvs=57132dad79=youssef.ghorbal@pasteur.fr) Received: from mx2.pasteur.fr (mx2.pasteur.fr [157.99.45.70]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4F2MP14Yhgz4fLK for ; Sat, 20 Mar 2021 00:40:21 +0000 (UTC) (envelope-from prvs=57132dad79=youssef.ghorbal@pasteur.fr) Received: from pps.filterd (proofpoint01.pasteur.fr [127.0.0.1]) by proofpoint01.pasteur.fr (8.16.1.2/8.16.1.2) with SMTP id 12K0Zlaj138865; Sat, 20 Mar 2021 01:40:13 +0100 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=pasteur.fr; h=from : to : cc : subject : date : message-id : references : in-reply-to : content-type : content-id : content-transfer-encoding : mime-version; s=DKIM2020; bh=xNjDX5/AecU+0xVtLUle6lmepLG+LiH2RRX/lbrVUQ4=; b=BxmmzFCpXOjXgjRJ00zHDiXT7Rf4X9se92J38sTYqOPwrYq5ARKbDLHWVIASTFTBav7s WUGYK6mkDWGNOjIvus9eD0KYEUWa8Kcu/vAjUcOvq4cMRx5vovxq9ZN2MmTu9u+XvF6n QWSxYqvM2lQoAggf78qdNF91zM0Ja2h/LdMCS28RlcEsP/epxCdQtGR9IaJfd1bjEA2s MdJiABq2QXuAZwWPcb99p0YxVICo/fr2mdasWGgtU8WBckFlZqyg2i4JSM68rA9DX0UV QogAkU8tEXixP9EBhTjfALObbfGe0EEqhKVhDrZbuwBQ1fbssM6flK7ZSDiM6DWhRni8 bQ== Received: from exchange11.corp.pasteur.fr (exchange11.corp.pasteur.fr [10.37.3.11]) by proofpoint01.pasteur.fr with ESMTP id 37d64wg4ym-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL); Sat, 20 Mar 2021 01:40:13 +0100 Received: from EXCHANGE01.corp.pasteur.fr (157.99.211.31) by exchange11.corp.pasteur.fr (10.37.3.11) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256) id 15.2.792.3; Sat, 20 Mar 2021 01:40:13 +0100 Received: from EXCHANGE01.corp.pasteur.fr (2002:9d63:d31f::9d63:d31f) by EXCHANGE01.corp.pasteur.fr (2002:9d63:d31f::9d63:d31f) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256_P256) id 15.1.2176.2; Sat, 20 Mar 2021 01:40:12 +0100 Received: from EXCHANGE01.corp.pasteur.fr ([fe80::a1:8d1c:2213:159a]) by EXCHANGE01.corp.pasteur.fr ([fe80::a1:8d1c:2213:159a%18]) with mapi id 15.01.2176.009; Sat, 20 Mar 2021 01:40:12 +0100 From: "Youssef GHORBAL" To: Jason Breitman CC: "freebsd-net@freebsd.org" Subject: Re: NFS Mount Hangs Thread-Topic: NFS Mount Hangs Thread-Index: AQHXG1GBS22C4lXrkUeDRWxvsDPYdaqL+8UA Date: Sat, 20 Mar 2021 00:40:12 +0000 Message-ID: References: <3750001D-3F1C-4D9A-A9D9-98BCA6CA65A4@tildenparkcapital.com> <33693DE3-7FF8-4FAB-9A75-75576B88A566@tildenparkcapital.com> In-Reply-To: <33693DE3-7FF8-4FAB-9A75-75576B88A566@tildenparkcapital.com> Accept-Language: en-US, fr-FR Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [157.99.101.114] Content-Type: text/plain; charset="utf-8" Content-ID: <6D84D968A845D34B93382468B91578AA@corp.pasteur.fr> Content-Transfer-Encoding: base64 MIME-Version: 1.0 X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10434:6.0.369, 18.0.761 definitions=2021-03-19_12:2021-03-19, 2021-03-19 signatures=0 X-Proofpoint-Spam-Details: rule=outbound_notspam policy=outbound score=0 impostorscore=0 spamscore=0 adultscore=0 clxscore=1011 bulkscore=0 priorityscore=1501 lowpriorityscore=0 phishscore=0 malwarescore=0 mlxlogscore=999 mlxscore=0 suspectscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.12.0-2009150000 definitions=main-2103200001 X-Rspamd-Queue-Id: 4F2MP14Yhgz4fLK X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=pasteur.fr header.s=DKIM2020 header.b=BxmmzFCp; dmarc=pass (policy=none) header.from=pasteur.fr; spf=pass (mx1.freebsd.org: domain of prvs=57132dad79=youssef.ghorbal@pasteur.fr designates 157.99.45.70 as permitted sender) smtp.mailfrom=prvs=57132dad79=youssef.ghorbal@pasteur.fr X-Spamd-Result: default: False [-2.90 / 15.00]; TO_DN_EQ_ADDR_SOME(0.00)[]; HAS_XOIP(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:157.99.45.70/32]; DKIM_TRACE(0.00)[pasteur.fr:+]; MIME_BASE64_TEXT(0.10)[]; RCPT_COUNT_TWO(0.00)[2]; NEURAL_HAM_SHORT(-1.00)[-1.000]; DMARC_POLICY_ALLOW(-0.50)[pasteur.fr,none]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:29110, ipnet:157.99.0.0/16, country:FR]; MID_RHS_MATCH_FROM(0.00)[]; FROM_NEQ_ENVFROM(0.00)[youssef.ghorbal@pasteur.fr,prvs=57132dad79=youssef.ghorbal@pasteur.fr]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; RCVD_COUNT_FIVE(0.00)[6]; R_DKIM_ALLOW(-0.20)[pasteur.fr:s=DKIM2020]; FROM_HAS_DN(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; FORGED_SENDER_VERP_SRS(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RWL_MAILSPIKE_VERYGOOD(0.00)[157.99.45.70:from]; FROM_NAME_EXCESS_SPACE(1.00)[]; MAILMAN_DEST(0.00)[freebsd-net] X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 20 Mar 2021 00:40:22 -0000 SGkgSmFzb24sDQoNCj4gT24gMTcgTWFyIDIwMjEsIGF0IDE4OjE3LCBKYXNvbiBCcmVpdG1hbiA8 amJyZWl0bWFuQHRpbGRlbnBhcmtjYXBpdGFsLmNvbT4gd3JvdGU6DQo+IA0KPiBQbGVhc2UgcmV2 aWV3IHRoZSBkZXRhaWxzIGJlbG93IGFuZCBsZXQgbWUga25vdyBpZiB0aGVyZSBpcyBhIHNldHRp bmcgdGhhdCBJIHNob3VsZCBhcHBseSB0byBteSBGcmVlQlNEIE5GUyBTZXJ2ZXIgb3IgaWYgdGhl cmUgaXMgYSBidWcgZml4IHRoYXQgSSBjYW4gYXBwbHkgdG8gcmVzb2x2ZSBteSBpc3N1ZS4NCj4g SSBzaGFyZWQgdGhpcyBpbmZvcm1hdGlvbiB3aXRoIHRoZSBsaW51eC1uZnMgbWFpbGluZyBsaXN0 IGFuZCB0aGV5IGJlbGlldmUgdGhlIGlzc3VlIGlzIG9uIHRoZSBzZXJ2ZXIgc2lkZS4NCj4gDQo+ IElzc3VlDQo+IE5GU3Y0IG1vdW50cyBwZXJpb2RpY2FsbHkgaGFuZyBvbiB0aGUgTkZTIENsaWVu dC4NCj4gDQo+IER1cmluZyB0aGlzIHRpbWUsIGl0IGlzIHBvc3NpYmxlIHRvIG1hbnVhbGx5IG1v dW50IGZyb20gYW5vdGhlciBORlMgU2VydmVyIG9uIHRoZSBORlMgQ2xpZW50IGhhdmluZyBpc3N1 ZXMuDQo+IEFsc28sIG90aGVyIE5GUyBDbGllbnRzIGFyZSBzdWNjZXNzZnVsbHkgbW91bnRpbmcg ZnJvbSB0aGUgTkZTIFNlcnZlciBpbiBxdWVzdGlvbi4NCj4gUmVib290aW5nIHRoZSBORlMgQ2xp ZW50IGFwcGVhcnMgdG8gYmUgdGhlIG9ubHkgc29sdXRpb24uDQoNCkkgaGFkIGV4cGVyaWVuY2Vk IGEgc2ltaWxhciB3ZWlyZCBzaXR1YXRpb24gd2l0aCBwZXJpb2RpY2FsbHkgc3R1Y2sgTGludXgg TkZTIGNsaWVudHMgbW91bnRpbmcgSXNpbG9uIE5GUyBzZXJ2ZXJzIChJc2lsb24gaXMgRnJlZUJT RCBiYXNlZCBidXQgdGhleSBzZWVtIHRvIGhhdmUgdGhlcmUgb3duIG5mc2QpDQpXZeKAmXZlIGhh ZCBiZXR0ZXIgbHVjayBhbmQgd2UgZGlkIG1hbmFnZSB0byBoYXZlIHBhY2tldCBjYXB0dXJlcyBv biBib3RoIHNpZGVzIGR1cmluZyB0aGUgaXNzdWUuIFRoZSBnaXN0IG9mIGl0IGdvZXMgbGlrZSBm b2xsb3dzOg0KDQotIERhdGEgZmxvd3MgY29ycmVjdGx5IGJldHdlZW4gU0VSVkVSIGFuZCB0aGUg Q0xJRU5UDQotIEF0IHNvbWUgcG9pbnQgU0VSVkVSIHN0YXJ0cyBkZWNyZWFzaW5nIGl0J3MgVENQ IFJlY2VpdmUgV2luZG93IHVudGlsIGl0IHJlYWNocyAwDQotIFRoZSBjbGllbnQgKGVhZ2VyIHRv IHNlbmQgZGF0YSkgY2FuIG9ubHkgYWNrIGRhdGEgc2VudCBieSBTRVJWRVIuDQotIFdoZW4gU0VS VkVSIHdhcyBkb25lIHNlbmRpbmcgZGF0YSwgdGhlIGNsaWVudCBzdGFydHMgc2VuZGluZyBUQ1Ag V2luZG93IFByb2JlcyBob3BpbmcgdGhhdCB0aGUgVENQIFdpbmRvdyBvcGVucyBhZ2FpbiBzbyBo ZSBjYW4gZmx1c2ggaXRzIGJ1ZmZlcnMuDQotIFNFUlZFUiByZXNwb25kcyB3aXRoIGEgVENQIFpl cm8gV2luZG93IHRvIHRob3NlIHByb2Jlcy4NCi0gQWZ0ZXIgNiBtaW51dGVzICh0aGUgTkZTIHNl cnZlciBkZWZhdWx0IElkbGUgdGltZW91dCkgU0VSVkVSIHJhY2VmdWxseSBjbG9zZXMgdGhlIFRD UCBjb25uZWN0aW9uIHNlbmRpbmcgYSBGSU4gUGFja2V0IChhbmQgc3RpbGwgYSBUQ1AgV2luZG93 IGF0IDApIA0KLSBDTElFTlQgQUNLIHRoYXQgRklOLg0KLSBTRVJWRVIgZ29lcyBpbiBGSU5fV0FJ VF8yIHN0YXRlDQotIENMSUVOVCBjbG9zZXMgaXRzIGhhbGYgcGFydCBwYXJ0IG9mIHRoZSBzb2Nr ZXQgYW5kIGdvZXMgaW4gTEFTVF9BQ0sgc3RhdGUuDQotIEZJTiBpcyBuZXZlciBzZW50IGJ5IHRo ZSBjbGllbnQgc2luY2UgdGhlcmUgc3RpbGwgZGF0YSBpbiBpdHMgU2VuZFEgYW5kIHJlY2VpdmVy IFRDUCBXaW5kb3cgaXMgc3RpbGwgMC4gQXQgdGhpcyBzdGFnZSB0aGUgY2xpZW50IHN0YXJ0cyBz ZW5kaW5nIFRDUCBXaW5kb3cgUHJvYmVzIGFnYWluIGFuZCBhZ2FpbiBob3BpbmcgdGhhdCB0aGUg c2VydmVyIG9wZW5zIGl0cyBUQ1AgV2luZG93IHNvIGl0IGNhbiBmbHVzaCBpdCdzIGJ1ZmZlcnMg YW5kIHRlcm1pbmF0ZSBpdHMgc2lkZSBvZiB0aGUgc29ja2V0Lg0KLSBTRVJWRVIga2VlcHMgcmVz cG9uZGluZyB3aXRoIGEgVENQIFplcm8gV2luZG93IHRvIHRob3NlIHByb2Jlcy4NCj0+IFRoZSBs YXN0IHR3byBzdGVwcyBnb2VzIG9uIGFuZCBvbiBmb3IgaG91cnMvZGF5cyBmcmVlemluZyB0aGUg TkZTIG1vdW50IGJvdW5kIHRvIHRoYXQgVENQIHNlc3Npb24uDQoNCklmIHdlIGhhZCBhIHNpdHVh dGlvbiB3aGVyZSBDTElFTlQgd2FzIHJlc3BvbnNpYmxlIGZvciBjbG9zaW5nIHRoZSBUQ1AgV2lu ZG93IChhbmQgaW5pdGlhdGluZyB0aGUgVENQIEZJTiBmaXJzdCkgYW5kIHNlcnZlciB3YW50aW5n IHRvIHNlbmQgZGF0YSB3ZeKAmWxsIGVuZCB1cCBpbiB0aGUgc2FtZSBzdGF0ZSBhcyB5b3UgSSB0 aGluay4NCg0KV2XigJl2ZSBuZXZlciBoYWQgdGhlIHJvb3QgY2F1c2Ugb2Ygd2h5IHRoZSBTRVJW RVIgZGVjaWRlZCB0byBjbG9zZSB0aGUgVENQIFdpbmRvdyBhbmQgbm8gbW9yZSBhY2NjZXB0IGRh dGEsIHRoZSBmaXggb24gdGhlIElzaWxvbiBwYXJ0IHdhcyB0byByZWN5Y2xlIG1vcmUgYWdncmVz c2l2ZWx5IHRoZSBGSU5fV0FJVF8yIHNvY2tldHMgKG5ldC5pbmV0LnRjcC5mYXN0X2ZpbndhaXQy X3JlY3ljbGU9MSAmIG5ldC5pbmV0LnRjcC5maW53YWl0Ml90aW1lb3V0PTUwMDApLiBPbmNlIHRo ZSBzb2NrZXQgcmVjeWNsZWQgYW5kIGF0IHRoZSBuZXh0IG9jY3VyZW5jZSBvZiBDTElFTlQgVENQ IFdpbmRvdyBwcm9iZSwgU0VSVkVSIHNlbmRzIGEgUlNULCB0cmlnZ2VyaW5nIHRoZSB0ZWFyZG93 biBvZiB0aGUgc2Vzc2lvbiBvbiB0aGUgY2xpZW50IHNpZGUsIGEgbmV3IFRDUCBoYW5kY2hha2Us IGV0YyBhbmQgdHJhZmZpYyBmbG93cyBhZ2FpbiAoTkZTIHN0YXJ0cyByZXNwb25kaW5nKQ0KDQpU byBhdm9pZCByZWJvb3RpbmcgdGhlIGNsaWVudCAoYW5kIGJlZm9yZSB0aGUgYWdncmVzc2l2ZSBG SU5fV0FJVF8yICB3YXMgaW1wbGVtZW50ZWQgb24gdGhlIElzaWxvbiBzaWRlKSB3ZeKAmXZlIGFk ZGVkIGEgY2hlY2sgc2NyaXB0IG9uIHRoZSBjbGllbnQgdGhhdCBkZXRlY3RzIExBU1RfQUNLIHNv Y2tldHMgb24gdGhlIGNsaWVudCBhbmQgdGhyb3VnaCBpcHRhYmxlcyBydWxlIGVuZm9yY2VzIGEg VENQIFJTVCwgU29tZXRoaW5nIGxpa2U6IC1BIE9VVFBVVCAtcCB0Y3AgLWQgJG5mc19zZXJ2ZXJf YWRkciAtLXNwb3J0ICRsb2NhbF9wb3J0IC1qIFJFSkVDVCAtLXJlamVjdC13aXRoIHRjcC1yZXNl dCAodGhlIHNjcmlwdCByZW1vdmVzIHRoaXMgaXB0YWJsZXMgcnVsZSBhcyBzb29uIGFzIHRoZSBM QVNUX0FDSyBkaXNhcHBlYXJzKQ0KDQpUaGUgYm90dG9tIGxpbmUgd291bGQgYmUgdG8gaGF2ZSBh IHBhY2tldCBjYXB0dXJlIGR1cmluZyB0aGUgb3V0YWdlIChjbGllbnQgYW5kL29yIHNlcnZlciBz aWRlKSwgaXQgd2lsbCBzaG93IHlvdSBhdCBsZWFzdCB0aGUgc2hhcGUgb2YgdGhlIFRDUCBleGNo YW5nZSB3aGVuIE5GUyBpcyBzdHVjay4NCg0KWW91c3NlZg0KDQo= From owner-freebsd-net@freebsd.org Sat Mar 20 10:28:07 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 9B0AA57B2E0 for ; Sat, 20 Mar 2021 10:28:07 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 4F2cRC3k9bz3pVL for ; Sat, 20 Mar 2021 10:28:07 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 7FB7957B609; Sat, 20 Mar 2021 10:28:07 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 7F78F57B58C for ; Sat, 20 Mar 2021 10:28:07 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4F2cRC34RQz3pVK for ; Sat, 20 Mar 2021 10:28:07 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 5CAF42645B for ; Sat, 20 Mar 2021 10:28:07 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 12KAS7RQ026326 for ; Sat, 20 Mar 2021 10:28:07 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 12KAS77K026325 for net@FreeBSD.org; Sat, 20 Mar 2021 10:28:07 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 254303] Fatal trap 12: page fault while in kernel mode ((frr 7.5_1 + Freebsd 13 Beta3) zebra crashes server when routes are populated) Date: Sat, 20 Mar 2021 10:28:07 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: Unspecified X-Bugzilla-Keywords: panic X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: melifaro@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: melifaro@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: assigned_to Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 20 Mar 2021 10:28:07 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D254303 Alexander V. Chernikov changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|net@FreeBSD.org |melifaro@FreeBSD.org --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-net@freebsd.org Sat Mar 20 14:10:27 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id D2C675A9EDE for ; Sat, 20 Mar 2021 14:10:27 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 4F2jMl5RNKz4Xn8 for ; Sat, 20 Mar 2021 14:10:27 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id BAA405A9CE2; Sat, 20 Mar 2021 14:10:27 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id BA68C5A9EDD for ; Sat, 20 Mar 2021 14:10:27 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4F2jMl4s7kz4Y4J for ; Sat, 20 Mar 2021 14:10:27 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 9632A10A1 for ; Sat, 20 Mar 2021 14:10:27 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 12KEARhu031915 for ; Sat, 20 Mar 2021 14:10:27 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 12KEARsV031914 for net@FreeBSD.org; Sat, 20 Mar 2021 14:10:27 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 254303] Fatal trap 12: page fault while in kernel mode ((frr 7.5_1 + Freebsd 13 Beta3) zebra crashes server when routes are populated) Date: Sat, 20 Mar 2021 14:10:27 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: Unspecified X-Bugzilla-Keywords: panic X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: rgrimes@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: melifaro@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 20 Mar 2021 14:10:27 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D254303 Rodney W. Grimes changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |net@FreeBSD.org, | |rgrimes@FreeBSD.org --=20 You are receiving this mail because: You are on the CC list for the bug.= From owner-freebsd-net@freebsd.org Sat Mar 20 22:15:33 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 901475B572F for ; Sat, 20 Mar 2021 22:15:33 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 4F2w7T3Ts2z3JCb for ; Sat, 20 Mar 2021 22:15:33 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 75F1D5B5A89; Sat, 20 Mar 2021 22:15:33 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 75BEE5B5A11 for ; Sat, 20 Mar 2021 22:15:33 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4F2w7T2rLmz3JRq for ; Sat, 20 Mar 2021 22:15:33 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 552827918 for ; Sat, 20 Mar 2021 22:15:33 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 12KMFXWQ081778 for ; Sat, 20 Mar 2021 22:15:33 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 12KMFXdT081777 for net@FreeBSD.org; Sat, 20 Mar 2021 22:15:33 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 247700] rtadvd: fails to generate error when iface lacks a link-local address Date: Sat, 20 Mar 2021 22:15:33 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: standards X-Bugzilla-Version: 12.1-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: john@saltant.com X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: hrs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: see_also Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 20 Mar 2021 22:15:33 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D247700 John W. O'Brien changed: What |Removed |Added ---------------------------------------------------------------------------- See Also| |https://bugs.freebsd.org/bu | |gzilla/show_bug.cgi?id=3D2= 544 | |45 --=20 You are receiving this mail because: You are on the CC list for the bug.=