From owner-freebsd-net@freebsd.org Sun May 2 00:18:43 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 93B0663D839 for ; Sun, 2 May 2021 00:18:43 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 4FXmtC3Zfxz3KxP for ; Sun, 2 May 2021 00:18:43 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 791A763D838; Sun, 2 May 2021 00:18:43 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 78E2663D5BC for ; Sun, 2 May 2021 00:18:43 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4FXmtC2vgSz3Krh for ; Sun, 2 May 2021 00:18:43 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 5702120BE9 for ; Sun, 2 May 2021 00:18:43 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 1420IhCx046110 for ; Sun, 2 May 2021 00:18:43 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 1420Ihux046109 for net@FreeBSD.org; Sun, 2 May 2021 00:18:43 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 230996] em/igb: Intel i210/i350: ifconfig: enabling "vlanhwtag" renders VLAN on i210/i350 NICs unusable Date: Sun, 02 May 2021 00:18:42 +0000 X-Bugzilla-Reason: CC AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 12.0-RELEASE X-Bugzilla-Keywords: IntelNetworking, needs-qa, performance, regression X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: kbowling@freebsd.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: Normal X-Bugzilla-Assigned-To: net@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? mfc-stable12? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 02 May 2021 00:18:43 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D230996 --- Comment #29 from Kevin Bowling --- (In reply to Kaho Toshikazu from comment #28) Can you explain how this helps? It looks to me that the current iflib_vlan_register compares two softcs as expected. --=20 You are receiving this mail because: You are on the CC list for the bug. You are the assignee for the bug.= From owner-freebsd-net@freebsd.org Sun May 2 01:17:39 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 9AD2563E7ED for ; Sun, 2 May 2021 01:17:39 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 4FXpBC3mlYz3NCx for ; Sun, 2 May 2021 01:17:39 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 8151A63E7EC; Sun, 2 May 2021 01:17:39 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 8119063E86E for ; Sun, 2 May 2021 01:17:39 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4FXpBC390Dz3MxD for ; Sun, 2 May 2021 01:17:39 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 6030021BA6 for ; Sun, 2 May 2021 01:17:39 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 1421Hdi0076840 for ; Sun, 2 May 2021 01:17:39 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 1421HdXS076839 for net@FreeBSD.org; Sun, 2 May 2021 01:17:39 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 230996] em/igb: Intel i210/i350: ifconfig: enabling "vlanhwtag" renders VLAN on i210/i350 NICs unusable Date: Sun, 02 May 2021 01:17:38 +0000 X-Bugzilla-Reason: AssignedTo CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 12.0-RELEASE X-Bugzilla-Keywords: IntelNetworking, needs-qa, performance, regression X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: kaho@elam.kais.kyoto-u.ac.jp X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: Normal X-Bugzilla-Assigned-To: net@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? mfc-stable12? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 02 May 2021 01:17:39 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D230996 --- Comment #30 from Kaho Toshikazu --- (In reply to Kevin Bowling from comment #29) EVENTHANDLER_REGISTER seems to require (struct ifnet *) which typedef if_t at if_var.h. When a vlan interface is created/destroyed, the vlan_config/unconfig handler is called, but I can not observe any execution of iflib_vlan_register or iflib_vlan_unregister at=20 using current code. The conversion form ctx to ifp makes execution of handl= ers. Then these handlers are called when a event is happened regardless for other devices or for itself. The compare is required to pick up a event related to a device driver. The handler calls with if_t because of being registered if_t instead of if_ctx_t by the above modification. --=20 You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug.= From owner-freebsd-net@freebsd.org Sun May 2 08:04:37 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 46C925FC557 for ; Sun, 2 May 2021 08:04:37 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 4FXzCn1L8Hz4RS7 for ; Sun, 2 May 2021 08:04:37 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 2DE205FC556; Sun, 2 May 2021 08:04:37 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 2DAA35FC4FC for ; Sun, 2 May 2021 08:04:37 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4FXzCn0klzz4RS6 for ; Sun, 2 May 2021 08:04:37 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 0C15C27622 for ; Sun, 2 May 2021 08:04:37 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 14284aFr086484 for ; Sun, 2 May 2021 08:04:36 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 14284aPk086483 for net@FreeBSD.org; Sun, 2 May 2021 08:04:36 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 238411] igb(4): Wake on Lan not working with Intel I210 Date: Sun, 02 May 2021 08:04:34 +0000 X-Bugzilla-Reason: AssignedTo CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 12.0-RELEASE X-Bugzilla-Keywords: IntelNetworking, needs-qa, regression X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: abraham@gmx.at X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: net@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 02 May 2021 08:04:37 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D238411 --- Comment #22 from Abraham122x --- What I can remember of my tests for my flashless NIC: - Some FreeBSD 11 releases: possible to set WOL flags with ifconfig (impor= tant is to avoid MCAST and UCAST flags, as they are triggered automatically seco= nds after shutdown and boot the device) - FreeBSD 12/13: no chance anymore to influence the driver settings in reg= ard to WOL flags; the flags are set and visible in ifconfig, but they have no effect. Don't understand the logic that the ifconfig flags have less priority than = the ROM settings. My proposal would be to use the ROM settings as default after boot (and set the ifconfig flags accordingly) and at shutdown the ifconfig settings should become priority. --=20 You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug.= From owner-freebsd-net@freebsd.org Sun May 2 13:08:25 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 04B75625222 for ; Sun, 2 May 2021 13:08:25 +0000 (UTC) (envelope-from bu7cher@yandex.ru) Received: from forward101j.mail.yandex.net (forward101j.mail.yandex.net [5.45.198.241]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4FY5yH4wMwz4fyj; Sun, 2 May 2021 13:08:23 +0000 (UTC) (envelope-from bu7cher@yandex.ru) Received: from forward102q.mail.yandex.net (forward102q.mail.yandex.net [IPv6:2a02:6b8:c0e:1ba:0:640:516:4e7d]) by forward101j.mail.yandex.net (Yandex) with ESMTP id C7DB11BE12F4; Sun, 2 May 2021 16:08:19 +0300 (MSK) Received: from vla1-b5449b1c7de5.qloud-c.yandex.net (vla1-b5449b1c7de5.qloud-c.yandex.net [IPv6:2a02:6b8:c0d:3915:0:640:b544:9b1c]) by forward102q.mail.yandex.net (Yandex) with ESMTP id A242A3A20002; Sun, 2 May 2021 16:08:19 +0300 (MSK) Received: from vla1-719694b86d9e.qloud-c.yandex.net (vla1-719694b86d9e.qloud-c.yandex.net [2a02:6b8:c0d:3495:0:640:7196:94b8]) by vla1-b5449b1c7de5.qloud-c.yandex.net (mxback/Yandex) with ESMTP id gRAY2SSjBl-8JI4bYKJ; Sun, 02 May 2021 16:08:19 +0300 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yandex.ru; s=mail; t=1619960899; bh=egq3P1l8JamcgNtO4gawcclULuSOJTEBTjZ4a+qPZx4=; h=In-Reply-To:Subject:From:Date:References:To:Message-ID:Cc; b=A8yrc9fpgvNASbM+5JXNa8DS9DJ3FK+8kjLFcnIy1dh2MHL2mPwb4AhiWUV9L3HNZ 4bSVUqetO7shNEL3noucLhsVbUTCn8/q8t+w8ms3FGCgTV0Dx52OjzCW9U/ZMLFbbm lqAu63Axa1NGtY6utYGrv6PHRUo33bpM//VQJWS8= Received: by vla1-719694b86d9e.qloud-c.yandex.net (smtp/Yandex) with ESMTPSA id 0Zj7yJgjoc-8JLGDjYB; Sun, 02 May 2021 16:08:19 +0300 (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) (Client certificate not present) To: Mark Johnston , =?UTF-8?Q?=c3=96zkan_KIRIK?= Cc: FreeBSD Net References: From: "Andrey V. Elsukov" Subject: Re: IPsec performace - netisr hits %100 Message-ID: <50cfc0e6-5cc6-7004-2566-bc06428d4394@yandex.ru> Date: Sun, 2 May 2021 16:08:18 +0300 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:78.0) Gecko/20100101 Thunderbird/78.9.0 MIME-Version: 1.0 In-Reply-To: Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="NSOW9Ri3VPfy3up6qZQwXjwHxiszOoES5" X-Rspamd-Queue-Id: 4FY5yH4wMwz4fyj X-Spamd-Bar: ----- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yandex.ru header.s=mail header.b=A8yrc9fp; dmarc=pass (policy=none) header.from=yandex.ru; spf=pass (mx1.freebsd.org: domain of bu7cher@yandex.ru designates 5.45.198.241 as permitted sender) smtp.mailfrom=bu7cher@yandex.ru X-Spamd-Result: default: False [-5.21 / 15.00]; FREEMAIL_FROM(0.00)[yandex.ru]; R_SPF_ALLOW(-0.20)[+ip4:5.45.192.0/19]; HAS_ATTACHMENT(0.00)[]; RCVD_COUNT_THREE(0.00)[4]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[yandex.ru:+]; DMARC_POLICY_ALLOW(-0.50)[yandex.ru,none]; NEURAL_HAM_SHORT(-0.30)[-0.298]; SIGNED_PGP(-2.00)[]; FREEMAIL_TO(0.00)[freebsd.org,gmail.com]; RCVD_IN_DNSWL_LOW(-0.10)[5.45.198.241:from]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:+,3:~]; FREEMAIL_ENVFROM(0.00)[yandex.ru]; MID_RHS_MATCH_FROM(0.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[5.45.198.241:from]; ASN(0.00)[asn:13238, ipnet:5.45.192.0/18, country:RU]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.71)[-0.709]; R_DKIM_ALLOW(-0.20)[yandex.ru:s=mail]; FROM_EQ_ENVFROM(0.00)[]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; NEURAL_HAM_LONG(-1.00)[-1.000]; TAGGED_RCPT(0.00)[]; MIME_GOOD(-0.20)[multipart/signed,multipart/mixed,text/plain]; SPAMHAUS_ZRD(0.00)[5.45.198.241:from:127.0.2.255]; DWL_DNSWL_NONE(0.00)[yandex.ru:dkim]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RWL_MAILSPIKE_POSSIBLE(0.00)[5.45.198.241:from]; MAILMAN_DEST(0.00)[freebsd-net] X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 02 May 2021 13:08:25 -0000 This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --NSOW9Ri3VPfy3up6qZQwXjwHxiszOoES5 Content-Type: multipart/mixed; boundary="6gJvw4Rnr7QpXaiyFsxtb5WniHvp3jCZA"; protected-headers="v1" From: "Andrey V. Elsukov" To: Mark Johnston , =?UTF-8?Q?=c3=96zkan_KIRIK?= Cc: FreeBSD Net Message-ID: <50cfc0e6-5cc6-7004-2566-bc06428d4394@yandex.ru> Subject: Re: IPsec performace - netisr hits %100 References: In-Reply-To: --6gJvw4Rnr7QpXaiyFsxtb5WniHvp3jCZA Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: quoted-printable 30.04.2021 23:32, Mark Johnston =D0=BF=D0=B8=D1=88=D0=B5=D1=82: > Second, netipsec unconditionally hands rx processing off to netisr > threads for some reason, that's why changing the dispatch policy doesn'= t > help. Maybe it's to help avoid running out of kernel stack space or to= > somehow avoid packet reordering in some case that is not clear to me. = I > tried a patch (see below) which eliminates this and it helped somewhat.= > If anyone can provide an explanation for the current behaviour I'd > appreciate it. Previously we have reports about kernel stack overflow during IPsec processing. In your example there is only one IPsec transform is configured, but it is possible to configure several in the bundle, AFAIR, it is limited to 4 transforms. E.g. if you configure ESP+AH - it is bundle of two transforms and this will grow kernel stack requirements.= --=20 WBR, Andrey V. Elsukov --6gJvw4Rnr7QpXaiyFsxtb5WniHvp3jCZA-- --NSOW9Ri3VPfy3up6qZQwXjwHxiszOoES5 Content-Type: application/pgp-signature; name="OpenPGP_signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="OpenPGP_signature" -----BEGIN PGP SIGNATURE----- wsB5BAABCAAjFiEE5lkeG0HaFRbwybwAAcXqBBDIoXoFAmCOpEIFAwAAAAAACgkQAcXqBBDIoXr0 HAgAqLOzhXvJFhDtmv7a+jQKxSZk0r3Fzxwl4n1RB9zLwkNTva0/8iCRE5oyCki/v7v8yxaoIVq5 bz8ptqtKC5UrUcP21RMrCQkGt9Tv3lyvz8U/vGx4wPPMrQVVeOEBN1Tn6/M4cj6+U2Kqe8DcDqNT 05Eb0v7rT3WX+tGIxc1sjNIWgN/CR3AOqitNBKL6yJ/Nnr/lVx8lz3DeTZaCKLVn/sKNlYNqmoWa RxyHFv45/oZvYA8L1mQgtd0rpZE2k1QB69OZnhXzGfrNY5YY46mzTz/M3dX+CCThpyU9911Z5CMd EOz0eWMZJgIhUn5/EjO2aVPgJ3zHyxqyHFpURGg54w== =BM6w -----END PGP SIGNATURE----- --NSOW9Ri3VPfy3up6qZQwXjwHxiszOoES5-- From owner-freebsd-net@freebsd.org Sun May 2 13:32:28 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id EA6906258E4 for ; Sun, 2 May 2021 13:32:28 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 4FY6V45WS4z4h6T for ; Sun, 2 May 2021 13:32:28 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id BD37B6259A8; Sun, 2 May 2021 13:32:28 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id BCF2E625962 for ; Sun, 2 May 2021 13:32:28 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4FY6V43PCyz4hJl for ; Sun, 2 May 2021 13:32:28 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 55055386D for ; Sun, 2 May 2021 13:32:28 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 142DWSVo051757 for ; Sun, 2 May 2021 13:32:28 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 142DWSG5051756 for net@FreeBSD.org; Sun, 2 May 2021 13:32:28 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 238411] igb(4): Wake on Lan not working with Intel I210 Date: Sun, 02 May 2021 13:32:26 +0000 X-Bugzilla-Reason: CC AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 12.0-RELEASE X-Bugzilla-Keywords: IntelNetworking, needs-qa, regression X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: kaho@elam.kais.kyoto-u.ac.jp X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: net@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: attachments.created Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 02 May 2021 13:32:29 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D238411 --- Comment #23 from Kaho Toshikazu --- Created attachment 224609 --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=3D224609&action= =3Dedit patch:force to enable wol (In reply to Abraham122x from comment #22) I'm sorry, you are right. Not all but some FreeBSD 11 igb driver can use wol despite from disabled wol at boot time. FreeBSD 11 em driver can not use wol if wol is disabled at boot time. The igb driver integrated to em driver at FreeBSD 12-current, and now FreeBSD 12/13 em driver has almost same defa= ult at FreeBSD 11. At only very short period, FreeBSD 12 integrated em driver could force to enable wol. If you would like to restore this function, please try the patch. --=20 You are receiving this mail because: You are on the CC list for the bug. You are the assignee for the bug.= From owner-freebsd-net@freebsd.org Sun May 2 13:48:39 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 06EDF62628B for ; Sun, 2 May 2021 13:48:39 +0000 (UTC) (envelope-from bu7cher@yandex.ru) Received: from forward100j.mail.yandex.net (forward100j.mail.yandex.net [IPv6:2a02:6b8:0:801:2::100]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4FY6rj68KTz4hfc for ; Sun, 2 May 2021 13:48:37 +0000 (UTC) (envelope-from bu7cher@yandex.ru) Received: from sas1-ad61ad785433.qloud-c.yandex.net (sas1-ad61ad785433.qloud-c.yandex.net [IPv6:2a02:6b8:c08:37a4:0:640:ad61:ad78]) by forward100j.mail.yandex.net (Yandex) with ESMTP id CF5EF50E05DA; Sun, 2 May 2021 16:48:33 +0300 (MSK) Received: from sas1-37da021029ee.qloud-c.yandex.net (sas1-37da021029ee.qloud-c.yandex.net [2a02:6b8:c08:1612:0:640:37da:210]) by sas1-ad61ad785433.qloud-c.yandex.net (mxback/Yandex) with ESMTP id y5J4orBbjN-mXHOTpjL; Sun, 02 May 2021 16:48:33 +0300 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yandex.ru; s=mail; t=1619963313; bh=UURLIV7aJt3SVfV+o8lBHmial3sB2rxNCtIpHgMggEA=; h=In-Reply-To:From:Date:References:To:Subject:Message-ID; b=fkSPqJQMTGkMDdoBuiZ7bjhwD2wJ/PrfWN/GQYcEp4NlVF8cu7g4lXFq6qrdINkIT kG18uDN3Qa8OvWI2o8xcSx6ZUe3XRhhIGxdpgfMs5qhoB3u8xbJg5IYcj3UEgEjqhR zQ0ddXngBeZ+xD1khEi8iaP65BquQFjt946mRgqM= Received: by sas1-37da021029ee.qloud-c.yandex.net (smtp/Yandex) with ESMTPSA id HxaAH0hE2Y-mXLOlZFR; Sun, 02 May 2021 16:48:33 +0300 (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) (Client certificate not present) Subject: Re: IPsec performace - netisr hits %100 To: =?UTF-8?Q?=c3=96zkan_KIRIK?= , FreeBSD Net References: From: "Andrey V. Elsukov" Message-ID: <6fb8384a-5fe6-9d59-6e35-09b72bd79c30@yandex.ru> Date: Sun, 2 May 2021 16:48:32 +0300 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:78.0) Gecko/20100101 Thunderbird/78.9.0 MIME-Version: 1.0 In-Reply-To: Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="55swJcWbEueFWtwL9iIn3zNBPatPykmix" X-Rspamd-Queue-Id: 4FY6rj68KTz4hfc X-Spamd-Bar: ------ Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yandex.ru header.s=mail header.b=fkSPqJQM; dmarc=pass (policy=none) header.from=yandex.ru; spf=pass (mx1.freebsd.org: domain of bu7cher@yandex.ru designates 2a02:6b8:0:801:2::100 as permitted sender) smtp.mailfrom=bu7cher@yandex.ru X-Spamd-Result: default: False [-6.10 / 15.00]; FREEMAIL_FROM(0.00)[yandex.ru]; R_SPF_ALLOW(-0.20)[+ip6:2a02:6b8:0::/52]; HAS_ATTACHMENT(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[yandex.ru:+]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[yandex.ru,none]; NEURAL_HAM_SHORT(-1.00)[-0.995]; SIGNED_PGP(-2.00)[]; FREEMAIL_TO(0.00)[gmail.com,freebsd.org]; RCVD_IN_DNSWL_LOW(-0.10)[2a02:6b8:0:801:2::100:from]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:+,3:~]; FREEMAIL_ENVFROM(0.00)[yandex.ru]; MID_RHS_MATCH_FROM(0.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[2a02:6b8:0:801:2::100:from]; ASN(0.00)[asn:13238, ipnet:2a02:6b8::/32, country:RU]; DWL_DNSWL_NONE(0.00)[yandex.ru:dkim]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[yandex.ru:s=mail]; FROM_EQ_ENVFROM(0.00)[]; FROM_HAS_DN(0.00)[]; NEURAL_HAM_MEDIUM(-0.90)[-0.903]; NEURAL_HAM_LONG(-1.00)[-1.000]; TAGGED_RCPT(0.00)[]; MIME_GOOD(-0.20)[multipart/signed,multipart/mixed,text/plain]; SPAMHAUS_ZRD(0.00)[2a02:6b8:0:801:2::100:from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; MAILMAN_DEST(0.00)[freebsd-net] X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 02 May 2021 13:48:39 -0000 This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --55swJcWbEueFWtwL9iIn3zNBPatPykmix Content-Type: multipart/mixed; boundary="Dmp2wHxJlcZPTXhJ2rsNwVvmgJIiDawK0"; protected-headers="v1" From: "Andrey V. Elsukov" To: =?UTF-8?Q?=c3=96zkan_KIRIK?= , FreeBSD Net Message-ID: <6fb8384a-5fe6-9d59-6e35-09b72bd79c30@yandex.ru> Subject: Re: IPsec performace - netisr hits %100 References: In-Reply-To: --Dmp2wHxJlcZPTXhJ2rsNwVvmgJIiDawK0 Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: quoted-printable 30.04.2021 23:11, =C3=96zkan KIRIK =D0=BF=D0=B8=D1=88=D0=B5=D1=82: > Hello, >=20 > I'm using FreeBSD stable/12 built world on 12 April 2021. > my setup is: > [freebsd host cc0] <--------> [cc1 - same freebsd, but jail] >=20 > without IPsec, I can achieve easily to 20Gbps. (test was run with diffe= rent > source IPs using multiple iperf to scale across multiple queues) > My hardware is Xeon D-2146NT (8 core + SoC Qat), cc0 and cc1 is Chelsio= > T62100-LP-CR. I suspect you are using 9k MTU on cc(4) interfaces. If you set bigger MTU on the if_ipsec(4) interfaces, this can increase throughput. --=20 WBR, Andrey V. Elsukov --Dmp2wHxJlcZPTXhJ2rsNwVvmgJIiDawK0-- --55swJcWbEueFWtwL9iIn3zNBPatPykmix Content-Type: application/pgp-signature; name="OpenPGP_signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="OpenPGP_signature" -----BEGIN PGP SIGNATURE----- wsB5BAABCAAjFiEE5lkeG0HaFRbwybwAAcXqBBDIoXoFAmCOrbAFAwAAAAAACgkQAcXqBBDIoXpg NwgAmm4QtsWn/gaHoFXmHA6SyJQjCnd7xtlMSzb4MEfiMLZS3HR6JJtX8GHMVqGnyfbens2H2ETc WW3QRVeHUIEs0cXlC+xkNWl/1IV4r0X8RribzbATVtYEM+hbMpFw77r3gGmz6jL1HljHIEbpCah8 E7QJy+GWkY5Fwc27+T6lHd97LFfsQYZvqe5QnBs0otlyVj5hLaVC1UWWIheQQcQq+3s+yqu5hKEd V7lLaNorwC36VzB1NWouS09DEchfvd5C35ou5l1f3UAak/vec0YgTDSeUsLRSCtbB0j/6M1leHNW ccvmxR4LZ4YVEoYzJ9uikvqEHpnxCuc5DODcCflkWw== =uCuc -----END PGP SIGNATURE----- --55swJcWbEueFWtwL9iIn3zNBPatPykmix-- From owner-freebsd-net@freebsd.org Sat May 1 20:58:02 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 9EFE463819F for ; Sat, 1 May 2021 20:58:02 +0000 (UTC) (envelope-from ozkan.kirik@gmail.com) Received: from mail-ua1-x936.google.com (mail-ua1-x936.google.com [IPv6:2607:f8b0:4864:20::936]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4FXhQd4zWQz4tCH; Sat, 1 May 2021 20:58:01 +0000 (UTC) (envelope-from ozkan.kirik@gmail.com) Received: by mail-ua1-x936.google.com with SMTP id n61so662398uan.2; Sat, 01 May 2021 13:58:01 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=cQDBOlfyzzcFwUaqfcErSSZ0AjAyVbFn0TUsf57VtZ0=; b=Agj1WDW+f2p0bBTSCKumdYShkN6ssMeFkhNbijCYKvtE4P72RQEnmwBcSBUtQJLr6R 07kwxZNRWIHsYdlQ5V0EibSOndAq1kN7U+yJvDUGzZDxkbbLR1XhzJNg/VkgbIIb/xS6 8ztpJHG49JTzcbD677v7w6SfagY9MboefnBwKAE/JRP5nGaZw+ETcCd8Cc8UdDNc8wzt EGowTUV6W2iWZdDiCUGEB3KOhWY9VHiDef4zPVf1wNfyIRZJBvhlDb6vehUWsz1U3EI7 NN2Etc321aYZdF2n4xCCfj5ijA+65p+z/PN7lGz2s0pKjzNOD8ceQR1b0npfGYPL4Doj 2cgQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=cQDBOlfyzzcFwUaqfcErSSZ0AjAyVbFn0TUsf57VtZ0=; b=HjiarW/gfY8W0CT3LV8ORP9+q30MThoBYIRO6ap3QbOyE5AcAJpbiLGL0iuRq502UA tAR6vHUPmTIxC3jkfZDNTDbQhtS73ubhFASPLvGmETIDkSd4nw78VXxCw9YumPPiVCiP BfmXukvYsDyzmS8Y05ICEcJ7hftBy2O22Q+/RXVRfbpAUhpO2J81yrwFJAA/sRTlTkdQ OMuPWVn6Zy/lKCoTl5AHhhXZRepDTN4NJpeN+c9YYdun0e6GjIQk4pGAYi2GMSdUMxQ2 zCx78w+LtkgTpqx4XTjfgKeEuFVWBxASZxD2cMEwesNBhZTZo1fXP0iUKs4jxVQP4l22 ajRQ== X-Gm-Message-State: AOAM531qmZAqd7h/IXCRx3i1WGtYekg23lnmZjrqx/+JJidKvJYKNwBd ocI0bGVEcnSzxUyk/FAtiyEUpgKpuJ4ReJ00AIo2ACLkbrE= X-Google-Smtp-Source: ABdhPJz2n+xljuw/0SG06cBOQ/cNx5iFCGpsiFrU3E3yg06HpMhVXRZXee0HyyAdGRdVbfgvQlC5d9TXKr1Yw3h86js= X-Received: by 2002:ab0:664f:: with SMTP id b15mr10595180uaq.110.1619902679490; Sat, 01 May 2021 13:57:59 -0700 (PDT) MIME-Version: 1.0 References: In-Reply-To: From: =?UTF-8?B?w5Z6a2FuIEtJUklL?= Date: Sat, 1 May 2021 23:57:48 +0300 Message-ID: Subject: Re: IPsec performace - netisr hits %100 To: Mark Johnston Cc: FreeBSD Net Content-Type: multipart/mixed; boundary="000000000000c880c605c14afbd0" X-Rspamd-Queue-Id: 4FXhQd4zWQz4tCH X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=Agj1WDW+; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of ozkankirik@gmail.com designates 2607:f8b0:4864:20::936 as permitted sender) smtp.mailfrom=ozkankirik@gmail.com X-Spamd-Result: default: False [-2.25 / 15.00]; FREEMAIL_FROM(0.00)[gmail.com]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; HAS_ATTACHMENT(0.00)[]; MIME_BASE64_TEXT_BOGUS(1.00)[]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; MIME_BASE64_TEXT(0.10)[]; RCPT_COUNT_TWO(0.00)[2]; NEURAL_HAM_SHORT(-0.98)[-0.975]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:+,3:~,4:+,5:+]; R_MIXED_CHARSET(0.62)[subject]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; TAGGED_FROM(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; ARC_NA(0.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[2607:f8b0:4864:20::936:from]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[multipart/mixed,multipart/alternative,text/plain,image/svg+xml]; SPAMHAUS_ZRD(0.00)[2607:f8b0:4864:20::936:from:127.0.2.255]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::936:from]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-net] X-Mailman-Approved-At: Sun, 02 May 2021 16:12:21 +0000 X-Content-Filtered-By: Mailman/MimeDel 2.1.34 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 01 May 2021 20:58:02 -0000 --000000000000c880c605c14afbd0 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Hello, The flamegraph is attached. # netstat -s ... ipsec: 0 inbound packets violated process security policy 0 inbound packets failed due to insufficient memory 0 invalid inbound packets 0 outbound packets violated process security policy 0 outbound packets with no SA available 0 outbound packets failed due to insufficient memory 0 outbound packets with no route available 0 invalid outbound packets 0 outbound packets with bundled SAs 0 spd cache hits 0 spd cache misses 0 clusters copied during clone 0 mbufs inserted during makespace ah: 0 packets shorter than header shows 0 packets dropped; protocol family not supported 0 packets dropped; no TDB 0 packets dropped; bad KCR 0 packets dropped; queue full 0 packets dropped; no transform 0 replay counter wraps 0 packets dropped; bad authentication detected 0 packets dropped; bad authentication length 0 possible replay packets detected 0 packets in 0 packets out 0 packets dropped; invalid TDB 0 bytes in 0 bytes out 0 packets dropped; larger than IP_MAXPACKET 0 packets blocked due to policy 0 crypto processing failures 0 tunnel sanity check failures AH output histogram: aes-gmac-128: 35517864 esp: 0 packets shorter than header shows 0 packets dropped; protocol family not supported 0 packets dropped; no TDB 0 packets dropped; bad KCR 0 packets dropped; queue full 20 packets dropped; no transform 0 packets dropped; bad ilen 0 replay counter wraps 0 packets dropped; bad encryption detected 0 packets dropped; bad authentication detected 0 possible replay packets detected 23598941 packets in 11918943 packets out 0 packets dropped; invalid TDB 32247932688 bytes in 630318292 bytes out 0 packets dropped; larger than IP_MAXPACKET 0 packets blocked due to policy 0 crypto processing failures 0 tunnel sanity check failures ESP output histogram: aes-gcm-16: 35517864 dev.qat.1.stats.sym_alloc_failures: 0 dev.qat.1.stats.ring_full: 1267 dev.qat.1.stats.gcm_aad_updates: 0 dev.qat.1.stats.gcm_aad_restarts: 0 dev.qat.1.%domain: 0 dev.qat.1.%parent: pci16 dev.qat.1.%pnpinfo: vendor=3D0x8086 device=3D0x37c8 subvendor=3D0x8086 subdevice=3D0x0000 class=3D0x0b4000 dev.qat.1.%location: slot=3D0 function=3D0 dbsf=3Dpci0:182:0:0 dev.qat.1.%driver: qat dev.qat.1.%desc: Intel C620/Xeon D-2100 QuickAssist PF dev.qat.0.stats.sym_alloc_failures: 0 dev.qat.0.stats.ring_full: 0 dev.qat.0.stats.gcm_aad_updates: 0 dev.qat.0.stats.gcm_aad_restarts: 0 dev.qat.0.%domain: 0 dev.qat.0.%parent: pci15 dev.qat.0.%pnpinfo: vendor=3D0x8086 device=3D0x37c8 subvendor=3D0x8086 subdevice=3D0x0000 class=3D0x0b4000 dev.qat.0.%location: slot=3D0 function=3D0 dbsf=3Dpci0:181:0:0 dev.qat.0.%driver: qat dev.qat.0.%desc: Intel C620/Xeon D-2100 QuickAssist PF dev.qat.%parent: On Sat, May 1, 2021 at 5:51 PM Mark Johnston wrote: > On Sat, May 01, 2021 at 04:30:59PM +0300, =C3=96zkan KIRIK wrote: > > This bug is related to CCR. @Navdeep Parhar , @John > Baldwin > > if you are interested to fix this bug related with > CCR, I > > can test if you provide patches. Test environment is explained in my > first > > email on this thread. > > > > @Mark Johnston Now again on stable/13, > > - with aesni, without netipsec/ipsec_input.c patch - 1.44Gbps - single > > netisr thread eats %100 cpu > > - with qat, without netipsec/ipsec_input.c patch - 1.88Gbps - single > netisr > > thread eats %100 cpu > > - with aesni, with netipsec/ipsec_input.c patch - 1.33Gbps > > - with qat, with netipsec/ipsec_input.c patch - 2.85Gbps - > > > > stable/13 results are better then stable/12 but not enough fast. There = is > > something makes bottleneck for IPsec. > > So with these results it looks like we have 4 crypto threads running, > which is what I'd expect for two pairs of IP addresses. There is still > a single-threaded bottleneck. I would suggest generating a flame graph > using DTrace and https://github.com/brendangregg/FlameGraph to see where > we're spending CPU time. It would also be useful to know if we're > getting errors or drops anywhere. The QAT (sysctl dev.qat.*.stats) and > ESP/AH (netstat -s -p (esp|ah)) counters would be a useful start, in > addition to counters from cxgbe. > --000000000000c880c605c14afbd0 Content-Type: text/plain; charset="US-ASCII"; name="dev.cc.txt" Content-Disposition: attachment; filename="dev.cc.txt" Content-Transfer-Encoding: base64 Content-ID: X-Attachment-Id: f_ko67xm3e1 ZGV2LmNjLjEub2ZsZF90eHEuNy50eF90b2VfdGxzX29jdGV0czogMApkZXYuY2MuMS5vZmxkX3R4 cS43LnR4X3RvZV90bHNfcmVjb3JkczogMApkZXYuY2MuMS5vZmxkX3R4cS43LnR4X2lzY3NpX29j dGV0czogMApkZXYuY2MuMS5vZmxkX3R4cS43LnR4X2lzY3NpX3BkdXM6IDAKZGV2LmNjLjEub2Zs ZF90eHEuNy50eF93cnNfc3NwYWNlOiAwCmRldi5jYy4xLm9mbGRfdHhxLjcudHhfd3JzX2NvcGll ZDogMApkZXYuY2MuMS5vZmxkX3R4cS43LnR4X3dyc19kaXJlY3Q6IDAKZGV2LmNjLjEub2ZsZF90 eHEuNy5zaWR4OiAxMDIzCmRldi5jYy4xLm9mbGRfdHhxLjcucGlkeDogMApkZXYuY2MuMS5vZmxk X3R4cS43LmNpZHg6IDAKZGV2LmNjLjEub2ZsZF90eHEuNy5jbnR4dF9pZDogODUKZGV2LmNjLjEu b2ZsZF90eHEuNy5kbWFsZW46IDY1NTM2CmRldi5jYy4xLm9mbGRfdHhxLjcuYmE6IDI1MTUwODgx NzkyCmRldi5jYy4xLm9mbGRfdHhxLjYudHhfdG9lX3Rsc19vY3RldHM6IDAKZGV2LmNjLjEub2Zs ZF90eHEuNi50eF90b2VfdGxzX3JlY29yZHM6IDAKZGV2LmNjLjEub2ZsZF90eHEuNi50eF9pc2Nz aV9vY3RldHM6IDAKZGV2LmNjLjEub2ZsZF90eHEuNi50eF9pc2NzaV9wZHVzOiAwCmRldi5jYy4x Lm9mbGRfdHhxLjYudHhfd3JzX3NzcGFjZTogMApkZXYuY2MuMS5vZmxkX3R4cS42LnR4X3dyc19j b3BpZWQ6IDAKZGV2LmNjLjEub2ZsZF90eHEuNi50eF93cnNfZGlyZWN0OiAwCmRldi5jYy4xLm9m bGRfdHhxLjYuc2lkeDogMTAyMwpkZXYuY2MuMS5vZmxkX3R4cS42LnBpZHg6IDAKZGV2LmNjLjEu b2ZsZF90eHEuNi5jaWR4OiAwCmRldi5jYy4xLm9mbGRfdHhxLjYuY250eHRfaWQ6IDg0CmRldi5j Yy4xLm9mbGRfdHhxLjYuZG1hbGVuOiA2NTUzNgpkZXYuY2MuMS5vZmxkX3R4cS42LmJhOiAyNTE1 MDgxNjI1NgpkZXYuY2MuMS5vZmxkX3R4cS41LnR4X3RvZV90bHNfb2N0ZXRzOiAwCmRldi5jYy4x Lm9mbGRfdHhxLjUudHhfdG9lX3Rsc19yZWNvcmRzOiAwCmRldi5jYy4xLm9mbGRfdHhxLjUudHhf aXNjc2lfb2N0ZXRzOiAwCmRldi5jYy4xLm9mbGRfdHhxLjUudHhfaXNjc2lfcGR1czogMApkZXYu Y2MuMS5vZmxkX3R4cS41LnR4X3dyc19zc3BhY2U6IDAKZGV2LmNjLjEub2ZsZF90eHEuNS50eF93 cnNfY29waWVkOiAwCmRldi5jYy4xLm9mbGRfdHhxLjUudHhfd3JzX2RpcmVjdDogMApkZXYuY2Mu MS5vZmxkX3R4cS41LnNpZHg6IDEwMjMKZGV2LmNjLjEub2ZsZF90eHEuNS5waWR4OiAwCmRldi5j Yy4xLm9mbGRfdHhxLjUuY2lkeDogMApkZXYuY2MuMS5vZmxkX3R4cS41LmNudHh0X2lkOiA4Mwpk ZXYuY2MuMS5vZmxkX3R4cS41LmRtYWxlbjogNjU1MzYKZGV2LmNjLjEub2ZsZF90eHEuNS5iYTog MjUxNTA3NTA3MjAKZGV2LmNjLjEub2ZsZF90eHEuNC50eF90b2VfdGxzX29jdGV0czogMApkZXYu Y2MuMS5vZmxkX3R4cS40LnR4X3RvZV90bHNfcmVjb3JkczogMApkZXYuY2MuMS5vZmxkX3R4cS40 LnR4X2lzY3NpX29jdGV0czogMApkZXYuY2MuMS5vZmxkX3R4cS40LnR4X2lzY3NpX3BkdXM6IDAK ZGV2LmNjLjEub2ZsZF90eHEuNC50eF93cnNfc3NwYWNlOiAwCmRldi5jYy4xLm9mbGRfdHhxLjQu dHhfd3JzX2NvcGllZDogMApkZXYuY2MuMS5vZmxkX3R4cS40LnR4X3dyc19kaXJlY3Q6IDAKZGV2 LmNjLjEub2ZsZF90eHEuNC5zaWR4OiAxMDIzCmRldi5jYy4xLm9mbGRfdHhxLjQucGlkeDogMApk ZXYuY2MuMS5vZmxkX3R4cS40LmNpZHg6IDAKZGV2LmNjLjEub2ZsZF90eHEuNC5jbnR4dF9pZDog ODIKZGV2LmNjLjEub2ZsZF90eHEuNC5kbWFsZW46IDY1NTM2CmRldi5jYy4xLm9mbGRfdHhxLjQu YmE6IDI1MTUwNjg1MTg0CmRldi5jYy4xLm9mbGRfdHhxLjMudHhfdG9lX3Rsc19vY3RldHM6IDAK ZGV2LmNjLjEub2ZsZF90eHEuMy50eF90b2VfdGxzX3JlY29yZHM6IDAKZGV2LmNjLjEub2ZsZF90 eHEuMy50eF9pc2NzaV9vY3RldHM6IDAKZGV2LmNjLjEub2ZsZF90eHEuMy50eF9pc2NzaV9wZHVz OiAwCmRldi5jYy4xLm9mbGRfdHhxLjMudHhfd3JzX3NzcGFjZTogMApkZXYuY2MuMS5vZmxkX3R4 cS4zLnR4X3dyc19jb3BpZWQ6IDAKZGV2LmNjLjEub2ZsZF90eHEuMy50eF93cnNfZGlyZWN0OiAw CmRldi5jYy4xLm9mbGRfdHhxLjMuc2lkeDogMTAyMwpkZXYuY2MuMS5vZmxkX3R4cS4zLnBpZHg6 IDAKZGV2LmNjLjEub2ZsZF90eHEuMy5jaWR4OiAwCmRldi5jYy4xLm9mbGRfdHhxLjMuY250eHRf aWQ6IDgxCmRldi5jYy4xLm9mbGRfdHhxLjMuZG1hbGVuOiA2NTUzNgpkZXYuY2MuMS5vZmxkX3R4 cS4zLmJhOiAyNTE1MDYxOTY0OApkZXYuY2MuMS5vZmxkX3R4cS4yLnR4X3RvZV90bHNfb2N0ZXRz OiAwCmRldi5jYy4xLm9mbGRfdHhxLjIudHhfdG9lX3Rsc19yZWNvcmRzOiAwCmRldi5jYy4xLm9m bGRfdHhxLjIudHhfaXNjc2lfb2N0ZXRzOiAwCmRldi5jYy4xLm9mbGRfdHhxLjIudHhfaXNjc2lf cGR1czogMApkZXYuY2MuMS5vZmxkX3R4cS4yLnR4X3dyc19zc3BhY2U6IDAKZGV2LmNjLjEub2Zs ZF90eHEuMi50eF93cnNfY29waWVkOiAwCmRldi5jYy4xLm9mbGRfdHhxLjIudHhfd3JzX2RpcmVj dDogMApkZXYuY2MuMS5vZmxkX3R4cS4yLnNpZHg6IDEwMjMKZGV2LmNjLjEub2ZsZF90eHEuMi5w aWR4OiAwCmRldi5jYy4xLm9mbGRfdHhxLjIuY2lkeDogMApkZXYuY2MuMS5vZmxkX3R4cS4yLmNu dHh0X2lkOiA4MApkZXYuY2MuMS5vZmxkX3R4cS4yLmRtYWxlbjogNjU1MzYKZGV2LmNjLjEub2Zs ZF90eHEuMi5iYTogMjUxNDc5MzI2NzIKZGV2LmNjLjEub2ZsZF90eHEuMS50eF90b2VfdGxzX29j dGV0czogMApkZXYuY2MuMS5vZmxkX3R4cS4xLnR4X3RvZV90bHNfcmVjb3JkczogMApkZXYuY2Mu MS5vZmxkX3R4cS4xLnR4X2lzY3NpX29jdGV0czogMApkZXYuY2MuMS5vZmxkX3R4cS4xLnR4X2lz Y3NpX3BkdXM6IDAKZGV2LmNjLjEub2ZsZF90eHEuMS50eF93cnNfc3NwYWNlOiAwCmRldi5jYy4x Lm9mbGRfdHhxLjEudHhfd3JzX2NvcGllZDogMApkZXYuY2MuMS5vZmxkX3R4cS4xLnR4X3dyc19k aXJlY3Q6IDAKZGV2LmNjLjEub2ZsZF90eHEuMS5zaWR4OiAxMDIzCmRldi5jYy4xLm9mbGRfdHhx LjEucGlkeDogMApkZXYuY2MuMS5vZmxkX3R4cS4xLmNpZHg6IDAKZGV2LmNjLjEub2ZsZF90eHEu MS5jbnR4dF9pZDogNzkKZGV2LmNjLjEub2ZsZF90eHEuMS5kbWFsZW46IDY1NTM2CmRldi5jYy4x Lm9mbGRfdHhxLjEuYmE6IDI1MTQ3ODY3MTM2CmRldi5jYy4xLm9mbGRfdHhxLjAudHhfdG9lX3Rs c19vY3RldHM6IDAKZGV2LmNjLjEub2ZsZF90eHEuMC50eF90b2VfdGxzX3JlY29yZHM6IDAKZGV2 LmNjLjEub2ZsZF90eHEuMC50eF9pc2NzaV9vY3RldHM6IDAKZGV2LmNjLjEub2ZsZF90eHEuMC50 eF9pc2NzaV9wZHVzOiAwCmRldi5jYy4xLm9mbGRfdHhxLjAudHhfd3JzX3NzcGFjZTogMApkZXYu Y2MuMS5vZmxkX3R4cS4wLnR4X3dyc19jb3BpZWQ6IDAKZGV2LmNjLjEub2ZsZF90eHEuMC50eF93 cnNfZGlyZWN0OiAwCmRldi5jYy4xLm9mbGRfdHhxLjAuc2lkeDogMTAyMwpkZXYuY2MuMS5vZmxk X3R4cS4wLnBpZHg6IDAKZGV2LmNjLjEub2ZsZF90eHEuMC5jaWR4OiAwCmRldi5jYy4xLm9mbGRf dHhxLjAuY250eHRfaWQ6IDc4CmRldi5jYy4xLm9mbGRfdHhxLjAuZG1hbGVuOiA2NTUzNgpkZXYu Y2MuMS5vZmxkX3R4cS4wLmJhOiAyNTE0NzgwMTYwMApkZXYuY2MuMS50eHEuMTUubXBfcmluZy5j b25zX2lkbGUyOiAwCmRldi5jYy4xLnR4cS4xNS5tcF9yaW5nLmNvbnNfaWRsZTogMApkZXYuY2Mu MS50eHEuMTUubXBfcmluZy5zdGFsbHM6IDAKZGV2LmNjLjEudHhxLjE1Lm1wX3JpbmcuYWJkaWNh dGlvbnM6IDAKZGV2LmNjLjEudHhxLjE1Lm1wX3Jpbmcubm90X2NvbnN1bWVyOiAwCmRldi5jYy4x LnR4cS4xNS5tcF9yaW5nLnRha2VvdmVyczogMApkZXYuY2MuMS50eHEuMTUubXBfcmluZy5jb25z dW1lcjM6IDAKZGV2LmNjLjEudHhxLjE1Lm1wX3JpbmcuY29uc3VtZXIyOiAwCmRldi5jYy4xLnR4 cS4xNS5tcF9yaW5nLmZhc3RfY29uc3VtZXI6IDAKZGV2LmNjLjEudHhxLjE1Lm1wX3JpbmcuY29u c3VtZWQ6IDAKZGV2LmNjLjEudHhxLjE1Lm1wX3JpbmcuZHJvcHBlZDogMApkZXYuY2MuMS50eHEu MTUubXBfcmluZy5zdGF0ZTogMApkZXYuY2MuMS50eHEuMTUudnhsYW5fdHhjc3VtOiAwCmRldi5j Yy4xLnR4cS4xNS52eGxhbl90c29fd3JzOiAwCmRldi5jYy4xLnR4cS4xNS5yYXdfd3JzOiAwCmRl di5jYy4xLnR4cS4xNS50eHBrdHNfZmx1c2g6IDAKZGV2LmNjLjEudHhxLjE1LnR4cGt0czFfcGt0 czogMApkZXYuY2MuMS50eHEuMTUudHhwa3RzMF9wa3RzOiAwCmRldi5jYy4xLnR4cS4xNS50eHBr dHMxX3dyczogMApkZXYuY2MuMS50eHEuMTUudHhwa3RzMF93cnM6IDAKZGV2LmNjLjEudHhxLjE1 LnR4cGt0X3dyczogMApkZXYuY2MuMS50eHEuMTUuc2dsX3dyczogMApkZXYuY2MuMS50eHEuMTUu aW1tX3dyczogMApkZXYuY2MuMS50eHEuMTUudHNvX3dyczogMApkZXYuY2MuMS50eHEuMTUudmxh bl9pbnNlcnRpb246IDAKZGV2LmNjLjEudHhxLjE1LnR4Y3N1bTogMApkZXYuY2MuMS50eHEuMTUu dGM6IC0xCmRldi5jYy4xLnR4cS4xNS5zaWR4OiAxMDIzCmRldi5jYy4xLnR4cS4xNS5waWR4OiAw CmRldi5jYy4xLnR4cS4xNS5jaWR4OiAwCmRldi5jYy4xLnR4cS4xNS5jbnR4dF9pZDogNzcKZGV2 LmNjLjEudHhxLjE1LmFic19pZDogNzcKZGV2LmNjLjEudHhxLjE1LmRtYWxlbjogNjU1MzYKZGV2 LmNjLjEudHhxLjE1LmJhOiAyNTE0NzczNjA2NApkZXYuY2MuMS50eHEuMTQubXBfcmluZy5jb25z X2lkbGUyOiAwCmRldi5jYy4xLnR4cS4xNC5tcF9yaW5nLmNvbnNfaWRsZTogMApkZXYuY2MuMS50 eHEuMTQubXBfcmluZy5zdGFsbHM6IDAKZGV2LmNjLjEudHhxLjE0Lm1wX3JpbmcuYWJkaWNhdGlv bnM6IDAKZGV2LmNjLjEudHhxLjE0Lm1wX3Jpbmcubm90X2NvbnN1bWVyOiAwCmRldi5jYy4xLnR4 cS4xNC5tcF9yaW5nLnRha2VvdmVyczogMApkZXYuY2MuMS50eHEuMTQubXBfcmluZy5jb25zdW1l cjM6IDAKZGV2LmNjLjEudHhxLjE0Lm1wX3JpbmcuY29uc3VtZXIyOiAwCmRldi5jYy4xLnR4cS4x NC5tcF9yaW5nLmZhc3RfY29uc3VtZXI6IDAKZGV2LmNjLjEudHhxLjE0Lm1wX3JpbmcuY29uc3Vt ZWQ6IDAKZGV2LmNjLjEudHhxLjE0Lm1wX3JpbmcuZHJvcHBlZDogMApkZXYuY2MuMS50eHEuMTQu bXBfcmluZy5zdGF0ZTogMApkZXYuY2MuMS50eHEuMTQudnhsYW5fdHhjc3VtOiAwCmRldi5jYy4x LnR4cS4xNC52eGxhbl90c29fd3JzOiAwCmRldi5jYy4xLnR4cS4xNC5yYXdfd3JzOiAwCmRldi5j Yy4xLnR4cS4xNC50eHBrdHNfZmx1c2g6IDAKZGV2LmNjLjEudHhxLjE0LnR4cGt0czFfcGt0czog MApkZXYuY2MuMS50eHEuMTQudHhwa3RzMF9wa3RzOiAwCmRldi5jYy4xLnR4cS4xNC50eHBrdHMx X3dyczogMApkZXYuY2MuMS50eHEuMTQudHhwa3RzMF93cnM6IDAKZGV2LmNjLjEudHhxLjE0LnR4 cGt0X3dyczogMApkZXYuY2MuMS50eHEuMTQuc2dsX3dyczogMApkZXYuY2MuMS50eHEuMTQuaW1t X3dyczogMApkZXYuY2MuMS50eHEuMTQudHNvX3dyczogMApkZXYuY2MuMS50eHEuMTQudmxhbl9p bnNlcnRpb246IDAKZGV2LmNjLjEudHhxLjE0LnR4Y3N1bTogMApkZXYuY2MuMS50eHEuMTQudGM6 IC0xCmRldi5jYy4xLnR4cS4xNC5zaWR4OiAxMDIzCmRldi5jYy4xLnR4cS4xNC5waWR4OiAwCmRl di5jYy4xLnR4cS4xNC5jaWR4OiAwCmRldi5jYy4xLnR4cS4xNC5jbnR4dF9pZDogNzYKZGV2LmNj LjEudHhxLjE0LmFic19pZDogNzYKZGV2LmNjLjEudHhxLjE0LmRtYWxlbjogNjU1MzYKZGV2LmNj LjEudHhxLjE0LmJhOiAyNTE0NzY3MDUyOApkZXYuY2MuMS50eHEuMTMubXBfcmluZy5jb25zX2lk bGUyOiAwCmRldi5jYy4xLnR4cS4xMy5tcF9yaW5nLmNvbnNfaWRsZTogMApkZXYuY2MuMS50eHEu MTMubXBfcmluZy5zdGFsbHM6IDAKZGV2LmNjLjEudHhxLjEzLm1wX3JpbmcuYWJkaWNhdGlvbnM6 IDAKZGV2LmNjLjEudHhxLjEzLm1wX3Jpbmcubm90X2NvbnN1bWVyOiAwCmRldi5jYy4xLnR4cS4x My5tcF9yaW5nLnRha2VvdmVyczogMApkZXYuY2MuMS50eHEuMTMubXBfcmluZy5jb25zdW1lcjM6 IDAKZGV2LmNjLjEudHhxLjEzLm1wX3JpbmcuY29uc3VtZXIyOiAwCmRldi5jYy4xLnR4cS4xMy5t cF9yaW5nLmZhc3RfY29uc3VtZXI6IDAKZGV2LmNjLjEudHhxLjEzLm1wX3JpbmcuY29uc3VtZWQ6 IDAKZGV2LmNjLjEudHhxLjEzLm1wX3JpbmcuZHJvcHBlZDogMApkZXYuY2MuMS50eHEuMTMubXBf cmluZy5zdGF0ZTogMApkZXYuY2MuMS50eHEuMTMudnhsYW5fdHhjc3VtOiAwCmRldi5jYy4xLnR4 cS4xMy52eGxhbl90c29fd3JzOiAwCmRldi5jYy4xLnR4cS4xMy5yYXdfd3JzOiAwCmRldi5jYy4x LnR4cS4xMy50eHBrdHNfZmx1c2g6IDAKZGV2LmNjLjEudHhxLjEzLnR4cGt0czFfcGt0czogMApk ZXYuY2MuMS50eHEuMTMudHhwa3RzMF9wa3RzOiAwCmRldi5jYy4xLnR4cS4xMy50eHBrdHMxX3dy czogMApkZXYuY2MuMS50eHEuMTMudHhwa3RzMF93cnM6IDAKZGV2LmNjLjEudHhxLjEzLnR4cGt0 X3dyczogMApkZXYuY2MuMS50eHEuMTMuc2dsX3dyczogMApkZXYuY2MuMS50eHEuMTMuaW1tX3dy czogMApkZXYuY2MuMS50eHEuMTMudHNvX3dyczogMApkZXYuY2MuMS50eHEuMTMudmxhbl9pbnNl cnRpb246IDAKZGV2LmNjLjEudHhxLjEzLnR4Y3N1bTogMApkZXYuY2MuMS50eHEuMTMudGM6IC0x CmRldi5jYy4xLnR4cS4xMy5zaWR4OiAxMDIzCmRldi5jYy4xLnR4cS4xMy5waWR4OiAwCmRldi5j Yy4xLnR4cS4xMy5jaWR4OiAwCmRldi5jYy4xLnR4cS4xMy5jbnR4dF9pZDogNzUKZGV2LmNjLjEu dHhxLjEzLmFic19pZDogNzUKZGV2LmNjLjEudHhxLjEzLmRtYWxlbjogNjU1MzYKZGV2LmNjLjEu dHhxLjEzLmJhOiAyNTE0NzYwNDk5MgpkZXYuY2MuMS50eHEuMTIubXBfcmluZy5jb25zX2lkbGUy OiAwCmRldi5jYy4xLnR4cS4xMi5tcF9yaW5nLmNvbnNfaWRsZTogMApkZXYuY2MuMS50eHEuMTIu bXBfcmluZy5zdGFsbHM6IDAKZGV2LmNjLjEudHhxLjEyLm1wX3JpbmcuYWJkaWNhdGlvbnM6IDAK ZGV2LmNjLjEudHhxLjEyLm1wX3Jpbmcubm90X2NvbnN1bWVyOiAwCmRldi5jYy4xLnR4cS4xMi5t cF9yaW5nLnRha2VvdmVyczogMApkZXYuY2MuMS50eHEuMTIubXBfcmluZy5jb25zdW1lcjM6IDAK ZGV2LmNjLjEudHhxLjEyLm1wX3JpbmcuY29uc3VtZXIyOiAwCmRldi5jYy4xLnR4cS4xMi5tcF9y aW5nLmZhc3RfY29uc3VtZXI6IDAKZGV2LmNjLjEudHhxLjEyLm1wX3JpbmcuY29uc3VtZWQ6IDAK ZGV2LmNjLjEudHhxLjEyLm1wX3JpbmcuZHJvcHBlZDogMApkZXYuY2MuMS50eHEuMTIubXBfcmlu Zy5zdGF0ZTogMApkZXYuY2MuMS50eHEuMTIudnhsYW5fdHhjc3VtOiAwCmRldi5jYy4xLnR4cS4x Mi52eGxhbl90c29fd3JzOiAwCmRldi5jYy4xLnR4cS4xMi5yYXdfd3JzOiAwCmRldi5jYy4xLnR4 cS4xMi50eHBrdHNfZmx1c2g6IDAKZGV2LmNjLjEudHhxLjEyLnR4cGt0czFfcGt0czogMApkZXYu Y2MuMS50eHEuMTIudHhwa3RzMF9wa3RzOiAwCmRldi5jYy4xLnR4cS4xMi50eHBrdHMxX3dyczog MApkZXYuY2MuMS50eHEuMTIudHhwa3RzMF93cnM6IDAKZGV2LmNjLjEudHhxLjEyLnR4cGt0X3dy czogMApkZXYuY2MuMS50eHEuMTIuc2dsX3dyczogMApkZXYuY2MuMS50eHEuMTIuaW1tX3dyczog MApkZXYuY2MuMS50eHEuMTIudHNvX3dyczogMApkZXYuY2MuMS50eHEuMTIudmxhbl9pbnNlcnRp b246IDAKZGV2LmNjLjEudHhxLjEyLnR4Y3N1bTogMApkZXYuY2MuMS50eHEuMTIudGM6IC0xCmRl di5jYy4xLnR4cS4xMi5zaWR4OiAxMDIzCmRldi5jYy4xLnR4cS4xMi5waWR4OiAwCmRldi5jYy4x LnR4cS4xMi5jaWR4OiAwCmRldi5jYy4xLnR4cS4xMi5jbnR4dF9pZDogNzQKZGV2LmNjLjEudHhx LjEyLmFic19pZDogNzQKZGV2LmNjLjEudHhxLjEyLmRtYWxlbjogNjU1MzYKZGV2LmNjLjEudHhx LjEyLmJhOiAyNTE0NzUzOTQ1NgpkZXYuY2MuMS50eHEuMTEubXBfcmluZy5jb25zX2lkbGUyOiAw CmRldi5jYy4xLnR4cS4xMS5tcF9yaW5nLmNvbnNfaWRsZTogMApkZXYuY2MuMS50eHEuMTEubXBf cmluZy5zdGFsbHM6IDAKZGV2LmNjLjEudHhxLjExLm1wX3JpbmcuYWJkaWNhdGlvbnM6IDAKZGV2 LmNjLjEudHhxLjExLm1wX3Jpbmcubm90X2NvbnN1bWVyOiAwCmRldi5jYy4xLnR4cS4xMS5tcF9y aW5nLnRha2VvdmVyczogMApkZXYuY2MuMS50eHEuMTEubXBfcmluZy5jb25zdW1lcjM6IDAKZGV2 LmNjLjEudHhxLjExLm1wX3JpbmcuY29uc3VtZXIyOiAwCmRldi5jYy4xLnR4cS4xMS5tcF9yaW5n LmZhc3RfY29uc3VtZXI6IDAKZGV2LmNjLjEudHhxLjExLm1wX3JpbmcuY29uc3VtZWQ6IDAKZGV2 LmNjLjEudHhxLjExLm1wX3JpbmcuZHJvcHBlZDogMApkZXYuY2MuMS50eHEuMTEubXBfcmluZy5z dGF0ZTogMApkZXYuY2MuMS50eHEuMTEudnhsYW5fdHhjc3VtOiAwCmRldi5jYy4xLnR4cS4xMS52 eGxhbl90c29fd3JzOiAwCmRldi5jYy4xLnR4cS4xMS5yYXdfd3JzOiAwCmRldi5jYy4xLnR4cS4x MS50eHBrdHNfZmx1c2g6IDAKZGV2LmNjLjEudHhxLjExLnR4cGt0czFfcGt0czogMApkZXYuY2Mu MS50eHEuMTEudHhwa3RzMF9wa3RzOiAwCmRldi5jYy4xLnR4cS4xMS50eHBrdHMxX3dyczogMApk ZXYuY2MuMS50eHEuMTEudHhwa3RzMF93cnM6IDAKZGV2LmNjLjEudHhxLjExLnR4cGt0X3dyczog MApkZXYuY2MuMS50eHEuMTEuc2dsX3dyczogMApkZXYuY2MuMS50eHEuMTEuaW1tX3dyczogMApk ZXYuY2MuMS50eHEuMTEudHNvX3dyczogMApkZXYuY2MuMS50eHEuMTEudmxhbl9pbnNlcnRpb246 IDAKZGV2LmNjLjEudHhxLjExLnR4Y3N1bTogMApkZXYuY2MuMS50eHEuMTEudGM6IC0xCmRldi5j Yy4xLnR4cS4xMS5zaWR4OiAxMDIzCmRldi5jYy4xLnR4cS4xMS5waWR4OiAwCmRldi5jYy4xLnR4 cS4xMS5jaWR4OiAwCmRldi5jYy4xLnR4cS4xMS5jbnR4dF9pZDogNzMKZGV2LmNjLjEudHhxLjEx LmFic19pZDogNzMKZGV2LmNjLjEudHhxLjExLmRtYWxlbjogNjU1MzYKZGV2LmNjLjEudHhxLjEx LmJhOiAyNTE0NzQ3MzkyMApkZXYuY2MuMS50eHEuMTAubXBfcmluZy5jb25zX2lkbGUyOiAwCmRl di5jYy4xLnR4cS4xMC5tcF9yaW5nLmNvbnNfaWRsZTogMApkZXYuY2MuMS50eHEuMTAubXBfcmlu Zy5zdGFsbHM6IDAKZGV2LmNjLjEudHhxLjEwLm1wX3JpbmcuYWJkaWNhdGlvbnM6IDAKZGV2LmNj LjEudHhxLjEwLm1wX3Jpbmcubm90X2NvbnN1bWVyOiAwCmRldi5jYy4xLnR4cS4xMC5tcF9yaW5n LnRha2VvdmVyczogMApkZXYuY2MuMS50eHEuMTAubXBfcmluZy5jb25zdW1lcjM6IDAKZGV2LmNj LjEudHhxLjEwLm1wX3JpbmcuY29uc3VtZXIyOiAwCmRldi5jYy4xLnR4cS4xMC5tcF9yaW5nLmZh c3RfY29uc3VtZXI6IDAKZGV2LmNjLjEudHhxLjEwLm1wX3JpbmcuY29uc3VtZWQ6IDAKZGV2LmNj LjEudHhxLjEwLm1wX3JpbmcuZHJvcHBlZDogMApkZXYuY2MuMS50eHEuMTAubXBfcmluZy5zdGF0 ZTogMApkZXYuY2MuMS50eHEuMTAudnhsYW5fdHhjc3VtOiAwCmRldi5jYy4xLnR4cS4xMC52eGxh bl90c29fd3JzOiAwCmRldi5jYy4xLnR4cS4xMC5yYXdfd3JzOiAwCmRldi5jYy4xLnR4cS4xMC50 eHBrdHNfZmx1c2g6IDAKZGV2LmNjLjEudHhxLjEwLnR4cGt0czFfcGt0czogMApkZXYuY2MuMS50 eHEuMTAudHhwa3RzMF9wa3RzOiAwCmRldi5jYy4xLnR4cS4xMC50eHBrdHMxX3dyczogMApkZXYu Y2MuMS50eHEuMTAudHhwa3RzMF93cnM6IDAKZGV2LmNjLjEudHhxLjEwLnR4cGt0X3dyczogMApk ZXYuY2MuMS50eHEuMTAuc2dsX3dyczogMApkZXYuY2MuMS50eHEuMTAuaW1tX3dyczogMApkZXYu Y2MuMS50eHEuMTAudHNvX3dyczogMApkZXYuY2MuMS50eHEuMTAudmxhbl9pbnNlcnRpb246IDAK ZGV2LmNjLjEudHhxLjEwLnR4Y3N1bTogMApkZXYuY2MuMS50eHEuMTAudGM6IC0xCmRldi5jYy4x LnR4cS4xMC5zaWR4OiAxMDIzCmRldi5jYy4xLnR4cS4xMC5waWR4OiAwCmRldi5jYy4xLnR4cS4x MC5jaWR4OiAwCmRldi5jYy4xLnR4cS4xMC5jbnR4dF9pZDogNzIKZGV2LmNjLjEudHhxLjEwLmFi c19pZDogNzIKZGV2LmNjLjEudHhxLjEwLmRtYWxlbjogNjU1MzYKZGV2LmNjLjEudHhxLjEwLmJh OiAyNTE1MDU1NDExMgpkZXYuY2MuMS50eHEuOS5tcF9yaW5nLmNvbnNfaWRsZTI6IDAKZGV2LmNj LjEudHhxLjkubXBfcmluZy5jb25zX2lkbGU6IDAKZGV2LmNjLjEudHhxLjkubXBfcmluZy5zdGFs bHM6IDAKZGV2LmNjLjEudHhxLjkubXBfcmluZy5hYmRpY2F0aW9uczogMApkZXYuY2MuMS50eHEu OS5tcF9yaW5nLm5vdF9jb25zdW1lcjogMApkZXYuY2MuMS50eHEuOS5tcF9yaW5nLnRha2VvdmVy czogMApkZXYuY2MuMS50eHEuOS5tcF9yaW5nLmNvbnN1bWVyMzogMApkZXYuY2MuMS50eHEuOS5t cF9yaW5nLmNvbnN1bWVyMjogMApkZXYuY2MuMS50eHEuOS5tcF9yaW5nLmZhc3RfY29uc3VtZXI6 IDAKZGV2LmNjLjEudHhxLjkubXBfcmluZy5jb25zdW1lZDogMApkZXYuY2MuMS50eHEuOS5tcF9y aW5nLmRyb3BwZWQ6IDAKZGV2LmNjLjEudHhxLjkubXBfcmluZy5zdGF0ZTogMApkZXYuY2MuMS50 eHEuOS52eGxhbl90eGNzdW06IDAKZGV2LmNjLjEudHhxLjkudnhsYW5fdHNvX3dyczogMApkZXYu Y2MuMS50eHEuOS5yYXdfd3JzOiAwCmRldi5jYy4xLnR4cS45LnR4cGt0c19mbHVzaDogMApkZXYu Y2MuMS50eHEuOS50eHBrdHMxX3BrdHM6IDAKZGV2LmNjLjEudHhxLjkudHhwa3RzMF9wa3RzOiAw CmRldi5jYy4xLnR4cS45LnR4cGt0czFfd3JzOiAwCmRldi5jYy4xLnR4cS45LnR4cGt0czBfd3Jz OiAwCmRldi5jYy4xLnR4cS45LnR4cGt0X3dyczogMApkZXYuY2MuMS50eHEuOS5zZ2xfd3JzOiAw CmRldi5jYy4xLnR4cS45LmltbV93cnM6IDAKZGV2LmNjLjEudHhxLjkudHNvX3dyczogMApkZXYu Y2MuMS50eHEuOS52bGFuX2luc2VydGlvbjogMApkZXYuY2MuMS50eHEuOS50eGNzdW06IDAKZGV2 LmNjLjEudHhxLjkudGM6IC0xCmRldi5jYy4xLnR4cS45LnNpZHg6IDEwMjMKZGV2LmNjLjEudHhx LjkucGlkeDogMApkZXYuY2MuMS50eHEuOS5jaWR4OiAwCmRldi5jYy4xLnR4cS45LmNudHh0X2lk OiA3MQpkZXYuY2MuMS50eHEuOS5hYnNfaWQ6IDcxCmRldi5jYy4xLnR4cS45LmRtYWxlbjogNjU1 MzYKZGV2LmNjLjEudHhxLjkuYmE6IDI1MTUwNDg4NTc2CmRldi5jYy4xLnR4cS44Lm1wX3Jpbmcu Y29uc19pZGxlMjogMApkZXYuY2MuMS50eHEuOC5tcF9yaW5nLmNvbnNfaWRsZTogMApkZXYuY2Mu MS50eHEuOC5tcF9yaW5nLnN0YWxsczogMApkZXYuY2MuMS50eHEuOC5tcF9yaW5nLmFiZGljYXRp b25zOiAwCmRldi5jYy4xLnR4cS44Lm1wX3Jpbmcubm90X2NvbnN1bWVyOiAwCmRldi5jYy4xLnR4 cS44Lm1wX3JpbmcudGFrZW92ZXJzOiAwCmRldi5jYy4xLnR4cS44Lm1wX3JpbmcuY29uc3VtZXIz OiAwCmRldi5jYy4xLnR4cS44Lm1wX3JpbmcuY29uc3VtZXIyOiAwCmRldi5jYy4xLnR4cS44Lm1w X3JpbmcuZmFzdF9jb25zdW1lcjogMApkZXYuY2MuMS50eHEuOC5tcF9yaW5nLmNvbnN1bWVkOiAw CmRldi5jYy4xLnR4cS44Lm1wX3JpbmcuZHJvcHBlZDogMApkZXYuY2MuMS50eHEuOC5tcF9yaW5n LnN0YXRlOiAwCmRldi5jYy4xLnR4cS44LnZ4bGFuX3R4Y3N1bTogMApkZXYuY2MuMS50eHEuOC52 eGxhbl90c29fd3JzOiAwCmRldi5jYy4xLnR4cS44LnJhd193cnM6IDAKZGV2LmNjLjEudHhxLjgu dHhwa3RzX2ZsdXNoOiAwCmRldi5jYy4xLnR4cS44LnR4cGt0czFfcGt0czogMApkZXYuY2MuMS50 eHEuOC50eHBrdHMwX3BrdHM6IDAKZGV2LmNjLjEudHhxLjgudHhwa3RzMV93cnM6IDAKZGV2LmNj LjEudHhxLjgudHhwa3RzMF93cnM6IDAKZGV2LmNjLjEudHhxLjgudHhwa3Rfd3JzOiAwCmRldi5j Yy4xLnR4cS44LnNnbF93cnM6IDAKZGV2LmNjLjEudHhxLjguaW1tX3dyczogMApkZXYuY2MuMS50 eHEuOC50c29fd3JzOiAwCmRldi5jYy4xLnR4cS44LnZsYW5faW5zZXJ0aW9uOiAwCmRldi5jYy4x LnR4cS44LnR4Y3N1bTogMApkZXYuY2MuMS50eHEuOC50YzogLTEKZGV2LmNjLjEudHhxLjguc2lk eDogMTAyMwpkZXYuY2MuMS50eHEuOC5waWR4OiAwCmRldi5jYy4xLnR4cS44LmNpZHg6IDAKZGV2 LmNjLjEudHhxLjguY250eHRfaWQ6IDcwCmRldi5jYy4xLnR4cS44LmFic19pZDogNzAKZGV2LmNj LjEudHhxLjguZG1hbGVuOiA2NTUzNgpkZXYuY2MuMS50eHEuOC5iYTogMjUxNTA0MjMwNDAKZGV2 LmNjLjEudHhxLjcubXBfcmluZy5jb25zX2lkbGUyOiAwCmRldi5jYy4xLnR4cS43Lm1wX3Jpbmcu Y29uc19pZGxlOiAwCmRldi5jYy4xLnR4cS43Lm1wX3Jpbmcuc3RhbGxzOiAwCmRldi5jYy4xLnR4 cS43Lm1wX3JpbmcuYWJkaWNhdGlvbnM6IDAKZGV2LmNjLjEudHhxLjcubXBfcmluZy5ub3RfY29u c3VtZXI6IDAKZGV2LmNjLjEudHhxLjcubXBfcmluZy50YWtlb3ZlcnM6IDAKZGV2LmNjLjEudHhx LjcubXBfcmluZy5jb25zdW1lcjM6IDAKZGV2LmNjLjEudHhxLjcubXBfcmluZy5jb25zdW1lcjI6 IDAKZGV2LmNjLjEudHhxLjcubXBfcmluZy5mYXN0X2NvbnN1bWVyOiAwCmRldi5jYy4xLnR4cS43 Lm1wX3JpbmcuY29uc3VtZWQ6IDAKZGV2LmNjLjEudHhxLjcubXBfcmluZy5kcm9wcGVkOiAwCmRl di5jYy4xLnR4cS43Lm1wX3Jpbmcuc3RhdGU6IDAKZGV2LmNjLjEudHhxLjcudnhsYW5fdHhjc3Vt OiAwCmRldi5jYy4xLnR4cS43LnZ4bGFuX3Rzb193cnM6IDAKZGV2LmNjLjEudHhxLjcucmF3X3dy czogMApkZXYuY2MuMS50eHEuNy50eHBrdHNfZmx1c2g6IDAKZGV2LmNjLjEudHhxLjcudHhwa3Rz MV9wa3RzOiAwCmRldi5jYy4xLnR4cS43LnR4cGt0czBfcGt0czogMApkZXYuY2MuMS50eHEuNy50 eHBrdHMxX3dyczogMApkZXYuY2MuMS50eHEuNy50eHBrdHMwX3dyczogMApkZXYuY2MuMS50eHEu Ny50eHBrdF93cnM6IDAKZGV2LmNjLjEudHhxLjcuc2dsX3dyczogMApkZXYuY2MuMS50eHEuNy5p bW1fd3JzOiAwCmRldi5jYy4xLnR4cS43LnRzb193cnM6IDAKZGV2LmNjLjEudHhxLjcudmxhbl9p bnNlcnRpb246IDAKZGV2LmNjLjEudHhxLjcudHhjc3VtOiAwCmRldi5jYy4xLnR4cS43LnRjOiAt MQpkZXYuY2MuMS50eHEuNy5zaWR4OiAxMDIzCmRldi5jYy4xLnR4cS43LnBpZHg6IDAKZGV2LmNj LjEudHhxLjcuY2lkeDogMApkZXYuY2MuMS50eHEuNy5jbnR4dF9pZDogNjkKZGV2LmNjLjEudHhx LjcuYWJzX2lkOiA2OQpkZXYuY2MuMS50eHEuNy5kbWFsZW46IDY1NTM2CmRldi5jYy4xLnR4cS43 LmJhOiAyNTE1MDM1NzUwNApkZXYuY2MuMS50eHEuNi5tcF9yaW5nLmNvbnNfaWRsZTI6IDAKZGV2 LmNjLjEudHhxLjYubXBfcmluZy5jb25zX2lkbGU6IDAKZGV2LmNjLjEudHhxLjYubXBfcmluZy5z dGFsbHM6IDAKZGV2LmNjLjEudHhxLjYubXBfcmluZy5hYmRpY2F0aW9uczogMApkZXYuY2MuMS50 eHEuNi5tcF9yaW5nLm5vdF9jb25zdW1lcjogMApkZXYuY2MuMS50eHEuNi5tcF9yaW5nLnRha2Vv dmVyczogMApkZXYuY2MuMS50eHEuNi5tcF9yaW5nLmNvbnN1bWVyMzogMApkZXYuY2MuMS50eHEu Ni5tcF9yaW5nLmNvbnN1bWVyMjogMApkZXYuY2MuMS50eHEuNi5tcF9yaW5nLmZhc3RfY29uc3Vt ZXI6IDAKZGV2LmNjLjEudHhxLjYubXBfcmluZy5jb25zdW1lZDogMApkZXYuY2MuMS50eHEuNi5t cF9yaW5nLmRyb3BwZWQ6IDAKZGV2LmNjLjEudHhxLjYubXBfcmluZy5zdGF0ZTogMApkZXYuY2Mu MS50eHEuNi52eGxhbl90eGNzdW06IDAKZGV2LmNjLjEudHhxLjYudnhsYW5fdHNvX3dyczogMApk ZXYuY2MuMS50eHEuNi5yYXdfd3JzOiAwCmRldi5jYy4xLnR4cS42LnR4cGt0c19mbHVzaDogMApk ZXYuY2MuMS50eHEuNi50eHBrdHMxX3BrdHM6IDAKZGV2LmNjLjEudHhxLjYudHhwa3RzMF9wa3Rz OiAwCmRldi5jYy4xLnR4cS42LnR4cGt0czFfd3JzOiAwCmRldi5jYy4xLnR4cS42LnR4cGt0czBf d3JzOiAwCmRldi5jYy4xLnR4cS42LnR4cGt0X3dyczogMApkZXYuY2MuMS50eHEuNi5zZ2xfd3Jz OiAwCmRldi5jYy4xLnR4cS42LmltbV93cnM6IDAKZGV2LmNjLjEudHhxLjYudHNvX3dyczogMApk ZXYuY2MuMS50eHEuNi52bGFuX2luc2VydGlvbjogMApkZXYuY2MuMS50eHEuNi50eGNzdW06IDAK ZGV2LmNjLjEudHhxLjYudGM6IC0xCmRldi5jYy4xLnR4cS42LnNpZHg6IDEwMjMKZGV2LmNjLjEu dHhxLjYucGlkeDogMApkZXYuY2MuMS50eHEuNi5jaWR4OiAwCmRldi5jYy4xLnR4cS42LmNudHh0 X2lkOiA2OApkZXYuY2MuMS50eHEuNi5hYnNfaWQ6IDY4CmRldi5jYy4xLnR4cS42LmRtYWxlbjog NjU1MzYKZGV2LmNjLjEudHhxLjYuYmE6IDI1MTQ3NDA4Mzg0CmRldi5jYy4xLnR4cS41Lm1wX3Jp bmcuY29uc19pZGxlMjogMApkZXYuY2MuMS50eHEuNS5tcF9yaW5nLmNvbnNfaWRsZTogMApkZXYu Y2MuMS50eHEuNS5tcF9yaW5nLnN0YWxsczogMApkZXYuY2MuMS50eHEuNS5tcF9yaW5nLmFiZGlj YXRpb25zOiAwCmRldi5jYy4xLnR4cS41Lm1wX3Jpbmcubm90X2NvbnN1bWVyOiAwCmRldi5jYy4x LnR4cS41Lm1wX3JpbmcudGFrZW92ZXJzOiAwCmRldi5jYy4xLnR4cS41Lm1wX3JpbmcuY29uc3Vt ZXIzOiAwCmRldi5jYy4xLnR4cS41Lm1wX3JpbmcuY29uc3VtZXIyOiAwCmRldi5jYy4xLnR4cS41 Lm1wX3JpbmcuZmFzdF9jb25zdW1lcjogMApkZXYuY2MuMS50eHEuNS5tcF9yaW5nLmNvbnN1bWVk OiAwCmRldi5jYy4xLnR4cS41Lm1wX3JpbmcuZHJvcHBlZDogMApkZXYuY2MuMS50eHEuNS5tcF9y aW5nLnN0YXRlOiAwCmRldi5jYy4xLnR4cS41LnZ4bGFuX3R4Y3N1bTogMApkZXYuY2MuMS50eHEu NS52eGxhbl90c29fd3JzOiAwCmRldi5jYy4xLnR4cS41LnJhd193cnM6IDAKZGV2LmNjLjEudHhx LjUudHhwa3RzX2ZsdXNoOiAwCmRldi5jYy4xLnR4cS41LnR4cGt0czFfcGt0czogMApkZXYuY2Mu MS50eHEuNS50eHBrdHMwX3BrdHM6IDAKZGV2LmNjLjEudHhxLjUudHhwa3RzMV93cnM6IDAKZGV2 LmNjLjEudHhxLjUudHhwa3RzMF93cnM6IDAKZGV2LmNjLjEudHhxLjUudHhwa3Rfd3JzOiAwCmRl di5jYy4xLnR4cS41LnNnbF93cnM6IDAKZGV2LmNjLjEudHhxLjUuaW1tX3dyczogMApkZXYuY2Mu MS50eHEuNS50c29fd3JzOiAwCmRldi5jYy4xLnR4cS41LnZsYW5faW5zZXJ0aW9uOiAwCmRldi5j Yy4xLnR4cS41LnR4Y3N1bTogMApkZXYuY2MuMS50eHEuNS50YzogLTEKZGV2LmNjLjEudHhxLjUu c2lkeDogMTAyMwpkZXYuY2MuMS50eHEuNS5waWR4OiAwCmRldi5jYy4xLnR4cS41LmNpZHg6IDAK ZGV2LmNjLjEudHhxLjUuY250eHRfaWQ6IDY3CmRldi5jYy4xLnR4cS41LmFic19pZDogNjcKZGV2 LmNjLjEudHhxLjUuZG1hbGVuOiA2NTUzNgpkZXYuY2MuMS50eHEuNS5iYTogMjUxNDczNDI4NDgK ZGV2LmNjLjEudHhxLjQubXBfcmluZy5jb25zX2lkbGUyOiAwCmRldi5jYy4xLnR4cS40Lm1wX3Jp bmcuY29uc19pZGxlOiAwCmRldi5jYy4xLnR4cS40Lm1wX3Jpbmcuc3RhbGxzOiAwCmRldi5jYy4x LnR4cS40Lm1wX3JpbmcuYWJkaWNhdGlvbnM6IDAKZGV2LmNjLjEudHhxLjQubXBfcmluZy5ub3Rf Y29uc3VtZXI6IDAKZGV2LmNjLjEudHhxLjQubXBfcmluZy50YWtlb3ZlcnM6IDAKZGV2LmNjLjEu dHhxLjQubXBfcmluZy5jb25zdW1lcjM6IDAKZGV2LmNjLjEudHhxLjQubXBfcmluZy5jb25zdW1l cjI6IDAKZGV2LmNjLjEudHhxLjQubXBfcmluZy5mYXN0X2NvbnN1bWVyOiAwCmRldi5jYy4xLnR4 cS40Lm1wX3JpbmcuY29uc3VtZWQ6IDAKZGV2LmNjLjEudHhxLjQubXBfcmluZy5kcm9wcGVkOiAw CmRldi5jYy4xLnR4cS40Lm1wX3Jpbmcuc3RhdGU6IDAKZGV2LmNjLjEudHhxLjQudnhsYW5fdHhj c3VtOiAwCmRldi5jYy4xLnR4cS40LnZ4bGFuX3Rzb193cnM6IDAKZGV2LmNjLjEudHhxLjQucmF3 X3dyczogMApkZXYuY2MuMS50eHEuNC50eHBrdHNfZmx1c2g6IDAKZGV2LmNjLjEudHhxLjQudHhw a3RzMV9wa3RzOiAwCmRldi5jYy4xLnR4cS40LnR4cGt0czBfcGt0czogMApkZXYuY2MuMS50eHEu NC50eHBrdHMxX3dyczogMApkZXYuY2MuMS50eHEuNC50eHBrdHMwX3dyczogMApkZXYuY2MuMS50 eHEuNC50eHBrdF93cnM6IDAKZGV2LmNjLjEudHhxLjQuc2dsX3dyczogMApkZXYuY2MuMS50eHEu NC5pbW1fd3JzOiAwCmRldi5jYy4xLnR4cS40LnRzb193cnM6IDAKZGV2LmNjLjEudHhxLjQudmxh bl9pbnNlcnRpb246IDAKZGV2LmNjLjEudHhxLjQudHhjc3VtOiAwCmRldi5jYy4xLnR4cS40LnRj OiAtMQpkZXYuY2MuMS50eHEuNC5zaWR4OiAxMDIzCmRldi5jYy4xLnR4cS40LnBpZHg6IDAKZGV2 LmNjLjEudHhxLjQuY2lkeDogMApkZXYuY2MuMS50eHEuNC5jbnR4dF9pZDogNjYKZGV2LmNjLjEu dHhxLjQuYWJzX2lkOiA2NgpkZXYuY2MuMS50eHEuNC5kbWFsZW46IDY1NTM2CmRldi5jYy4xLnR4 cS40LmJhOiAyNTE0NzI3NzMxMgpkZXYuY2MuMS50eHEuMy5tcF9yaW5nLmNvbnNfaWRsZTI6IDAK ZGV2LmNjLjEudHhxLjMubXBfcmluZy5jb25zX2lkbGU6IDAKZGV2LmNjLjEudHhxLjMubXBfcmlu Zy5zdGFsbHM6IDAKZGV2LmNjLjEudHhxLjMubXBfcmluZy5hYmRpY2F0aW9uczogMApkZXYuY2Mu MS50eHEuMy5tcF9yaW5nLm5vdF9jb25zdW1lcjogMApkZXYuY2MuMS50eHEuMy5tcF9yaW5nLnRh a2VvdmVyczogMApkZXYuY2MuMS50eHEuMy5tcF9yaW5nLmNvbnN1bWVyMzogMApkZXYuY2MuMS50 eHEuMy5tcF9yaW5nLmNvbnN1bWVyMjogMApkZXYuY2MuMS50eHEuMy5tcF9yaW5nLmZhc3RfY29u c3VtZXI6IDAKZGV2LmNjLjEudHhxLjMubXBfcmluZy5jb25zdW1lZDogMApkZXYuY2MuMS50eHEu My5tcF9yaW5nLmRyb3BwZWQ6IDAKZGV2LmNjLjEudHhxLjMubXBfcmluZy5zdGF0ZTogMApkZXYu Y2MuMS50eHEuMy52eGxhbl90eGNzdW06IDAKZGV2LmNjLjEudHhxLjMudnhsYW5fdHNvX3dyczog MApkZXYuY2MuMS50eHEuMy5yYXdfd3JzOiAwCmRldi5jYy4xLnR4cS4zLnR4cGt0c19mbHVzaDog MApkZXYuY2MuMS50eHEuMy50eHBrdHMxX3BrdHM6IDAKZGV2LmNjLjEudHhxLjMudHhwa3RzMF9w a3RzOiAwCmRldi5jYy4xLnR4cS4zLnR4cGt0czFfd3JzOiAwCmRldi5jYy4xLnR4cS4zLnR4cGt0 czBfd3JzOiAwCmRldi5jYy4xLnR4cS4zLnR4cGt0X3dyczogMApkZXYuY2MuMS50eHEuMy5zZ2xf d3JzOiAwCmRldi5jYy4xLnR4cS4zLmltbV93cnM6IDAKZGV2LmNjLjEudHhxLjMudHNvX3dyczog MApkZXYuY2MuMS50eHEuMy52bGFuX2luc2VydGlvbjogMApkZXYuY2MuMS50eHEuMy50eGNzdW06 IDAKZGV2LmNjLjEudHhxLjMudGM6IC0xCmRldi5jYy4xLnR4cS4zLnNpZHg6IDEwMjMKZGV2LmNj LjEudHhxLjMucGlkeDogMApkZXYuY2MuMS50eHEuMy5jaWR4OiAwCmRldi5jYy4xLnR4cS4zLmNu dHh0X2lkOiA2NQpkZXYuY2MuMS50eHEuMy5hYnNfaWQ6IDY1CmRldi5jYy4xLnR4cS4zLmRtYWxl bjogNjU1MzYKZGV2LmNjLjEudHhxLjMuYmE6IDI1MTQ3MjExNzc2CmRldi5jYy4xLnR4cS4yLm1w X3JpbmcuY29uc19pZGxlMjogOApkZXYuY2MuMS50eHEuMi5tcF9yaW5nLmNvbnNfaWRsZTogMjM1 OTg1NjgKZGV2LmNjLjEudHhxLjIubXBfcmluZy5zdGFsbHM6IDAKZGV2LmNjLjEudHhxLjIubXBf cmluZy5hYmRpY2F0aW9uczogMApkZXYuY2MuMS50eHEuMi5tcF9yaW5nLm5vdF9jb25zdW1lcjog Mzg1CmRldi5jYy4xLnR4cS4yLm1wX3JpbmcudGFrZW92ZXJzOiAwCmRldi5jYy4xLnR4cS4yLm1w X3JpbmcuY29uc3VtZXIzOiA4CmRldi5jYy4xLnR4cS4yLm1wX3JpbmcuY29uc3VtZXIyOiAwCmRl di5jYy4xLnR4cS4yLm1wX3JpbmcuZmFzdF9jb25zdW1lcjogMjM1OTg0ODgKZGV2LmNjLjEudHhx LjIubXBfcmluZy5jb25zdW1lZDogMjM1OTg4ODEKZGV2LmNjLjEudHhxLjIubXBfcmluZy5kcm9w cGVkOiAwCmRldi5jYy4xLnR4cS4yLm1wX3Jpbmcuc3RhdGU6IDEzNjE1MjU0MDgwNjEKZGV2LmNj LjEudHhxLjIudnhsYW5fdHhjc3VtOiAwCmRldi5jYy4xLnR4cS4yLnZ4bGFuX3Rzb193cnM6IDAK ZGV2LmNjLjEudHhxLjIucmF3X3dyczogMApkZXYuY2MuMS50eHEuMi50eHBrdHNfZmx1c2g6IDg5 CmRldi5jYy4xLnR4cS4yLnR4cGt0czFfcGt0czogMApkZXYuY2MuMS50eHEuMi50eHBrdHMwX3Br dHM6IDE4NDAKZGV2LmNjLjEudHhxLjIudHhwa3RzMV93cnM6IDAKZGV2LmNjLjEudHhxLjIudHhw a3RzMF93cnM6IDMyMwpkZXYuY2MuMS50eHEuMi50eHBrdF93cnM6IDIzNTk3MDQxCmRldi5jYy4x LnR4cS4yLnNnbF93cnM6IDIzNTk3MzY0CmRldi5jYy4xLnR4cS4yLmltbV93cnM6IDAKZGV2LmNj LjEudHhxLjIudHNvX3dyczogMApkZXYuY2MuMS50eHEuMi52bGFuX2luc2VydGlvbjogMApkZXYu Y2MuMS50eHEuMi50eGNzdW06IDIzNTk4ODgxCmRldi5jYy4xLnR4cS4yLnRjOiAtMQpkZXYuY2Mu MS50eHEuMi5zaWR4OiAxMDIzCmRldi5jYy4xLnR4cS4yLnBpZHg6IDg0MQpkZXYuY2MuMS50eHEu Mi5jaWR4OiA4NDEKZGV2LmNjLjEudHhxLjIuY250eHRfaWQ6IDY0CmRldi5jYy4xLnR4cS4yLmFi c19pZDogNjQKZGV2LmNjLjEudHhxLjIuZG1hbGVuOiA2NTUzNgpkZXYuY2MuMS50eHEuMi5iYTog MjUxNTAyOTE5NjgKZGV2LmNjLjEudHhxLjEubXBfcmluZy5jb25zX2lkbGUyOiAwCmRldi5jYy4x LnR4cS4xLm1wX3JpbmcuY29uc19pZGxlOiAwCmRldi5jYy4xLnR4cS4xLm1wX3Jpbmcuc3RhbGxz OiAwCmRldi5jYy4xLnR4cS4xLm1wX3JpbmcuYWJkaWNhdGlvbnM6IDAKZGV2LmNjLjEudHhxLjEu bXBfcmluZy5ub3RfY29uc3VtZXI6IDAKZGV2LmNjLjEudHhxLjEubXBfcmluZy50YWtlb3ZlcnM6 IDAKZGV2LmNjLjEudHhxLjEubXBfcmluZy5jb25zdW1lcjM6IDAKZGV2LmNjLjEudHhxLjEubXBf cmluZy5jb25zdW1lcjI6IDAKZGV2LmNjLjEudHhxLjEubXBfcmluZy5mYXN0X2NvbnN1bWVyOiAw CmRldi5jYy4xLnR4cS4xLm1wX3JpbmcuY29uc3VtZWQ6IDAKZGV2LmNjLjEudHhxLjEubXBfcmlu Zy5kcm9wcGVkOiAwCmRldi5jYy4xLnR4cS4xLm1wX3Jpbmcuc3RhdGU6IDAKZGV2LmNjLjEudHhx LjEudnhsYW5fdHhjc3VtOiAwCmRldi5jYy4xLnR4cS4xLnZ4bGFuX3Rzb193cnM6IDAKZGV2LmNj LjEudHhxLjEucmF3X3dyczogMApkZXYuY2MuMS50eHEuMS50eHBrdHNfZmx1c2g6IDAKZGV2LmNj LjEudHhxLjEudHhwa3RzMV9wa3RzOiAwCmRldi5jYy4xLnR4cS4xLnR4cGt0czBfcGt0czogMApk ZXYuY2MuMS50eHEuMS50eHBrdHMxX3dyczogMApkZXYuY2MuMS50eHEuMS50eHBrdHMwX3dyczog MApkZXYuY2MuMS50eHEuMS50eHBrdF93cnM6IDAKZGV2LmNjLjEudHhxLjEuc2dsX3dyczogMApk ZXYuY2MuMS50eHEuMS5pbW1fd3JzOiAwCmRldi5jYy4xLnR4cS4xLnRzb193cnM6IDAKZGV2LmNj LjEudHhxLjEudmxhbl9pbnNlcnRpb246IDAKZGV2LmNjLjEudHhxLjEudHhjc3VtOiAwCmRldi5j Yy4xLnR4cS4xLnRjOiAtMQpkZXYuY2MuMS50eHEuMS5zaWR4OiAxMDIzCmRldi5jYy4xLnR4cS4x LnBpZHg6IDAKZGV2LmNjLjEudHhxLjEuY2lkeDogMApkZXYuY2MuMS50eHEuMS5jbnR4dF9pZDog NjMKZGV2LmNjLjEudHhxLjEuYWJzX2lkOiA2MwpkZXYuY2MuMS50eHEuMS5kbWFsZW46IDY1NTM2 CmRldi5jYy4xLnR4cS4xLmJhOiAyNTE1MDIyNjQzMgpkZXYuY2MuMS50eHEuMC5tcF9yaW5nLmNv bnNfaWRsZTI6IDAKZGV2LmNjLjEudHhxLjAubXBfcmluZy5jb25zX2lkbGU6IDYxCmRldi5jYy4x LnR4cS4wLm1wX3Jpbmcuc3RhbGxzOiAwCmRldi5jYy4xLnR4cS4wLm1wX3JpbmcuYWJkaWNhdGlv bnM6IDAKZGV2LmNjLjEudHhxLjAubXBfcmluZy5ub3RfY29uc3VtZXI6IDAKZGV2LmNjLjEudHhx LjAubXBfcmluZy50YWtlb3ZlcnM6IDAKZGV2LmNjLjEudHhxLjAubXBfcmluZy5jb25zdW1lcjM6 IDAKZGV2LmNjLjEudHhxLjAubXBfcmluZy5jb25zdW1lcjI6IDAKZGV2LmNjLjEudHhxLjAubXBf cmluZy5mYXN0X2NvbnN1bWVyOiA2MQpkZXYuY2MuMS50eHEuMC5tcF9yaW5nLmNvbnN1bWVkOiA2 MQpkZXYuY2MuMS50eHEuMC5tcF9yaW5nLmRyb3BwZWQ6IDAKZGV2LmNjLjEudHhxLjAubXBfcmlu Zy5zdGF0ZTogMjYxOTk3MDAyODEzCmRldi5jYy4xLnR4cS4wLnZ4bGFuX3R4Y3N1bTogMApkZXYu Y2MuMS50eHEuMC52eGxhbl90c29fd3JzOiAwCmRldi5jYy4xLnR4cS4wLnJhd193cnM6IDAKZGV2 LmNjLjEudHhxLjAudHhwa3RzX2ZsdXNoOiAwCmRldi5jYy4xLnR4cS4wLnR4cGt0czFfcGt0czog MApkZXYuY2MuMS50eHEuMC50eHBrdHMwX3BrdHM6IDAKZGV2LmNjLjEudHhxLjAudHhwa3RzMV93 cnM6IDAKZGV2LmNjLjEudHhxLjAudHhwa3RzMF93cnM6IDAKZGV2LmNjLjEudHhxLjAudHhwa3Rf d3JzOiA2MQpkZXYuY2MuMS50eHEuMC5zZ2xfd3JzOiA2MApkZXYuY2MuMS50eHEuMC5pbW1fd3Jz OiAxCmRldi5jYy4xLnR4cS4wLnRzb193cnM6IDAKZGV2LmNjLjEudHhxLjAudmxhbl9pbnNlcnRp b246IDAKZGV2LmNjLjEudHhxLjAudHhjc3VtOiA2MApkZXYuY2MuMS50eHEuMC50YzogLTEKZGV2 LmNjLjEudHhxLjAuc2lkeDogMTAyMwpkZXYuY2MuMS50eHEuMC5waWR4OiA2MgpkZXYuY2MuMS50 eHEuMC5jaWR4OiA2MgpkZXYuY2MuMS50eHEuMC5jbnR4dF9pZDogNjIKZGV2LmNjLjEudHhxLjAu YWJzX2lkOiA2MgpkZXYuY2MuMS50eHEuMC5kbWFsZW46IDY1NTM2CmRldi5jYy4xLnR4cS4wLmJh OiAyNTE0NzE0NjI0MApkZXYuY2MuMS5vZmxkX3J4cS4xLnJ4X3RvZV90bHNfb2N0ZXRzOiAwCmRl di5jYy4xLm9mbGRfcnhxLjEucnhfdG9lX3Rsc19yZWNvcmRzOiAwCmRldi5jYy4xLm9mbGRfcnhx LjEuZmwuY2x1c3Rlcl9mYXN0X3JlY3ljbGVkOiAwCmRldi5jYy4xLm9mbGRfcnhxLjEuZmwuY2x1 c3Rlcl9yZWN5Y2xlZDogMApkZXYuY2MuMS5vZmxkX3J4cS4xLmZsLmNsdXN0ZXJfYWxsb2NhdGVk OiAzMgpkZXYuY2MuMS5vZmxkX3J4cS4xLmZsLnBpZHg6IDMyCmRldi5jYy4xLm9mbGRfcnhxLjEu Zmwucnhfb2Zmc2V0OiAwCmRldi5jYy4xLm9mbGRfcnhxLjEuZmwuY2lkeDogMApkZXYuY2MuMS5v ZmxkX3J4cS4xLmZsLnBhY2tpbmc6IDEKZGV2LmNjLjEub2ZsZF9yeHEuMS5mbC5wYWRkaW5nOiAx CmRldi5jYy4xLm9mbGRfcnhxLjEuZmwuY250eHRfaWQ6IDYxCmRldi5jYy4xLm9mbGRfcnhxLjEu ZmwuZG1hbGVuOiA4MTkyCmRldi5jYy4xLm9mbGRfcnhxLjEuZmwuYmE6IDI1MDM3Nzk1MzI4CmRl di5jYy4xLm9mbGRfcnhxLjEuY2lkeDogMApkZXYuY2MuMS5vZmxkX3J4cS4xLmNudHh0X2lkOiAy OApkZXYuY2MuMS5vZmxkX3J4cS4xLmFic19pZDogMjgKZGV2LmNjLjEub2ZsZF9yeHEuMS5kbWFs ZW46IDY1NTM2CmRldi5jYy4xLm9mbGRfcnhxLjEuYmE6IDI1MDM3NzI5NzkyCmRldi5jYy4xLm9m bGRfcnhxLjAucnhfdG9lX3Rsc19vY3RldHM6IDAKZGV2LmNjLjEub2ZsZF9yeHEuMC5yeF90b2Vf dGxzX3JlY29yZHM6IDAKZGV2LmNjLjEub2ZsZF9yeHEuMC5mbC5jbHVzdGVyX2Zhc3RfcmVjeWNs ZWQ6IDAKZGV2LmNjLjEub2ZsZF9yeHEuMC5mbC5jbHVzdGVyX3JlY3ljbGVkOiAwCmRldi5jYy4x Lm9mbGRfcnhxLjAuZmwuY2x1c3Rlcl9hbGxvY2F0ZWQ6IDMyCmRldi5jYy4xLm9mbGRfcnhxLjAu ZmwucGlkeDogMzIKZGV2LmNjLjEub2ZsZF9yeHEuMC5mbC5yeF9vZmZzZXQ6IDAKZGV2LmNjLjEu b2ZsZF9yeHEuMC5mbC5jaWR4OiAwCmRldi5jYy4xLm9mbGRfcnhxLjAuZmwucGFja2luZzogMQpk ZXYuY2MuMS5vZmxkX3J4cS4wLmZsLnBhZGRpbmc6IDEKZGV2LmNjLjEub2ZsZF9yeHEuMC5mbC5j bnR4dF9pZDogNjAKZGV2LmNjLjEub2ZsZF9yeHEuMC5mbC5kbWFsZW46IDgxOTIKZGV2LmNjLjEu b2ZsZF9yeHEuMC5mbC5iYTogMjUwMzc3MDUyMTYKZGV2LmNjLjEub2ZsZF9yeHEuMC5jaWR4OiAw CmRldi5jYy4xLm9mbGRfcnhxLjAuY250eHRfaWQ6IDI3CmRldi5jYy4xLm9mbGRfcnhxLjAuYWJz X2lkOiAyNwpkZXYuY2MuMS5vZmxkX3J4cS4wLmRtYWxlbjogNjU1MzYKZGV2LmNjLjEub2ZsZF9y eHEuMC5iYTogMjUwMzc2Mzk2ODAKZGV2LmNjLjEucnhxLjcuZmwuY2x1c3Rlcl9mYXN0X3JlY3lj bGVkOiAwCmRldi5jYy4xLnJ4cS43LmZsLmNsdXN0ZXJfcmVjeWNsZWQ6IDAKZGV2LmNjLjEucnhx LjcuZmwuY2x1c3Rlcl9hbGxvY2F0ZWQ6IDE2MApkZXYuY2MuMS5yeHEuNy5mbC5waWR4OiAxNjAK ZGV2LmNjLjEucnhxLjcuZmwucnhfb2Zmc2V0OiAwCmRldi5jYy4xLnJ4cS43LmZsLmNpZHg6IDAK ZGV2LmNjLjEucnhxLjcuZmwucGFja2luZzogMQpkZXYuY2MuMS5yeHEuNy5mbC5wYWRkaW5nOiAx CmRldi5jYy4xLnJ4cS43LmZsLmNudHh0X2lkOiA1OQpkZXYuY2MuMS5yeHEuNy5mbC5kbWFsZW46 IDgxOTIKZGV2LmNjLjEucnhxLjcuZmwuYmE6IDI1MDM3NjE1MTA0CmRldi5jYy4xLnJ4cS43LnZ4 bGFuX3J4Y3N1bTogMApkZXYuY2MuMS5yeHEuNy52bGFuX2V4dHJhY3Rpb246IDAKZGV2LmNjLjEu cnhxLjcucnhjc3VtOiAwCmRldi5jYy4xLnJ4cS43Lmxyb19mbHVzaGVkOiAwCmRldi5jYy4xLnJ4 cS43Lmxyb19xdWV1ZWQ6IDAKZGV2LmNjLjEucnhxLjcuY2lkeDogMApkZXYuY2MuMS5yeHEuNy5j bnR4dF9pZDogMjYKZGV2LmNjLjEucnhxLjcuYWJzX2lkOiAyNgpkZXYuY2MuMS5yeHEuNy5kbWFs ZW46IDY1NTM2CmRldi5jYy4xLnJ4cS43LmJhOiAyNTAzNzU0OTU2OApkZXYuY2MuMS5yeHEuNi5m bC5jbHVzdGVyX2Zhc3RfcmVjeWNsZWQ6IDAKZGV2LmNjLjEucnhxLjYuZmwuY2x1c3Rlcl9yZWN5 Y2xlZDogMApkZXYuY2MuMS5yeHEuNi5mbC5jbHVzdGVyX2FsbG9jYXRlZDogMTYwCmRldi5jYy4x LnJ4cS42LmZsLnBpZHg6IDE2MApkZXYuY2MuMS5yeHEuNi5mbC5yeF9vZmZzZXQ6IDAKZGV2LmNj LjEucnhxLjYuZmwuY2lkeDogMApkZXYuY2MuMS5yeHEuNi5mbC5wYWNraW5nOiAxCmRldi5jYy4x LnJ4cS42LmZsLnBhZGRpbmc6IDEKZGV2LmNjLjEucnhxLjYuZmwuY250eHRfaWQ6IDU4CmRldi5j Yy4xLnJ4cS42LmZsLmRtYWxlbjogODE5MgpkZXYuY2MuMS5yeHEuNi5mbC5iYTogMjUwMzc1MjQ5 OTIKZGV2LmNjLjEucnhxLjYudnhsYW5fcnhjc3VtOiAwCmRldi5jYy4xLnJ4cS42LnZsYW5fZXh0 cmFjdGlvbjogMApkZXYuY2MuMS5yeHEuNi5yeGNzdW06IDAKZGV2LmNjLjEucnhxLjYubHJvX2Zs dXNoZWQ6IDAKZGV2LmNjLjEucnhxLjYubHJvX3F1ZXVlZDogMApkZXYuY2MuMS5yeHEuNi5jaWR4 OiAwCmRldi5jYy4xLnJ4cS42LmNudHh0X2lkOiAyNQpkZXYuY2MuMS5yeHEuNi5hYnNfaWQ6IDI1 CmRldi5jYy4xLnJ4cS42LmRtYWxlbjogNjU1MzYKZGV2LmNjLjEucnhxLjYuYmE6IDI1MDM3NDU5 NDU2CmRldi5jYy4xLnJ4cS41LmZsLmNsdXN0ZXJfZmFzdF9yZWN5Y2xlZDogMApkZXYuY2MuMS5y eHEuNS5mbC5jbHVzdGVyX3JlY3ljbGVkOiAwCmRldi5jYy4xLnJ4cS41LmZsLmNsdXN0ZXJfYWxs b2NhdGVkOiAxNjAKZGV2LmNjLjEucnhxLjUuZmwucGlkeDogMTYwCmRldi5jYy4xLnJ4cS41LmZs LnJ4X29mZnNldDogMApkZXYuY2MuMS5yeHEuNS5mbC5jaWR4OiAwCmRldi5jYy4xLnJ4cS41LmZs LnBhY2tpbmc6IDEKZGV2LmNjLjEucnhxLjUuZmwucGFkZGluZzogMQpkZXYuY2MuMS5yeHEuNS5m bC5jbnR4dF9pZDogNTcKZGV2LmNjLjEucnhxLjUuZmwuZG1hbGVuOiA4MTkyCmRldi5jYy4xLnJ4 cS41LmZsLmJhOiAyNTAzNzQzNDg4MApkZXYuY2MuMS5yeHEuNS52eGxhbl9yeGNzdW06IDAKZGV2 LmNjLjEucnhxLjUudmxhbl9leHRyYWN0aW9uOiAwCmRldi5jYy4xLnJ4cS41LnJ4Y3N1bTogMApk ZXYuY2MuMS5yeHEuNS5scm9fZmx1c2hlZDogMApkZXYuY2MuMS5yeHEuNS5scm9fcXVldWVkOiAw CmRldi5jYy4xLnJ4cS41LmNpZHg6IDAKZGV2LmNjLjEucnhxLjUuY250eHRfaWQ6IDI0CmRldi5j Yy4xLnJ4cS41LmFic19pZDogMjQKZGV2LmNjLjEucnhxLjUuZG1hbGVuOiA2NTUzNgpkZXYuY2Mu MS5yeHEuNS5iYTogMjUwMzczNjkzNDQKZGV2LmNjLjEucnhxLjQuZmwuY2x1c3Rlcl9mYXN0X3Jl Y3ljbGVkOiAwCmRldi5jYy4xLnJ4cS40LmZsLmNsdXN0ZXJfcmVjeWNsZWQ6IDAKZGV2LmNjLjEu cnhxLjQuZmwuY2x1c3Rlcl9hbGxvY2F0ZWQ6IDE2MApkZXYuY2MuMS5yeHEuNC5mbC5waWR4OiAx NjAKZGV2LmNjLjEucnhxLjQuZmwucnhfb2Zmc2V0OiAwCmRldi5jYy4xLnJ4cS40LmZsLmNpZHg6 IDAKZGV2LmNjLjEucnhxLjQuZmwucGFja2luZzogMQpkZXYuY2MuMS5yeHEuNC5mbC5wYWRkaW5n OiAxCmRldi5jYy4xLnJ4cS40LmZsLmNudHh0X2lkOiA1NgpkZXYuY2MuMS5yeHEuNC5mbC5kbWFs ZW46IDgxOTIKZGV2LmNjLjEucnhxLjQuZmwuYmE6IDI1MDM3MzYxMTUyCmRldi5jYy4xLnJ4cS40 LnZ4bGFuX3J4Y3N1bTogMApkZXYuY2MuMS5yeHEuNC52bGFuX2V4dHJhY3Rpb246IDAKZGV2LmNj LjEucnhxLjQucnhjc3VtOiAwCmRldi5jYy4xLnJ4cS40Lmxyb19mbHVzaGVkOiAwCmRldi5jYy4x LnJ4cS40Lmxyb19xdWV1ZWQ6IDAKZGV2LmNjLjEucnhxLjQuY2lkeDogMApkZXYuY2MuMS5yeHEu NC5jbnR4dF9pZDogMjMKZGV2LmNjLjEucnhxLjQuYWJzX2lkOiAyMwpkZXYuY2MuMS5yeHEuNC5k bWFsZW46IDY1NTM2CmRldi5jYy4xLnJ4cS40LmJhOiAyNTAzNzI5NTYxNgpkZXYuY2MuMS5yeHEu My5mbC5jbHVzdGVyX2Zhc3RfcmVjeWNsZWQ6IDAKZGV2LmNjLjEucnhxLjMuZmwuY2x1c3Rlcl9y ZWN5Y2xlZDogMApkZXYuY2MuMS5yeHEuMy5mbC5jbHVzdGVyX2FsbG9jYXRlZDogMTYwCmRldi5j Yy4xLnJ4cS4zLmZsLnBpZHg6IDE2MApkZXYuY2MuMS5yeHEuMy5mbC5yeF9vZmZzZXQ6IDAKZGV2 LmNjLjEucnhxLjMuZmwuY2lkeDogMApkZXYuY2MuMS5yeHEuMy5mbC5wYWNraW5nOiAxCmRldi5j Yy4xLnJ4cS4zLmZsLnBhZGRpbmc6IDEKZGV2LmNjLjEucnhxLjMuZmwuY250eHRfaWQ6IDU1CmRl di5jYy4xLnJ4cS4zLmZsLmRtYWxlbjogODE5MgpkZXYuY2MuMS5yeHEuMy5mbC5iYTogMjUwMzcy ODc0MjQKZGV2LmNjLjEucnhxLjMudnhsYW5fcnhjc3VtOiAwCmRldi5jYy4xLnJ4cS4zLnZsYW5f ZXh0cmFjdGlvbjogMApkZXYuY2MuMS5yeHEuMy5yeGNzdW06IDAKZGV2LmNjLjEucnhxLjMubHJv X2ZsdXNoZWQ6IDAKZGV2LmNjLjEucnhxLjMubHJvX3F1ZXVlZDogMApkZXYuY2MuMS5yeHEuMy5j aWR4OiAwCmRldi5jYy4xLnJ4cS4zLmNudHh0X2lkOiAyMgpkZXYuY2MuMS5yeHEuMy5hYnNfaWQ6 IDIyCmRldi5jYy4xLnJ4cS4zLmRtYWxlbjogNjU1MzYKZGV2LmNjLjEucnhxLjMuYmE6IDI1MDM3 MjIxODg4CmRldi5jYy4xLnJ4cS4yLmZsLmNsdXN0ZXJfZmFzdF9yZWN5Y2xlZDogNzQ0OTIwCmRl di5jYy4xLnJ4cS4yLmZsLmNsdXN0ZXJfcmVjeWNsZWQ6IDAKZGV2LmNjLjEucnhxLjIuZmwuY2x1 c3Rlcl9hbGxvY2F0ZWQ6IDEwMTYKZGV2LmNjLjEucnhxLjIuZmwucGlkeDogMTkyCmRldi5jYy4x LnJ4cS4yLmZsLnJ4X29mZnNldDogMzg0MApkZXYuY2MuMS5yeHEuMi5mbC5jaWR4OiAyMDUKZGV2 LmNjLjEucnhxLjIuZmwucGFja2luZzogMQpkZXYuY2MuMS5yeHEuMi5mbC5wYWRkaW5nOiAxCmRl di5jYy4xLnJ4cS4yLmZsLmNudHh0X2lkOiA1NApkZXYuY2MuMS5yeHEuMi5mbC5kbWFsZW46IDgx OTIKZGV2LmNjLjEucnhxLjIuZmwuYmE6IDI1MDM3MjEzNjk2CmRldi5jYy4xLnJ4cS4yLnZ4bGFu X3J4Y3N1bTogMApkZXYuY2MuMS5yeHEuMi52bGFuX2V4dHJhY3Rpb246IDAKZGV2LmNjLjEucnhx LjIucnhjc3VtOiAxMTkxODk0MwpkZXYuY2MuMS5yeHEuMi5scm9fZmx1c2hlZDogMApkZXYuY2Mu MS5yeHEuMi5scm9fcXVldWVkOiAwCmRldi5jYy4xLnJ4cS4yLmNpZHg6IDIwMwpkZXYuY2MuMS5y eHEuMi5jbnR4dF9pZDogMjEKZGV2LmNjLjEucnhxLjIuYWJzX2lkOiAyMQpkZXYuY2MuMS5yeHEu Mi5kbWFsZW46IDY1NTM2CmRldi5jYy4xLnJ4cS4yLmJhOiAyNTAzNzE0ODE2MApkZXYuY2MuMS5y eHEuMS5mbC5jbHVzdGVyX2Zhc3RfcmVjeWNsZWQ6IDAKZGV2LmNjLjEucnhxLjEuZmwuY2x1c3Rl cl9yZWN5Y2xlZDogMApkZXYuY2MuMS5yeHEuMS5mbC5jbHVzdGVyX2FsbG9jYXRlZDogMTYwCmRl di5jYy4xLnJ4cS4xLmZsLnBpZHg6IDE2MApkZXYuY2MuMS5yeHEuMS5mbC5yeF9vZmZzZXQ6IDAK ZGV2LmNjLjEucnhxLjEuZmwuY2lkeDogMApkZXYuY2MuMS5yeHEuMS5mbC5wYWNraW5nOiAxCmRl di5jYy4xLnJ4cS4xLmZsLnBhZGRpbmc6IDEKZGV2LmNjLjEucnhxLjEuZmwuY250eHRfaWQ6IDUz CmRldi5jYy4xLnJ4cS4xLmZsLmRtYWxlbjogODE5MgpkZXYuY2MuMS5yeHEuMS5mbC5iYTogMjUw MzcxMzk5NjgKZGV2LmNjLjEucnhxLjEudnhsYW5fcnhjc3VtOiAwCmRldi5jYy4xLnJ4cS4xLnZs YW5fZXh0cmFjdGlvbjogMApkZXYuY2MuMS5yeHEuMS5yeGNzdW06IDAKZGV2LmNjLjEucnhxLjEu bHJvX2ZsdXNoZWQ6IDAKZGV2LmNjLjEucnhxLjEubHJvX3F1ZXVlZDogMApkZXYuY2MuMS5yeHEu MS5jaWR4OiAwCmRldi5jYy4xLnJ4cS4xLmNudHh0X2lkOiAyMApkZXYuY2MuMS5yeHEuMS5hYnNf aWQ6IDIwCmRldi5jYy4xLnJ4cS4xLmRtYWxlbjogNjU1MzYKZGV2LmNjLjEucnhxLjEuYmE6IDI1 MDM3MDc0NDMyCmRldi5jYy4xLnJ4cS4wLmZsLmNsdXN0ZXJfZmFzdF9yZWN5Y2xlZDogMApkZXYu Y2MuMS5yeHEuMC5mbC5jbHVzdGVyX3JlY3ljbGVkOiAwCmRldi5jYy4xLnJ4cS4wLmZsLmNsdXN0 ZXJfYWxsb2NhdGVkOiA0MTYKZGV2LmNjLjEucnhxLjAuZmwucGlkeDogNDE2CmRldi5jYy4xLnJ4 cS4wLmZsLnJ4X29mZnNldDogMjU2CmRldi5jYy4xLnJ4cS4wLmZsLmNpZHg6IDAKZGV2LmNjLjEu cnhxLjAuZmwucGFja2luZzogMQpkZXYuY2MuMS5yeHEuMC5mbC5wYWRkaW5nOiAxCmRldi5jYy4x LnJ4cS4wLmZsLmNudHh0X2lkOiA1MgpkZXYuY2MuMS5yeHEuMC5mbC5kbWFsZW46IDgxOTIKZGV2 LmNjLjEucnhxLjAuZmwuYmE6IDI1MDM3MDY2MjQwCmRldi5jYy4xLnJ4cS4wLnZ4bGFuX3J4Y3N1 bTogMApkZXYuY2MuMS5yeHEuMC52bGFuX2V4dHJhY3Rpb246IDAKZGV2LmNjLjEucnhxLjAucnhj c3VtOiAwCmRldi5jYy4xLnJ4cS4wLmxyb19mbHVzaGVkOiAwCmRldi5jYy4xLnJ4cS4wLmxyb19x dWV1ZWQ6IDAKZGV2LmNjLjEucnhxLjAuY2lkeDogNApkZXYuY2MuMS5yeHEuMC5jbnR4dF9pZDog MTkKZGV2LmNjLjEucnhxLjAuYWJzX2lkOiAxOQpkZXYuY2MuMS5yeHEuMC5kbWFsZW46IDY1NTM2 CmRldi5jYy4xLnJ4cS4wLmJhOiAyNTAzNzAwMDcwNApkZXYuY2MuMS5zdGF0cy5yeF90cnVuYzM6 IDAKZGV2LmNjLjEuc3RhdHMucnhfdHJ1bmMyOiAwCmRldi5jYy4xLnN0YXRzLnJ4X3RydW5jMTog MApkZXYuY2MuMS5zdGF0cy5yeF90cnVuYzA6IDAKZGV2LmNjLjEuc3RhdHMucnhfb3ZmbG93Mzog MApkZXYuY2MuMS5zdGF0cy5yeF9vdmZsb3cyOiAwCmRldi5jYy4xLnN0YXRzLnJ4X292ZmxvdzE6 IDAKZGV2LmNjLjEuc3RhdHMucnhfb3ZmbG93MDogMApkZXYuY2MuMS5zdGF0cy5yeF9wcHA3OiAw CmRldi5jYy4xLnN0YXRzLnJ4X3BwcDY6IDAKZGV2LmNjLjEuc3RhdHMucnhfcHBwNTogMApkZXYu Y2MuMS5zdGF0cy5yeF9wcHA0OiAwCmRldi5jYy4xLnN0YXRzLnJ4X3BwcDM6IDAKZGV2LmNjLjEu c3RhdHMucnhfcHBwMjogMApkZXYuY2MuMS5zdGF0cy5yeF9wcHAxOiAwCmRldi5jYy4xLnN0YXRz LnJ4X3BwcDA6IDAKZGV2LmNjLjEuc3RhdHMucnhfcGF1c2U6IDAKZGV2LmNjLjEuc3RhdHMucnhf ZnJhbWVzXzE1MTlfbWF4OiAwCmRldi5jYy4xLnN0YXRzLnJ4X2ZyYW1lc18xMDI0XzE1MTg6IDAK ZGV2LmNjLjEuc3RhdHMucnhfZnJhbWVzXzUxMl8xMDIzOiAwCmRldi5jYy4xLnN0YXRzLnJ4X2Zy YW1lc18yNTZfNTExOiAwCmRldi5jYy4xLnN0YXRzLnJ4X2ZyYW1lc18xMjhfMjU1OiA4NzY1MzIK ZGV2LmNjLjEuc3RhdHMucnhfZnJhbWVzXzY1XzEyNzogMTEwNDI0MTEKZGV2LmNjLjEuc3RhdHMu cnhfZnJhbWVzXzY0OiAxCmRldi5jYy4xLnN0YXRzLnJ4X3J1bnQ6IDAKZGV2LmNjLjEuc3RhdHMu cnhfc3ltYm9sX2VycjogMApkZXYuY2MuMS5zdGF0cy5yeF9sZW5fZXJyOiAwCmRldi5jYy4xLnN0 YXRzLnJ4X2Zjc19lcnI6IDAKZGV2LmNjLjEuc3RhdHMucnhfamFiYmVyOiAwCmRldi5jYy4xLnN0 YXRzLnJ4X3Rvb19sb25nOiAwCmRldi5jYy4xLnN0YXRzLnJ4X3VjYXN0X2ZyYW1lczogMTE5MTg5 NDQKZGV2LmNjLjEuc3RhdHMucnhfbWNhc3RfZnJhbWVzOiAwCmRldi5jYy4xLnN0YXRzLnJ4X2Jj YXN0X2ZyYW1lczogMApkZXYuY2MuMS5zdGF0cy5yeF9mcmFtZXM6IDExOTE4OTQ0CmRldi5jYy4x LnN0YXRzLnJ4X29jdGV0czogMTUxMjMyMDEzOApkZXYuY2MuMS5zdGF0cy50eF9wcHA3OiAwCmRl di5jYy4xLnN0YXRzLnR4X3BwcDY6IDAKZGV2LmNjLjEuc3RhdHMudHhfcHBwNTogMApkZXYuY2Mu MS5zdGF0cy50eF9wcHA0OiAwCmRldi5jYy4xLnN0YXRzLnR4X3BwcDM6IDAKZGV2LmNjLjEuc3Rh dHMudHhfcHBwMjogMApkZXYuY2MuMS5zdGF0cy50eF9wcHAxOiAwCmRldi5jYy4xLnN0YXRzLnR4 X3BwcDA6IDAKZGV2LmNjLjEuc3RhdHMudHhfcGF1c2U6IDAKZGV2LmNjLjEuc3RhdHMudHhfZHJv cDogMApkZXYuY2MuMS5zdGF0cy50eF9mcmFtZXNfMTUxOV9tYXg6IDAKZGV2LmNjLjEuc3RhdHMu dHhfZnJhbWVzXzEwMjRfMTUxODogMjI5NDI0MDkKZGV2LmNjLjEuc3RhdHMudHhfZnJhbWVzXzUx Ml8xMDIzOiAyNgpkZXYuY2MuMS5zdGF0cy50eF9mcmFtZXNfMjU2XzUxMTogMjEKZGV2LmNjLjEu c3RhdHMudHhfZnJhbWVzXzEyOF8yNTU6IDI2OApkZXYuY2MuMS5zdGF0cy50eF9mcmFtZXNfNjVf MTI3OiA2NTYyMTcKZGV2LmNjLjEuc3RhdHMudHhfZnJhbWVzXzY0OiAxCmRldi5jYy4xLnN0YXRz LnR4X2Vycm9yX2ZyYW1lczogMApkZXYuY2MuMS5zdGF0cy50eF91Y2FzdF9mcmFtZXM6IDIzNTk4 OTQxCmRldi5jYy4xLnN0YXRzLnR4X21jYXN0X2ZyYW1lczogMApkZXYuY2MuMS5zdGF0cy50eF9i Y2FzdF9mcmFtZXM6IDEKZGV2LmNjLjEuc3RhdHMudHhfZnJhbWVzOiAyMzU5ODk0MgpkZXYuY2Mu MS5zdGF0cy50eF9vY3RldHM6IDMzODk5ODU4NjIyCmRldi5jYy4xLnN0YXRzLnR4X3BhcnNlX2Vy cm9yOiAwCmRldi5jYy4xLnRjLjE1LnBhcmFtczogMUdicHMgYWdncmVnYXRlCmRldi5jYy4xLnRj LjE1LnJlZmNvdW50OiAwCmRldi5jYy4xLnRjLjE1LmZsYWdzOiAwCmRldi5jYy4xLnRjLjE0LnBh cmFtczogMUdicHMgYWdncmVnYXRlCmRldi5jYy4xLnRjLjE0LnJlZmNvdW50OiAwCmRldi5jYy4x LnRjLjE0LmZsYWdzOiAwCmRldi5jYy4xLnRjLjEzLnBhcmFtczogMUdicHMgYWdncmVnYXRlCmRl di5jYy4xLnRjLjEzLnJlZmNvdW50OiAwCmRldi5jYy4xLnRjLjEzLmZsYWdzOiAwCmRldi5jYy4x LnRjLjEyLnBhcmFtczogMUdicHMgYWdncmVnYXRlCmRldi5jYy4xLnRjLjEyLnJlZmNvdW50OiAw CmRldi5jYy4xLnRjLjEyLmZsYWdzOiAwCmRldi5jYy4xLnRjLjExLnBhcmFtczogMUdicHMgYWdn cmVnYXRlCmRldi5jYy4xLnRjLjExLnJlZmNvdW50OiAwCmRldi5jYy4xLnRjLjExLmZsYWdzOiAw CmRldi5jYy4xLnRjLjEwLnBhcmFtczogMUdicHMgYWdncmVnYXRlCmRldi5jYy4xLnRjLjEwLnJl ZmNvdW50OiAwCmRldi5jYy4xLnRjLjEwLmZsYWdzOiAwCmRldi5jYy4xLnRjLjkucGFyYW1zOiAx R2JwcyBhZ2dyZWdhdGUKZGV2LmNjLjEudGMuOS5yZWZjb3VudDogMApkZXYuY2MuMS50Yy45LmZs YWdzOiAwCmRldi5jYy4xLnRjLjgucGFyYW1zOiAxR2JwcyBhZ2dyZWdhdGUKZGV2LmNjLjEudGMu OC5yZWZjb3VudDogMApkZXYuY2MuMS50Yy44LmZsYWdzOiAwCmRldi5jYy4xLnRjLjcucGFyYW1z OiAxR2JwcyBhZ2dyZWdhdGUKZGV2LmNjLjEudGMuNy5yZWZjb3VudDogMApkZXYuY2MuMS50Yy43 LmZsYWdzOiAwCmRldi5jYy4xLnRjLjYucGFyYW1zOiAxR2JwcyBhZ2dyZWdhdGUKZGV2LmNjLjEu dGMuNi5yZWZjb3VudDogMApkZXYuY2MuMS50Yy42LmZsYWdzOiAwCmRldi5jYy4xLnRjLjUucGFy YW1zOiAxR2JwcyBhZ2dyZWdhdGUKZGV2LmNjLjEudGMuNS5yZWZjb3VudDogMApkZXYuY2MuMS50 Yy41LmZsYWdzOiAwCmRldi5jYy4xLnRjLjQucGFyYW1zOiAxR2JwcyBhZ2dyZWdhdGUKZGV2LmNj LjEudGMuNC5yZWZjb3VudDogMApkZXYuY2MuMS50Yy40LmZsYWdzOiAwCmRldi5jYy4xLnRjLjMu cGFyYW1zOiAxR2JwcyBhZ2dyZWdhdGUKZGV2LmNjLjEudGMuMy5yZWZjb3VudDogMApkZXYuY2Mu MS50Yy4zLmZsYWdzOiAwCmRldi5jYy4xLnRjLjIucGFyYW1zOiAxR2JwcyBhZ2dyZWdhdGUKZGV2 LmNjLjEudGMuMi5yZWZjb3VudDogMApkZXYuY2MuMS50Yy4yLmZsYWdzOiAwCmRldi5jYy4xLnRj LjEucGFyYW1zOiAxR2JwcyBhZ2dyZWdhdGUKZGV2LmNjLjEudGMuMS5yZWZjb3VudDogMApkZXYu Y2MuMS50Yy4xLmZsYWdzOiAwCmRldi5jYy4xLnRjLjAucGFyYW1zOiAxR2JwcyBhZ2dyZWdhdGUK ZGV2LmNjLjEudGMuMC5yZWZjb3VudDogMApkZXYuY2MuMS50Yy4wLmZsYWdzOiAwCmRldi5jYy4x LnRjLmJ1cnN0c2l6ZTogMApkZXYuY2MuMS50Yy5wa3RzaXplOiAwCmRldi5jYy4xLnJ4X2NfY2hh bjogMApkZXYuY2MuMS5yeF9lX2NoYW5fbWFwOiAyCmRldi5jYy4xLm1wc19iZ19tYXA6IDEyCmRl di5jYy4xLm1heF9zcGVlZDogMTAwCmRldi5jYy4xLmxwYWNhcHM6IDQ1ODc1MgpkZXYuY2MuMS5h Y2FwczogNTQ1NzE4MzM2CmRldi5jYy4xLnBjYXBzOiA4NjUwMDk3OTAKZGV2LmNjLjEuYXV0b25l ZzogLTEKZGV2LmNjLjEubW9kdWxlX2ZlYzogMTxSUy1GRUM+CmRldi5jYy4xLmZlYzogMjE8UlMt RkVDLGF1dG8+CmRldi5jYy4xLnBhdXNlX3NldHRpbmdzOiA3PFJYLFRYLEFVVE8+CmRldi5jYy4x LmxpbmtkbnJjOiBuL2EKZGV2LmNjLjEucXNpemVfdHhxOiAxMDI0CmRldi5jYy4xLnFzaXplX3J4 cTogMTAyNApkZXYuY2MuMS5ob2xkb2ZmX3BrdGNfaWR4OiAtMQpkZXYuY2MuMS5ob2xkb2ZmX3Rt cl9pZHg6IDEKZGV2LmNjLjEuZmlyc3Rfb2ZsZF90eHE6IDgKZGV2LmNjLjEubm9mbGR0eHE6IDgK ZGV2LmNjLjEuaG9sZG9mZl9wa3RjX2lkeF9vZmxkOiAtMQpkZXYuY2MuMS5ob2xkb2ZmX3Rtcl9p ZHhfb2ZsZDogMQpkZXYuY2MuMS5maXJzdF9vZmxkX3J4cTogMgpkZXYuY2MuMS5ub2ZsZHJ4cTog MgpkZXYuY2MuMS50eF92bV93cjogMApkZXYuY2MuMS5yc3J2X25vZmxvd3E6IDAKZGV2LmNjLjEu cnNzX3NpemU6IDEyOApkZXYuY2MuMS5yc3NfYmFzZTogMTI4CmRldi5jYy4xLmZpcnN0X3R4cTog MTYKZGV2LmNjLjEuZmlyc3RfcnhxOiA4CmRldi5jYy4xLm50eHE6IDE2CmRldi5jYy4xLm5yeHE6 IDgKZGV2LmNjLjEudmlpZDogMjM3MwpkZXYuY2MuMS4lZG9tYWluOiAwCmRldi5jYy4xLiVwYXJl bnQ6IHQ2bmV4MApkZXYuY2MuMS4lcG5waW5mbzogCmRldi5jYy4xLiVsb2NhdGlvbjogcG9ydD0x CmRldi5jYy4xLiVkcml2ZXI6IGNjCmRldi5jYy4xLiVkZXNjOiBwb3J0IDEKZGV2LmNjLjAub2Zs ZF90eHEuNy50eF90b2VfdGxzX29jdGV0czogMApkZXYuY2MuMC5vZmxkX3R4cS43LnR4X3RvZV90 bHNfcmVjb3JkczogMApkZXYuY2MuMC5vZmxkX3R4cS43LnR4X2lzY3NpX29jdGV0czogMApkZXYu Y2MuMC5vZmxkX3R4cS43LnR4X2lzY3NpX3BkdXM6IDAKZGV2LmNjLjAub2ZsZF90eHEuNy50eF93 cnNfc3NwYWNlOiAwCmRldi5jYy4wLm9mbGRfdHhxLjcudHhfd3JzX2NvcGllZDogMApkZXYuY2Mu MC5vZmxkX3R4cS43LnR4X3dyc19kaXJlY3Q6IDAKZGV2LmNjLjAub2ZsZF90eHEuNy5zaWR4OiAx MDIzCmRldi5jYy4wLm9mbGRfdHhxLjcucGlkeDogMApkZXYuY2MuMC5vZmxkX3R4cS43LmNpZHg6 IDAKZGV2LmNjLjAub2ZsZF90eHEuNy5jbnR4dF9pZDogNTEKZGV2LmNjLjAub2ZsZF90eHEuNy5k bWFsZW46IDY1NTM2CmRldi5jYy4wLm9mbGRfdHhxLjcuYmE6IDI0OTE0NjkwMDQ4CmRldi5jYy4w Lm9mbGRfdHhxLjYudHhfdG9lX3Rsc19vY3RldHM6IDAKZGV2LmNjLjAub2ZsZF90eHEuNi50eF90 b2VfdGxzX3JlY29yZHM6IDAKZGV2LmNjLjAub2ZsZF90eHEuNi50eF9pc2NzaV9vY3RldHM6IDAK ZGV2LmNjLjAub2ZsZF90eHEuNi50eF9pc2NzaV9wZHVzOiAwCmRldi5jYy4wLm9mbGRfdHhxLjYu dHhfd3JzX3NzcGFjZTogMApkZXYuY2MuMC5vZmxkX3R4cS42LnR4X3dyc19jb3BpZWQ6IDAKZGV2 LmNjLjAub2ZsZF90eHEuNi50eF93cnNfZGlyZWN0OiAwCmRldi5jYy4wLm9mbGRfdHhxLjYuc2lk eDogMTAyMwpkZXYuY2MuMC5vZmxkX3R4cS42LnBpZHg6IDAKZGV2LmNjLjAub2ZsZF90eHEuNi5j aWR4OiAwCmRldi5jYy4wLm9mbGRfdHhxLjYuY250eHRfaWQ6IDUwCmRldi5jYy4wLm9mbGRfdHhx LjYuZG1hbGVuOiA2NTUzNgpkZXYuY2MuMC5vZmxkX3R4cS42LmJhOiAyNDg1ODAwMTQwOApkZXYu Y2MuMC5vZmxkX3R4cS41LnR4X3RvZV90bHNfb2N0ZXRzOiAwCmRldi5jYy4wLm9mbGRfdHhxLjUu dHhfdG9lX3Rsc19yZWNvcmRzOiAwCmRldi5jYy4wLm9mbGRfdHhxLjUudHhfaXNjc2lfb2N0ZXRz OiAwCmRldi5jYy4wLm9mbGRfdHhxLjUudHhfaXNjc2lfcGR1czogMApkZXYuY2MuMC5vZmxkX3R4 cS41LnR4X3dyc19zc3BhY2U6IDAKZGV2LmNjLjAub2ZsZF90eHEuNS50eF93cnNfY29waWVkOiAw CmRldi5jYy4wLm9mbGRfdHhxLjUudHhfd3JzX2RpcmVjdDogMApkZXYuY2MuMC5vZmxkX3R4cS41 LnNpZHg6IDEwMjMKZGV2LmNjLjAub2ZsZF90eHEuNS5waWR4OiAwCmRldi5jYy4wLm9mbGRfdHhx LjUuY2lkeDogMApkZXYuY2MuMC5vZmxkX3R4cS41LmNudHh0X2lkOiA0OQpkZXYuY2MuMC5vZmxk X3R4cS41LmRtYWxlbjogNjU1MzYKZGV2LmNjLjAub2ZsZF90eHEuNS5iYTogMjQ4NTc5MzU4NzIK ZGV2LmNjLjAub2ZsZF90eHEuNC50eF90b2VfdGxzX29jdGV0czogMApkZXYuY2MuMC5vZmxkX3R4 cS40LnR4X3RvZV90bHNfcmVjb3JkczogMApkZXYuY2MuMC5vZmxkX3R4cS40LnR4X2lzY3NpX29j dGV0czogMApkZXYuY2MuMC5vZmxkX3R4cS40LnR4X2lzY3NpX3BkdXM6IDAKZGV2LmNjLjAub2Zs ZF90eHEuNC50eF93cnNfc3NwYWNlOiAwCmRldi5jYy4wLm9mbGRfdHhxLjQudHhfd3JzX2NvcGll ZDogMApkZXYuY2MuMC5vZmxkX3R4cS40LnR4X3dyc19kaXJlY3Q6IDAKZGV2LmNjLjAub2ZsZF90 eHEuNC5zaWR4OiAxMDIzCmRldi5jYy4wLm9mbGRfdHhxLjQucGlkeDogMApkZXYuY2MuMC5vZmxk X3R4cS40LmNpZHg6IDAKZGV2LmNjLjAub2ZsZF90eHEuNC5jbnR4dF9pZDogNDgKZGV2LmNjLjAu b2ZsZF90eHEuNC5kbWFsZW46IDY1NTM2CmRldi5jYy4wLm9mbGRfdHhxLjQuYmE6IDI0ODU5MDQ5 OTg0CmRldi5jYy4wLm9mbGRfdHhxLjMudHhfdG9lX3Rsc19vY3RldHM6IDAKZGV2LmNjLjAub2Zs ZF90eHEuMy50eF90b2VfdGxzX3JlY29yZHM6IDAKZGV2LmNjLjAub2ZsZF90eHEuMy50eF9pc2Nz aV9vY3RldHM6IDAKZGV2LmNjLjAub2ZsZF90eHEuMy50eF9pc2NzaV9wZHVzOiAwCmRldi5jYy4w Lm9mbGRfdHhxLjMudHhfd3JzX3NzcGFjZTogMApkZXYuY2MuMC5vZmxkX3R4cS4zLnR4X3dyc19j b3BpZWQ6IDAKZGV2LmNjLjAub2ZsZF90eHEuMy50eF93cnNfZGlyZWN0OiAwCmRldi5jYy4wLm9m bGRfdHhxLjMuc2lkeDogMTAyMwpkZXYuY2MuMC5vZmxkX3R4cS4zLnBpZHg6IDAKZGV2LmNjLjAu b2ZsZF90eHEuMy5jaWR4OiAwCmRldi5jYy4wLm9mbGRfdHhxLjMuY250eHRfaWQ6IDQ3CmRldi5j Yy4wLm9mbGRfdHhxLjMuZG1hbGVuOiA2NTUzNgpkZXYuY2MuMC5vZmxkX3R4cS4zLmJhOiAyNDg1 Nzg3MDMzNgpkZXYuY2MuMC5vZmxkX3R4cS4yLnR4X3RvZV90bHNfb2N0ZXRzOiAwCmRldi5jYy4w Lm9mbGRfdHhxLjIudHhfdG9lX3Rsc19yZWNvcmRzOiAwCmRldi5jYy4wLm9mbGRfdHhxLjIudHhf aXNjc2lfb2N0ZXRzOiAwCmRldi5jYy4wLm9mbGRfdHhxLjIudHhfaXNjc2lfcGR1czogMApkZXYu Y2MuMC5vZmxkX3R4cS4yLnR4X3dyc19zc3BhY2U6IDAKZGV2LmNjLjAub2ZsZF90eHEuMi50eF93 cnNfY29waWVkOiAwCmRldi5jYy4wLm9mbGRfdHhxLjIudHhfd3JzX2RpcmVjdDogMApkZXYuY2Mu MC5vZmxkX3R4cS4yLnNpZHg6IDEwMjMKZGV2LmNjLjAub2ZsZF90eHEuMi5waWR4OiAwCmRldi5j Yy4wLm9mbGRfdHhxLjIuY2lkeDogMApkZXYuY2MuMC5vZmxkX3R4cS4yLmNudHh0X2lkOiA0Ngpk ZXYuY2MuMC5vZmxkX3R4cS4yLmRtYWxlbjogNjU1MzYKZGV2LmNjLjAub2ZsZF90eHEuMi5iYTog MjQ1OTEwODk2NjQKZGV2LmNjLjAub2ZsZF90eHEuMS50eF90b2VfdGxzX29jdGV0czogMApkZXYu Y2MuMC5vZmxkX3R4cS4xLnR4X3RvZV90bHNfcmVjb3JkczogMApkZXYuY2MuMC5vZmxkX3R4cS4x LnR4X2lzY3NpX29jdGV0czogMApkZXYuY2MuMC5vZmxkX3R4cS4xLnR4X2lzY3NpX3BkdXM6IDAK ZGV2LmNjLjAub2ZsZF90eHEuMS50eF93cnNfc3NwYWNlOiAwCmRldi5jYy4wLm9mbGRfdHhxLjEu dHhfd3JzX2NvcGllZDogMApkZXYuY2MuMC5vZmxkX3R4cS4xLnR4X3dyc19kaXJlY3Q6IDAKZGV2 LmNjLjAub2ZsZF90eHEuMS5zaWR4OiAxMDIzCmRldi5jYy4wLm9mbGRfdHhxLjEucGlkeDogMApk ZXYuY2MuMC5vZmxkX3R4cS4xLmNpZHg6IDAKZGV2LmNjLjAub2ZsZF90eHEuMS5jbnR4dF9pZDog NDUKZGV2LmNjLjAub2ZsZF90eHEuMS5kbWFsZW46IDY1NTM2CmRldi5jYy4wLm9mbGRfdHhxLjEu YmE6IDI0NTkxMDI0MTI4CmRldi5jYy4wLm9mbGRfdHhxLjAudHhfdG9lX3Rsc19vY3RldHM6IDAK ZGV2LmNjLjAub2ZsZF90eHEuMC50eF90b2VfdGxzX3JlY29yZHM6IDAKZGV2LmNjLjAub2ZsZF90 eHEuMC50eF9pc2NzaV9vY3RldHM6IDAKZGV2LmNjLjAub2ZsZF90eHEuMC50eF9pc2NzaV9wZHVz OiAwCmRldi5jYy4wLm9mbGRfdHhxLjAudHhfd3JzX3NzcGFjZTogMApkZXYuY2MuMC5vZmxkX3R4 cS4wLnR4X3dyc19jb3BpZWQ6IDAKZGV2LmNjLjAub2ZsZF90eHEuMC50eF93cnNfZGlyZWN0OiAw CmRldi5jYy4wLm9mbGRfdHhxLjAuc2lkeDogMTAyMwpkZXYuY2MuMC5vZmxkX3R4cS4wLnBpZHg6 IDAKZGV2LmNjLjAub2ZsZF90eHEuMC5jaWR4OiAwCmRldi5jYy4wLm9mbGRfdHhxLjAuY250eHRf aWQ6IDQ0CmRldi5jYy4wLm9mbGRfdHhxLjAuZG1hbGVuOiA2NTUzNgpkZXYuY2MuMC5vZmxkX3R4 cS4wLmJhOiAyNDU5MDk1ODU5MgpkZXYuY2MuMC50eHEuMTUubXBfcmluZy5jb25zX2lkbGUyOiAw CmRldi5jYy4wLnR4cS4xNS5tcF9yaW5nLmNvbnNfaWRsZTogMApkZXYuY2MuMC50eHEuMTUubXBf cmluZy5zdGFsbHM6IDAKZGV2LmNjLjAudHhxLjE1Lm1wX3JpbmcuYWJkaWNhdGlvbnM6IDAKZGV2 LmNjLjAudHhxLjE1Lm1wX3Jpbmcubm90X2NvbnN1bWVyOiAwCmRldi5jYy4wLnR4cS4xNS5tcF9y aW5nLnRha2VvdmVyczogMApkZXYuY2MuMC50eHEuMTUubXBfcmluZy5jb25zdW1lcjM6IDAKZGV2 LmNjLjAudHhxLjE1Lm1wX3JpbmcuY29uc3VtZXIyOiAwCmRldi5jYy4wLnR4cS4xNS5tcF9yaW5n LmZhc3RfY29uc3VtZXI6IDAKZGV2LmNjLjAudHhxLjE1Lm1wX3JpbmcuY29uc3VtZWQ6IDAKZGV2 LmNjLjAudHhxLjE1Lm1wX3JpbmcuZHJvcHBlZDogMApkZXYuY2MuMC50eHEuMTUubXBfcmluZy5z dGF0ZTogMApkZXYuY2MuMC50eHEuMTUudnhsYW5fdHhjc3VtOiAwCmRldi5jYy4wLnR4cS4xNS52 eGxhbl90c29fd3JzOiAwCmRldi5jYy4wLnR4cS4xNS5yYXdfd3JzOiAwCmRldi5jYy4wLnR4cS4x NS50eHBrdHNfZmx1c2g6IDAKZGV2LmNjLjAudHhxLjE1LnR4cGt0czFfcGt0czogMApkZXYuY2Mu MC50eHEuMTUudHhwa3RzMF9wa3RzOiAwCmRldi5jYy4wLnR4cS4xNS50eHBrdHMxX3dyczogMApk ZXYuY2MuMC50eHEuMTUudHhwa3RzMF93cnM6IDAKZGV2LmNjLjAudHhxLjE1LnR4cGt0X3dyczog MApkZXYuY2MuMC50eHEuMTUuc2dsX3dyczogMApkZXYuY2MuMC50eHEuMTUuaW1tX3dyczogMApk ZXYuY2MuMC50eHEuMTUudHNvX3dyczogMApkZXYuY2MuMC50eHEuMTUudmxhbl9pbnNlcnRpb246 IDAKZGV2LmNjLjAudHhxLjE1LnR4Y3N1bTogMApkZXYuY2MuMC50eHEuMTUudGM6IC0xCmRldi5j Yy4wLnR4cS4xNS5zaWR4OiAxMDIzCmRldi5jYy4wLnR4cS4xNS5waWR4OiAwCmRldi5jYy4wLnR4 cS4xNS5jaWR4OiAwCmRldi5jYy4wLnR4cS4xNS5jbnR4dF9pZDogNDMKZGV2LmNjLjAudHhxLjE1 LmFic19pZDogNDMKZGV2LmNjLjAudHhxLjE1LmRtYWxlbjogNjU1MzYKZGV2LmNjLjAudHhxLjE1 LmJhOiAyNDU5MDg3NjY3MgpkZXYuY2MuMC50eHEuMTQubXBfcmluZy5jb25zX2lkbGUyOiAwCmRl di5jYy4wLnR4cS4xNC5tcF9yaW5nLmNvbnNfaWRsZTogMApkZXYuY2MuMC50eHEuMTQubXBfcmlu Zy5zdGFsbHM6IDAKZGV2LmNjLjAudHhxLjE0Lm1wX3JpbmcuYWJkaWNhdGlvbnM6IDAKZGV2LmNj LjAudHhxLjE0Lm1wX3Jpbmcubm90X2NvbnN1bWVyOiAwCmRldi5jYy4wLnR4cS4xNC5tcF9yaW5n LnRha2VvdmVyczogMApkZXYuY2MuMC50eHEuMTQubXBfcmluZy5jb25zdW1lcjM6IDAKZGV2LmNj LjAudHhxLjE0Lm1wX3JpbmcuY29uc3VtZXIyOiAwCmRldi5jYy4wLnR4cS4xNC5tcF9yaW5nLmZh c3RfY29uc3VtZXI6IDAKZGV2LmNjLjAudHhxLjE0Lm1wX3JpbmcuY29uc3VtZWQ6IDAKZGV2LmNj LjAudHhxLjE0Lm1wX3JpbmcuZHJvcHBlZDogMApkZXYuY2MuMC50eHEuMTQubXBfcmluZy5zdGF0 ZTogMApkZXYuY2MuMC50eHEuMTQudnhsYW5fdHhjc3VtOiAwCmRldi5jYy4wLnR4cS4xNC52eGxh bl90c29fd3JzOiAwCmRldi5jYy4wLnR4cS4xNC5yYXdfd3JzOiAwCmRldi5jYy4wLnR4cS4xNC50 eHBrdHNfZmx1c2g6IDAKZGV2LmNjLjAudHhxLjE0LnR4cGt0czFfcGt0czogMApkZXYuY2MuMC50 eHEuMTQudHhwa3RzMF9wa3RzOiAwCmRldi5jYy4wLnR4cS4xNC50eHBrdHMxX3dyczogMApkZXYu Y2MuMC50eHEuMTQudHhwa3RzMF93cnM6IDAKZGV2LmNjLjAudHhxLjE0LnR4cGt0X3dyczogMApk ZXYuY2MuMC50eHEuMTQuc2dsX3dyczogMApkZXYuY2MuMC50eHEuMTQuaW1tX3dyczogMApkZXYu Y2MuMC50eHEuMTQudHNvX3dyczogMApkZXYuY2MuMC50eHEuMTQudmxhbl9pbnNlcnRpb246IDAK ZGV2LmNjLjAudHhxLjE0LnR4Y3N1bTogMApkZXYuY2MuMC50eHEuMTQudGM6IC0xCmRldi5jYy4w LnR4cS4xNC5zaWR4OiAxMDIzCmRldi5jYy4wLnR4cS4xNC5waWR4OiAwCmRldi5jYy4wLnR4cS4x NC5jaWR4OiAwCmRldi5jYy4wLnR4cS4xNC5jbnR4dF9pZDogNDIKZGV2LmNjLjAudHhxLjE0LmFi c19pZDogNDIKZGV2LmNjLjAudHhxLjE0LmRtYWxlbjogNjU1MzYKZGV2LmNjLjAudHhxLjE0LmJh OiAyNDU5MDc3ODM2OApkZXYuY2MuMC50eHEuMTMubXBfcmluZy5jb25zX2lkbGUyOiAwCmRldi5j Yy4wLnR4cS4xMy5tcF9yaW5nLmNvbnNfaWRsZTogMApkZXYuY2MuMC50eHEuMTMubXBfcmluZy5z dGFsbHM6IDAKZGV2LmNjLjAudHhxLjEzLm1wX3JpbmcuYWJkaWNhdGlvbnM6IDAKZGV2LmNjLjAu dHhxLjEzLm1wX3Jpbmcubm90X2NvbnN1bWVyOiAwCmRldi5jYy4wLnR4cS4xMy5tcF9yaW5nLnRh a2VvdmVyczogMApkZXYuY2MuMC50eHEuMTMubXBfcmluZy5jb25zdW1lcjM6IDAKZGV2LmNjLjAu dHhxLjEzLm1wX3JpbmcuY29uc3VtZXIyOiAwCmRldi5jYy4wLnR4cS4xMy5tcF9yaW5nLmZhc3Rf Y29uc3VtZXI6IDAKZGV2LmNjLjAudHhxLjEzLm1wX3JpbmcuY29uc3VtZWQ6IDAKZGV2LmNjLjAu dHhxLjEzLm1wX3JpbmcuZHJvcHBlZDogMApkZXYuY2MuMC50eHEuMTMubXBfcmluZy5zdGF0ZTog MApkZXYuY2MuMC50eHEuMTMudnhsYW5fdHhjc3VtOiAwCmRldi5jYy4wLnR4cS4xMy52eGxhbl90 c29fd3JzOiAwCmRldi5jYy4wLnR4cS4xMy5yYXdfd3JzOiAwCmRldi5jYy4wLnR4cS4xMy50eHBr dHNfZmx1c2g6IDAKZGV2LmNjLjAudHhxLjEzLnR4cGt0czFfcGt0czogMApkZXYuY2MuMC50eHEu MTMudHhwa3RzMF9wa3RzOiAwCmRldi5jYy4wLnR4cS4xMy50eHBrdHMxX3dyczogMApkZXYuY2Mu MC50eHEuMTMudHhwa3RzMF93cnM6IDAKZGV2LmNjLjAudHhxLjEzLnR4cGt0X3dyczogMApkZXYu Y2MuMC50eHEuMTMuc2dsX3dyczogMApkZXYuY2MuMC50eHEuMTMuaW1tX3dyczogMApkZXYuY2Mu MC50eHEuMTMudHNvX3dyczogMApkZXYuY2MuMC50eHEuMTMudmxhbl9pbnNlcnRpb246IDAKZGV2 LmNjLjAudHhxLjEzLnR4Y3N1bTogMApkZXYuY2MuMC50eHEuMTMudGM6IC0xCmRldi5jYy4wLnR4 cS4xMy5zaWR4OiAxMDIzCmRldi5jYy4wLnR4cS4xMy5waWR4OiAwCmRldi5jYy4wLnR4cS4xMy5j aWR4OiAwCmRldi5jYy4wLnR4cS4xMy5jbnR4dF9pZDogNDEKZGV2LmNjLjAudHhxLjEzLmFic19p ZDogNDEKZGV2LmNjLjAudHhxLjEzLmRtYWxlbjogNjU1MzYKZGV2LmNjLjAudHhxLjEzLmJhOiAy NDU5MDY4MDA2NApkZXYuY2MuMC50eHEuMTIubXBfcmluZy5jb25zX2lkbGUyOiAwCmRldi5jYy4w LnR4cS4xMi5tcF9yaW5nLmNvbnNfaWRsZTogMApkZXYuY2MuMC50eHEuMTIubXBfcmluZy5zdGFs bHM6IDAKZGV2LmNjLjAudHhxLjEyLm1wX3JpbmcuYWJkaWNhdGlvbnM6IDAKZGV2LmNjLjAudHhx LjEyLm1wX3Jpbmcubm90X2NvbnN1bWVyOiAwCmRldi5jYy4wLnR4cS4xMi5tcF9yaW5nLnRha2Vv dmVyczogMApkZXYuY2MuMC50eHEuMTIubXBfcmluZy5jb25zdW1lcjM6IDAKZGV2LmNjLjAudHhx LjEyLm1wX3JpbmcuY29uc3VtZXIyOiAwCmRldi5jYy4wLnR4cS4xMi5tcF9yaW5nLmZhc3RfY29u c3VtZXI6IDAKZGV2LmNjLjAudHhxLjEyLm1wX3JpbmcuY29uc3VtZWQ6IDAKZGV2LmNjLjAudHhx LjEyLm1wX3JpbmcuZHJvcHBlZDogMApkZXYuY2MuMC50eHEuMTIubXBfcmluZy5zdGF0ZTogMApk ZXYuY2MuMC50eHEuMTIudnhsYW5fdHhjc3VtOiAwCmRldi5jYy4wLnR4cS4xMi52eGxhbl90c29f d3JzOiAwCmRldi5jYy4wLnR4cS4xMi5yYXdfd3JzOiAwCmRldi5jYy4wLnR4cS4xMi50eHBrdHNf Zmx1c2g6IDAKZGV2LmNjLjAudHhxLjEyLnR4cGt0czFfcGt0czogMApkZXYuY2MuMC50eHEuMTIu dHhwa3RzMF9wa3RzOiAwCmRldi5jYy4wLnR4cS4xMi50eHBrdHMxX3dyczogMApkZXYuY2MuMC50 eHEuMTIudHhwa3RzMF93cnM6IDAKZGV2LmNjLjAudHhxLjEyLnR4cGt0X3dyczogMApkZXYuY2Mu MC50eHEuMTIuc2dsX3dyczogMApkZXYuY2MuMC50eHEuMTIuaW1tX3dyczogMApkZXYuY2MuMC50 eHEuMTIudHNvX3dyczogMApkZXYuY2MuMC50eHEuMTIudmxhbl9pbnNlcnRpb246IDAKZGV2LmNj LjAudHhxLjEyLnR4Y3N1bTogMApkZXYuY2MuMC50eHEuMTIudGM6IC0xCmRldi5jYy4wLnR4cS4x Mi5zaWR4OiAxMDIzCmRldi5jYy4wLnR4cS4xMi5waWR4OiAwCmRldi5jYy4wLnR4cS4xMi5jaWR4 OiAwCmRldi5jYy4wLnR4cS4xMi5jbnR4dF9pZDogNDAKZGV2LmNjLjAudHhxLjEyLmFic19pZDog NDAKZGV2LmNjLjAudHhxLjEyLmRtYWxlbjogNjU1MzYKZGV2LmNjLjAudHhxLjEyLmJhOiAyNDU5 MDU4MTc2MApkZXYuY2MuMC50eHEuMTEubXBfcmluZy5jb25zX2lkbGUyOiAwCmRldi5jYy4wLnR4 cS4xMS5tcF9yaW5nLmNvbnNfaWRsZTogMApkZXYuY2MuMC50eHEuMTEubXBfcmluZy5zdGFsbHM6 IDAKZGV2LmNjLjAudHhxLjExLm1wX3JpbmcuYWJkaWNhdGlvbnM6IDAKZGV2LmNjLjAudHhxLjEx Lm1wX3Jpbmcubm90X2NvbnN1bWVyOiAwCmRldi5jYy4wLnR4cS4xMS5tcF9yaW5nLnRha2VvdmVy czogMApkZXYuY2MuMC50eHEuMTEubXBfcmluZy5jb25zdW1lcjM6IDAKZGV2LmNjLjAudHhxLjEx Lm1wX3JpbmcuY29uc3VtZXIyOiAwCmRldi5jYy4wLnR4cS4xMS5tcF9yaW5nLmZhc3RfY29uc3Vt ZXI6IDAKZGV2LmNjLjAudHhxLjExLm1wX3JpbmcuY29uc3VtZWQ6IDAKZGV2LmNjLjAudHhxLjEx Lm1wX3JpbmcuZHJvcHBlZDogMApkZXYuY2MuMC50eHEuMTEubXBfcmluZy5zdGF0ZTogMApkZXYu Y2MuMC50eHEuMTEudnhsYW5fdHhjc3VtOiAwCmRldi5jYy4wLnR4cS4xMS52eGxhbl90c29fd3Jz OiAwCmRldi5jYy4wLnR4cS4xMS5yYXdfd3JzOiAwCmRldi5jYy4wLnR4cS4xMS50eHBrdHNfZmx1 c2g6IDAKZGV2LmNjLjAudHhxLjExLnR4cGt0czFfcGt0czogMApkZXYuY2MuMC50eHEuMTEudHhw a3RzMF9wa3RzOiAwCmRldi5jYy4wLnR4cS4xMS50eHBrdHMxX3dyczogMApkZXYuY2MuMC50eHEu MTEudHhwa3RzMF93cnM6IDAKZGV2LmNjLjAudHhxLjExLnR4cGt0X3dyczogMApkZXYuY2MuMC50 eHEuMTEuc2dsX3dyczogMApkZXYuY2MuMC50eHEuMTEuaW1tX3dyczogMApkZXYuY2MuMC50eHEu MTEudHNvX3dyczogMApkZXYuY2MuMC50eHEuMTEudmxhbl9pbnNlcnRpb246IDAKZGV2LmNjLjAu dHhxLjExLnR4Y3N1bTogMApkZXYuY2MuMC50eHEuMTEudGM6IC0xCmRldi5jYy4wLnR4cS4xMS5z aWR4OiAxMDIzCmRldi5jYy4wLnR4cS4xMS5waWR4OiAwCmRldi5jYy4wLnR4cS4xMS5jaWR4OiAw CmRldi5jYy4wLnR4cS4xMS5jbnR4dF9pZDogMzkKZGV2LmNjLjAudHhxLjExLmFic19pZDogMzkK ZGV2LmNjLjAudHhxLjExLmRtYWxlbjogNjU1MzYKZGV2LmNjLjAudHhxLjExLmJhOiAyNDU5MDQ4 MzQ1NgpkZXYuY2MuMC50eHEuMTAubXBfcmluZy5jb25zX2lkbGUyOiAwCmRldi5jYy4wLnR4cS4x MC5tcF9yaW5nLmNvbnNfaWRsZTogMApkZXYuY2MuMC50eHEuMTAubXBfcmluZy5zdGFsbHM6IDAK ZGV2LmNjLjAudHhxLjEwLm1wX3JpbmcuYWJkaWNhdGlvbnM6IDAKZGV2LmNjLjAudHhxLjEwLm1w X3Jpbmcubm90X2NvbnN1bWVyOiAwCmRldi5jYy4wLnR4cS4xMC5tcF9yaW5nLnRha2VvdmVyczog MApkZXYuY2MuMC50eHEuMTAubXBfcmluZy5jb25zdW1lcjM6IDAKZGV2LmNjLjAudHhxLjEwLm1w X3JpbmcuY29uc3VtZXIyOiAwCmRldi5jYy4wLnR4cS4xMC5tcF9yaW5nLmZhc3RfY29uc3VtZXI6 IDAKZGV2LmNjLjAudHhxLjEwLm1wX3JpbmcuY29uc3VtZWQ6IDAKZGV2LmNjLjAudHhxLjEwLm1w X3JpbmcuZHJvcHBlZDogMApkZXYuY2MuMC50eHEuMTAubXBfcmluZy5zdGF0ZTogMApkZXYuY2Mu MC50eHEuMTAudnhsYW5fdHhjc3VtOiAwCmRldi5jYy4wLnR4cS4xMC52eGxhbl90c29fd3JzOiAw CmRldi5jYy4wLnR4cS4xMC5yYXdfd3JzOiAwCmRldi5jYy4wLnR4cS4xMC50eHBrdHNfZmx1c2g6 IDAKZGV2LmNjLjAudHhxLjEwLnR4cGt0czFfcGt0czogMApkZXYuY2MuMC50eHEuMTAudHhwa3Rz MF9wa3RzOiAwCmRldi5jYy4wLnR4cS4xMC50eHBrdHMxX3dyczogMApkZXYuY2MuMC50eHEuMTAu dHhwa3RzMF93cnM6IDAKZGV2LmNjLjAudHhxLjEwLnR4cGt0X3dyczogMApkZXYuY2MuMC50eHEu MTAuc2dsX3dyczogMApkZXYuY2MuMC50eHEuMTAuaW1tX3dyczogMApkZXYuY2MuMC50eHEuMTAu dHNvX3dyczogMApkZXYuY2MuMC50eHEuMTAudmxhbl9pbnNlcnRpb246IDAKZGV2LmNjLjAudHhx LjEwLnR4Y3N1bTogMApkZXYuY2MuMC50eHEuMTAudGM6IC0xCmRldi5jYy4wLnR4cS4xMC5zaWR4 OiAxMDIzCmRldi5jYy4wLnR4cS4xMC5waWR4OiAwCmRldi5jYy4wLnR4cS4xMC5jaWR4OiAwCmRl di5jYy4wLnR4cS4xMC5jbnR4dF9pZDogMzgKZGV2LmNjLjAudHhxLjEwLmFic19pZDogMzgKZGV2 LmNjLjAudHhxLjEwLmRtYWxlbjogNjU1MzYKZGV2LmNjLjAudHhxLjEwLmJhOiAyNDU5MDM4NTE1 MgpkZXYuY2MuMC50eHEuOS5tcF9yaW5nLmNvbnNfaWRsZTI6IDAKZGV2LmNjLjAudHhxLjkubXBf cmluZy5jb25zX2lkbGU6IDAKZGV2LmNjLjAudHhxLjkubXBfcmluZy5zdGFsbHM6IDAKZGV2LmNj LjAudHhxLjkubXBfcmluZy5hYmRpY2F0aW9uczogMApkZXYuY2MuMC50eHEuOS5tcF9yaW5nLm5v dF9jb25zdW1lcjogMApkZXYuY2MuMC50eHEuOS5tcF9yaW5nLnRha2VvdmVyczogMApkZXYuY2Mu MC50eHEuOS5tcF9yaW5nLmNvbnN1bWVyMzogMApkZXYuY2MuMC50eHEuOS5tcF9yaW5nLmNvbnN1 bWVyMjogMApkZXYuY2MuMC50eHEuOS5tcF9yaW5nLmZhc3RfY29uc3VtZXI6IDAKZGV2LmNjLjAu dHhxLjkubXBfcmluZy5jb25zdW1lZDogMApkZXYuY2MuMC50eHEuOS5tcF9yaW5nLmRyb3BwZWQ6 IDAKZGV2LmNjLjAudHhxLjkubXBfcmluZy5zdGF0ZTogMApkZXYuY2MuMC50eHEuOS52eGxhbl90 eGNzdW06IDAKZGV2LmNjLjAudHhxLjkudnhsYW5fdHNvX3dyczogMApkZXYuY2MuMC50eHEuOS5y YXdfd3JzOiAwCmRldi5jYy4wLnR4cS45LnR4cGt0c19mbHVzaDogMApkZXYuY2MuMC50eHEuOS50 eHBrdHMxX3BrdHM6IDAKZGV2LmNjLjAudHhxLjkudHhwa3RzMF9wa3RzOiAwCmRldi5jYy4wLnR4 cS45LnR4cGt0czFfd3JzOiAwCmRldi5jYy4wLnR4cS45LnR4cGt0czBfd3JzOiAwCmRldi5jYy4w LnR4cS45LnR4cGt0X3dyczogMApkZXYuY2MuMC50eHEuOS5zZ2xfd3JzOiAwCmRldi5jYy4wLnR4 cS45LmltbV93cnM6IDAKZGV2LmNjLjAudHhxLjkudHNvX3dyczogMApkZXYuY2MuMC50eHEuOS52 bGFuX2luc2VydGlvbjogMApkZXYuY2MuMC50eHEuOS50eGNzdW06IDAKZGV2LmNjLjAudHhxLjku dGM6IC0xCmRldi5jYy4wLnR4cS45LnNpZHg6IDEwMjMKZGV2LmNjLjAudHhxLjkucGlkeDogMApk ZXYuY2MuMC50eHEuOS5jaWR4OiAwCmRldi5jYy4wLnR4cS45LmNudHh0X2lkOiAzNwpkZXYuY2Mu MC50eHEuOS5hYnNfaWQ6IDM3CmRldi5jYy4wLnR4cS45LmRtYWxlbjogNjU1MzYKZGV2LmNjLjAu dHhxLjkuYmE6IDI0NTkwMjg2ODQ4CmRldi5jYy4wLnR4cS44Lm1wX3JpbmcuY29uc19pZGxlMjog MApkZXYuY2MuMC50eHEuOC5tcF9yaW5nLmNvbnNfaWRsZTogMApkZXYuY2MuMC50eHEuOC5tcF9y aW5nLnN0YWxsczogMApkZXYuY2MuMC50eHEuOC5tcF9yaW5nLmFiZGljYXRpb25zOiAwCmRldi5j Yy4wLnR4cS44Lm1wX3Jpbmcubm90X2NvbnN1bWVyOiAwCmRldi5jYy4wLnR4cS44Lm1wX3Jpbmcu dGFrZW92ZXJzOiAwCmRldi5jYy4wLnR4cS44Lm1wX3JpbmcuY29uc3VtZXIzOiAwCmRldi5jYy4w LnR4cS44Lm1wX3JpbmcuY29uc3VtZXIyOiAwCmRldi5jYy4wLnR4cS44Lm1wX3JpbmcuZmFzdF9j b25zdW1lcjogMApkZXYuY2MuMC50eHEuOC5tcF9yaW5nLmNvbnN1bWVkOiAwCmRldi5jYy4wLnR4 cS44Lm1wX3JpbmcuZHJvcHBlZDogMApkZXYuY2MuMC50eHEuOC5tcF9yaW5nLnN0YXRlOiAwCmRl di5jYy4wLnR4cS44LnZ4bGFuX3R4Y3N1bTogMApkZXYuY2MuMC50eHEuOC52eGxhbl90c29fd3Jz OiAwCmRldi5jYy4wLnR4cS44LnJhd193cnM6IDAKZGV2LmNjLjAudHhxLjgudHhwa3RzX2ZsdXNo OiAwCmRldi5jYy4wLnR4cS44LnR4cGt0czFfcGt0czogMApkZXYuY2MuMC50eHEuOC50eHBrdHMw X3BrdHM6IDAKZGV2LmNjLjAudHhxLjgudHhwa3RzMV93cnM6IDAKZGV2LmNjLjAudHhxLjgudHhw a3RzMF93cnM6IDAKZGV2LmNjLjAudHhxLjgudHhwa3Rfd3JzOiAwCmRldi5jYy4wLnR4cS44LnNn bF93cnM6IDAKZGV2LmNjLjAudHhxLjguaW1tX3dyczogMApkZXYuY2MuMC50eHEuOC50c29fd3Jz OiAwCmRldi5jYy4wLnR4cS44LnZsYW5faW5zZXJ0aW9uOiAwCmRldi5jYy4wLnR4cS44LnR4Y3N1 bTogMApkZXYuY2MuMC50eHEuOC50YzogLTEKZGV2LmNjLjAudHhxLjguc2lkeDogMTAyMwpkZXYu Y2MuMC50eHEuOC5waWR4OiAwCmRldi5jYy4wLnR4cS44LmNpZHg6IDAKZGV2LmNjLjAudHhxLjgu Y250eHRfaWQ6IDM2CmRldi5jYy4wLnR4cS44LmFic19pZDogMzYKZGV2LmNjLjAudHhxLjguZG1h bGVuOiA2NTUzNgpkZXYuY2MuMC50eHEuOC5iYTogMjQ1OTAxODg1NDQKZGV2LmNjLjAudHhxLjcu bXBfcmluZy5jb25zX2lkbGUyOiAwCmRldi5jYy4wLnR4cS43Lm1wX3JpbmcuY29uc19pZGxlOiAw CmRldi5jYy4wLnR4cS43Lm1wX3Jpbmcuc3RhbGxzOiAwCmRldi5jYy4wLnR4cS43Lm1wX3Jpbmcu YWJkaWNhdGlvbnM6IDAKZGV2LmNjLjAudHhxLjcubXBfcmluZy5ub3RfY29uc3VtZXI6IDAKZGV2 LmNjLjAudHhxLjcubXBfcmluZy50YWtlb3ZlcnM6IDAKZGV2LmNjLjAudHhxLjcubXBfcmluZy5j b25zdW1lcjM6IDAKZGV2LmNjLjAudHhxLjcubXBfcmluZy5jb25zdW1lcjI6IDAKZGV2LmNjLjAu dHhxLjcubXBfcmluZy5mYXN0X2NvbnN1bWVyOiAwCmRldi5jYy4wLnR4cS43Lm1wX3JpbmcuY29u c3VtZWQ6IDAKZGV2LmNjLjAudHhxLjcubXBfcmluZy5kcm9wcGVkOiAwCmRldi5jYy4wLnR4cS43 Lm1wX3Jpbmcuc3RhdGU6IDAKZGV2LmNjLjAudHhxLjcudnhsYW5fdHhjc3VtOiAwCmRldi5jYy4w LnR4cS43LnZ4bGFuX3Rzb193cnM6IDAKZGV2LmNjLjAudHhxLjcucmF3X3dyczogMApkZXYuY2Mu MC50eHEuNy50eHBrdHNfZmx1c2g6IDAKZGV2LmNjLjAudHhxLjcudHhwa3RzMV9wa3RzOiAwCmRl di5jYy4wLnR4cS43LnR4cGt0czBfcGt0czogMApkZXYuY2MuMC50eHEuNy50eHBrdHMxX3dyczog MApkZXYuY2MuMC50eHEuNy50eHBrdHMwX3dyczogMApkZXYuY2MuMC50eHEuNy50eHBrdF93cnM6 IDAKZGV2LmNjLjAudHhxLjcuc2dsX3dyczogMApkZXYuY2MuMC50eHEuNy5pbW1fd3JzOiAwCmRl di5jYy4wLnR4cS43LnRzb193cnM6IDAKZGV2LmNjLjAudHhxLjcudmxhbl9pbnNlcnRpb246IDAK ZGV2LmNjLjAudHhxLjcudHhjc3VtOiAwCmRldi5jYy4wLnR4cS43LnRjOiAtMQpkZXYuY2MuMC50 eHEuNy5zaWR4OiAxMDIzCmRldi5jYy4wLnR4cS43LnBpZHg6IDAKZGV2LmNjLjAudHhxLjcuY2lk eDogMApkZXYuY2MuMC50eHEuNy5jbnR4dF9pZDogMzUKZGV2LmNjLjAudHhxLjcuYWJzX2lkOiAz NQpkZXYuY2MuMC50eHEuNy5kbWFsZW46IDY1NTM2CmRldi5jYy4wLnR4cS43LmJhOiAyNDU5MDA5 MDI0MApkZXYuY2MuMC50eHEuNi5tcF9yaW5nLmNvbnNfaWRsZTI6IDAKZGV2LmNjLjAudHhxLjYu bXBfcmluZy5jb25zX2lkbGU6IDAKZGV2LmNjLjAudHhxLjYubXBfcmluZy5zdGFsbHM6IDAKZGV2 LmNjLjAudHhxLjYubXBfcmluZy5hYmRpY2F0aW9uczogMApkZXYuY2MuMC50eHEuNi5tcF9yaW5n Lm5vdF9jb25zdW1lcjogMApkZXYuY2MuMC50eHEuNi5tcF9yaW5nLnRha2VvdmVyczogMApkZXYu Y2MuMC50eHEuNi5tcF9yaW5nLmNvbnN1bWVyMzogMApkZXYuY2MuMC50eHEuNi5tcF9yaW5nLmNv bnN1bWVyMjogMApkZXYuY2MuMC50eHEuNi5tcF9yaW5nLmZhc3RfY29uc3VtZXI6IDAKZGV2LmNj LjAudHhxLjYubXBfcmluZy5jb25zdW1lZDogMApkZXYuY2MuMC50eHEuNi5tcF9yaW5nLmRyb3Bw ZWQ6IDAKZGV2LmNjLjAudHhxLjYubXBfcmluZy5zdGF0ZTogMApkZXYuY2MuMC50eHEuNi52eGxh bl90eGNzdW06IDAKZGV2LmNjLjAudHhxLjYudnhsYW5fdHNvX3dyczogMApkZXYuY2MuMC50eHEu Ni5yYXdfd3JzOiAwCmRldi5jYy4wLnR4cS42LnR4cGt0c19mbHVzaDogMApkZXYuY2MuMC50eHEu Ni50eHBrdHMxX3BrdHM6IDAKZGV2LmNjLjAudHhxLjYudHhwa3RzMF9wa3RzOiAwCmRldi5jYy4w LnR4cS42LnR4cGt0czFfd3JzOiAwCmRldi5jYy4wLnR4cS42LnR4cGt0czBfd3JzOiAwCmRldi5j Yy4wLnR4cS42LnR4cGt0X3dyczogMApkZXYuY2MuMC50eHEuNi5zZ2xfd3JzOiAwCmRldi5jYy4w LnR4cS42LmltbV93cnM6IDAKZGV2LmNjLjAudHhxLjYudHNvX3dyczogMApkZXYuY2MuMC50eHEu Ni52bGFuX2luc2VydGlvbjogMApkZXYuY2MuMC50eHEuNi50eGNzdW06IDAKZGV2LmNjLjAudHhx LjYudGM6IC0xCmRldi5jYy4wLnR4cS42LnNpZHg6IDEwMjMKZGV2LmNjLjAudHhxLjYucGlkeDog MApkZXYuY2MuMC50eHEuNi5jaWR4OiAwCmRldi5jYy4wLnR4cS42LmNudHh0X2lkOiAzNApkZXYu Y2MuMC50eHEuNi5hYnNfaWQ6IDM0CmRldi5jYy4wLnR4cS42LmRtYWxlbjogNjU1MzYKZGV2LmNj LjAudHhxLjYuYmE6IDI0NTg5OTkxOTM2CmRldi5jYy4wLnR4cS41Lm1wX3JpbmcuY29uc19pZGxl MjogMApkZXYuY2MuMC50eHEuNS5tcF9yaW5nLmNvbnNfaWRsZTogMApkZXYuY2MuMC50eHEuNS5t cF9yaW5nLnN0YWxsczogMApkZXYuY2MuMC50eHEuNS5tcF9yaW5nLmFiZGljYXRpb25zOiAwCmRl di5jYy4wLnR4cS41Lm1wX3Jpbmcubm90X2NvbnN1bWVyOiAwCmRldi5jYy4wLnR4cS41Lm1wX3Jp bmcudGFrZW92ZXJzOiAwCmRldi5jYy4wLnR4cS41Lm1wX3JpbmcuY29uc3VtZXIzOiAwCmRldi5j Yy4wLnR4cS41Lm1wX3JpbmcuY29uc3VtZXIyOiAwCmRldi5jYy4wLnR4cS41Lm1wX3JpbmcuZmFz dF9jb25zdW1lcjogMApkZXYuY2MuMC50eHEuNS5tcF9yaW5nLmNvbnN1bWVkOiAwCmRldi5jYy4w LnR4cS41Lm1wX3JpbmcuZHJvcHBlZDogMApkZXYuY2MuMC50eHEuNS5tcF9yaW5nLnN0YXRlOiAw CmRldi5jYy4wLnR4cS41LnZ4bGFuX3R4Y3N1bTogMApkZXYuY2MuMC50eHEuNS52eGxhbl90c29f d3JzOiAwCmRldi5jYy4wLnR4cS41LnJhd193cnM6IDAKZGV2LmNjLjAudHhxLjUudHhwa3RzX2Zs dXNoOiAwCmRldi5jYy4wLnR4cS41LnR4cGt0czFfcGt0czogMApkZXYuY2MuMC50eHEuNS50eHBr dHMwX3BrdHM6IDAKZGV2LmNjLjAudHhxLjUudHhwa3RzMV93cnM6IDAKZGV2LmNjLjAudHhxLjUu dHhwa3RzMF93cnM6IDAKZGV2LmNjLjAudHhxLjUudHhwa3Rfd3JzOiAwCmRldi5jYy4wLnR4cS41 LnNnbF93cnM6IDAKZGV2LmNjLjAudHhxLjUuaW1tX3dyczogMApkZXYuY2MuMC50eHEuNS50c29f d3JzOiAwCmRldi5jYy4wLnR4cS41LnZsYW5faW5zZXJ0aW9uOiAwCmRldi5jYy4wLnR4cS41LnR4 Y3N1bTogMApkZXYuY2MuMC50eHEuNS50YzogLTEKZGV2LmNjLjAudHhxLjUuc2lkeDogMTAyMwpk ZXYuY2MuMC50eHEuNS5waWR4OiAwCmRldi5jYy4wLnR4cS41LmNpZHg6IDAKZGV2LmNjLjAudHhx LjUuY250eHRfaWQ6IDMzCmRldi5jYy4wLnR4cS41LmFic19pZDogMzMKZGV2LmNjLjAudHhxLjUu ZG1hbGVuOiA2NTUzNgpkZXYuY2MuMC50eHEuNS5iYTogMjQ1ODk4OTM2MzIKZGV2LmNjLjAudHhx LjQubXBfcmluZy5jb25zX2lkbGUyOiAwCmRldi5jYy4wLnR4cS40Lm1wX3JpbmcuY29uc19pZGxl OiAwCmRldi5jYy4wLnR4cS40Lm1wX3Jpbmcuc3RhbGxzOiAwCmRldi5jYy4wLnR4cS40Lm1wX3Jp bmcuYWJkaWNhdGlvbnM6IDAKZGV2LmNjLjAudHhxLjQubXBfcmluZy5ub3RfY29uc3VtZXI6IDAK ZGV2LmNjLjAudHhxLjQubXBfcmluZy50YWtlb3ZlcnM6IDAKZGV2LmNjLjAudHhxLjQubXBfcmlu Zy5jb25zdW1lcjM6IDAKZGV2LmNjLjAudHhxLjQubXBfcmluZy5jb25zdW1lcjI6IDAKZGV2LmNj LjAudHhxLjQubXBfcmluZy5mYXN0X2NvbnN1bWVyOiAwCmRldi5jYy4wLnR4cS40Lm1wX3Jpbmcu Y29uc3VtZWQ6IDAKZGV2LmNjLjAudHhxLjQubXBfcmluZy5kcm9wcGVkOiAwCmRldi5jYy4wLnR4 cS40Lm1wX3Jpbmcuc3RhdGU6IDAKZGV2LmNjLjAudHhxLjQudnhsYW5fdHhjc3VtOiAwCmRldi5j Yy4wLnR4cS40LnZ4bGFuX3Rzb193cnM6IDAKZGV2LmNjLjAudHhxLjQucmF3X3dyczogMApkZXYu Y2MuMC50eHEuNC50eHBrdHNfZmx1c2g6IDAKZGV2LmNjLjAudHhxLjQudHhwa3RzMV9wa3RzOiAw CmRldi5jYy4wLnR4cS40LnR4cGt0czBfcGt0czogMApkZXYuY2MuMC50eHEuNC50eHBrdHMxX3dy czogMApkZXYuY2MuMC50eHEuNC50eHBrdHMwX3dyczogMApkZXYuY2MuMC50eHEuNC50eHBrdF93 cnM6IDAKZGV2LmNjLjAudHhxLjQuc2dsX3dyczogMApkZXYuY2MuMC50eHEuNC5pbW1fd3JzOiAw CmRldi5jYy4wLnR4cS40LnRzb193cnM6IDAKZGV2LmNjLjAudHhxLjQudmxhbl9pbnNlcnRpb246 IDAKZGV2LmNjLjAudHhxLjQudHhjc3VtOiAwCmRldi5jYy4wLnR4cS40LnRjOiAtMQpkZXYuY2Mu MC50eHEuNC5zaWR4OiAxMDIzCmRldi5jYy4wLnR4cS40LnBpZHg6IDAKZGV2LmNjLjAudHhxLjQu Y2lkeDogMApkZXYuY2MuMC50eHEuNC5jbnR4dF9pZDogMzIKZGV2LmNjLjAudHhxLjQuYWJzX2lk OiAzMgpkZXYuY2MuMC50eHEuNC5kbWFsZW46IDY1NTM2CmRldi5jYy4wLnR4cS40LmJhOiAyNDU4 OTc5NTMyOApkZXYuY2MuMC50eHEuMy5tcF9yaW5nLmNvbnNfaWRsZTI6IDAKZGV2LmNjLjAudHhx LjMubXBfcmluZy5jb25zX2lkbGU6IDAKZGV2LmNjLjAudHhxLjMubXBfcmluZy5zdGFsbHM6IDAK ZGV2LmNjLjAudHhxLjMubXBfcmluZy5hYmRpY2F0aW9uczogMApkZXYuY2MuMC50eHEuMy5tcF9y aW5nLm5vdF9jb25zdW1lcjogMApkZXYuY2MuMC50eHEuMy5tcF9yaW5nLnRha2VvdmVyczogMApk ZXYuY2MuMC50eHEuMy5tcF9yaW5nLmNvbnN1bWVyMzogMApkZXYuY2MuMC50eHEuMy5tcF9yaW5n LmNvbnN1bWVyMjogMApkZXYuY2MuMC50eHEuMy5tcF9yaW5nLmZhc3RfY29uc3VtZXI6IDAKZGV2 LmNjLjAudHhxLjMubXBfcmluZy5jb25zdW1lZDogMApkZXYuY2MuMC50eHEuMy5tcF9yaW5nLmRy b3BwZWQ6IDAKZGV2LmNjLjAudHhxLjMubXBfcmluZy5zdGF0ZTogMApkZXYuY2MuMC50eHEuMy52 eGxhbl90eGNzdW06IDAKZGV2LmNjLjAudHhxLjMudnhsYW5fdHNvX3dyczogMApkZXYuY2MuMC50 eHEuMy5yYXdfd3JzOiAwCmRldi5jYy4wLnR4cS4zLnR4cGt0c19mbHVzaDogMApkZXYuY2MuMC50 eHEuMy50eHBrdHMxX3BrdHM6IDAKZGV2LmNjLjAudHhxLjMudHhwa3RzMF9wa3RzOiAwCmRldi5j Yy4wLnR4cS4zLnR4cGt0czFfd3JzOiAwCmRldi5jYy4wLnR4cS4zLnR4cGt0czBfd3JzOiAwCmRl di5jYy4wLnR4cS4zLnR4cGt0X3dyczogMApkZXYuY2MuMC50eHEuMy5zZ2xfd3JzOiAwCmRldi5j Yy4wLnR4cS4zLmltbV93cnM6IDAKZGV2LmNjLjAudHhxLjMudHNvX3dyczogMApkZXYuY2MuMC50 eHEuMy52bGFuX2luc2VydGlvbjogMApkZXYuY2MuMC50eHEuMy50eGNzdW06IDAKZGV2LmNjLjAu dHhxLjMudGM6IC0xCmRldi5jYy4wLnR4cS4zLnNpZHg6IDEwMjMKZGV2LmNjLjAudHhxLjMucGlk eDogMApkZXYuY2MuMC50eHEuMy5jaWR4OiAwCmRldi5jYy4wLnR4cS4zLmNudHh0X2lkOiAzMQpk ZXYuY2MuMC50eHEuMy5hYnNfaWQ6IDMxCmRldi5jYy4wLnR4cS4zLmRtYWxlbjogNjU1MzYKZGV2 LmNjLjAudHhxLjMuYmE6IDI0NTg5Njk3MDI0CmRldi5jYy4wLnR4cS4yLm1wX3JpbmcuY29uc19p ZGxlMjogMQpkZXYuY2MuMC50eHEuMi5tcF9yaW5nLmNvbnNfaWRsZTogMTE5MTg5MjAKZGV2LmNj LjAudHhxLjIubXBfcmluZy5zdGFsbHM6IDAKZGV2LmNjLjAudHhxLjIubXBfcmluZy5hYmRpY2F0 aW9uczogMApkZXYuY2MuMC50eHEuMi5tcF9yaW5nLm5vdF9jb25zdW1lcjogMzMKZGV2LmNjLjAu dHhxLjIubXBfcmluZy50YWtlb3ZlcnM6IDAKZGV2LmNjLjAudHhxLjIubXBfcmluZy5jb25zdW1l cjM6IDEKZGV2LmNjLjAudHhxLjIubXBfcmluZy5jb25zdW1lcjI6IDAKZGV2LmNjLjAudHhxLjIu bXBfcmluZy5mYXN0X2NvbnN1bWVyOiAxMTkxODkwOQpkZXYuY2MuMC50eHEuMi5tcF9yaW5nLmNv bnN1bWVkOiAxMTkxODk0MwpkZXYuY2MuMC50eHEuMi5tcF9yaW5nLmRyb3BwZWQ6IDAKZGV2LmNj LjAudHhxLjIubXBfcmluZy5zdGF0ZTogNDI2NDk2NzYwMzE2OQpkZXYuY2MuMC50eHEuMi52eGxh bl90eGNzdW06IDAKZGV2LmNjLjAudHhxLjIudnhsYW5fdHNvX3dyczogMApkZXYuY2MuMC50eHEu Mi5yYXdfd3JzOiAwCmRldi5jYy4wLnR4cS4yLnR4cGt0c19mbHVzaDogMTEKZGV2LmNjLjAudHhx LjIudHhwa3RzMV9wa3RzOiAwCmRldi5jYy4wLnR4cS4yLnR4cGt0czBfcGt0czogMjExCmRldi5j Yy4wLnR4cS4yLnR4cGt0czFfd3JzOiAwCmRldi5jYy4wLnR4cS4yLnR4cGt0czBfd3JzOiAzNApk ZXYuY2MuMC50eHEuMi50eHBrdF93cnM6IDExOTE4NzMyCmRldi5jYy4wLnR4cS4yLnNnbF93cnM6 IDExOTE4NzY2CmRldi5jYy4wLnR4cS4yLmltbV93cnM6IDAKZGV2LmNjLjAudHhxLjIudHNvX3dy czogMApkZXYuY2MuMC50eHEuMi52bGFuX2luc2VydGlvbjogMApkZXYuY2MuMC50eHEuMi50eGNz dW06IDExOTE4OTQzCmRldi5jYy4wLnR4cS4yLnRjOiAtMQpkZXYuY2MuMC50eHEuMi5zaWR4OiAx MDIzCmRldi5jYy4wLnR4cS4yLnBpZHg6IDQKZGV2LmNjLjAudHhxLjIuY2lkeDogNApkZXYuY2Mu MC50eHEuMi5jbnR4dF9pZDogMzAKZGV2LmNjLjAudHhxLjIuYWJzX2lkOiAzMApkZXYuY2MuMC50 eHEuMi5kbWFsZW46IDY1NTM2CmRldi5jYy4wLnR4cS4yLmJhOiAyNDU4OTU5ODcyMApkZXYuY2Mu MC50eHEuMS5tcF9yaW5nLmNvbnNfaWRsZTI6IDAKZGV2LmNjLjAudHhxLjEubXBfcmluZy5jb25z X2lkbGU6IDAKZGV2LmNjLjAudHhxLjEubXBfcmluZy5zdGFsbHM6IDAKZGV2LmNjLjAudHhxLjEu bXBfcmluZy5hYmRpY2F0aW9uczogMApkZXYuY2MuMC50eHEuMS5tcF9yaW5nLm5vdF9jb25zdW1l cjogMApkZXYuY2MuMC50eHEuMS5tcF9yaW5nLnRha2VvdmVyczogMApkZXYuY2MuMC50eHEuMS5t cF9yaW5nLmNvbnN1bWVyMzogMApkZXYuY2MuMC50eHEuMS5tcF9yaW5nLmNvbnN1bWVyMjogMApk ZXYuY2MuMC50eHEuMS5tcF9yaW5nLmZhc3RfY29uc3VtZXI6IDAKZGV2LmNjLjAudHhxLjEubXBf cmluZy5jb25zdW1lZDogMApkZXYuY2MuMC50eHEuMS5tcF9yaW5nLmRyb3BwZWQ6IDAKZGV2LmNj LjAudHhxLjEubXBfcmluZy5zdGF0ZTogMApkZXYuY2MuMC50eHEuMS52eGxhbl90eGNzdW06IDAK ZGV2LmNjLjAudHhxLjEudnhsYW5fdHNvX3dyczogMApkZXYuY2MuMC50eHEuMS5yYXdfd3JzOiAw CmRldi5jYy4wLnR4cS4xLnR4cGt0c19mbHVzaDogMApkZXYuY2MuMC50eHEuMS50eHBrdHMxX3Br dHM6IDAKZGV2LmNjLjAudHhxLjEudHhwa3RzMF9wa3RzOiAwCmRldi5jYy4wLnR4cS4xLnR4cGt0 czFfd3JzOiAwCmRldi5jYy4wLnR4cS4xLnR4cGt0czBfd3JzOiAwCmRldi5jYy4wLnR4cS4xLnR4 cGt0X3dyczogMApkZXYuY2MuMC50eHEuMS5zZ2xfd3JzOiAwCmRldi5jYy4wLnR4cS4xLmltbV93 cnM6IDAKZGV2LmNjLjAudHhxLjEudHNvX3dyczogMApkZXYuY2MuMC50eHEuMS52bGFuX2luc2Vy dGlvbjogMApkZXYuY2MuMC50eHEuMS50eGNzdW06IDAKZGV2LmNjLjAudHhxLjEudGM6IC0xCmRl di5jYy4wLnR4cS4xLnNpZHg6IDEwMjMKZGV2LmNjLjAudHhxLjEucGlkeDogMApkZXYuY2MuMC50 eHEuMS5jaWR4OiAwCmRldi5jYy4wLnR4cS4xLmNudHh0X2lkOiAyOQpkZXYuY2MuMC50eHEuMS5h YnNfaWQ6IDI5CmRldi5jYy4wLnR4cS4xLmRtYWxlbjogNjU1MzYKZGV2LmNjLjAudHhxLjEuYmE6 IDI0NTg5NTAwNDE2CmRldi5jYy4wLnR4cS4wLm1wX3JpbmcuY29uc19pZGxlMjogMApkZXYuY2Mu MC50eHEuMC5tcF9yaW5nLmNvbnNfaWRsZTogMQpkZXYuY2MuMC50eHEuMC5tcF9yaW5nLnN0YWxs czogMApkZXYuY2MuMC50eHEuMC5tcF9yaW5nLmFiZGljYXRpb25zOiAwCmRldi5jYy4wLnR4cS4w Lm1wX3Jpbmcubm90X2NvbnN1bWVyOiAwCmRldi5jYy4wLnR4cS4wLm1wX3JpbmcudGFrZW92ZXJz OiAwCmRldi5jYy4wLnR4cS4wLm1wX3JpbmcuY29uc3VtZXIzOiAwCmRldi5jYy4wLnR4cS4wLm1w X3JpbmcuY29uc3VtZXIyOiAwCmRldi5jYy4wLnR4cS4wLm1wX3JpbmcuZmFzdF9jb25zdW1lcjog MQpkZXYuY2MuMC50eHEuMC5tcF9yaW5nLmNvbnN1bWVkOiAxCmRldi5jYy4wLnR4cS4wLm1wX3Jp bmcuZHJvcHBlZDogMApkZXYuY2MuMC50eHEuMC5tcF9yaW5nLnN0YXRlOiA0Mjk1MDMyODMzCmRl di5jYy4wLnR4cS4wLnZ4bGFuX3R4Y3N1bTogMApkZXYuY2MuMC50eHEuMC52eGxhbl90c29fd3Jz OiAwCmRldi5jYy4wLnR4cS4wLnJhd193cnM6IDAKZGV2LmNjLjAudHhxLjAudHhwa3RzX2ZsdXNo OiAwCmRldi5jYy4wLnR4cS4wLnR4cGt0czFfcGt0czogMApkZXYuY2MuMC50eHEuMC50eHBrdHMw X3BrdHM6IDAKZGV2LmNjLjAudHhxLjAudHhwa3RzMV93cnM6IDAKZGV2LmNjLjAudHhxLjAudHhw a3RzMF93cnM6IDAKZGV2LmNjLjAudHhxLjAudHhwa3Rfd3JzOiAxCmRldi5jYy4wLnR4cS4wLnNn bF93cnM6IDAKZGV2LmNjLjAudHhxLjAuaW1tX3dyczogMQpkZXYuY2MuMC50eHEuMC50c29fd3Jz OiAwCmRldi5jYy4wLnR4cS4wLnZsYW5faW5zZXJ0aW9uOiAwCmRldi5jYy4wLnR4cS4wLnR4Y3N1 bTogMApkZXYuY2MuMC50eHEuMC50YzogLTEKZGV2LmNjLjAudHhxLjAuc2lkeDogMTAyMwpkZXYu Y2MuMC50eHEuMC5waWR4OiAyCmRldi5jYy4wLnR4cS4wLmNpZHg6IDIKZGV2LmNjLjAudHhxLjAu Y250eHRfaWQ6IDI4CmRldi5jYy4wLnR4cS4wLmFic19pZDogMjgKZGV2LmNjLjAudHhxLjAuZG1h bGVuOiA2NTUzNgpkZXYuY2MuMC50eHEuMC5iYTogMjQ1ODk0MDIxMTIKZGV2LmNjLjAub2ZsZF9y eHEuMS5yeF90b2VfdGxzX29jdGV0czogMApkZXYuY2MuMC5vZmxkX3J4cS4xLnJ4X3RvZV90bHNf cmVjb3JkczogMApkZXYuY2MuMC5vZmxkX3J4cS4xLmZsLmNsdXN0ZXJfZmFzdF9yZWN5Y2xlZDog MApkZXYuY2MuMC5vZmxkX3J4cS4xLmZsLmNsdXN0ZXJfcmVjeWNsZWQ6IDAKZGV2LmNjLjAub2Zs ZF9yeHEuMS5mbC5jbHVzdGVyX2FsbG9jYXRlZDogMzIKZGV2LmNjLjAub2ZsZF9yeHEuMS5mbC5w aWR4OiAzMgpkZXYuY2MuMC5vZmxkX3J4cS4xLmZsLnJ4X29mZnNldDogMApkZXYuY2MuMC5vZmxk X3J4cS4xLmZsLmNpZHg6IDAKZGV2LmNjLjAub2ZsZF9yeHEuMS5mbC5wYWNraW5nOiAxCmRldi5j Yy4wLm9mbGRfcnhxLjEuZmwucGFkZGluZzogMQpkZXYuY2MuMC5vZmxkX3J4cS4xLmZsLmNudHh0 X2lkOiAyNwpkZXYuY2MuMC5vZmxkX3J4cS4xLmZsLmRtYWxlbjogODE5MgpkZXYuY2MuMC5vZmxk X3J4cS4xLmZsLmJhOiAyNDU4OTM3NzUzNgpkZXYuY2MuMC5vZmxkX3J4cS4xLmNpZHg6IDAKZGV2 LmNjLjAub2ZsZF9yeHEuMS5jbnR4dF9pZDogMTgKZGV2LmNjLjAub2ZsZF9yeHEuMS5hYnNfaWQ6 IDE4CmRldi5jYy4wLm9mbGRfcnhxLjEuZG1hbGVuOiA2NTUzNgpkZXYuY2MuMC5vZmxkX3J4cS4x LmJhOiAyNDU4OTMxMjAwMApkZXYuY2MuMC5vZmxkX3J4cS4wLnJ4X3RvZV90bHNfb2N0ZXRzOiAw CmRldi5jYy4wLm9mbGRfcnhxLjAucnhfdG9lX3Rsc19yZWNvcmRzOiAwCmRldi5jYy4wLm9mbGRf cnhxLjAuZmwuY2x1c3Rlcl9mYXN0X3JlY3ljbGVkOiAwCmRldi5jYy4wLm9mbGRfcnhxLjAuZmwu Y2x1c3Rlcl9yZWN5Y2xlZDogMApkZXYuY2MuMC5vZmxkX3J4cS4wLmZsLmNsdXN0ZXJfYWxsb2Nh dGVkOiAzMgpkZXYuY2MuMC5vZmxkX3J4cS4wLmZsLnBpZHg6IDMyCmRldi5jYy4wLm9mbGRfcnhx LjAuZmwucnhfb2Zmc2V0OiAwCmRldi5jYy4wLm9mbGRfcnhxLjAuZmwuY2lkeDogMApkZXYuY2Mu MC5vZmxkX3J4cS4wLmZsLnBhY2tpbmc6IDEKZGV2LmNjLjAub2ZsZF9yeHEuMC5mbC5wYWRkaW5n OiAxCmRldi5jYy4wLm9mbGRfcnhxLjAuZmwuY250eHRfaWQ6IDI2CmRldi5jYy4wLm9mbGRfcnhx LjAuZmwuZG1hbGVuOiA4MTkyCmRldi5jYy4wLm9mbGRfcnhxLjAuZmwuYmE6IDI0NTg5Mjg3NDI0 CmRldi5jYy4wLm9mbGRfcnhxLjAuY2lkeDogMApkZXYuY2MuMC5vZmxkX3J4cS4wLmNudHh0X2lk OiAxNwpkZXYuY2MuMC5vZmxkX3J4cS4wLmFic19pZDogMTcKZGV2LmNjLjAub2ZsZF9yeHEuMC5k bWFsZW46IDY1NTM2CmRldi5jYy4wLm9mbGRfcnhxLjAuYmE6IDI0NTg5MjIxODg4CmRldi5jYy4w LnJ4cS43LmZsLmNsdXN0ZXJfZmFzdF9yZWN5Y2xlZDogMApkZXYuY2MuMC5yeHEuNy5mbC5jbHVz dGVyX3JlY3ljbGVkOiAwCmRldi5jYy4wLnJ4cS43LmZsLmNsdXN0ZXJfYWxsb2NhdGVkOiAxNjAK ZGV2LmNjLjAucnhxLjcuZmwucGlkeDogMTYwCmRldi5jYy4wLnJ4cS43LmZsLnJ4X29mZnNldDog MApkZXYuY2MuMC5yeHEuNy5mbC5jaWR4OiAwCmRldi5jYy4wLnJ4cS43LmZsLnBhY2tpbmc6IDEK ZGV2LmNjLjAucnhxLjcuZmwucGFkZGluZzogMQpkZXYuY2MuMC5yeHEuNy5mbC5jbnR4dF9pZDog MjUKZGV2LmNjLjAucnhxLjcuZmwuZG1hbGVuOiA4MTkyCmRldi5jYy4wLnJ4cS43LmZsLmJhOiAy NDU4OTE5NzMxMgpkZXYuY2MuMC5yeHEuNy52eGxhbl9yeGNzdW06IDAKZGV2LmNjLjAucnhxLjcu dmxhbl9leHRyYWN0aW9uOiAwCmRldi5jYy4wLnJ4cS43LnJ4Y3N1bTogMApkZXYuY2MuMC5yeHEu Ny5scm9fZmx1c2hlZDogMApkZXYuY2MuMC5yeHEuNy5scm9fcXVldWVkOiAwCmRldi5jYy4wLnJ4 cS43LmNpZHg6IDAKZGV2LmNjLjAucnhxLjcuY250eHRfaWQ6IDE2CmRldi5jYy4wLnJ4cS43LmFi c19pZDogMTYKZGV2LmNjLjAucnhxLjcuZG1hbGVuOiA2NTUzNgpkZXYuY2MuMC5yeHEuNy5iYTog MjQ1ODkxMzE3NzYKZGV2LmNjLjAucnhxLjYuZmwuY2x1c3Rlcl9mYXN0X3JlY3ljbGVkOiAwCmRl di5jYy4wLnJ4cS42LmZsLmNsdXN0ZXJfcmVjeWNsZWQ6IDAKZGV2LmNjLjAucnhxLjYuZmwuY2x1 c3Rlcl9hbGxvY2F0ZWQ6IDE2MApkZXYuY2MuMC5yeHEuNi5mbC5waWR4OiAxNjAKZGV2LmNjLjAu cnhxLjYuZmwucnhfb2Zmc2V0OiAwCmRldi5jYy4wLnJ4cS42LmZsLmNpZHg6IDAKZGV2LmNjLjAu cnhxLjYuZmwucGFja2luZzogMQpkZXYuY2MuMC5yeHEuNi5mbC5wYWRkaW5nOiAxCmRldi5jYy4w LnJ4cS42LmZsLmNudHh0X2lkOiAyNApkZXYuY2MuMC5yeHEuNi5mbC5kbWFsZW46IDgxOTIKZGV2 LmNjLjAucnhxLjYuZmwuYmE6IDI0NTg5MTA3MjAwCmRldi5jYy4wLnJ4cS42LnZ4bGFuX3J4Y3N1 bTogMApkZXYuY2MuMC5yeHEuNi52bGFuX2V4dHJhY3Rpb246IDAKZGV2LmNjLjAucnhxLjYucnhj c3VtOiAwCmRldi5jYy4wLnJ4cS42Lmxyb19mbHVzaGVkOiAwCmRldi5jYy4wLnJ4cS42Lmxyb19x dWV1ZWQ6IDAKZGV2LmNjLjAucnhxLjYuY2lkeDogMApkZXYuY2MuMC5yeHEuNi5jbnR4dF9pZDog MTUKZGV2LmNjLjAucnhxLjYuYWJzX2lkOiAxNQpkZXYuY2MuMC5yeHEuNi5kbWFsZW46IDY1NTM2 CmRldi5jYy4wLnJ4cS42LmJhOiAyNDg1NzgwNDgwMApkZXYuY2MuMC5yeHEuNS5mbC5jbHVzdGVy X2Zhc3RfcmVjeWNsZWQ6IDAKZGV2LmNjLjAucnhxLjUuZmwuY2x1c3Rlcl9yZWN5Y2xlZDogMApk ZXYuY2MuMC5yeHEuNS5mbC5jbHVzdGVyX2FsbG9jYXRlZDogMTYwCmRldi5jYy4wLnJ4cS41LmZs LnBpZHg6IDE2MApkZXYuY2MuMC5yeHEuNS5mbC5yeF9vZmZzZXQ6IDAKZGV2LmNjLjAucnhxLjUu ZmwuY2lkeDogMApkZXYuY2MuMC5yeHEuNS5mbC5wYWNraW5nOiAxCmRldi5jYy4wLnJ4cS41LmZs LnBhZGRpbmc6IDEKZGV2LmNjLjAucnhxLjUuZmwuY250eHRfaWQ6IDIzCmRldi5jYy4wLnJ4cS41 LmZsLmRtYWxlbjogODE5MgpkZXYuY2MuMC5yeHEuNS5mbC5iYTogMjQ5MTQyMjMxMDQKZGV2LmNj LjAucnhxLjUudnhsYW5fcnhjc3VtOiAwCmRldi5jYy4wLnJ4cS41LnZsYW5fZXh0cmFjdGlvbjog MApkZXYuY2MuMC5yeHEuNS5yeGNzdW06IDAKZGV2LmNjLjAucnhxLjUubHJvX2ZsdXNoZWQ6IDAK ZGV2LmNjLjAucnhxLjUubHJvX3F1ZXVlZDogMApkZXYuY2MuMC5yeHEuNS5jaWR4OiAwCmRldi5j Yy4wLnJ4cS41LmNudHh0X2lkOiAxNApkZXYuY2MuMC5yeHEuNS5hYnNfaWQ6IDE0CmRldi5jYy4w LnJ4cS41LmRtYWxlbjogNjU1MzYKZGV2LmNjLjAucnhxLjUuYmE6IDI0OTE0NjI0NTEyCmRldi5j Yy4wLnJ4cS40LmZsLmNsdXN0ZXJfZmFzdF9yZWN5Y2xlZDogMApkZXYuY2MuMC5yeHEuNC5mbC5j bHVzdGVyX3JlY3ljbGVkOiAwCmRldi5jYy4wLnJ4cS40LmZsLmNsdXN0ZXJfYWxsb2NhdGVkOiAx NjAKZGV2LmNjLjAucnhxLjQuZmwucGlkeDogMTYwCmRldi5jYy4wLnJ4cS40LmZsLnJ4X29mZnNl dDogMApkZXYuY2MuMC5yeHEuNC5mbC5jaWR4OiAwCmRldi5jYy4wLnJ4cS40LmZsLnBhY2tpbmc6 IDEKZGV2LmNjLjAucnhxLjQuZmwucGFkZGluZzogMQpkZXYuY2MuMC5yeHEuNC5mbC5jbnR4dF9p ZDogMjIKZGV2LmNjLjAucnhxLjQuZmwuZG1hbGVuOiA4MTkyCmRldi5jYy4wLnJ4cS40LmZsLmJh OiAyNDkxNDIxNDkxMgpkZXYuY2MuMC5yeHEuNC52eGxhbl9yeGNzdW06IDAKZGV2LmNjLjAucnhx LjQudmxhbl9leHRyYWN0aW9uOiAwCmRldi5jYy4wLnJ4cS40LnJ4Y3N1bTogMApkZXYuY2MuMC5y eHEuNC5scm9fZmx1c2hlZDogMApkZXYuY2MuMC5yeHEuNC5scm9fcXVldWVkOiAwCmRldi5jYy4w LnJ4cS40LmNpZHg6IDAKZGV2LmNjLjAucnhxLjQuY250eHRfaWQ6IDEzCmRldi5jYy4wLnJ4cS40 LmFic19pZDogMTMKZGV2LmNjLjAucnhxLjQuZG1hbGVuOiA2NTUzNgpkZXYuY2MuMC5yeHEuNC5i YTogMjQ5MTQ1NTg5NzYKZGV2LmNjLjAucnhxLjMuZmwuY2x1c3Rlcl9mYXN0X3JlY3ljbGVkOiAw CmRldi5jYy4wLnJ4cS4zLmZsLmNsdXN0ZXJfcmVjeWNsZWQ6IDAKZGV2LmNjLjAucnhxLjMuZmwu Y2x1c3Rlcl9hbGxvY2F0ZWQ6IDE2MApkZXYuY2MuMC5yeHEuMy5mbC5waWR4OiAxNjAKZGV2LmNj LjAucnhxLjMuZmwucnhfb2Zmc2V0OiAwCmRldi5jYy4wLnJ4cS4zLmZsLmNpZHg6IDAKZGV2LmNj LjAucnhxLjMuZmwucGFja2luZzogMQpkZXYuY2MuMC5yeHEuMy5mbC5wYWRkaW5nOiAxCmRldi5j Yy4wLnJ4cS4zLmZsLmNudHh0X2lkOiAyMQpkZXYuY2MuMC5yeHEuMy5mbC5kbWFsZW46IDgxOTIK ZGV2LmNjLjAucnhxLjMuZmwuYmE6IDI0ODU1NjY2Njg4CmRldi5jYy4wLnJ4cS4zLnZ4bGFuX3J4 Y3N1bTogMApkZXYuY2MuMC5yeHEuMy52bGFuX2V4dHJhY3Rpb246IDAKZGV2LmNjLjAucnhxLjMu cnhjc3VtOiAwCmRldi5jYy4wLnJ4cS4zLmxyb19mbHVzaGVkOiAwCmRldi5jYy4wLnJ4cS4zLmxy b19xdWV1ZWQ6IDAKZGV2LmNjLjAucnhxLjMuY2lkeDogMApkZXYuY2MuMC5yeHEuMy5jbnR4dF9p ZDogMTIKZGV2LmNjLjAucnhxLjMuYWJzX2lkOiAxMgpkZXYuY2MuMC5yeHEuMy5kbWFsZW46IDY1 NTM2CmRldi5jYy4wLnJ4cS4zLmJhOiAyNDkxNDQ5MzQ0MApkZXYuY2MuMC5yeHEuMi5mbC5jbHVz dGVyX2Zhc3RfcmVjeWNsZWQ6IDE2MjQKZGV2LmNjLjAucnhxLjIuZmwuY2x1c3Rlcl9yZWN5Y2xl ZDogOTgyOTI1OQpkZXYuY2MuMC5yeHEuMi5mbC5jbHVzdGVyX2FsbG9jYXRlZDogMTY2MDgyOQpk ZXYuY2MuMC5yeHEuMi5mbC5waWR4OiA3NTIKZGV2LmNjLjAucnhxLjIuZmwucnhfb2Zmc2V0OiAy NTYKZGV2LmNjLjAucnhxLjIuZmwuY2lkeDogNzY1CmRldi5jYy4wLnJ4cS4yLmZsLnBhY2tpbmc6 IDEKZGV2LmNjLjAucnhxLjIuZmwucGFkZGluZzogMQpkZXYuY2MuMC5yeHEuMi5mbC5jbnR4dF9p ZDogMjAKZGV2LmNjLjAucnhxLjIuZmwuZG1hbGVuOiA4MTkyCmRldi5jYy4wLnJ4cS4yLmZsLmJh OiAyNDkxNDIwNjcyMApkZXYuY2MuMC5yeHEuMi52eGxhbl9yeGNzdW06IDAKZGV2LmNjLjAucnhx LjIudmxhbl9leHRyYWN0aW9uOiAwCmRldi5jYy4wLnJ4cS4yLnJ4Y3N1bTogMjM1OTg5NDEKZGV2 LmNjLjAucnhxLjIubHJvX2ZsdXNoZWQ6IDAKZGV2LmNjLjAucnhxLjIubHJvX3F1ZXVlZDogMApk ZXYuY2MuMC5yeHEuMi5jaWR4OiA1MDIKZGV2LmNjLjAucnhxLjIuY250eHRfaWQ6IDExCmRldi5j Yy4wLnJ4cS4yLmFic19pZDogMTEKZGV2LmNjLjAucnhxLjIuZG1hbGVuOiA2NTUzNgpkZXYuY2Mu MC5yeHEuMi5iYTogMjQ5MTQ0Mjc5MDQKZGV2LmNjLjAucnhxLjEuZmwuY2x1c3Rlcl9mYXN0X3Jl Y3ljbGVkOiAwCmRldi5jYy4wLnJ4cS4xLmZsLmNsdXN0ZXJfcmVjeWNsZWQ6IDAKZGV2LmNjLjAu cnhxLjEuZmwuY2x1c3Rlcl9hbGxvY2F0ZWQ6IDE2MApkZXYuY2MuMC5yeHEuMS5mbC5waWR4OiAx NjAKZGV2LmNjLjAucnhxLjEuZmwucnhfb2Zmc2V0OiAwCmRldi5jYy4wLnJ4cS4xLmZsLmNpZHg6 IDAKZGV2LmNjLjAucnhxLjEuZmwucGFja2luZzogMQpkZXYuY2MuMC5yeHEuMS5mbC5wYWRkaW5n OiAxCmRldi5jYy4wLnJ4cS4xLmZsLmNudHh0X2lkOiAxOQpkZXYuY2MuMC5yeHEuMS5mbC5kbWFs ZW46IDgxOTIKZGV2LmNjLjAucnhxLjEuZmwuYmE6IDI0OTE0MTk4NTI4CmRldi5jYy4wLnJ4cS4x LnZ4bGFuX3J4Y3N1bTogMApkZXYuY2MuMC5yeHEuMS52bGFuX2V4dHJhY3Rpb246IDAKZGV2LmNj LjAucnhxLjEucnhjc3VtOiAwCmRldi5jYy4wLnJ4cS4xLmxyb19mbHVzaGVkOiAwCmRldi5jYy4w LnJ4cS4xLmxyb19xdWV1ZWQ6IDAKZGV2LmNjLjAucnhxLjEuY2lkeDogMApkZXYuY2MuMC5yeHEu MS5jbnR4dF9pZDogMTAKZGV2LmNjLjAucnhxLjEuYWJzX2lkOiAxMApkZXYuY2MuMC5yeHEuMS5k bWFsZW46IDY1NTM2CmRldi5jYy4wLnJ4cS4xLmJhOiAyNDkxNDM2MjM2OApkZXYuY2MuMC5yeHEu MC5mbC5jbHVzdGVyX2Zhc3RfcmVjeWNsZWQ6IDAKZGV2LmNjLjAucnhxLjAuZmwuY2x1c3Rlcl9y ZWN5Y2xlZDogMApkZXYuY2MuMC5yeHEuMC5mbC5jbHVzdGVyX2FsbG9jYXRlZDogMjg4CmRldi5j Yy4wLnJ4cS4wLmZsLnBpZHg6IDI4OApkZXYuY2MuMC5yeHEuMC5mbC5yeF9vZmZzZXQ6IDI1Ngpk ZXYuY2MuMC5yeHEuMC5mbC5jaWR4OiAwCmRldi5jYy4wLnJ4cS4wLmZsLnBhY2tpbmc6IDEKZGV2 LmNjLjAucnhxLjAuZmwucGFkZGluZzogMQpkZXYuY2MuMC5yeHEuMC5mbC5jbnR4dF9pZDogMTgK ZGV2LmNjLjAucnhxLjAuZmwuZG1hbGVuOiA4MTkyCmRldi5jYy4wLnJ4cS4wLmZsLmJhOiAyNDg0 OTg5OTUyMApkZXYuY2MuMC5yeHEuMC52eGxhbl9yeGNzdW06IDAKZGV2LmNjLjAucnhxLjAudmxh bl9leHRyYWN0aW9uOiAwCmRldi5jYy4wLnJ4cS4wLnJ4Y3N1bTogMApkZXYuY2MuMC5yeHEuMC5s cm9fZmx1c2hlZDogMApkZXYuY2MuMC5yeHEuMC5scm9fcXVldWVkOiAwCmRldi5jYy4wLnJ4cS4w LmNpZHg6IDIKZGV2LmNjLjAucnhxLjAuY250eHRfaWQ6IDkKZGV2LmNjLjAucnhxLjAuYWJzX2lk OiA5CmRldi5jYy4wLnJ4cS4wLmRtYWxlbjogNjU1MzYKZGV2LmNjLjAucnhxLjAuYmE6IDI0OTE0 Mjk2ODMyCmRldi5jYy4wLnN0YXRzLnJ4X3RydW5jMzogMApkZXYuY2MuMC5zdGF0cy5yeF90cnVu YzI6IDAKZGV2LmNjLjAuc3RhdHMucnhfdHJ1bmMxOiAwCmRldi5jYy4wLnN0YXRzLnJ4X3RydW5j MDogMApkZXYuY2MuMC5zdGF0cy5yeF9vdmZsb3czOiAwCmRldi5jYy4wLnN0YXRzLnJ4X292Zmxv dzI6IDAKZGV2LmNjLjAuc3RhdHMucnhfb3ZmbG93MTogMApkZXYuY2MuMC5zdGF0cy5yeF9vdmZs b3cwOiAwCmRldi5jYy4wLnN0YXRzLnJ4X3BwcDc6IDAKZGV2LmNjLjAuc3RhdHMucnhfcHBwNjog MApkZXYuY2MuMC5zdGF0cy5yeF9wcHA1OiAwCmRldi5jYy4wLnN0YXRzLnJ4X3BwcDQ6IDAKZGV2 LmNjLjAuc3RhdHMucnhfcHBwMzogMApkZXYuY2MuMC5zdGF0cy5yeF9wcHAyOiAwCmRldi5jYy4w LnN0YXRzLnJ4X3BwcDE6IDAKZGV2LmNjLjAuc3RhdHMucnhfcHBwMDogMApkZXYuY2MuMC5zdGF0 cy5yeF9wYXVzZTogMApkZXYuY2MuMC5zdGF0cy5yeF9mcmFtZXNfMTUxOV9tYXg6IDAKZGV2LmNj LjAuc3RhdHMucnhfZnJhbWVzXzEwMjRfMTUxODogMjI5NDI0MDkKZGV2LmNjLjAuc3RhdHMucnhf ZnJhbWVzXzUxMl8xMDIzOiAyNgpkZXYuY2MuMC5zdGF0cy5yeF9mcmFtZXNfMjU2XzUxMTogMjEK ZGV2LmNjLjAuc3RhdHMucnhfZnJhbWVzXzEyOF8yNTU6IDI2OApkZXYuY2MuMC5zdGF0cy5yeF9m cmFtZXNfNjVfMTI3OiA2NTYyMTcKZGV2LmNjLjAuc3RhdHMucnhfZnJhbWVzXzY0OiAxCmRldi5j Yy4wLnN0YXRzLnJ4X3J1bnQ6IDAKZGV2LmNjLjAuc3RhdHMucnhfc3ltYm9sX2VycjogMApkZXYu Y2MuMC5zdGF0cy5yeF9sZW5fZXJyOiAwCmRldi5jYy4wLnN0YXRzLnJ4X2Zjc19lcnI6IDAKZGV2 LmNjLjAuc3RhdHMucnhfamFiYmVyOiAwCmRldi5jYy4wLnN0YXRzLnJ4X3Rvb19sb25nOiAwCmRl di5jYy4wLnN0YXRzLnJ4X3VjYXN0X2ZyYW1lczogMjM1OTg5NDEKZGV2LmNjLjAuc3RhdHMucnhf bWNhc3RfZnJhbWVzOiAwCmRldi5jYy4wLnN0YXRzLnJ4X2JjYXN0X2ZyYW1lczogMQpkZXYuY2Mu MC5zdGF0cy5yeF9mcmFtZXM6IDIzNTk4OTQyCmRldi5jYy4wLnN0YXRzLnJ4X29jdGV0czogMzM4 OTk4NTg2MjIKZGV2LmNjLjAuc3RhdHMudHhfcHBwNzogMApkZXYuY2MuMC5zdGF0cy50eF9wcHA2 OiAwCmRldi5jYy4wLnN0YXRzLnR4X3BwcDU6IDAKZGV2LmNjLjAuc3RhdHMudHhfcHBwNDogMApk ZXYuY2MuMC5zdGF0cy50eF9wcHAzOiAwCmRldi5jYy4wLnN0YXRzLnR4X3BwcDI6IDAKZGV2LmNj LjAuc3RhdHMudHhfcHBwMTogMApkZXYuY2MuMC5zdGF0cy50eF9wcHAwOiAwCmRldi5jYy4wLnN0 YXRzLnR4X3BhdXNlOiAwCmRldi5jYy4wLnN0YXRzLnR4X2Ryb3A6IDAKZGV2LmNjLjAuc3RhdHMu dHhfZnJhbWVzXzE1MTlfbWF4OiAwCmRldi5jYy4wLnN0YXRzLnR4X2ZyYW1lc18xMDI0XzE1MTg6 IDAKZGV2LmNjLjAuc3RhdHMudHhfZnJhbWVzXzUxMl8xMDIzOiAwCmRldi5jYy4wLnN0YXRzLnR4 X2ZyYW1lc18yNTZfNTExOiAwCmRldi5jYy4wLnN0YXRzLnR4X2ZyYW1lc18xMjhfMjU1OiA4NzY1 MzIKZGV2LmNjLjAuc3RhdHMudHhfZnJhbWVzXzY1XzEyNzogMTEwNDI0MTEKZGV2LmNjLjAuc3Rh dHMudHhfZnJhbWVzXzY0OiAxCmRldi5jYy4wLnN0YXRzLnR4X2Vycm9yX2ZyYW1lczogMApkZXYu Y2MuMC5zdGF0cy50eF91Y2FzdF9mcmFtZXM6IDExOTE4OTQ0CmRldi5jYy4wLnN0YXRzLnR4X21j YXN0X2ZyYW1lczogMApkZXYuY2MuMC5zdGF0cy50eF9iY2FzdF9mcmFtZXM6IDAKZGV2LmNjLjAu c3RhdHMudHhfZnJhbWVzOiAxMTkxODk0NApkZXYuY2MuMC5zdGF0cy50eF9vY3RldHM6IDE1MTIz MjAxMzgKZGV2LmNjLjAuc3RhdHMudHhfcGFyc2VfZXJyb3I6IDAKZGV2LmNjLjAudGMuMTUucGFy YW1zOiAxR2JwcyBhZ2dyZWdhdGUKZGV2LmNjLjAudGMuMTUucmVmY291bnQ6IDAKZGV2LmNjLjAu dGMuMTUuZmxhZ3M6IDAKZGV2LmNjLjAudGMuMTQucGFyYW1zOiAxR2JwcyBhZ2dyZWdhdGUKZGV2 LmNjLjAudGMuMTQucmVmY291bnQ6IDAKZGV2LmNjLjAudGMuMTQuZmxhZ3M6IDAKZGV2LmNjLjAu dGMuMTMucGFyYW1zOiAxR2JwcyBhZ2dyZWdhdGUKZGV2LmNjLjAudGMuMTMucmVmY291bnQ6IDAK ZGV2LmNjLjAudGMuMTMuZmxhZ3M6IDAKZGV2LmNjLjAudGMuMTIucGFyYW1zOiAxR2JwcyBhZ2dy ZWdhdGUKZGV2LmNjLjAudGMuMTIucmVmY291bnQ6IDAKZGV2LmNjLjAudGMuMTIuZmxhZ3M6IDAK ZGV2LmNjLjAudGMuMTEucGFyYW1zOiAxR2JwcyBhZ2dyZWdhdGUKZGV2LmNjLjAudGMuMTEucmVm Y291bnQ6IDAKZGV2LmNjLjAudGMuMTEuZmxhZ3M6IDAKZGV2LmNjLjAudGMuMTAucGFyYW1zOiAx R2JwcyBhZ2dyZWdhdGUKZGV2LmNjLjAudGMuMTAucmVmY291bnQ6IDAKZGV2LmNjLjAudGMuMTAu ZmxhZ3M6IDAKZGV2LmNjLjAudGMuOS5wYXJhbXM6IDFHYnBzIGFnZ3JlZ2F0ZQpkZXYuY2MuMC50 Yy45LnJlZmNvdW50OiAwCmRldi5jYy4wLnRjLjkuZmxhZ3M6IDAKZGV2LmNjLjAudGMuOC5wYXJh bXM6IDFHYnBzIGFnZ3JlZ2F0ZQpkZXYuY2MuMC50Yy44LnJlZmNvdW50OiAwCmRldi5jYy4wLnRj LjguZmxhZ3M6IDAKZGV2LmNjLjAudGMuNy5wYXJhbXM6IDFHYnBzIGFnZ3JlZ2F0ZQpkZXYuY2Mu MC50Yy43LnJlZmNvdW50OiAwCmRldi5jYy4wLnRjLjcuZmxhZ3M6IDAKZGV2LmNjLjAudGMuNi5w YXJhbXM6IDFHYnBzIGFnZ3JlZ2F0ZQpkZXYuY2MuMC50Yy42LnJlZmNvdW50OiAwCmRldi5jYy4w LnRjLjYuZmxhZ3M6IDAKZGV2LmNjLjAudGMuNS5wYXJhbXM6IDFHYnBzIGFnZ3JlZ2F0ZQpkZXYu Y2MuMC50Yy41LnJlZmNvdW50OiAwCmRldi5jYy4wLnRjLjUuZmxhZ3M6IDAKZGV2LmNjLjAudGMu NC5wYXJhbXM6IDFHYnBzIGFnZ3JlZ2F0ZQpkZXYuY2MuMC50Yy40LnJlZmNvdW50OiAwCmRldi5j Yy4wLnRjLjQuZmxhZ3M6IDAKZGV2LmNjLjAudGMuMy5wYXJhbXM6IDFHYnBzIGFnZ3JlZ2F0ZQpk ZXYuY2MuMC50Yy4zLnJlZmNvdW50OiAwCmRldi5jYy4wLnRjLjMuZmxhZ3M6IDAKZGV2LmNjLjAu dGMuMi5wYXJhbXM6IDFHYnBzIGFnZ3JlZ2F0ZQpkZXYuY2MuMC50Yy4yLnJlZmNvdW50OiAwCmRl di5jYy4wLnRjLjIuZmxhZ3M6IDAKZGV2LmNjLjAudGMuMS5wYXJhbXM6IDFHYnBzIGFnZ3JlZ2F0 ZQpkZXYuY2MuMC50Yy4xLnJlZmNvdW50OiAwCmRldi5jYy4wLnRjLjEuZmxhZ3M6IDAKZGV2LmNj LjAudGMuMC5wYXJhbXM6IDFHYnBzIGFnZ3JlZ2F0ZQpkZXYuY2MuMC50Yy4wLnJlZmNvdW50OiAw CmRldi5jYy4wLnRjLjAuZmxhZ3M6IDAKZGV2LmNjLjAudGMuYnVyc3RzaXplOiAwCmRldi5jYy4w LnRjLnBrdHNpemU6IDAKZGV2LmNjLjAucnhfY19jaGFuOiAwCmRldi5jYy4wLnJ4X2VfY2hhbl9t YXA6IDEKZGV2LmNjLjAubXBzX2JnX21hcDogMwpkZXYuY2MuMC5tYXhfc3BlZWQ6IDEwMApkZXYu Y2MuMC5scGFjYXBzOiA0NTg3NTIKZGV2LmNjLjAuYWNhcHM6IDU0NTcxODMzNgpkZXYuY2MuMC5w Y2FwczogODY1MDA5NzkwCmRldi5jYy4wLmF1dG9uZWc6IC0xCmRldi5jYy4wLm1vZHVsZV9mZWM6 IDE8UlMtRkVDPgpkZXYuY2MuMC5mZWM6IDIxPFJTLUZFQyxhdXRvPgpkZXYuY2MuMC5wYXVzZV9z ZXR0aW5nczogNzxSWCxUWCxBVVRPPgpkZXYuY2MuMC5saW5rZG5yYzogbi9hCmRldi5jYy4wLnFz aXplX3R4cTogMTAyNApkZXYuY2MuMC5xc2l6ZV9yeHE6IDEwMjQKZGV2LmNjLjAuaG9sZG9mZl9w a3RjX2lkeDogLTEKZGV2LmNjLjAuaG9sZG9mZl90bXJfaWR4OiAxCmRldi5jYy4wLmZpcnN0X29m bGRfdHhxOiAwCmRldi5jYy4wLm5vZmxkdHhxOiA4CmRldi5jYy4wLmhvbGRvZmZfcGt0Y19pZHhf b2ZsZDogLTEKZGV2LmNjLjAuaG9sZG9mZl90bXJfaWR4X29mbGQ6IDEKZGV2LmNjLjAuZmlyc3Rf b2ZsZF9yeHE6IDAKZGV2LmNjLjAubm9mbGRyeHE6IDIKZGV2LmNjLjAudHhfdm1fd3I6IDAKZGV2 LmNjLjAucnNydl9ub2Zsb3dxOiAwCmRldi5jYy4wLnJzc19zaXplOiAxMjgKZGV2LmNjLjAucnNz X2Jhc2U6IDAKZGV2LmNjLjAuZmlyc3RfdHhxOiAwCmRldi5jYy4wLmZpcnN0X3J4cTogMApkZXYu Y2MuMC5udHhxOiAxNgpkZXYuY2MuMC5ucnhxOiA4CmRldi5jYy4wLnZpaWQ6IDIzNzIKZGV2LmNj LjAuJWRvbWFpbjogMApkZXYuY2MuMC4lcGFyZW50OiB0Nm5leDAKZGV2LmNjLjAuJXBucGluZm86 IApkZXYuY2MuMC4lbG9jYXRpb246IHBvcnQ9MApkZXYuY2MuMC4lZHJpdmVyOiBjYwpkZXYuY2Mu MC4lZGVzYzogcG9ydCAwCmRldi5jYy4lcGFyZW50OiAK --000000000000c880c605c14afbd0-- From owner-freebsd-net@freebsd.org Sun May 2 18:33:52 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 8B46E62CBCC for ; Sun, 2 May 2021 18:33:52 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 4FYF9r3KCGz4vhv for ; Sun, 2 May 2021 18:33:52 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 71E6262CBCB; Sun, 2 May 2021 18:33:52 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 71AFC62CB7D for ; Sun, 2 May 2021 18:33:52 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4FYF9r2k2Hz4vdZ for ; Sun, 2 May 2021 18:33:52 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 509497865 for ; Sun, 2 May 2021 18:33:52 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 142IXqPt012405 for ; Sun, 2 May 2021 18:33:52 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 142IXqk1012404 for net@FreeBSD.org; Sun, 2 May 2021 18:33:52 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 238411] igb(4): Wake on Lan not working with Intel I210 Date: Sun, 02 May 2021 18:33:50 +0000 X-Bugzilla-Reason: AssignedTo CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 12.0-RELEASE X-Bugzilla-Keywords: IntelNetworking, needs-qa, regression X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: abraham@gmx.at X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: net@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 02 May 2021 18:33:52 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D238411 --- Comment #24 from Abraham122x --- (In reply to Kaho Toshikazu from comment #23) I applied your patch (except sub "em_get_wakeup" because I don't have the n= ew enumerations in my package) and can confirm it does exactly what I need: ifconfig igb1 wol_packet sets the WOL option and the single NIC gets in WOL state when powered down. Perfect. Thanks. --=20 You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug.= From owner-freebsd-net@freebsd.org Sun May 2 20:04:56 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 5044E62FBD1 for ; Sun, 2 May 2021 20:04:56 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 4FYHBw1dqxz3H3V for ; Sun, 2 May 2021 20:04:56 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 3836662FE25; Sun, 2 May 2021 20:04:56 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 3800B62FBD0 for ; Sun, 2 May 2021 20:04:56 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4FYHBw14n7z3Gy9 for ; Sun, 2 May 2021 20:04:56 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 182E211147 for ; Sun, 2 May 2021 20:04:56 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 142K4u9m056395 for ; Sun, 2 May 2021 20:04:56 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 142K4u0d056394 for net@FreeBSD.org; Sun, 2 May 2021 20:04:56 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 241954] netgraph fails on concurrent node rename Date: Sun, 02 May 2021 20:04:54 +0000 X-Bugzilla-Reason: AssignedTo CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 12.1-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: donner@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: donner@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_status cc assigned_to Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 02 May 2021 20:04:56 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D241954 Lutz Donnerhacke changed: What |Removed |Added ---------------------------------------------------------------------------- Status|New |Open CC| |net@FreeBSD.org Assignee|net@FreeBSD.org |donner@FreeBSD.org --=20 You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug.= From owner-freebsd-net@freebsd.org Sun May 2 21:00:21 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id E4DFC5F9F1D for ; Sun, 2 May 2021 21:00:21 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 4FYJQs4wLNz3Kd0 for ; Sun, 2 May 2021 21:00:21 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: by mailman.nyi.freebsd.org (Postfix) id 98A915F9E30; Sun, 2 May 2021 21:00:21 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 979805F9DA9 for ; Sun, 2 May 2021 21:00:21 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4FYJQs0lwhz3KPQ for ; Sun, 2 May 2021 21:00:21 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 79C9A11863 for ; Sun, 2 May 2021 21:00:20 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 142L0KNH084974 for ; Sun, 2 May 2021 21:00:20 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 142L0Km0084973 for net@FreeBSD.org; Sun, 2 May 2021 21:00:20 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Message-Id: <202105022100.142L0Km0084973@kenobi.freebsd.org> X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@FreeBSD.org using -f From: bugzilla-noreply@FreeBSD.org To: net@FreeBSD.org Subject: Problem reports for net@FreeBSD.org that need special attention Date: Sun, 2 May 2021 21:00:20 +0000 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.34 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 02 May 2021 21:00:22 -0000 To view an individual PR, use: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=(Bug Id). The following is a listing of current problems submitted by FreeBSD users, which need special attention. These represent problem reports covering all versions including experimental development code and obsolete releases. Status | Bug Id | Description ------------+-----------+--------------------------------------------------- In Progress | 221146 | [ixgbe] Problem with second laggport New | 204438 | setsockopt() handling of kern.ipc.maxsockbuf limi New | 213410 | [carp] service netif restart causes hang only whe Open | 7556 | ppp: sl_compress_init() will fail if called anyth Open | 166724 | if_re(4): watchdog timeout Open | 193452 | Dell PowerEdge 210 II -- Kernel panic bce (broadc Open | 194453 | dummynet(4): pipe config bw parameter limited to Open | 200319 | Bridge+CARP crashes/freezes Open | 202510 | [CARP] advertisements sourced from CARP IP cause Open | 207261 | netmap: Doesn't do TX sync with kqueue Open | 217978 | dhclient: Support supersede statement for option Open | 222273 | igb(4): Kernel panic (fatal trap 12) due to netwo Open | 225438 | panic in6_unlink_ifa() due to race Open | 227720 | Kernel panic in ppp server Open | 230807 | if_alc(4): Driver not working for Killer Networki Open | 236888 | ppp daemon: Allow MTU to be overridden for PPPoE Open | 236983 | bnxt(4) VLAN not operational unless explicit "ifc Open | 237072 | netgraph(4): performance issue [on HardenedBSD]? Open | 237840 | Removed dummynet dependency on ipfw Open | 238324 | Add XG-C100C/AQtion AQC107 10GbE NIC driver Open | 238707 | Lock order reversal: rtentry vs "nd6 list" Open | 240944 | em(4): Crash with Intel 82571EB NIC with AMD Pile Open | 241106 | tun/ppp: panic: vm_fault: fault on nofault entry Open | 241162 | Panic in closefp() triggered by nginx (uwsgi with Open | 243463 | ix0: Watchdog timeout Open | 244066 | divert: Add sysctls for divert socket send and re Open | 118111 | rc: network.subr Add MAC address based interface 27 problems total for which you should take action. From owner-freebsd-net@freebsd.org Sun May 2 23:00:15 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id C47445FD35E for ; Sun, 2 May 2021 23:00:15 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 4FYM5C51lLz3Qpy for ; Sun, 2 May 2021 23:00:15 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id AC62A5FD600; Sun, 2 May 2021 23:00:15 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id AC2B45FD520 for ; Sun, 2 May 2021 23:00:15 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4FYM5C4RfXz3Qmm for ; Sun, 2 May 2021 23:00:15 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 8A03D1394A for ; Sun, 2 May 2021 23:00:15 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 142N0FdW046983 for ; Sun, 2 May 2021 23:00:15 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 142N0FvH046982 for net@FreeBSD.org; Sun, 2 May 2021 23:00:15 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 254333] [tcp] sysctl net.inet.tcp.hostcache.list hangs Date: Sun, 02 May 2021 23:00:15 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.4-STABLE X-Bugzilla-Keywords: performance X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: rscheff@freebsd.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: FIXED X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: rscheff@freebsd.org X-Bugzilla-Flags: mfc-stable13? mfc-stable12? mfc-stable11? X-Bugzilla-Changed-Fields: bug_status resolution Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 02 May 2021 23:00:15 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D254333 Richard Scheffenegger changed: What |Removed |Added ---------------------------------------------------------------------------- Status|In Progress |Closed Resolution|--- |FIXED --=20 You are receiving this mail because: You are on the CC list for the bug.= From owner-freebsd-net@freebsd.org Mon May 3 00:52:24 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id A94A2621EF1 for ; Mon, 3 May 2021 00:52:24 +0000 (UTC) (envelope-from bc979@lafn.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 4FYPZc3gNQz3mZ6 for ; Mon, 3 May 2021 00:52:24 +0000 (UTC) (envelope-from bc979@lafn.org) Received: by mailman.nyi.freebsd.org (Postfix) id 7DF69621EF0; Mon, 3 May 2021 00:52:24 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 7DBF0622354 for ; Mon, 3 May 2021 00:52:24 +0000 (UTC) (envelope-from bc979@lafn.org) Received: from mail.sermon-archive.info (sermon-archive.info [47.181.130.121]) by mx1.freebsd.org (Postfix) with ESMTP id 4FYPZb5Jlpz3mhy for ; Mon, 3 May 2021 00:52:23 +0000 (UTC) (envelope-from bc979@lafn.org) Received: from smtpclient.apple (mini [10.0.1.251]) by mail.sermon-archive.info (Postfix) with ESMTPSA id 4FYPZZ6QVdz2fjSF for ; Sun, 2 May 2021 17:52:22 -0700 (PDT) From: Doug Hardie Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable Mime-Version: 1.0 (Mac OS X Mail 14.0 \(3654.80.0.2.43\)) Subject: Re: Problem with resolver/host Date: Sun, 2 May 2021 17:52:22 -0700 References: <041E6B07-0797-436F-909F-5B77ED77DAEC@sermon-archive.info> To: "net@freebsd.org" In-Reply-To: <041E6B07-0797-436F-909F-5B77ED77DAEC@sermon-archive.info> Message-Id: <51F58892-1383-4698-8984-173CDE01AB67@sermon-archive.info> X-Mailer: Apple Mail (2.3654.80.0.2.43) X-Virus-Scanned: clamav-milter 0.103.1 at mail X-Virus-Status: Clean X-Rspamd-Queue-Id: 4FYPZb5Jlpz3mhy X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of bc979@lafn.org designates 47.181.130.121 as permitted sender) smtp.mailfrom=bc979@lafn.org X-Spamd-Result: default: False [-1.39 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; NEURAL_SPAM_SHORT(0.30)[0.301]; NEURAL_HAM_MEDIUM(-0.99)[-0.994]; FROM_HAS_DN(0.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[47.181.130.121:from]; R_SPF_ALLOW(-0.20)[+mx:c]; MV_CASE(0.50)[]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[net@freebsd.org]; DMARC_NA(0.00)[lafn.org: no valid DMARC record]; RCPT_COUNT_ONE(0.00)[1]; SPAMHAUS_ZRD(0.00)[47.181.130.121:from:127.0.2.255]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; TO_DN_EQ_ADDR_ALL(0.00)[]; RCVD_NO_TLS_LAST(0.10)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:5650, ipnet:47.181.128.0/18, country:US]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[net] X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 03 May 2021 00:52:24 -0000 > On 20 April 2021, at 14:12, Doug Hardie wrote: >=20 > I suspect this is an issue with the resolver, but it could also be in = host. I have the following in /etc/resolv.conf: >=20 > # Generated by resolvconf > nameserver fe80::213:72ff:fec3:180f%bge0 > nameserver fe80::120c:6bff:fee9:cdf7%bge0 >=20 > There is a DNS server running at the first address that supplies IPv6 = addresses. When I ping the first address, it succeeds: >=20 > test# ping fe80::213:72ff:fec3:180f%bge0 > PING6(56=3D40+8+8 bytes) fe80::6a5b:35ff:fed3:4eda%bge0 --> = fe80::213:72ff:fec3:180f%bge0 > 16 bytes from fe80::213:72ff:fec3:180f%bge0, icmp_seq=3D0 hlim=3D64 = time=3D0.321 ms > 16 bytes from fe80::213:72ff:fec3:180f%bge0, icmp_seq=3D1 hlim=3D64 = time=3D0.553 ms > 16 bytes from fe80::213:72ff:fec3:180f%bge0, icmp_seq=3D2 hlim=3D64 = time=3D0.544 ms > 16 bytes from fe80::213:72ff:fec3:180f%bge0, icmp_seq=3D3 hlim=3D64 = time=3D0.424 ms >=20 > However, host client.global.example return an error: >=20 > test# host client.global.example > ;; connection timed out; no servers could be reached >=20 > ktrace of host shows that either host or the resolver is trying to use = the address without the %bge0 which is why that error occurs: >=20 > 2027 host STRU struct sockaddr { AF_INET6, = [fe80::213:72ff:fec3:180f]:53 } > 2027 host RET sendto -1 errno 51 Network is unreachable >=20 > Is this a bug or is there some configuration item I have missed: >=20 I have filed a bug report: Bug 255316 on this. However, it is still = sitting in limbo: =20 Assignee: freebsd-bugs (Nobody) I am not sure that the patch I provided is not going to break something = else. I am not sure this is the right place to ask these questions. = The resolver is used for more than just finding the default route. I = also have no idea how to build the parts needed to test it. I know the = patch works fine in a simple test case where I extracted that portion of = the code as a standalone test. I don't want to do a buildworld as that = machine has no cooling and overheats quickly. =20 -- Doug= From owner-freebsd-net@freebsd.org Mon May 3 01:08:28 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 0C1E4622643 for ; Mon, 3 May 2021 01:08:28 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 4FYPx76k7Tz3nHB for ; Mon, 3 May 2021 01:08:27 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id E4FCD622642; Mon, 3 May 2021 01:08:27 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id E4C886226B6 for ; Mon, 3 May 2021 01:08:27 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4FYPx764wfz3n15 for ; Mon, 3 May 2021 01:08:27 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id C48AB151FA for ; Mon, 3 May 2021 01:08:27 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 14318RGu018601 for ; Mon, 3 May 2021 01:08:27 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 14318RIQ018600 for net@FreeBSD.org; Mon, 3 May 2021 01:08:27 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 254333] [tcp] sysctl net.inet.tcp.hostcache.list hangs Date: Mon, 03 May 2021 01:08:27 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.4-STABLE X-Bugzilla-Keywords: performance X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: koobs@FreeBSD.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: rscheff@freebsd.org X-Bugzilla-Flags: mfc-stable13? mfc-stable12? mfc-stable11? X-Bugzilla-Changed-Fields: resolution bug_status Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 03 May 2021 01:08:28 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D254333 Kubilay Kocak changed: What |Removed |Added ---------------------------------------------------------------------------- Resolution|FIXED |--- Status|Closed |In Progress --- Comment #44 from Kubilay Kocak --- Thank you for the update Richard. Re-open pending MFC. If this will not aor cannot be merged to a particular stable/ branch, please set mfc-stableX fla= g to - with comment --=20 You are receiving this mail because: You are on the CC list for the bug.= From owner-freebsd-net@freebsd.org Mon May 3 02:27:26 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id C80E162485C for ; Mon, 3 May 2021 02:27:26 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 4FYRhG3X7Qz3rDf for ; Mon, 3 May 2021 02:27:26 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 76D8D6245D7; Mon, 3 May 2021 02:27:26 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 76A2062427E for ; Mon, 3 May 2021 02:27:26 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4FYRhG2r9jz3rGq for ; Mon, 3 May 2021 02:27:26 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4FD1F1612F for ; Mon, 3 May 2021 02:27:26 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 1432RQ0g060391 for ; Mon, 3 May 2021 02:27:26 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 1432RQwp060390 for net@FreeBSD.org; Mon, 3 May 2021 02:27:26 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 203476] [net] [igb] not optimal checksum processing Date: Mon, 03 May 2021 02:27:26 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 10.2-STABLE X-Bugzilla-Keywords: IntelNetworking, patch X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: kbowling@freebsd.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: Overcome By Events X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: net@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: resolution cc bug_status Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 03 May 2021 02:27:26 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D203476 Kevin Bowling changed: What |Removed |Added ---------------------------------------------------------------------------- Resolution|--- |Overcome By Events CC| |kbowling@freebsd.org Status|New |Closed --- Comment #1 from Kevin Bowling --- The way this works in the FreeBSD 12+ driver looks correct with respect to = your patch. If you want to review the current settings take a look at isc_tx_csum_flags in if_em.c. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-net@freebsd.org Mon May 3 09:27:37 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 0A94162C646 for ; Mon, 3 May 2021 09:27:37 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 4FYd146kcqz4cdW for ; Mon, 3 May 2021 09:27:36 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id E52DC62C566; Mon, 3 May 2021 09:27:36 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id E4F0B62C732 for ; Mon, 3 May 2021 09:27:36 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4FYd1463plz4clw for ; Mon, 3 May 2021 09:27:36 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id BF5C21BD06 for ; Mon, 3 May 2021 09:27:36 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 1439Raeo071397 for ; Mon, 3 May 2021 09:27:36 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 1439Raav071396 for net@FreeBSD.org; Mon, 3 May 2021 09:27:36 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 255558] No IPv4/ARP traffic on vlan interface when using IntX.Y notation, vlanXY works Date: Mon, 03 May 2021 09:27:36 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 12.2-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: linimon@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: net@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: assigned_to Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 03 May 2021 09:27:37 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D255558 Mark Linimon changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|bugs@FreeBSD.org |net@FreeBSD.org --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-net@freebsd.org Mon May 3 17:56:37 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 9F90D639062 for ; Mon, 3 May 2021 17:56:37 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 4FYrJP3wXvz3KSj for ; Mon, 3 May 2021 17:56:37 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 84663639231; Mon, 3 May 2021 17:56:37 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 842D8638FFA for ; Mon, 3 May 2021 17:56:37 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4FYrJP3Fv5z3K8m for ; Mon, 3 May 2021 17:56:37 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 6352122893 for ; Mon, 3 May 2021 17:56:37 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 143HubuB032168 for ; Mon, 3 May 2021 17:56:37 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 143Hubd0032167 for net@FreeBSD.org; Mon, 3 May 2021 17:56:37 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 255507] traceroute6 generates wrong UDP checksum Date: Mon, 03 May 2021 17:56:37 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: 13.0-STABLE X-Bugzilla-Keywords: regression X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: commit-hook@FreeBSD.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: net@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 03 May 2021 17:56:37 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D255507 --- Comment #2 from commit-hook@FreeBSD.org --- A commit in branch main references this bug: URL: https://cgit.FreeBSD.org/src/commit/?id=3D1d712c05370dca8cbf81d1ecd9acd606f= dcacaf4 commit 1d712c05370dca8cbf81d1ecd9acd606fdcacaf4 Author: Zhenlei Huang AuthorDate: 2021-05-03 16:46:19 +0000 Commit: Mark Johnston CommitDate: 2021-05-03 17:24:30 +0000 traceroute6: Properly calculate UDP checksum The revision D25604 capsicumize traceroute6. For UDP the send socket was changed from SOCK_DGRAM to SOCK_RAW and thus the UDP checksum need be calculated by application itself other than the kernel. outpacket is filled with zeros by line 707, thus the first round the UDP checksum is correct. But subsequent rounds outudp->uh_sum will be left with garbage. PR: 255507 Reviewed by: ae, markj, tuexen MFC after: 3 days Differential Revision: https://reviews.freebsd.org/D30042 usr.sbin/traceroute6/traceroute6.c | 1 + 1 file changed, 1 insertion(+) --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-net@freebsd.org Mon May 3 18:04:34 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 4A54B639523 for ; Mon, 3 May 2021 18:04:34 +0000 (UTC) (envelope-from schmiedgen@gmx.net) Received: from mout.gmx.net (mout.gmx.net [212.227.17.22]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange ECDHE (P-256) server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "mout.gmx.net", Issuer "TeleSec ServerPass Class 2 CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4FYrTY18YNz3Kql for ; Mon, 3 May 2021 18:04:32 +0000 (UTC) (envelope-from schmiedgen@gmx.net) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=gmx.net; s=badeba3b8450; t=1620065071; bh=i8IaWUxmG/lHMVQkGfWGPvPkLQgVkroGdD66mezdtlQ=; h=X-UI-Sender-Class:To:From:Subject:Date; b=g4PeOhSiDOj2GtHEK164MBASh65ODtcKJrSae65ZiAg4mGnYaEvBSes9qN00ZxZCk sVnZ9+j/x8oJZgqkKy3y0QzqG9iEkrQvGKeHkuq2ovl6MniSeW20LGLSkrFRi3kQ/o 4boORLOxdNrxO4V5Hf5GKScK6x2tPayfFICEO2FE= X-UI-Sender-Class: 01bb95c1-4bf8-414a-932a-4f6e2808ef9c Received: from [192.168.10.5] ([62.246.110.10]) by mail.gmx.net (mrgmx105 [212.227.17.168]) with ESMTPSA (Nemesis) id 1MqJmF-1l9jkz4BZj-00nND8 for ; Mon, 03 May 2021 20:04:31 +0200 To: freebsd-net@freebsd.org From: Michael Schmiedgen Subject: page fault while in kernel mode - after upgrade from 12.2 to 13.0 Message-ID: Date: Mon, 3 May 2021 20:04:30 +0200 User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:78.0) Gecko/20100101 Thunderbird/78.10.0 MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: quoted-printable X-Provags-ID: V03:K1:8IKsBsXjsOIWm+Ae7B4KqzFYhC873ALiDBszXxzwwjlAYpWpPIq LuHlw5oNYHhW5kkekdO0oiFfwndBkrAUJHaFPkYO+IEnG9AkpFjIvjkiv3QB581Kc6W9F5z HUKXWPO/3LjPlxqmuzkbVrq8vjZ4pGB0HvZUs6QQ2yOo91xBj00o4YQnZsHFl/BiWurQw2d gQJgDfdv+nA+Sfg3wrgIQ== X-Spam-Flag: NO X-UI-Out-Filterresults: notjunk:1;V03:K0:vx/rXRuyRvs=:bAqlH6aEs7dfnejaaISkNp YvmH8FQb+IROQou/qOzttLmB1FndIBEIMj8kjO4UmJNPP5nhdbKco2+QzzQA7OzpT6JtHtrko OLMeDP/cXnTGpW7+BURSNJmW94AtCh32sotrAbAS31JUzsVqsgcYNf1v5wmcalB4kh8loLvm+ j/6wVtYsfbfzmYS3VSsuYk85gQQ2Td86UaJr5wtmgWFcRBthu3xkdthJSv1RJCTaaX0dUTDlJ 9XFzBTdXPGsKPzs14WWz5RKPDkQHmxBFTfYljU1U/TfXso9cSOUGVy8lg4I4ls2O+Vqj3mZ3l GRpgFUcHMs8WNokfCF5zuzB4xuGkpmOfTdEtmKSZFdJSORXtSpHmAOKVzg9Apx9g/+cnFvurB AGF0dZ+pXZfZ0FJMN+I8NNZiQw7GmL6A6wlaaGd9KdG3y1Q4NNNAMyMBc1qRcS8e881m14vOL l75DyLap7vU/GV8UXqamicKDc5PUqGnDDDO1qd3y3GDm0RQD1tEjIAXULEiX4+ogd0fZ6YMlC TGrowpR71ZQYD08fdiCYf6BfNW29OjPmQcJa741vny5bkKuhltc2Bes7omfkeWf47+AxKJfU9 wl+SsvW18XPLTMB3oKxIZFX95tuztxtAxeC5sqjquPNAnKMizjKfsNRTd364WeSZ+Wue4m3lj lelUIpsjOUSFKqU0wbBpGPkstvfd36lX2xv2J9pJ92by6r88zuSX/09N7Y/FGIURX2cU2BwMi 8LKG3eEyi6RVlvbPBuT5zNp+mXz0ebj+DGisvRnmKfzAyl4fWDZR2OF3TXoIUsiLY3ZpF7npU a9z4xghOn0Nxl8pqNkReufThNm5ZUrFEm8ZQWGwd+gdw/2PukZYWGm8hcnBiLCTvwCm+iG+7s N2/vtPbzKNOerk6QN7E9NkDvMwkCjXbFdLhG5VJ3oa2RKzj00HU+jqJb4HTx02v8LnVeKYDJ1 gaQpLJiZBaFYO9RXgc308XIEtqOgaKSFWsAskoj5F1KtwRYiodDBjHIyw2gQKaWtnIxIT7ROO fKPcAif+w8SUqoj3wXPIn2TtOeFdMvmrvu5uRA9I5XjyikBUpk89YZIJ/yAl4MCbDQle2zJZ6 eVrCCMHmu20JPjjH7X/SFBluJHvXI6vybMSRd4PD3ttzzVrWLtYbUOeL/zQTyWCOesBDgNdH6 Du7PCRca0fJW1e2cl8r1MWrYf9Mq4i2KvhIHCWzWvZGxlC9T10jVW4K6uF1MR8gsQ+hq4= X-Rspamd-Queue-Id: 4FYrTY18YNz3Kql X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmx.net header.s=badeba3b8450 header.b=g4PeOhSi; dmarc=pass (policy=none) header.from=gmx.net; spf=pass (mx1.freebsd.org: domain of schmiedgen@gmx.net designates 212.227.17.22 as permitted sender) smtp.mailfrom=schmiedgen@gmx.net X-Spamd-Result: default: False [-4.10 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; FREEMAIL_FROM(0.00)[gmx.net]; R_SPF_ALLOW(-0.20)[+ip4:212.227.17.0/27]; TO_DN_NONE(0.00)[]; DKIM_TRACE(0.00)[gmx.net:+]; DMARC_POLICY_ALLOW(-0.50)[gmx.net,none]; NEURAL_HAM_SHORT(-1.00)[-1.000]; RCVD_IN_DNSWL_LOW(-0.10)[212.227.17.22:from]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[gmx.net]; MID_RHS_MATCH_FROM(0.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[212.227.17.22:from]; DWL_DNSWL_NONE(0.00)[gmx.net:dkim]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[gmx.net:s=badeba3b8450]; FROM_HAS_DN(0.00)[]; ASN(0.00)[asn:8560, ipnet:212.227.0.0/16, country:DE]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-net@freebsd.org]; NEURAL_HAM_LONG(-1.00)[-1.000]; RCPT_COUNT_ONE(0.00)[1]; SPAMHAUS_ZRD(0.00)[212.227.17.22:from:127.0.2.255]; RWL_MAILSPIKE_POSSIBLE(0.00)[212.227.17.22:from]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-net] X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 03 May 2021 18:04:34 -0000 Hi List, if I start a Samba jail, after a few seconds the system crashes. Very repr= oducible. System has ~10 jails and 3 bhyve VMs. Dell server, Xeon E3-1240, 64GB RAM,= 3 way mirror ZFS. It also occurs a few seconds after I start a phone call using the SIP VM o= f that machine, very strange. I got some log messages suggesting raising somaxconn, so I did kern.ipc.somaxconn=3D4096 in sysctl.conf Below some debug information, please let me know if I should provide furth= er information. Should I open a bug or something? Thank you very much! Michael Fatal trap 12: page fault while in kernel mode cpuid =3D 0; apic id =3D 00 fault virtual address =3D 0x0 fault code =3D supervisor read data, page not present instruction pointer =3D 0x20:0xffffffff80ca52c0 stack pointer =3D 0x28:0xfffffe019d039650 frame pointer =3D 0x28:0xfffffe019d039690 code segment =3D base 0x0, limit 0xfffff, type 0x1b =3D DPL 0, pres 1, long 1, def32 0, gran 1 processor eflags =3D interrupt enabled, resume, IOPL =3D 0 current process =3D 649 (devd) trap number =3D 12 panic: page fault cpuid =3D 0 time =3D 1620061253 KDB: stack backtrace: #0 0xffffffff80c57345 at kdb_backtrace+0x65 #1 0xffffffff80c09d21 at vpanic+0x181 #2 0xffffffff80c09b93 at panic+0x43 #3 0xffffffff8108b187 at trap_fatal+0x387 #4 0xffffffff8108b1df at trap_pfault+0x4f #5 0xffffffff8108a83d at trap+0x27d #6 0xffffffff810617a8 at calltrap+0x8 #7 0xffffffff80ca51c3 at sbappendaddr_locked+0x93 #8 0xffffffff80cb437a at uipc_send+0x73a #9 0xffffffff80ca9053 at sosend_generic+0x633 #10 0xffffffff80ca94e0 at sosend+0x50 #11 0xffffffff80caff2e at kern_sendit+0x20e #12 0xffffffff80cb032b at sendit+0x1db #13 0xffffffff80cb013d at sys_sendto+0x4d #14 0xffffffff8108ba8c at amd64_syscall+0x10c #15 0xffffffff810620ce at fast_syscall_common+0xf8 Uptime: 2m2s Dumping 2373 out of 65454 MB:..1%..11%..21%..31%..41%..51%..61%..71%..81%.= .91% __curthread () at /usr/src/sys/amd64/include/pcpu_aux.h:55 55 __asm("movq %%gs:%P1,%0" : "=3Dr" (td) : "n" (offsetof(str= uct pcpu, (kgdb) list *0xffffffff80ca52c0 0xffffffff80ca52c0 is in sbappendaddr_locked_internal (/usr/src/sys/kern/u= ipc_sockbuf.c:1169). 1164 if (ctrl_last) 1165 ctrl_last->m_next =3D m0; /* concatenate data to c= ontrol */ 1166 else 1167 control =3D m0; 1168 m->m_next =3D control; 1169 for (n =3D m; n->m_next !=3D NULL; n =3D n->m_next) 1170 sballoc(sb, n); 1171 sballoc(sb, n); 1172 nlast =3D n; 1173 SBLINKRECORD(sb, m); (kgdb) backtrace #0 __curthread () at /usr/src/sys/amd64/include/pcpu_aux.h:55 #1 doadump (textdump=3D) at /usr/src/sys/kern/kern_shutdow= n.c:399 #2 0xffffffff80c09916 in kern_reboot (howto=3D260) at /usr/src/sys/kern/k= ern_shutdown.c:486 #3 0xffffffff80c09d90 in vpanic (fmt=3D, ap=3D) at /usr/src/sys/kern/kern_shutdown.c:919 #4 0xffffffff80c09b93 in panic (fmt=3D) at /usr/src/sys/kern= /kern_shutdown.c:843 #5 0xffffffff8108b187 in trap_fatal (frame=3D0xfffffe019d039590, eva=3D0)= at /usr/src/sys/amd64/amd64/trap.c:915 #6 0xffffffff8108b1df in trap_pfault (frame=3Dframe@entry=3D0xfffffe019d0= 39590, usermode=3Dfalse, signo=3D, signo@entry=3D0x0, ucode= =3D, ucode@entry=3D0x0) at /usr/src/sys/amd64/amd64/trap.c:732 #7 0xffffffff8108a83d in trap (frame=3D0xfffffe019d039590) at /usr/src/sy= s/amd64/amd64/trap.c:398 #8 #9 sbappendaddr_locked_internal (sb=3Dsb@entry=3D0xfffff800447ef4f8, asa= =3Dasa@entry=3D0xffffffff815cde60 , m0=3D, m0@entry=3D0xfffff8008b186500, control=3D0xfffff8008b186500, control@entry=3D0x0, ctrl_last=3D) at /usr/src/sys/ker= n/uipc_sockbuf.c:1169 #10 0xffffffff80ca51c3 in sbappendaddr_locked (sb=3Dsb@entry=3D0xfffff8004= 47ef4f8, asa=3Dasa@entry=3D0xffffffff815cde60 , m0=3Dm0@entry=3D0xfffff8008b186500, control=3D0x0) at /usr/src/sys/kern/uipc_sockbuf.c:1205 #11 0xffffffff80cb437a in uipc_send (so=3D, flags=3D0, m=3D= 0xfffff8008b186500, nam=3D, control=3D0x10, td=3D) at /usr/src/sys/kern/uipc_usrreq.c:1056 #12 0xffffffff80ca9053 in sosend_generic (so=3D0xfffff800444abb10, addr=3D= 0x0, uio=3D, top=3D0xfffff8008b186500, control=3D0x0, flags= =3D0, td=3D0xfffffe0165ddc500) at /usr/src/sys/kern/uipc_socket.c:1755 #13 0xffffffff80ca94e0 in sosend (so=3D0x100, so@entry=3D0xfffff800444abb1= 0, addr=3D0xb5ea5000, uio=3D0xfffff8008b186500, uio@entry=3D0xfffffe019d03= 9898, top=3D0x10, top@entry=3D0x0, control=3Dcontrol@entry=3D0x0, flags=3D272, flags@entry=3D0, td=3D0xf= ffffe0165ddc500) at /usr/src/sys/kern/uipc_socket.c:1810 #14 0xffffffff80caff2e in kern_sendit (td=3D, td@entry=3D0x= fffffe0165ddc500, s=3D8, mp=3D, mp@entry=3D0xfffffe019d0399= 80, flags=3D0, control=3D0x0, segflg=3Dsegflg@entry=3DUIO_USERSPACE) at /usr/src/sys/kern/uipc_sysc= alls.c:798 #15 0xffffffff80cb032b in sendit (td=3D0xfffffe0165ddc500, s=3D-1242935296= , mp=3Dmp@entry=3D0xfffffe019d039980, flags=3D16) at /usr/src/sys/kern/uip= c_syscalls.c:723 #16 0xffffffff80cb013d in sys_sendto (td=3D0x100, uap=3D) a= t /usr/src/sys/kern/uipc_syscalls.c:841 #17 0xffffffff8108ba8c in syscallenter (td=3D0xfffffe0165ddc500) at /usr/s= rc/sys/amd64/amd64/../../kern/subr_syscall.c:189 #18 amd64_syscall (td=3D0xfffffe0165ddc500, traced=3D0) at /usr/src/sys/am= d64/amd64/trap.c:1156 #19 #20 0x00000000002858ea in ?? () From owner-freebsd-net@freebsd.org Mon May 3 19:31:15 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id ABA1F63B13F for ; Mon, 3 May 2021 19:31:15 +0000 (UTC) (envelope-from markjdb@gmail.com) Received: from mail-qk1-x72d.google.com (mail-qk1-x72d.google.com [IPv6:2607:f8b0:4864:20::72d]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4FYtPV1XC4z3PWV for ; Mon, 3 May 2021 19:31:10 +0000 (UTC) (envelope-from markjdb@gmail.com) Received: by mail-qk1-x72d.google.com with SMTP id o5so6310211qkb.0 for ; Mon, 03 May 2021 12:31:10 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=sender:date:from:to:cc:subject:message-id:references:mime-version :content-disposition:content-transfer-encoding:in-reply-to; bh=Hi5AR/OQxdxnvT0o78potHzW9DwEtx/4Gvpu0uG9vrI=; b=UzzgqkAKbyZZhFLyYz98WCw52RfHUQCsedmSktBdo7oW+Hbt9w4nUXRZc3ZvC3AylE OC0X0wjsfNWTzlmnkJY2Qar7WmCcLwSG446VArA/g4EgcnT/Y70bL9MUrxcM1qDCry0B Miyw9nGlangPxiGWG/Z4yEh6nwPpouHuIq7t0kiECa2sAUS2Oov9fNn3tS809IH9c7E9 Vmp+NbU0KV67E4MXMVCK+jP6cikQKYDV61Ng+sRQGRoBJRzwKl6SOmNvFkVPnHJKxn/F cPhmVdlarGucULbJ6kOKUFniLyWR9S6De6kOTfAOY7iuvBh6Gcv5BCnD6JppF/QkTFvp gqJA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:sender:date:from:to:cc:subject:message-id :references:mime-version:content-disposition :content-transfer-encoding:in-reply-to; bh=Hi5AR/OQxdxnvT0o78potHzW9DwEtx/4Gvpu0uG9vrI=; b=TFIwrZ8IZgiQOzF+ZRzm7lH5MKkgGeVGXuLjBGKKc2wG+bfsnHszbZW7lrL3pr+0wP aivPrwt7mrGkqJUCuJ3niSA4ou7o+yYu0LdtxK4Q+eUYgcxF0ASnc1JWqMd+jHaggxJZ 1jhbz7ZLSP7N5FWsmKPtgWiWfcl5owv7h74DPNKNKpQY7QoubF8y5tZWS35Je9c5y0qz i2xD5KZQOTKLj/7QmYvaYDzRMAeK3qqWKvpq/wwK/oxQbiNtFEDSMPRyJt4xqESIMfYM n7bEi77paL2ijyPrf8+dKJYhNqiaxeM4AN+oUyESHfL7F4PmzkmyfAFoYmCX+gs59hjU MDZg== X-Gm-Message-State: AOAM530rEQdpJ5+gVgqvP28n5Z510uTvxrMp3Rcp5RyKBIAp+SnmCm/h lDgEi0prh7Ee2hJksIVn8yJO/MYCy1z1VA== X-Google-Smtp-Source: ABdhPJyUQdEwSGfb0mahgOsMGudNcEdaYG5+SffN9kkpRIeNu6rCSiMTpJHC7TzqiynCBkBOYj+OVA== X-Received: by 2002:ae9:df82:: with SMTP id t124mr20472338qkf.267.1620070269300; Mon, 03 May 2021 12:31:09 -0700 (PDT) Received: from nuc ([142.126.164.150]) by smtp.gmail.com with ESMTPSA id t18sm9333469qkj.75.2021.05.03.12.31.08 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Mon, 03 May 2021 12:31:08 -0700 (PDT) Sender: Mark Johnston Date: Mon, 3 May 2021 15:31:09 -0400 From: Mark Johnston To: "Andrey V. Elsukov" Cc: =?iso-8859-1?Q?=D6zkan?= KIRIK , FreeBSD Net Subject: Re: IPsec performace - netisr hits %100 Message-ID: References: <50cfc0e6-5cc6-7004-2566-bc06428d4394@yandex.ru> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: <50cfc0e6-5cc6-7004-2566-bc06428d4394@yandex.ru> X-Rspamd-Queue-Id: 4FYtPV1XC4z3PWV X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=UzzgqkAK; dmarc=none; spf=pass (mx1.freebsd.org: domain of markjdb@gmail.com designates 2607:f8b0:4864:20::72d as permitted sender) smtp.mailfrom=markjdb@gmail.com X-Spamd-Result: default: False [-1.75 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; RCVD_COUNT_THREE(0.00)[3]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; NEURAL_HAM_SHORT(-0.05)[-0.046]; FREEMAIL_TO(0.00)[yandex.ru]; FORGED_SENDER(0.30)[markj@freebsd.org,markjdb@gmail.com]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; FROM_NEQ_ENVFROM(0.00)[markj@freebsd.org,markjdb@gmail.com]; RBL_DBL_DONT_QUERY_IPS(0.00)[2607:f8b0:4864:20::72d:from]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; NEURAL_HAM_LONG(-1.00)[-1.000]; TAGGED_RCPT(0.00)[]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-net@freebsd.org]; DMARC_NA(0.00)[freebsd.org]; SPAMHAUS_ZRD(0.00)[2607:f8b0:4864:20::72d:from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; BLOCKLISTDE_FAIL(0.00)[142.126.164.150:query timed out,2607:f8b0:4864:20::72d:query timed out]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::72d:from]; MID_RHS_NOT_FQDN(0.50)[]; FREEMAIL_CC(0.00)[gmail.com,freebsd.org]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-net] X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 03 May 2021 19:31:15 -0000 On Sun, May 02, 2021 at 04:08:18PM +0300, Andrey V. Elsukov wrote: > 30.04.2021 23:32, Mark Johnston пишет: > > Second, netipsec unconditionally hands rx processing off to netisr > > threads for some reason, that's why changing the dispatch policy doesn't > > help. Maybe it's to help avoid running out of kernel stack space or to > > somehow avoid packet reordering in some case that is not clear to me. I > > tried a patch (see below) which eliminates this and it helped somewhat. > > If anyone can provide an explanation for the current behaviour I'd > > appreciate it. > > Previously we have reports about kernel stack overflow during IPsec > processing. In your example there is only one IPsec transform is > configured, but it is possible to configure several in the bundle, > AFAIR, it is limited to 4 transforms. E.g. if you configure ESP+AH - it > is bundle of two transforms and this will grow kernel stack requirements. Is it only a problem for synchronous crypto ops? With hardware drivers I'd expect the stack usage to be reset after each transform, since completions are handled by a dedicated thread. There is also the net.inet.ipsec.async_crypto knob, which has a similar effect I think. From owner-freebsd-net@freebsd.org Mon May 3 19:45:54 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 669EB63BBF0 for ; Mon, 3 May 2021 19:45:54 +0000 (UTC) (envelope-from markjdb@gmail.com) Received: from mail-qt1-x831.google.com (mail-qt1-x831.google.com [IPv6:2607:f8b0:4864:20::831]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4FYtkT0tXgz3QFj for ; Mon, 3 May 2021 19:45:53 +0000 (UTC) (envelope-from markjdb@gmail.com) Received: by mail-qt1-x831.google.com with SMTP id z5so4631310qts.3 for ; Mon, 03 May 2021 12:45:53 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=sender:date:from:to:cc:subject:message-id:references:mime-version :content-disposition:in-reply-to; bh=4dsrx/fZ/ZiZz4LRVI6lj0RwwlsMopCLAxGE2ux/Z+M=; b=o5HiaEcP8oMnB6qvpQWCESE8cWE4bOf3BRJW7H4loSYflPv21i3BnXDsQFni9p21He nVE+7QfhcE9K5/UKjHSG2kWlvQB5J7tstL7YALqRNLO98WeUBP7XaIzOBYuIULxgaFm+ oWy6X1/SPT4zpngTA/qCr/fS0saiQWTjZ7Exj5d6XMFJKw/kRvruINCOukGteGBL2IPw Z7E0dnSbDkrrV5gk5B8JsZ8bxhjt6j58RDbvkdzZ5nXOCpH4lNRp/s8seGlNrIbylQjF jPQLwLouA26bfFi7Dl20VxIzZXm8XIWaYLZgERkwJKm1soufZGOHsxvzWD57behEM3Av IKZQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:sender:date:from:to:cc:subject:message-id :references:mime-version:content-disposition:in-reply-to; bh=4dsrx/fZ/ZiZz4LRVI6lj0RwwlsMopCLAxGE2ux/Z+M=; b=uL9Imis1jtA9FyjNdPwYJmnlLuqUBwfs79AL145jNDBEmxmSHYE/goT9rmtkhCifls kL/9m4Ws7oJrAXqFF2Gn6OPIO2/xmSeo3ObUvWVrvFAr9iuJqdsV0goyDm+fU2PdTdUU n4MrZywbRPWf0uyEhOTfIAezlafHEiEYu+zGz4zbG9vm2yWpcGuPKyb9yAZybTup8ow8 nqaBUoB5SXZAIMtzsCoeTummqKqOsms0qaaLSAydnmybJAfGVSgsEnungYRMaU3O+dkU H2w4GctqGXVnNiHqFDiIFOcGA+tvSl74/Wo1zHS8icwj6+BRKYmeZtlofb+AtlXY/Quf 3nMg== X-Gm-Message-State: AOAM533uHtHiwdNPez+/AmjldQSJWSaH0YK60bgpBFknQy8D45FcrAWf 2fdiHqQ0LQTPBnuDQT5053Y= X-Google-Smtp-Source: ABdhPJzJuGv8AvJ+R6CHQmfPbQaQHxwaaRnkFzYFRgt6y0n9pj4QBajuZsKh0gk93SsDvnShE2SZlg== X-Received: by 2002:ac8:5f48:: with SMTP id y8mr18836709qta.69.1620071152228; Mon, 03 May 2021 12:45:52 -0700 (PDT) Received: from nuc ([142.126.164.150]) by smtp.gmail.com with ESMTPSA id e11sm8754864qkl.32.2021.05.03.12.45.51 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Mon, 03 May 2021 12:45:51 -0700 (PDT) Sender: Mark Johnston Date: Mon, 3 May 2021 15:45:53 -0400 From: Mark Johnston To: Michael Schmiedgen Cc: freebsd-net@freebsd.org Subject: Re: page fault while in kernel mode - after upgrade from 12.2 to 13.0 Message-ID: References: MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: X-Rspamd-Queue-Id: 4FYtkT0tXgz3QFj X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=o5HiaEcP; dmarc=none; spf=pass (mx1.freebsd.org: domain of markjdb@gmail.com designates 2607:f8b0:4864:20::831 as permitted sender) smtp.mailfrom=markjdb@gmail.com X-Spamd-Result: default: False [-2.70 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; RCVD_COUNT_THREE(0.00)[3]; DKIM_TRACE(0.00)[gmail.com:+]; RCPT_COUNT_TWO(0.00)[2]; NEURAL_HAM_SHORT(-1.00)[-1.000]; FREEMAIL_TO(0.00)[gmx.net]; FORGED_SENDER(0.30)[markj@freebsd.org,markjdb@gmail.com]; MIME_TRACE(0.00)[0:+]; RBL_DBL_DONT_QUERY_IPS(0.00)[2607:f8b0:4864:20::831:from]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; FROM_NEQ_ENVFROM(0.00)[markj@freebsd.org,markjdb@gmail.com]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-0.999]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; FROM_HAS_DN(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-net@freebsd.org]; DMARC_NA(0.00)[freebsd.org]; SPAMHAUS_ZRD(0.00)[2607:f8b0:4864:20::831:from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::831:from]; MID_RHS_NOT_FQDN(0.50)[]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-net] X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 03 May 2021 19:45:54 -0000 On Mon, May 03, 2021 at 08:04:30PM +0200, Michael Schmiedgen wrote: > Hi List, > > if I start a Samba jail, after a few seconds the system crashes. Very reproducible. > > System has ~10 jails and 3 bhyve VMs. Dell server, Xeon E3-1240, 64GB RAM, 3 way mirror ZFS. > > It also occurs a few seconds after I start a phone call using the SIP VM of that machine, > very strange. > > I got some log messages suggesting raising somaxconn, so I did > > kern.ipc.somaxconn=4096 > > in sysctl.conf > > > Below some debug information, please let me know if I should provide further information. > > Should I open a bug or something? > > Thank you very much! > Michael > > > > Fatal trap 12: page fault while in kernel mode > cpuid = 0; apic id = 00 > fault virtual address = 0x0 > fault code = supervisor read data, page not present > instruction pointer = 0x20:0xffffffff80ca52c0 > stack pointer = 0x28:0xfffffe019d039650 > frame pointer = 0x28:0xfffffe019d039690 > code segment = base 0x0, limit 0xfffff, type 0x1b > = DPL 0, pres 1, long 1, def32 0, gran 1 > processor eflags = interrupt enabled, resume, IOPL = 0 > current process = 649 (devd) > trap number = 12 > panic: page fault > cpuid = 0 > time = 1620061253 > KDB: stack backtrace: > #0 0xffffffff80c57345 at kdb_backtrace+0x65 > #1 0xffffffff80c09d21 at vpanic+0x181 > #2 0xffffffff80c09b93 at panic+0x43 > #3 0xffffffff8108b187 at trap_fatal+0x387 > #4 0xffffffff8108b1df at trap_pfault+0x4f > #5 0xffffffff8108a83d at trap+0x27d > #6 0xffffffff810617a8 at calltrap+0x8 > #7 0xffffffff80ca51c3 at sbappendaddr_locked+0x93 > #8 0xffffffff80cb437a at uipc_send+0x73a > #9 0xffffffff80ca9053 at sosend_generic+0x633 > #10 0xffffffff80ca94e0 at sosend+0x50 > #11 0xffffffff80caff2e at kern_sendit+0x20e > #12 0xffffffff80cb032b at sendit+0x1db > #13 0xffffffff80cb013d at sys_sendto+0x4d > #14 0xffffffff8108ba8c at amd64_syscall+0x10c > #15 0xffffffff810620ce at fast_syscall_common+0xf8 > Uptime: 2m2s > Dumping 2373 out of 65454 MB:..1%..11%..21%..31%..41%..51%..61%..71%..81%..91% > > __curthread () at /usr/src/sys/amd64/include/pcpu_aux.h:55 > 55 __asm("movq %%gs:%P1,%0" : "=r" (td) : "n" (offsetof(struct pcpu, > (kgdb) list *0xffffffff80ca52c0 > 0xffffffff80ca52c0 is in sbappendaddr_locked_internal (/usr/src/sys/kern/uipc_sockbuf.c:1169). > 1164 if (ctrl_last) > 1165 ctrl_last->m_next = m0; /* concatenate data to control */ > 1166 else > 1167 control = m0; > 1168 m->m_next = control; > 1169 for (n = m; n->m_next != NULL; n = n->m_next) > 1170 sballoc(sb, n); > 1171 sballoc(sb, n); > 1172 nlast = n; > 1173 SBLINKRECORD(sb, m); So we are crashing because "n" is somehow NULL? That seems difficult to explain. Can you show the local variables in this frame? Does the panic always have the same stack trace? From owner-freebsd-net@freebsd.org Tue May 4 16:57:51 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 84DFC5F987E for ; Tue, 4 May 2021 16:57:51 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 4FZQy738Gfz3lyQ for ; Tue, 4 May 2021 16:57:51 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 6A25E5F999C; Tue, 4 May 2021 16:57:51 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 69E8C5F9A94 for ; Tue, 4 May 2021 16:57:51 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4FZQy72V0Cz3lsc for ; Tue, 4 May 2021 16:57:51 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 48A9214D65 for ; Tue, 4 May 2021 16:57:51 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 144GvpY9053481 for ; Tue, 4 May 2021 16:57:51 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 144GvpW8053480 for net@FreeBSD.org; Tue, 4 May 2021 16:57:51 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 241954] netgraph fails on concurrent node rename Date: Tue, 04 May 2021 16:57:51 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 12.1-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: donner@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: donner@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 04 May 2021 16:57:51 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D241954 --- Comment #2 from Lutz Donnerhacke --- https://github.com/genneko/freebsd-vimage-jails/issues/2 describes the prob= lem in detail: ng_name_node() is called twice and does not recognize the rename= to the identical name. This might be solvable. --=20 You are receiving this mail because: You are on the CC list for the bug.= From owner-freebsd-net@freebsd.org Tue May 4 18:38:42 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id D930C5FD763 for ; Tue, 4 May 2021 18:38:42 +0000 (UTC) (envelope-from schmiedgen@gmx.net) Received: from mout.gmx.net (mout.gmx.net [212.227.17.22]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange ECDHE (P-256) server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "mout.gmx.net", Issuer "TeleSec ServerPass Class 2 CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4FZTBT6gDXz3sXp; Tue, 4 May 2021 18:38:41 +0000 (UTC) (envelope-from schmiedgen@gmx.net) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=gmx.net; s=badeba3b8450; t=1620153520; bh=OK4Z577p7w5gX2COZL493xGpDlDpvo5FqPdeUIxrSwA=; h=X-UI-Sender-Class:Subject:To:Cc:References:From:Date:In-Reply-To; b=MzyvxwwH7iDJQL9eM1sp4x2s1RplbqdnKjlwkTv3jEcD7kTkOtZQzCYoS1WvQfLK6 dJ+JAxdm8YjBlnhnqYH29u4yWHfyTS5A1qmgFbimX69qrF7piXn8JYZxQctWyK0i+p R/QvJ1vofDO40MVAXyp3a69YNQJHMB/KqaACXtl4= X-UI-Sender-Class: 01bb95c1-4bf8-414a-932a-4f6e2808ef9c Received: from [192.168.10.5] ([62.246.110.10]) by mail.gmx.net (mrgmx104 [212.227.17.168]) with ESMTPSA (Nemesis) id 1MwQXN-1lN9Te4Ayr-00sNIk; Tue, 04 May 2021 20:38:40 +0200 Subject: Re: page fault while in kernel mode - after upgrade from 12.2 to 13.0 To: Mark Johnston Cc: freebsd-net@freebsd.org References: From: Michael Schmiedgen Message-ID: Date: Tue, 4 May 2021 20:38:39 +0200 User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:78.0) Gecko/20100101 Thunderbird/78.10.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: quoted-printable X-Provags-ID: V03:K1:dK/1jb/8d7NTLjcwGPKYmOH6FePYBGxWy7/fr7E6fOUuJx8wHUb 1Dg/Xffy4vhMQ8WSmb1udOHAzl9O3U0dmq6KieWbqhGy4Ev4S8bHXtoL2mQTNC10jNx1suM DOEGJXPjioNaCZ3fuirg5pcx/TDtAXjXJDVSlFr23jKoo2OdbntVHYb/W6dLW7B95Gq8Lhu cy8cxQ2HwI7sFoAYTXEJg== X-Spam-Flag: NO X-UI-Out-Filterresults: notjunk:1;V03:K0:ec77GZXnC1s=:zTO4z9n/jYjZ5PB//nUNAF dEvuAkhwJtkmvwUjALwwuxSJUV1Rh3JuRFq7jhp9KpTYEOF7J7qFesxg/Y581pj+/ZPJ6iHgG Frs/ZJ2grWQbsh7sFvFgSbNUXdUifOt9UYxcrDsDPsPNsZg8GDd51F6oNIpNYBb7jANSkbpBx iUUCl+We4xhcssfMHmmT5uVU2JzxN60KT7UNwquPAQMcWhJ5xhW0N0ykwt5YCK4cvCeHd5GnX zaBvc59dG4hhl42Y8fghMqPtfQHqayahmdjZnYDyD2pUXY0rTD6Ko+AQTIE/9G0fao6RWkXO1 ip4gLsUtMrh934b+5Zb8uwFNM+OUMNP+EApQUSDv0ggX+NiI1fNSTJDHl464zeKVuIFQH47Ra Sw1ortYJK6+fTt1wIbDFjALY/lk64qA8qlNMO8qFuuXpST5q2lP7WpmjYxo7iDRyULfVx4Swt SQL/l5GV1yKQDnDVkfCwgvfndt/+FC3sAlViPBWUhUUhNqzWUjYBSnfNeVgUjDv1tAqUZanE7 34c/RxDMZN6mJgPsbgc32ymBr3QqX2E4lzmBrIYs6BPDnVgTbUlpi4azam73Zoi0ZMW/Lhinc 72SVB4DxP70tJzNvCJgsjOUoJU+L1imaxV678tG+7Cy9NxOh3DlY3c8Wawudihkb0aVUR122h 7/9VWZmxQP+wzZ9fQ/MaYY8oUHN76fKTUqT767AoCzBUkCm1S8l+SuRh4AyQ+Af7ULJ/Vx2gm 9nx2T/EmujWhQ73z0Sx+kDiMwKyC1yyLhGUrJCfDXnxCJoHYqUIjknH8gUvB5qj70hWVABsnS XEt106fPiLylyAhuTlmHvefNxdJBd5PHbl+7RfZ/dcwvaR111jKJn2qBSGPR1NnOEnt62GOEE A07VUni3tP/jxBV8G8MTQ6uV42BHFR10r3NJZaVUXIrFhkiBXWxWfV3gPNlq1xfjb9C00rXJj ZDCMARdcck1izcgIbWyNmRynO8J3qoOyziaUB7iYltm6/elUD5Py3b48PkpvE3uSoYoq0/8xy H38jaIqm9/VAm5UVK1VsrdDW7w/qwAthMjVMct+Xb8JxyL7F55Kp+VyzmZV2fJnjU9x0Z/ZrO NSbj5w2S1mkhH2AgdgvuIwJGcU8DECdcAZcuGlzggjNcfHWJ/nX14aT6JnPMa2wuVH6uXmcbd b+4mYWUYGtVRQLTt7EgtroVh1nqxG+hzmFv8zkDX1SyKV4HvWqhpAMIhVhndZhL/DQAE0= X-Rspamd-Queue-Id: 4FZTBT6gDXz3sXp X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmx.net header.s=badeba3b8450 header.b=MzyvxwwH; dmarc=pass (policy=none) header.from=gmx.net; spf=pass (mx1.freebsd.org: domain of schmiedgen@gmx.net designates 212.227.17.22 as permitted sender) smtp.mailfrom=schmiedgen@gmx.net X-Spamd-Result: default: False [-4.10 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_DN_SOME(0.00)[]; FREEMAIL_FROM(0.00)[gmx.net]; R_SPF_ALLOW(-0.20)[+ip4:212.227.17.0/27]; DKIM_TRACE(0.00)[gmx.net:+]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[gmx.net,none]; NEURAL_HAM_SHORT(-1.00)[-1.000]; RCVD_IN_DNSWL_LOW(-0.10)[212.227.17.22:from]; FROM_EQ_ENVFROM(0.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[212.227.17.22:from]; FREEMAIL_ENVFROM(0.00)[gmx.net]; MID_RHS_MATCH_FROM(0.00)[]; ASN(0.00)[asn:8560, ipnet:212.227.0.0/16, country:DE]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[gmx.net:s=badeba3b8450]; FROM_HAS_DN(0.00)[]; DWL_DNSWL_NONE(0.00)[gmx.net:dkim]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; MIME_TRACE(0.00)[0:+]; SPAMHAUS_ZRD(0.00)[212.227.17.22:from:127.0.2.255]; RWL_MAILSPIKE_POSSIBLE(0.00)[212.227.17.22:from]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-net] X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 04 May 2021 18:38:42 -0000 Hi Mark, sorry for the delay, I only can test after work. I triggered another 2 pan= ics, this time with a different result (see below). Can I provide some more information? Thank you! Michael =2D-- #1 Fatal trap 12: page fault while in kernel mode cpuid =3D 1; apic id =3D 01 fault virtual address =3D 0x388 fault code =3D supervisor read data, page not present instruction pointer =3D 0x20:0xffffffff80d3fa67 stack pointer =3D 0x28:0xfffffe0115bea9c0 frame pointer =3D 0x28:0xfffffe0115beaa20 code segment =3D base 0x0, limit 0xfffff, type 0x1b =3D DPL 0, pres 1, long 1, def32 0, gran 1 processor eflags =3D interrupt enabled, resume, IOPL =3D 0 current process =3D 12 (swi1: netisr 0) trap number =3D 12 panic: page fault cpuid =3D 1 time =3D 1620144777 KDB: stack backtrace: #0 0xffffffff80c57345 at kdb_backtrace+0x65 #1 0xffffffff80c09d21 at vpanic+0x181 #2 0xffffffff80c09b93 at panic+0x43 #3 0xffffffff8108b187 at trap_fatal+0x387 #4 0xffffffff8108b1df at trap_pfault+0x4f #5 0xffffffff8108a83d at trap+0x27d #6 0xffffffff810617a8 at calltrap+0x8 #7 0xffffffff80bcae5d at ithread_loop+0x24d #8 0xffffffff80bc7c5e at fork_exit+0x7e #9 0xffffffff8106282e at fork_trampoline+0xe Uptime: 3m51s Dumping 2617 out of 65454 MB:..1%..11%..21%..31%..41%..51%..61%..71%..81%.= .91% __curthread () at /usr/src/sys/amd64/include/pcpu_aux.h:55 55 __asm("movq %%gs:%P1,%0" : "=3Dr" (td) : "n" (offsetof(str= uct pcpu, (kgdb) list *0xffffffff80d3fa67 0xffffffff80d3fa67 is in swi_net (/usr/src/sys/net/netisr.c:918). 913 if (local_npw.nw_head =3D=3D NULL) 914 local_npw.nw_tail =3D NULL; 915 local_npw.nw_len--; 916 VNET_ASSERT(m->m_pkthdr.rcvif !=3D NULL, 917 ("%s:%d rcvif =3D=3D NULL: m=3D%p", __func__, = __LINE__, m)); 918 CURVNET_SET(m->m_pkthdr.rcvif->if_vnet); 919 netisr_proto[proto].np_handler(m); 920 CURVNET_RESTORE(); 921 } 922 KASSERT(local_npw.nw_len =3D=3D 0, (kgdb) backtrace #0 __curthread () at /usr/src/sys/amd64/include/pcpu_aux.h:55 #1 doadump (textdump=3D) at /usr/src/sys/kern/kern_shutdow= n.c:399 #2 0xffffffff80c09916 in kern_reboot (howto=3D260) at /usr/src/sys/kern/k= ern_shutdown.c:486 #3 0xffffffff80c09d90 in vpanic (fmt=3D, ap=3D) at /usr/src/sys/kern/kern_shutdown.c:919 #4 0xffffffff80c09b93 in panic (fmt=3D) at /usr/src/sys/kern= /kern_shutdown.c:843 #5 0xffffffff8108b187 in trap_fatal (frame=3D0xfffffe0115bea900, eva=3D90= 4) at /usr/src/sys/amd64/amd64/trap.c:915 #6 0xffffffff8108b1df in trap_pfault (frame=3Dframe@entry=3D0xfffffe0115b= ea900, usermode=3Dfalse, signo=3D, signo@entry=3D0x0, ucode= =3D, ucode@entry=3D0x0) at /usr/src/sys/amd64/amd64/trap.c:732 #7 0xffffffff8108a83d in trap (frame=3D0xfffffe0115bea900) at /usr/src/sy= s/amd64/amd64/trap.c:398 #8 #9 0xffffffff80d3fa67 in netisr_process_workstream_proto (nwsp=3D, proto=3D1) at /usr/src/sys/net/netisr.c:918 #10 swi_net (arg=3D) at /usr/src/sys/net/netisr.c:966 #11 0xffffffff80bcae5d in intr_event_execute_handlers (p=3D= , ie=3D0xfffff80003dbb600) at /usr/src/sys/kern/kern_intr.c:1168 #12 ithread_execute_handlers (p=3D, ie=3D0xfffff80003dbb600= ) at /usr/src/sys/kern/kern_intr.c:1181 #13 ithread_loop (arg=3Darg@entry=3D0xfffff80003dced40) at /usr/src/sys/ke= rn/kern_intr.c:1269 #14 0xffffffff80bc7c5e in fork_exit (callout=3D0xffffffff80bcac10 , arg=3D0xfffff80003dced40, frame=3D0xfffffe0115beab00) at /usr/src/sys/kern/kern_fork.c:1069 #15 =2D-- #2 Fatal trap 12: page fault while in kernel mode cpuid =3D 1; apic id =3D 01 fault virtual address =3D 0x8 fault code =3D supervisor read data, page not present instruction pointer =3D 0x20:0xffffffff80ca599c stack pointer =3D 0x28:0xfffffe0115bea6c0 frame pointer =3D 0x28:0xfffffe0115bea700 code segment =3D base 0x0, limit 0xfffff, type 0x1b =3D DPL 0, pres 1, long 1, def32 0, gran 1 processor eflags =3D interrupt enabled, resume, IOPL =3D 0 current process =3D 12 (swi1: netisr 0) trap number =3D 12 panic: page fault cpuid =3D 1 time =3D 1620152374 KDB: stack backtrace: #0 0xffffffff80c57345 at kdb_backtrace+0x65 #1 0xffffffff80c09d21 at vpanic+0x181 #2 0xffffffff80c09b93 at panic+0x43 #3 0xffffffff8108b187 at trap_fatal+0x387 #4 0xffffffff8108b1df at trap_pfault+0x4f #5 0xffffffff8108a83d at trap+0x27d #6 0xffffffff810617a8 at calltrap+0x8 #7 0xffffffff80dbf0ae at tcp_do_segment+0x10ce #8 0xffffffff80dbd21e at tcp_input+0xabe #9 0xffffffff80dafc15 at ip_input+0x125 #10 0xffffffff80d3fa7b at swi_net+0x12b #11 0xffffffff80bcae5d at ithread_loop+0x24d #12 0xffffffff80bc7c5e at fork_exit+0x7e #13 0xffffffff8106282e at fork_trampoline+0xe Uptime: 2h3m59s Dumping 2666 out of 65454 MB:..1%..11%..21%..31%..41%..51%..61%..71%..81%.= .91% __curthread () at /usr/src/sys/amd64/include/pcpu_aux.h:55 55 __asm("movq %%gs:%P1,%0" : "=3Dr" (td) : "n" (offsetof(str= uct pcpu, (kgdb) #0 __curthread () at /usr/src/sys/amd64/include/pcpu_aux.h:55 #1 doadump (textdump=3D) at /usr/src/sys/kern/kern_shutdown.c:399 #2 0xffffffff80c09916 in kern_reboot (howto=3D260) at /usr/src/sys/kern/kern_shutdown.c:486 #3 0xffffffff80c09d90 in vpanic (fmt=3D, ap=3D) at /usr/src/sys/kern/kern_shutdown.c:919 #4 0xffffffff80c09b93 in panic (fmt=3D) at /usr/src/sys/kern/kern_shutdown.c:843 #5 0xffffffff8108b187 in trap_fatal (frame=3D0xfffffe0115bea600, eva=3D8) at /usr/src/sys/amd64/amd64/trap.c:915 #6 0xffffffff8108b1df in trap_pfault (frame=3Dframe@entry=3D0xfffffe0115b= ea600, usermode=3Dfalse, signo=3D, signo@entry=3D0x0, ucode=3D, ucode@entry=3D0x0) at /usr/src/sys/amd64/amd64/trap.c:732 #7 0xffffffff8108a83d in trap (frame=3D0xfffffe0115bea600) at /usr/src/sys/amd64/amd64/trap.c:398 #8 #9 sbcut_internal (sb=3D0xfffff80522aa09c0, len=3D203, len@entry=3D476) at /usr/src/sys/kern/uipc_sockbuf.c:1491 #10 0xffffffff80ca5b8a in sbcut_locked (sb=3D0xfffff80522aa09c0, len=3D-743943424, len@entry=3D476) at /usr/src/sys/kern/uipc_sockbuf.= c:1591 #11 0xffffffff80dbf0ae in tcp_do_segment (m=3D0xfffff8004c2aae00, th=3D, so=3D, tp=3D, drop_hdrlen=3D52, tlen=3D, iptos=3D0 '\000') at /usr/src/sys/netinet/tcp_input.c:2918 #12 0xffffffff80dbd21e in tcp_input (mp=3D, offp=3D, proto=3D) at /usr/src/sys/netinet/tcp_input.c:1382 #13 0xffffffff80dafc15 in ip_input (m=3D0x0) at /usr/src/sys/netinet/ip_input.c:829 #14 0xffffffff80d3fa7b in netisr_process_workstream_proto ( nwsp=3D, proto=3D1) at /usr/src/sys/net/netisr.c:919 #15 swi_net (arg=3D) at /usr/src/sys/net/netisr.c:966 #16 0xffffffff80bcae5d in intr_event_execute_handlers (p=3D= , ie=3D0xfffff80003bbe500) at /usr/src/sys/kern/kern_intr.c:1168 #17 ithread_execute_handlers (p=3D, ie=3D0xfffff80003bbe500= ) at /usr/src/sys/kern/kern_intr.c:1181 #18 ithread_loop (arg=3Darg@entry=3D0xfffff80003cb6d40) at /usr/src/sys/kern/kern_intr.c:1269 #19 0xffffffff80bc7c5e in fork_exit ( callout=3D0xffffffff80bcac10 , arg=3D0xfffff80003cb6d40= , frame=3D0xfffffe0115beab00) at /usr/src/sys/kern/kern_fork.c:1069 #20 =2D-- On 03.05.2021 21:45, Mark Johnston wrote: > On Mon, May 03, 2021 at 08:04:30PM +0200, Michael Schmiedgen wrote: >> Hi List, >> >> if I start a Samba jail, after a few seconds the system crashes. Very r= eproducible. >> >> System has ~10 jails and 3 bhyve VMs. Dell server, Xeon E3-1240, 64GB R= AM, 3 way mirror ZFS. >> >> It also occurs a few seconds after I start a phone call using the SIP V= M of that machine, >> very strange. >> >> I got some log messages suggesting raising somaxconn, so I did >> >> kern.ipc.somaxconn=3D4096 >> >> in sysctl.conf >> >> >> Below some debug information, please let me know if I should provide fu= rther information. >> >> Should I open a bug or something? >> >> Thank you very much! >> Michael >> >> >> >> Fatal trap 12: page fault while in kernel mode >> cpuid =3D 0; apic id =3D 00 >> fault virtual address =3D 0x0 >> fault code =3D supervisor read data, page not present >> instruction pointer =3D 0x20:0xffffffff80ca52c0 >> stack pointer =3D 0x28:0xfffffe019d039650 >> frame pointer =3D 0x28:0xfffffe019d039690 >> code segment =3D base 0x0, limit 0xfffff, type 0x1b >> =3D DPL 0, pres 1, long 1, def32 0, gran 1 >> processor eflags =3D interrupt enabled, resume, IOPL =3D 0 >> current process =3D 649 (devd) >> trap number =3D 12 >> panic: page fault >> cpuid =3D 0 >> time =3D 1620061253 >> KDB: stack backtrace: >> #0 0xffffffff80c57345 at kdb_backtrace+0x65 >> #1 0xffffffff80c09d21 at vpanic+0x181 >> #2 0xffffffff80c09b93 at panic+0x43 >> #3 0xffffffff8108b187 at trap_fatal+0x387 >> #4 0xffffffff8108b1df at trap_pfault+0x4f >> #5 0xffffffff8108a83d at trap+0x27d >> #6 0xffffffff810617a8 at calltrap+0x8 >> #7 0xffffffff80ca51c3 at sbappendaddr_locked+0x93 >> #8 0xffffffff80cb437a at uipc_send+0x73a >> #9 0xffffffff80ca9053 at sosend_generic+0x633 >> #10 0xffffffff80ca94e0 at sosend+0x50 >> #11 0xffffffff80caff2e at kern_sendit+0x20e >> #12 0xffffffff80cb032b at sendit+0x1db >> #13 0xffffffff80cb013d at sys_sendto+0x4d >> #14 0xffffffff8108ba8c at amd64_syscall+0x10c >> #15 0xffffffff810620ce at fast_syscall_common+0xf8 >> Uptime: 2m2s >> Dumping 2373 out of 65454 MB:..1%..11%..21%..31%..41%..51%..61%..71%..8= 1%..91% >> >> __curthread () at /usr/src/sys/amd64/include/pcpu_aux.h:55 >> 55 __asm("movq %%gs:%P1,%0" : "=3Dr" (td) : "n" (offsetof(= struct pcpu, >> (kgdb) list *0xffffffff80ca52c0 >> 0xffffffff80ca52c0 is in sbappendaddr_locked_internal (/usr/src/sys/ker= n/uipc_sockbuf.c:1169). >> 1164 if (ctrl_last) >> 1165 ctrl_last->m_next =3D m0; /* concatenate data t= o control */ >> 1166 else >> 1167 control =3D m0; >> 1168 m->m_next =3D control; >> 1169 for (n =3D m; n->m_next !=3D NULL; n =3D n->m_next) >> 1170 sballoc(sb, n); >> 1171 sballoc(sb, n); >> 1172 nlast =3D n; >> 1173 SBLINKRECORD(sb, m); > > So we are crashing because "n" is somehow NULL? That seems difficult to > explain. Can you show the local variables in this frame? > > Does the panic always have the same stack trace? > From owner-freebsd-net@freebsd.org Tue May 4 19:02:47 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id D2ACE5FE600 for ; Tue, 4 May 2021 19:02:47 +0000 (UTC) (envelope-from markjdb@gmail.com) Received: from mail-qv1-xf36.google.com (mail-qv1-xf36.google.com [IPv6:2607:f8b0:4864:20::f36]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4FZTkB2bDVz3tYp for ; Tue, 4 May 2021 19:02:42 +0000 (UTC) (envelope-from markjdb@gmail.com) Received: by mail-qv1-xf36.google.com with SMTP id i8so22736qvv.0 for ; Tue, 04 May 2021 12:02:42 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=sender:date:from:to:cc:subject:message-id:references:mime-version :content-disposition:in-reply-to; bh=KC3FRcesCDrd2Ecx/HYckev66kcACPOwecmzlLh/jzA=; b=ptjFx+lKAZtWXRI1tS9GkZQrMZhcdoSHhN4xEqMuztwhIejpr9WNrOKF+r3QP3pNFB OzO0Z3mH9KgC73Y/MeDa2pcp5wNF5lDDWMH/eMwJwfriBZQ0YTLotJrK7C0bAml0LzoZ qfk29L0cre0iPWg9fB4gc0vzzGa6sEeg6DMz2LyISCii+iClt1buHuoS/hfGyZMYguev Ug2qrZOPfWinx24cjcfGmVZMAWtYd3421OlrCadOs1UW4zLiWjbnadYBwXTUPNqiwF9r pGddy34rv4z/078fjuyERLymMgrmMFf6D0WXullFm5ZYYdzDg12oKxLRLmcc+y5+jT2S IO5w== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:sender:date:from:to:cc:subject:message-id :references:mime-version:content-disposition:in-reply-to; bh=KC3FRcesCDrd2Ecx/HYckev66kcACPOwecmzlLh/jzA=; b=pQMPm6nwD1F2YBOX2OukohVKH2m6Erprerx3vo2AIT34oxweMxDPu2QJyfQmgcZpSb E8sTAWQbRPvllAyUD5PQc9z8N9o+sO7VNNQVNROafxQBoC7bqsI72jaL2dlTiEgkfyHc NH86QLwgmK5RJh+jF30AREmcGRM+e/48UAyAtSw72eBi6cvnl7SHyPRrWOSy6Gz9X8hl L5X7mEERVvGUP/LriFkp3vMEakqkrRTLn/PY36X0Xu/A/irNaC9AwHagDaXhPzHVRWfI ryePHNvAoM0tefAQEBxORIUTx7Crl7JCIX1gDIv6Vz3A3vFhsufVEgDjyncqn+V7zVcb vrEA== X-Gm-Message-State: AOAM5300o/UtS4bTYEt4gQA9Sy7OnwNELuoK0su/RhjQ0eILFvoM5XoX sN0rx6rGshYKNPkRHjjsVKsti39BijBmRw== X-Google-Smtp-Source: ABdhPJzzj3EJuuY7mkRVD6wnqdQw2w+kcRmzCPm8go1toZz07c86jEoDx7id+W6DIuOrHbBvc3zQXQ== X-Received: by 2002:a0c:ed2d:: with SMTP id u13mr886346qvq.27.1620154961357; Tue, 04 May 2021 12:02:41 -0700 (PDT) Received: from nuc ([142.126.164.150]) by smtp.gmail.com with ESMTPSA id z18sm6300035qki.55.2021.05.04.12.02.40 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Tue, 04 May 2021 12:02:40 -0700 (PDT) Sender: Mark Johnston Date: Tue, 4 May 2021 15:02:42 -0400 From: Mark Johnston To: Michael Schmiedgen Cc: freebsd-net@freebsd.org Subject: Re: page fault while in kernel mode - after upgrade from 12.2 to 13.0 Message-ID: References: MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: X-Rspamd-Queue-Id: 4FZTkB2bDVz3tYp X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=ptjFx+lK; dmarc=none; spf=pass (mx1.freebsd.org: domain of markjdb@gmail.com designates 2607:f8b0:4864:20::f36 as permitted sender) smtp.mailfrom=markjdb@gmail.com X-Spamd-Result: default: False [-1.20 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; RCVD_COUNT_THREE(0.00)[3]; DKIM_TRACE(0.00)[gmail.com:+]; RCPT_COUNT_TWO(0.00)[2]; FREEMAIL_TO(0.00)[gmx.net]; FORGED_SENDER(0.30)[markj@freebsd.org,markjdb@gmail.com]; MIME_TRACE(0.00)[0:+]; RBL_DBL_DONT_QUERY_IPS(0.00)[2607:f8b0:4864:20::f36:from]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; FROM_NEQ_ENVFROM(0.00)[markj@freebsd.org,markjdb@gmail.com]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; FROM_HAS_DN(0.00)[]; NEURAL_SPAM_SHORT(0.50)[0.502]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-net@freebsd.org]; DMARC_NA(0.00)[freebsd.org]; SPAMHAUS_ZRD(0.00)[2607:f8b0:4864:20::f36:from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; BLOCKLISTDE_FAIL(0.00)[142.126.164.150:query timed out,2607:f8b0:4864:20::f36:query timed out]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::f36:from]; MID_RHS_NOT_FQDN(0.50)[]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-net] X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 04 May 2021 19:02:47 -0000 On Tue, May 04, 2021 at 08:38:39PM +0200, Michael Schmiedgen wrote: > Hi Mark, > > sorry for the delay, I only can test after work. I triggered another 2 panics, this time > with a different result (see below). Can I provide some more information? This looks like fairly random kernel memory corruption. Are you able to build an INVARIANTS kernel and test that? Assuming you're using 13.0, you'd grab the 13.0 sources, add "options INVARIANT_SUPPORT" and "options INVARIANTS" to the GENERIC kernel configuration in sys/amd64/conf, and do a "make buildkernel installkernel". From owner-freebsd-net@freebsd.org Tue May 4 19:29:36 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id D2ACB5FF8A9 for ; Tue, 4 May 2021 19:29:36 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 4FZVKD5R0mz3wGp for ; Tue, 4 May 2021 19:29:36 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id BA6A65FFA1C; Tue, 4 May 2021 19:29:36 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id BA3135FF9AF for ; Tue, 4 May 2021 19:29:36 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4FZVKD4rSMz3wQC for ; Tue, 4 May 2021 19:29:36 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 99744171D5 for ; Tue, 4 May 2021 19:29:36 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 144JTapi033138 for ; Tue, 4 May 2021 19:29:36 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 144JTaQO033137 for net@FreeBSD.org; Tue, 4 May 2021 19:29:36 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 241954] netgraph fails on concurrent node rename Date: Tue, 04 May 2021 19:29:36 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 12.1-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: donner@FreeBSD.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: donner@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_status Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 04 May 2021 19:29:36 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D241954 Lutz Donnerhacke changed: What |Removed |Added ---------------------------------------------------------------------------- Status|Open |In Progress --- Comment #3 from Lutz Donnerhacke --- Please test this patch: https://reviews.freebsd.org/D30110 --=20 You are receiving this mail because: You are on the CC list for the bug.= From owner-freebsd-net@freebsd.org Tue May 4 23:00:46 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 8AC42626A53 for ; Tue, 4 May 2021 23:00:46 +0000 (UTC) (envelope-from evgeniy@khramtsov.org) Received: from mxa.khramtsov.org (mxa.khramtsov.org [IPv6:2a0a:e5c0:2:10f::f]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4FZb0s42XGz4byl for ; Tue, 4 May 2021 23:00:45 +0000 (UTC) (envelope-from evgeniy@khramtsov.org) Received: from mxa.khramtsov.org (mxa.khramtsov.org [IPv6:2a0a:e5c0:2:10f::f]) by mxa.khramtsov.org (Postfix) with ESMTP id B6C80125EC1 for ; Tue, 4 May 2021 22:59:36 +0000 (UTC) Date: Wed, 5 May 2021 02:00:29 +0300 From: Evgeniy Khramtsov To: freebsd-net@freebsd.org Subject: Hop limit override Message-ID: MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline X-Rspamd-Queue-Id: 4FZb0s42XGz4byl X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.80 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[khramtsov.org:s=rsa]; NEURAL_HAM_LONG(-1.00)[-1.000]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2a0a:e5c0:2:10f::f:c]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-net@freebsd.org]; TO_DN_NONE(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; SPAMHAUS_ZRD(0.00)[2a0a:e5c0:2:10f::f:from:127.0.2.255]; DKIM_TRACE(0.00)[khramtsov.org:+]; DMARC_POLICY_ALLOW(-0.50)[khramtsov.org,reject]; NEURAL_HAM_SHORT(-1.00)[-0.998]; RCVD_COUNT_ONE(0.00)[1]; RCVD_NO_TLS_LAST(0.10)[]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RBL_DBL_DONT_QUERY_IPS(0.00)[2a0a:e5c0:2:10f::f:from]; ASN(0.00)[asn:207996, ipnet:2a0a:e5c0:2::/48, country:CH]; MAILMAN_DEST(0.00)[freebsd-net]; ONCE_RECEIVED(0.10)[] X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 04 May 2021 23:00:46 -0000 Hi net, According to in6_selecthlim() in in6_src.c, hlim selection order is: 1. hlim specified via ioctl; 2. interface chlim via nd if outgoing interface; 3. V_ip6_defhlim. Let us suppose one needs to change the default non-ioctl hlim. The obvious way without reading in6_src.c would be to specify it via net.inet6.ip6.hlim. But then it would not work if there is curhlim: # ndp -i foo ... curhlim=255 ... Changing it via 'ndp -i foo curhlim=bar' seems to be temporary. I thought rtsold may refresh it back to the original value, though the value changes back to the original after rtsold was stopped. The first question: is nd behaviour a bug or works as intended? The second question: what would be the best way to override hlim? Currently I patched in6_selecthlim() to always return V_ip6_defhlim, though I am more interested to know a way that already works, or the way networking people would accept as a patch. If it matters, the described behaviour was observed on FreeBSD 14. -- (reachability warning: IPv6-only email address) From owner-freebsd-net@freebsd.org Wed May 5 09:08:54 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 4EFDA636D2F for ; Wed, 5 May 2021 09:08:54 +0000 (UTC) (envelope-from schmiedgen@gmx.net) Received: from mout.gmx.net (mout.gmx.net [212.227.15.19]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange ECDHE (P-256) server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "mout.gmx.net", Issuer "TeleSec ServerPass Class 2 CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4FZrVY1pC2z3MjB; Wed, 5 May 2021 09:08:52 +0000 (UTC) (envelope-from schmiedgen@gmx.net) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=gmx.net; s=badeba3b8450; t=1620205729; bh=tNBjKwIfVkZglsbFLO1l0Vrl6tEyX/iyisjOQW2K5VI=; h=X-UI-Sender-Class:Subject:To:Cc:References:From:Date:In-Reply-To; b=G9XICzuXonaSc25gHGXG5V/5e/SypIma+Lh3FmpB3P1kFJi+NaV90jVBXVeVUA5hu 5V+qDYUjSRqngfmoUiLL9lzOieO7sujvvOn94qU3hLHM4eYIUU/1AdlhJ8Tt/Qf3O5 AiQf6NwYbOvH1YaG+P2LFR1WIEUeAlnWxOIV6OWU= X-UI-Sender-Class: 01bb95c1-4bf8-414a-932a-4f6e2808ef9c Received: from [192.168.10.5] ([62.246.110.10]) by mail.gmx.net (mrgmx005 [212.227.17.190]) with ESMTPSA (Nemesis) id 1MPXhA-1lqojL0qV0-00Mbir; Wed, 05 May 2021 11:08:49 +0200 Subject: Re: page fault while in kernel mode - after upgrade from 12.2 to 13.0 To: Mark Johnston Cc: freebsd-net@freebsd.org References: From: Michael Schmiedgen Message-ID: <8016b487-4256-73d1-0e61-7e245956f718@gmx.net> Date: Wed, 5 May 2021 11:08:49 +0200 User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:78.0) Gecko/20100101 Thunderbird/78.10.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: quoted-printable X-Provags-ID: V03:K1:e9Wrxlo2nTjzEOWX+/OrqAHabJ/ZqElc7tXkYg3EQnLfuH5lt8T UMQHSuPBd5FNQwVfdmAFuTs8NaMoPzS6L1MO+zV2aUqI6Xq9NE+Elo0x9y09qh3qu4pBtKG DNxEZkmSNS+BqHtlgAbZ7hkoUUoHz5UvnsGINgVqqq0kMlF8g5fXBOnizn4YarinUsBgNqi XU7M42yg5UwmvhJxQ9b2w== X-Spam-Flag: NO X-UI-Out-Filterresults: notjunk:1;V03:K0:3/TWosn7UEw=:yI4gkjHtYv9C3gBOHxRyBO eX4y1whhYr3oFzYUoN62mhml4ukBueOWablKCHJ0gPxU+jIQLcZdi3W008NkauO9tvL542BqD v5fpvEqpq5K6SCoCX3GAoZyqRT5jTo1SD6NVzs1MGhWwPENMrWiNjkzGsgso98EVSvFLVfwSD OAoaLSlD0whUdqqtqL+FwhKys5LwDBF2OEDKHu05bL6EOg7WbuvsZ2JK5tdJIDDXukU0QgkG7 jeaXISek/9xW6UWlH8xYoZvjVy94jnmF+Aeuu0wEs7dDyLVWEbKYyaVir+OLzdO5XaNhmH+mB 6SbqeqdHwQeLPVCDa+eybHlXyUgJlELLoqVFfhESA819TqKAsF7uWREPXuf5Nd6OlFzqeI7/0 u6yrTSFpwd2EoYYbgqpjnh4efq4sXhDCa0cJylWGYnqGa5fbHKW76i6iLMecyY5t697EEibOO M7M47sPYW0MV26ghpdkvE7PCkU5RxcHWpJFPpdYVQs1NmyKXWJjitsD4rdntWVWvFpM6DJWA0 cTe8W052Iep5R0I/r6mIPvnGGj9bLkb3KH0f4RyxsVtUCOWDwFSn1q7BUSlAFkby3CkFdRWQw ALSu7h5rmWVdaaaPVbOm5BNPCOe25W9Jdovv+o+MDX55dOd9aVUereLNtlf3nYPvqfV6w4d3z baFgxMcU6023Lcb2wYATJx6+TyH70CrT59cAngQNJLoUxa9bwSjeHfKAaRwN+i3xInPRDfZmM gsa+zntGKUQf6nw3Wu2c3XWhVjebS17MxwF5qDry7ANgIaDpzs7tLNzJSI74Sq1m3OQk0p8oe NfvdQ3uECUKiNxTwwasX21obsfNwE7s6Ld7kcQCXYb/tGlHt/ZQJy7iAr8RpF0X3rjjbpXyFP TWBmogu4vNGr6wvnnMfwqhMqWnj+3NaulDHdsocAI3tN9tiEEm2hR/1A3sYaUQBifGDYMM9H8 +513DD5tDkU2q6p2RWwuyo7My6AY9eLVc5njppN1zdvD7NfTsUZVsatqM3miG9Cn4IMUeW71L CKCbjP9EHHknABA/hlj8Hq82hmgJz0xNPqvujm8YBHynJqpbEJ5L9Qad7IGZqYeopLWLBZn6I MZoviOFJWyeK8CVNcbkYqaVOHiUudSuk8suca+N7kx0Ck7HR7Ip0OASj0635/yAFqDnHm4RWZ OTy/ed0bwVztNjNbL1ZQ1jY2GChyPMzhf1CJbmy5G3k2rIdU5Zd707BycW46f1aoKURKU= X-Rspamd-Queue-Id: 4FZrVY1pC2z3MjB X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmx.net header.s=badeba3b8450 header.b=G9XICzuX; dmarc=pass (policy=none) header.from=gmx.net; spf=pass (mx1.freebsd.org: domain of schmiedgen@gmx.net designates 212.227.15.19 as permitted sender) smtp.mailfrom=schmiedgen@gmx.net X-Spamd-Result: default: False [-4.10 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_DN_SOME(0.00)[]; FREEMAIL_FROM(0.00)[gmx.net]; R_SPF_ALLOW(-0.20)[+ip4:212.227.15.0/25]; DKIM_TRACE(0.00)[gmx.net:+]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[gmx.net,none]; NEURAL_HAM_SHORT(-1.00)[-1.000]; RCVD_IN_DNSWL_LOW(-0.10)[212.227.15.19:from]; FROM_EQ_ENVFROM(0.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[212.227.15.19:from]; FREEMAIL_ENVFROM(0.00)[gmx.net]; MID_RHS_MATCH_FROM(0.00)[]; ASN(0.00)[asn:8560, ipnet:212.227.0.0/16, country:DE]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[gmx.net:s=badeba3b8450]; FROM_HAS_DN(0.00)[]; DWL_DNSWL_NONE(0.00)[gmx.net:dkim]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; MIME_TRACE(0.00)[0:+]; SPAMHAUS_ZRD(0.00)[212.227.15.19:from:127.0.2.255]; RWL_MAILSPIKE_POSSIBLE(0.00)[212.227.15.19:from]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-net] X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 05 May 2021 09:08:54 -0000 On 04.05.2021 21:02, Mark Johnston wrote: > On Tue, May 04, 2021 at 08:38:39PM +0200, Michael Schmiedgen wrote: >> Hi Mark, >> >> sorry for the delay, I only can test after work. I triggered another 2 = panics, this time >> with a different result (see below). Can I provide some more informatio= n? > > This looks like fairly random kernel memory corruption. Are you able to > build an INVARIANTS kernel and test that? Assuming you're using 13.0, > you'd grab the 13.0 sources, add "options INVARIANT_SUPPORT" and > "options INVARIANTS" to the GENERIC kernel configuration in > sys/amd64/conf, and do a "make buildkernel installkernel". I will try INVARIANTS after work, but in the meantime I got 2 more panics from tonight. =2D-- #1 Fatal trap 12: page fault while in kernel mode cpuid =3D 7; apic id =3D 07 fault virtual address =3D 0x8 fault code =3D supervisor read data, page not present instruction pointer =3D 0x20:0xffffffff80ca599c stack pointer =3D 0x28:0xfffffe0115bc46c0 frame pointer =3D 0x28:0xfffffe0115bc4700 code segment =3D base 0x0, limit 0xfffff, type 0x1b =3D DPL 0, pres 1, long 1, def32 0, gran 1 processor eflags =3D interrupt enabled, resume, IOPL =3D 0 current process =3D 12 (swi1: netisr 0) trap number =3D 12 panic: page fault cpuid =3D 7 time =3D 1620172732 KDB: stack backtrace: #0 0xffffffff80c57345 at kdb_backtrace+0x65 #1 0xffffffff80c09d21 at vpanic+0x181 #2 0xffffffff80c09b93 at panic+0x43 #3 0xffffffff8108b187 at trap_fatal+0x387 #4 0xffffffff8108b1df at trap_pfault+0x4f #5 0xffffffff8108a83d at trap+0x27d #6 0xffffffff810617a8 at calltrap+0x8 #7 0xffffffff80dbf0ae at tcp_do_segment+0x10ce #8 0xffffffff80dbd21e at tcp_input+0xabe #9 0xffffffff80dafc15 at ip_input+0x125 #10 0xffffffff80d3fa7b at swi_net+0x12b #11 0xffffffff80bcae5d at ithread_loop+0x24d #12 0xffffffff80bc7c5e at fork_exit+0x7e #13 0xffffffff8106282e at fork_trampoline+0xe Uptime: 5h36m39s Dumping 7281 out of 65454 MB:..1%..11%..21%..31%..41%..51%..61%..71%..81%.= .91% __curthread () at /usr/src/sys/amd64/include/pcpu_aux.h:55 55 __asm("movq %%gs:%P1,%0" : "=3Dr" (td) : "n" (offsetof(str= uct pcpu, (kgdb) #0 __curthread () at /usr/src/sys/amd64/include/pcpu_aux.h:55 #1 doadump (textdump=3D) at /usr/src/sys/kern/kern_shutdown.c:399 #2 0xffffffff80c09916 in kern_reboot (howto=3D260) at /usr/src/sys/kern/kern_shutdown.c:486 #3 0xffffffff80c09d90 in vpanic (fmt=3D, ap=3D) at /usr/src/sys/kern/kern_shutdown.c:919 #4 0xffffffff80c09b93 in panic (fmt=3D) at /usr/src/sys/kern/kern_shutdown.c:843 #5 0xffffffff8108b187 in trap_fatal (frame=3D0xfffffe0115bc4600, eva=3D8) at /usr/src/sys/amd64/amd64/trap.c:915 #6 0xffffffff8108b1df in trap_pfault (frame=3Dframe@entry=3D0xfffffe0115b= c4600, usermode=3Dfalse, signo=3D, signo@entry=3D0x0, ucode=3D, ucode@entry=3D0x0) at /usr/src/sys/amd64/amd64/trap.c:732 #7 0xffffffff8108a83d in trap (frame=3D0xfffffe0115bc4600) at /usr/src/sys/amd64/amd64/trap.c:398 #8 #9 sbcut_internal (sb=3D0xfffff8043bc00610, len=3D57, len@entry=3D304) at /usr/src/sys/kern/uipc_sockbuf.c:1491 #10 0xffffffff80ca5b8a in sbcut_locked (sb=3D0xfffff8043bc00610, len=3D-1796951296, len@entry=3D304) at /usr/src/sys/kern/uipc_sockbuf= .c:1591 #11 0xffffffff80dbf0ae in tcp_do_segment (m=3D0xfffff8024b9a6900, th=3D, so=3D, tp=3D, drop_hdrlen=3D52, tlen=3D, iptos=3D0 '\000') at /usr/src/sys/netinet/tcp_input.c:2918 #12 0xffffffff80dbd21e in tcp_input (mp=3D, offp=3D, proto=3D) at /usr/src/sys/netinet/tcp_input.c:1382 #13 0xffffffff80dafc15 in ip_input (m=3D0x0) at /usr/src/sys/netinet/ip_input.c:829 #14 0xffffffff80d3fa7b in netisr_process_workstream_proto ( nwsp=3D, proto=3D1) at /usr/src/sys/net/netisr.c:919 #15 swi_net (arg=3D) at /usr/src/sys/net/netisr.c:966 #16 0xffffffff80bcae5d in intr_event_execute_handlers (p=3D= , ie=3D0xfffff80003b88c00) at /usr/src/sys/kern/kern_intr.c:1168 #17 ithread_execute_handlers (p=3D, ie=3D0xfffff80003b88c00= ) at /usr/src/sys/kern/kern_intr.c:1181 #18 ithread_loop (arg=3Darg@entry=3D0xfffff80003b95d20) at /usr/src/sys/kern/kern_intr.c:1269 #19 0xffffffff80bc7c5e in fork_exit ( callout=3D0xffffffff80bcac10 , arg=3D0xfffff80003b95d20= , frame=3D0xfffffe0115bc4b00) at /usr/src/sys/kern/kern_fork.c:1069 =2D-- #2 Unread portion of the kernel message buffer: panic: sbappendaddr_locked cpuid =3D 2 time =3D 1620181490 KDB: stack backtrace: #0 0xffffffff80c57345 at kdb_backtrace+0x65 #1 0xffffffff80c09d21 at vpanic+0x181 #2 0xffffffff80c09b93 at panic+0x43 #3 0xffffffff80ca51e0 at sbappendaddr_locked_internal+0 #4 0xffffffff82c4efd0 at divert_packet+0x1a0 #5 0xffffffff82c2bc81 at ipfw_check_packet+0x2c1 #6 0xffffffff80d41f87 at pfil_run_hooks+0x97 #7 0xffffffff80dafeb5 at ip_input+0x3c5 #8 0xffffffff80d3f2da at netisr_dispatch_src+0xca #9 0xffffffff80d23a68 at ether_demux+0x148 #10 0xffffffff80d24dec at ether_nh_input+0x34c #11 0xffffffff80d3f2da at netisr_dispatch_src+0xca #12 0xffffffff80d23eb9 at ether_input+0x69 #13 0xffffffff80d2074a at if_input+0xa #14 0xffffffff8060a98e at bge_rxeof+0x49e #15 0xffffffff80607f27 at bge_intr_task+0x1a7 #16 0xffffffff80c6afe1 at taskqueue_run_locked+0x181 #17 0xffffffff80c6c2fc at taskqueue_thread_loop+0xac Uptime: 2h21m11s Dumping 8148 out of 65454 MB:..1%..11%..21%..31%..41%..51%..61%..71%..81%.= .91% __curthread () at /usr/src/sys/amd64/include/pcpu_aux.h:55 55 __asm("movq %%gs:%P1,%0" : "=3Dr" (td) : "n" (offsetof(str= uct pcpu, (kgdb) #0 __curthread () at /usr/src/sys/amd64/include/pcpu_aux.h:55 #1 doadump (textdump=3D) at /usr/src/sys/kern/kern_shutdown.c:399 #2 0xffffffff80c09916 in kern_reboot (howto=3D260) at /usr/src/sys/kern/kern_shutdown.c:486 #3 0xffffffff80c09d90 in vpanic (fmt=3D, ap=3D) at /usr/src/sys/kern/kern_shutdown.c:919 #4 0xffffffff80c09b93 in panic (fmt=3D) at /usr/src/sys/kern/kern_shutdown.c:843 #5 0xffffffff80ca51e0 in sbappendaddr_locked (sb=3D0xfffff8002829a8a8, asa=3D0xfffffe0115ebc5a0, m0=3D0xfffff804a977b700, control=3D0x0) at /usr/src/sys/kern/uipc_sockbuf.c:1198 #6 0xffffffff82c4efd0 in divert_packet (m=3D0xfffff804a977b700, incoming=3D) at /usr/src/sys/netinet/ip_divert.c:285 #7 0xffffffff82c2bc81 in ipfw_divert (m0=3D0xfffffe0115ebc760, args=3D0xfffffe0115ebc610, tee=3D) at /usr/src/sys/netpfil/ipfw/ip_fw_pfil.c:525 #8 ipfw_check_packet (m0=3D0xfffffe0115ebc760, ifp=3D0xfffff8000506f000, flags=3D65536, ruleset=3D, inp=3D0x0) at /usr/src/sys/netpfil/ipfw/ip_fw_pfil.c:283 #9 0xffffffff80d41f87 in pfil_run_hooks (head=3D, p=3D..., ifp=3Difp@entry=3D0xfffff8000506f000, flags=3Dflags@entry=3D65536, inp=3Dinp@entry=3D0x0) at /usr/src/sys/net/pfil.c:187 #10 0xffffffff80dafeb5 in ip_input (m=3D0x0) at /usr/src/sys/netinet/ip_input.c:610 #11 0xffffffff80d3f2da in netisr_dispatch_src (proto=3D1, source=3D, source@entry=3D0, m=3D) at /usr/src/sys/net/netisr.c:1143 #12 0xffffffff80d3f5cf in netisr_dispatch (proto=3D, m=3D) at /usr/src/sys/net/netisr.c:1234 #13 0xffffffff80d23a68 in ether_demux (ifp=3Difp@entry=3D0xfffff8000506f00= 0, m=3D) at /usr/src/sys/net/if_ethersubr.c:923 #14 0xffffffff80d24dec in ether_input_internal (ifp=3D0xfffff8000506f000, m=3D) at /usr/src/sys/net/if_ethersubr.c:709 #15 ether_nh_input (m=3D) at /usr/src/sys/net/if_ethersubr.= c:739 #16 0xffffffff80d3f2da in netisr_dispatch_src (proto=3Dproto@entry=3D5, source=3D, source@entry=3D0, m=3D, m@entry=3D0xfffff804a977b700) at /usr/src/sys/net/netisr.c:1143 #17 0xffffffff80d3f5cf in netisr_dispatch (proto=3D, proto@entry=3D5, m=3D, m@entry=3D0xfffff804a977b700) at /usr/src/sys/net/netisr.c:1234 #18 0xffffffff80d23eb9 in ether_input (ifp=3D, ifp@entry=3D, m=3D0xfffff804a977b700, m@entry=3D) at /usr/src/sys/net/if_ethersubr.c:830 #19 0xffffffff80d2074a in if_input (ifp=3D, ifp@entry=3D0xfffff8000506f000, sendmp=3D, sendmp@entry=3D0xfffff804a977b700) at /usr/src/sys/net/if.c:4391 #20 0xffffffff8060a98e in bge_rxeof (sc=3Dsc@entry=3D0xfffffe0115cd4000, rx_prod=3Drx_prod@entry=3D448, holdlck=3Dholdlck@entry=3D0) at /usr/src/sys/dev/bge/if_bge.c:4412 #21 0xffffffff80607f27 in bge_intr_task (arg=3D0xfffffe0115cd4000, pending=3D) at /usr/src/sys/dev/bge/if_bge.c:4642 #22 0xffffffff80c6afe1 in taskqueue_run_locked ( queue=3Dqueue@entry=3D0xfffff80005051d00) at /usr/src/sys/kern/subr_taskqueue.c:476 #23 0xffffffff80c6c2fc in taskqueue_thread_loop (arg=3D, arg@entry=3D0xfffffe0115cdb568) at /usr/src/sys/kern/subr_taskqueue.c= :793 #24 0xffffffff80bc7c5e in fork_exit ( callout=3D0xffffffff80c6c250 , arg=3D0xfffffe0115cdb568, frame=3D0xfffffe0115ebcb00) at /usr/src/sys/kern/kern_fork.c:1069 From owner-freebsd-net@freebsd.org Wed May 5 11:54:15 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 9573763BB60 for ; Wed, 5 May 2021 11:54:15 +0000 (UTC) (envelope-from evgeniy@khramtsov.org) Received: from mxa.khramtsov.org (mxa.khramtsov.org [IPv6:2a0a:e5c0:2:10f::f]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4FZw9L14Fwz3mWK for ; Wed, 5 May 2021 11:54:13 +0000 (UTC) (envelope-from evgeniy@khramtsov.org) Received: from mxa.khramtsov.org (mxa.khramtsov.org [IPv6:2a0a:e5c0:2:10f::f]) by mxa.khramtsov.org (Postfix) with ESMTP id 1FD2F125EC1 for ; Wed, 5 May 2021 11:53:02 +0000 (UTC) Date: Wed, 5 May 2021 14:53:53 +0300 From: Evgeniy Khramtsov To: freebsd-net@freebsd.org Subject: Re: Hop limit override Message-ID: References: MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: X-Rspamd-Queue-Id: 4FZw9L14Fwz3mWK X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.80 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[khramtsov.org:s=rsa]; NEURAL_HAM_LONG(-1.00)[-1.000]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2a0a:e5c0:2:10f::f]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-net@freebsd.org]; TO_DN_NONE(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; SPAMHAUS_ZRD(0.00)[2a0a:e5c0:2:10f::f:from:127.0.2.255]; DKIM_TRACE(0.00)[khramtsov.org:+]; DMARC_POLICY_ALLOW(-0.50)[khramtsov.org,reject]; NEURAL_HAM_SHORT(-1.00)[-1.000]; RCVD_COUNT_ONE(0.00)[1]; RCVD_NO_TLS_LAST(0.10)[]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RBL_DBL_DONT_QUERY_IPS(0.00)[2a0a:e5c0:2:10f::f:from]; ASN(0.00)[asn:207996, ipnet:2a0a:e5c0:2::/48, country:CH]; MAILMAN_DEST(0.00)[freebsd-net]; ONCE_RECEIVED(0.10)[] X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 05 May 2021 11:54:15 -0000 FWIW, one should also clear the accept_rtadv flag from if after stopping rtsold. After that curhlim is static. Is it the intended behaviour? -- (reachability warning: IPv6-only email address) From owner-freebsd-net@freebsd.org Wed May 5 12:56:50 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id D759863E11F for ; Wed, 5 May 2021 12:56:50 +0000 (UTC) (envelope-from Jason@zx2c4.com) Received: from mail.zx2c4.com (mail.zx2c4.com [104.131.123.232]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA512 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "mail.zx2c4.com", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4FZxYZ296hz3qql for ; Wed, 5 May 2021 12:56:50 +0000 (UTC) (envelope-from Jason@zx2c4.com) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=zx2c4.com; s=20210105; t=1620219407; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=BTHoQiH00RJ8mGSzvMen63yxTJhy1+NFftWzg/acOtI=; b=omfNszJvq/ka+Oq/ldB1gbe+XpR1J91x1pN9mORAFI7quMCT6XzZIrnB+apkarp330aXgE fEMH3W9P/X3+bX4GwKI+AT3aELKB4Ynil4GevJlmUXFVu2ctXjfeHAcdqYPKZCbbZ+wdbx i5TFKuPPjNLLB+DyNE7O+4ppSv07v2k= Received: by mail.zx2c4.com (ZX2C4 Mail Server) with ESMTPSA id 637b7ddb (TLSv1.3:AEAD-AES256-GCM-SHA384:256:NO) for ; Wed, 5 May 2021 12:56:47 +0000 (UTC) Received: by mail-yb1-f181.google.com with SMTP id v39so2516780ybd.4 for ; Wed, 05 May 2021 05:56:47 -0700 (PDT) X-Gm-Message-State: AOAM530M2cBi7umtamIXGlEsQ5QqXwqNTQKHnaMnRGiOPrVXa+aVbzfG 9oCsqI+vxKvC/4Ht4djAQXh39ywj2uAIl+q+LYc= X-Google-Smtp-Source: ABdhPJwHaDACtaPyCA0nr+dpv0U0wTY1mtrw5/hRZfV9SPUOzG2nk+ovEQws7Lzrx9vHv+fnWQjFJM4OcOZmDVhfyXg= X-Received: by 2002:a25:3416:: with SMTP id b22mr9907708yba.49.1620219406701; Wed, 05 May 2021 05:56:46 -0700 (PDT) MIME-Version: 1.0 References: <20210423053902.16087-1-Jason@zx2c4.com> In-Reply-To: <20210423053902.16087-1-Jason@zx2c4.com> From: "Jason A. Donenfeld" Date: Wed, 5 May 2021 14:56:35 +0200 X-Gmail-Original-Message-ID: Message-ID: Subject: Re: [PATCH 0/2] two small additions in advance of if_wg To: freebsd-net@freebsd.org Content-Type: text/plain; charset="UTF-8" X-Rspamd-Queue-Id: 4FZxYZ296hz3qql X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=zx2c4.com header.s=20210105 header.b=omfNszJv; dmarc=pass (policy=none) header.from=zx2c4.com; spf=pass (mx1.freebsd.org: domain of Jason@zx2c4.com designates 104.131.123.232 as permitted sender) smtp.mailfrom=Jason@zx2c4.com X-Spamd-Result: default: False [-4.70 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[zx2c4.com:s=20210105]; FREEFALL_USER(0.00)[Jason]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; R_SPF_ALLOW(-0.20)[+a:mail.zx2c4.com]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-net@freebsd.org]; TO_DN_NONE(0.00)[]; RCVD_DKIM_ARC_DNSWL_MED(-0.50)[]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_LONG(-1.00)[-1.000]; RCVD_COUNT_THREE(0.00)[3]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; RCVD_IN_DNSWL_MED(-0.20)[104.131.123.232:from]; DKIM_TRACE(0.00)[zx2c4.com:+]; DMARC_POLICY_ALLOW(-0.50)[zx2c4.com,none]; NEURAL_HAM_SHORT(-1.00)[-1.000]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:14061, ipnet:104.131.64.0/18, country:US]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-net] X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 05 May 2021 12:56:50 -0000 I wound up posting the 1/2 patch to phabricator here: https://reviews.freebsd.org/D30087 Could somebody review and commit this? Thanks, Jason From owner-freebsd-net@freebsd.org Wed May 5 16:35:35 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 7174B5FC0DF for ; Wed, 5 May 2021 16:35:35 +0000 (UTC) (envelope-from schmiedgen@gmx.net) Received: from mout.gmx.net (mout.gmx.net [212.227.15.15]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange ECDHE (P-256) server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "mout.gmx.net", Issuer "TeleSec ServerPass Class 2 CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Fb2Py2WS4z4WCq; Wed, 5 May 2021 16:35:33 +0000 (UTC) (envelope-from schmiedgen@gmx.net) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=gmx.net; s=badeba3b8450; t=1620232532; bh=lDrfy6GglOQsHP486JeueRwdQufgI3QSpmqw6XaaTsc=; h=X-UI-Sender-Class:Subject:To:Cc:References:From:Date:In-Reply-To; b=Vwf845fN2YzFjD/3wEh800qMK+9TDhQgESnIgAahDDlmxl//pgJV0cJdBGpWNWuxE 8un7Ghpcpl+9VlvdLT44/Bp47CdqiQevS8MZbs4y8098lxoJjsA9KA0v4MgMq5Q4/O gK6/+gkzpdXOuiOI30gaHtXuk11AsQs4AZke7YSA= X-UI-Sender-Class: 01bb95c1-4bf8-414a-932a-4f6e2808ef9c Received: from [192.168.10.5] ([62.246.110.10]) by mail.gmx.net (mrgmx004 [212.227.17.190]) with ESMTPSA (Nemesis) id 1N4QsO-1lVunS0dok-011SFJ; Wed, 05 May 2021 18:35:32 +0200 Subject: Re: page fault while in kernel mode - after upgrade from 12.2 to 13.0 To: Mark Johnston Cc: freebsd-net@freebsd.org References: From: Michael Schmiedgen Message-ID: <51a3abc5-76b9-df09-acbe-895b62ec87b3@gmx.net> Date: Wed, 5 May 2021 18:35:32 +0200 User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:78.0) Gecko/20100101 Thunderbird/78.10.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: quoted-printable X-Provags-ID: V03:K1:osiUl7OJ2fm8PzqnM2nhlvlplpHJwipSEl+JH1Ov5om0vHV0Zt4 F5DDb7tLEyi7hE50Iz4NYQyWosWp/nIFrUg6+TVYUPPkcpJmkT0VIt3ajQ1/gvi3iMhaxCx WLVdoZII3xg1FYTOS/KF21Z4HDfPTMiuAVUYmTcwrGOlygKSN/qcSkZX6F6eMLDXN7yckDU dBJcfDvFJKVe38c47XsTw== X-Spam-Flag: NO X-UI-Out-Filterresults: notjunk:1;V03:K0:VxMxmDpONcA=:u8IQMYkfrynCsg3/NZwd2Z M6kAnuMX1rEbwUtq8fv9OCfpE8nTo1tGSig3z0yAWzINFzsOp33S8/nxnfhxPZ6PV7PKIZz7g jM7oZ1WcfOJ6vQtDVZvD/x+wLD7AUl7m8MBytSRXdkCwCSgRXfTM08k0tg0R2Xwz87b2NpX7j UFP4UY8iBKkNf7s7/sdUXBarcLXABpvlM0bNrZ6lAk0ucEPHw39t9WW54uybsn90dAUbgDqk2 ocVBcbi0NqHMZkKvC60mQBMtsXXcLnce8XFuvqZd3qaX5OyoQztEJqAR1AZGhwN8qToJpWb/K CnQtCm4l7/aiz6B/6xiUwLquORevZqQAAn3F/Z3xsg73ZanYTEXYMSzlz2JC7H+2CxysXCfVh Zf/L7WCQXPudzc6G46hTAv/j2YDoqio3NAqVF3/HziSdLZip1WYg7ehKmDU+m1CtrHB9JtSeG Q4mcfGUkeCZsPEKcBXi6j4/nqC7meth3kN2hw1A9rcsIvS6+z1yYH90EuYeTTaIpE9wsG6a2H Z/XHckzptQ8uWY4yCoriyStR9MMDl8/xYgB5ga/6zf1YbtSp89x+pW3eHV1IqR/BvvkIquKgn c3PT19zM6YmzrJELyFBZz3Uxb1d9nDbGkKnwGKq/NAopuK1b0iJwiFnYLXfjLeE+o1jorY35P Iz7dPFkC+eBsbxu+fHVchNG1suwfd3VCxCdVwWuFuV5qJqbFYQPZoM6hd2frA8vGnl+cZ57ad 6Vcgbj/Dx3H1fjLqnUjQiGyZNbZ0WZpZBR4KFn1ilDajghUo4V3AqOUA1AQ3BlvtZNU3yB6qK jTpgPcHxxFeQyMiYEUo3C19SwBNkprLaphZoA2KG8XunuJA9Pi0vXBmiEXzJCAAn3NFZhF7TF +RbpRyg8fRWpYj9a4ZfoVaEFMtVjjhwV231vIjD82YAIFpvs2PHq4qeSw67ZTO2bpRfgSnCof MKcmpIo03ileGrhXZdg1hTNh8uYAtXdXsAWlN4x1v+AbGo9P/03CUTLpMqWN3O6PxO9ukw2Y5 WipcXxqWUuKH+CgPcsq7VTU3Ujh0OgDWHWj/Ps1s/KKsJvemZbcKw8O2JNjJ31TmJXAL7kCkA XS+ea0W1prdS3Ubyc14A8rVMx+UUlzrVGrSnMRo23axdkrYXZ0eoIIzp9Jw5yhY+jsh4QlHiY 4zvpBWKnklwzwCGL2HM8UcUm/oiN+qLrbVeCKJKjQ/U3ZQDfUPSwEWn8uKVheEdyFanXk= X-Rspamd-Queue-Id: 4Fb2Py2WS4z4WCq X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmx.net header.s=badeba3b8450 header.b=Vwf845fN; dmarc=pass (policy=none) header.from=gmx.net; spf=pass (mx1.freebsd.org: domain of schmiedgen@gmx.net designates 212.227.15.15 as permitted sender) smtp.mailfrom=schmiedgen@gmx.net X-Spamd-Result: default: False [-3.88 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_DN_SOME(0.00)[]; FREEMAIL_FROM(0.00)[gmx.net]; R_SPF_ALLOW(-0.20)[+ip4:212.227.15.0/25]; DKIM_TRACE(0.00)[gmx.net:+]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[gmx.net,none]; NEURAL_HAM_SHORT(-0.88)[-0.875]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RBL_DBL_DONT_QUERY_IPS(0.00)[212.227.15.15:from]; FREEMAIL_ENVFROM(0.00)[gmx.net]; MID_RHS_MATCH_FROM(0.00)[]; ASN(0.00)[asn:8560, ipnet:212.227.0.0/16, country:DE]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[gmx.net:s=badeba3b8450]; FROM_HAS_DN(0.00)[]; DWL_DNSWL_NONE(0.00)[gmx.net:dkim]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; SPAMHAUS_ZRD(0.00)[212.227.15.15:from:127.0.2.255]; RCVD_IN_DNSWL_NONE(0.00)[212.227.15.15:from]; RWL_MAILSPIKE_POSSIBLE(0.00)[212.227.15.15:from]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-net] X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 05 May 2021 16:35:35 -0000 On 04.05.2021 21:02, Mark Johnston wrote: > This looks like fairly random kernel memory corruption. Are you able to > build an INVARIANTS kernel and test that? Assuming you're using 13.0, > you'd grab the 13.0 sources, add "options INVARIANT_SUPPORT" and > "options INVARIANTS" to the GENERIC kernel configuration in > sys/amd64/conf, and do a "make buildkernel installkernel". Below some info with an INVARIANTS kernel. Please let me know if I can pro= vide further information. Thank you! =2D-- kgdb backtrace (kgdb) backtrace #0 __curthread () at /usr/src/sys/amd64/include/pcpu_aux.h:55 #1 doadump (textdump=3D) at /usr/src/sys/kern/kern_shutdow= n.c:399 #2 0xffffffff80bf580b in kern_reboot (howto=3D260) at /usr/src/sys/kern/k= ern_shutdown.c:486 #3 0xffffffff80bf5c50 in vpanic (fmt=3D, ap=3D) at /usr/src/sys/kern/kern_shutdown.c:919 #4 0xffffffff80bf59b3 in panic (fmt=3D) at /usr/src/sys/kern= /kern_shutdown.c:843 #5 0xffffffff80f1ae71 in uma_dbg_free (zone=3D0xfffffe006e3e3c00, slab=3D= 0xfffff8053b159fd8, item=3D0xfffff8053b159300) at /usr/src/sys/vm/uma_core= .c:5437 #6 0xffffffff80f13a64 in item_dtor (zone=3D0xfffffe006e3e3c00, item=3D0xf= ffff8053b159300, size=3D256, udata=3D0x0, skip=3DSKIP_NONE) at /usr/src/sys/vm/uma_core.c:3220 #7 uma_zfree_arg (zone=3D0xfffffe006e3e3c00, item=3Ditem@entry=3D0xfffff8= 053b159300, udata=3Dudata@entry=3D0x0) at /usr/src/sys/vm/uma_core.c:4165 #8 0xffffffff80bcefcf in mb_free_ext (m=3Dm@entry=3D0xfffff8053b159300) a= t /usr/src/sys/kern/kern_mbuf.c:1200 #9 0xffffffff80bcda68 in m_free (m=3Dm@entry=3D0xfffff8053b159300) at /us= r/src/sys/sys/mbuf.h:1441 #10 0xffffffff80bceda8 in m_freem (mb=3Dmb@entry=3D0xfffff8053b159300) at = /usr/src/sys/kern/kern_mbuf.c:1525 #11 0xffffffff82c4d79a in div_output (so=3D, m=3D0xfffff805= 3b159300, sin=3D, control=3D) at /usr/src/sys/netinet/ip_divert.c:396 #12 div_send (so=3D, so@entry=3D, flags=3D, flags@entry=3D, m=3D0xfffff8053b159300, m@entry=3D, nam=3D, nam@entry=3D, control= =3D, control@entry=3D, td=3D, td@entry=3D) at /usr/src/sys/netinet/ip_divert.c:659 #13 0xffffffff80c92f97 in sosend_generic (so=3D0xfffff800468d5760, so@entr= y=3D, addr=3D0xfffff800120= c72e0, addr@entry=3D, uio=3D, uio@entry=3D, top=3D0xfffff8053b159300, top@entry=3D, control= =3D, control@entry=3D, flags=3D0, flags@entry=3D, td=3D0xfffffe019cdc2300, td@entry=3D) at /usr/src/sys/kern/uipc_socket.c:1755 #14 0xffffffff80c93286 in sosend (so=3D, so@entry=3D0xfffff80= 0468d5760, addr=3D, uio=3D, uio@entry=3D0xfffffe= 0199b338a8, top=3D, top@entry=3D0x0, control=3Dcontrol@entry=3D0x0, flags= =3D, flags@entry=3D0, td=3D0xfffffe019cdc2300) at /usr/src/sys/kern/uipc_socket.c:1810 #15 0xffffffff80c99ffc in kern_sendit (td=3D, td@entry=3D0x= fffffe019cdc2300, s=3D3, mp=3D, mp@entry=3D0xfffffe0199b339= 80, flags=3D0, control=3D0x0, segflg=3Dsegflg@entry=3DUIO_USERSPACE) at /usr/src/sys/kern= /uipc_syscalls.c:798 #16 0xffffffff80c9a39b in sendit (td=3D0xfffffe019cdc2300, td@entry=3D, s=3D, mp=3Dmp@entry=3D0xfffffe0199b33980, flags=3D= ) at /usr/src/sys/kern/uipc_syscalls.c:723 #17 0xffffffff80c9a1ad in sys_sendto (td=3D, td@entry=3D, uap=3D, uap@entr= y=3D) at /usr/src/sys/kern/uipc_sysca= lls.c:841 #18 0xffffffff8108824e in syscallenter (td=3D) at /usr/src/= sys/amd64/amd64/../../kern/subr_syscall.c:189 #19 amd64_syscall (td=3D0xfffffe019cdc2300, traced=3D0) at /usr/src/sys/am= d64/amd64/trap.c:1156 #20 =2D-- core.txt panic: Duplicate free of 0xfffff8053b159300 from zone 0xfffffe006e3e3c00(m= buf_packet) slab 0xfffff8053b159fd8(3) Unread portion of the kernel message buffer: <110>ipfw: 4500 Deny UDP 192.168.10.100:137 192.168.10.255:137 out via bge= 0 panic: Duplicate free of 0xfffff8053b159300 from zone 0xfffffe006e3e3c00(m= buf_packet) slab 0xfffff8053b159fd8(3) cpuid =3D 6 time =3D 1620231385 KDB: stack backtrace: #0 0xffffffff80c400e5 at kdb_backtrace+0x65 #1 0xffffffff80bf5be1 at vpanic+0x181 #2 0xffffffff80bf59b3 at panic+0x43 #3 0xffffffff80f1ae71 at uma_dbg_free+0x1e1 #4 0xffffffff80f13a64 at uma_zfree_arg+0x144 #5 0xffffffff80bcefcf at mb_free_ext+0x11f #6 0xffffffff80bcda68 at m_free+0xd8 #7 0xffffffff80bceda8 at m_freem+0x28 #8 0xffffffff82c4d79a at div_send+0x43a #9 0xffffffff80c92f97 at sosend_generic+0x5f7 #10 0xffffffff80c93286 at sosend+0x66 #11 0xffffffff80c99ffc at kern_sendit+0x1ec #12 0xffffffff80c9a39b at sendit+0x1db #13 0xffffffff80c9a1ad at sys_sendto+0x4d #14 0xffffffff8108824e at amd64_syscall+0x12e #15 0xffffffff8105bf4e at fast_syscall_common+0xf8 Uptime: 5m17s Dumping 2609 out of 65454 MB:..1%..11%..21%..31%..41%..51%..61%..71%..81%.= .91% __curthread () at /usr/src/sys/amd64/include/pcpu_aux.h:55 55 __asm("movq %%gs:%P1,%0" : "=3Dr" (td) : "n" (offsetof(str= uct pcpu, (kgdb) #0 __curthread () at /usr/src/sys/amd64/include/pcpu_aux.h:55 #1 doadump (textdump=3D) at /usr/src/sys/kern/kern_shutdown.c:399 #2 0xffffffff80bf580b in kern_reboot (howto=3D260) at /usr/src/sys/kern/kern_shutdown.c:486 #3 0xffffffff80bf5c50 in vpanic (fmt=3D, ap=3D) at /usr/src/sys/kern/kern_shutdown.c:919 #4 0xffffffff80bf59b3 in panic (fmt=3D) at /usr/src/sys/kern/kern_shutdown.c:843 #5 0xffffffff80f1ae71 in uma_dbg_free (zone=3D0xfffffe006e3e3c00, slab=3D0xfffff8053b159fd8, item=3D0xfffff8053b159300) at /usr/src/sys/vm/uma_core.c:5437 #6 0xffffffff80f13a64 in item_dtor (zone=3D0xfffffe006e3e3c00, item=3D0xfffff8053b159300, size=3D256, udata=3D0x0, skip=3DSKIP_NONE) at /usr/src/sys/vm/uma_core.c:3220 #7 uma_zfree_arg (zone=3D0xfffffe006e3e3c00, item=3Ditem@entry=3D0xfffff8053b159300, udata=3Dudata@entry=3D0x0) at /usr/src/sys/vm/uma_core.c:4165 #8 0xffffffff80bcefcf in mb_free_ext (m=3Dm@entry=3D0xfffff8053b159300) at /usr/src/sys/kern/kern_mbuf.c:1200 #9 0xffffffff80bcda68 in m_free (m=3Dm@entry=3D0xfffff8053b159300) at /usr/src/sys/sys/mbuf.h:1441 #10 0xffffffff80bceda8 in m_freem (mb=3Dmb@entry=3D0xfffff8053b159300) at /usr/src/sys/kern/kern_mbuf.c:1525 #11 0xffffffff82c4d79a in div_output (so=3D, m=3D0xfffff8053b159300, sin=3D, control=3D) at /usr/src/sys/netinet/ip_divert.c:396 #12 div_send (so=3D, so@entry=3D, flags=3D, flags@entry=3D, m=3D0xfffff8053b159300, m@entry=3D, nam=3D, nam@entry=3D, control=3D, control@entry=3D, td=3D, td@entry=3D) at /usr/src/sys/netinet/ip_divert.c:659 #13 0xffffffff80c92f97 in sosend_generic (so=3D0xfffff800468d5760, so@entry=3D, addr=3D0xfffff800120c72e0, addr@entry=3D, uio=3D, uio@entry=3D, top=3D0xfffff8053b159300, top@entry=3D, control=3D, control@entry=3D, fla= gs=3D0, flags@entry=3D, td=3D0xfffffe019cdc2300, td@entry=3D) at /usr/src/sys/kern/uipc_socket.c:1755 #14 0xffffffff80c93286 in sosend (so=3D, so@entry=3D0xfffff800468d5760, addr=3D, uio=3D, uio@entry=3D0xfffffe0199b338a8, top=3D, top@entry=3D0x0, control=3Dcontrol@entry=3D0x0, flags=3D, flags@entry=3D0= , td=3D0xfffffe019cdc2300) at /usr/src/sys/kern/uipc_socket.c:1810 #15 0xffffffff80c99ffc in kern_sendit (td=3D, td@entry=3D0xfffffe019cdc2300, s=3D3, mp=3D, mp@entry=3D0xfffffe0199b33980, flags=3D0, control=3D0x0, segflg=3Dsegflg@entry=3DUIO_USERSPACE) at /usr/src/sys/kern/uipc_syscalls.c:798 #16 0xffffffff80c9a39b in sendit (td=3D0xfffffe019cdc2300, td@entry=3D, s=3D, mp=3Dmp@entry=3D0xfffffe= 0199b33980, flags=3D) at /usr/src/sys/kern/uipc_syscalls.c:723 #17 0xffffffff80c9a1ad in sys_sendto (td=3D, td@entry=3D, uap=3D, uap@entry=3D) at /usr/src/sys/kern/uipc_syscalls.c:841 #18 0xffffffff8108824e in syscallenter (td=3D) at /usr/src/sys/amd64/amd64/../../kern/subr_syscall.c:189 #19 amd64_syscall (td=3D0xfffffe019cdc2300, traced=3D0) at /usr/src/sys/amd64/amd64/trap.c:1156 #20 From owner-freebsd-net@freebsd.org Wed May 5 16:51:32 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id A70745FCAB4 for ; Wed, 5 May 2021 16:51:32 +0000 (UTC) (envelope-from schmiedgen@gmx.net) Received: from mout.gmx.net (mout.gmx.net [212.227.15.15]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange ECDHE (P-256) server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "mout.gmx.net", Issuer "TeleSec ServerPass Class 2 CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Fb2mM5Rkyz4WvK; Wed, 5 May 2021 16:51:31 +0000 (UTC) (envelope-from schmiedgen@gmx.net) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=gmx.net; s=badeba3b8450; t=1620233490; bh=Hp8MTU49Dap9hzUFb96bWNkRhU1FvlzPTx8mgxrjb3s=; h=X-UI-Sender-Class:Subject:To:References:Cc:From:Date:In-Reply-To; b=IMPieI5s3hjCPx+X/PxKzgLiD67S/u/JdHqvwxMpf1mWMNnTbSfOsYULP8CthKj1b v0i4jiZ+cV1ETQ/i/ERwWQPHSI7MLVAIl5SvIzGIjzkw+/t7X5EwHjbQZuMO7mQaSn NU0K1csqmO6JjoaKrNyuLtxo8tjnTYFcuAZDPxrE= X-UI-Sender-Class: 01bb95c1-4bf8-414a-932a-4f6e2808ef9c Received: from [192.168.10.5] ([62.246.110.10]) by mail.gmx.net (mrgmx005 [212.227.17.190]) with ESMTPSA (Nemesis) id 1N17Ye-1lX0Tg1jsg-012U9K; Wed, 05 May 2021 18:51:30 +0200 Subject: Re: page fault while in kernel mode - after upgrade from 12.2 to 13.0 To: Mark Johnston References: <51a3abc5-76b9-df09-acbe-895b62ec87b3@gmx.net> Cc: freebsd-net@freebsd.org From: Michael Schmiedgen Message-ID: <197967f8-9675-4342-7961-8c902a57f58d@gmx.net> Date: Wed, 5 May 2021 18:51:30 +0200 User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:78.0) Gecko/20100101 Thunderbird/78.10.0 MIME-Version: 1.0 In-Reply-To: <51a3abc5-76b9-df09-acbe-895b62ec87b3@gmx.net> Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: quoted-printable X-Provags-ID: V03:K1:2jGsdH6CCLxh52ls2yPPlEnBgTVQWt1Io5UO8obohwWq1hswmQi 0FVjGBCOUCgnTBOQrirbkw+dS7sKJkjnEnPRuilQN/Ff1vU77M7yd0m8lIc+PsRSMVScCnM 9pCZ8xCoMzPZZCS4czW4z4YrEckOiQMavAQ46Puhxww7BRgix2EvaCGZmHA5W7H8JL9qis1 ZI8/DrE0fGTc/xYSOzJXg== X-Spam-Flag: NO X-UI-Out-Filterresults: notjunk:1;V03:K0:4/zoTK8Qqa0=:/Gs3kJFXxUYN32eqv+DpEV AXbibvq3DfXbDMat8XBB3/qbEeWZHhT7Apnn31ghf04/jW/vTIHI08bvVcRFDUQZvdOWMWmKq 3NWv0faJJpqs+UjE5o7Q4Yuq9HgxBIHHkP4Fm2QpUM2l8NcQIHYKJJNehN5td1wZDaNzyk0YI AzEq3gqEtv6ccB+RcWkyu7uFeUEeSvYkJZHAK5G0SOm9Q4NDyurxobV6fq2nTSIHEzHh9Ryg6 Drohlf5RDpJhv6NRWMXYLDYfHWCfCFn9C49q7Fdt2CJ7TGAJyJDaeQ7niuz/jNUm32UFPS1Zv Fs+4yNMzFl7z3Rk6gGQb/ckaU17s9UyKvikLDAtZU7+v2qzeRsCLYhPEpt1q3ngHANpk2spYr V7g8rZi7rndy/0gFYG+vm3r+qhnXwxvkZHQLKPWXYfqj9HMl9vvvQWbHsxcYavbedrZY7M+HK 57a127N3LYTe7BhD4a/4Sz17VyhgsTXEYu4VW7ukolQQNr4lciHARZ3Z1ADRiut9UMmBiZMTi pqLOes7u/gKHt28+enVk2nv07c5wAje+vRS4Ls0IIzRikLMZj2m4WZ7bPhwctR5rld3Zu/CKh a+gzyDA4uNgnby3Lk9evNAKI0DoLsnY/VPTNtI487cGHDS8iRBcJqSXDzF3AQsus2KQat/4jj CZAKSUtefgJ/ElxUS8zs+odbRIckLfsvTTzUZ2MtNzMNIebBF10guwMrEqPDR73nP36DHBuc2 ega1HB9VLlM5nxr4eYrXljFD3Ow2LzkhN91hr7kTazUYaWt8CQUH2zguUjYDnqwLe/CdLI2Nv wsT44YTksOZwpGXVoshSB5jJteUKPY9OnbfJ30MiSv9QlnVsdXgGUrF8NgkUrP2dzU79Sn8RG Ry5Sx5KfZtYSKVY+rhkUdlw7FwTi/lV/8vyTfTklety4CmLdT0ePW20mVSC2kQaBhGhpmmVAE tJ+3fmbGhodmZB+j1p3KQ6dAgTjuK7xZ84ZoxJsvoTkXMI/9KbyYt6wg5yedEMtL6ow+wuHvT yGe4MdxNb2zR/dxwyLrWU1iQS8/fPx1bXRVNBcgf04cEO6B/w7f4YZZHsEFk/Hy9LlmbcwQc4 2xlUgn44jM1YlvEV335xjr6IqoFalW9EeUJGtjiJGHRMXIpM0vH6Lf+khWK1wIeuAo24ZYRzx JWIYbDc2WhfFqtqzIFdNcI15SKbfnOvLDipSwM6aCzgUqCI3OHMx5deTRcJZRRGXBvZAI= X-Rspamd-Queue-Id: 4Fb2mM5Rkyz4WvK X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmx.net header.s=badeba3b8450 header.b=IMPieI5s; dmarc=pass (policy=none) header.from=gmx.net; spf=pass (mx1.freebsd.org: domain of schmiedgen@gmx.net designates 212.227.15.15 as permitted sender) smtp.mailfrom=schmiedgen@gmx.net X-Spamd-Result: default: False [-4.00 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_DN_SOME(0.00)[]; FREEMAIL_FROM(0.00)[gmx.net]; R_SPF_ALLOW(-0.20)[+ip4:212.227.15.0/25]; DKIM_TRACE(0.00)[gmx.net:+]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[gmx.net,none]; NEURAL_HAM_SHORT(-1.00)[-1.000]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RBL_DBL_DONT_QUERY_IPS(0.00)[212.227.15.15:from]; FREEMAIL_ENVFROM(0.00)[gmx.net]; MID_RHS_MATCH_FROM(0.00)[]; ASN(0.00)[asn:8560, ipnet:212.227.0.0/16, country:DE]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[gmx.net:s=badeba3b8450]; FROM_HAS_DN(0.00)[]; DWL_DNSWL_NONE(0.00)[gmx.net:dkim]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; SPAMHAUS_ZRD(0.00)[212.227.15.15:from:127.0.2.255]; RCVD_IN_DNSWL_NONE(0.00)[212.227.15.15:from]; RWL_MAILSPIKE_POSSIBLE(0.00)[212.227.15.15:from]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-net] X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 05 May 2021 16:51:32 -0000 On 05.05.2021 18:35, Michael Schmiedgen wrote: > On 04.05.2021 21:02, Mark Johnston wrote: >> This looks like fairly random kernel memory corruption.=C2=A0 Are you a= ble to >> build an INVARIANTS kernel and test that?=C2=A0 Assuming you're using 1= 3.0, >> you'd grab the 13.0 sources, add "options INVARIANT_SUPPORT" and >> "options INVARIANTS" to the GENERIC kernel configuration in >> sys/amd64/conf, and do a "make buildkernel installkernel". > > Below some info with an INVARIANTS kernel. Please let me know if I can p= rovide > further information. Thank you! > > > --- kgdb backtrace > > > (kgdb) backtrace > #0=C2=A0 __curthread () at /usr/src/sys/amd64/include/pcpu_aux.h:55 > #1=C2=A0 doadump (textdump=3D) at /usr/src/sys/kern/kern_= shutdown.c:399 [...] FYI, I just triggered another panic with INVARIANTS and the backtrace look= s like the one before. Michael From owner-freebsd-net@freebsd.org Wed May 5 18:38:24 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id EB4095FF0D9 for ; Wed, 5 May 2021 18:38:24 +0000 (UTC) (envelope-from markjdb@gmail.com) Received: from mail-qt1-x835.google.com (mail-qt1-x835.google.com [IPv6:2607:f8b0:4864:20::835]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Fb57g6H2Kz4clB for ; Wed, 5 May 2021 18:38:23 +0000 (UTC) (envelope-from markjdb@gmail.com) Received: by mail-qt1-x835.google.com with SMTP id o1so2019497qta.1 for ; Wed, 05 May 2021 11:38:23 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=sender:date:from:to:cc:subject:message-id:references:mime-version :content-disposition:in-reply-to; bh=lgwvK1otAsUlCLON7os8nAga9qMH/KHJKn15KEcskwQ=; b=Wfvx5Xt916yoR7LpMVUjE7zRTfpEmv6U3BlLmlZlAhbVXEIRc8XSS4tjz36I2YpbhD UhLC3/huPk5nwCfL6nI26KHIGdc0KX+jpMFheBt2H0cp7UAfp0AjsN2DamjK1r8rpa0k TR1mGoAIMvg8BdcpF7gGHaiQXYfXg4p1plqYBIibz1sRAzhtJX7+BslqTl5YDZa6jFXx cMG4mLhCH2VczNAjs76b+0LGyEL+KKqWvhnjzWdAujt5QzOR9iapWfYKDAaJH+wEsONw i3KLypIZqh4Us715UtnvUw4j1Qnh91l/4UAeU3baa20Qkl1V+1XsU0Eiy33HWAGj3wr8 sGag== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:sender:date:from:to:cc:subject:message-id :references:mime-version:content-disposition:in-reply-to; bh=lgwvK1otAsUlCLON7os8nAga9qMH/KHJKn15KEcskwQ=; b=IwQ0djJSKwkMIGQLR2TZwxznXVQynZMOUB33zO9k/zLzE55YlC27u+EqFfhrM9zBkD VfHNvXmNRco/7wzSIdFAPhQBjmX1HPRXJxoQo0PkiCNgol51Gi1HOEch44+/YcFPtsVX pZh6ZZnidPGebik7IFjx1fBCpKvXiYGP3RFRV9d95lsPc9rS5nc54yN1FSTldwhhm8ZZ DdQL+ftBVsQXONudEu5rmymjLfQwQV8JcHoRT1oWRQtPZgy7+pcnpr2T8dzivSxCQtux 65rk9f8PminT3i3N9xjM1IFIj6IAtFYJtEHrKzFO9oXVmAbnnI4rLFSliryk9CKC/Uqi 2K2Q== X-Gm-Message-State: AOAM5320jzTeHQtGpKPlsK4ginBtae9bO5OZ3XOmgigL6Wy/qtYNEXJx 4Auprtu4N7rnJaNyskS8seU= X-Google-Smtp-Source: ABdhPJx+2P8wM5Dumf5zZ6pszlGUrrBcVX4uot/H7+J7UAWqicI8CtzhsG/T97dVXocbsdNB62i+Pw== X-Received: by 2002:ac8:5b8f:: with SMTP id a15mr29531121qta.21.1620239902684; Wed, 05 May 2021 11:38:22 -0700 (PDT) Received: from nuc ([142.126.164.150]) by smtp.gmail.com with ESMTPSA id 7sm52527qtu.38.2021.05.05.11.38.21 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 05 May 2021 11:38:22 -0700 (PDT) Sender: Mark Johnston Date: Wed, 5 May 2021 14:38:23 -0400 From: Mark Johnston To: Michael Schmiedgen Cc: freebsd-net@freebsd.org Subject: Re: page fault while in kernel mode - after upgrade from 12.2 to 13.0 Message-ID: References: <51a3abc5-76b9-df09-acbe-895b62ec87b3@gmx.net> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <51a3abc5-76b9-df09-acbe-895b62ec87b3@gmx.net> X-Rspamd-Queue-Id: 4Fb57g6H2Kz4clB X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=Wfvx5Xt9; dmarc=none; spf=pass (mx1.freebsd.org: domain of markjdb@gmail.com designates 2607:f8b0:4864:20::835 as permitted sender) smtp.mailfrom=markjdb@gmail.com X-Spamd-Result: default: False [-2.70 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; RCVD_COUNT_THREE(0.00)[3]; DKIM_TRACE(0.00)[gmail.com:+]; RCPT_COUNT_TWO(0.00)[2]; NEURAL_HAM_SHORT(-1.00)[-1.000]; FREEMAIL_TO(0.00)[gmx.net]; FORGED_SENDER(0.30)[markj@freebsd.org,markjdb@gmail.com]; MIME_TRACE(0.00)[0:+]; RBL_DBL_DONT_QUERY_IPS(0.00)[2607:f8b0:4864:20::835:from]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; FROM_NEQ_ENVFROM(0.00)[markj@freebsd.org,markjdb@gmail.com]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; FROM_HAS_DN(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-net@freebsd.org]; DMARC_NA(0.00)[freebsd.org]; SPAMHAUS_ZRD(0.00)[2607:f8b0:4864:20::835:from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::835:from]; MID_RHS_NOT_FQDN(0.50)[]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-net] X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 05 May 2021 18:38:25 -0000 On Wed, May 05, 2021 at 06:35:32PM +0200, Michael Schmiedgen wrote: > On 04.05.2021 21:02, Mark Johnston wrote: > > This looks like fairly random kernel memory corruption. Are you able to > > build an INVARIANTS kernel and test that? Assuming you're using 13.0, > > you'd grab the 13.0 sources, add "options INVARIANT_SUPPORT" and > > "options INVARIANTS" to the GENERIC kernel configuration in > > sys/amd64/conf, and do a "make buildkernel installkernel". > > Below some info with an INVARIANTS kernel. Please let me know if I can provide > further information. Thank you! Thanks, this helped a lot. I believe https://reviews.freebsd.org/D30129 will fix the problem. That patch is against the main branch but applies cleanly to 13.0. From owner-freebsd-net@freebsd.org Thu May 6 13:00:14 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 1690D62106B for ; Thu, 6 May 2021 13:00:14 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 4FbYb173mrz4fR4 for ; Thu, 6 May 2021 13:00:13 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id F26A062105F; Thu, 6 May 2021 13:00:13 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id F2347621014 for ; Thu, 6 May 2021 13:00:13 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4FbYb16Slwz4fYV for ; Thu, 6 May 2021 13:00:13 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id D0C35187F4 for ; Thu, 6 May 2021 13:00:13 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 146D0Dq8025733 for ; Thu, 6 May 2021 13:00:13 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 146D0DVF025732 for net@FreeBSD.org; Thu, 6 May 2021 13:00:13 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 255507] traceroute6 generates wrong UDP checksum Date: Thu, 06 May 2021 13:00:13 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: 13.0-STABLE X-Bugzilla-Keywords: regression X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: commit-hook@FreeBSD.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: net@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 06 May 2021 13:00:14 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D255507 --- Comment #3 from commit-hook@FreeBSD.org --- A commit in branch stable/13 references this bug: URL: https://cgit.FreeBSD.org/src/commit/?id=3De183dd501caf03751c96c7c0683ccc3a6= c0cd27d commit e183dd501caf03751c96c7c0683ccc3a6c0cd27d Author: Zhenlei Huang AuthorDate: 2021-05-03 16:46:19 +0000 Commit: Mark Johnston CommitDate: 2021-05-06 12:59:19 +0000 traceroute6: Properly calculate UDP checksum The revision D25604 capsicumize traceroute6. For UDP the send socket was changed from SOCK_DGRAM to SOCK_RAW and thus the UDP checksum need be calculated by application itself other than the kernel. outpacket is filled with zeros by line 707, thus the first round the UDP checksum is correct. But subsequent rounds outudp->uh_sum will be left with garbage. PR: 255507 Reviewed by: ae, markj, tuexen Differential Revision: https://reviews.freebsd.org/D30042 (cherry picked from commit 1d712c05370dca8cbf81d1ecd9acd606fdcacaf4) usr.sbin/traceroute6/traceroute6.c | 1 + 1 file changed, 1 insertion(+) --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-net@freebsd.org Thu May 6 14:01:44 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 9EFEB622F81 for ; Thu, 6 May 2021 14:01:44 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 4FbZy03vfQz4jCH for ; Thu, 6 May 2021 14:01:44 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 8319C6228EF; Thu, 6 May 2021 14:01:44 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 82DFA622C59 for ; Thu, 6 May 2021 14:01:44 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4FbZy03B6gz4jHp for ; Thu, 6 May 2021 14:01:44 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 51AA519752 for ; Thu, 6 May 2021 14:01:44 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 146E1ioa056297 for ; Thu, 6 May 2021 14:01:44 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 146E1ibW056296 for net@FreeBSD.org; Thu, 6 May 2021 14:01:44 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 241191] route flush panic with RADIX_MPATH Date: Thu, 06 May 2021 14:01:44 +0000 X-Bugzilla-Reason: CC AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 12.0-STABLE X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: michael.adm@gmail.com X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: net@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? maintainer-feedback? mfc-stable12? mfc-stable11? X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 06 May 2021 14:01:44 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D241191 Michael changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |michael.adm@gmail.com --- Comment #7 from Michael --- FreeBSD 14.0-CURRENT (GENERIC) All parameters are default. In /boot/loader.conf -> if_wg_load=3D"YES" In /etc/rc.conf -> wireguard_interfaces=3D"wg0 wg1 wg2 wg3" In wg0.conf ... wg3.conf (almost everything is identical) : [Interface] Address =3D 10.127.0.9/30 PrivateKey =3D xxxx...xxxx=3D ListenPort =3D 46010 Table =3D off [Peer] PublicKey =3D yyyy...yyyy=3D AllowedIPs =3D 10.18.0.0/22, 10.127.0.8/30, 172.16.42.0/24 Endpoint =3D A.B.C.D:46010 PersistentKeepalive =3D 25 #> ifconfig wg0: flags=3D80c1 metric 0 mtu 1420 options=3D80000 inet 10.127.0.9 netmask 0xfffffffc groups: wg nd6 options=3D109 wg1: flags=3D80c1 metric 0 mtu 1420 options=3D80000 inet 10.127.0.13 netmask 0xfffffffc groups: wg nd6 options=3D109 wg2: flags=3D80c1 metric 0 mtu 1420 options=3D80000 inet 10.127.0.17 netmask 0xfffffffc groups: wg nd6 options=3D109 wg3: flags=3D80c1 metric 0 mtu 1420 options=3D80000 inet 10.127.0.21 netmask 0xfffffffc groups: wg nd6 options=3D109 #> netstat -rn4 Routing tables Internet: Destination Gateway Flags Netif Expire default E.F.G.H UGS hn1 10.127.0.8/30 link#7 U wg0 10.127.0.9 link#7 UHS lo0 10.127.0.12/30 link#8 U wg1 10.127.0.13 link#8 UHS lo0 10.127.0.16/30 link#9 U wg2 10.127.0.17 link#9 UHS lo0 10.127.0.20/30 link#10 U wg3 10.127.0.21 link#10 UHS lo0 51.83.179.112 link#5 UH hn1 51.83.236.254 link#5 UHS hn1 127.0.0.1 link#1 UH lo0 172.16.42.0/24 link#4 U hn0 172.16.42.2 link#4 UHS lo0 Let's try to delete a non-existing route: #> route delete 10.18.0.0/22 10.127.0.10 route: route has not been found delete net 10.18.0.0: gateway 10.127.0.10 fib 0: not in table At this stage, everything is ok. Adding routes: route add 10.18.0.0/22 10.127.0.10 route add 10.18.0.0/22 10.127.0.14 route add 10.18.0.0/22 10.127.0.18 route add 10.18.0.0/22 10.127.0.22 #> netstat -rn4 Routing tables Internet: Destination Gateway Flags Netif Expire default E.F.G.H UGS hn1 10.18.0.0/22 10.127.0.14 UGS wg1 10.18.0.0/22 10.127.0.10 UGS wg0 10.18.0.0/22 10.127.0.22 UGS wg3 10.18.0.0/22 10.127.0.18 UGS wg2 10.127.0.8/30 link#7 U wg0 10.127.0.9 link#7 UHS lo0 10.127.0.12/30 link#8 U wg1 10.127.0.13 link#8 UHS lo0 10.127.0.16/30 link#9 U wg2 10.127.0.17 link#9 UHS lo0 10.127.0.20/30 link#10 U wg3 10.127.0.21 link#10 UHS lo0 51.83.179.112 link#5 UH hn1 51.83.236.254 link#5 UHS hn1 127.0.0.1 link#1 UH lo0 172.16.42.0/24 link#4 U hn0 172.16.42.2 link#4 UHS lo0 In /var/log/messages -> the message appears: kernel: FIB: enabled flowid calculation for locally-originated packets Let's try to delete a existing one route: #> route delete 10.18.0.0/22 10.127.0.10 delete net 10.18.0.0: gateway 10.127.0.10 fib 0 Let's try to delete a non-existing route (let's say we made a mistake in the figure): #> route delete 10.18.0.0/22 10.127.0.50 kernel: Fatal trap 12: page fault while in kernel mode kernel: cpuid =3D 1; apic id =3D 01 kernel: fault virtual address =3D 0x18 kernel: fault code =3D supervisor read data, page not present kernel: instruction pointer =3D 0x20:0xffffffff80d779f4 kernel: stack pointer =3D 0x28:0xfffffe00b54f14f0 kernel: frame pointer =3D 0x28:0xfffffe00b54f14f0 kernel: code segment =3D base 0x0, limit 0xfffff, type 0x1b kernel: =3D DPL 0, pres 1, long 1, def32 0, gran 1 kernel: processor eflags =3D interrupt enabled, resume, IOPL =3D 0 kernel: current process =3D 1648 (route) kernel: trap number =3D 12 kernel: panic: page fault kernel: cpuid =3D 1 kernel: time =3D 1620308885 kernel: KDB: stack backtrace: kernel: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00b54f11a0 kernel: vpanic() at vpanic+0x181/frame 0xfffffe00b54f11f0 kernel: panic() at panic+0x43/frame 0xfffffe00b54f1250 kernel: trap_fatal() at trap_fatal+0x387/frame 0xfffffe00b54f12b0 kernel: trap_pfault() at trap_pfault+0x4f/frame 0xfffffe00b54f1310 kernel: trap() at trap+0x27d/frame 0xfffffe00b54f1420 kernel: calltrap() at calltrap+0x8/frame 0xfffffe00b54f1420 kernel: --- trap 0xc, rip =3D 0xffffffff80d779f4, rsp =3D 0xfffffe00b54f14f= 0, rbp =3D 0xfffffe00b54f14f0 --- kernel: rt_get_inet_prefix_pmask() at rt_get_inet_prefix_pmask+0x4/frame 0xfffffe00b54f14f0 kernel: route_output() at route_output+0x17da/frame 0xfffffe00b54f17d0 kernel: sosend_generic() at sosend_generic+0x633/frame 0xfffffe00b54f1890 kernel: sosend() at sosend+0x50/frame 0xfffffe00b54f18c0 kernel: soo_write() at soo_write+0x49/frame 0xfffffe00b54f1900 kernel: dofilewrite() at dofilewrite+0x88/frame 0xfffffe00b54f1950 kernel: sys_write() at sys_write+0xbc/frame 0xfffffe00b54f19c0 kernel: amd64_syscall() at amd64_syscall+0x10c/frame 0xfffffe00b54f1af0 kernel: fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00b54f1af0 kernel: --- syscall (4, FreeBSD ELF64, sys_write), rip =3D 0x8011ad8ea, rsp= =3D 0x7fffffffe918, rbp =3D 0x7fffffffe9d0 --- kernel: KDB: enter: panic --=20 You are receiving this mail because: You are on the CC list for the bug. You are the assignee for the bug.= From owner-freebsd-net@freebsd.org Thu May 6 14:07:44 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 41235622DFD for ; Thu, 6 May 2021 14:07:44 +0000 (UTC) (envelope-from ozkan.kirik@gmail.com) Received: from mail-vs1-xe2b.google.com (mail-vs1-xe2b.google.com [IPv6:2607:f8b0:4864:20::e2b]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Fbb4v3ZFJz4jXc; Thu, 6 May 2021 14:07:43 +0000 (UTC) (envelope-from ozkan.kirik@gmail.com) Received: by mail-vs1-xe2b.google.com with SMTP id h18so2951968vsp.8; Thu, 06 May 2021 07:07:43 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=/aXhl6NO/ivNXF0NXI10VKc+a+6SdRWxZ7L11tzh1m8=; b=cyPyD2FwcGycagRdIOYJfEx2RkqiuazvFEdkJg+3R/ax6Qs732tfTL3c0Z/Cugb1X3 eqbqPFZ2r4Plpw1Tk4WEjVXtadOLx3DIQy9M6xOxpBLP+btwGWE6rPrDAhPaMN9to6vE +5x5KMPLM9Y5tFkEuTXarduAfphgHIjLF1Oi/H8/n+h9x2tuNL/TUubcC53dG6Sn/ZW+ D1kuvwbi4VXFoFxhBWWsWxnd57+CN1fSh+sIvC+m3IF4bCuoVnU3vwTMO4yFkSwXrshj 0BTEJ9a4+MwtfnzBo2ZNGH30BfXsKlq8nwRlvqXDBrpd0k/0wK7skwrmNR7ZjcLf42oL k2ww== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=/aXhl6NO/ivNXF0NXI10VKc+a+6SdRWxZ7L11tzh1m8=; b=fnYqLnuLf4Gefwh6olxnEIWqKqhcUiCqXwUjex75GzVetJeVjMMJI/pXg29Lcqile9 ayJR4d+B7yCEc4H4o6agPAu5D7wjIctbxsyCM6Al3Qrz1MyC/EYA8rxl2qaIxiIu4BfI X1kqN/n/pkbqV1wNNDQTUGsEk+1zxf+79Vw1U8EpCaE0xNCtOMqQ9CnQ9uWyjbUc4avR 3T80/rEmnhqz/+pAXxGRPsv/YxrAqq9skWSsP3RXIMuFolfB/2K5ou9EPfnojWNkW8CW 3D79sYs3P5FpKJ4fFhUvBvBQmunftDZhoOGXoz2YMDJ7pNKn6R9Xz4SqpxbntAoohidH w4Cw== X-Gm-Message-State: AOAM530oP3I0SPrOZai//WztVOMrBdOatEMPNatyUm6qCIF6cc0nIkAR g2O4JgBEk6E6rrBMcTR4nDyfPhXfp3fzDiUO1yTyuH6s7No= X-Google-Smtp-Source: ABdhPJzlq5CdRWBvSU3ccNBpbdgzJHhcUu3M87EavUYjJL392Eu+1D/eLqfwkgPZQrdKTk0h/JV8vWOOFHs0IqesSiI= X-Received: by 2002:a67:c406:: with SMTP id c6mr3313166vsk.33.1620310061595; Thu, 06 May 2021 07:07:41 -0700 (PDT) MIME-Version: 1.0 References: <50cfc0e6-5cc6-7004-2566-bc06428d4394@yandex.ru> In-Reply-To: From: =?UTF-8?B?w5Z6a2FuIEtJUklL?= Date: Thu, 6 May 2021 17:07:30 +0300 Message-ID: Subject: Re: IPsec performace - netisr hits %100 To: Mark Johnston Cc: "Andrey V. Elsukov" , FreeBSD Net X-Rspamd-Queue-Id: 4Fbb4v3ZFJz4jXc X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=cyPyD2Fw; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of ozkankirik@gmail.com designates 2607:f8b0:4864:20::e2b as permitted sender) smtp.mailfrom=ozkankirik@gmail.com X-Spamd-Result: default: False [-3.36 / 15.00]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36:c]; FREEMAIL_FROM(0.00)[gmail.com]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; NEURAL_HAM_SHORT(-1.00)[-1.000]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; R_MIXED_CHARSET(0.62)[subject]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; TAGGED_FROM(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; ARC_NA(0.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[2607:f8b0:4864:20::e2b:from]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; NEURAL_HAM_MEDIUM(-0.98)[-0.984]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; SPAMHAUS_ZRD(0.00)[2607:f8b0:4864:20::e2b:from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::e2b:from]; FREEMAIL_CC(0.00)[yandex.ru,freebsd.org]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-net]; RCVD_COUNT_TWO(0.00)[2] Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.34 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 06 May 2021 14:07:44 -0000 I wonder that if you received the flame graphs ? I also tested system with multiple if_ipsec interfaces using different source-dst tunnel address. By this way, system can utilize all cpu cores. But for single if_ipsec interface, is there a way to speed up transfer ? Thanks! On Mon, May 3, 2021 at 10:31 PM Mark Johnston wrote: > On Sun, May 02, 2021 at 04:08:18PM +0300, Andrey V. Elsukov wrote: > > 30.04.2021 23:32, Mark Johnston =D0=BF=D0=B8=D1=88=D0=B5=D1=82: > > > Second, netipsec unconditionally hands rx processing off to netisr > > > threads for some reason, that's why changing the dispatch policy > doesn't > > > help. Maybe it's to help avoid running out of kernel stack space or = to > > > somehow avoid packet reordering in some case that is not clear to me. > I > > > tried a patch (see below) which eliminates this and it helped somewha= t. > > > If anyone can provide an explanation for the current behaviour I'd > > > appreciate it. > > > > Previously we have reports about kernel stack overflow during IPsec > > processing. In your example there is only one IPsec transform is > > configured, but it is possible to configure several in the bundle, > > AFAIR, it is limited to 4 transforms. E.g. if you configure ESP+AH - it > > is bundle of two transforms and this will grow kernel stack requirement= s. > > Is it only a problem for synchronous crypto ops? With hardware drivers > I'd expect the stack usage to be reset after each transform, since > completions are handled by a dedicated thread. There is also the > net.inet.ipsec.async_crypto knob, which has a similar effect I think. > From owner-freebsd-net@freebsd.org Thu May 6 15:56:45 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id DB62F626088 for ; Thu, 6 May 2021 15:56:45 +0000 (UTC) (envelope-from markjdb@gmail.com) Received: from mail-qk1-x72b.google.com (mail-qk1-x72b.google.com [IPv6:2607:f8b0:4864:20::72b]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4FbdVh5P04z4pJ3 for ; Thu, 6 May 2021 15:56:44 +0000 (UTC) (envelope-from markjdb@gmail.com) Received: by mail-qk1-x72b.google.com with SMTP id o5so5421767qkb.0 for ; Thu, 06 May 2021 08:56:44 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=sender:date:from:to:cc:subject:message-id:references:mime-version :content-disposition:content-transfer-encoding:in-reply-to; bh=QYOcwzdH98M4PTxiAzC682Jdcmaq9eAFbJIEIdr/FE4=; b=P7YKvwPKNtVLyXNUyBdhmSnBnmcgsp+4HR9YMf4jtoQq22cr8+3psRRBTFYHhuMEi9 Ydpupw5q8lQKTpMu262M4nxKWH6cIanGykMVjh5NgPbeNJ+rqz+s0JoqA1o6VkcqhFDX YFPRTft5XGV3kGX7Pp38tMmvZlVWXzuYPRA2sPZ42jOENoOWLsMJtBmBWz6LkB76gr7Z X9X3NPT831t3Ka6bna1N0UTeN+GEdG8wgAZnPyfEPKqgJv8tufoo8QZGhduSyF4ax22b Szu3voP6q8pahACyWoZc0nv3EIdqxu1eNXZgEl5sFUO1cNjspod6ieEPf+JHUQtGIdGA kiIg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:sender:date:from:to:cc:subject:message-id :references:mime-version:content-disposition :content-transfer-encoding:in-reply-to; bh=QYOcwzdH98M4PTxiAzC682Jdcmaq9eAFbJIEIdr/FE4=; b=b7VYQpXhi2VXdlAP8wVWQZzdn5RxdgopNef3ySelOJM2UVTNBndtN9/Ngge1LpIcyd R37ZuHa94nzZnceIzxNbrumaNYJBiRZd/R+bX2STEGap7MmlB1/m+AFkl5ESfR+gFW+/ /0wnr7FX8lrKKZ8N/p0UmFGnGgn+kvVoQy54q1fJzanU24ljjV88udUTq9y/cXdjoCET HPuI+QL2ZO9N17aO4qcoi9wpvWnW06GehAzIqeIAepeStvdjjq6kt08Gq28PsrfdtTPt /WR5+In24OBzAJYXW68o2nqXMgmAjkmYLh2AkqP3d58t26hMisBqnJ/ynhc1KajYAuIF ZU/Q== X-Gm-Message-State: AOAM533mQhfCY2Ez/471HLqerbhNeW27PJZCUNnBy1rIyeD6wiOdizI8 w9xtiZchPI1HpBTdH8oF7vU= X-Google-Smtp-Source: ABdhPJx5+sfmxIO6AZRRKcuU7RJBoov/F+Drd6xuEDJtg1Rg1g5dG5JQiWaWjpIsfXWu4axLrGrSKA== X-Received: by 2002:a37:42d3:: with SMTP id p202mr4599012qka.456.1620316603430; Thu, 06 May 2021 08:56:43 -0700 (PDT) Received: from nuc ([142.126.164.150]) by smtp.gmail.com with ESMTPSA id p187sm2422804qkd.92.2021.05.06.08.56.42 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Thu, 06 May 2021 08:56:43 -0700 (PDT) Sender: Mark Johnston Date: Thu, 6 May 2021 11:56:44 -0400 From: Mark Johnston To: =?iso-8859-1?Q?=D6zkan?= KIRIK Cc: "Andrey V. Elsukov" , FreeBSD Net Subject: Re: IPsec performace - netisr hits %100 Message-ID: References: <50cfc0e6-5cc6-7004-2566-bc06428d4394@yandex.ru> MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: X-Rspamd-Queue-Id: 4FbdVh5P04z4pJ3 X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=P7YKvwPK; dmarc=none; spf=pass (mx1.freebsd.org: domain of markjdb@gmail.com designates 2607:f8b0:4864:20::72b as permitted sender) smtp.mailfrom=markjdb@gmail.com X-Spamd-Result: default: False [-2.48 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; RCVD_COUNT_THREE(0.00)[3]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; NEURAL_HAM_SHORT(-0.78)[-0.777]; FREEMAIL_TO(0.00)[gmail.com]; FORGED_SENDER(0.30)[markj@freebsd.org,markjdb@gmail.com]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; FROM_NEQ_ENVFROM(0.00)[markj@freebsd.org,markjdb@gmail.com]; RBL_DBL_DONT_QUERY_IPS(0.00)[2607:f8b0:4864:20::72b:from]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; NEURAL_HAM_LONG(-1.00)[-1.000]; TAGGED_RCPT(0.00)[]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-net@freebsd.org]; DMARC_NA(0.00)[freebsd.org]; SPAMHAUS_ZRD(0.00)[2607:f8b0:4864:20::72b:from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::72b:from]; MID_RHS_NOT_FQDN(0.50)[]; FREEMAIL_CC(0.00)[yandex.ru,freebsd.org]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-net] X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 06 May 2021 15:56:45 -0000 On Thu, May 06, 2021 at 05:07:30PM +0300, Özkan KIRIK wrote: > I wonder that if you received the flame graphs ? Yes, there's nothing obviously problematic there. > I also tested system with multiple if_ipsec interfaces using different > source-dst tunnel address. > By this way, system can utilize all cpu cores. > But for single if_ipsec interface, is there a way to speed up transfer ? Did you see Andrey's comment regarding the MTU on the ipsec interface? From owner-freebsd-net@freebsd.org Thu May 6 15:57:51 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id ACFDD625FAF for ; Thu, 6 May 2021 15:57:51 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 4FbdWz4L6Rz4pJc for ; Thu, 6 May 2021 15:57:51 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 94C22625FAE; Thu, 6 May 2021 15:57:51 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 94893626130 for ; Thu, 6 May 2021 15:57:51 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4FbdWz3lTQz4p7H for ; Thu, 6 May 2021 15:57:51 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 707411AE6C for ; Thu, 6 May 2021 15:57:51 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 146FvpQJ015526 for ; Thu, 6 May 2021 15:57:51 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 146FvpmV015525 for net@FreeBSD.org; Thu, 6 May 2021 15:57:51 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 255507] traceroute6 generates wrong UDP checksum Date: Thu, 06 May 2021 15:57:51 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: 13.0-STABLE X-Bugzilla-Keywords: regression X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: markj@FreeBSD.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: FIXED X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: net@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_status resolution Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 06 May 2021 15:57:51 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D255507 Mark Johnston changed: What |Removed |Added ---------------------------------------------------------------------------- Status|In Progress |Closed Resolution|--- |FIXED --- Comment #4 from Mark Johnston --- Thanks for the report and patch. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-net@freebsd.org Thu May 6 16:00:10 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 037666260EF for ; Thu, 6 May 2021 16:00:10 +0000 (UTC) (envelope-from schmiedgen@gmx.net) Received: from mout.gmx.net (mout.gmx.net [212.227.17.21]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange ECDHE (P-256) server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "mout.gmx.net", Issuer "TeleSec ServerPass Class 2 CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4FbdZd0W9Yz4pRs; Thu, 6 May 2021 16:00:08 +0000 (UTC) (envelope-from schmiedgen@gmx.net) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=gmx.net; s=badeba3b8450; t=1620316805; bh=KzHmDkXWbH0RvRTsQiIvaDC9EW6LrkLVKr7uKUK1RUk=; h=X-UI-Sender-Class:Subject:To:Cc:References:From:Date:In-Reply-To; b=A8qz1Lw0wUaoGkBqPLr/Fwz13uXivQcSxJ0iu30kbf2plCCBX8C6u2rM+ngC3eHIu EkWPJye9hx78reKf3h7jNin1oapV43s6G7bp/6YbbVGYWRPh30il1t0d4C/rkdrOFs o61/YwkFm9AjISWUOpkXyF5ZDYv/CLY2LyqA13xg= X-UI-Sender-Class: 01bb95c1-4bf8-414a-932a-4f6e2808ef9c Received: from [192.168.10.5] ([62.246.110.10]) by mail.gmx.net (mrgmx105 [212.227.17.168]) with ESMTPSA (Nemesis) id 1MgesG-1l2Jnl2Vwa-00h8MY; Thu, 06 May 2021 18:00:05 +0200 Subject: Re: page fault while in kernel mode - after upgrade from 12.2 to 13.0 To: Mark Johnston Cc: freebsd-net@freebsd.org References: <51a3abc5-76b9-df09-acbe-895b62ec87b3@gmx.net> From: Michael Schmiedgen Message-ID: <90ed0277-9fcc-28c0-a546-c6a80babfa34@gmx.net> Date: Thu, 6 May 2021 18:00:05 +0200 User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:78.0) Gecko/20100101 Thunderbird/78.10.1 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: quoted-printable X-Provags-ID: V03:K1:6E763lALLIynMFa5yccipIc+D0bXJFc176Kz4GQ+WJt9SY3j2hX Dl6HBjkZDEDbqa/je+vf1sMVnEkLSFJ6Xv/t03ZRN/W4IKlMjwRTO4wJGFKcY9No5CjpyOc MFrLgIVUNs+5wIPiBFTZxvZI3H/aqZBIuDeoyrXrNQ7+u/ADFb6xW9RR6+Cut0eB2WfeEvA BkcyxMjZ838cTM0+Xl4wg== X-Spam-Flag: NO X-UI-Out-Filterresults: notjunk:1;V03:K0:bno521EeS9I=:0U6ywMTQtz3rEOmt4u+bF/ oL8ZTIZckp+vvvBd4ehPUpk/gH7/VhoYe1Pyo9s5teF1S8zVxEDC3OCo3tnq7/pLg7aLdvage vfadrvYBiHH8d6usT5JkQFFoRWKrDkPWwQ8fiiRrEJ+UXyfyzvDxlMMKNH+Z+jtJKtD0ThaCu HJVxWPKLiEldDxk79SqBLTOHEYkjvTgU/t48KeZUcOBau0mA1cQHP/E0mR7h64HXsF5sGi2Rm oM0cHaPJ/hT8bB+Pw4VrDFzfU2sGySH1AvzCQtlcT4eou/kDbhm30TGrZvE5fZRN1hqu/q9cJ gV9lGgzd1mhfTaRP6eTt6QD9rVECATrtgaOyGjC09o3DRMgMA8Hu+vNEdDZFOGPIAqa429KgC luVh8Jnn8SjLnuV+aztZxLcFNlEqexjntQY/XXFwexMjaN+VATWIl1kgHhPzHHZsf9QV4+c0N 83YAR4WvDQd2o4mJc7mkl62MhuudvbRRrx6h99fAoqiO87EcczaxahzsWoGH1S++PipMeaKQM vc6uaiXJPLi3ibUr4W4LXDJYFhd7wi5i4KVXVD6R2pbM5xy1+u6akZ8y64fXmaWJE6CoUOLN7 rqE4CiBjoHHd10OSw0tFzMSoOryknWx4QoW/euNUJTzGNA1RC8EnYUtYhFr9Sa2LuICkpTOIs uNURoEupem/mTC5NaW8LaOzwICKxSBSruIYOAq6posPv4a07+F3cteY0oQ08hJWcuCZ+gONe5 5ySm4xQXJLVs/eIIs1Vl+L5fQforbFFRkC2ecY8Hr4q6smbTCB8IOUl8+Odo+xBkwKHkrgFfv sHfgsNtHTM3Equj3D4g1voSOnbw2I3sYd7v1i9jlFJaWAF31bZUBuvdxqJe4JQRH4JGRO1psS 39hcIJtuza0OsLKFVu1socRkCZQ4XYDnoOqlnOzU7XITuvDaL+UwuD4UjYMVi61VFhAz1CFA5 OoW4Lq9jNMC4wLHP6H9qgcB/e/7Qd7dTSBVohZyQCt+NG7EE4AJVO00OneiYIZ5Ug2UJXyYCp nTwh+x1GvU6xQHjKPnS3zGkDNWrNG7IT0r6WDRfQe7Z3Kc2VDaZZ/dzzNmCvaE86/FfM6QO9Q qfGvfdiVUhDG50IN1J9tmhdolc/HRsn1pdCW9diol5yXzlSZnj/Y5PBzMgRYxOXSgBgPolvef b0tPahIOT0cW5rRZRMxtO1U38IVOUhw8hn3hl+dhW5hDXhwzImGYqG9a6ngq4+JiKF1j4= X-Rspamd-Queue-Id: 4FbdZd0W9Yz4pRs X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmx.net header.s=badeba3b8450 header.b=A8qz1Lw0; dmarc=pass (policy=none) header.from=gmx.net; spf=pass (mx1.freebsd.org: domain of schmiedgen@gmx.net designates 212.227.17.21 as permitted sender) smtp.mailfrom=schmiedgen@gmx.net X-Spamd-Result: default: False [-4.10 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_DN_SOME(0.00)[]; FREEMAIL_FROM(0.00)[gmx.net]; R_SPF_ALLOW(-0.20)[+ip4:212.227.17.0/27]; DKIM_TRACE(0.00)[gmx.net:+]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[gmx.net,none]; NEURAL_HAM_SHORT(-1.00)[-1.000]; RCVD_IN_DNSWL_LOW(-0.10)[212.227.17.21:from]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[gmx.net]; MID_RHS_MATCH_FROM(0.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[212.227.17.21:from]; DWL_DNSWL_NONE(0.00)[gmx.net:dkim]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[gmx.net:s=badeba3b8450]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; ASN(0.00)[asn:8560, ipnet:212.227.0.0/16, country:DE]; SPAMHAUS_ZRD(0.00)[212.227.17.21:from:127.0.2.255]; RWL_MAILSPIKE_POSSIBLE(0.00)[212.227.17.21:from]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-net] X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 06 May 2021 16:00:10 -0000 On 05.05.2021 20:38, Mark Johnston wrote: > On Wed, May 05, 2021 at 06:35:32PM +0200, Michael Schmiedgen wrote: >> On 04.05.2021 21:02, Mark Johnston wrote: >>> This looks like fairly random kernel memory corruption. Are you able = to >>> build an INVARIANTS kernel and test that? Assuming you're using 13.0, >>> you'd grab the 13.0 sources, add "options INVARIANT_SUPPORT" and >>> "options INVARIANTS" to the GENERIC kernel configuration in >>> sys/amd64/conf, and do a "make buildkernel installkernel". >> >> Below some info with an INVARIANTS kernel. Please let me know if I can = provide >> further information. Thank you! > > Thanks, this helped a lot. I believe https://reviews.freebsd.org/D30129 > will fix the problem. That patch is against the main branch but applies > cleanly to 13.0. I applied the patch and the server is running fine now for 8 hours with th= e INVARIANTS kernel, including the Samba jail and SIP VM. I just compiled my custom kernel and it looks like it is working too. Are there plans to get this MFCed or even as Errata? BTW, we got 2 other systems, also with userland NAT but different workload= . After an uncertain amount of time, mostly weeks, the natd starts to spin 1= 00% CPU on these systems. Quick noobish workaround was restarting natd every n= ight. I saw your recent commits that applied some more safety in that area, do y= ou plan to MFC these as well? I can imagine that could help with my NAT probl= ems. Anyway, many thanks for your investigation and your fix, much appreciated! Michael From owner-freebsd-net@freebsd.org Thu May 6 16:02:55 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 25300626267 for ; Thu, 6 May 2021 16:02:55 +0000 (UTC) (envelope-from markjdb@gmail.com) Received: from mail-qk1-x732.google.com (mail-qk1-x732.google.com [IPv6:2607:f8b0:4864:20::732]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Fbddp1FFWz4pTM for ; Thu, 6 May 2021 16:02:54 +0000 (UTC) (envelope-from markjdb@gmail.com) Received: by mail-qk1-x732.google.com with SMTP id x8so5422228qkl.2 for ; Thu, 06 May 2021 09:02:54 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=sender:date:from:to:cc:subject:message-id:references:mime-version :content-disposition:in-reply-to; bh=WNr+YUkxpeRC2IoYeuI63qSMvpoaxsNOraMDAW1eowA=; b=ip28BM96pi9IrkNV52PCEnMvEAojoMuXDc3kunfxktk82OstlyVPRBHMI9LWNSFqA3 2TJvts75LUn5MQXZTYxfUqQph8axk7TmE55MEeny/EialOgCEp59elAHK8fhejjttPSU TTopZ38epKuGUO5SKlBb8NGBipLAdZ8UBZtGN+BZmISrZ6bZDy/Fu1Mm44yJj2HnW2Rn COWve90iyhQ71kMXUEP7fCTptaYYuiNZbup16YJCPsDaEFv2RsmRaRY62icSbmOWCN5Y xjMSVQJ3eElemmsOGdxukyAx+vw7A6CTa+TTalwt5W1U9Awr5OUqus5JEBmyh1SyUTkP wCOg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:sender:date:from:to:cc:subject:message-id :references:mime-version:content-disposition:in-reply-to; bh=WNr+YUkxpeRC2IoYeuI63qSMvpoaxsNOraMDAW1eowA=; b=VOWksT3Q4KAwdc+asovFpnA2H+pd6dvPaqM9fjUB2LCDqgsQ6WzS/2ARDeG4UgtB0Q 0IPz1svNHy8zL7w/aM7RA7fcb1B10iMrjcIzhxjoHkZkKIEFPGF4aZU19WwhuXWbPw/U CJRR/wrHPFsgUCtbuoNZIP8NSopKU+zmS7SUdGH04S1D9yJAOdOt0HmVmQxZ5WY82psk gIi0fTGN3Omedvp5sqDoyO/1gmGjXLFaAoRknb65nTOb0o5fhJYVeB0ziEQU+JluOHq5 0VnyC/K2a98xLM2ggCiiNFAPBKO5M/QA0/G12NzCA9dpL++jFkYpgZdVDKeAY1YoodW7 ngiw== X-Gm-Message-State: AOAM531QBP3ylv2OSwDEsfFJ8Eywkdc0/X0REyPu5pS+hSZ7UXXhtL1r RVcMXrUXm6S60us6imOZKms= X-Google-Smtp-Source: ABdhPJwCgMKNT8sRh5mi3XeBa6Iru3CCMiMqxcrVxPsopVFRC1OL1z8XkBfhQgeYT22vg5Ms2x6Ogg== X-Received: by 2002:a37:e508:: with SMTP id e8mr4848796qkg.82.1620316973467; Thu, 06 May 2021 09:02:53 -0700 (PDT) Received: from nuc ([142.126.164.150]) by smtp.gmail.com with ESMTPSA id w16sm292547qts.70.2021.05.06.09.02.52 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Thu, 06 May 2021 09:02:53 -0700 (PDT) Sender: Mark Johnston Date: Thu, 6 May 2021 12:02:56 -0400 From: Mark Johnston To: Michael Schmiedgen Cc: freebsd-net@freebsd.org Subject: Re: page fault while in kernel mode - after upgrade from 12.2 to 13.0 Message-ID: References: <51a3abc5-76b9-df09-acbe-895b62ec87b3@gmx.net> <90ed0277-9fcc-28c0-a546-c6a80babfa34@gmx.net> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <90ed0277-9fcc-28c0-a546-c6a80babfa34@gmx.net> X-Rspamd-Queue-Id: 4Fbddp1FFWz4pTM X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=ip28BM96; dmarc=none; spf=pass (mx1.freebsd.org: domain of markjdb@gmail.com designates 2607:f8b0:4864:20::732 as permitted sender) smtp.mailfrom=markjdb@gmail.com X-Spamd-Result: default: False [-2.51 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36:c]; RCVD_COUNT_THREE(0.00)[3]; DKIM_TRACE(0.00)[gmail.com:+]; RCPT_COUNT_TWO(0.00)[2]; NEURAL_HAM_SHORT(-0.81)[-0.806]; FREEMAIL_TO(0.00)[gmx.net]; FORGED_SENDER(0.30)[markj@freebsd.org,markjdb@gmail.com]; MIME_TRACE(0.00)[0:+]; RBL_DBL_DONT_QUERY_IPS(0.00)[2607:f8b0:4864:20::732:from]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; FROM_NEQ_ENVFROM(0.00)[markj@freebsd.org,markjdb@gmail.com]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; FROM_HAS_DN(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-net@freebsd.org]; DMARC_NA(0.00)[freebsd.org]; SPAMHAUS_ZRD(0.00)[2607:f8b0:4864:20::732:from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::732:from]; MID_RHS_NOT_FQDN(0.50)[]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-net] X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 06 May 2021 16:02:55 -0000 On Thu, May 06, 2021 at 06:00:05PM +0200, Michael Schmiedgen wrote: > On 05.05.2021 20:38, Mark Johnston wrote: > > On Wed, May 05, 2021 at 06:35:32PM +0200, Michael Schmiedgen wrote: > >> On 04.05.2021 21:02, Mark Johnston wrote: > >>> This looks like fairly random kernel memory corruption. Are you able to > >>> build an INVARIANTS kernel and test that? Assuming you're using 13.0, > >>> you'd grab the 13.0 sources, add "options INVARIANT_SUPPORT" and > >>> "options INVARIANTS" to the GENERIC kernel configuration in > >>> sys/amd64/conf, and do a "make buildkernel installkernel". > >> > >> Below some info with an INVARIANTS kernel. Please let me know if I can provide > >> further information. Thank you! > > > > Thanks, this helped a lot. I believe https://reviews.freebsd.org/D30129 > > will fix the problem. That patch is against the main branch but applies > > cleanly to 13.0. > > I applied the patch and the server is running fine now for 8 hours with the > INVARIANTS kernel, including the Samba jail and SIP VM. I just compiled my > custom kernel and it looks like it is working too. Are there plans to get > this MFCed or even as Errata? Great, thanks. Yes I think we will do an EN for this. > BTW, we got 2 other systems, also with userland NAT but different workload. > After an uncertain amount of time, mostly weeks, the natd starts to spin 100% > CPU on these systems. Quick noobish workaround was restarting natd every night. > I saw your recent commits that applied some more safety in that area, do you > plan to MFC these as well? I can imagine that could help with my NAT problems. I am skeptical that anything I did recently would fix this. Did you try attaching a debugger to natd to see where it's getting stuck? Is it also a regression from upgrading to 13.0? > Anyway, many thanks for your investigation and your fix, much appreciated! > > Michael > From owner-freebsd-net@freebsd.org Thu May 6 16:22:16 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id A85466269E9 for ; Thu, 6 May 2021 16:22:16 +0000 (UTC) (envelope-from schmiedgen@gmx.net) Received: from mout.gmx.net (mout.gmx.net [212.227.17.22]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange ECDHE (P-256) server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "mout.gmx.net", Issuer "TeleSec ServerPass Class 2 CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Fbf473Gxyz4qZL; Thu, 6 May 2021 16:22:15 +0000 (UTC) (envelope-from schmiedgen@gmx.net) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=gmx.net; s=badeba3b8450; t=1620318133; bh=vSdPkw9yHRO614HLCmQZSxzljchqJiX1Z8KvygItra8=; h=X-UI-Sender-Class:Subject:To:Cc:References:From:Date:In-Reply-To; b=JwHUnXlmJrU8oaJRnvZ24gb9muxaCmeeAKFI1EK+3JbiWwZlOx4Fyp+Xdt3gTROkl KM7ImYxuDu9AcS3IxLUU3ofEBTteE6JPfnBShOF+YZDQhEDvuSldg8/9OcXgcODPji Ng3GWUR7kEWXPszI8It1zibIG77uvWT9KnWql/6U= X-UI-Sender-Class: 01bb95c1-4bf8-414a-932a-4f6e2808ef9c Received: from [192.168.10.5] ([62.246.110.10]) by mail.gmx.net (mrgmx105 [212.227.17.168]) with ESMTPSA (Nemesis) id 1MMGRK-1lvnfv0HX4-00JFhi; Thu, 06 May 2021 18:22:13 +0200 Subject: Re: page fault while in kernel mode - after upgrade from 12.2 to 13.0 To: Mark Johnston Cc: freebsd-net@freebsd.org References: <51a3abc5-76b9-df09-acbe-895b62ec87b3@gmx.net> <90ed0277-9fcc-28c0-a546-c6a80babfa34@gmx.net> From: Michael Schmiedgen Message-ID: Date: Thu, 6 May 2021 18:22:12 +0200 User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:78.0) Gecko/20100101 Thunderbird/78.10.1 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: quoted-printable X-Provags-ID: V03:K1:e2RJexZQoe8w4wzKLbwt/z3xlLwaac/qvtkaTiuqIegeRXLPzMx ZjS4UWED+qnOV0OkHZpIwbyI83XHWxW2v8Ue+Vb7XkMRNaAuRoVrqD1onFeR/Y1FX/Fsy+S lwZESNBpwDkrb+LiqvAt6sxe3uvmwfo0uYSIucJAAA75BzXCOppgLgHeD3WXVt74ixwLN7f jsAzkPKT7qvz6qjBuO16w== X-Spam-Flag: NO X-UI-Out-Filterresults: notjunk:1;V03:K0:myiWr/6TZx4=:ARO5Dkbcezue/nr/PkI8xe b8uL1p1oJedsoRX6XhrLn368Gg/qS70Ut2htK/ZdGwHhR2rL89txJa5xwOZ1t+8DlxQspJRev Qebd2vmK0C57URP2a716/weq9nCsoZ8qUzSsyc/4wi73AoZvjEma2wbgBJTry6cbX++mKUPIn XAfha78RgBPYIAW9i2Rv/I8vsdUGXMmogS1dG9qInSRATm1OdR6jg9ijrgL7RBfy2AEgh8bFD /77cVDiCmQINN0Y8CLPhyq0yJlX0PCLD1pBA9N1ae7Rz/KXAYX/NUPX751uivaAqHGRyftmZc Lv0nLu9iDZdaf+eXFWb9S7sruQD0qcNtiIBBmwg/5CobVwjQCcIvWg3TlOoC0jLZQCrDuw71u WX4Pt+6LUcL6tpupbCkxKMKQKjhJYmcy6BZArcCdMc6gHIsICK4NQM/C9laCY/AQpPjnznhC9 BACpIruNML6LkU/CpBe0OHp3hbGpLTf2anAQIw+KPIUDBea9aNlC+NNFBzfwTMnqFWkHsLuv3 fbpivSjJu9lrlrUghhnf9gb/+XXxdBEaPrqPP50udTFVAmxbHxarzHh63TRB848e5MRSLnpap 80kYKipthFTp8lIkOXyaB8hEYOIt+FzWiEEKsJSAi6ekUr+o+esTnGz9hX3FamX75Gxfxo4er etiqecxholH/pi2sYHC9awHxLkVH2DktuPvmvw/NaQdJV5mkebxrpJlNB4RURlW4RaMiu5/ZG URFhmr+kXQDxUV1hM9Ecqb8BhGAQc8RQ6LOl8JZo3cD/ZY7IEAi9hQI6iMJLLOcTkHnxYYvdr cpIwx6cztvhYlOBPBUO0JkYpaKcLA7wkSDgdiq5Xhn5qDdLNwJf+lhFz2/xNxK8JrTMUxCNIv BVntqZZvEkyKiVry9f6QUV7OSMIqZYhA7LhjJnumK8/nZqbXauvTkTUHSYDisV+cXvECLdLqG Tvsd3IfQuTAhaQ0r2GQ2NbKcQlfuh9cXrwf83lvyAvzFOUyqJ9yPc2zveTqQkrCbcIKcA/vic yX8j0KDta6vRDoAyQ5+PMMuklRIJ1q1bFIq38d2Evqqm3lVgqFutZ0QBoq3PFMoLMS/O8xc7Z Ssh8esM4mcjxTOAzxy1sYp0NNb0taUlZ1RhcmpFjMmTNux05ak9jzYBVm7VkcBwNXaK2AiiZB 3z0HHl2aSR2APDyya9/rMgy/69HZyzE5Jap0cBizLj9L8oxlbNTHHWmYsmDQGqUXRk7ms= X-Rspamd-Queue-Id: 4Fbf473Gxyz4qZL X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmx.net header.s=badeba3b8450 header.b=JwHUnXlm; dmarc=pass (policy=none) header.from=gmx.net; spf=pass (mx1.freebsd.org: domain of schmiedgen@gmx.net designates 212.227.17.22 as permitted sender) smtp.mailfrom=schmiedgen@gmx.net X-Spamd-Result: default: False [-4.10 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_DN_SOME(0.00)[]; FREEMAIL_FROM(0.00)[gmx.net]; R_SPF_ALLOW(-0.20)[+ip4:212.227.17.0/27]; DKIM_TRACE(0.00)[gmx.net:+]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[gmx.net,none]; NEURAL_HAM_SHORT(-1.00)[-1.000]; RCVD_IN_DNSWL_LOW(-0.10)[212.227.17.22:from]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[gmx.net]; MID_RHS_MATCH_FROM(0.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[212.227.17.22:from]; DWL_DNSWL_NONE(0.00)[gmx.net:dkim]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[gmx.net:s=badeba3b8450]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; ASN(0.00)[asn:8560, ipnet:212.227.0.0/16, country:DE]; SPAMHAUS_ZRD(0.00)[212.227.17.22:from:127.0.2.255]; RWL_MAILSPIKE_POSSIBLE(0.00)[212.227.17.22:from]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-net] X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 06 May 2021 16:22:16 -0000 On 06.05.2021 18:02, Mark Johnston wrote: > On Thu, May 06, 2021 at 06:00:05PM +0200, Michael Schmiedgen wrote: >> BTW, we got 2 other systems, also with userland NAT but different workl= oad. >> After an uncertain amount of time, mostly weeks, the natd starts to spi= n 100% >> CPU on these systems. Quick noobish workaround was restarting natd ever= y night. >> I saw your recent commits that applied some more safety in that area, d= o you >> plan to MFC these as well? I can imagine that could help with my NAT pr= oblems. > > I am skeptical that anything I did recently would fix this. Did you try > attaching a debugger to natd to see where it's getting stuck? Is it > also a regression from upgrading to 13.0? Unfortunately this was difficult to trigger, and when it did, networking s= topped working and these are remote machines. This was/is on 12, I plan to upgrad= e these in the near future and keep an eye on it. From owner-freebsd-net@freebsd.org Thu May 6 17:18:55 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id E147A62883C for ; Thu, 6 May 2021 17:18:55 +0000 (UTC) (envelope-from gnn@neville-neil.com) Received: from relay4-d.mail.gandi.net (relay4-d.mail.gandi.net [217.70.183.196]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4FbgKV5vxSz4t0S for ; Thu, 6 May 2021 17:18:54 +0000 (UTC) (envelope-from gnn@neville-neil.com) X-Originating-IP: 108.41.41.5 Received: from [10.8.7.235] (pool-108-41-41-5.nycmny.ftas.verizon.net [108.41.41.5]) (Authenticated sender: gnn@neville-neil.com) by relay4-d.mail.gandi.net (Postfix) with ESMTPSA id 778DDE000E; Thu, 6 May 2021 17:18:50 +0000 (UTC) From: "George Neville-Neil" To: "Kevin Bowling" Cc: "Rick Macklem" , "FreeBSD Net" Subject: Re: Client Networking Issues / NIC Lab Date: Thu, 06 May 2021 13:18:49 -0400 X-Mailer: MailMate (1.14r5757) Message-ID: <9C836634-BA84-4C10-BDF2-75D387FBBCC6@neville-neil.com> In-Reply-To: References: MIME-Version: 1.0 Content-Type: text/plain; format=flowed X-Rspamd-Queue-Id: 4FbgKV5vxSz4t0S X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of gnn@neville-neil.com designates 217.70.183.196 as permitted sender) smtp.mailfrom=gnn@neville-neil.com X-Spamd-Result: default: False [-3.40 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; HAS_XOIP(0.00)[]; RWL_MAILSPIKE_GOOD(0.00)[217.70.183.196:from]; R_SPF_ALLOW(-0.20)[+ip4:217.70.183.192/28]; TO_DN_ALL(0.00)[]; NEURAL_HAM_SHORT(-1.00)[-1.000]; RECEIVED_SPAMHAUS_PBL(0.00)[108.41.41.5:received]; MIME_TRACE(0.00)[0:+]; RBL_DBL_DONT_QUERY_IPS(0.00)[217.70.183.196:from]; FROM_EQ_ENVFROM(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; ASN(0.00)[asn:29169, ipnet:217.70.176.0/20, country:FR]; R_DKIM_NA(0.00)[]; ARC_NA(0.00)[]; FREEFALL_USER(0.00)[gnn]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[neville-neil.com]; SPAMHAUS_ZRD(0.00)[217.70.183.196:from:127.0.2.255]; RCVD_IN_DNSWL_LOW(-0.10)[217.70.183.196:from]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-net] X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 06 May 2021 17:18:55 -0000 On 23 Apr 2021, at 18:12, Kevin Bowling wrote: > On Fri, Apr 23, 2021 at 6:19 AM Rick Macklem > wrote: >> >> Kyle Evans wrote: >>> On Fri, Apr 23, 2021 at 12:22 AM Kevin Bowling >>> wrote: >>>> >>>> Greetings, >>>> >>>> [... snip ...] >>>> >>>> Tehuti Networks seems to have gone out of business. Probably not >>>> worth worrying about. >>>> >>> >>> That's unfortunate. I had a box of their 10G NICs and I got them to >>> put a driver up for review[0][1], but they weren't very responsive >>> and >>> the existing codebase was in pretty rough shape. >>> >>> Beyond that, your #3 seems to be the most appealing. #2 could >>> probably >>> work in the mid-to-long term, but we'd likely be better off >>> bootstrapping interest with solid community-supported drivers then >>> reaching out to vendors once we can demonstrate that plan field of >>> dreams can work and drive some substantial amount of business. >> >> I'll admit to knowing nothing about it, but is using the linuxKPI >> to port Linux drivers into FreeBSD feasible? > > Hi Rick, > > I did consider this but do not think it makes sense for PCI Ethernet > NIC drivers. I will explain my judgement for consideration. In > complex systems such as an Ethernet driver, there are intrinsic and > extrinsic complexity. The intrinsic properties of an Ethernet driver > are small enough that one person can understand them. So we spend a > lot of time fighting against extrinsic problems that I outlined in my > email. Put in simpler terms, an iflib driver can be written by one > person and there are a number of people that are good at this in the > community. The intrinsic complexity of the LKPI on top of an Ethernet > driver, as well as some license and social problems people have with > LKPI lead it to be a worse fit. > > If you apply this to drm+i915 etc it is illuminating why the Linux KPI > is the right approach. The intrinsic properties of the graphics stack > are beyond time and practicality for most in the community, the > graphics drivers have become labyrinths that most kernel devs don't > have internal knowledge of, rival the size of the rest of the kernel, > and keeping up is easier if internal code changes can be kept to a > minimum. > >> Obviously, given the size of the Linux community, it seems >> more likely that it will have a driver that handles many chip >> variants, plus updates for newer chips, I think. > > I would agree that Linux has a much better Realtek driver. I am > familiar with the Linux e1000 series for instance, and although they > tend to have most the workarounds the quality is a lot lower than most > users realize. > >> I do agree that having drivers that at least work for the >> basics (maybe no Netmap, TSO, or similar) for the >> commodity chips would make it easier for new adopters >> of FreeBSD. (I avoid the problem by finding old, used >> hardware. The variants of Intel PRO1000 and re chips I >> have work fine with the drivers in FreeBSD13/14.;-) > > Having good inbox network drivers is a way for FreeBSD to > differentiate itself. I like nice drivers like cxgbe(4), it is a > great piece of engineering and to me even artful. Consider some cxgbe > so you can test high speeds :) > >> Oh, and if TSO support is questionable, I think it would be >> better to leave it disabled and at least generate a warning >> when someone enables it, if it can be enabled at all. > > I would like to preserve and correct TSO and other offloads as much as > possible. There are consequences to half assing it such as burning > more electricity than necessary and causing unnecessary HW > upgrade/replacement. Of course, where we can't deliver, we should > limit the feature set to known good ones. Striking this balance will > require more feedback from the community, with faster turnaround time > on PRs. > >> Good luck with it, rick >> >> Thanks, >> >> Kyle Evans >> >> [0] https://reviews.freebsd.org/D18856 >> [1] https://reviews.freebsd.org/D19433 >> _______________________________________________ >> freebsd-net@freebsd.org mailing list >> https://lists.freebsd.org/mailman/listinfo/freebsd-net >> To unsubscribe, send any mail to >> "freebsd-net-unsubscribe@freebsd.org" >> On the NIC Lab question, anyone on the project (and some off) can use the lab we built for high performance networking at Sentex. This lab has plenty of machines and excellent remote hands: https://wiki.freebsd.org/TestClusterOnePointers https://wiki.freebsd.org/TestClusterOneReservations Folks are welcome to contact me off list for access. Best, George From owner-freebsd-net@freebsd.org Thu May 6 18:01:29 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 121056297EE for ; Thu, 6 May 2021 18:01:29 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 4FbhGc6wgJz4vdX for ; Thu, 6 May 2021 18:01:28 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id EB0BF62984E; Thu, 6 May 2021 18:01:28 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id EAD87629B15 for ; Thu, 6 May 2021 18:01:28 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4FbhGc6FNdz4vxV for ; Thu, 6 May 2021 18:01:28 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id C9ABC1C769 for ; Thu, 6 May 2021 18:01:28 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 146I1So3075892 for ; Thu, 6 May 2021 18:01:28 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 146I1SIL075891 for net@FreeBSD.org; Thu, 6 May 2021 18:01:28 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 241191] route flush panic with RADIX_MPATH Date: Thu, 06 May 2021 18:01:27 +0000 X-Bugzilla-Reason: AssignedTo CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 12.0-STABLE X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: glebius@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: net@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? maintainer-feedback? mfc-stable12? mfc-stable11? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 06 May 2021 18:01:29 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D241191 --- Comment #8 from Gleb Smirnoff --- (In reply to Michael from comment #7) Michael, I'm pretty sure the bug you see with 14.0-CURRENT is different to = the bug Andrey reports. Can you please file a separate bug report? --=20 You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug.= From owner-freebsd-net@freebsd.org Thu May 6 18:35:54 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 327A662AAC1 for ; Thu, 6 May 2021 18:35:54 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 4Fbj2L0nJQz4wyh for ; Thu, 6 May 2021 18:35:54 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 1ABF962A9A3; Thu, 6 May 2021 18:35:54 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 1A8CA62A83D for ; Thu, 6 May 2021 18:35:54 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Fbj2K6T15z4xLN for ; Thu, 6 May 2021 18:35:53 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id D11B71D21D for ; Thu, 6 May 2021 18:35:53 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 146IZrg9096256 for ; Thu, 6 May 2021 18:35:53 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 146IZrOD096255 for net@FreeBSD.org; Thu, 6 May 2021 18:35:53 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 241191] route flush panic with RADIX_MPATH Date: Thu, 06 May 2021 18:35:53 +0000 X-Bugzilla-Reason: CC AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 12.0-STABLE X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: michael.adm@gmail.com X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: net@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? maintainer-feedback? mfc-stable12? mfc-stable11? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 06 May 2021 18:35:54 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D241191 --- Comment #9 from Michael --- Create new thread (Fatal trap 12 in ROUTE_MPATH variant "route delete"): https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D255665 --=20 You are receiving this mail because: You are on the CC list for the bug. You are the assignee for the bug.= From owner-freebsd-net@freebsd.org Thu May 6 19:46:40 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 5C69562C06E for ; Thu, 6 May 2021 19:46:40 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 4Fbkc01z3Cz51BX for ; Thu, 6 May 2021 19:46:40 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 4397162C61B; Thu, 6 May 2021 19:46:40 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 435D762C597 for ; Thu, 6 May 2021 19:46:40 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Fbkc016wYz5120 for ; Thu, 6 May 2021 19:46:40 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 1932E1DCE6 for ; Thu, 6 May 2021 19:46:40 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 146Jkekw029098 for ; Thu, 6 May 2021 19:46:40 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 146JkeBB029097 for net@FreeBSD.org; Thu, 6 May 2021 19:46:40 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 241191] route flush panic with RADIX_MPATH Date: Thu, 06 May 2021 19:46:37 +0000 X-Bugzilla-Reason: CC AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 12.0-STABLE X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: michael.adm@gmail.com X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: net@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? maintainer-feedback? mfc-stable12? mfc-stable11? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 06 May 2021 19:46:40 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D241191 --- Comment #10 from Michael --- (In reply to Gleb Smirnoff from comment #8) route -qn flush this is actually the same as route delete multi, for all route's ... and, RADIX_MPATH now renamed to ROUTE_MPATH (from 13.0) https://reviews.freebsd.org/D26449 --=20 You are receiving this mail because: You are on the CC list for the bug. You are the assignee for the bug.= From owner-freebsd-net@freebsd.org Fri May 7 11:23:31 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 9E8EB629416 for ; Fri, 7 May 2021 11:23:31 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 4Fc7Nz3xS1z4Tb8 for ; Fri, 7 May 2021 11:23:31 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 873126290E3; Fri, 7 May 2021 11:23:31 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 85DBC629397 for ; Fri, 7 May 2021 11:23:31 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Fc7Nz3K2nz4TmW for ; Fri, 7 May 2021 11:23:31 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 64EC92609 for ; Fri, 7 May 2021 11:23:31 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 147BNVNw049609 for ; Fri, 7 May 2021 11:23:31 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 147BNVQi049608 for net@FreeBSD.org; Fri, 7 May 2021 11:23:31 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 253251] Hardware Revision Realtek 8117 Date: Fri, 07 May 2021 11:23:30 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 12.2-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: linimon@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: net@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: assigned_to Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 07 May 2021 11:23:31 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D253251 Mark Linimon changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|bugs@FreeBSD.org |net@FreeBSD.org --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-net@freebsd.org Fri May 7 21:20:57 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 0518D63D0F9 for ; Fri, 7 May 2021 21:20:57 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 4FcNfJ6XcJz3NZd for ; Fri, 7 May 2021 21:20:56 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id E06EB63D484; Fri, 7 May 2021 21:20:56 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id E03AE63D2C7 for ; Fri, 7 May 2021 21:20:56 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4FcNfJ5xcYz3Nfd for ; Fri, 7 May 2021 21:20:56 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id BF36812D93 for ; Fri, 7 May 2021 21:20:56 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 147LKuY8054938 for ; Fri, 7 May 2021 21:20:56 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 147LKuH1054937 for net@FreeBSD.org; Fri, 7 May 2021 21:20:56 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 241191] route flush panic with RADIX_MPATH Date: Fri, 07 May 2021 21:20:54 +0000 X-Bugzilla-Reason: CC AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 12.0-STABLE X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: melifaro@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: net@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? maintainer-feedback? mfc-stable12? mfc-stable11? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 07 May 2021 21:20:57 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D241191 --- Comment #11 from Alexander V. Chernikov --- For the record: it indeed was a different bug and it was fixed in https://cgit.FreeBSD.org/src/commit/?id=3Daad59c79f5f2b1881c6613b1b0b6ac7be= 8eb474b --=20 You are receiving this mail because: You are on the CC list for the bug. You are the assignee for the bug.= From owner-freebsd-net@freebsd.org Sat May 8 17:06:07 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id D4D7063A2AC for ; Sat, 8 May 2021 17:06:07 +0000 (UTC) (envelope-from hausen@punkt.de) Received: from mail.punkt.de (mail.punkt.de [IPv6:2a00:b580:8000:11:1c6b:7032:35e9:5616]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Fctxp5jr3z3KvL for ; Sat, 8 May 2021 17:06:06 +0000 (UTC) (envelope-from hausen@punkt.de) Received: from [IPv6:2003:a:d59:3880:b006:16c5:aabb:ea9f] (unknown [IPv6:2003:a:d59:3880:b006:16c5:aabb:ea9f]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.punkt.de (Postfix) with ESMTPSA id E0CA72AE5F for ; Sat, 8 May 2021 19:05:57 +0200 (CEST) From: "Patrick M. Hausen" Content-Type: multipart/signed; boundary="Apple-Mail=_B6B5940D-4312-4CF2-9DD0-8C6C1BF7F752"; protocol="application/pgp-signature"; micalg=pgp-sha256 Mime-Version: 1.0 (Mac OS X Mail 12.4 \(3445.104.20\)) Subject: sender source IP address on UDP socket bound to INADDR_ANY in golang Message-Id: <2B26D5AB-0F77-4E36-AD9A-D7D6CE5F173C@punkt.de> Date: Sat, 8 May 2021 19:05:56 +0200 To: freebsd-net@freebsd.org X-Mailer: Apple Mail (2.3445.104.20) X-Rspamd-Queue-Id: 4Fctxp5jr3z3KvL X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of hausen@punkt.de designates 2a00:b580:8000:11:1c6b:7032:35e9:5616 as permitted sender) smtp.mailfrom=hausen@punkt.de X-Spamd-Result: default: False [-4.90 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+ip6:2a00:b580::/32]; HAS_ATTACHMENT(0.00)[]; TO_DN_NONE(0.00)[]; NEURAL_HAM_SHORT(-1.00)[-0.997]; SIGNED_PGP(-2.00)[]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; RBL_DBL_DONT_QUERY_IPS(0.00)[2a00:b580:8000:11:1c6b:7032:35e9:5616:from]; ASN(0.00)[asn:16188, ipnet:2a00:b580::/32, country:DE]; MID_RHS_MATCH_FROM(0.00)[]; R_DKIM_NA(0.00)[]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.20)[multipart/signed,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-net@freebsd.org]; DMARC_NA(0.00)[punkt.de]; RCPT_COUNT_ONE(0.00)[1]; SPAMHAUS_ZRD(0.00)[2a00:b580:8000:11:1c6b:7032:35e9:5616:from:127.0.2.255]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-net] X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 08 May 2021 17:06:07 -0000 --Apple-Mail=_B6B5940D-4312-4CF2-9DD0-8C6C1BF7F752 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=utf-8 Hi all, I am facing a problem that is perfectly explained by the semantics of the socket interface for UDP, if one assumes that the application in question binds to INADDR_ANY and does not specifically set the sender address when sending datagrams. In the case of a DNS server and an interface with multiple addresses that means outgoing answers will always be sent from the primary address if the server does not take specific measures to answer queries received on an alias address also *from* that alias address. I guess that is the primary reason why BIND binds to all addresses it finds at startup individually - to get this function "for free" by = the underlying OS. Now recently I stumbled over AdGuard Home - a filtering recursive nameserver written in golang - sending replies from the wrong address when alias addresses are involved. Naturally I opened the folks responsible a ticket: https://github.com/AdguardTeam/AdGuardHome/issues/3015 Their answer: "we *do* keep track of the address a query was sent to, that problem was solved long ago." Yet, clearly, my installation on Free/HardenedBSD 12.1 (OPNsense) behaves differently. My question to you on this list: since they do their main development work on Linux, is there a remote possibility that our API is sufficiently different for their code to run, but not to work as intended? Their code in question is here: = https://github.com/AdguardTeam/dnsproxy/blob/1163404e605c3dfbeab360fc3540f= c290f61a321/proxyutil/udp_unix.go#L47 I am familiar with the socket API in C (and could always fetch a copy of "Stevens" from my shelf), but don't know enough about golang to make any progress from here. Anyone who can help? Thanks! Patrick -- punkt.de GmbH Patrick M. Hausen .infrastructure Kaiserallee 13a 76133 Karlsruhe Tel. +49 721 9109500 https://infrastructure.punkt.de info@punkt.de AG Mannheim 108285 Gesch=C3=A4ftsf=C3=BChrer: J=C3=BCrgen Egeling, Daniel Lienert, Fabian = Stein --Apple-Mail=_B6B5940D-4312-4CF2-9DD0-8C6C1BF7F752 Content-Transfer-Encoding: 7bit Content-Disposition: attachment; filename=signature.asc Content-Type: application/pgp-signature; name=signature.asc Content-Description: Message signed with OpenPGP -----BEGIN PGP SIGNATURE----- iQEzBAEBCAAdFiEEgzqrjO/mj9CSsTg2kG8u4u3aiVwFAmCWxPQACgkQkG8u4u3a iVzS5AgAjH7IRm1tVSeFERgivPfDrjsvM+CgBwnBhYtNFIFvxoeIt5sTSykIQ/E3 /lPhz5eaM5yPCwq3fT0wakggtrlaY3Xq731yXauZXhl4/zeQ+cTkK3NSq6YgxP4Z EmUdwafDRw2Xct6cFfo5sWAOyCXn/TQCtDZFqvKDht9Ov4qugvSYSytINPumm1hw bhrznAb63R6DxHjuSlxvhzYVIqD5wStymsN0tkl1HXeNEqCYrjIrFVBdVsFmchPO Gv3vkr+6oMVAu6xr/A5vv3b83gsPQR8mBhHIbCzkgPo/EidvwTXl6hMjO4L4TFwN 1aG+EgE/98+da8/9sahCuqrkJmUgnA== =O32W -----END PGP SIGNATURE----- --Apple-Mail=_B6B5940D-4312-4CF2-9DD0-8C6C1BF7F752-- From owner-freebsd-net@freebsd.org Sat May 8 21:21:10 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id F35CE640066 for ; Sat, 8 May 2021 21:21:10 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 4Fd0c66NTHz3mwd for ; Sat, 8 May 2021 21:21:10 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id DB0F3640464; Sat, 8 May 2021 21:21:10 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id DADB164074B for ; Sat, 8 May 2021 21:21:10 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Fd0c65nsFz3mwc for ; Sat, 8 May 2021 21:21:10 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id BA718257C8 for ; Sat, 8 May 2021 21:21:10 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 148LLAKG037146 for ; Sat, 8 May 2021 21:21:10 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 148LLArS037145 for net@FreeBSD.org; Sat, 8 May 2021 21:21:10 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 255671] ixl(4) netmap pkt-gen stops transmitting Date: Sat, 08 May 2021 21:21:10 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 12.2-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: donner@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: net@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: assigned_to Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 08 May 2021 21:21:11 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D255671 Lutz Donnerhacke changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|bugs@FreeBSD.org |net@FreeBSD.org --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-net@freebsd.org Sat May 8 21:42:52 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id D9241640DB5 for ; Sat, 8 May 2021 21:42:52 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 4Fd1585g0wz3nhk for ; Sat, 8 May 2021 21:42:52 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id C0874640E04; Sat, 8 May 2021 21:42:52 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id C050E640B3C for ; Sat, 8 May 2021 21:42:52 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Fd1584zKpz3nbL for ; Sat, 8 May 2021 21:42:52 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 9DEDC260FB for ; Sat, 8 May 2021 21:42:52 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 148Lgq25047858 for ; Sat, 8 May 2021 21:42:52 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 148LgqRe047857 for net@FreeBSD.org; Sat, 8 May 2021 21:42:52 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 255671] ixl(4) netmap pkt-gen stops transmitting Date: Sat, 08 May 2021 21:42:52 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 12.2-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: ozkan.kirik@gmail.com X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: net@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 08 May 2021 21:42:52 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D255671 Ozkan KIRIK changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |ozkan.kirik@gmail.com --- Comment #1 from Ozkan KIRIK --- Hello, I hit same problem before. We have discussed this issue with Vincenzo Maffi= one.=20 He told me that ixl driver has issues but setting hw.ixl.enable_head_writeback=3D0 on loader.conf helps. By setting this loader tunable I solved my problem. I hope it helps to you also. It will be good if this issue could be solved within ixl driver. Regads Ozkan --=20 You are receiving this mail because: You are the assignee for the bug.=