From nobody Mon Jun 23 04:45:32 2025 X-Original-To: net@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4bQb9n0JPFz5yl9h for ; Mon, 23 Jun 2025 04:45:33 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R10" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4bQb9m40lfz41W7 for ; Mon, 23 Jun 2025 04:45:32 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1750653932; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=vxEvU7b3+PNCE3VYUnkivZV8ZDE7F0GAfLRfZj6bnA4=; b=fYxbzqjHKVQ9JobeBtZkh2CR/DX/z6vIF838ZdGycRt05hPRgXK2QhPGN3mEBmN1vEwB5Y o5/ys5UDxLg/HSMrMIoBJ0lDzqVZh5BcOMfVWEd6VIZNb2z0SPC4w4aijH0ZTrGtDX4Q+3 HwYdD2tjHCltKbzuwORpzs1mQWHqmrDQS7IFdWA8YwVyabkHBu5En1//psPoE+h7Za4Fjo iCwko3hkeFf88MaVhSRFLXDbW/MyOwnImetgqDdY55RmjwhyPWVp6IhYHCJj5vFpDj4fOT iXanXugj0rPo7qrKbwo9SjGtJ6je8VK+c6v/B/0h6THD/JMP/HVmiQjxD+fEZQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1750653932; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=vxEvU7b3+PNCE3VYUnkivZV8ZDE7F0GAfLRfZj6bnA4=; b=CrdXmM3e4lpjpZ0Pq4T6w7pQzPILU6KL9F3zdSSY58cZBTelbwvpqKwtKCMxr4KIspUjRi Is/2VlDqw28RmT/pUqvpIJFc6pBPNlgG69MT7wbw9xixPs2s8eRv+G7wXX6xD4v9RTRcx7 +mjETtB88nkemti8eJ3bL26M2psqulw0QcKMczLQx4DjiXLOGEca/Uu53vxNyr8Q1enHA/ Ge3LBFnf2e5ctaZZAVd0vApM+XTEEVSiDvc9X4qOExt61VN49LCV0UKDx5pmFxdYju6SSv iZNnHlcHjnCEuExa8potsBq15MflqwqFXFkvmJ/rHVuDWHl3l9kKAFEculAGjQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1750653932; a=rsa-sha256; cv=none; b=k6zdniykckZ674ww59YOAPfdP6YtgGbg96MXCP9e2DQpczsXGiGE9WiQXacRO0Jwv+zX7+ pc4UWnsA12VT1C1hj4mTvpNvevx5Da6PHXwr9t3nvH1V/aiqLruY4Q5R8z/XU3otgQVWnt iXa2H2cv7tPlsrtD5Xmr6nhaC6AK1wNnOKoy8jIRIoR12z5dyaGzcljyCspX4aVRJWQk1Y cZ0oS1EkOr4dM0HX183h+HTa2uohwrAfYEgdrDRXNvyd0M/yP8NrTaoVtoyB4URF3w+eLu fCfCxv3RxbkL4VtS0fo4TRPXj0n0cSRcCcYqywNtihi3UmfwlTVFdPZS+zA6eQ== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4bQb9m3ThQzpH4 for ; Mon, 23 Jun 2025 04:45:32 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 55N4jWR1087238 for ; Mon, 23 Jun 2025 04:45:32 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 55N4jWGt087237 for net@FreeBSD.org; Mon, 23 Jun 2025 04:45:32 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 287492] Unable to detect NIC cards on few PCIe Gen5 slots on Dell R770 servers where x2APIC mode is enabled Date: Mon, 23 Jun 2025 04:45:32 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 15.0-CURRENT X-Bugzilla-Keywords: vendor X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: sreekanth.reddy@broadcom.com X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: net@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset="UTF-8" X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Networking and TCP/IP with FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-net List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-net@FreeBSD.org MIME-Version: 1.0 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D287492 --- Comment #4 from Sreekanth Reddy --- Intel(R) Xeon(R) 6710E CPU is being used. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Tue Jun 24 09:29:54 2025 X-Original-To: net@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4bRKRQ60Z5z60XBZ for ; Tue, 24 Jun 2025 09:29:54 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R10" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4bRKRQ4BGSz3c4N for ; Tue, 24 Jun 2025 09:29:54 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1750757394; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=NXPBThS/gnayxzQYCdujyaWe1Ano34zmK/gz+R3VXD4=; b=t15AVZTdnzrKJY4HMtEijE0+uJThWOOYHfozFmiJuf1ogB7ZCBK12/lz4MD97TOVmIP/Oq AaPDYJhoojYchpeYnJZDq47OixMO3sDhQjJP2rqEPWCfZqIIc7NxR7M0UzEhLsVi2bDo5c 7gfVcvy06wgf96tWEJ1N7dqcbkfwE1a16TTv4jBRtaVT17CwF91xcviqMeFnmLgrmhCfab 41wo5tHwmuo8UtP2dNKgkQRhVr/d4l+eBMSvFfI9nQ1ShRivLZ3lqDK0YSqUfAu26gxGh1 QFlaERnuE1XLnMqqPqlqM5Aehi49sSntwSJL/VdGeoA1vWyM3pUQGrUMpicgJQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1750757394; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=NXPBThS/gnayxzQYCdujyaWe1Ano34zmK/gz+R3VXD4=; b=Vpz2wkcIcVI+kAOPMPEIfwBhixboS+EXxXtzDtebZSnawzIai11m1ZFhGmLomyH7ZfppMv yq5YzofqRPEES/vDK3lRRExw0Ygh9J7+eu+N27Tpz/rH2Q3s9SJkddCspyjTXYz7bo38W9 5rBILN0ukrhjyZb6tFvcyRWqZTxhNrD2DX0L38/kEQIfr+ysh1yFxt/DtYCCLgWBFD88yk CHW2vemNViK22MRzwZxGU+peGwULouo8SWx8R5jAFS+Bh3TvpKlIEM4HA8jkSuqqZjiptL 25yn95Z7CGjGLHP2iVA3NOI2g2NjvXiTdYjdUGJUvVhlPandEkPNbcmxCZDHKg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1750757394; a=rsa-sha256; cv=none; b=jYHmu1XrAQFALk4h4cV8jhj2nq5BrROgW1SlCmdlPJsxAwAq6izvxKv0nCWbwNxrFLQSRL msBhy5k84KK+anegy+wwAZZt1xlkyEl3AAylhc9A7Ndzmathg6Xr1Y6lR8CMemZsmZ2EIF SRXmB/pT4Bl3jHZX1vi6Y7VtNk6DS3bVcAK04lUTnOu/D4TYrXape3v+vJ9veqTnN8+0VG eWzWR34+gFT1H9b1P/navG6PCHcqQt8aCH1tbV0rmIXiO7uHE/bJGXXTpMcQ6ABlSFbrh1 GNS1pCdkR5R7aIRPkzO1yWsnJW10thTAnnjq1yPy3o7ey4LNrQbbaRksV52t/A== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4bRKRQ37ndzjLx for ; Tue, 24 Jun 2025 09:29:54 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 55O9TsQm010508 for ; Tue, 24 Jun 2025 09:29:54 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 55O9TsDj010507 for net@FreeBSD.org; Tue, 24 Jun 2025 09:29:54 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 287229] IP reassembly issue in FreeBSD 14.1 Date: Tue, 24 Jun 2025 09:29:54 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 14.2-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: lucas.aubard@irisa.fr X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: tuexen@freebsd.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset="UTF-8" X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Networking and TCP/IP with FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-net List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-net@FreeBSD.org MIME-Version: 1.0 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D287229 --- Comment #37 from Lucas Aubard --- (In reply to Michael Tuexen from comment #33) In the attacks we consider, the attacker does not try to reach FreeBSD limi= ts to force it to drop some fragments. Instead, the attacker sends a sequence = of overlapping packets that the NIDS and the supervised host reassemble differently (e.g., the NIDS favors the oldest data in the overlapping porti= on while the supervised host prefers the newest). Thus, the attacker does not = try to reproduce our entire set of test cases; they only need one of the test c= ases to perform the attack. In our testing, we are trying to obtain the FreeBSD reassembly policy, and = the limits are reached because of the VM setting and the testing parallelizatio= n.=20 For your information, here are the results of some experiments I ran with 4= 0 or 60 processes: - (1) vm.kmem_size=3D"200M", vm.kmem_size_max=3D"200M", maxfragbucketsize= =3D100, maxfrags=3D400 (default), 40 processes =3D> inconsistencies. - (2) vm.kmem_size=3D"200M", vm.kmem_size_max=3D"200M", maxfragbucketsize= =3D100, maxfrags=3D4000, 40 processes =3D> no inconsistency. - (3) vm.kmem_size=3D"200M", vm.kmem_size_max=3D"200M", maxfragbucketsize= =3D100, maxfrags=3D4000, 60 processes =3D> inconsistencies. - (4) vm.kmem_size=3D"1000M", vm.kmem_size_max=3D"1000M", maxfragbucketsize= =3D3 (default), maxfrags=3D1983 (default), 60 processes =3D> inconsistencies. - (5) vm.kmem_size=3D"1000M", vm.kmem_size_max=3D"1000M", maxfragbucketsize= =3D3 (default), maxfrags=3D4000, 60 processes =3D> no inconsistency. - (6) vm.kmem_size=3D"1000M", vm.kmem_size_max=3D"1000M", maxfragbucketsize= =3D100, maxfrags=3D4000, 60 processes =3D> inconsistencies. Let me know if you want that I test other parameter values. For my specific case, I should increase kmem_size to 2000M so as not to experience reassembly inconsistency. --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Tue Jun 24 09:30:46 2025 X-Original-To: net@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4bRKSR0sqCz5yYCF for ; Tue, 24 Jun 2025 09:30:47 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R10" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4bRKSQ5Pqsz3crg for ; Tue, 24 Jun 2025 09:30:46 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1750757446; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=y/ZCbpihkoAouiJUHzrcYVcAPfGRmJ1CB5jpqCeAXtU=; b=CuPxFK4KIoisyrbobyl/pph1wskqADfdowwVUxCFgv/UU3Re13q3nnULtKMW1rTYrHrSMR Nl+eq4yEgF/SV95g16cmJoDczrt2GIE8/7WPp1IGNyywTzkSnIgVrzIT9uWy9FDbo93+cj u87rJo9rTEmTW3zTR3UdJCoCbOIN4EkbcjiJcyysAN20GbiS6p8beEgGA5eDNGtti7XbGP Nmr5gCzj8Nfakt77OTs5yLMVeqFmRWr3wHZF8gVxQe0Y2X+d4fGX+EpWPvuKGbbGSeJfqT hhN7h5kKkt/beY14vRz+3xntC0HKTzsHqrgM2Kl8QMj2ByBUFhaCNSU0M1DfWA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1750757446; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=y/ZCbpihkoAouiJUHzrcYVcAPfGRmJ1CB5jpqCeAXtU=; b=lXgX/hOmHeGl/I4kSYXZU9NZynTzl5beJXWmq31aVQZtGVJWjx6xY1FjglDBcvUyXatf9H UifVjHbReZqZxR8HXWUb5Zcf/NjQBRcyuL1BgkGux4BEaK9+o9GLY7s6GuYjAsmO4wXGej dPDTLdCZ/QSAB9lvq+mmMhtz1avq2DKy2VDgyIdUak2QRpDp6NENq9mKGRsGsw5J0XyTxV w6JDFxgR772hOwMGd/2kH8fD8oOpLrXl0I2ttXLAm+LldiEm38I4xHPe8qzU5FUWR6sM5h uyrMtwsvzoro4ompBg1sTLTwiyaKyLC+rq/ZA5aD3lBh0et3i8DghvF8nLeDJg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1750757446; a=rsa-sha256; cv=none; b=UUNtzEevH8cDO8TmMMPMZD4ZMlt2gToIp63bqwhiJJTZITgR0tF3GvvfS1RdoqL25oxaD/ O3ZIXli17EvGjchfaAXnziul2Lr3xkrRljW0KGXzRlcXzi/LeO1C8Ie45hZ5/vgkK7a4cm 3VE7TFYd1yUUPjy7hxCXnO9m0QN0E3cu2I7wdVHqLwKfWalLoQlJwmCS3X0XgTBu0V8k/T uP/2CHyrNwyhxU1irwJL7HiLDqcHb4Q+JtgrdpZBFEW7921LwRQD07qMyzu1AJCaBpIx9m S0b91amIGrqUgUc8vMa8ypuzobQKWulGjngF6wS5D95hWY6GMfLLYSQ1IPoyrQ== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4bRKSQ4NWmzjMG for ; Tue, 24 Jun 2025 09:30:46 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 55O9UklH012483 for ; Tue, 24 Jun 2025 09:30:46 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 55O9UkCj012456 for net@FreeBSD.org; Tue, 24 Jun 2025 09:30:46 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 287229] IP reassembly issue in FreeBSD 14.1 Date: Tue, 24 Jun 2025 09:30:46 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 14.2-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: lucas.aubard@irisa.fr X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: tuexen@freebsd.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset="UTF-8" X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Networking and TCP/IP with FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-net List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-net@FreeBSD.org MIME-Version: 1.0 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D287229 --- Comment #38 from Lucas Aubard --- (In reply to Gleb Smirnoff from comment #36) Thanks a lot for the instructions. I guess, this is not relevant to test th= is for the attacks I consider as discussed with Michael. --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Thu Jun 26 11:35:22 2025 X-Original-To: freebsd-net@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4bSc7P5fL9z60S3v for ; Thu, 26 Jun 2025 11:35:29 +0000 (UTC) (envelope-from karl@denninger.net) Received: from colo1.denninger.net (colo1.denninger.net [104.236.120.189]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4bSc7N2fn8z3YjP for ; Thu, 26 Jun 2025 11:35:28 +0000 (UTC) (envelope-from karl@denninger.net) Authentication-Results: mx1.freebsd.org; dkim=none; spf=pass (mx1.freebsd.org: domain of karl@denninger.net designates 104.236.120.189 as permitted sender) smtp.mailfrom=karl@denninger.net; dmarc=pass (policy=none) header.from=denninger.net Received: from denninger.net (unknown [162.81.137.111]) by colo1.denninger.net (Postfix) with ESMTP id 352D8B16D7 for ; Thu, 26 Jun 2025 07:35:22 -0400 (EDT) Received: from [192.168.10.15] (D5.Denninger.Net [192.168.10.15]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange x25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by denninger.net (Postfix) with ESMTPSA id 885F14D65C4 for ; Thu, 26 Jun 2025 07:35:22 -0400 (EDT) Message-ID: <7080a255-41bb-49b9-a76c-9eec9d888302@denninger.net> Date: Thu, 26 Jun 2025 07:35:22 -0400 List-Id: Networking and TCP/IP with FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-net List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-net@FreeBSD.org MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Subject: Re: dhcpcd(8) into FreeBSD base To: freebsd-net@freebsd.org References: <18ff2d4772a.129dde187836962.5411001908566459400@marples.name> <1188806329.62817.1750321263908@localhost> <5f4fe904-dda8-42d8-8325-dd3bb0403df8@denninger.net> <549425506.8980.1750427031217@localhost> Content-Language: en-US From: Karl Denninger In-Reply-To: <549425506.8980.1750427031217@localhost> Content-Type: multipart/signed; protocol="application/pkcs7-signature"; micalg=sha-512; boundary="------------ms060909010202020902080702" X-Spamd-Result: default: False [-1.79 / 15.00]; SIGNED_SMIME(-2.00)[]; NEURAL_SPAM_MEDIUM(1.00)[1.000]; NEURAL_SPAM_LONG(1.00)[1.000]; NEURAL_HAM_SHORT(-0.99)[-0.987]; DMARC_POLICY_ALLOW(-0.50)[denninger.net,none]; MIME_GOOD(-0.20)[multipart/signed,multipart/alternative,text/plain]; R_SPF_ALLOW(-0.20)[+mx]; MIME_BASE64_TEXT(0.10)[]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; ASN(0.00)[asn:14061, ipnet:104.236.64.0/18, country:US]; RCPT_COUNT_ONE(0.00)[1]; MIME_TRACE(0.00)[0:+,1:+,2:+,3:~,4:~]; FREEFALL_USER(0.00)[karl]; MID_RHS_MATCH_FROM(0.00)[]; MLMMJ_DEST(0.00)[freebsd-net@freebsd.org]; RCVD_TLS_LAST(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; FROM_HAS_DN(0.00)[]; R_DKIM_NA(0.00)[]; RCVD_COUNT_TWO(0.00)[2]; TO_MATCH_ENVRCPT_ALL(0.00)[]; TO_DN_NONE(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-net@freebsd.org]; HAS_ATTACHMENT(0.00)[] X-Rspamd-Queue-Id: 4bSc7N2fn8z3YjP X-Spamd-Bar: - This is a cryptographically signed message in MIME format. --------------ms060909010202020902080702 Content-Type: multipart/alternative; boundary="------------01Ppvbag3Z2eT9paGvvciPSv" --------------01Ppvbag3Z2eT9paGvvciPSv Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: base64 SSd2ZSBub3Qgc2VlbiBhbnl0aGluZyBsaWtlIHRoYXQ7IGl0IGFwcGVhcnMgdGhhdCB0aGUg aXNzdWUgSSd2ZSBoYWQgaXMgDQpyZWxhdGVkIHRvIG15ICh2ZXJ5IHN0cm9uZykgZGVzaXJl IHRvIGhhdmUgdGhlIGdhdGV3YXkgYmUgZW50aXJlbHkgDQpwb3dlci1mYWlsIHNhZmUsIHdo aWNoIGluIHR1cm4gbWVhbnMgdGhhdCB0aGUgY29udGVudHMgb2YgL3Zhci9kYiBhcmUgDQp2 b2xhdGlsZSAoc2luY2UgaXRzIGEgbmFub2JzZCBidWlsZC4pIC8vVGhhdCwgY291cGxlZCB3 aXRoIHRoZSBJU1BzIA0Kb3JpZ2luYWwgInZhbGlkIiB0aW1lIGZvciB0aGUgSXA2IGRlbGVn YXRpb24gYmVpbmcgcm91Z2hseSBhIHdlZWsgbWVhbnMgDQp0aGV5IGZyb20gd2hhdCB0aGV5 J3JlIHRlbGxpbmcgaXMgdGhhdCB0aGV5IHdhbnQgbWUgdG8gYXR0ZW1wdCB0byByZWJpbmQg DQpvbiBhIHJlYm9vdCAoZS5nLiBwb3dlciBsb3NzLCBzb2Z0d2FyZSB1cGdyYWRlLCBldGMu KSBhbmQgb2YgY291cnNlIHlvdSANCmNhbid0IGlmIHlvdSBkb24ndCBrbm93IHdoYXQgdGhl IG9yaWdpbmFsIGRlbGVnYXRpb24gd2FzLsKgIFRoZSBzYW1lIA0KYXBwbGllcyB0byB0aGUg ZHVpZCBhbHRob3VnaCBkaGNwY2QgZG9lcyBoYXZlIGEgd2F5IHRvIHByb2R1Y2Ugd2hhdCAN CnNob3VsZCBiZSBpbnZhcmlhbnQgZm9yIGF0IGxlYXN0IGEgY29uc2lzdGVudCBNQUMgYWRk cmVzcyAoZS5nLiANCmludGVyZmFjZSB0byB3aGljaCB5b3UncmUgcGx1Z2dlZC4pDQoNCkkn bSB3b25kZXJpbmcgaWYgdGhlIGludGVyYWN0aW9uIHlvdSByYW4gaW50byBpcyByZWxhdGVk IHRvIGl0cyB1c2Ugb2YgQlBGLg0KDQpPbiA2LzIwLzIwMjUgMDk6NDMsIFJvbmFsZCBLbG9w IHdyb3RlOg0KPg0KPiBJIGhhdmUgdHJpZWQgdGhlwqAibm9pcDRsbCIgYW5kICJub2FycCIg b3B0aW9uLiBEaWRuJ3QgY2hhbmdlIGFueXRoaW5nLg0KPg0KPiBNeSBpc3N1ZSBlbmRlZCB1 cCB0aGF0IGRoY3BjZCBzYWlkIGluIHRoZSBsb2dzIGl0IHdvdWxkIHNlbnQgYSBkaGNwIA0K PiBwYWNrZXQgKHRoZSBwb3J0IDY3LzY4IHRoaW5nKSwgYnV0IG5vdGhpbmcgYXBwZWFyZWQg b24gdGhlIG5ldHdvcmsuIA0KPiBBbmQgc28gdGhlIGxlYXNlIHRpbWVkIG91dCBhZnRlciBh IGxvbmcgdGltZSBhbmQgaXQgcmVtb3ZlZCB0aGUgSVAgDQo+IGFkZHJlc3MgZnJvbSB0aGUg aW50ZXJmYWNlLg0KPg0KPiBSb25hbGQuDQo+DQo+ICpWYW46KiBLYXJsIERlbm5pbmdlciA8 a2FybEBkZW5uaW5nZXIubmV0Pg0KPiAqRGF0dW06KnZyaWpkYWcsIDIwIGp1bmkgMjAyNSAx NToyNA0KPiAqQWFuOipmcmVlYnNkLW5ldEBmcmVlYnNkLm9yZw0KPiAqT25kZXJ3ZXJwOipS ZTogZGhjcGNkKDgpIGludG8gRnJlZUJTRCBiYXNlDQo+DQo+ICAgICBPbiA2LzE5LzIwMjUg MDQ6MjEsIFJvbmFsZCBLbG9wIHdyb3RlOg0KPg0KPiAgICAgICAgIEhpLA0KPg0KPiAgICAg ICAgIEkgZG9uJ3Qga25vdyB0aGUgZGV0YWlscyBhYm91dCB5b3VyIHNldHVwLCBidXQgSSB0 cmllZCBkaGNwY2QNCj4gICAgICAgICBpbiBteSBuZXR3b3JrIGxhc3QgZmV3IG1vbnRocyBh bmQgSSBlbmNvdW50ZXJlZCB0aGF0IGl0Og0KPg0KPiAgICAgICAgIC0gcnVucyBmaW5lIGlu IGEgMTQuWCBqYWlsIG9uIGEgMTQuWCBtYWNoaW5lIChSUEkzQikgZm9yIGJvdGgNCj4gICAg ICAgICBJUDQgYW5kIElQNg0KPiAgICAgICAgIC0gaXQgZG9lcyBub3Qgd29yayB3ZWxsIG9u IGEgMTQuWCBqYWlsIG9uIGEgMTUueCBtYWNoaW5lcy4gKFJQSTQpDQo+DQo+ICAgICAgICAg VGhlIHN5bXB0b21zIGxvb2sgYSBsb3QgbGlrZSB3aGF0IHlvdSBkZXNjcmliZS4gU29tZXRp bWVzIGl0DQo+ICAgICAgICAgZ290IGFuIGFkZHJlc3MgYW5kIGEgZGF5IGxhdGVyIGl0IHdh cyBnb25lIGFnYWluLiBSZXN0YXJ0aW5nDQo+ICAgICAgICAgc29tZXRpbWVzIGhlbHBlZCwg b2Z0ZW4gZGlkbid0IGNoYW5nZSBhbnl0aGluZy4NCj4gICAgICAgICBVcCB0byB0aGUgcG9p bnQgdGhhdCBJIHN0YXJ0ZWQgcmVhZGluZyB0byBjb2RlIG9mIGRoY3BjZCBhbmQNCj4gICAg ICAgICBlbmNvdW50ZXJlZCB0aGF0IGl0IHdyaXRlcyBhIGxpbmUgaW4gdGhlIGxvZyBhYm91 dCBnZXR0aW5nIGENCj4gICAgICAgICBsZWFzZSBhbmQgdGhlIG5leHQgc3RhdGVtZW50IHdh cyBzZW5kaW5nIGEgcGFja2V0IG91dCBvbiB0aGUNCj4gICAgICAgICBuZXR3b3JrIGFuZCBJ IG5ldmVyIHNlZSB0aGF0IHBhY2tldCBpbiB0Y3BkdW1wLg0KPg0KPiAgICAgICAgIEFueXdh eSBvbiB0aGUgUlBJMyBJIHN0aWxsIHVzZSBpdC4gT24gdGhlIFJQSTQgSSB3ZW50IGJhY2sg dG8NCj4gICAgICAgICBkaGNsaWVudCArIFNMQUFDIGFmdGVyIEkgcHV0IGEgbG90IG9mIHRp bWUgaW4gdGNwZHVtcGluZyBhbmQNCj4gICAgICAgICB0ZXN0aW5nLiBNYXliZSBpdCBpcyBq dXN0IHRoYXQgMTQgdXNlcmxhbmQgZG9lc24ndCBtYXRjaA0KPiAgICAgICAgIGVub3VnaCB3 aXRoIDE1IGtlcm5lbCB0byBkbyBCUEYvZGhjcC4gQnV0IHRoYW4gYWdhaW4uLi4uIHdpdGgN Cj4gICAgICAgICBkaGNsaWVudCBpdCB3b3JrcyBmaW5lLg0KPg0KPiAgICAgICAgIEkgZGlk bid0IHJ1biBkaGNwY2QgeWV0IG9uIHRoZSBob3N0IE9TIHlldCBhcyBJIHdhcyBmaXJzdA0K PiAgICAgICAgIHRlc3RpbmcgaXQgaW4gdGhlIFZORVQgamFpbHMuDQo+DQo+ICAgICAgICAg SnVzdCBteSAyIGNlbnRzLg0KPg0KPiAgICAgICAgIFJlZ2FyZHMsDQo+ICAgICAgICAgUm9u YWxkLg0KPg0KPiAgICAgTm93IHRoYXQncyB2ZXJ5IGN1cmlvdXMuDQo+DQo+ICAgICBDb3Vs ZCB5b3UgKHdoZXJlIHlvdSBjYW4gY29udHJvbCB3aGF0J3MgZ29pbmcgb24gd2l0aCB0aGUg b3RoZXINCj4gICAgIGVuZCwgd2hpY2ggSSBjYW4ndCkgdHJ5IGFnYWluIHdpdGggIm5vaXA0 bGwiIGFuZCAibm9hcnAiIGFuZCBzZWUNCj4gICAgIGlmIHlvdSBzdGlsbCBnZXQgdGhlIG9k ZG5lc3M/DQo+DQo+ICAgICBJIGhhdmUgYSBzdXNwaWNpb24gdGhpcyBpcyB0aGUgY2F1c2Ug KGZyb20gdGhlIGRvY3MgIm5vYXJwIiBzaG91bGQNCj4gICAgIGJlIGVub3VnaCB0byBkaXNh YmxlIGJvdGgsIGJ1dCBuZXZlciBodXJ0cyB0byBzdGljayAnZW0gYm90aCBpbg0KPiAgICAg dGhlcmUpIC0tIGFuZCBpZiBzbyB0aGVuIHBlcmhhcHMgZGVmYXVsdCBiZWhhdmlvciBzaG91 bGQgYmUgY2hhbmdlZC4NCj4NCj4gICAgIC0tDQo+ICAgICBLYXJsIERlbm5pbmdlcg0KPiAg ICAga2FybEBkZW5uaW5nZXIubmV0DQo+ICAgICAvVGhlIE1hcmtldCBUaWNrZXIvDQo+ICAg ICAvW1MvTUlNRSBlbmNyeXB0ZWQgZW1haWwgcHJlZmVycmVkXS8NCj4NCj4NCi0tIA0KS2Fy bCBEZW5uaW5nZXINCmthcmxAZGVubmluZ2VyLm5ldA0KL1RoZSBNYXJrZXQgVGlja2VyLw0K L1tTL01JTUUgZW5jcnlwdGVkIGVtYWlsIHByZWZlcnJlZF0vDQo= --------------01Ppvbag3Z2eT9paGvvciPSv Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
I've not seen anything like that; it appears that the issue I've had is related to my (very strong) desire to have the gateway be entirely power-fail safe, which in turn means that the contents of /var/db are volatile (since its a nanobsd build.)=C2=A0=C2=A0That, coupled with the ISPs origi= nal "valid" time for the Ip6 delegation being roughly a week means they from what they're telling is that they want me to attempt to rebind on a reboot (e.g. power loss, software upgrade, etc.) and of course you can't if you don't know what the original delegation was.=C2=A0 The same applies to the duid although dhcpcd does have a= way to produce what should be invariant for at least a consistent MAC address (e.g. interface to which you're plugged.)

I'm wondering if the interaction you ran into is related to its use of BPF.

On 6/20/2025 09:43, Ronald Klop wrote:=

I have tried the=C2=A0"noip4ll" and "noarp" option. Didn't change anything.

My issue ended up that dhcpcd said in the logs it would sent a dhcp packet (the port 67/68 thing), but nothing appeared on the network. And so the lease timed out after a long time and it removed the IP address from the interface.

Ronald.

=C2=A0

Van: Karl Denninger <karl@denninger.net>=
Datum:vrijdag, 20 juni 2025 15:24
Aan:freebsd-net@freebsd.org
Onderwerp:Re: dhcpcd(8) into FreeBSD base

On 6/19/2025 04:21, Ronald= Klop wrote:
Hi,

I don't know the details about your setup, but I tried dhcpcd in my network last few months and I encountered that it:

- runs fine in a 14.X jail on a 14.X machine (RPI3B) for both IP4 and IP6
- it does not work well on a 14.X jail on a 15.x machines. (RPI4)

The symptoms look a lot like what you describe. Sometimes it got an address and a day later it was gone again. Restarting sometimes helped, often didn't change anything.
Up to the point that I started reading to code of dhcpcd and encountered that it writes a line in the log about getting a lease and the next statement was sending a packet out on the network and I never see that packet in tcpdump.

Anyway on the RPI3 I still use it. On the RPI4 I went back to dhclient + SLAAC after I put a lot of time in tcpdumping and testing. Maybe it is just that 14 userland doesn't match enough with 15 kernel to do BPF/dhcp. But than again.... with dhclient it works fine.

I didn't run dhcpcd yet on the host OS yet as I was first testing it in the VNET jails.

Just my 2 cents.

Regards,
Ronald.
=C2=A0

Now that's very curious.

Could you (where you can control what's going on with the other end, which I can't) try again with "noip4ll" and "noarp" and see if you still get the oddness?

I have a suspicion this is the cause (from the docs "noarp" should be enough to disable both, but never hurts to stick 'em both in there) -- and if so then perhaps default behavior should be changed.

--
Karl Denninger
karl@denninger.net
The Market Ticker
[S/MIME encrypted email preferred]=
=C2=A0

=C2=A0
--
Karl Denninger
karl@denninger.net
The Market Ticker
[S/MIME encrypted email preferred]<= /div> --------------01Ppvbag3Z2eT9paGvvciPSv-- --------------ms060909010202020902080702 Content-Type: application/pkcs7-signature; name="smime.p7s" Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="smime.p7s" Content-Description: S/MIME Cryptographic Signature MIAGCSqGSIb3DQEHAqCAMIACAQExDzANBglghkgBZQMEAgMFADCABgkqhkiG9w0BBwEAAKCC C4owggWZMIIDgaADAgECAhRZU8dKdMneRI1Vq5kv0k54Q5rQuDANBgkqhkiG9w0BAQsFADB2 MQswCQYDVQQGEwJVUzESMBAGA1UECAwJVGVubmVzc2VlMRYwFAYDVQQKDA1EZW5uaW5nZXIu TmV0MRcwFQYDVQQDDA5EZW5uaW5nZXIgUm9vdDEiMCAGCSqGSIb3DQEJARYTYWRtaW5AZGVu bmluZ2VyLm5ldDAeFw0yNDA1MDkyMTA4MDNaFw00NDA1MDQyMTA4MDNaMF0xCzAJBgNVBAYT AlVTMRIwEAYDVQQIDAlUZW5uZXNzZWUxFjAUBgNVBAoMDURlbm5pbmdlci5uZXQxIjAgBgNV BAMMGURlbm5pbmdlci5OZXQgU2lnbmluZyBJbnQwggEiMA0GCSqGSIb3DQEBAQUAA4IBDwAw ggEKAoIBAQDbR0tSiuLG5HPfo+cWtdeYQ8jc8Bjfuo0GTcNRT0glHnH1apUtInIktUknEZDH ohahInN+mMBdKg54FCHOiYZrJbyxBIo9FwX7hRmOc+spxmSYWnOd2E/YcGInMK4ZpjPzldzB Yt1n3zygkhx2bssxTJS3x4nv1qAXfLSZd1VwqoQufifEoPyTtymkkvHLv86vLgqAqooM/cXc 4LSIQ5u2uM308n42r8RkKtp7X1v9fJW8oRZN2XnFZtiUPH44YY2rHqyN2Hea9Y3+TXbldXjo xhPHTA+JYVFq8KTmbQBqU7YcMhlIG0cSxPeFLMxnP6pqPcIVTAlK+a6YGRFppfjZAgMBAAGj ggE2MIIBMjAdBgNVHQ4EFgQUH+VuxXhBxaJAQrvDekwkH91hBi4wgbMGA1UdIwSBqzCBqIAU RFYC4p6L6KITnEvrpx2cyt+PcMmheqR4MHYxCzAJBgNVBAYTAlVTMRIwEAYDVQQIDAlUZW5u ZXNzZWUxFjAUBgNVBAoMDURlbm5pbmdlci5OZXQxFzAVBgNVBAMMDkRlbm5pbmdlciBSb290 MSIwIAYJKoZIhvcNAQkBFhNhZG1pbkBkZW5uaW5nZXIubmV0ghQZE7NBItWtQsCouuwU6jZ+ HPPwnjAPBgNVHRMBAf8EBTADAQH/MA4GA1UdDwEB/wQEAwIBBjA6BgNVHR8EMzAxMC+gLaAr hilodHRwOi8vd3d3LmRlbm5pbmdlci5uZXQvcm9vdC1yZXZva2VkLmNybDANBgkqhkiG9w0B AQsFAAOCAgEAfFbhPc82AfhyUqONs7IccYD36w+OP4nQgwfC4IWf3y/aQAZ2Zk6IITzYqwf7 PFM0bJRT3zi7xyetolqHDhfMJvnOQWpITZiyM/FSKwIvuBsy/uJUqPuqui4XQMYoSbAA1qmI MW/z7VZZHwaRFoeWE40UirYcf0fNcooBZ72bmd+iBaVyjtZvky0Vgcz0eC6e6LR5kNb23yC6 TkyQIlGyQkK5/afXUYFzk49rOHVbVyxW3oXRfq8Ow6HCrpDGAS8p84S04MFwBVAUfbe4aXs3 bampaI2LzKgkVywyFP14LSvvdjCfLYfnLy1Z9hm2EHMqNHA2tCGdRhWp2d7aZC1MYFqng0ZS fjPJjqHrI1qPU0p6k9A1GxAtrQlL2v/IUzUnMZkiawFV3qlxMGZf/kTYTUOcJhx1KU4zSLHu 80qO7ldRpp5gHssCAGFbeTu2gp6LxfmaFhLPDBJ1VGfdPx9lUrU/9OcoHczcl5x2Rb8IUZyX 9elzP5WdAU8p5R/DLlOAq24VcabhFtYBCA2dOESLupSfWKNQuJCN/1gz7ysSc+mjnnPV77IO mpszJfkFFJEDNJlGIVKX1vwwygtC/9Ulox8frgbZlRAYAgDc/YbOBFxticVVre0Y3Ujx6Kzb tkgZRlgfdZWbT1W5smncqJxg5qAL8e/yTb3fCe2nJ0jhiP4wggXpMIIE0aADAgECAhMAmNFt CiCF3j+FwQLYtBTmGjzkMA0GCSqGSIb3DQEBCwUAMF0xCzAJBgNVBAYTAlVTMRIwEAYDVQQI DAlUZW5uZXNzZWUxFjAUBgNVBAoMDURlbm5pbmdlci5uZXQxIjAgBgNVBAMMGURlbm5pbmdl ci5OZXQgU2lnbmluZyBJbnQwHhcNMjQwNTEwMTkyNjU5WhcNMjkwNTA5MTkyNjU5WjBXMQsw CQYDVQQGEwJVUzESMBAGA1UECAwJVGVubmVzc2VlMRcwFQYDVQQKDA5LYXJsIERlbm5pbmdl cjEbMBkGA1UEAwwSa2FybEBkZW5uaW5nZXIubmV0MIICIjANBgkqhkiG9w0BAQEFAAOCAg8A MIICCgKCAgEAvh1UssVbSYctzobPjwBkbjv/w4WvQNepeRTwE6+sLnXvc41+X9pa5EclPL4Q l02Vu1m71mSqXGfK9HbWZoivbhefBHOoYb35MSc24PelhwcORbpneWoWc7giQ7QgFlvEe/yj fs8M0H9fgdzFS5m2lwBQbis8kioSjHB2yt/8I1GE4Mvt1Cur9kga6ML5FAQvo8TYN1stdhrE 13FEv/BWCF4FVT4H2Wa2ySW+R1jkKb74SC6Twg98bGCRTShD5bVylh0+0LXNhzaopIDcI/KK jm/j3mRjIlmqbGrSpvJsbjjhjhAYQKE1U8FB5TDU4OkFAibblhQit/KjgspPR2o/vOpVFPER uhZEV1oDGzUJtZlkREIcN2sYBi0p7Y4585ya+b7L10mEenPlyi3eSkGXEuiy/BR2DY6lShwW DPoQ5602TKmttCSwBdWGoLrQ4jEVEVNt4lku2wPbTHF3KpHJU0g7RbcWoUYn10SOxKathkir hF3v9U32+QhPELGwqRrH0sL9rWf0qalRtPDHUYl8TebZmYkFqNeSMlqHijl5f4SsQPSj7gx5 4F19Ntm9ZcvuWTmW8QQGWTKHeMuG+BYkVIUSPe6/ZQsbD/xDx7rkyGfNgWIa4W7Wm/B7kaNq H53tk3wFmNgZQOxMTPF0oTHfW0T2azU6JD0D1AlgoAnSAE0CAwEAAaOCAaYwggGiMDoGCCsG AQUFBwEBBC4wLDAqBggrBgEFBQcwAYYeaHR0cDovL29jc3AuZGVubmluZ2VyLm5ldDo3Nzc3 MAwGA1UdEwEB/wQCMAAwDgYDVR0PAQH/BAQDAgXgMB0GA1UdJQQWMBQGCCsGAQUFBwMCBggr BgEFBQcDBDAzBglghkgBhvhCAQ0EJhYkT3BlblNTTCBHZW5lcmF0ZWQgQ2xpZW50IENlcnRp ZmljYXRlMB0GA1UdDgQWBBSxJZjVnlYLAT3uzvDYgc4742J6UTCBswYDVR0jBIGrMIGogBQf 5W7FeEHFokBCu8N6TCQf3WEGLqF6pHgwdjELMAkGA1UEBhMCVVMxEjAQBgNVBAgMCVRlbm5l c3NlZTEWMBQGA1UECgwNRGVubmluZ2VyLk5ldDEXMBUGA1UEAwwORGVubmluZ2VyIFJvb3Qx IjAgBgkqhkiG9w0BCQEWE2FkbWluQGRlbm5pbmdlci5uZXSCFFlTx0p0yd5EjVWrmS/STnhD mtC4MB0GA1UdEQQWMBSBEmthcmxAZGVubmluZ2VyLm5ldDANBgkqhkiG9w0BAQsFAAOCAQEA TrQ45/tBN3SiuqItFv/V+CF3h7Hxe0YLsL+A/P+q9ZhxIscaNjaclgQhPA+rUr+l8DGoXJ/w yAl1E0SSBK+9phIc/9xFOBg3rCy4ngubzP+lHS1t03nMCBSUNsu5qPzqLBPiKaPabUu3Gr9o koRezSszgM3/zNJfr8cMO93csCK/fBccsMx5q+3nxB5XeT7UciicjfEzUA4m2mQxBmGk9SSU 147Gy8UmdSq57Tw82KqUrQ1pJ6IOzVPLREpwlqGbHykSU3MwtPYPtfQeFVjvO/XcWvoFQjbV UyhzAqMMYFudxoVLlJQiAgU38OScTLDgKxCO41h7VOjb2mss0zHndzGCBZUwggWRAgEBMHQw XTELMAkGA1UEBhMCVVMxEjAQBgNVBAgMCVRlbm5lc3NlZTEWMBQGA1UECgwNRGVubmluZ2Vy Lm5ldDEiMCAGA1UEAwwZRGVubmluZ2VyLk5ldCBTaWduaW5nIEludAITAJjRbQoghd4/hcEC 2LQU5ho85DANBglghkgBZQMEAgMFAKCCAvIwGAYJKoZIhvcNAQkDMQsGCSqGSIb3DQEHATAc BgkqhkiG9w0BCQUxDxcNMjUwNjI2MTEzNTIyWjBPBgkqhkiG9w0BCQQxQgRAs6+yoz+rNwC9 gAnZLyAHVKqWTa4nI9Z/JzN2fw6IW+PhrBXpnzEkvkfHBULxSrRBAFmW1jJlBczvdPfgaiI2 wTCBgwYJKwYBBAGCNxAEMXYwdDBdMQswCQYDVQQGEwJVUzESMBAGA1UECAwJVGVubmVzc2Vl MRYwFAYDVQQKDA1EZW5uaW5nZXIubmV0MSIwIAYDVQQDDBlEZW5uaW5nZXIuTmV0IFNpZ25p bmcgSW50AhMAmNFtCiCF3j+FwQLYtBTmGjzkMIGFBgsqhkiG9w0BCRACCzF2oHQwXTELMAkG A1UEBhMCVVMxEjAQBgNVBAgMCVRlbm5lc3NlZTEWMBQGA1UECgwNRGVubmluZ2VyLm5ldDEi MCAGA1UEAwwZRGVubmluZ2VyLk5ldCBTaWduaW5nIEludAITAJjRbQoghd4/hcEC2LQU5ho8 5DCCAVcGCSqGSIb3DQEJDzGCAUgwggFEMAsGCWCGSAFlAwQBKjALBglghkgBZQMEAQIwCgYI KoZIhvcNAwcwDQYIKoZIhvcNAwICAQUwDQYIKoZIhvcNAwICAQUwBwYFKw4DAgcwDQYIKoZI hvcNAwICAQUwBwYFKw4DAhowCwYJYIZIAWUDBAIBMAsGCWCGSAFlAwQCAjALBglghkgBZQME AgMwCwYJYIZIAWUDBAIEMAsGCWCGSAFlAwQCBzALBglghkgBZQMEAggwCwYJYIZIAWUDBAIJ MAsGCWCGSAFlAwQCCjALBgkqhkiG9w0BAQEwCwYJK4EFEIZIPwACMAgGBiuBBAELADAIBgYr gQQBCwEwCAYGK4EEAQsCMAgGBiuBBAELAzALBgkrgQUQhkg/AAMwCAYGK4EEAQ4AMAgGBiuB BAEOATAIBgYrgQQBDgIwCAYGK4EEAQ4DMA0GCSqGSIb3DQEBAQUABIICAC218vcGeRszrKGc 0hdGbxs2rTQU0XRsfg/MvD/VNsHUtq6lAuBj3f3/X5v/aHdyfx18Y4B0RtiStuFRourAKQqK ntfBUlUSvLTHB//h1pcsYXypoDeHgC4/QhWSOcPeMGUO98Bk+lAtSSf19fwaSy0Nb0wLARRG wxabZe4ofecNcO3mSEg6oYowvSfluahmbKSX1qIV1tJXWUAyNcGMplaWnrMShHHNqvrBXZzd GINHefYing0cF0+Dfp0h6srYqcLQkwsJDWsFTTRPMFbnhfwhJeePnNKjX9O9k6J+oSOAjsoL +z31oV2wnXMhXYaH6XSXkJCTCYdTQOCPksrqLcp0kbJFmlgx8Gh3z7+zQ3cSQWVwvwaJ0Uue 87bye2acGXzNnbyQh52k+QQVp2z4gy/52qb9yB1LAsjhxO4z0qu4KcpDYrXAa3rqZRbDHRQQ I56xs2BoMEQztzxZgxn+B+wr34/m8dXsBk3KjcPT6l1XuNH/I6goPpStrvzEdNhD+xQMG5yT kA+VUGJIcyhsJNBo8x96/AmDNo8ehGKn+LkSFpM+2H0guhtCNl77PpUApRtSShstHLss486l URT/J4dFNwR7wmg2d5SypHcE8v3Tk9k4Mm/SKTI9ZyOXbQSrquLw+lCYsO9SAzWWp0ho+dNN txlPntYilqM/jPplTcDuAAAAAAAA --------------ms060909010202020902080702-- From nobody Fri Jun 27 02:17:18 2025 X-Original-To: freebsd-net@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4bSzhy455kz606dc for ; Fri, 27 Jun 2025 02:17:22 +0000 (UTC) (envelope-from ben@benhutton.com.au) Received: from mail.myuniquemail.com (mail.myuniquemail.com [115.70.107.139]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4bSzhx4tHWz3HB2 for ; Fri, 27 Jun 2025 02:17:21 +0000 (UTC) (envelope-from ben@benhutton.com.au) Authentication-Results: mx1.freebsd.org; dkim=none; spf=pass (mx1.freebsd.org: domain of ben@benhutton.com.au designates 115.70.107.139 as permitted sender) smtp.mailfrom=ben@benhutton.com.au; dmarc=pass (policy=reject) header.from=benhutton.com.au Received: from [10.128.2.107] (unknown [10.128.10.1]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature ECDSA (prime256v1) server-digest SHA256) (No client certificate requested) by mail.myuniquemail.com (Postfix) with ESMTPSA id D80D81CC614 for ; Fri, 27 Jun 2025 10:17:18 +0800 (AWST) Content-Type: multipart/alternative; boundary="------------D0LyLSPxwh5Dk0Azmz1vag8f" Message-ID: <8255b0b9-c9df-4af9-bbb2-94140edf189c@benhutton.com.au> Date: Fri, 27 Jun 2025 10:17:18 +0800 List-Id: Networking and TCP/IP with FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-net List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-net@FreeBSD.org MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Content-Language: en-US To: freebsd-net@freebsd.org From: Ben Hutton Subject: Network Tuning - mbuf X-Spamd-Result: default: False [0.20 / 15.00]; NEURAL_SPAM_LONG(1.00)[1.000]; NEURAL_HAM_SHORT(-1.00)[-1.000]; NEURAL_SPAM_MEDIUM(1.00)[1.000]; DMARC_POLICY_ALLOW(-0.50)[benhutton.com.au,reject]; R_SPF_ALLOW(-0.20)[+mx:c]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; ARC_NA(0.00)[]; RCVD_COUNT_ONE(0.00)[1]; RCVD_VIA_SMTP_AUTH(0.00)[]; ASN(0.00)[asn:10143, ipnet:115.70.104.0/21, country:AU]; MIME_TRACE(0.00)[0:+,1:+,2:~]; FREEFALL_USER(0.00)[ben]; R_DKIM_NA(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; FROM_EQ_ENVFROM(0.00)[]; FROM_HAS_DN(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; TO_DN_NONE(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-net@freebsd.org]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MLMMJ_DEST(0.00)[freebsd-net@freebsd.org]; RCVD_TLS_ALL(0.00)[] X-Rspamd-Queue-Id: 4bSzhx4tHWz3HB2 X-Spamd-Bar: / This is a multi-part message in MIME format. --------------D0LyLSPxwh5Dk0Azmz1vag8f Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit Hi, I'm currently having an issue with a spring-boot application (with nginx  in front on the same instance) running on FreeBSD 14.1 in AWS. Two of our instances at present have had the application go offline with the following appearing in the /var/log/messages: Jun 26 07:57:47 freebsd kernel: [zone: mbuf_jumbo_page] kern.ipc.nmbjumbop limit reached Jun 26 07:57:47 freebsd kernel: [zone: mbuf_cluster] kern.ipc.nmbclusters limit reached Jun 26 07:59:34 freebsd kernel: sonewconn: pcb 0xfffff8021bd74000 (0.0.0.0:443 (proto 6)): Listen queue overflow: 193 already in queue awaiting acceptance (104 occurrences), euid 0, rgid 0, jail 0 Jun 26 08:01:51 freebsd kernel: sonewconn: pcb 0xfffff8021bd74000 (0.0.0.0:443 (proto 6)): Listen queue overflow: 193 already in queue awaiting acceptance (13 occurrences), euid 0, rgid 0, jail 0 Each time this has occurred I have increased the nmbjumbop and nmbclusters values. The last time by a huge amount to see if we can mitigate the issue. Once I adjust the values the application starts responding to requests again. My question is, is just increasing this the correct course of action or should I be investigating something else, or adjusting other settings accordingly? Also if this is due to an underlying issue and not just network load how would I get to the root cause? Note the application streams allot of files in rapid succession which I'm suspecting is what is causing the issue. Thanks Ben --------------D0LyLSPxwh5Dk0Azmz1vag8f Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: 8bit

Hi,

I'm currently having an issue with a spring-boot application (with nginx  in front on the same instance) running on FreeBSD 14.1 in AWS. Two of our instances at present have had the application go offline with the following appearing in the /var/log/messages:

Jun 26 07:57:47 freebsd kernel: [zone: mbuf_jumbo_page] kern.ipc.nmbjumbop limit reached
Jun 26 07:57:47 freebsd kernel: [zone: mbuf_cluster] kern.ipc.nmbclusters limit reached
Jun 26 07:59:34 freebsd kernel: sonewconn: pcb 0xfffff8021bd74000 (0.0.0.0:443 (proto 6)): Listen queue overflow: 193 already in queue awaiting acceptance (104 occurrences), euid 0, rgid 0, jail 0
Jun 26 08:01:51 freebsd kernel: sonewconn: pcb 0xfffff8021bd74000 (0.0.0.0:443 (proto 6)): Listen queue overflow: 193 already in queue awaiting acceptance (13 occurrences), euid 0, rgid 0, jail 0

Each time this has occurred I have increased the nmbjumbop and nmbclusters values. The last time by a huge amount to see if we can mitigate the issue. Once I adjust the values the application starts responding to requests again.

My question is, is just increasing this the correct course of action or should I be investigating something else, or adjusting other settings accordingly? Also if this is due to an underlying issue and not just network load how would I get to the root cause? Note the application streams allot of files in rapid succession which I'm suspecting is what is causing the issue.

Thanks
Ben


--------------D0LyLSPxwh5Dk0Azmz1vag8f-- From nobody Fri Jun 27 04:52:41 2025 X-Original-To: freebsd-net@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4bT38F2gPkz60GRY for ; Fri, 27 Jun 2025 04:52:45 +0000 (UTC) (envelope-from michael.tuexen@lurchi.franken.de) Received: from drew.franken.de (mail-n.franken.de [193.175.24.27]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "*.franken.de", Issuer "Certum Domain Validation CA SHA2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4bT38F0Cl1z3jXV for ; Fri, 27 Jun 2025 04:52:44 +0000 (UTC) (envelope-from michael.tuexen@lurchi.franken.de) Authentication-Results: mx1.freebsd.org; none Received: from smtpclient.apple (unknown [IPv6:2a02:8109:1101:be00:d0b3:38f6:4cb8:9551]) (Authenticated sender: lurchi) by mail-n.franken.de (Postfix) with ESMTPSA id 626A0721BE006; Fri, 27 Jun 2025 06:52:42 +0200 (CEST) Content-Type: text/plain; charset=us-ascii List-Id: Networking and TCP/IP with FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-net List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-net@FreeBSD.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3826.600.51.1.1\)) Subject: Re: Network Tuning - mbuf From: Michael Tuexen In-Reply-To: <8255b0b9-c9df-4af9-bbb2-94140edf189c@benhutton.com.au> Date: Fri, 27 Jun 2025 06:52:41 +0200 Cc: freebsd-net@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: <1B2AEE29-C71B-4EF7-9DDC-F45A13B0DC5F@lurchi.franken.de> References: <8255b0b9-c9df-4af9-bbb2-94140edf189c@benhutton.com.au> To: Ben Hutton X-Mailer: Apple Mail (2.3826.600.51.1.1) X-Rspamd-Queue-Id: 4bT38F0Cl1z3jXV X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:680, ipnet:193.174.0.0/15, country:DE] > On 27. Jun 2025, at 04:17, Ben Hutton wrote: >=20 > Hi, > I'm currently having an issue with a spring-boot application (with = nginx in front on the same instance) running on FreeBSD 14.1 in AWS. = Two of our instances at present have had the application go offline with = the following appearing in the /var/log/messages: > Jun 26 07:57:47 freebsd kernel: [zone: mbuf_jumbo_page] = kern.ipc.nmbjumbop limit reached=20 > Jun 26 07:57:47 freebsd kernel: [zone: mbuf_cluster] = kern.ipc.nmbclusters limit reached=20 > Jun 26 07:59:34 freebsd kernel: sonewconn: pcb 0xfffff8021bd74000 = (0.0.0.0:443 (proto 6)): Listen queue overflow: 193 already in queue = awaiting acceptance (104 occurrences), euid 0, rgid 0, jail 0=20 > Jun 26 08:01:51 freebsd kernel: sonewconn: pcb 0xfffff8021bd74000 = (0.0.0.0:443 (proto 6)): Listen queue overflow: 193 already in queue = awaiting acceptance (13 occurrences), euid 0, rgid 0, jail 0 >=20 > Each time this has occurred I have increased the nmbjumbop and = nmbclusters values. The last time by a huge amount to see if we can = mitigate the issue. Once I adjust the values the application starts = responding to requests again. > My question is, is just increasing this the correct course of action = or should I be investigating something else, or adjusting other settings = accordingly? Also if this is due to an underlying issue and not just = network load how would I get to the root cause? Note the application = streams allot of files in rapid succession which I'm suspecting is what = is causing the issue. Hi Ben, how much memory does your VM have? What is the output of netstat -m when the system is in operation? Best regards Michael > Thanks > Ben >=20 From nobody Fri Jun 27 05:53:02 2025 X-Original-To: freebsd-net@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4bT4Tw65vbz60KSy for ; Fri, 27 Jun 2025 05:53:08 +0000 (UTC) (envelope-from ben@benhutton.com.au) Received: from mail.myuniquemail.com (mail.myuniquemail.com [115.70.107.139]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4bT4Tv6HRtz3KP3 for ; Fri, 27 Jun 2025 05:53:07 +0000 (UTC) (envelope-from ben@benhutton.com.au) Authentication-Results: mx1.freebsd.org; none Received: from [10.128.2.107] (unknown [10.128.10.1]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature ECDSA (prime256v1) server-digest SHA256) (No client certificate requested) by mail.myuniquemail.com (Postfix) with ESMTPSA id 10E2B1F9B34; Fri, 27 Jun 2025 13:53:03 +0800 (AWST) Content-Type: multipart/alternative; boundary="------------l50OztuS80EnHgmo2Y705YJE" Message-ID: <9fe64741-9f42-4e7e-9671-345221676136@benhutton.com.au> Date: Fri, 27 Jun 2025 13:53:02 +0800 List-Id: Networking and TCP/IP with FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-net List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-net@FreeBSD.org MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Subject: Re: Network Tuning - mbuf To: Michael Tuexen Cc: freebsd-net@freebsd.org References: <8255b0b9-c9df-4af9-bbb2-94140edf189c@benhutton.com.au> <1B2AEE29-C71B-4EF7-9DDC-F45A13B0DC5F@lurchi.franken.de> Content-Language: en-US From: Ben Hutton In-Reply-To: <1B2AEE29-C71B-4EF7-9DDC-F45A13B0DC5F@lurchi.franken.de> X-Rspamd-Queue-Id: 4bT4Tv6HRtz3KP3 X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:10143, ipnet:115.70.104.0/21, country:AU] This is a multi-part message in MIME format. --------------l50OztuS80EnHgmo2Y705YJE Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit Hi Michael, 8G $ netstat -m 1590074/4231/1594305 mbufs in use (current/cache/total) 797974/2592/800566/1800796 mbuf clusters in use (current/cache/total/max) 797974/790 mbuf+clusters out of packet secondary zone in use (current/cache) 644657/1542/646199/1550398 4k (page size) jumbo clusters in use (current/cache/total/max) 0/0/0/74192 9k jumbo clusters in use (current/cache/total/max) 0/0/0/41733 16k jumbo clusters in use (current/cache/total/max) 4572094K/12409K/4584504K bytes allocated to network (current/cache/total) 0/8507/8489 requests for mbufs denied (mbufs/clusters/mbuf+clusters) 0/30432/0 requests for mbufs delayed (mbufs/clusters/mbuf+clusters) 0/0/0 requests for jumbo clusters delayed (4k/9k/16k) 485354407/0/0 requests for jumbo clusters denied (4k/9k/16k) 2 sendfile syscalls 2 sendfile syscalls completed without I/O request 0 requests for I/O initiated by sendfile 0 pages read by sendfile as part of a request 2 pages were valid at time of a sendfile request 0 pages were valid and substituted to bogus page 0 pages were requested for read ahead by applications 0 pages were read ahead by sendfile 0 times sendfile encountered an already busy page 0 requests for sfbufs denied 0 requests for sfbufs delayed Kind regards Ben On 27/06/2025 12:52, Michael Tuexen wrote: >> On 27. Jun 2025, at 04:17, Ben Hutton wrote: >> >> Hi, >> I'm currently having an issue with a spring-boot application (with nginx in front on the same instance) running on FreeBSD 14.1 in AWS. Two of our instances at present have had the application go offline with the following appearing in the /var/log/messages: >> Jun 26 07:57:47 freebsd kernel: [zone: mbuf_jumbo_page] kern.ipc.nmbjumbop limit reached >> Jun 26 07:57:47 freebsd kernel: [zone: mbuf_cluster] kern.ipc.nmbclusters limit reached >> Jun 26 07:59:34 freebsd kernel: sonewconn: pcb 0xfffff8021bd74000 (0.0.0.0:443 (proto 6)): Listen queue overflow: 193 already in queue awaiting acceptance (104 occurrences), euid 0, rgid 0, jail 0 >> Jun 26 08:01:51 freebsd kernel: sonewconn: pcb 0xfffff8021bd74000 (0.0.0.0:443 (proto 6)): Listen queue overflow: 193 already in queue awaiting acceptance (13 occurrences), euid 0, rgid 0, jail 0 >> >> Each time this has occurred I have increased the nmbjumbop and nmbclusters values. The last time by a huge amount to see if we can mitigate the issue. Once I adjust the values the application starts responding to requests again. >> My question is, is just increasing this the correct course of action or should I be investigating something else, or adjusting other settings accordingly? Also if this is due to an underlying issue and not just network load how would I get to the root cause? Note the application streams allot of files in rapid succession which I'm suspecting is what is causing the issue. > Hi Ben, > > how much memory does your VM have? What is the output of > netstat -m > when the system is in operation? > > Best regards > Michael >> Thanks >> Ben >> --------------l50OztuS80EnHgmo2Y705YJE Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: 7bit

Hi Michael,

8G

$ netstat -m
1590074/4231/1594305 mbufs in use (current/cache/total)
797974/2592/800566/1800796 mbuf clusters in use (current/cache/total/max)
797974/790 mbuf+clusters out of packet secondary zone in use (current/cache)
644657/1542/646199/1550398 4k (page size) jumbo clusters in use (current/cache/total/max)
0/0/0/74192 9k jumbo clusters in use (current/cache/total/max)
0/0/0/41733 16k jumbo clusters in use (current/cache/total/max)
4572094K/12409K/4584504K bytes allocated to network (current/cache/total)
0/8507/8489 requests for mbufs denied (mbufs/clusters/mbuf+clusters)
0/30432/0 requests for mbufs delayed (mbufs/clusters/mbuf+clusters)
0/0/0 requests for jumbo clusters delayed (4k/9k/16k)
485354407/0/0 requests for jumbo clusters denied (4k/9k/16k)
2 sendfile syscalls
2 sendfile syscalls completed without I/O request
0 requests for I/O initiated by sendfile
0 pages read by sendfile as part of a request
2 pages were valid at time of a sendfile request
0 pages were valid and substituted to bogus page
0 pages were requested for read ahead by applications
0 pages were read ahead by sendfile
0 times sendfile encountered an already busy page
0 requests for sfbufs denied
0 requests for sfbufs delayed

Kind regards
Ben

On 27/06/2025 12:52, Michael Tuexen wrote:
On 27. Jun 2025, at 04:17, Ben Hutton <ben@benhutton.com.au> wrote:

Hi,
I'm currently having an issue with a spring-boot application (with nginx  in front on the same instance) running on FreeBSD 14.1 in AWS. Two of our instances at present have had the application go offline with the following appearing in the /var/log/messages:
Jun 26 07:57:47 freebsd kernel: [zone: mbuf_jumbo_page] kern.ipc.nmbjumbop limit reached 
Jun 26 07:57:47 freebsd kernel: [zone: mbuf_cluster] kern.ipc.nmbclusters limit reached 
Jun 26 07:59:34 freebsd kernel: sonewconn: pcb 0xfffff8021bd74000 (0.0.0.0:443 (proto 6)): Listen queue overflow: 193 already in queue awaiting acceptance (104 occurrences), euid 0, rgid 0, jail 0 
Jun 26 08:01:51 freebsd kernel: sonewconn: pcb 0xfffff8021bd74000 (0.0.0.0:443 (proto 6)): Listen queue overflow: 193 already in queue awaiting acceptance (13 occurrences), euid 0, rgid 0, jail 0

Each time this has occurred I have increased the nmbjumbop and nmbclusters values. The last time by a huge amount to see if we can mitigate the issue. Once I adjust the values the application starts responding to requests again.
My question is, is just increasing this the correct course of action or should I be investigating something else, or adjusting other settings accordingly? Also if this is due to an underlying issue and not just network load how would I get to the root cause? Note the application streams allot of files in rapid succession which I'm suspecting is what is causing the issue.

Hi Ben,

how much memory does your VM have? What is the output of
netstat -m
when the system is in operation?

Best regards
Michael

Thanks
Ben



    

  


--------------l50OztuS80EnHgmo2Y705YJE--

From nobody Fri Jun 27 08:38:18 2025
X-Original-To: freebsd-net@mlmmj.nyi.freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1])
	by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4bT88j0wqYz60Tjb
	for ; Fri, 27 Jun 2025 08:38:29 +0000 (UTC)
	(envelope-from michael.tuexen@lurchi.franken.de)
Received: from drew.franken.de (drew.ipv6.franken.de [IPv6:2001:638:a02:a001:20e:cff:fe4a:feaa])
	(using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits))
	(Client CN "*.franken.de", Issuer "Certum Domain Validation CA SHA2" (verified OK))
	by mx1.freebsd.org (Postfix) with ESMTPS id 4bT88h3HXnz3KMp
	for ; Fri, 27 Jun 2025 08:38:28 +0000 (UTC)
	(envelope-from michael.tuexen@lurchi.franken.de)
Authentication-Results: mx1.freebsd.org;
	none
Received: from smtpclient.apple (unknown [IPv6:2a02:8109:1101:be00:d0b3:38f6:4cb8:9551])
	(Authenticated sender: lurchi)
	by mail-n.franken.de (Postfix) with ESMTPSA id E4CC5721BE006;
	Fri, 27 Jun 2025 10:38:18 +0200 (CEST)
Content-Type: text/plain;
	charset=us-ascii
List-Id: Networking and TCP/IP with FreeBSD 
List-Archive: https://lists.freebsd.org/archives/freebsd-net
List-Help: 
List-Post: 
List-Subscribe: 
List-Unsubscribe: 
Sender: owner-freebsd-net@FreeBSD.org
Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3826.600.51.1.1\))
Subject: Re: Network Tuning - mbuf
From: Michael Tuexen 
In-Reply-To: <9fe64741-9f42-4e7e-9671-345221676136@benhutton.com.au>
Date: Fri, 27 Jun 2025 10:38:18 +0200
Cc: freebsd-net@freebsd.org
Content-Transfer-Encoding: quoted-printable
Message-Id: <3964B087-54A2-4ABD-B69E-F93DDFF763C7@lurchi.franken.de>
References: <8255b0b9-c9df-4af9-bbb2-94140edf189c@benhutton.com.au>
 <1B2AEE29-C71B-4EF7-9DDC-F45A13B0DC5F@lurchi.franken.de>
 <9fe64741-9f42-4e7e-9671-345221676136@benhutton.com.au>
To: Ben Hutton 
X-Mailer: Apple Mail (2.3826.600.51.1.1)
X-Rspamd-Queue-Id: 4bT88h3HXnz3KMp
X-Spamd-Bar: ----
X-Rspamd-Pre-Result: action=no action;
	module=replies;
	Message is reply to one we originated
X-Spamd-Result: default: False [-4.00 / 15.00];
	REPLY(-4.00)[];
	ASN(0.00)[asn:680, ipnet:2001:638::/32, country:DE]

> On 27. Jun 2025, at 07:53, Ben Hutton  wrote:
>=20
> Hi Michael,
> 8G
> $ netstat -m=20
> 1590074/4231/1594305 mbufs in use (current/cache/total)=20
> 797974/2592/800566/1800796 mbuf clusters in use =
(current/cache/total/max)=20
> 797974/790 mbuf+clusters out of packet secondary zone in use =
(current/cache)=20
> 644657/1542/646199/1550398 4k (page size) jumbo clusters in use =
(current/cache/total/max)=20
> 0/0/0/74192 9k jumbo clusters in use (current/cache/total/max)=20
> 0/0/0/41733 16k jumbo clusters in use (current/cache/total/max)=20
> 4572094K/12409K/4584504K bytes allocated to network =
(current/cache/total)=20
> 0/8507/8489 requests for mbufs denied (mbufs/clusters/mbuf+clusters)=20=

> 0/30432/0 requests for mbufs delayed (mbufs/clusters/mbuf+clusters)=20
> 0/0/0 requests for jumbo clusters delayed (4k/9k/16k)=20
> 485354407/0/0 requests for jumbo clusters denied (4k/9k/16k)=20
> 2 sendfile syscalls=20
> 2 sendfile syscalls completed without I/O request=20
> 0 requests for I/O initiated by sendfile=20
> 0 pages read by sendfile as part of a request=20
> 2 pages were valid at time of a sendfile request=20
> 0 pages were valid and substituted to bogus page=20
> 0 pages were requested for read ahead by applications=20
> 0 pages were read ahead by sendfile=20
> 0 times sendfile encountered an already busy page=20
> 0 requests for sfbufs denied=20
> 0 requests for sfbufs delayed

OK. You can use netstat -x to figure out how the occupancy of the send
and receive buffers for TCP connections is. The output contain the IP
addresses of your current connections. So you might not want to post
it here. But you can remove the IP addresses from it and send it to =
me...

Best regards
Michael
> Kind regards
> Ben
> On 27/06/2025 12:52, Michael Tuexen wrote:
>>> On 27. Jun 2025, at 04:17, Ben Hutton  wrote:
>>>=20
>>> Hi,
>>> I'm currently having an issue with a spring-boot application (with =
nginx in front on the same instance) running on FreeBSD 14.1 in AWS. Two =
of our instances at present have had the application go offline with the =
following appearing in the /var/log/messages:
>>> Jun 26 07:57:47 freebsd kernel: [zone: mbuf_jumbo_page] =
kern.ipc.nmbjumbop limit reached=20
>>> Jun 26 07:57:47 freebsd kernel: [zone: mbuf_cluster] =
kern.ipc.nmbclusters limit reached=20
>>> Jun 26 07:59:34 freebsd kernel: sonewconn: pcb 0xfffff8021bd74000 =
(0.0.0.0:443 (proto 6)): Listen queue overflow: 193 already in queue =
awaiting acceptance (104 occurrences), euid 0, rgid 0, jail 0=20
>>> Jun 26 08:01:51 freebsd kernel: sonewconn: pcb 0xfffff8021bd74000 =
(0.0.0.0:443 (proto 6)): Listen queue overflow: 193 already in queue =
awaiting acceptance (13 occurrences), euid 0, rgid 0, jail 0
>>>=20
>>> Each time this has occurred I have increased the nmbjumbop and =
nmbclusters values. The last time by a huge amount to see if we can =
mitigate the issue. Once I adjust the values the application starts =
responding to requests again.
>>> My question is, is just increasing this the correct course of action =
or should I be investigating something else, or adjusting other settings =
accordingly? Also if this is due to an underlying issue and not just =
network load how would I get to the root cause? Note the application =
streams allot of files in rapid succession which I'm suspecting is what =
is causing the issue.
>>>=20
>> Hi Ben,
>>=20
>> how much memory does your VM have? What is the output of
>> netstat -m
>> when the system is in operation?
>>=20
>> Best regards
>> Michael
>>=20
>>> Thanks
>>> Ben
>>>=20
>>>=20
>>=20


From nobody Fri Jun 27 10:07:52 2025
X-Original-To: freebsd-net@mlmmj.nyi.freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1])
	by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4bTB7y6PsMz5yZYT
	for ; Fri, 27 Jun 2025 10:07:58 +0000 (UTC)
	(envelope-from ben@benhutton.com.au)
Received: from mail.myuniquemail.com (mail.myuniquemail.com [115.70.107.139])
	(using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)
	 key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256)
	(Client did not present a certificate)
	by mx1.freebsd.org (Postfix) with ESMTPS id 4bTB7y1ZSHz3vHn
	for ; Fri, 27 Jun 2025 10:07:57 +0000 (UTC)
	(envelope-from ben@benhutton.com.au)
Authentication-Results: mx1.freebsd.org;
	none
Received: from [10.128.2.107] (unknown [10.128.10.1])
	(using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits)
	 key-exchange X25519 server-signature ECDSA (prime256v1) server-digest SHA256)
	(No client certificate requested)
	by mail.myuniquemail.com (Postfix) with ESMTPSA id 781A11F2203;
	Fri, 27 Jun 2025 18:07:53 +0800 (AWST)
Message-ID: <908250f5-c85d-4bb1-a576-07e5b369aad6@benhutton.com.au>
Date: Fri, 27 Jun 2025 18:07:52 +0800
List-Id: Networking and TCP/IP with FreeBSD 
List-Archive: https://lists.freebsd.org/archives/freebsd-net
List-Help: 
List-Post: 
List-Subscribe: 
List-Unsubscribe: 
Sender: owner-freebsd-net@FreeBSD.org
MIME-Version: 1.0
User-Agent: Mozilla Thunderbird
Subject: Re: Network Tuning - mbuf
To: Michael Tuexen 
Cc: freebsd-net@freebsd.org
References: <8255b0b9-c9df-4af9-bbb2-94140edf189c@benhutton.com.au>
 <1B2AEE29-C71B-4EF7-9DDC-F45A13B0DC5F@lurchi.franken.de>
 <9fe64741-9f42-4e7e-9671-345221676136@benhutton.com.au>
 <3964B087-54A2-4ABD-B69E-F93DDFF763C7@lurchi.franken.de>
Content-Language: en-US
From: Ben Hutton 
In-Reply-To: <3964B087-54A2-4ABD-B69E-F93DDFF763C7@lurchi.franken.de>
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 7bit
X-Rspamd-Queue-Id: 4bTB7y1ZSHz3vHn
X-Spamd-Bar: ----
X-Rspamd-Pre-Result: action=no action;
	module=replies;
	Message is reply to one we originated
X-Spamd-Result: default: False [-4.00 / 15.00];
	REPLY(-4.00)[];
	ASN(0.00)[asn:10143, ipnet:115.70.104.0/21, country:AU]

Thanks I'll look into that.

Might take a couple of days to get some worthwhile data and to sanitise it.

Kind regards
Ben

On 27/06/2025 16:38, Michael Tuexen wrote:
>> On 27. Jun 2025, at 07:53, Ben Hutton  wrote:
>>
>> Hi Michael,
>> 8G
>> $ netstat -m
>> 1590074/4231/1594305 mbufs in use (current/cache/total)
>> 797974/2592/800566/1800796 mbuf clusters in use (current/cache/total/max)
>> 797974/790 mbuf+clusters out of packet secondary zone in use (current/cache)
>> 644657/1542/646199/1550398 4k (page size) jumbo clusters in use (current/cache/total/max)
>> 0/0/0/74192 9k jumbo clusters in use (current/cache/total/max)
>> 0/0/0/41733 16k jumbo clusters in use (current/cache/total/max)
>> 4572094K/12409K/4584504K bytes allocated to network (current/cache/total)
>> 0/8507/8489 requests for mbufs denied (mbufs/clusters/mbuf+clusters)
>> 0/30432/0 requests for mbufs delayed (mbufs/clusters/mbuf+clusters)
>> 0/0/0 requests for jumbo clusters delayed (4k/9k/16k)
>> 485354407/0/0 requests for jumbo clusters denied (4k/9k/16k)
>> 2 sendfile syscalls
>> 2 sendfile syscalls completed without I/O request
>> 0 requests for I/O initiated by sendfile
>> 0 pages read by sendfile as part of a request
>> 2 pages were valid at time of a sendfile request
>> 0 pages were valid and substituted to bogus page
>> 0 pages were requested for read ahead by applications
>> 0 pages were read ahead by sendfile
>> 0 times sendfile encountered an already busy page
>> 0 requests for sfbufs denied
>> 0 requests for sfbufs delayed
> OK. You can use netstat -x to figure out how the occupancy of the send
> and receive buffers for TCP connections is. The output contain the IP
> addresses of your current connections. So you might not want to post
> it here. But you can remove the IP addresses from it and send it to me...
>
> Best regards
> Michael
>> Kind regards
>> Ben
>> On 27/06/2025 12:52, Michael Tuexen wrote:
>>>> On 27. Jun 2025, at 04:17, Ben Hutton  wrote:
>>>>
>>>> Hi,
>>>> I'm currently having an issue with a spring-boot application (with nginx in front on the same instance) running on FreeBSD 14.1 in AWS. Two of our instances at present have had the application go offline with the following appearing in the /var/log/messages:
>>>> Jun 26 07:57:47 freebsd kernel: [zone: mbuf_jumbo_page] kern.ipc.nmbjumbop limit reached
>>>> Jun 26 07:57:47 freebsd kernel: [zone: mbuf_cluster] kern.ipc.nmbclusters limit reached
>>>> Jun 26 07:59:34 freebsd kernel: sonewconn: pcb 0xfffff8021bd74000 (0.0.0.0:443 (proto 6)): Listen queue overflow: 193 already in queue awaiting acceptance (104 occurrences), euid 0, rgid 0, jail 0
>>>> Jun 26 08:01:51 freebsd kernel: sonewconn: pcb 0xfffff8021bd74000 (0.0.0.0:443 (proto 6)): Listen queue overflow: 193 already in queue awaiting acceptance (13 occurrences), euid 0, rgid 0, jail 0
>>>>
>>>> Each time this has occurred I have increased the nmbjumbop and nmbclusters values. The last time by a huge amount to see if we can mitigate the issue. Once I adjust the values the application starts responding to requests again.
>>>> My question is, is just increasing this the correct course of action or should I be investigating something else, or adjusting other settings accordingly? Also if this is due to an underlying issue and not just network load how would I get to the root cause? Note the application streams allot of files in rapid succession which I'm suspecting is what is causing the issue.
>>>>
>>> Hi Ben,
>>>
>>> how much memory does your VM have? What is the output of
>>> netstat -m
>>> when the system is in operation?
>>>
>>> Best regards
>>> Michael
>>>
>>>> Thanks
>>>> Ben
>>>>
>>>>

From nobody Sat Jun 28 10:33:15 2025
X-Original-To: net@mlmmj.nyi.freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1])
	by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4bTpfk1kCPz5yrMQ
	for ; Sat, 28 Jun 2025 10:33:18 +0000 (UTC)
	(envelope-from bugzilla-noreply@freebsd.org)
Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3])
	(using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)
	 key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256
	 client-signature RSA-PSS (4096 bits) client-digest SHA256)
	(Client CN "mxrelay.nyi.freebsd.org", Issuer "R10" (verified OK))
	by mx1.freebsd.org (Postfix) with ESMTPS id 4bTpfj6bCHz3v16
	for ; Sat, 28 Jun 2025 10:33:17 +0000 (UTC)
	(envelope-from bugzilla-noreply@freebsd.org)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim;
	t=1751106797;
	h=from:from:reply-to:subject:subject:date:date:message-id:message-id:
	 to:to:cc:mime-version:mime-version:content-type:content-type:
	 content-transfer-encoding:content-transfer-encoding;
	bh=/biUXlGSe01fEarJJrWDOXXY2pBM0tr8xrJXn1R9MOM=;
	b=cIN+gMxn2/ve1VQErRZq5eciVaVoDqfdtq0hWBvRzVGWiZWgOUE5PZGoKygKHGE30mPPUY
	ZKeP8k+2pf9b+HfM+H/w5vtqvaKtsZ9O/hJBXknt0HjDmXunA3OmEBqNvSS99V7OviIwtY
	7wx0k8vKAGYVIRJU7kXQgs/9A6i5oX3tbGSGA1KtoiLF27LI2wHECZOQrSliBYa+ceko1t
	zdsPKOK7K2ZLFTN+p/ijI6QjD8WAwPsKtjqhCS/EqzR2mI+X43gk6jjrNHzB9CpwWdRe1z
	7rCRfNCjQygZw9WT1vvrxxigefGwCYA8myW8pXsrXMR1IFuEUSa/dhTDxy0nxA==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org;
	s=dkim; t=1751106797;
	h=from:from:reply-to:subject:subject:date:date:message-id:message-id:
	 to:to:cc:mime-version:mime-version:content-type:content-type:
	 content-transfer-encoding:content-transfer-encoding;
	bh=/biUXlGSe01fEarJJrWDOXXY2pBM0tr8xrJXn1R9MOM=;
	b=Hqp+KMRkc2Wy6oGUse9PcuT7B2LuIAZ3mU1T4LE4wQG9G6TRWJ7ayAeC1e+FiHB4seSJTQ
	g7/NIiqT+U1BF/Y4j7iVAwXvTXsOnzHrNGcN46WiKH6bJ6CQfVBMFiT4mECZrbuxjcfYVb
	o+wcbA29ojbuN7atA27BN23Bjqb0rfyDNkiEbk43Xk14a6j9gs82YiCsdxTnFigwvBOuIP
	CqZ/ww7qbcFecfBtw794/xkhbkMOnH4LfT0RapMW2RF85yyf/CSRxJEfRHlRb7QtQ6qPjS
	lzjsCpBFGemVGlT5fJjjowP3ppzBFcLSK/MFDKnPql0IvzkuDkqN6WXVCGhF+g==
ARC-Authentication-Results: i=1;
	mx1.freebsd.org;
	none
ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1751106797; a=rsa-sha256; cv=none;
	b=vzJIveL2mEV4XdTkyQoBevcoG5PjlwDkYjOujtJTe53gmj2JJrslvMbaEQv7LOqaKUDeDS
	FBoLAW76mEdgDq55wgHs67wCn6OcWJpdwBbAHsP6Ou2H1r98BDAf4wZwvYGVSrKX9Wzbw9
	u7flFwuSKWnRAFa19Tg/xgnravQLoYz0AU8y3nsPzuqeJjcHYNhiNUNT6s0W++3Hu9+IX6
	QuvH8FZIJItZnf0uF42d+/eMkFzwktnn2CqGTYJ154ajZy61yF2mrZfKlAU7Znwb4U7B9d
	VradE3rhbqQObvURT4Es22aSVaVRbVVtsmkxl/f++UhE2ChyqIKF/trN2nqwYA==
Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d])
	(using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)
	 key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256)
	(Client did not present a certificate)
	by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4bTpfj63bqzTwB
	for ; Sat, 28 Jun 2025 10:33:17 +0000 (UTC)
	(envelope-from bugzilla-noreply@freebsd.org)
Received: from kenobi.freebsd.org ([127.0.1.5])
	by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 55SAXHWF093638
	for ; Sat, 28 Jun 2025 10:33:17 GMT
	(envelope-from bugzilla-noreply@freebsd.org)
Received: (from www@localhost)
	by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 55SAXHh8093637
	for net@FreeBSD.org; Sat, 28 Jun 2025 10:33:17 GMT
	(envelope-from bugzilla-noreply@freebsd.org)
X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f
From: bugzilla-noreply@freebsd.org
To: net@FreeBSD.org
Subject: [Bug 287872] boot time regression related to netlink and devd
Date: Sat, 28 Jun 2025 10:33:15 +0000
X-Bugzilla-Reason: AssignedTo
X-Bugzilla-Type: new
X-Bugzilla-Watch-Reason: None
X-Bugzilla-Product: Base System
X-Bugzilla-Component: kern
X-Bugzilla-Version: 14.3-STABLE
X-Bugzilla-Keywords: 
X-Bugzilla-Severity: Affects Some People
X-Bugzilla-Who: eugen@freebsd.org
X-Bugzilla-Status: New
X-Bugzilla-Resolution: 
X-Bugzilla-Priority: ---
X-Bugzilla-Assigned-To: net@FreeBSD.org
X-Bugzilla-Flags: 
X-Bugzilla-Changed-Fields: bug_id short_desc product version rep_platform
 op_sys bug_status bug_severity priority component assigned_to reporter cc
Message-ID: 
Content-Transfer-Encoding: quoted-printable
Content-Type: text/plain; charset="UTF-8"
X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/
Auto-Submitted: auto-generated
List-Id: Networking and TCP/IP with FreeBSD 
List-Archive: https://lists.freebsd.org/archives/freebsd-net
List-Help: 
List-Post: 
List-Subscribe: 
List-Unsubscribe: 
Sender: owner-freebsd-net@FreeBSD.org
MIME-Version: 1.0

https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D287872

            Bug ID: 287872
           Summary: boot time regression related to netlink and devd
           Product: Base System
           Version: 14.3-STABLE
          Hardware: Any
                OS: Any
            Status: New
          Severity: Affects Some People
          Priority: ---
         Component: kern
          Assignee: net@FreeBSD.org
          Reporter: eugen@freebsd.org
                CC: melifaro@FreeBSD.org

I have an old HP ProLiant DL120 G6 server that ran FreeBSD 13.5-STABLE/amd64
just fine until today I updated it to 14.3-STABLE/amd64 using sources of
stable/14 as of June, 11. The upgrade process went just fine but after rebo=
ot
start of devd took over 17.6 minutes, then system proceeded to boot normally
and now runs just fine. This is UFS2-only system.

CPU: Intel(R) Xeon(R) CPU X3470 @ 2.93GHz (2926.10-MHz K8-class CPU)

Mem: 1716M Active, 2244M Inact, 690M Wired, 326M Buf, 11G Free
Swap: 14G Total, 14G Free

I have a custom rc.d script that starts before devd and creates over 800 vl=
ans
with integrated bge0 interface as a parent.=20

For a test, in multiuser mode I destroy all vlans, stop devd, rerun my scri=
pt
to recreate all vlans and use "service devd start", and the problem reprodu=
ces
and mentioned command takes same long time again.

During that time, "top -SHPz" shows:

  PID USERNAME    PRI NICE   SIZE    RES STATE    C   TIME    WCPU COMMAND
   12 root        -60    -     0B   336K CPU1     1  22:53  97,01% intr{irq=
16:
ehci0 bge0}
    0 root          8    -     0B   720K CPU3     3   0:01   5,27%
kernel{netlink_socket (PID}
    2 root        -60    -     0B    64K WAIT     2   0:12   0,77% clock{cl=
ock
(0)}
15765 root         68    0    21M  7808K wait     1   0:00   0,11% devd

Note, there are less than 200 kilobytes/s of traffic over bge0 meantime. Af=
ter
"service devd start" finishes, the load of "intr{irq16: ehci0 bge0}" drops =
to
about zero.

More details follow.

--=20
You are receiving this mail because:
You are the assignee for the bug.=

From nobody Sat Jun 28 10:36:25 2025
X-Original-To: net@mlmmj.nyi.freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1])
	by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4bTpkN5tHKz5yr15
	for ; Sat, 28 Jun 2025 10:36:28 +0000 (UTC)
	(envelope-from bugzilla-noreply@freebsd.org)
Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3])
	(using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)
	 key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256
	 client-signature RSA-PSS (4096 bits) client-digest SHA256)
	(Client CN "mxrelay.nyi.freebsd.org", Issuer "R10" (verified OK))
	by mx1.freebsd.org (Postfix) with ESMTPS id 4bTpkN2Gqlz3w8l
	for ; Sat, 28 Jun 2025 10:36:28 +0000 (UTC)
	(envelope-from bugzilla-noreply@freebsd.org)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim;
	t=1751106988;
	h=from:from:reply-to:subject:subject:date:date:message-id:message-id:
	 to:to:cc:mime-version:mime-version:content-type:content-type:
	 content-transfer-encoding:content-transfer-encoding:
	 in-reply-to:in-reply-to:references:references;
	bh=gz37RiMTYxtUfREfP6UXKEnvmyXoj0gM+2IGZtntJLs=;
	b=YGHLoYkPC36jwRmMMxhrThH9Dg8ek6ePvSwLVaUUucEim8GVv7I0SlQTvaPKEqRHkbdIdN
	SrfXiD3y1TPQ8WAVZom5+XNLTiOfdC2J1NpLMdHNP9t8QPzm1KFecU60IfWfFNRV5DafF0
	zQWDEO71Jmj22H+JfHKl64kLn27L23cJfd64Uloxb/NrITqRUjWxN2ezsIPBUrYnudwKe1
	Kh0WwzqEZlwyQhUovKnS+ffS7bXveZNe+MG7quHcW4DZax+uf5UvS9OtKmsEsb4PvpLswx
	6M4Mx/OzVrJ32VuGViVOmtn+ZEMcRTPiWEiN1HJzUjXlmh45udGizzkv3MA62g==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org;
	s=dkim; t=1751106988;
	h=from:from:reply-to:subject:subject:date:date:message-id:message-id:
	 to:to:cc:mime-version:mime-version:content-type:content-type:
	 content-transfer-encoding:content-transfer-encoding:
	 in-reply-to:in-reply-to:references:references;
	bh=gz37RiMTYxtUfREfP6UXKEnvmyXoj0gM+2IGZtntJLs=;
	b=qSkRQTCQYv5DhwGX1gcG34zQLYa/iMuwH0BDZBuB8HoZ4neO7s0nNrNnd40ANmFeW97yXp
	DN0hD8fK8i7eoBLDpzMEFvh8jJs5jNbsCxbaaDJTbLdczgzXnkmdg0uiQ3RORmuTMzyT4W
	JxH2e6dXryo5A/GpoCHyc2gKrWQ2HYPj8g/VPEyhU06Ke9q4GFcbtOzHbaXwg7ayzdGzu2
	2OsuyHtVSFs2CJUwZ4G7vUCT0Ibsg6EJQSRzAQMEe2oaJAzBh389WARYvsVqUHYhbvxaqu
	W7hLTjQcSZXzRiqkeywEcU2LNxOr+ImSltaHkWQW9fWgdvkyN5XnvEJW6O+B/w==
ARC-Authentication-Results: i=1;
	mx1.freebsd.org;
	none
ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1751106988; a=rsa-sha256; cv=none;
	b=aWY7sE6tB06Q9bJel6Lhjk8Udu7MKCVN1IbYY0AxRhMHzsMjz3dmohBmAIX8WxiEpIQk10
	J7xgy3ysxnlJWdAXMYPb5aHWFeN1o0ztzqkbr13Qg83lCf7SVbk/dz3ZAOLiBGWbMf4gIY
	JMlVac2YEtsOX/2DZ2bDgfv+a/Am8TkFSyuPYWy7SB2BCPDXpgvKOLLItn2zLpI0OCee10
	goj4JHiFkdjXqZThM8TGbLFVBHCgkurMzmxxCfEgDmRZCXkEy3CTHYZHJRV0KaQ+od6Fyi
	hmtTVbah9uFJwC4Q7MbVVA0DHf6UF1mhvvpGbyz5sRDr4Nwj4x+o+B4TWLOUVw==
Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d])
	(using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)
	 key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256)
	(Client did not present a certificate)
	by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4bTpkN1rK2zVRT
	for ; Sat, 28 Jun 2025 10:36:28 +0000 (UTC)
	(envelope-from bugzilla-noreply@freebsd.org)
Received: from kenobi.freebsd.org ([127.0.1.5])
	by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 55SAaSwa096528
	for ; Sat, 28 Jun 2025 10:36:28 GMT
	(envelope-from bugzilla-noreply@freebsd.org)
Received: (from www@localhost)
	by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 55SAaSOd096526
	for net@FreeBSD.org; Sat, 28 Jun 2025 10:36:28 GMT
	(envelope-from bugzilla-noreply@freebsd.org)
X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f
From: bugzilla-noreply@freebsd.org
To: net@FreeBSD.org
Subject: [Bug 287872] boot time regression related to netlink and devd
Date: Sat, 28 Jun 2025 10:36:25 +0000
X-Bugzilla-Reason: AssignedTo
X-Bugzilla-Type: changed
X-Bugzilla-Watch-Reason: None
X-Bugzilla-Product: Base System
X-Bugzilla-Component: kern
X-Bugzilla-Version: 14.3-STABLE
X-Bugzilla-Keywords: 
X-Bugzilla-Severity: Affects Some People
X-Bugzilla-Who: eugen@freebsd.org
X-Bugzilla-Status: New
X-Bugzilla-Resolution: 
X-Bugzilla-Priority: ---
X-Bugzilla-Assigned-To: net@FreeBSD.org
X-Bugzilla-Flags: 
X-Bugzilla-Changed-Fields: 
Message-ID: 
In-Reply-To: 
References: 
Content-Transfer-Encoding: quoted-printable
Content-Type: text/plain; charset="UTF-8"
X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/
Auto-Submitted: auto-generated
List-Id: Networking and TCP/IP with FreeBSD 
List-Archive: https://lists.freebsd.org/archives/freebsd-net
List-Help: 
List-Post: 
List-Subscribe: 
List-Unsubscribe: 
Sender: owner-freebsd-net@FreeBSD.org
MIME-Version: 1.0

https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D287872

--- Comment #1 from Eugene Grosbein  ---
I enabled debugging output of devd to the syslog and it shows multiple simi=
lar
lines like the following:

<15>1 2025-06-28T16:52:01.062438+07:00 hostname devd 15765 - - Popping table
<14>1 2025-06-28T16:52:01.063433+07:00 hostname devd 15765 - - Processing e=
vent
'!system=3DIFNET subsystem=3Dvlan847 type=3DATTACH'
<15>1 2025-06-28T16:52:01.064058+07:00 hostname devd 15765 - - Pushing table
<15>1 2025-06-28T16:52:01.064250+07:00 hostname devd 15765 - - Processing
notify event
<14>1 2025-06-28T16:52:01.064591+07:00 hostname devd 15765 - - Executing
'/etc/pccard_ether $'vlan847' start'
<15>1 2025-06-28T16:52:02.774930+07:00 hostname devd 15765 - - Popping table
<14>1 2025-06-28T16:52:02.774998+07:00 hostname devd 15765 - - Processing e=
vent
'!system=3DETHERNET subsystem=3Dvlan847 type=3DIFATTACH'
<15>1 2025-06-28T16:52:02.775027+07:00 hostname devd 15765 - - Pushing table
<15>1 2025-06-28T16:52:02.775127+07:00 hostname devd 15765 - - Processing
notify event
<14>1 2025-06-28T16:52:02.775335+07:00 hostname devd 15765 - - Executing
'/usr/libexec/hyperv/hyperv_vfattach $'vlan847' 0'
<15>1 2025-06-28T16:52:02.784287+07:00 hostname devd 15765 - - Popping table
<14>1 2025-06-28T16:52:02.784359+07:00 hostname devd 15765 - - Processing e=
vent
'!system=3DIFNET subsystem=3Dvlan848 type=3DATTACH'

Note this is bare metal server, no a VM.

--=20
You are receiving this mail because:
You are the assignee for the bug.=

From nobody Sat Jun 28 10:42:32 2025
X-Original-To: net@mlmmj.nyi.freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1])
	by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4bTpsQ1CwSz5yrwQ
	for ; Sat, 28 Jun 2025 10:42:34 +0000 (UTC)
	(envelope-from bugzilla-noreply@freebsd.org)
Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3])
	(using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)
	 key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256
	 client-signature RSA-PSS (4096 bits) client-digest SHA256)
	(Client CN "mxrelay.nyi.freebsd.org", Issuer "R10" (verified OK))
	by mx1.freebsd.org (Postfix) with ESMTPS id 4bTpsP5s68z3xpQ
	for ; Sat, 28 Jun 2025 10:42:33 +0000 (UTC)
	(envelope-from bugzilla-noreply@freebsd.org)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim;
	t=1751107353;
	h=from:from:reply-to:subject:subject:date:date:message-id:message-id:
	 to:to:cc:mime-version:mime-version:content-type:content-type:
	 content-transfer-encoding:content-transfer-encoding:
	 in-reply-to:in-reply-to:references:references;
	bh=NxQyEWLp2J5h0pCPKtfEnRnDrK7orq68m2dh8YgPtOA=;
	b=X/tqcrF41v10Lk25MYnFYhLHiPRbmMJZm9RZJEkAXse4XZRKZEnhH5vjBOStP6NZeqc61E
	p1lSnmKV8RoR0CrKn9+7HeRZaeLBofNN/RFZg58e2fpqB+mmPC65SNIEdzikXLlHuEacTb
	NLrGLG3d/NiHuFE528jlyMYaA4SgBZZHEU8TRSsBxRF1kSRD72pg3g26yMsxKByi8gGQ3c
	Ac9/dUZuGh5eNCrdi4k1JQ4ee4XkqAFWk64PkNnYuTcqliR+tJ9hF/bvYkcJrVN5v06EPc
	YdROSywcTUi1tp+9j1VEfKukMTIUfWaVh/rWxYvI1+T+VFbtEahBJKtN+b+kgg==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org;
	s=dkim; t=1751107353;
	h=from:from:reply-to:subject:subject:date:date:message-id:message-id:
	 to:to:cc:mime-version:mime-version:content-type:content-type:
	 content-transfer-encoding:content-transfer-encoding:
	 in-reply-to:in-reply-to:references:references;
	bh=NxQyEWLp2J5h0pCPKtfEnRnDrK7orq68m2dh8YgPtOA=;
	b=QMjkKYd5gNe5Jhln935BrkwQQSMzsSkQ6xqaLIV78pezbvIwHg6U4XgDmfmEw+JlMHkmCG
	bHjjwXryS/8d2HapvuOUS902opMlRqzMzngcrhL+ngJxvGLagSNpU7bgjwaTNFSRd+gwW+
	Uw0SXoBt2LQ7g46r5SkzM5cBprfFxw4a610yYtFy7+xQmZUdr+13L5ztrCmIZv4ROl5kU4
	0gBpihtbn4GCM7nW86gynBgHGdAHdznU9Wv8+wKYiYJVikd0v7b3W4fVKt0uddHVA0dWf1
	je5GKeY1Rk2lHSp9nrBKEVEpYrkWLRWretRr+hkp5F/ThG5UiiSeVuVc4r2KJg==
ARC-Authentication-Results: i=1;
	mx1.freebsd.org;
	none
ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1751107353; a=rsa-sha256; cv=none;
	b=ql6QnVmkvLZDchNoTh6kQ0o256T6ASBOiUQfk7tmrQ5voTnnbl2sh+xxWvknjMcRnsoHq0
	rIEFeDgYoWSBaCgMOLIE5NE1g9FJ2IruK7m1vQparDI4IZ2r2k1NxYnKNT+Q1i9vCElLFZ
	Tg+FMT46xaY7OMBhDfb0wcpe25mpBVVSu7cCDSNje03gOZVuy7ER1ZxJLe6Vo30pvZRcaF
	Q44MPp0Cc7Elhw/tP7P7M8Tn5TEktJcnF3zUqCyPIRjyu5aRpAHesvpsS8y0RnXVsGZf6S
	6gr+LNUDx+pOxNlMKegvYf8gk4GsF7RQNT4nRCc7+H+hn6u99VTAvqHtehEvQg==
Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d])
	(using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)
	 key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256)
	(Client did not present a certificate)
	by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4bTpsP5RDszTtj
	for ; Sat, 28 Jun 2025 10:42:33 +0000 (UTC)
	(envelope-from bugzilla-noreply@freebsd.org)
Received: from kenobi.freebsd.org ([127.0.1.5])
	by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 55SAgXwf009556
	for ; Sat, 28 Jun 2025 10:42:33 GMT
	(envelope-from bugzilla-noreply@freebsd.org)
Received: (from www@localhost)
	by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 55SAgXsV009550
	for net@FreeBSD.org; Sat, 28 Jun 2025 10:42:33 GMT
	(envelope-from bugzilla-noreply@freebsd.org)
X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f
From: bugzilla-noreply@freebsd.org
To: net@FreeBSD.org
Subject: [Bug 287872] boot time regression related to netlink and devd
Date: Sat, 28 Jun 2025 10:42:32 +0000
X-Bugzilla-Reason: AssignedTo
X-Bugzilla-Type: changed
X-Bugzilla-Watch-Reason: None
X-Bugzilla-Product: Base System
X-Bugzilla-Component: kern
X-Bugzilla-Version: 14.3-STABLE
X-Bugzilla-Keywords: 
X-Bugzilla-Severity: Affects Some People
X-Bugzilla-Who: eugen@freebsd.org
X-Bugzilla-Status: New
X-Bugzilla-Resolution: 
X-Bugzilla-Priority: ---
X-Bugzilla-Assigned-To: net@FreeBSD.org
X-Bugzilla-Flags: 
X-Bugzilla-Changed-Fields: 
Message-ID: 
In-Reply-To: 
References: 
Content-Transfer-Encoding: quoted-printable
Content-Type: text/plain; charset="UTF-8"
X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/
Auto-Submitted: auto-generated
List-Id: Networking and TCP/IP with FreeBSD 
List-Archive: https://lists.freebsd.org/archives/freebsd-net
List-Help: 
List-Post: 
List-Subscribe: 
List-Unsubscribe: 
Sender: owner-freebsd-net@FreeBSD.org
MIME-Version: 1.0

https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D287872

--- Comment #2 from Eugene Grosbein  ---
Also, I observe bad performance of the command ifconfig while the host has =
814
network interfaces in total, including vlans:

# time ifconfig -l > /dev/null

real    0m0,836s
user    0m0,001s
sys     0m0,001s

# time ifconfig lo0 > /dev/null

real    0m0,840s
user    0m0,000s
sys     0m0,008s

ifconfig does many netlink calls:

# kdump -Ep 15771 | fgrep -c AF_NETLINK
165

devd runs many extra scripts and I suspect O(N^2) or even O(N^3) complexity=
 of
devd starting sequence where N is total amount of vlans created before devd
starts.

--=20
You are receiving this mail because:
You are the assignee for the bug.=

From nobody Sat Jun 28 10:45:09 2025
X-Original-To: net@mlmmj.nyi.freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1])
	by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4bTpwQ3QYyz5yrxM
	for ; Sat, 28 Jun 2025 10:45:10 +0000 (UTC)
	(envelope-from bugzilla-noreply@freebsd.org)
Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3])
	(using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)
	 key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256
	 client-signature RSA-PSS (4096 bits) client-digest SHA256)
	(Client CN "mxrelay.nyi.freebsd.org", Issuer "R10" (verified OK))
	by mx1.freebsd.org (Postfix) with ESMTPS id 4bTpwQ0Thdz40vc
	for ; Sat, 28 Jun 2025 10:45:10 +0000 (UTC)
	(envelope-from bugzilla-noreply@freebsd.org)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim;
	t=1751107510;
	h=from:from:reply-to:subject:subject:date:date:message-id:message-id:
	 to:to:cc:mime-version:mime-version:content-type:content-type:
	 content-transfer-encoding:content-transfer-encoding:
	 in-reply-to:in-reply-to:references:references;
	bh=iY0O1FvIBodJPr+1rxDQaedT8m1NqCyVmvvogdSCsCo=;
	b=h1Ba+Ma+ZzI/rFOY8Oxd4QcIVR6xVBRAt6NaAEQkF4mWtCUpDHwRfH/XtX3Wx1ICJ389th
	7QyAE3qazxXEkbZn3I3jgEzaUZF7f3IjWbdeuldX9wrhZ4A9eDmpifFKtv4AZtXMXEIAo5
	wM0U7uwToLRvdHj9ocsxO9Y8tCcyym6SwqWWCbXaINy/0MD7PuYa+OXc2J+vTDxXQhXy7y
	FW/R4oiZFleFfSBCHpkOJsMPsoLzVlDwPXSwzNzPFAqMsBo9YezmYfPsftOqznZBgE7R6i
	97NCPnOV4I7PLQYDe27q3axeczYTRXKDVQdbjU3H6hE7QykIlDvVItZeGkA2pA==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org;
	s=dkim; t=1751107510;
	h=from:from:reply-to:subject:subject:date:date:message-id:message-id:
	 to:to:cc:mime-version:mime-version:content-type:content-type:
	 content-transfer-encoding:content-transfer-encoding:
	 in-reply-to:in-reply-to:references:references;
	bh=iY0O1FvIBodJPr+1rxDQaedT8m1NqCyVmvvogdSCsCo=;
	b=Av3w7VbLX1NVD00e76/Pimbu+NdGS94yqPXVT+lafpMsy0+NqQGsxWt/n92mWJNCTVv4fC
	qgiRshNIfFapIVS9Ltc+UfWui/gP5fZb/w50KXPxshO6C3WMVCLN+RsymHHK1/NAu9vlsy
	Da72svkAfzwW5TvdADtqYU9LuuElnPaNbDC6c8ZNi7vsM9MfoGbpaqEnWogNKCcRm6ebRN
	HmM8V1TvNmAU1NLypOsdw3abNGpeoQ7IbILrBQFLXHhgD65zwO6TEwRBONOeQwMB+9P+zl
	jXD4UYDb+9M1sirlnVW99usNjoMJKRK2GAxdzoxreKsbRCmgKJKsNUTRti5XPQ==
ARC-Authentication-Results: i=1;
	mx1.freebsd.org;
	none
ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1751107510; a=rsa-sha256; cv=none;
	b=VSskG4BNJ2kAI9IV8Sb8rZBy/UhwxfcOlEUNb0d2BY0pzfdAicT9qHBTj15jsj5J8S9RXY
	qZ55fmQqo6JIh2KsO6PrGP9xSnQoyEoag6gxxzg7PsxMOwrRjdOuaMzWOYma62/tMMDhY0
	kDHuR02bk7uAFxXw7dKSu71G4J69JxWG32WKo4LP4KBQvY/DVsBxFoxRuipCkbngScP02j
	jbHqkEYsq9b9jFnQ2SjeUjtF05yUbOb2YArt72WOYO/8MiD868JZRLUF6SxAr/khJv5/qL
	SSLXk1EVfkbpQ4rdTNLxavWDTMB6cTa6i6ohrEtY1sWgn6pdkXPmNHvUmOFcEQ==
Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d])
	(using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)
	 key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256)
	(Client did not present a certificate)
	by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4bTpwQ05LPzVZj
	for ; Sat, 28 Jun 2025 10:45:10 +0000 (UTC)
	(envelope-from bugzilla-noreply@freebsd.org)
Received: from kenobi.freebsd.org ([127.0.1.5])
	by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 55SAj9IM013056
	for ; Sat, 28 Jun 2025 10:45:09 GMT
	(envelope-from bugzilla-noreply@freebsd.org)
Received: (from www@localhost)
	by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 55SAj9GO013049
	for net@FreeBSD.org; Sat, 28 Jun 2025 10:45:09 GMT
	(envelope-from bugzilla-noreply@freebsd.org)
X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f
From: bugzilla-noreply@freebsd.org
To: net@FreeBSD.org
Subject: [Bug 287872] 14.3-STABLE boot time regression related to netlink and
 devd
Date: Sat, 28 Jun 2025 10:45:09 +0000
X-Bugzilla-Reason: AssignedTo
X-Bugzilla-Type: changed
X-Bugzilla-Watch-Reason: None
X-Bugzilla-Product: Base System
X-Bugzilla-Component: kern
X-Bugzilla-Version: 14.3-STABLE
X-Bugzilla-Keywords: 
X-Bugzilla-Severity: Affects Some People
X-Bugzilla-Who: eugen@freebsd.org
X-Bugzilla-Status: New
X-Bugzilla-Resolution: 
X-Bugzilla-Priority: ---
X-Bugzilla-Assigned-To: net@FreeBSD.org
X-Bugzilla-Flags: 
X-Bugzilla-Changed-Fields: short_desc
Message-ID: 
In-Reply-To: 
References: 
Content-Transfer-Encoding: quoted-printable
Content-Type: text/plain; charset="UTF-8"
X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/
Auto-Submitted: auto-generated
List-Id: Networking and TCP/IP with FreeBSD 
List-Archive: https://lists.freebsd.org/archives/freebsd-net
List-Help: 
List-Post: 
List-Subscribe: 
List-Unsubscribe: 
Sender: owner-freebsd-net@FreeBSD.org
MIME-Version: 1.0

https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D287872

Eugene Grosbein  changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
            Summary|boot time regression        |14.3-STABLE boot time
                   |related to netlink and devd |regression related to
                   |                            |netlink and devd

--=20
You are receiving this mail because:
You are the assignee for the bug.=

From nobody Sat Jun 28 10:50:42 2025
X-Original-To: net@mlmmj.nyi.freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1])
	by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4bTq2q4GWWz5ys85
	for ; Sat, 28 Jun 2025 10:50:43 +0000 (UTC)
	(envelope-from bugzilla-noreply@freebsd.org)
Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3])
	(using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)
	 key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256
	 client-signature RSA-PSS (4096 bits) client-digest SHA256)
	(Client CN "mxrelay.nyi.freebsd.org", Issuer "R10" (verified OK))
	by mx1.freebsd.org (Postfix) with ESMTPS id 4bTq2q2HYJz43Fl
	for ; Sat, 28 Jun 2025 10:50:43 +0000 (UTC)
	(envelope-from bugzilla-noreply@freebsd.org)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim;
	t=1751107843;
	h=from:from:reply-to:subject:subject:date:date:message-id:message-id:
	 to:to:cc:mime-version:mime-version:content-type:content-type:
	 content-transfer-encoding:content-transfer-encoding:
	 in-reply-to:in-reply-to:references:references;
	bh=7IzVQRc7qMEvMgeo5/uj/TAUIjMw/E78Ld5DhNQhVOo=;
	b=wBeDaCpOkgGVIwzBdIlyRvZIzPCuGtEUzZZtdzU5edPVAN8OLYX0A5E/gD644LBt48VZ9Z
	06XkWr2RsVHa6yPj3jNcki3Dxqlpaqzrb1Dml0OyHCFOGmvBmdLM9puDAW+jrH6DQ6ETtb
	ohVh9WT7ArlSuS0GbF1HgnXtGU3/Vfqd7JvDcjW3aJ6oqF1d0a6HSShlk8+XE1cuVNVeum
	b8EG2f4Mz+MxhmFsYQFd6ylTt0GhG6HAZPwj33XCo4z5ZwNHPeBCu1LQTIEhu3cZ2wNWTa
	H30essF9FiWATXuaIi0xGZ8hMBQAh4BFVZ74wu46QxUAViUAOST340U9HIC1fg==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org;
	s=dkim; t=1751107843;
	h=from:from:reply-to:subject:subject:date:date:message-id:message-id:
	 to:to:cc:mime-version:mime-version:content-type:content-type:
	 content-transfer-encoding:content-transfer-encoding:
	 in-reply-to:in-reply-to:references:references;
	bh=7IzVQRc7qMEvMgeo5/uj/TAUIjMw/E78Ld5DhNQhVOo=;
	b=OXp83CYbkpOQ5yzCDkGPjwOwYMaSbp0mFFN0a2D883YcKHpTA/us9XF0TjTR2kA4SjJwXi
	3ReupGx9fdorGD9Is6hjvIw6pAZP952G4zDh27aOv+pLKWLSF/+tK9powfnJIltK71LHqU
	NFOh5O0yg54U4dzr0MHmih/vFP0hhwbfG0aApsgZmLp/aCbjW+Qb54cR8+pY8j8tIOWW8S
	9i9o8FbnkXPhTKDFqyjWvp11iiBftWYBcb41Xyy7Kj+4RBSGqxTYiPMMBlsXw/MxphJ7r5
	973qMWIH1H9TfeSZXAr0glWWvLL65YXBAuBpgunne4cQfkES0dtPAAd11n73+w==
ARC-Authentication-Results: i=1;
	mx1.freebsd.org;
	none
ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1751107843; a=rsa-sha256; cv=none;
	b=gEu2/6mrzbw2QEP6j7567YZiM+F7SC0S0GfrZVX59pB58Lvq7xrxV0YkNO9jLwBCelAz4G
	3q8S+SOtUYuzIzF7NVjQZvoRgdUE4wSrANK6IeHo9x7egxQzjRqMj/JaYs4n26ZQBwHbq/
	28q+5OWqHDM2TtlFCbPCAxgi1ThFSUnThZbz2jQTQWFcXfghza7jUtGWhMZJj2YAFq9wti
	kkL95IZ2rIsR8ZhAApsUobep8yNARVMRk+bBTeBaRec6DCAxMDQUNsqIFxADOKMbDDhaBp
	yoH5H6b5hTqhXpJZed5bN+vvHB5Yerooh6XLrg2KjlMq5dA9LOAiXoeZKYMqQQ==
Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d])
	(using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)
	 key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256)
	(Client did not present a certificate)
	by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4bTq2q0vnQzTtr
	for ; Sat, 28 Jun 2025 10:50:43 +0000 (UTC)
	(envelope-from bugzilla-noreply@freebsd.org)
Received: from kenobi.freebsd.org ([127.0.1.5])
	by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 55SAohsd017759
	for ; Sat, 28 Jun 2025 10:50:43 GMT
	(envelope-from bugzilla-noreply@freebsd.org)
Received: (from www@localhost)
	by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 55SAogqp017751
	for net@FreeBSD.org; Sat, 28 Jun 2025 10:50:42 GMT
	(envelope-from bugzilla-noreply@freebsd.org)
X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f
From: bugzilla-noreply@freebsd.org
To: net@FreeBSD.org
Subject: [Bug 287872] 14.3-STABLE boot time regression related to netlink and
 devd
Date: Sat, 28 Jun 2025 10:50:42 +0000
X-Bugzilla-Reason: AssignedTo
X-Bugzilla-Type: changed
X-Bugzilla-Watch-Reason: None
X-Bugzilla-Product: Base System
X-Bugzilla-Component: kern
X-Bugzilla-Version: 14.3-STABLE
X-Bugzilla-Keywords: 
X-Bugzilla-Severity: Affects Some People
X-Bugzilla-Who: eugen@freebsd.org
X-Bugzilla-Status: New
X-Bugzilla-Resolution: 
X-Bugzilla-Priority: ---
X-Bugzilla-Assigned-To: net@FreeBSD.org
X-Bugzilla-Flags: 
X-Bugzilla-Changed-Fields: 
Message-ID: 
In-Reply-To: 
References: 
Content-Transfer-Encoding: quoted-printable
Content-Type: text/plain; charset="UTF-8"
X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/
Auto-Submitted: auto-generated
List-Id: Networking and TCP/IP with FreeBSD 
List-Archive: https://lists.freebsd.org/archives/freebsd-net
List-Help: 
List-Post: 
List-Subscribe: 
List-Unsubscribe: 
Sender: owner-freebsd-net@FreeBSD.org
MIME-Version: 1.0

https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D287872

--- Comment #3 from Eugene Grosbein  ---
Note also: while removing vlans with the command "ifconfig -g scan | time x=
args
-n1 -I^ ifconfig ^ destroy" sometimes this process takes moderate time (less
then 8 second in total), but sometimes it takes about 160 second and Ctrl-T
shows in process:

load: 5.30  cmd: ifconfig 72666 [EDRAIN] 0.14r 0.00u 0.00s 0% 3132k
       66,25 real         0,00 user         0,00 sys
load: 5.30  cmd: ifconfig 72666 [EDRAIN] 0.33r 0.00u 0.00s 0% 3132k
       66,45 real         0,00 user         0,00 sys
load: 4.38  cmd: ifconfig 75760 [vlan_sx] 0.07r 0.00u 0.00s 0% 3160k
      100,75 real         0,00 user         0,00 sys
load: 4.38  cmd: ifconfig 75760 [vlan_sx] 0.41r 0.00u 0.00s 0% 3160k
      101,09 real         0,00 user         0,00 sys
load: 4.38  cmd: ifconfig 75765 [vlan_sx] 0.29r 0.00u 0.01s 0% 3136k
      101,47 real         0,00 user         0,00 sys

--=20
You are receiving this mail because:
You are the assignee for the bug.=

From nobody Sat Jun 28 10:54:33 2025
X-Original-To: net@mlmmj.nyi.freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1])
	by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4bTq7F6sVyz5ys2S
	for ; Sat, 28 Jun 2025 10:54:33 +0000 (UTC)
	(envelope-from bugzilla-noreply@freebsd.org)
Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3])
	(using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)
	 key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256
	 client-signature RSA-PSS (4096 bits) client-digest SHA256)
	(Client CN "mxrelay.nyi.freebsd.org", Issuer "R10" (verified OK))
	by mx1.freebsd.org (Postfix) with ESMTPS id 4bTq7F3n9xz46mp
	for ; Sat, 28 Jun 2025 10:54:33 +0000 (UTC)
	(envelope-from bugzilla-noreply@freebsd.org)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim;
	t=1751108073;
	h=from:from:reply-to:subject:subject:date:date:message-id:message-id:
	 to:to:cc:mime-version:mime-version:content-type:content-type:
	 content-transfer-encoding:content-transfer-encoding:
	 in-reply-to:in-reply-to:references:references;
	bh=7MPXg5pgW69htBretGqHh14uTfeBfH8cDc12upS76X8=;
	b=qjTNyyRl4ykA/aT5LtXoVCH8IFXkf8Dpb29mRUC4fvDX987i0Ki9fddbuzU1yR2GJmgNkt
	K+Cc0x9b5ZnvT+ygY69EmNtTmMjEFEckGq+uTdweXdWm2TgSMeivxwf1+wTUrPda3HSRrt
	EI6zArBkiz17C6oCHupbxjhNtHCWzESAw6Nvm9ofS2d1ibB6CGiDa6y4urstt48ndTBmrq
	XrWGIPHxp4wMjY4FsmmQ1j3PRYX91G2bsUlRkWJnXqNOaCs5yVPbrn329rDWN/3D+RhqKd
	x4M5ELvUma+ipRFPwMKcbTA/hz3923ipGgYXUOVcMs/W0chMdboeWyHST3taIQ==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org;
	s=dkim; t=1751108073;
	h=from:from:reply-to:subject:subject:date:date:message-id:message-id:
	 to:to:cc:mime-version:mime-version:content-type:content-type:
	 content-transfer-encoding:content-transfer-encoding:
	 in-reply-to:in-reply-to:references:references;
	bh=7MPXg5pgW69htBretGqHh14uTfeBfH8cDc12upS76X8=;
	b=gx4aOag2t/KOM6X9CIYbyYYEXVRqZHF78jFfuGr3N3iiqpEwpiR7zfvgJTaZHuglaNCcKq
	AC4hJPRbPyWw5cwNEJFRidXLbXyC0GbSwSBFrGjHD5RGhKu7OYI+PHgbourImR8MMEYdzI
	4nUwbTqYvUB8oNjaqrc8IZWpnKoJo+V3F+/01ghu0BwZ8fL9XIC5gvZzqSFi3isbZmrP+l
	iSsJEvVyykrSiFGwRio6q9xkqD/tiyo0MWnvKmzFVDRnKmO5qkNSPfbai9PTNgM5EVXZ5Q
	aY//VhGRJBWvgbX8BXH37OtkddyLCYsN/PTin8Dkb8A7J1jgUXIWw5/hQNWhDg==
ARC-Authentication-Results: i=1;
	mx1.freebsd.org;
	none
ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1751108073; a=rsa-sha256; cv=none;
	b=AHIQRxix43hkfXNWx0mf2j+UMBUK44EvihTbb/OqCZTNegPy17iHL1lG4avVtxdAxtKkZ7
	2slzOSXEuHpkibQBSCGJmLZNAoKuanNtZShuq3Tqvp9Pla2DXuQ6zuDN8QByJNlDlR+Wzu
	U3hDRz194XnQn27PE/nci2wnSOdyFsJ+4jbgkZgT8UJWuGqN5j4dSN44gQaLDPRaZc7d9W
	62/EYFuRF1T37oq7Bi1IivBsolyQ2xvyeKA4r7ZTnJDbYM/wSYjp2r4eezSr5Oa3NiQOMs
	SnzjfdNkj4EKCChUrnTad+Lcod8EyYFC4bIG5q+L9fNuayiymgvlTXA+EykTOw==
Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d])
	(using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)
	 key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256)
	(Client did not present a certificate)
	by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4bTq7F2qQMzWGk
	for ; Sat, 28 Jun 2025 10:54:33 +0000 (UTC)
	(envelope-from bugzilla-noreply@freebsd.org)
Received: from kenobi.freebsd.org ([127.0.1.5])
	by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 55SAsX1K028100
	for ; Sat, 28 Jun 2025 10:54:33 GMT
	(envelope-from bugzilla-noreply@freebsd.org)
Received: (from www@localhost)
	by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 55SAsXsj028099
	for net@FreeBSD.org; Sat, 28 Jun 2025 10:54:33 GMT
	(envelope-from bugzilla-noreply@freebsd.org)
X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f
From: bugzilla-noreply@freebsd.org
To: net@FreeBSD.org
Subject: [Bug 287872] 14.3-STABLE boot time regression related to netlink and
 devd
Date: Sat, 28 Jun 2025 10:54:33 +0000
X-Bugzilla-Reason: AssignedTo
X-Bugzilla-Type: changed
X-Bugzilla-Watch-Reason: None
X-Bugzilla-Product: Base System
X-Bugzilla-Component: kern
X-Bugzilla-Version: 14.3-STABLE
X-Bugzilla-Keywords: 
X-Bugzilla-Severity: Affects Some People
X-Bugzilla-Who: eugen@freebsd.org
X-Bugzilla-Status: New
X-Bugzilla-Resolution: 
X-Bugzilla-Priority: ---
X-Bugzilla-Assigned-To: net@FreeBSD.org
X-Bugzilla-Flags: 
X-Bugzilla-Changed-Fields: 
Message-ID: 
In-Reply-To: 
References: 
Content-Transfer-Encoding: quoted-printable
Content-Type: text/plain; charset="UTF-8"
X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/
Auto-Submitted: auto-generated
List-Id: Networking and TCP/IP with FreeBSD 
List-Archive: https://lists.freebsd.org/archives/freebsd-net
List-Help: 
List-Post: 
List-Subscribe: 
List-Unsubscribe: 
Sender: owner-freebsd-net@FreeBSD.org
MIME-Version: 1.0

https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D287872

--- Comment #4 from Eugene Grosbein  ---
Forgot to mention: my script creates vlans looping over the list with the
following command:

ifconfig vlan$i create vlan $i vlandev $client_if group $group up

The group here is "scan" and $client_if is bge0.

--=20
You are receiving this mail because:
You are the assignee for the bug.=

From nobody Sat Jun 28 11:09:37 2025
X-Original-To: net@mlmmj.nyi.freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1])
	by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4bTqSd57xMz5yt2n
	for ; Sat, 28 Jun 2025 11:09:37 +0000 (UTC)
	(envelope-from bugzilla-noreply@freebsd.org)
Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3])
	(using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)
	 key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256
	 client-signature RSA-PSS (4096 bits) client-digest SHA256)
	(Client CN "mxrelay.nyi.freebsd.org", Issuer "R10" (verified OK))
	by mx1.freebsd.org (Postfix) with ESMTPS id 4bTqSd29C5z3K9j
	for ; Sat, 28 Jun 2025 11:09:37 +0000 (UTC)
	(envelope-from bugzilla-noreply@freebsd.org)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim;
	t=1751108977;
	h=from:from:reply-to:subject:subject:date:date:message-id:message-id:
	 to:to:cc:mime-version:mime-version:content-type:content-type:
	 content-transfer-encoding:content-transfer-encoding:
	 in-reply-to:in-reply-to:references:references;
	bh=se1HQ7cpzNZ+tbjwEzKnp7S0WDhI0lLIDZF8srGdeVo=;
	b=nE+Y2vEZnF7QCZAFXs9Sap0BioeDuAWSCoQCukkPM+t3r4TgRYMrDrkevIHs8hYk3pqAZn
	XP1uGrPySMWrfDB7nh43FeC+hVHuM5qkkxtKs/T3rmDoi+5H2ZUdVMp2Iy9qgYG0Qdr84Z
	MabOXVFhUAupluPVVhHblRB0iFp2DLV3QQ6Ast2/HJe7vhx0ht0eMI6x9xIG4Jc7Vh0n5M
	MVddrueQDcIqzGSv4IyYl7QlOWO0FOrCSGZrXP9HQc+sDW0I/IUp5Z33riCIyxSGwR/T3N
	+DNWUgo238zoPEe3UJfGMcSLjD1DY99RALXDGWR5psBrNfHNlBNAWYirx3FVog==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org;
	s=dkim; t=1751108977;
	h=from:from:reply-to:subject:subject:date:date:message-id:message-id:
	 to:to:cc:mime-version:mime-version:content-type:content-type:
	 content-transfer-encoding:content-transfer-encoding:
	 in-reply-to:in-reply-to:references:references;
	bh=se1HQ7cpzNZ+tbjwEzKnp7S0WDhI0lLIDZF8srGdeVo=;
	b=LO+FepifL/btmDbmi8K1FS6S56uO79Yf7kfSPObP1GERaRYYhja71Ngjh+pd/FSfJwa9Il
	m76doVmxfaNhlVz2dZvolf9eDVQMaaENQhn/ouJGii1xCGVhGSFkmfZr/HgrrXYZpCCPox
	d+WJJr9mM0r9jNuVoq2m/jkeKeNFCyeH/puT3Zqt9Isgzj3lmlBpmOlbVS6HA6TdNmDMrA
	TFa20/AKVhdLWpqHYcg9Z4MHa1cI9IbDUpJNfD8URHDZk5muaDSHICb/otxfwvhrlYTWHb
	/HFis1HB/j8Ho7toOVLfPBcWtAjRusktMDf22nQ9JO8MhJiphOO6v6sU6txDGg==
ARC-Authentication-Results: i=1;
	mx1.freebsd.org;
	none
ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1751108977; a=rsa-sha256; cv=none;
	b=U9XKVEwPrz/z+2D8SsQh4daZiUO131jFsN2rkkDJmU9Up7oZCMhP8baiFgH5HLbF/CcOQJ
	M/BY8Lw24yjOXAkxNtlUmMhTZ2VW9Ue/J0wERW9xSNTd88rZyCSxoXmWTENsLwLUDAsC3X
	SXyhDDp28OI50FIjtORExDA5URkhqu/Imkm68HNKJ1dgp0a4sLgviITxsyp8WuCeTwvJoc
	WiW2YvRBeGNoW3uGC6vowMxTjSwvmqjAiRVPRQFAQ4m985CLuL7nIxd1t4zG4lHGTXefPx
	TAgCSLrYWJq/CNu4ZM01H4VtsI63f2nYgKRK3e7pkYO+Wao11r6WZkuHbM7Ziw==
Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d])
	(using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)
	 key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256)
	(Client did not present a certificate)
	by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4bTqSd1TrnzVgs
	for ; Sat, 28 Jun 2025 11:09:37 +0000 (UTC)
	(envelope-from bugzilla-noreply@freebsd.org)
Received: from kenobi.freebsd.org ([127.0.1.5])
	by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 55SB9b2P054083
	for ; Sat, 28 Jun 2025 11:09:37 GMT
	(envelope-from bugzilla-noreply@freebsd.org)
Received: (from www@localhost)
	by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 55SB9brH054082
	for net@FreeBSD.org; Sat, 28 Jun 2025 11:09:37 GMT
	(envelope-from bugzilla-noreply@freebsd.org)
X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f
From: bugzilla-noreply@freebsd.org
To: net@FreeBSD.org
Subject: [Bug 287872] 14.3-STABLE boot time regression related to netlink and
 devd
Date: Sat, 28 Jun 2025 11:09:37 +0000
X-Bugzilla-Reason: AssignedTo
X-Bugzilla-Type: changed
X-Bugzilla-Watch-Reason: None
X-Bugzilla-Product: Base System
X-Bugzilla-Component: kern
X-Bugzilla-Version: 14.3-STABLE
X-Bugzilla-Keywords: 
X-Bugzilla-Severity: Affects Some People
X-Bugzilla-Who: eugen@freebsd.org
X-Bugzilla-Status: New
X-Bugzilla-Resolution: 
X-Bugzilla-Priority: ---
X-Bugzilla-Assigned-To: net@FreeBSD.org
X-Bugzilla-Flags: 
X-Bugzilla-Changed-Fields: 
Message-ID: 
In-Reply-To: 
References: 
Content-Transfer-Encoding: quoted-printable
Content-Type: text/plain; charset="UTF-8"
X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/
Auto-Submitted: auto-generated
List-Id: Networking and TCP/IP with FreeBSD 
List-Archive: https://lists.freebsd.org/archives/freebsd-net
List-Help: 
List-Post: 
List-Subscribe: 
List-Unsubscribe: 
Sender: owner-freebsd-net@FreeBSD.org
MIME-Version: 1.0

https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D287872

--- Comment #5 from Eugene Grosbein  ---
I've rebuilt and reinstalled /sbin/ifconfig binary using
WITHOUT_NETLINK_SUPPORT and its performance went back to normal:

# time ifconfig lo0 >/dev/null

real    0m0,056s
user    0m0,048s
sys     0m0,008s

And now devd starts much faster, I presume the time is same as with
13.5-STABLE:

# time service devd start
Starting devd.

real    0m27,800s
user    0m21,826s
sys     0m6,071s

It is still not so quick, but not over 17 minutes.

--=20
You are receiving this mail because:
You are the assignee for the bug.=

From nobody Sat Jun 28 11:45:19 2025
X-Original-To: net@mlmmj.nyi.freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1])
	by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4bTrFs2NSHz5yvms
	for ; Sat, 28 Jun 2025 11:45:21 +0000 (UTC)
	(envelope-from bugzilla-noreply@freebsd.org)
Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3])
	(using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)
	 key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256
	 client-signature RSA-PSS (4096 bits) client-digest SHA256)
	(Client CN "mxrelay.nyi.freebsd.org", Issuer "R10" (verified OK))
	by mx1.freebsd.org (Postfix) with ESMTPS id 4bTrFr6jb7z3j6r
	for ; Sat, 28 Jun 2025 11:45:20 +0000 (UTC)
	(envelope-from bugzilla-noreply@freebsd.org)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim;
	t=1751111121;
	h=from:from:reply-to:subject:subject:date:date:message-id:message-id:
	 to:to:cc:mime-version:mime-version:content-type:content-type:
	 content-transfer-encoding:content-transfer-encoding:
	 in-reply-to:in-reply-to:references:references;
	bh=jNcubqubqa1qcWURz/qnUj4MPEWTLjA1wSBkiPNk/sU=;
	b=AwI7wc/zfCK+77z9lJqHUdpEyFq8YV+nTHnMklII+a1WQMQ0GAAaKmqrhdBQtqZjCIyNFh
	vsPaRBlJFESxb//BZS/vNs126Xw8Zo8T8meHY9nkyxMMWyFObzsIb6bbhW7UgtqjJC6+w3
	LeX6vyozFkZehTauWbYlbfa/AjXM7hWSpLAdtLaN/JYr1b1ggohBUGgDzafPU+mRUz0QB/
	5JkFmD14WRoxTeyebUGoOWN4qRTa0XuOcG6V0e2gr11VNd5c/lDSo/skZXUzfvYD1ufptX
	FuOVFiB+E6Op8/0AglvbGQvxOQFD15MUCRnUwb2wO/Kvkp8QpnPVi2x33gXmbQ==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org;
	s=dkim; t=1751111121;
	h=from:from:reply-to:subject:subject:date:date:message-id:message-id:
	 to:to:cc:mime-version:mime-version:content-type:content-type:
	 content-transfer-encoding:content-transfer-encoding:
	 in-reply-to:in-reply-to:references:references;
	bh=jNcubqubqa1qcWURz/qnUj4MPEWTLjA1wSBkiPNk/sU=;
	b=y3DmXvUqyv9jCHhpWz6SPUZfj6sANPtpYotMOt5z4YUQm4V7vrYDWdY8Fn5hG5plHR9fNh
	yIejzDsnqXnTDAt9Mg5T6uD3hjdTMl+fEBQCCD0COzcI9MdQa+JjpNr23DkkYXswBinotW
	/dNZa48/h63dfjujdvvDG1AQHb8BeKs33U3EqUYGOa91GFEmu7+LpwvLw7sklD7Q483wU9
	kJSvZL9t/RY5+94NPERHJpRSCXriM21qXkDBxLnheEbbLgV1SKOKYOvBb1gcSyRkajVl+M
	X4cTVdo+usEDZ+tvuoSzmnkKMDmfCm4tJ48P5RCkQqMAPg6NMBYNThNE8gnm6A==
ARC-Authentication-Results: i=1;
	mx1.freebsd.org;
	none
ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1751111121; a=rsa-sha256; cv=none;
	b=RqSsATSaLaKQ11JfkXEL/bsDZARqCPq9W5M9X54JhsuPwXBXR6kZnFnyP1lQ7RcLOTq329
	nhZ0p1keavMdsuDn3UhHk93HGvBcp5JytW0Qkpv46xScyfR4oXZblE/I734LSt88R1omLa
	ERPQTI5/tpkY9BoUiDUMGmX4/NuSnqMnGiwqu8/umRV4dDl3p0rXvU9bHwD3gCnwIuWMj4
	piM/6AoDl7x+rvXyMO2AMxQlt9ccQEktBRfQeSRL3eyMlQ/tHRD2PSq/ZeyfaHHbIUePxt
	VjY6uqTxlJrGa29CYIO+5/uiIcaHvfBPyBF7W+5d25OXwb3/Gn/9xLrlwpCWBQ==
Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d])
	(using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)
	 key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256)
	(Client did not present a certificate)
	by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4bTrFr6DWpzYBS
	for ; Sat, 28 Jun 2025 11:45:20 +0000 (UTC)
	(envelope-from bugzilla-noreply@freebsd.org)
Received: from kenobi.freebsd.org ([127.0.1.5])
	by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 55SBjKC9016749
	for ; Sat, 28 Jun 2025 11:45:20 GMT
	(envelope-from bugzilla-noreply@freebsd.org)
Received: (from www@localhost)
	by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 55SBjKs4016748
	for net@FreeBSD.org; Sat, 28 Jun 2025 11:45:20 GMT
	(envelope-from bugzilla-noreply@freebsd.org)
X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f
From: bugzilla-noreply@freebsd.org
To: net@FreeBSD.org
Subject: [Bug 287872] 14.3-STABLE boot time regression related to netlink and
 devd
Date: Sat, 28 Jun 2025 11:45:19 +0000
X-Bugzilla-Reason: AssignedTo
X-Bugzilla-Type: changed
X-Bugzilla-Watch-Reason: None
X-Bugzilla-Product: Base System
X-Bugzilla-Component: kern
X-Bugzilla-Version: 14.3-STABLE
X-Bugzilla-Keywords: 
X-Bugzilla-Severity: Affects Some People
X-Bugzilla-Who: eugen@freebsd.org
X-Bugzilla-Status: New
X-Bugzilla-Resolution: 
X-Bugzilla-Priority: ---
X-Bugzilla-Assigned-To: net@FreeBSD.org
X-Bugzilla-Flags: 
X-Bugzilla-Changed-Fields: see_also
Message-ID: 
In-Reply-To: 
References: 
Content-Transfer-Encoding: quoted-printable
Content-Type: text/plain; charset="UTF-8"
X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/
Auto-Submitted: auto-generated
List-Id: Networking and TCP/IP with FreeBSD 
List-Archive: https://lists.freebsd.org/archives/freebsd-net
List-Help: 
List-Post: 
List-Subscribe: 
List-Unsubscribe: 
Sender: owner-freebsd-net@FreeBSD.org
MIME-Version: 1.0

https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D287872

Eugene Grosbein  changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
           See Also|                            |https://bugs.freebsd.org/bu
                   |                            |gzilla/show_bug.cgi?id=3D2=
878
                   |                            |73

--=20
You are receiving this mail because:
You are the assignee for the bug.=

From nobody Sat Jun 28 14:10:20 2025
X-Original-To: net@mlmmj.nyi.freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1])
	by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4bTvT85Jw2z604TD
	for ; Sat, 28 Jun 2025 14:10:20 +0000 (UTC)
	(envelope-from bugzilla-noreply@freebsd.org)
Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3])
	(using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)
	 key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256
	 client-signature RSA-PSS (4096 bits) client-digest SHA256)
	(Client CN "mxrelay.nyi.freebsd.org", Issuer "R10" (verified OK))
	by mx1.freebsd.org (Postfix) with ESMTPS id 4bTvT84TbPz446W
	for ; Sat, 28 Jun 2025 14:10:20 +0000 (UTC)
	(envelope-from bugzilla-noreply@freebsd.org)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim;
	t=1751119820;
	h=from:from:reply-to:subject:subject:date:date:message-id:message-id:
	 to:to:cc:mime-version:mime-version:content-type:content-type:
	 content-transfer-encoding:content-transfer-encoding:
	 in-reply-to:in-reply-to:references:references;
	bh=dpRHsvNYboFydse7fKjBRmAQABJQoaNT/EPaDX2xX+g=;
	b=hlHISouwj4y/Tt+a/HrzsRF7+5kPmuxQukgCuEe9VXYeoVTFlaJPyuXHbskD+cTHuxuK46
	7cTEqetvdXMYwno3nEuFAgWUhiXubGhXZcVFCAb5cASuC+UAXr14p65Yue/B4UrCvGKPqe
	0nsB/Tuo9Y8oo0KKBueB+nef9JUUmIeNtLkCLEbosxj17QfqfNrOQOuzvOQk5MTuP3VtkK
	diPDEfsOT7SRnWmFvZsthCZcz1daMC+jJCb45d5I+Cn0Mc054p85+Ys5cGSnfsbrZEnWwS
	A8GnX44BWoT+8pJ+9eDAdR2Kqr7zCTx5Pge5oMtHYHbXGBHcw6VSlGNUNaapkw==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org;
	s=dkim; t=1751119820;
	h=from:from:reply-to:subject:subject:date:date:message-id:message-id:
	 to:to:cc:mime-version:mime-version:content-type:content-type:
	 content-transfer-encoding:content-transfer-encoding:
	 in-reply-to:in-reply-to:references:references;
	bh=dpRHsvNYboFydse7fKjBRmAQABJQoaNT/EPaDX2xX+g=;
	b=EIBZ9E5qn7Pk7jKo6wyq2Fvvrl+8buHJi8U6UFiWg67uQESoYB6Z9lXx4u052lvC6HwrfP
	LtMDIsgQCjOgcokSp4zz4s5xmcwoGH1fACH24FfBjrsZ3nvj/yIPG4zCXYOQmermSVnBRk
	m66w/xM3PZNuBkkfq7Uao8zHwIynttGjMSv3IimSzx6QE9GqfKPArTExyMrT0UL9ad2RAa
	/EU9qQPaOEvECsBvOWziGjLp+N93NL6K6F31oz23826Qfj+GoLvkMGZ64iqn2ySe7JhJ3K
	Rn8RYv6ExtJEQ0eMR5kCPOKTsTvBzyvr7dOW8trjwtNTzoJz4Me7BhPcsdYZIw==
ARC-Authentication-Results: i=1;
	mx1.freebsd.org;
	none
ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1751119820; a=rsa-sha256; cv=none;
	b=gMK/PIP4M9HbSpmdkfzxAmzDe8Wn/PJtpcap6SrLwo4w4sB5dXg74ol1DIt49lPrSUo/Ei
	hirwel6MvlUW7PUN1mlJ/qqgQ0iArHRpjm2pm2OK+OpH40pMHDRpyzPqvJdlJn2DapPqEF
	IieEOQOsWHqAwFa4OXzq2B4c0JuR+1Rj2BXP6rJv5n4S81w1vj5IHXCmK8J2QEhjOn1YDh
	cxUhU9RfE+az2hUX/Xx7u1/6/BZWqc3qLk5SsditzyKkGkaa7q7XcwIAKJwhK9fWLab8l6
	LhX/HIzPKz269PMrNxKoZQwF3TbVhhurditm38ehNVLSnGGhkeH0dvq8L8GCgQ==
Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d])
	(using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)
	 key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256)
	(Client did not present a certificate)
	by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4bTvT83rCMzd95
	for ; Sat, 28 Jun 2025 14:10:20 +0000 (UTC)
	(envelope-from bugzilla-noreply@freebsd.org)
Received: from kenobi.freebsd.org ([127.0.1.5])
	by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 55SEAKGj076420
	for ; Sat, 28 Jun 2025 14:10:20 GMT
	(envelope-from bugzilla-noreply@freebsd.org)
Received: (from www@localhost)
	by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 55SEAKSO076419
	for net@FreeBSD.org; Sat, 28 Jun 2025 14:10:20 GMT
	(envelope-from bugzilla-noreply@freebsd.org)
X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f
From: bugzilla-noreply@freebsd.org
To: net@FreeBSD.org
Subject: [Bug 287872] 14.3-STABLE boot time regression related to netlink and
 devd
Date: Sat, 28 Jun 2025 14:10:20 +0000
X-Bugzilla-Reason: AssignedTo
X-Bugzilla-Type: changed
X-Bugzilla-Watch-Reason: None
X-Bugzilla-Product: Base System
X-Bugzilla-Component: kern
X-Bugzilla-Version: 14.3-STABLE
X-Bugzilla-Keywords: 
X-Bugzilla-Severity: Affects Some People
X-Bugzilla-Who: eugen@freebsd.org
X-Bugzilla-Status: New
X-Bugzilla-Resolution: 
X-Bugzilla-Priority: ---
X-Bugzilla-Assigned-To: net@FreeBSD.org
X-Bugzilla-Flags: 
X-Bugzilla-Changed-Fields: 
Message-ID: 
In-Reply-To: 
References: 
Content-Transfer-Encoding: quoted-printable
Content-Type: text/plain; charset="UTF-8"
X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/
Auto-Submitted: auto-generated
List-Id: Networking and TCP/IP with FreeBSD 
List-Archive: https://lists.freebsd.org/archives/freebsd-net
List-Help: 
List-Post: 
List-Subscribe: 
List-Unsubscribe: 
Sender: owner-freebsd-net@FreeBSD.org
MIME-Version: 1.0

https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D287872

--- Comment #6 from Eugene Grosbein  ---
Forgot to note that kernel config is custom here:

include         GENERIC
ident           N-7-MONITOR

options         KDB
options         KDB_UNATTENDED
options         KDB_TRACE
options         DDB
options         GDB

options         IPFIREWALL
options         IPFIREWALL_NAT
options         IPDIVERT
options         DUMMYNET
options         LIBALIAS
# EOF

--=20
You are receiving this mail because:
You are the assignee for the bug.=

From nobody Sat Jun 28 15:47:01 2025
X-Original-To: net@mlmmj.nyi.freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1])
	by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4bTxcj3FwHz608y5
	for ; Sat, 28 Jun 2025 15:47:01 +0000 (UTC)
	(envelope-from bugzilla-noreply@freebsd.org)
Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3])
	(using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)
	 key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256
	 client-signature RSA-PSS (4096 bits) client-digest SHA256)
	(Client CN "mxrelay.nyi.freebsd.org", Issuer "R10" (verified OK))
	by mx1.freebsd.org (Postfix) with ESMTPS id 4bTxcj2N53z3DXL
	for ; Sat, 28 Jun 2025 15:47:01 +0000 (UTC)
	(envelope-from bugzilla-noreply@freebsd.org)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim;
	t=1751125621;
	h=from:from:reply-to:subject:subject:date:date:message-id:message-id:
	 to:to:cc:mime-version:mime-version:content-type:content-type:
	 content-transfer-encoding:content-transfer-encoding:
	 in-reply-to:in-reply-to:references:references;
	bh=k+jDwml1BQ/cXI7kUkLJCHDF8aO+rttUoyd3aJz/9tg=;
	b=puWm84NUl0PEuLf4xNPB/FYvt6jQb8kv83WRoZBrCmO2R7GPXUvnf+zV1pfurA43zpg7yc
	B266bHJbWLRkedaobc9a4VKoW43WYvnf0T1i7fFDnznvYB3YyRaoGLDTsQbferx6ExDlmO
	x43TvB8cp4Ev3HnOoSsBGd/6kNDFAPprRHo11x098DUmZCHMRJiTbJFXF/xShpUE6s6sJU
	shEb1m5xeex8O2G2eIM3RN/cCHjY/OyMRFDG4Zs5Zw/z6vLpDwKS1RB9n7hEudxUuKKPNA
	uEi5QWmX4S9he/kpbsTr+bAm5Gu3MvjPhEMv8/WXUB3t+27BM3/+GKhwwB81jA==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org;
	s=dkim; t=1751125621;
	h=from:from:reply-to:subject:subject:date:date:message-id:message-id:
	 to:to:cc:mime-version:mime-version:content-type:content-type:
	 content-transfer-encoding:content-transfer-encoding:
	 in-reply-to:in-reply-to:references:references;
	bh=k+jDwml1BQ/cXI7kUkLJCHDF8aO+rttUoyd3aJz/9tg=;
	b=vPrmS1j9o5IHpjb0c03c0WNzKPMjadr+ccD9uZ+MhkEK9dmse0PXe4MkIoYGOVErmmZJO2
	H0xJdn1GDbaexHdm1th9cnqLyw5VT8w595RyrI8RpN4H95QalNipp+n0p1YnF45DTuxEos
	tmf4NdeSB9JgTeIBDGKTVEKb0aqOAALBJorTl5rZ9oxITQu9rtxZK3DM5+f5oE5Jj2hw3e
	ERiR8fS/49PHS0hQbY4B8gRVP7qjGsUCPItK/I1VL529WTTv0R5oXnyDzZONK5sCWGEQsl
	kXWBa4dqhkjyP3IjHJnEDp+QmNjXtWP0Lx0SEac4qva1dtP/MRiehPM393fozw==
ARC-Authentication-Results: i=1;
	mx1.freebsd.org;
	none
ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1751125621; a=rsa-sha256; cv=none;
	b=jW1pnIUaRSunDAx1UTHEho9M1EU4orWsVokmOMT16u+fw4gGXEKvZ7gxexoVXsK1OlIJdY
	qFPbm5XWhOv6SGM1joNTUr3VCeGL7tv3zUm+KXIyLqby8qpIrMqH5pEZjhTv0jTBdoqy5U
	J5At8A6/qvkig5RUNXK+WE7OvU+UoQi4fnPuS78jrStU/o0D+1lUW/TSSHDtQ80zZ+rje/
	S/g6UxtrAfMU108RzjfPyUvZ3c5DoRCDY1wGE4n0zgAfmC5MaKWOszLhXM4Yk1VKOFYyu9
	LGGuuXMjZAxmfla78qRDOE6+Uf1c9POjYyUYEsKQrRpUfPvmgOPuBcdqych46Q==
Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d])
	(using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)
	 key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256)
	(Client did not present a certificate)
	by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4bTxcj1jTDzg46
	for ; Sat, 28 Jun 2025 15:47:01 +0000 (UTC)
	(envelope-from bugzilla-noreply@freebsd.org)
Received: from kenobi.freebsd.org ([127.0.1.5])
	by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 55SFl1gV057929
	for ; Sat, 28 Jun 2025 15:47:01 GMT
	(envelope-from bugzilla-noreply@freebsd.org)
Received: (from www@localhost)
	by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 55SFl1uA057928
	for net@FreeBSD.org; Sat, 28 Jun 2025 15:47:01 GMT
	(envelope-from bugzilla-noreply@freebsd.org)
X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f
From: bugzilla-noreply@freebsd.org
To: net@FreeBSD.org
Subject: [Bug 287872] 14.3-STABLE boot time regression related to netlink and
 devd
Date: Sat, 28 Jun 2025 15:47:01 +0000
X-Bugzilla-Reason: AssignedTo
X-Bugzilla-Type: changed
X-Bugzilla-Watch-Reason: None
X-Bugzilla-Product: Base System
X-Bugzilla-Component: kern
X-Bugzilla-Version: 14.3-STABLE
X-Bugzilla-Keywords: 
X-Bugzilla-Severity: Affects Some People
X-Bugzilla-Who: michaelo@FreeBSD.org
X-Bugzilla-Status: New
X-Bugzilla-Resolution: 
X-Bugzilla-Priority: ---
X-Bugzilla-Assigned-To: net@FreeBSD.org
X-Bugzilla-Flags: 
X-Bugzilla-Changed-Fields: 
Message-ID: 
In-Reply-To: 
References: 
Content-Transfer-Encoding: quoted-printable
Content-Type: text/plain; charset="UTF-8"
X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/
Auto-Submitted: auto-generated
List-Id: Networking and TCP/IP with FreeBSD 
List-Archive: https://lists.freebsd.org/archives/freebsd-net
List-Help: 
List-Post: 
List-Subscribe: 
List-Unsubscribe: 
Sender: owner-freebsd-net@FreeBSD.org
MIME-Version: 1.0

https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D287872

--- Comment #7 from Michael Osipov  ---
In theory, one needs to find out whether this was already present in
14.0-RELEASE...

--=20
You are receiving this mail because:
You are the assignee for the bug.=

From nobody Sat Jun 28 16:02:13 2025
X-Original-To: net@mlmmj.nyi.freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1])
	by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4bTxyG2c8dz609vk
	for ; Sat, 28 Jun 2025 16:02:14 +0000 (UTC)
	(envelope-from bugzilla-noreply@freebsd.org)
Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3])
	(using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)
	 key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256
	 client-signature RSA-PSS (4096 bits) client-digest SHA256)
	(Client CN "mxrelay.nyi.freebsd.org", Issuer "R10" (verified OK))
	by mx1.freebsd.org (Postfix) with ESMTPS id 4bTxyG0KZtz3NyB
	for ; Sat, 28 Jun 2025 16:02:14 +0000 (UTC)
	(envelope-from bugzilla-noreply@freebsd.org)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim;
	t=1751126534;
	h=from:from:reply-to:subject:subject:date:date:message-id:message-id:
	 to:to:cc:mime-version:mime-version:content-type:content-type:
	 content-transfer-encoding:content-transfer-encoding:
	 in-reply-to:in-reply-to:references:references;
	bh=pDfxZJ8ok5KzV3+GTW9gDzUf/qhI4MFAFvj/FuCPAPE=;
	b=RXj+EHwJ0/NMi4zoenqQwzI5Ev4tMgmKDn8KojufLCQ6Earvbldp+/vClR7F7h3KiT/foJ
	po3SzK1WrGs+G8gyoumZAUlLwC9QO7M6n14l4vK8vAzI5hQAWPV4fGlRBrLOZbbsvzR8r0
	j2wg89CPr4JSjnJ/3+iqpinwYzV3bEhy+FKvUmzR4uqVv2BgReG87sfJT+o7OXG3HsyJa4
	g8iOVZtjIKd6QApvwC2vycou005XTUSI3Js6olWk2i2zWlSJya72szn6BkIjik5+Ke/IRK
	FigQAEwexofUVyJOIC2PEPrHbFhsxh+60GAEx7fY4XhdCoSK5x1QIAsjCMCbCw==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org;
	s=dkim; t=1751126534;
	h=from:from:reply-to:subject:subject:date:date:message-id:message-id:
	 to:to:cc:mime-version:mime-version:content-type:content-type:
	 content-transfer-encoding:content-transfer-encoding:
	 in-reply-to:in-reply-to:references:references;
	bh=pDfxZJ8ok5KzV3+GTW9gDzUf/qhI4MFAFvj/FuCPAPE=;
	b=BFhnhjDwecegu7MtSUulo5IYx9hDtZ6mcNnZ02b9ZYaOJJE50aRdW90v4+i6IEc+eN6WMn
	QKHY+qptVmStQ1hayQAqoawJ76tYOQCfSAvKwwjU8IKnp1pEXfCuqNNMeYYuDzcHU0PtNt
	kNjJDUlxBDuFtiiE6u4UBgOTUtoeedcw/KlwAiVT3U4OpbtJXq6OKSWEAVXWnFYLzG/BfW
	XQ0nF/dQYjPjFwfk5/irz3NDH6wHS7e5S6bu1rBeuRhhDyLgfOa/WjTVbmhEcsadxwR5Sw
	WJF7cckauxWZs/ZI6c0jE3BFzHyH2eWrFceLrI2MMDWVicJ90fUhBYJiJ9+Npw==
ARC-Authentication-Results: i=1;
	mx1.freebsd.org;
	none
ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1751126534; a=rsa-sha256; cv=none;
	b=KggQfp2agiK+sQUtYKUQniMApp64NSoXCNC+JX72EwwusL3y5VePG0kGS3/0mh69Dpx9sQ
	tBq5OW0PJE84vBXNvZnY7SjWSBy0xa/gtX/J9bYgZiq7VrpRmP+rxOWCUuWla/uHiakkoG
	leMFZO8D5dzEKzY0ZNlDVrMJp4nlKmBU6u/vJL/UqjcJAbyyqQ7QS3cR1Q3rFW9jjunvJ4
	L5uoY90s7itsk0T+ytsEVsU5vIWwgmT6J9tC6Z3WgyyZaAoXOkjbhZiomtmVwadD/bbWcT
	6OV2WnNbIj2lZuQfYWL41GncN/PoRmhsD7moVXzVsu03HJuzwFm7xsM5PIGO1g==
Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d])
	(using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)
	 key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256)
	(Client did not present a certificate)
	by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4bTxyF72zFzgwJ
	for ; Sat, 28 Jun 2025 16:02:13 +0000 (UTC)
	(envelope-from bugzilla-noreply@freebsd.org)
Received: from kenobi.freebsd.org ([127.0.1.5])
	by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 55SG2DHh086812
	for ; Sat, 28 Jun 2025 16:02:13 GMT
	(envelope-from bugzilla-noreply@freebsd.org)
Received: (from www@localhost)
	by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 55SG2Dcj086811
	for net@FreeBSD.org; Sat, 28 Jun 2025 16:02:13 GMT
	(envelope-from bugzilla-noreply@freebsd.org)
X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f
From: bugzilla-noreply@freebsd.org
To: net@FreeBSD.org
Subject: [Bug 287244] [fib_algo] inet.80 (radix4_lockless#865)
 rebuild_fd_flm: table rebuild failed  (route add 255.255.255.255/32 -reject
 -fib 80)
Date: Sat, 28 Jun 2025 16:02:13 +0000
X-Bugzilla-Reason: AssignedTo
X-Bugzilla-Type: changed
X-Bugzilla-Watch-Reason: None
X-Bugzilla-Product: Base System
X-Bugzilla-Component: kern
X-Bugzilla-Version: 14.2-STABLE
X-Bugzilla-Keywords: 
X-Bugzilla-Severity: Affects Only Me
X-Bugzilla-Who: zlei@FreeBSD.org
X-Bugzilla-Status: New
X-Bugzilla-Resolution: 
X-Bugzilla-Priority: ---
X-Bugzilla-Assigned-To: net@FreeBSD.org
X-Bugzilla-Flags: 
X-Bugzilla-Changed-Fields: 
Message-ID: 
In-Reply-To: 
References: 
Content-Transfer-Encoding: quoted-printable
Content-Type: text/plain; charset="UTF-8"
X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/
Auto-Submitted: auto-generated
List-Id: Networking and TCP/IP with FreeBSD 
List-Archive: https://lists.freebsd.org/archives/freebsd-net
List-Help: 
List-Post: 
List-Subscribe: 
List-Unsubscribe: 
Sender: owner-freebsd-net@FreeBSD.org
MIME-Version: 1.0

https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D287244

--- Comment #1 from Zhenlei Huang  ---
I noticed this issue is tagged with 14.2-STABLE, since 14.3 is released so I
test with 14.3 but can not repeat. Or maybe my steps is wrong. Have you tri=
ed
14.3-RELEASE yet ?

--=20
You are receiving this mail because:
You are the assignee for the bug.=

From nobody Sun Jun 29 09:54:14 2025
X-Original-To: net@mlmmj.nyi.freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1])
	by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4bVPlC0GpFz601Lh
	for ; Sun, 29 Jun 2025 09:54:15 +0000 (UTC)
	(envelope-from bugzilla-noreply@freebsd.org)
Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3])
	(using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)
	 key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256
	 client-signature RSA-PSS (4096 bits) client-digest SHA256)
	(Client CN "mxrelay.nyi.freebsd.org", Issuer "R10" (verified OK))
	by mx1.freebsd.org (Postfix) with ESMTPS id 4bVPlB623xz3JZZ
	for ; Sun, 29 Jun 2025 09:54:14 +0000 (UTC)
	(envelope-from bugzilla-noreply@freebsd.org)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim;
	t=1751190854;
	h=from:from:reply-to:subject:subject:date:date:message-id:message-id:
	 to:to:cc:mime-version:mime-version:content-type:content-type:
	 content-transfer-encoding:content-transfer-encoding:
	 in-reply-to:in-reply-to:references:references;
	bh=H3qI+ytSuZxUTMqveQkRKLffcvabJRiDhLj0GyeUwgc=;
	b=ahfI9hHWiC5/aOtbDIoKLQxNmhitWl6AmjoDt2CkFwRS5eiPPSUVqIRHNw97UIaduIgqcG
	QUZh7iMrm6UQX1jqaZlzUs7t8LSBMdzn4XdHBEzBLR+LEtgNfUBTlpNreaM2+JGtnXYBFc
	Clg7uQ/ljXQ+jHcZwQN7m4x0cOfCX28M68HEdfIZe7aJxYTVzvsh7GuunRt6D+3lBW5u8j
	Mg+Iynm1NjpG/IZedbyUrT9yMPoN8hQX1RwbJaeyWOUkpCZDewSDiP7RJGeFHBcWTo0N7P
	jfM1EfnKm+mxRXHxeqE0oGsFvZmXWASL2J+kN1XvZr/L6hc3SfggyUkZU+njig==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org;
	s=dkim; t=1751190854;
	h=from:from:reply-to:subject:subject:date:date:message-id:message-id:
	 to:to:cc:mime-version:mime-version:content-type:content-type:
	 content-transfer-encoding:content-transfer-encoding:
	 in-reply-to:in-reply-to:references:references;
	bh=H3qI+ytSuZxUTMqveQkRKLffcvabJRiDhLj0GyeUwgc=;
	b=W9+suwLuVQUDnP/jNpS4q0SrtXRCee3bAmrLx8t8XEnLKxoUxtiD4N+qVbup6fIcg8s5G4
	5oJhcNe7vxX3Rqadf0Bh5ae4fPpzu1sNIi1okqQy6pjh4KvgrL0vhzqBzoGw3tpp4fQLM0
	tIeuyjScojdMy9xaqUA5dkDe3YfOiqhA13t/CzMt02hAb7qJxSIW7kXI2ib08ZK4AaU+G4
	mYIcC0ExjmWDgS941FKfDkQTf70J6k9C5jn85v9Ep/35XQW41oEvepxStugzJM/nIdX3D1
	mces4gTkLphbGVki1l0ayCcqvht1Wmgfk5EbXQnoYptIzbWIP3Kx8gXaUHFA+w==
ARC-Authentication-Results: i=1;
	mx1.freebsd.org;
	none
ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1751190854; a=rsa-sha256; cv=none;
	b=VFR8W3rNVkr2j26xroEaNL41xUFUqw7x17RAtFs7d/rXyCE0RyMVG8BgV72QcjJnMYcJ9B
	7OH9701MCnl1DSBo50wlzHbHsQncq6dKF+m6I1PKtWV9CZ6kkhKoEjagVsRuv97JP6gbH3
	MkAEAMwm+QvyYTtgtmKf79zeAZkHR6VhrOYhqP+h6JAc9Eedh2oiP7q5kwPU5ZEEauTCvx
	uvRB9taLeC2TDYyeNdbiazDkRsUPM/jzPukwSpNfeY5jdxkJSjr2LkHbYMefhBY7/LTrtu
	V4YyRSS3Kg/LjPzOi2S8Cl33Z6Yn9Wn8cqDq9FL/D1RC2VEFiTgVY9hqSIKPJw==
Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d])
	(using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)
	 key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256)
	(Client did not present a certificate)
	by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4bVPlB5czkz5B
	for ; Sun, 29 Jun 2025 09:54:14 +0000 (UTC)
	(envelope-from bugzilla-noreply@freebsd.org)
Received: from kenobi.freebsd.org ([127.0.1.5])
	by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 55T9sEhe039255
	for ; Sun, 29 Jun 2025 09:54:14 GMT
	(envelope-from bugzilla-noreply@freebsd.org)
Received: (from www@localhost)
	by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 55T9sErf039254
	for net@FreeBSD.org; Sun, 29 Jun 2025 09:54:14 GMT
	(envelope-from bugzilla-noreply@freebsd.org)
X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f
From: bugzilla-noreply@freebsd.org
To: net@FreeBSD.org
Subject: [Bug 287872] 14.3-STABLE boot time regression related to netlink and
 devd
Date: Sun, 29 Jun 2025 09:54:14 +0000
X-Bugzilla-Reason: AssignedTo
X-Bugzilla-Type: changed
X-Bugzilla-Watch-Reason: None
X-Bugzilla-Product: Base System
X-Bugzilla-Component: kern
X-Bugzilla-Version: 14.3-STABLE
X-Bugzilla-Keywords: regression
X-Bugzilla-Severity: Affects Some People
X-Bugzilla-Who: linimon@FreeBSD.org
X-Bugzilla-Status: New
X-Bugzilla-Resolution: 
X-Bugzilla-Priority: ---
X-Bugzilla-Assigned-To: net@FreeBSD.org
X-Bugzilla-Flags: 
X-Bugzilla-Changed-Fields: keywords
Message-ID: 
In-Reply-To: 
References: 
Content-Transfer-Encoding: quoted-printable
Content-Type: text/plain; charset="UTF-8"
X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/
Auto-Submitted: auto-generated
List-Id: Networking and TCP/IP with FreeBSD 
List-Archive: https://lists.freebsd.org/archives/freebsd-net
List-Help: 
List-Post: 
List-Subscribe: 
List-Unsubscribe: 
Sender: owner-freebsd-net@FreeBSD.org
MIME-Version: 1.0

https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D287872

Mark Linimon  changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
           Keywords|                            |regression

--=20
You are receiving this mail because:
You are the assignee for the bug.=

From nobody Sun Jun 29 11:16:42 2025
X-Original-To: net@mlmmj.nyi.freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1])
	by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4bVRZN5kQNz605v0
	for ; Sun, 29 Jun 2025 11:16:44 +0000 (UTC)
	(envelope-from bugzilla-noreply@freebsd.org)
Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3])
	(using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)
	 key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256
	 client-signature RSA-PSS (4096 bits) client-digest SHA256)
	(Client CN "mxrelay.nyi.freebsd.org", Issuer "R10" (verified OK))
	by mx1.freebsd.org (Postfix) with ESMTPS id 4bVRZN4kN4z49yg
	for ; Sun, 29 Jun 2025 11:16:44 +0000 (UTC)
	(envelope-from bugzilla-noreply@freebsd.org)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim;
	t=1751195804;
	h=from:from:reply-to:subject:subject:date:date:message-id:message-id:
	 to:to:cc:mime-version:mime-version:content-type:content-type:
	 content-transfer-encoding:content-transfer-encoding:
	 in-reply-to:in-reply-to:references:references;
	bh=CFHCAlI425kEgISBep0ySGqZSCCYZyR98z2uVN1VVCU=;
	b=ci1qYcVsxCUJNjyZdRqjGHya1j2Rsb0XMY6hlxeoYz5ApBoQ+5Oyf4vSrUiuP0r0bbQb3o
	nw7XdnUN9P2rTq2PE5Wm4Zct8LMmT/xUZsDD+E83inIGZ/jvtk450oLuGmaLK6qpka/QmB
	x4E/oAiSPAK9jVH5THqazgNiMCCzWShax31/1w8FLyvjYdTlF5erEHkn2S9aFZDhZVPvno
	WHH08Rk+CXn1jtzCdSetmGoBu5zOEZAyHjo7jjri4eg82TC23mR9rgfyPouVRDUCHeel5r
	QpfOba/Th+YkF0SR0T7tJZLNBNeVMtppGX7pHpJJk4pSX08YeKM+DuVuxDEhXg==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org;
	s=dkim; t=1751195804;
	h=from:from:reply-to:subject:subject:date:date:message-id:message-id:
	 to:to:cc:mime-version:mime-version:content-type:content-type:
	 content-transfer-encoding:content-transfer-encoding:
	 in-reply-to:in-reply-to:references:references;
	bh=CFHCAlI425kEgISBep0ySGqZSCCYZyR98z2uVN1VVCU=;
	b=G9pLsFjtNAFebhP1BWnWUkPRQxYDS0rgU/gd3QbbAFi4IR8ravncnqctK3VekW5gCytV3F
	LtfUzuJtpoxSPXxoQjtSRKIONCG99hTRwJ44Tvse7mkAR3vFuCB8O9b/2yCg3GpUQk2O7W
	rFIMkenAi+sWaZtgrP+u7nNX6g/2ok0fiRPr276ybwLroct+jXLONRIp/CMU+f8CnKvuPs
	lQSEc61tConjJDUb1LM/wWZqx5SEflwQkeJdGpKDR6+bWKfSjRScKMYBdk1XtM4nY2LAS+
	xSOKsTRMfJ3mhakt3DPS+EDlMisGVagvpXUL3aat9EmDfUxyU+FzpeY2bG8ewg==
ARC-Authentication-Results: i=1;
	mx1.freebsd.org;
	none
ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1751195804; a=rsa-sha256; cv=none;
	b=c47xL99XyytpNa5u7cfR2PYjLlZ30y7qwU9nezbBJV8HP75Ex6jeadoApDgrLS3jUxxf1k
	4Ym3TuNDdPMiWMMPSiSexVD9vv8ZGHQwMs8cfboZvQS2aQ2DpTDgAGTS8T8enRnw722sDf
	WjkHUdqjpkGdTkUlss3pazG56EbSWAsfZwd52WJcX+SONsMyPsCRzSz/xraT0EnhkFqBoy
	46KSTYiZ0xxCHtGH7Gdb/n2mj21qkIiOq1SZ5Fd1nNU1Zxsim1XuvaKbSYO0nNJfyLZJLm
	ViS0U2O3mw4wO8YHguf0ZwY4Tec7u3mULPu9dNOpVizt2K+Wii31U5NR3XicqQ==
Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d])
	(using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)
	 key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256)
	(Client did not present a certificate)
	by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4bVRZN4KpQz2Fm
	for ; Sun, 29 Jun 2025 11:16:44 +0000 (UTC)
	(envelope-from bugzilla-noreply@freebsd.org)
Received: from kenobi.freebsd.org ([127.0.1.5])
	by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 55TBGit1086847
	for ; Sun, 29 Jun 2025 11:16:44 GMT
	(envelope-from bugzilla-noreply@freebsd.org)
Received: (from www@localhost)
	by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 55TBGinl086845
	for net@FreeBSD.org; Sun, 29 Jun 2025 11:16:44 GMT
	(envelope-from bugzilla-noreply@freebsd.org)
X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f
From: bugzilla-noreply@freebsd.org
To: net@FreeBSD.org
Subject: [Bug 287872] 14.3-STABLE boot time regression related to netlink and
 devd
Date: Sun, 29 Jun 2025 11:16:42 +0000
X-Bugzilla-Reason: AssignedTo
X-Bugzilla-Type: changed
X-Bugzilla-Watch-Reason: None
X-Bugzilla-Product: Base System
X-Bugzilla-Component: kern
X-Bugzilla-Version: 14.3-STABLE
X-Bugzilla-Keywords: regression
X-Bugzilla-Severity: Affects Some People
X-Bugzilla-Who: eugen@freebsd.org
X-Bugzilla-Status: New
X-Bugzilla-Resolution: 
X-Bugzilla-Priority: ---
X-Bugzilla-Assigned-To: net@FreeBSD.org
X-Bugzilla-Flags: 
X-Bugzilla-Changed-Fields: 
Message-ID: 
In-Reply-To: 
References: 
Content-Transfer-Encoding: quoted-printable
Content-Type: text/plain; charset="UTF-8"
X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/
Auto-Submitted: auto-generated
List-Id: Networking and TCP/IP with FreeBSD 
List-Archive: https://lists.freebsd.org/archives/freebsd-net
List-Help: 
List-Post: 
List-Subscribe: 
List-Unsubscribe: 
Sender: owner-freebsd-net@FreeBSD.org
MIME-Version: 1.0

https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D287872

--- Comment #8 from Eugene Grosbein  ---
I tried to use hwpmc(4) to profile the kernel:

# kenv kern.hwpmc.logbuffersize=3D64
# kenv kern.hwpmc.nbuffers_pcpu=3D512
# kldload hwpmc

Then removed all vlans, stopped devd, recreated vlans. Then:

# pmcstat -S inst_retired.any_p -O devd.out &
# service devd start
# kill -INT %1
# pmcstat -R devd.out -g

And "gprof -l /boot/kernel/kernel inst_retired.any_p/kernel.gmon" shows the
following:

  %   cumulative   self              self     total
 time   seconds   seconds    calls  ms/call  ms/call  name
 44.5  131231.00 131231.00    28705  4571.71  4571.71  lock_delay [2]
 22.6  197818.00 66587.00    67341   988.80   988.80  DELAY [19]
  3.1  207038.00  9220.00     2875  3206.96  3807.34  pmap_remove_pages  [36]
  1.4  211181.00  4143.00     1134  3653.44  7948.42  pmap_enter_quick_lock=
ed
[38]
  1.3  215064.00  3883.00      956  4061.72  4138.80  get_pv_entry [48]
  1.3  218829.00  3765.00     1053  3575.50  4107.77  pmap_enter [45]
  1.0  221869.00  3040.00     1639  1854.79  4229.11  pmap_try_insert_pv_en=
try
[39]

Above profiling for stock /sbin/ifconfig using netlink. Below for
/sbin/ifconfig rebuilt without netlink and same profiling procedure:

  %   cumulative   self              self     total
 time   seconds   seconds    calls  ms/call  ms/call  name
 11.1     581.00   581.00      422  1376.78  1376.78  counter_u64_fetch [16]
  8.7    1037.00   456.00      226  2017.70  2017.70  DELAY [25]
  6.6    1383.00   346.00      375   922.67  1037.36  pmap_remove_pages [26]
  6.2    1709.00   326.00      187  1743.32  1743.32  strncmp [28]
  3.2    1875.00   166.00       10 16600.00 21475.00  rtsock_msg_buffer [49]
  2.6    2013.00   138.00       86  1604.65  1889.35  pmap_enter [52]
  2.3    2134.00   121.00      512   236.33  2146.13  sysctl_iflist [7]
  2.3    2253.00   119.00      124   959.68  1009.98  get_pv_entry [57]
  2.1    2361.00   108.00      220   490.91  1000.49  pmap_try_insert_pv_en=
try
[48]

--=20
You are receiving this mail because:
You are the assignee for the bug.=

From nobody Sun Jun 29 21:00:54 2025
X-Original-To: net@mlmmj.nyi.freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1])
	by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4bVhXR5Q27z60gD9
	for ; Sun, 29 Jun 2025 21:00:55 +0000 (UTC)
	(envelope-from bugzilla-noreply@FreeBSD.org)
Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3])
	(using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)
	 key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256
	 client-signature RSA-PSS (4096 bits) client-digest SHA256)
	(Client CN "mxrelay.nyi.freebsd.org", Issuer "R10" (verified OK))
	by mx1.freebsd.org (Postfix) with ESMTPS id 4bVhXR222Vz3YCL
	for ; Sun, 29 Jun 2025 21:00:55 +0000 (UTC)
	(envelope-from bugzilla-noreply@FreeBSD.org)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim;
	t=1751230855;
	h=from:from:reply-to:subject:subject:date:date:message-id:message-id:
	 to:to:cc:mime-version:mime-version:content-type:content-type:
	 content-transfer-encoding:content-transfer-encoding;
	bh=saoDrBvMCj0HoVXNbJJFYsnds+IBRBzm/XKAb5mSeGs=;
	b=oc7Gv1sfVeypvTOot55QYoFT3aKalbBt+z5HC2arcm/1oOe3ybBX1mj8eJjV30OZalNBsT
	rvIN11mgh0oRVeXidS8mq+1dy2mMG4HBXIxJcjYCUvrY3qfNe0VZdVUMd2j4kN1RYCXhLr
	M58SgFPVTSC23yMqtTOyBRMdh+9Nv9Vx+WRyJt+8/qaVupvbuuMaRnjXWAHC35hDiwXMrk
	Qhv+GbAZLugF0dw/eSbDzShBgn40uSchQKJblqg8IKiX5Jb6Un0twcM18zVfUoZiSQKNRD
	JxvrxPcDi3I9osbINVb/srBGnbrBgLxaRjjwC1eUJMXQa0kdk77nZBzKP/xCYA==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org;
	s=dkim; t=1751230855;
	h=from:from:reply-to:subject:subject:date:date:message-id:message-id:
	 to:to:cc:mime-version:mime-version:content-type:content-type:
	 content-transfer-encoding:content-transfer-encoding;
	bh=saoDrBvMCj0HoVXNbJJFYsnds+IBRBzm/XKAb5mSeGs=;
	b=CcZ5dPMxrJOFB8ldF62qDmdLzi2gccXhqaEf+1VH0LL88gbp9mDGREwC29Xj/dBVf+x2S/
	NqF0i/Q9DxNdcAnWD7k3ovz7cXEPHwV3TpUOypZtFi501juWUYizJPPRtCjluNIWVOCCE1
	3F+9MB7B8ePWePk9m02nzuDTUc2OZI4cwLXLCYtXi06JUfXUun2ExmTXn9c3EkaJj4a+W0
	rPc1BtUe+imUZlMr5CqiixpXCp0zmy3s2feen4zUhdqjSIR/v9VYV4lxjuh9abl0Moi4e/
	2JHJyvPhI7gL1mq2LpaAa6kaI0lm3BUasFXMAM5k4/Xu2qz+AzQHJk+IwWjzYA==
ARC-Authentication-Results: i=1;
	mx1.freebsd.org;
	none
ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1751230855; a=rsa-sha256; cv=none;
	b=aJc3AqDriRDDBQTufO9j+ul4cVasD9bvDOHIcO6L/xDs6LZJBPpgUbTJ+VCIaMYsrhe2ps
	MotTGE0pH64OtGXFIBsDBX39PUHhnfe1fuPFEg4i6tMxjGJolgG4BbxV0Agbbfx7hDLdy/
	l9yeh2EBcC4QCLw64F0zRZr0xUqyaUGuy2eDvVRreDtI2ZP3QBtwnk/pJodK1ax8J9rzh0
	7128gsLokWJt3ipF7ejzNdYEytUzZu0QbtbMcTbac0aFZKa/SZa1KHUjZcLW1zyjOoh12u
	WGK4cBzOBx9ku2CvfsmuUiUBj8Zr0oWB8gHWh6Li9shovTYQmkY1e9i+hxhHlg==
Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d])
	(using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)
	 key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256)
	(Client did not present a certificate)
	by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4bVhXR1Vbqzc27
	for ; Sun, 29 Jun 2025 21:00:55 +0000 (UTC)
	(envelope-from bugzilla-noreply@FreeBSD.org)
Received: from kenobi.freebsd.org ([127.0.1.5])
	by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 55TL0tSq021721
	for ; Sun, 29 Jun 2025 21:00:55 GMT
	(envelope-from bugzilla-noreply@FreeBSD.org)
Received: (from bugzilla@localhost)
	by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 55TL0taa021718
	for net@FreeBSD.org; Sun, 29 Jun 2025 21:00:55 GMT
	(envelope-from bugzilla-noreply@FreeBSD.org)
Message-Id: <202506292100.55TL0taa021718@kenobi.freebsd.org>
X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@FreeBSD.org using -f
From: bugzilla-noreply@FreeBSD.org
To: net@FreeBSD.org
Subject: Problem reports for net@FreeBSD.org that need special attention
Date: Sun, 29 Jun 2025 21:00:54 +0000
List-Id: Networking and TCP/IP with FreeBSD 
List-Archive: https://lists.freebsd.org/archives/freebsd-net
List-Help: 
List-Post: 
List-Subscribe: 
List-Unsubscribe: 
Sender: owner-freebsd-net@FreeBSD.org
MIME-Version: 1.0
Content-Type: multipart/alternative; boundary="17512308547.71F9B11.16881"
Content-Transfer-Encoding: 7bit


--17512308547.71F9B11.16881
Date: Sun, 29 Jun 2025 21:00:54 +0000
MIME-Version: 1.0
Content-Type: text/plain; charset="UTF-8"

To view an individual PR, use:
  https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=(Bug Id).

The following is a listing of current problems submitted by FreeBSD users,
which need special attention. These represent problem reports covering
all versions including experimental development code and obsolete releases.

Status      |    Bug Id | Description
------------+-----------+---------------------------------------------------
In Progress |    118111 | rc: network.subr Add MAC address based interface  

1 problems total for which you should take action.

--17512308547.71F9B11.16881
Date: Sun, 29 Jun 2025 21:00:54 +0000
MIME-Version: 1.0
Content-Type: text/html; charset="UTF-8"


The following is a listing of current problems submitted by FreeBSD users,
which need special attention. These represent problem reports covering
all versions including experimental development code and obsolete releases.

Status      |    Bug Id | Description
------------+-----------+---------------------------------------------------
In Progress |    118111 | rc: network.subr Add MAC address based interface 

1 problems total for which you should take action.


--17512308547.71F9B11.16881--