Date: Fri, 17 Mar 2023 07:23:59 +0100 From: Matthias Pfaller <leo@marco.de> To: stable@freebsd.org Subject: Re: Fwd: Kernel DHCP unpredictable/fails (PXE boot), userspace DHCP works just fine Message-ID: <0b95a502-eea0-46cc-5d0d-ec6e861ad51f@marco.de> In-Reply-To: <CAM2hQG-oDRsoccg3S1LykyUF=joWbdJz=GSPOnUroDRxjZ2_iQ@mail.gmail.com> References: <CAM2hQG-p=bfSh_nxuah9zcTBbz7HQ9pYyvOR2f6rC=CUGePKsg@mail.gmail.com> <CAM2hQG-oDRsoccg3S1LykyUF=joWbdJz=GSPOnUroDRxjZ2_iQ@mail.gmail.com>
next in thread | previous in thread | raw e-mail | index | archive | help
This is a cryptographically signed message in MIME format. --------------ms050308070205070808020400 Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit On 2023-03-16 21:44, Attila Nagy wrote: > Hi, > > As this is super annoying, I'm willing to pay a $500 bounty for solving this issue > (whomever is first, however I don't anticipate a big competition :) Having an invoice > would be best, but I'm willing to accept individuals as well). > I can't give remote access, but can run debug builds with serial console. stable/13 > branch. > > I have a bunch of netbooted machines, one set in a cluster is older (HP DL80 G9, > 2x8C, Intel I350 -igb- NICs), the other set is newer (HP XL225n G10, AMD EPYC2x16C, > BCM57412 -bnxt- NICs). > All of these boot from the network, which is basically: > - get IP and options with DHCP with the help of the NIC's PXE stack > - get the loader and kernel, start it > - do another round of DHCP from the kernel (bootp_subr.c) > - mount the root via NFS and let everything work as usual > > The problem is that the newer machines take an indefinite time to boot. The older > ones (with igb NIC) work reliably, they always boot fast. > The process of getting an IP address via DHCP (bootpc_call from bootp_subr.c) either > succeeds normally (in a few seconds), or takes a lot of time. > Common (measured) times to boot range from 10s of minutes to anywhere between a few > hours (1-6). > Sometimes it just gets stuck and couldn't get past bootpc_call (getting the DHCP lease). Do you have STP/RSTP enabled on the switch ports? When the link goes down when switching from firmware mode to kernel mode, the port will go back to blocking. When the dhcp requests don't make it to the dhcp server because of this and the link goes down and up again while retrying (don't know if this happens) you will get the same problem on the next try. As a simple test you could put a dumb unmanaged switch between your core network and the server. best regards, Matthias --------------ms050308070205070808020400 Content-Type: application/pkcs7-signature; name="smime.p7s" Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="smime.p7s" Content-Description: S/MIME Cryptographic Signature MIAGCSqGSIb3DQEHAqCAMIACAQExDzANBglghkgBZQMEAgEFADCABgkqhkiG9w0BBwEAAKCC DUcwggXSMIIDuqADAgECAhANWkFd0y31u4EWJee/nuAQMA0GCSqGSIb3DQEBCwUAMIGBMQsw CQYDVQQGEwJJVDEQMA4GA1UECAwHQmVyZ2FtbzEZMBcGA1UEBwwQUG9udGUgU2FuIFBpZXRy bzEXMBUGA1UECgwOQWN0YWxpcyBTLnAuQS4xLDAqBgNVBAMMI0FjdGFsaXMgQ2xpZW50IEF1 dGhlbnRpY2F0aW9uIENBIEczMB4XDTIyMDkxNTExMTMzMFoXDTIzMDkxNTExMTMzMFowFzEV MBMGA1UEAwwMbGVvQG1hcmNvLmRlMIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEA 71j1E3kubCJTUdz1VzJWgEaIsPUuiYmtoW7wz/0KRrbhBe3NFeDMjdgpDkzXip1W7Hvr9V+X pGql/HoZw680Rn3X9h3KbUULKVEsvrBm274J/5RCoTMYC9gAr9rQUgfbvKB2/U3k1cgfNP0N dhkC/5TboL/1pMJx8QUQ5ejD7/ki6trZggHXDPDmrdXU0ft6LUYydIQ4I8r3LQWRt4R45Bzo Bjmt/RANN48JeMOt99juX3T5Xuyv5nmEkLzSssqJjhJf4aXLjYPSTTB3N8LVlmcTINUUe9Rg zCth7MBQq+07weyZfk64w7VrejHiGgDqv6ix+Z1BRj/wVXWhUzgVtQIDAQABo4IBrTCCAakw DAYDVR0TAQH/BAIwADAfBgNVHSMEGDAWgBS+l6mqhL+AvxBTfQky+eEuMhvPdzB+BggrBgEF BQcBAQRyMHAwOwYIKwYBBQUHMAKGL2h0dHA6Ly9jYWNlcnQuYWN0YWxpcy5pdC9jZXJ0cy9h Y3RhbGlzLWF1dGNsaWczMDEGCCsGAQUFBzABhiVodHRwOi8vb2NzcDA5LmFjdGFsaXMuaXQv VkEvQVVUSENMLUczMBcGA1UdEQQQMA6BDGxlb0BtYXJjby5kZTBHBgNVHSAEQDA+MDwGBiuB HwEYATAyMDAGCCsGAQUFBwIBFiRodHRwczovL3d3dy5hY3RhbGlzLml0L2FyZWEtZG93bmxv YWQwHQYDVR0lBBYwFAYIKwYBBQUHAwIGCCsGAQUFBwMEMEgGA1UdHwRBMD8wPaA7oDmGN2h0 dHA6Ly9jcmwwOS5hY3RhbGlzLml0L1JlcG9zaXRvcnkvQVVUSENMLUczL2dldExhc3RDUkww HQYDVR0OBBYEFLxHW6QtOnvcSExiAJzldApYeUwAMA4GA1UdDwEB/wQEAwIFoDANBgkqhkiG 9w0BAQsFAAOCAgEAoXEsDkG5o4HzHnR5O5NKL9BfWAGpuWTx3BJlFYEFLMLzhREMc3Y88MaK /oXPtMc4JxZ3Dkbt7C63frcU+AeGqLgR8zVD5/15YdqFTTKuVlewShPnYUz/mCW9T5H/efgn bBA4taQ+hMH0sbqqijmMFqElOdwPIeCncfZ6uMfCU8rUq1Dna0J8DG1R8hTsIcy74+/MrNli mQEXOqMo0r40VRbbmTj5RaWwGz6rZ8iFAHynZWwtnxtT15coTSaCyRGnO1uRIUQ8cX+Jeq8r Fjb6rx3Lg9WzsLahUhzW4JkWGxOjGFqvF+ypVh2sSHM3Ih1Wl1pGjB9dV2PLOiPVmzTKbrsp 6nWdnCKwvwVAmj4goid3clANWYtg16Z3zdwGFBnKw7kAWrtxqHQPuRgZUcsVz8l6Y2CdBUM0 prKR+kRBKA6pnfStCvzZ1j0rp+wIz+xLLXKZfE+Ovh7075uo5j55nAg6cnaI0GY6TnT/72wN 4XCf7TJ9CGRSfUZPtzL2Z9Tq0qB14CJ8QcDxKy06j30KQrXnec4XNKsGFd2IpaPJ+arZBANV jJVDH/IS6jO48jcZSkTtlRk9CcrFYwGVaRgp1DLrJGixPQeKdW3evV5OCwDDtkmcOhtP/Jlj 1DMU9/M70HHIx1P3GsM5EwnX9a9oSiI4ODpgzO746ZYA8q0vAOUwggdtMIIFVaADAgECAhAX ED7ePYoctcoGUZPnykNrMA0GCSqGSIb3DQEBCwUAMGsxCzAJBgNVBAYTAklUMQ4wDAYDVQQH DAVNaWxhbjEjMCEGA1UECgwaQWN0YWxpcyBTLnAuQS4vMDMzNTg1MjA5NjcxJzAlBgNVBAMM HkFjdGFsaXMgQXV0aGVudGljYXRpb24gUm9vdCBDQTAeFw0yMDA3MDYwODQ1NDdaFw0zMDA5 MjIxMTIyMDJaMIGBMQswCQYDVQQGEwJJVDEQMA4GA1UECAwHQmVyZ2FtbzEZMBcGA1UEBwwQ UG9udGUgU2FuIFBpZXRybzEXMBUGA1UECgwOQWN0YWxpcyBTLnAuQS4xLDAqBgNVBAMMI0Fj dGFsaXMgQ2xpZW50IEF1dGhlbnRpY2F0aW9uIENBIEczMIICIjANBgkqhkiG9w0BAQEFAAOC Ag8AMIICCgKCAgEA7eaHlqHBpLbtwkJV9z8PDyJgXxPgpkOIhkmReRwbLxpQD9xGAe72ujqG zFFh78QPgAhxKVqtGHzYeq0VJVCzhnCKRBbVX+JwIhL3ULYhUAZrViUp952qDB6qTL5sGeJS 9F69VPSR5k6pFNw7mHDTTt0voWFg2aVkG3khomzVXoieJGOiQ4dH76paCtQbLkt59joAKz2B nwGLQ4wr09nfumJt5AKx2YxHK2XgSPslVZ4z8G00gimsfA7UtjT/wiekY6Z0b7ksLrEcvODn cHQe9VSrNRA149SE3AlkWaZM/joVei/GYfj9K5jkiReinR4mqM353FEceLOeBhSTURpMdQ5w sXLi9DSTGBuNv4aw2Dozb/qBlkhGTvwk92mi0jAecE22Sn3A9UfrU2p1w/uRs+TIteQ0xO0B /J2mY2caqocsS9SsriIGlQ8b0LT0o6Ob07KGtPa5/lIvMmx572Dv2v+vDiECByxm1Hdgjp8J tE4mdyYP6GBscJyT71NZw1zXHnFkyCbxReag9qaSR9x4CVVXj1BDmNROCqd5NAfIXUXYTFeZ /jukQigkxXGWhEhfLBC4Ha6pwizz9fq1+wwPKcWaF9P/SZOuBDrG30MiyCZa66G9mEtF5ZLu h4rGfKqxy4Z5Mxecuzt+MZmrSKfKGeXOeED/iuX5Z02M1o7iMS8CAwEAAaOCAfQwggHwMA8G A1UdEwEB/wQFMAMBAf8wHwYDVR0jBBgwFoAUUtiIOsifeGbtifN7OHCUyQICNtAwQQYIKwYB BQUHAQEENTAzMDEGCCsGAQUFBzABhiVodHRwOi8vb2NzcDA1LmFjdGFsaXMuaXQvVkEvQVVU SC1ST09UMEUGA1UdIAQ+MDwwOgYEVR0gADAyMDAGCCsGAQUFBwIBFiRodHRwczovL3d3dy5h Y3RhbGlzLml0L2FyZWEtZG93bmxvYWQwHQYDVR0lBBYwFAYIKwYBBQUHAwIGCCsGAQUFBwME MIHjBgNVHR8EgdswgdgwgZaggZOggZCGgY1sZGFwOi8vbGRhcDA1LmFjdGFsaXMuaXQvY24l M2RBY3RhbGlzJTIwQXV0aGVudGljYXRpb24lMjBSb290JTIwQ0EsbyUzZEFjdGFsaXMlMjBT LnAuQS4lMmYwMzM1ODUyMDk2NyxjJTNkSVQ/Y2VydGlmaWNhdGVSZXZvY2F0aW9uTGlzdDti aW5hcnkwPaA7oDmGN2h0dHA6Ly9jcmwwNS5hY3RhbGlzLml0L1JlcG9zaXRvcnkvQVVUSC1S T09UL2dldExhc3RDUkwwHQYDVR0OBBYEFL6XqaqEv4C/EFN9CTL54S4yG893MA4GA1UdDwEB /wQEAwIBBjANBgkqhkiG9w0BAQsFAAOCAgEAJpvnG1kNdLMSA+nnVfeEgIXNQsM7YRxXx6bm Et9IIrFlH1qYKeNw4NV8xtop91Rle168wghmYeCTP10FqfuKMZsleNkI8/b3PBkZLIKOl9p2 Dmz2Gc0I3WvcMbAgd/IuBtx998PJX/bBb5dMZuGV2drNmxfz3ar6ytGYLxedfjKCD55Yv8CQ cN6e9sW5OUm9TJ3kjt7Wdvd1hcw5s+7bhlND38rWFJBuzump5xqm1NSOggOkFSlKnhSz6HUj gwBaid6Ypig9L1/TLrkmtEIpx+wpIj7WTA9JqcMMyLJ0rN6jjpetLSGUDk3NCOpQntSy4a8+ 0O+SepzS/Tec1cGdSN6Ni2/A7ewQNd1Rbmb2SM2qVBlfN0e6ZklWo9QYpNZyf0d/d3upsKab E9eNCg1S4eDnp8sJqdlaQQ7hI/UYCAgDtLIm7/J9+/S2zuwEWtJMPcvaYIBczdjwF9uW+8NJ /Zu/JKb98971uua7OsJexPFRBzX7/PnJ2/NXcTdwudShJc/pd9c3IRU7qw+RxRKchIczv3zE uQJMHkSSM8KM8TbOzi/0v0lU6SSyS9bpGdZZxx19Hd8Qs0cv+R6nyt7ohttizwefkYzQ6Gzw IwM9gSjH5Bf/r9Kc5/JqqpKKUGicxAGy2zKYEGB0Qo761MccIyclBW9mfuNFDbTBeDEyu80x ggPzMIID7wIBATCBljCBgTELMAkGA1UEBhMCSVQxEDAOBgNVBAgMB0JlcmdhbW8xGTAXBgNV BAcMEFBvbnRlIFNhbiBQaWV0cm8xFzAVBgNVBAoMDkFjdGFsaXMgUy5wLkEuMSwwKgYDVQQD DCNBY3RhbGlzIENsaWVudCBBdXRoZW50aWNhdGlvbiBDQSBHMwIQDVpBXdMt9buBFiXnv57g EDANBglghkgBZQMEAgEFAKCCAi0wGAYJKoZIhvcNAQkDMQsGCSqGSIb3DQEHATAcBgkqhkiG 9w0BCQUxDxcNMjMwMzE3MDYyMzU5WjAvBgkqhkiG9w0BCQQxIgQgeaYL85LDkxtCjGFA0GTb hkj2E1XarLl0AzPFJXgYwHAwbAYJKoZIhvcNAQkPMV8wXTALBglghkgBZQMEASowCwYJYIZI AWUDBAECMAoGCCqGSIb3DQMHMA4GCCqGSIb3DQMCAgIAgDANBggqhkiG9w0DAgIBQDAHBgUr DgMCBzANBggqhkiG9w0DAgIBKDCBpwYJKwYBBAGCNxAEMYGZMIGWMIGBMQswCQYDVQQGEwJJ VDEQMA4GA1UECAwHQmVyZ2FtbzEZMBcGA1UEBwwQUG9udGUgU2FuIFBpZXRybzEXMBUGA1UE CgwOQWN0YWxpcyBTLnAuQS4xLDAqBgNVBAMMI0FjdGFsaXMgQ2xpZW50IEF1dGhlbnRpY2F0 aW9uIENBIEczAhANWkFd0y31u4EWJee/nuAQMIGpBgsqhkiG9w0BCRACCzGBmaCBljCBgTEL MAkGA1UEBhMCSVQxEDAOBgNVBAgMB0JlcmdhbW8xGTAXBgNVBAcMEFBvbnRlIFNhbiBQaWV0 cm8xFzAVBgNVBAoMDkFjdGFsaXMgUy5wLkEuMSwwKgYDVQQDDCNBY3RhbGlzIENsaWVudCBB dXRoZW50aWNhdGlvbiBDQSBHMwIQDVpBXdMt9buBFiXnv57gEDANBgkqhkiG9w0BAQEFAASC AQC7j8ol7ePpu9fD1ZCPmuJT8unrBicrAbBoKXGvKH6aRpDVQPD/rL2Y73XsaMvPMxW2ydoh Wmvns3iCWQm/Kjj6EqyyDcDeqEQ37yRPdiUaT3/qyqK3vnk4UPIo9XARX+LWmpQVX1XjJuj1 YAJXuRazd4Aq5uMxzT12qtjqvFwi1G7T3B6EF2GBA8HLzTYrrJA2T907dQc88tQ+h13HpBhU Bq1YXktmhr7pX/AYWO1qIWWCA4/jW2pW1ZqiNJ0ndK5OOi8oNEBkd1ARGJsPIOgBnZml3LO2 por/cwVxg01OfiXNjxYGRa7QxhDNjohhA8YWdfT+CI954kU8PFEitPxEAAAAAAAA --------------ms050308070205070808020400--
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?0b95a502-eea0-46cc-5d0d-ec6e861ad51f>