From nobody Mon Apr 22 05:59:48 2024 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4VNF2k4fJXz5JNnH for ; Mon, 22 Apr 2024 05:59:58 +0000 (UTC) (envelope-from gerrit.kuehn@aei.mpg.de) Received: from umail2.aei.mpg.de (umail2.aei.mpg.de [194.94.224.8]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4VNF2j4vwrz4qn3; Mon, 22 Apr 2024 05:59:57 +0000 (UTC) (envelope-from gerrit.kuehn@aei.mpg.de) Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of gerrit.kuehn@aei.mpg.de designates 194.94.224.8 as permitted sender) smtp.mailfrom=gerrit.kuehn@aei.mpg.de Received: from arc.aei.uni-hannover.de (ahgate1.aei.uni-hannover.de [130.75.117.49]) by umail2.aei.mpg.de (Postfix) with ESMTPS id EEE921BA06E1; Mon, 22 Apr 2024 07:59:54 +0200 (CEST) Date: Mon, 22 Apr 2024 07:59:48 +0200 From: Gerrit =?UTF-8?B?S8O8aG4=?= To: Dag-Erling =?UTF-8?B?U23DuHJncmF2?= Cc: freebsd-stable@freebsd.org Subject: Re: possible regression handling packet fragmentation in 14.0 with tftp/pxe Message-ID: <20240422075948.5bb856ac@arc.aei.uni-hannover.de> In-Reply-To: <86y1999wwe.fsf@ltc.des.dev> References: <20240419153951.5a23ce5f@arc.aei.uni-hannover.de> <86y1999wwe.fsf@ltc.des.dev> Organization: MPG X-Mailer: Claws Mail 3.19.0 (GTK+ 2.24.33; amd64-portbld-freebsd13.1) List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-stable@freebsd.org Sender: owner-freebsd-stable@FreeBSD.org MIME-Version: 1.0 Content-Type: multipart/signed; boundary="Sig_/Gdv=.qnOy7tmj3EMLUFINuV"; protocol="application/pkcs7-signature"; micalg=SHA384 X-Spamd-Bar: ----- X-Spamd-Result: default: False [-5.70 / 15.00]; SIGNED_SMIME(-2.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-0.998]; NEURAL_HAM_SHORT(-0.90)[-0.904]; RCVD_IN_DNSWL_MED(-0.20)[194.94.224.8:from]; RWL_MAILSPIKE_VERYGOOD(-0.20)[194.94.224.8:from]; MIME_GOOD(-0.20)[multipart/signed,text/plain]; R_SPF_ALLOW(-0.20)[+ip4:194.94.224.8]; RCVD_COUNT_ONE(0.00)[1]; MIME_TRACE(0.00)[0:+,1:+,2:~]; TO_DN_SOME(0.00)[]; ASN(0.00)[asn:680, ipnet:194.94.0.0/15, country:DE]; ARC_NA(0.00)[]; HAS_ORG_HEADER(0.00)[]; RCVD_TLS_ALL(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; FROM_EQ_ENVFROM(0.00)[]; FROM_HAS_DN(0.00)[]; R_DKIM_NA(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MLMMJ_DEST(0.00)[freebsd-stable@freebsd.org]; DMARC_NA(0.00)[mpg.de]; HAS_ATTACHMENT(0.00)[] X-Rspamd-Queue-Id: 4VNF2j4vwrz4qn3 --Sig_/Gdv=.qnOy7tmj3EMLUFINuV Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Am Fri, 19 Apr 2024 17:48:01 +0200 schrieb Dag-Erling Sm=C3=B8rgrav : > Since you control the routers and endpoints, I would suggest running > tcpdump at various points to see what is the tunnel and pf are doing to > the UDP packets. They are presumably getting fragmented at some point, > and hopefully reassembled somewhere else. Yes, I can acces all tap, bridge, and ethernet interfaces along the way (well, apart from what the pxe client actually receives, this is hidden in its firmware). However, I already did that last week but was not able to spot the culprit (the packet being sent back to the pxe client machine is 1460 bytes, so it looks complete to me but is obviously not accepted on the client's end). I'll probably have to read up more on tcpdump and fragmentation handling first to get a better understanding of what I am actually looking for. Any idea what the "bad length 1460 > 1392" message on the 13.3 system means (and why everything is still working)? > Meanwhile you can also set the net.inet.udp.maxdgram sysctl to 1425 on > the NFS server, as tftpd will cap the blocksize to that value. That's an interesting hint I didn't see before. thanks. As the server is used by a bunch of systems and the "-o" option works around the issue for me right now, I will probably refrain from toying with the setting on the production system and see if I can come up with a separate test setup instead. I am working on a new server machine that will come with a migration from syslinux/mbr to ipxe/uefi and thus reduce the usage of tftp (it will only be used for the first ipxe firmware/bootloader step then - bootmenu, kernel and initramfs will be transferred over http). This might give me a good test environment where I can try things without breaking the production system. As this appears to be different behaviour on 13.3 and 14.0, I had hoped this might already be sufficient to ring a bell for someone here reading this (like "oh, yes, there were changes in pf that cause different handling of fragmented udp packets"). I hope I can soon dig up more information. cu Gerrit --Sig_/Gdv=.qnOy7tmj3EMLUFINuV Content-Type: application/pkcs7-signature; name=smime.p7s Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename=smime.p7s MIAGCSqGSIb3DQEHAqCAMIACAQExDzANBglghkgBZQMEAgIFADCABgkqhkiG9w0B BwEAAKCCF/QwggQyMIIDGqADAgECAgEBMA0GCSqGSIb3DQEBBQUAMHsxCzAJBgNV BAYTAkdCMRswGQYDVQQIDBJHcmVhdGVyIE1hbmNoZXN0ZXIxEDAOBgNVBAcMB1Nh bGZvcmQxGjAYBgNVBAoMEUNvbW9kbyBDQSBMaW1pdGVkMSEwHwYDVQQDDBhBQUEg Q2VydGlmaWNhdGUgU2VydmljZXMwHhcNMDQwMTAxMDAwMDAwWhcNMjgxMjMxMjM1 OTU5WjB7MQswCQYDVQQGEwJHQjEbMBkGA1UECAwSR3JlYXRlciBNYW5jaGVzdGVy MRAwDgYDVQQHDAdTYWxmb3JkMRowGAYDVQQKDBFDb21vZG8gQ0EgTGltaXRlZDEh MB8GA1UEAwwYQUFBIENlcnRpZmljYXRlIFNlcnZpY2VzMIIBIjANBgkqhkiG9w0B AQEFAAOCAQ8AMIIBCgKCAQEAvkCd9G7h6naHHE1FRI6+RsiDBp3BKv4YH47kAvrz q11QihYxC5oG0MVwIs1JLVRjzLZuaEYLU+rLTCTAvHJO6vEVrvRUmhIKw3qyM2Di 2olV8yJY897cz++DhqKMlE+faPKYkEaEJ8d2v+PMNSyLXgdkZYLASLCokflhn3Yg UKiRx2a163hiA1bwihoT6jGjHqCZ/Tj29icyWG8H9Wu4+xQrr7eqzNZjX3OM2gWZ qDioyxd4NlGs6Z70eDqNzw/ZQuKYDKsvnw4B3u+fmUnxLd+sdE0bmLVHxeUp0fmQ GMdinL6DxyZ7Poolx8DdneY1aBAgnY/Y3tLDhJwNXugvyQIDAQABo4HAMIG9MB0G A1UdDgQWBBSgEQojPpbxB+zirynvgqV/0DCktDAOBgNVHQ8BAf8EBAMCAQYwDwYD VR0TAQH/BAUwAwEB/zB7BgNVHR8EdDByMDigNqA0hjJodHRwOi8vY3JsLmNvbW9k b2NhLmNvbS9BQUFDZXJ0aWZpY2F0ZVNlcnZpY2VzLmNybDA2oDSgMoYwaHR0cDov L2NybC5jb21vZG8ubmV0L0FBQUNlcnRpZmljYXRlU2VydmljZXMuY3JsMA0GCSqG SIb3DQEBBQUAA4IBAQAIVvwC8Jvo/6T61nvGRIDOT8TF9gBYzKa2vBRJaAR26Obu XewCD2DWjVAYTyZOAePmsKXuv7x0VEG//fwSuMdPWvSJYAV/YLcFSvP28cK/xLl0 hrYtfWvM0vNG3S/G4GrDwzQDLH2W3VrCDqcKmcEFi6sML/NcOs9sN1UJh95TQGxY 7/y2q2VuBPYb3DzgWhXGntnxWUgwIWUDbOzpIXPsmwOh4DetoBUYj/q6As6nLKkQ EyzU5QgmqyKXYPiQXnTUoppTvfKpaOCibsLXbLGjD56/62jnVvKu8uMrODoJgbVr hde+Le0/GreyY+L1YiyC1GoAQVDxOYOflek2lphuMIIFgTCCBGmgAwIBAgIQOXJE Ovkit1HX02wQ3TE1lTANBgkqhkiG9w0BAQwFADB7MQswCQYDVQQGEwJHQjEbMBkG A1UECAwSR3JlYXRlciBNYW5jaGVzdGVyMRAwDgYDVQQHDAdTYWxmb3JkMRowGAYD VQQKDBFDb21vZG8gQ0EgTGltaXRlZDEhMB8GA1UEAwwYQUFBIENlcnRpZmljYXRl IFNlcnZpY2VzMB4XDTE5MDMxMjAwMDAwMFoXDTI4MTIzMTIzNTk1OVowgYgxCzAJ BgNVBAYTAlVTMRMwEQYDVQQIEwpOZXcgSmVyc2V5MRQwEgYDVQQHEwtKZXJzZXkg Q2l0eTEeMBwGA1UEChMVVGhlIFVTRVJUUlVTVCBOZXR3b3JrMS4wLAYDVQQDEyVV U0VSVHJ1c3QgUlNBIENlcnRpZmljYXRpb24gQXV0aG9yaXR5MIICIjANBgkqhkiG 9w0BAQEFAAOCAg8AMIICCgKCAgEAgBJlFzYOw9sIs9CsVw127c0n00ytUINh4qog TQktZAnczomfzD2p7PbPwdzx07HWezcoEStH2jnGvDoZtF+mvX2do2NCtnbyqTsr kfjib9DsFiCQCT7i6HTJGLSR1GJk23+jBvGIGGqQIjy8/hPwhxR79uQfjtTkUcYR Z0YIUcuGFFQ/vDP+fmyc/xadGL1RjjWmp2bIcmfbIWax1Jt4A8BQOujM8Ny8nkz+ rwWWNR9XWrf/zvk9tyy29lTdyOcSOk2uTIq3XJq0tyA9yn8iNK5+O2hmAUTnAU5G U5szYPeUvlM3kHND8zLDU+/bqv50TmnHa4xgk97Exwzf4TKuzJM7UXiVZ4vuPVb+ DNBpDxsP8yUmazNt925H+nND5X4OpWaxKXwyhGNVicQNwZNUMBkTrNN9N6frXTps NVzbQdcS2qlJC9/YgIoJk2KOtWbPJYjNhLixP6Q5D9kCnusSTJV882sFqV4Wg8y4 Z+LoE53MW4LTTLPtW//e5XOsIzstAL81VXQJSdhJWBp/kjbmUZIO8yZ9HE0XvMns QybQv0FfQKlERPSZ51eHnlAfV1SoPv10Yy+xUGUJ5lhCLkMaTLTwJUdZ+gQek9Qm RkpQgbLevni3/GcV4clXhB4PY9bpYrrWX1Uu6lzGKAgEJTm4Diup8kyXHAc/DVL1 7e8vgg8CAwEAAaOB8jCB7zAfBgNVHSMEGDAWgBSgEQojPpbxB+zirynvgqV/0DCk tDAdBgNVHQ4EFgQUU3m/WqorSs9UgOHYm8Cd8rIDZsswDgYDVR0PAQH/BAQDAgGG MA8GA1UdEwEB/wQFMAMBAf8wEQYDVR0gBAowCDAGBgRVHSAAMEMGA1UdHwQ8MDow OKA2oDSGMmh0dHA6Ly9jcmwuY29tb2RvY2EuY29tL0FBQUNlcnRpZmljYXRlU2Vy dmljZXMuY3JsMDQGCCsGAQUFBwEBBCgwJjAkBggrBgEFBQcwAYYYaHR0cDovL29j c3AuY29tb2RvY2EuY29tMA0GCSqGSIb3DQEBDAUAA4IBAQAYh1HcdCE9nIrgJ7cz 0C7M7PDmy14R3iJvm3WOnnL+5Nb+qh+cli3vA0p+rvSNb3I8QzvAP+u431yqqcau 8vzY7qN7Q/aGNnwU4M309z/+3ri0ivCRlv79Q2R+/czSAaF9ffgZGclCKxO/WIu6 pKJmBHaIkU4MiRTOok3JMrO66BQavHHxW/BBC5gACiIDEOUMsfnNkjcZ7Tvx5Dq2 +UUTJnWvu6rvP3t3O9LEApE9GQDTF1w52z97GA1FzZOFli9d31kWTz9RvdVFGD/t So7oBmF0Ixa1DVBzJ0RHfxBdiSprhTEUxOipakyAvGp4z7h/jnZymQyd/teRCBah o1+VMIIG5jCCBM6gAwIBAgIQMQJw1DW+mySa+FbQ4eKFSTANBgkqhkiG9w0BAQwF ADCBiDELMAkGA1UEBhMCVVMxEzARBgNVBAgTCk5ldyBKZXJzZXkxFDASBgNVBAcT C0plcnNleSBDaXR5MR4wHAYDVQQKExVUaGUgVVNFUlRSVVNUIE5ldHdvcmsxLjAs BgNVBAMTJVVTRVJUcnVzdCBSU0EgQ2VydGlmaWNhdGlvbiBBdXRob3JpdHkwHhcN MjAwMjE4MDAwMDAwWhcNMzMwNTAxMjM1OTU5WjBGMQswCQYDVQQGEwJOTDEZMBcG A1UEChMQR0VBTlQgVmVyZW5pZ2luZzEcMBoGA1UEAxMTR0VBTlQgUGVyc29uYWwg Q0EgNDCCAiIwDQYJKoZIhvcNAQEBBQADggIPADCCAgoCggIBALNK4iJeJ1vpBFsU BDUyIBSutNIxQMbNUMAeoUTKr55KYX8tkN5imzNqLaRCypYBPP9wED2AaO6e8njk bjzJwLgPqDBkW9sG3kmi3GW6cF4Hwr5ysZqve/5EJDhV+9OhfTu/4dMnoR4Q41Hc jMk9MzLOADAQ0awBZ/29r0d49AUmIKELNeqEqmnTN6fndL7x/2K0TLToZLxqS7sy /Jvi0wEFr0CfdjcAsioh7KaD+Jizyb1aRKQzJ6Q20VEHX7UqWc1SkzTkbz6xj0S5 ydBBFQh0fNiy+qM/deVpK4HgmPSJrrpQZ+LlbHfWabmwoDPxF71QZVYiqrrAoUrG RJ+47iLBiIg8miIYS7Hd2ppvAUt24CugMXUjETjQ+oYh09fNi5n/AvoER8UBvTHL xt+blL0bvL+2z2YiUWk+2Qtn+dD+JU5Z2y71qV7+cr+4YXjvGzF5bYsi8HiwflTb 4Php3y+k1twKtchdcq2QGc0eDG6Y01nRHUiyr8/PtMAsLHEPNZ2wzsA7fb8mftHi V20ZFmYqknJ8AIOfwdTVA+E62JayOJ+sxadqcmFDorsz/mrPwGZ8+txr4xSuvVjg 0dlv0yuA+1YpBDIYNfL4bkX+IcZ1mTstL4Xw0f4N2iW3bBmnPnYmoYxMM8gflCiT gss73nBvG2f7v1PD7BDGYNO4iD4vAgMBAAGjggGLMIIBhzAfBgNVHSMEGDAWgBRT eb9aqitKz1SA4dibwJ3ysgNmyzAdBgNVHQ4EFgQUaQChxyFY+ODFGyCwCt2nUb8T 2eQwDgYDVR0PAQH/BAQDAgGGMBIGA1UdEwEB/wQIMAYBAf8CAQAwHQYDVR0lBBYw FAYIKwYBBQUHAwIGCCsGAQUFBwMEMDgGA1UdIAQxMC8wLQYEVR0gADAlMCMGCCsG AQUFBwIBFhdodHRwczovL3NlY3RpZ28uY29tL0NQUzBQBgNVHR8ESTBHMEWgQ6BB hj9odHRwOi8vY3JsLnVzZXJ0cnVzdC5jb20vVVNFUlRydXN0UlNBQ2VydGlmaWNh dGlvbkF1dGhvcml0eS5jcmwwdgYIKwYBBQUHAQEEajBoMD8GCCsGAQUFBzAChjNo dHRwOi8vY3J0LnVzZXJ0cnVzdC5jb20vVVNFUlRydXN0UlNBQWRkVHJ1c3RDQS5j cnQwJQYIKwYBBQUHMAGGGWh0dHA6Ly9vY3NwLnVzZXJ0cnVzdC5jb20wDQYJKoZI hvcNAQEMBQADggIBAAoFTnsNjx8TOQD9b+xixsPt7Req4wHMeNw/R5dddEPgQAQA YJZKz5BEv1cjGbH7nbPH3AxrxhN6OVH40p6OLIo9MXSrrfMzGs7/P+FTCjwgNxFE tLQ1KC9NboA3asJcl7mIs3l8h9iAgEH1zLUvq2s+5n++NQmbzudDsTFDMapY3kX1 TwyUCTRzmItqcbsYIyg2MeIXWfRtqPqC5R4bufmpzA5BPINLX340Sp/CNQ9QZqw3 VkfyHWwTo+vO9Gm2L6srNamJT6Lb+TeXZvl8UPL5a72O/pH0GgGHjt6z9QzPARna RKshVWviNK6ST4WmZHllu3CJg0BXqx1vWyswawgvNeWt1qxITacYe9mSWTbNR2Cf tvTUwerruDSY2jMaZPoNqbjUpuG/blYwWzzvVerBUhviAahPXJF/9V48ybWPBq6q KOEokW+s3B4ad5sY96KlovEijaIQDip1HO0SD+rLNYaiBcr9MV2aK+DfbZ8w9BaN CQyFEYwzxIKOVk3bYvzHRk5ihUDascmbk/bkiNl74c/KfuKQmJImaqWoWZR6jBcX cPV0WUIKz/nILTpFhGojZEQW77by3aezAi9jrEIUBHRG1LwzPbJc2V3SOzYyaJFQ atzuKZbN1Q9s9y/2x1QXtKwREY8jNgvx0iIfOK35gKgYJJcyDql4XfuEc2nVMIIH SzCCBTOgAwIBAgIRAMCEqCZW/bEp9AgcdlGEWuEwDQYJKoZIhvcNAQEMBQAwRjEL MAkGA1UEBhMCTkwxGTAXBgNVBAoTEEdFQU5UIFZlcmVuaWdpbmcxHDAaBgNVBAMT E0dFQU5UIFBlcnNvbmFsIENBIDQwHhcNMjMwODE1MDAwMDAwWhcNMjYwODE0MjM1 OTU5WjCB0zEOMAwGA1UEERMFODA1MzkxRzBFBgNVBAoMPk1heC1QbGFuY2stR2Vz ZWxsc2NoYWZ0IHp1ciBGw7ZyZGVydW5nIGRlciBXaXNzZW5zY2hhZnRlbiBlLlYu MRswGQYDVQQJDBJIb2ZnYXJ0ZW5zdHJhw59lIDgxDzANBgNVBAgTBkJheWVybjEL MAkGA1UEBhMCREUxFTATBgNVBAMTDEdlcnJpdCBLdWVobjEmMCQGCSqGSIb3DQEJ ARYXZ2Vycml0Lmt1ZWhuQGFlaS5tcGcuZGUwggIiMA0GCSqGSIb3DQEBAQUAA4IC DwAwggIKAoICAQCg7n7fRC0hIeomyBYF0RZ0L/jKjURwqPL3vBN+HvDxzp+Wcn0a Voeia3LPeXvf18d7BeIQ2SVFXWnWzVpVKzv7VUg4OD424GmcQrFXkChSvOc/rLaA FmNIaKWgYwUOAqmDh3t9JzQTVj6FrAeJwzXmnv42msNUfnhA2dRllOCmilLUqm/5 nOgrImuiA3R1S0CcljAmEr5PnUmKJaanbaq74Jb54gf622cRyWwylMJijMGboDYw uaGynrLgfo+rWbXc2TASO6pjSQDKAAfXO/NzLgp+BmneN1II9alVUAJRUpFDkgx9 peM+qUJryLtO+veOKElsOe2S4qvk0PaE/MVAcIJiThdY7qde8Q9FyOJsDN5kiX4g fsKmtF7EdB71Uc8N78L62r7/7Y5WL8gRxXCN8BsmLXSiCylvtIYsbJMDhK6C+37w 9Cg1A8AWeksg1TmCcvolEJy3+bfPx7NlmEfRdkdzuVb1KxfB0z4SbhSwOAR1WYVg mEAQuj1l9k7suUtdUY4ZeMnRLVPtmQh+bxcJPaRllpHSTYbYVQlSNXkP0al2/J8d jJHhulOsCX8oYfyQ9a33jHsKUf632Lpg8446ym19UrNPh9pntXRXVhhkw+/tPE8G BxH81BCvvSUhVu0Nckx8zOWiI1+6Z5t71udnXOEv9lJFvqDlY71lkiu+jQIDAQAB o4IBpDCCAaAwHwYDVR0jBBgwFoAUaQChxyFY+ODFGyCwCt2nUb8T2eQwHQYDVR0O BBYEFOsacOXMtCWA1hWcY7A/tb8e/tTSMA4GA1UdDwEB/wQEAwIFoDAMBgNVHRMB Af8EAjAAMB0GA1UdJQQWMBQGCCsGAQUFBwMEBggrBgEFBQcDAjA/BgNVHSAEODA2 MDQGCysGAQQBsjEBAgJPMCUwIwYIKwYBBQUHAgEWF2h0dHBzOi8vc2VjdGlnby5j b20vQ1BTMEIGA1UdHwQ7MDkwN6A1oDOGMWh0dHA6Ly9HRUFOVC5jcmwuc2VjdGln by5jb20vR0VBTlRQZXJzb25hbENBNC5jcmwweAYIKwYBBQUHAQEEbDBqMD0GCCsG AQUFBzAChjFodHRwOi8vR0VBTlQuY3J0LnNlY3RpZ28uY29tL0dFQU5UUGVyc29u YWxDQTQuY3J0MCkGCCsGAQUFBzABhh1odHRwOi8vR0VBTlQub2NzcC5zZWN0aWdv LmNvbTAiBgNVHREEGzAZgRdnZXJyaXQua3VlaG5AYWVpLm1wZy5kZTANBgkqhkiG 9w0BAQwFAAOCAgEAbUB7zWvNZ98vh3u7hzpnbA1K4U9bga1YkpVbOgv7/UY5RiZP Rk06O18f5TnRSWiiF3XImBG1uVjbcwVKIemliCQRQzVVt2JXOJVT1EafDDe9DK5o QaXGHY7NAT1lPLEwtgv8hxBBvthMaMa6lpibT/IUi83jHPZUgsGajCgPXd05Bh/L jCzWDOmHuwFdjRAMQs1VsPYx+OVcRvS1jmw0bT6o5/nruRwF5brxUK39Mftj3sIN b+UvVkXdAGw5iQWFwllGpwBgo3iESa1R72qkBMWph8D6Jbg795WBgjMULCPTiZkq eOif9sW1/37AoutSh7VMh7WMrEW9QURVWYR1hYjS0/TMo8aXfPOLtLYoSg/R6i+j eXqREsJQxMAl0e/JJej1TAFCsWg0r6Dg4mYq636plAr6pu7pJATNVPT0HrsBMYWu PV2WRH8Obs+n1xe4ftGxE4yDWiL56lnp6tnfVR8qinEqpGBfj7BAwEcO/Na9b+oK tDEmWHzupKkdmoOWktURY+Q/5RVWoiozNujYljc9iaK3agqBbJ5ZzRyrCKOPLnw4 9b8koO03WkXPqlm59nxAOdJE6ZQ2aQ8ev6ji+UlGnlIvgk70MsRukY2shpAiowb6 bKjKyK3QGNnT4zmL6ixSRmnYhC95U923Yf+hy+6jqS1Ec6kgpREYG53Qv5IxggMs MIIDKAIBATBbMEYxCzAJBgNVBAYTAk5MMRkwFwYDVQQKExBHRUFOVCBWZXJlbmln aW5nMRwwGgYDVQQDExNHRUFOVCBQZXJzb25hbCBDQSA0AhEAwISoJlb9sSn0CBx2 UYRa4TANBglghkgBZQMEAgIFAKCBozAYBgkqhkiG9w0BCQMxCwYJKoZIhvcNAQcB MBwGCSqGSIb3DQEJBTEPFw0yNDA0MjIwNTU5NDhaMCgGCSqGSIb3DQEJDzEbMBkw CwYJYIZIAWUDBAECMAoGCCqGSIb3DQMHMD8GCSqGSIb3DQEJBDEyBDDFSviCbimK m//eW5w1mjcldm5WUNWRmk3cLfvTDDWswsf+bnF8XdSECpStTQfCHfkwDQYJKoZI hvcNAQEBBQAEggIAgPnyCmQRqgGFnYVclVtXJ59SFLYlkmYZez9pepdumLsMV/Zw YTUJbp50edmcAdW20SvleF/H2WZHLddFXA5WSXMH7je3b7t35FQIAmQb4LKEdoq+ e5C8vjpprrMhV1yr328fwoeSR+y2fzQbU/ghNDFkclTTOCuxYsZvKOe0I+Z32Aca BcxhDI4b3oSeaaf1SFXXH+2stF6AKUG9SIS9GlRNCaqt19p1giR5k1T/xcf1Y790 N2VGMGXTbYTckQvBetRHABCt79MPYF6JL31YxgfdGKX/RNbK49OoK4j+x74OGQOt kFBc6DlvmqcuFnjbnLFdm2nDwiJ/ebTvjrQfDye4sRUJQj6YIa8yowPzonV3zQ++ 6BBPsM04s+SwP0+/TIeO3TUGqt2HtczMAh4NtXVdq/gVBUpJYZjf7MwxRtT0gM0s HeryxzJIvkR+ZloMFk0koWq4rVH9qraEVybMVXIwsaScDRhh1P/IJ1mk+7GviZTA 3RbMs2eczrR/o+94SqI41bO+t4dk6WEt+2Gp+ulgeGHyk/InHeBGpibsK8yEedzx mrTTBYkh+OFGcKcbY0oBn2mrW7+R7RspXUEIaDPv+/qdEmwuCKiEYhHGY3yyTfbV r0CoprvSo94rfkfUN9/dCWT9o9yxiOqQF0iGIG5jsr8FhWtmdQ0lbND7JFkAAAAA AAA= --Sig_/Gdv=.qnOy7tmj3EMLUFINuV-- From nobody Mon Apr 22 13:57:42 2024 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4VNRf10P2Wz5H96G for ; Mon, 22 Apr 2024 13:57:45 +0000 (UTC) (envelope-from des@freebsd.org) Received: from smtp.freebsd.org (smtp.freebsd.org [96.47.72.83]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4VNRf070ztz4h1g; Mon, 22 Apr 2024 13:57:44 +0000 (UTC) (envelope-from des@freebsd.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1713794265; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=PXspAEBL8sNgVZxby7kYXXZEz5Y3pK/+qW/OUvqBi1g=; b=sLyjLiR2PzQljy1wU5QzgnhO69aOCnYMSnE/Khgy1TR2hidQDFHPNNiZL2oLjTish6B/HL 0QXHx/VER0svQq4eHaUUK/0ybR4HorjzafM5r7us1mJC7u1kBmSywcsJA4N/RjazQc7hvI Sr8ihh6b+X5cZjLqnca4oEOxKpWKDPw6+OxJENQoK0DysxsKvqzh+KxSshlFtQgEYMY/H6 DMmOG1luW2frStV3+r6mcJaInvxkADsMKQdAGS9jtuo2tWWQ+/haON+eJE013k04MsjpqZ s0ek5ym18ntXNVpfyYSTYFMZsgIaR5YdeCmtLhLAl30yJNKzaZ0BgUucGtsZtQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1713794265; a=rsa-sha256; cv=none; b=nbAvK7MSKOQgxLlctch9/XYbKXKDqv/h7BDk17RzsgPLC3J6dplw6f5GOyvXMRet3mQaI6 ngYzkBKnxBGG1xwlNEpkl2W/Zr5KcYc2dBfqswb9lKjmphVzyruBkImCdEZbpAzqprWiUv sewXGHVBTbr4vKvX/r0QKqtX5jtxtDk2zwoMzgkgt+XD+KOuLUeDvPq677+CAFwLeqH3ha htyCyQy/FfztGfFK0/kMMVVP4d87F/GU666pw+BpREhXm45AXHSsMYanpHmtbjjrz2BbuA ZoqJmIf+YLCRwC6A3C4qp+j/i6txVOxgtVik8stdRHTTV9bwiYn2u7CXSY8w9A== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1713794265; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=PXspAEBL8sNgVZxby7kYXXZEz5Y3pK/+qW/OUvqBi1g=; b=V4kmGtJ8qpPlDOB748ANRHSEbkeVmLSdSHZdBj1e7e2PI78LurnMoOfkiQfcX6nyaDzQXu mxVW4XGFp8cO1v+Scdo9Ko6BCQOyveyGE/RS6pNvqNIOHxIyC+akrfT+t/2IbI2ueGVGD4 y81QSB6D0i/woe1YVjRXVjOUz7FDuHAQHls+wVyf5IKYAOafYm62mZiMc1SpRZormBFs3H pHIGSXyqToQa1kbdlTFxYARSbhnm4PTWtq20RLO8UiCLwI4Edp958+Zc2L8cMpuwZiOwSl cFGZXHWDa1KyaV2X2rAcex583ZO94M98/kKYHT2FS15W4lyAq2a78dt/JL4jBA== Received: from ltc.des.dev (163.23.65.37.rev.sfr.net [37.65.23.163]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) (Authenticated sender: des) by smtp.freebsd.org (Postfix) with ESMTPSA id 4VNRf05tpvz1Lwq; Mon, 22 Apr 2024 13:57:44 +0000 (UTC) (envelope-from des@freebsd.org) Received: by ltc.des.dev (Postfix, from userid 1001) id BCBF11EB39; Mon, 22 Apr 2024 15:57:42 +0200 (CEST) From: =?utf-8?Q?Dag-Erling_Sm=C3=B8rgrav?= To: Gerrit =?utf-8?Q?K=C3=BChn?= Cc: freebsd-stable@freebsd.org Subject: Re: possible regression handling packet fragmentation in 14.0 with tftp/pxe In-Reply-To: <20240422075948.5bb856ac@arc.aei.uni-hannover.de> ("Gerrit =?utf-8?Q?K=C3=BChn=22's?= message of "Mon, 22 Apr 2024 07:59:48 +0200") References: <20240419153951.5a23ce5f@arc.aei.uni-hannover.de> <86y1999wwe.fsf@ltc.des.dev> <20240422075948.5bb856ac@arc.aei.uni-hannover.de> User-Agent: Gnus/5.13 (Gnus v5.13) Date: Mon, 22 Apr 2024 15:57:42 +0200 Message-ID: <86o7a18ppl.fsf@ltc.des.dev> List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-stable@freebsd.org Sender: owner-freebsd-stable@FreeBSD.org MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Gerrit K=C3=BChn writes: > Any idea what the "bad length 1460 > 1392" message on the 13.3 system > means (and why everything is still working)? Off the top of my head, it means the packet length according to its header is longer than the capture length but the MF flag is not set. Historically, it meant you needed to increase tcpdump's snaplen, but these days it defaults to 256 kB so it shouldn't matter. It might be a bug in bpf, or an interaction between pf and bpf. > As this appears to be different behaviour on 13.3 and 14.0, I had hoped > this might already be sufficient to ring a bell for someone here reading > this (like "oh, yes, there were changes in pf that cause different > handling of fragmented udp packets"). There were changes in tftpd, but I don't know if that's relevant. DES --=20 Dag-Erling Sm=C3=B8rgrav - des@FreeBSD.org From nobody Mon Apr 22 14:52:19 2024 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4VNSsB15Fnz5HGKC for ; Mon, 22 Apr 2024 14:52:30 +0000 (UTC) (envelope-from mike@sentex.net) Received: from smarthost1.sentex.ca (smarthost1.sentex.ca [IPv6:2607:f3e0:0:1::12]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smarthost1.sentex.ca", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4VNSs93W5qz4n26 for ; Mon, 22 Apr 2024 14:52:29 +0000 (UTC) (envelope-from mike@sentex.net) Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of mike@sentex.net designates 2607:f3e0:0:1::12 as permitted sender) smtp.mailfrom=mike@sentex.net Received: from pyroxene2a.sentex.ca (pyroxene19.sentex.ca [199.212.134.19]) by smarthost1.sentex.ca (8.17.1/8.16.1) with ESMTPS id 43MEqMIp088864 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=FAIL) for ; Mon, 22 Apr 2024 10:52:22 -0400 (EDT) (envelope-from mike@sentex.net) Received: from [IPV6:2607:f3e0:0:4:486a:7a6f:42a:68f5] ([IPv6:2607:f3e0:0:4:486a:7a6f:42a:68f5]) by pyroxene2a.sentex.ca (8.17.1/8.15.2) with ESMTPS id 43MEqJvO025787 (version=TLSv1.3 cipher=TLS_AES_128_GCM_SHA256 bits=128 verify=NO) for ; Mon, 22 Apr 2024 10:52:21 -0400 (EDT) (envelope-from mike@sentex.net) Message-ID: <9a593ca1-4975-438a-afec-d8dd5199dbcf@sentex.net> Date: Mon, 22 Apr 2024 10:52:19 -0400 List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-stable@freebsd.org Sender: owner-freebsd-stable@FreeBSD.org MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Content-Language: en-US To: FreeBSD-STABLE Mailing List From: mike tancsa Subject: block size: 512B configured, 4096B native all of a sudden Autocrypt: addr=mike@sentex.net; keydata= xsBNBFywzOMBCACoNFpwi5MeyEREiCeHtbm6pZJI/HnO+wXdCAWtZkS49weOoVyUj5BEXRZP xflV2ib2hflX4nXqhenaNiia4iaZ9ft3I1ebd7GEbGnsWCvAnob5MvDZyStDAuRxPJK1ya/s +6rOvr+eQiXYNVvfBhrCfrtR/esSkitBGxhUkBjOti8QwzD71JVF5YaOjBAs7jZUKyLGj0kW yDg4jUndudWU7G2yc9GwpHJ9aRSUN8e/mWdIogK0v+QBHfv/dsI6zVB7YuxCC9Fx8WPwfhDH VZC4kdYCQWKXrm7yb4TiVdBh5kgvlO9q3js1yYdfR1x8mjK2bH2RSv4bV3zkNmsDCIxjABEB AAHNHW1pa2UgdGFuY3NhIDxtaWtlQHNlbnRleC5uZXQ+wsCOBBMBCAA4FiEEmuvCXT0aY6hs 4SbWeVOEFl5WrMgFAl+pQfkCGwMFCwkIBwIGFQoJCAsCBBYCAwECHgECF4AACgkQeVOEFl5W rMiN6ggAk3H5vk8QnbvGbb4sinxZt/wDetgk0AOR9NRmtTnPaW+sIJEfGBOz47Xih+f7uWJS j+uvc9Ewn2Z7n8z3ZHJlLAByLVLtcNXGoRIGJ27tevfOaNqgJHBPbFOcXCBBFTx4MYMM4iAZ cDT5vsBTSaM36JZFtHZBKkuFEItbA/N8ZQSHKdTYMIA7A3OCLGbJBqloQ8SlW4MkTzKX4u7R yefAYQ0h20x9IqC5Ju8IsYRFacVZconT16KS81IBceO42vXTN0VexbVF2rZIx3v/NT75r6Vw 0FlXVB1lXOHKydRA2NeleS4NEG2vWqy/9Boj0itMfNDlOhkrA/0DcCurMpnpbM7ATQRcsMzk AQgA1Dpo/xWS66MaOJLwA28sKNMwkEk1Yjs+okOXDOu1F+0qvgE8sVmrOOPvvWr4axtKRSG1 t2QUiZ/ZkW/x/+t0nrM39EANV1VncuQZ1ceIiwTJFqGZQ8kb0+BNkwuNVFHRgXm1qzAJweEt RdsCMohB+H7BL5LGCVG5JaU0lqFU9pFP40HxEbyzxjsZgSE8LwkI6wcu0BLv6K6cLm0EiHPO l5G8kgRi38PS7/6s3R8QDsEtbGsYy6O82k3zSLIjuDBwA9GRaeigGppTxzAHVjf5o9KKu4O7 gC2KKVHPegbXS+GK7DU0fjzX57H5bZ6komE5eY4p3oWT/CwVPSGfPs8jOwARAQABwsB2BBgB CAAgFiEEmuvCXT0aY6hs4SbWeVOEFl5WrMgFAl+pQfkCGwwACgkQeVOEFl5WrMiVqwf9GwU8 c6cylknZX8QwlsVudTC8xr/L17JA84wf03k3d4wxP7bqy5AYy7jboZMbgWXngAE/HPQU95NM aukysSnknzoIpC96XZJ0okLBXVS6Y0ylZQ+HrbIhMpuQPoDweoF5F9wKrsHRoDaUK1VR706X rwm4HUzh7Jk+auuMYfuCh0FVlFBEuiJWMLhg/5WCmcRfiuB6F59ZcUQrwLEZeNhF2XJV4KwB Tlg7HCWO/sy1foE5noaMyACjAtAQE9p5kGYaj+DuRhPdWUTsHNuqrhikzIZd2rrcMid+ktb0 NvtvswzMO059z1YGMtGSqQ4srCArju+XHIdTFdiIYbd7+jeehg== Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit X-Scanned-By: MIMEDefang 2.86 X-Spamd-Bar: - X-Spamd-Result: default: False [-1.84 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_SPAM_SHORT(0.55)[0.549]; R_SPF_ALLOW(-0.20)[+ip6:2607:f3e0::/32]; MIME_GOOD(-0.10)[text/plain]; RCVD_IN_DNSWL_LOW(-0.10)[199.212.134.19:received]; XM_UA_NO_VERSION(0.01)[]; TO_DN_ALL(0.00)[]; RCVD_TLS_ALL(0.00)[]; ASN(0.00)[asn:11647, ipnet:2607:f3e0::/32, country:CA]; RCPT_COUNT_ONE(0.00)[1]; MIME_TRACE(0.00)[0:+]; FREEFALL_USER(0.00)[mike]; MID_RHS_MATCH_FROM(0.00)[]; MLMMJ_DEST(0.00)[freebsd-stable@freebsd.org]; DMARC_NA(0.00)[sentex.net]; FROM_EQ_ENVFROM(0.00)[]; FROM_HAS_DN(0.00)[]; R_DKIM_NA(0.00)[]; RCVD_COUNT_TWO(0.00)[2]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; TO_MATCH_ENVRCPT_ALL(0.00)[]; ARC_NA(0.00)[] X-Rspamd-Queue-Id: 4VNSs93W5qz4n26 I upgraded a RELENG_13 box from last March to one today to bring in some of the zfs bug fixes.  But now I have this warning on a pool that was not there before.  But the special devices (two 2TB samsungs) are 512 according to smartctl ?  Any idea why this warning popped up on the pool all of a sudden ? the disks and pool have been the same for a year or so. # smartctl -a /dev/da4 === START OF INFORMATION SECTION === Model Family:     Samsung based SSDs Device Model:     Samsung SSD 870 EVO 2TB Serial Number:    S6PNNM0W619793P LU WWN Device Id: 5 002538 fc36093bc Firmware Version: SVT02B6Q User Capacity:    2,000,398,934,016 bytes [2.00 TB] Sector Size:      512 bytes logical/physical Rotation Rate:    Solid State Device # zpool status zbackup1 -v   pool: zbackup1  state: ONLINE status: One or more devices are configured to use a non-native block size.         Expect reduced performance. action: Replace affected devices with devices that support the         configured block size, or migrate data to a properly configured         pool.   scan: scrub repaired 0B in 1 days 12:33:12 with 0 errors on Sun Dec 10 17:45:06 2023 config:         NAME                               STATE     READ WRITE CKSUM         zbackup1                           ONLINE       0 0     0           raidz1-0                         ONLINE       0 0     0             diskid/DISK-VAGGPZKLp1         ONLINE       0 0     0             diskid/DISK-VAHZDXALp1         ONLINE       0 0     0             diskid/DISK-VAJ0S1DLp1         ONLINE       0 0     0             diskid/DISK-VAHZRMSLp1         ONLINE       0 0     0             diskid/DISK-VAHZAN4Lp1         ONLINE       0 0     0           raidz1-2                         ONLINE       0 0     0             diskid/DISK-1EJD0HUZp1         ONLINE       0 0     0             diskid/DISK-1EJD5Y7Zp1         ONLINE       0 0     0             diskid/DISK-1EK5KGUZp1         ONLINE       0 0     0             diskid/DISK-1EK112WZp1         ONLINE       0 0     0         special           mirror-1                         ONLINE       0 0     0             diskid/DISK-S6PNNM0W619793Pp1  ONLINE       0 0     0  block size: 512B configured, 4096B native             diskid/DISK-S6PNNM0W619816Bp1  ONLINE       0 0     0  block size: 512B configured, 4096B native errors: No known data errors From nobody Mon Apr 22 15:18:46 2024 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4VNTRW4Sphz5HJCw for ; Mon, 22 Apr 2024 15:18:47 +0000 (UTC) (envelope-from des@freebsd.org) Received: from smtp.freebsd.org (smtp.freebsd.org [IPv6:2610:1c1:1:606c::24b:4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4VNTRW3yy8z4qTp; Mon, 22 Apr 2024 15:18:47 +0000 (UTC) (envelope-from des@freebsd.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1713799127; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=4P+EAowP2v5Cj80/lY7z4L9n4GpzNBT40UfMY0rrBhY=; b=EH7X7n1ttl4toLX68I9C//VkTdPJjbWtxDsVx1XEzchSHaQq1urC0EYAgXX6p6g+UmKcVV qR3AGAooRGuqCrfXheaPtr0GlWWz9+76hrGjtDI4wEF0irM7knjI+Ps3bmtzejGooYpCIC deMWDr2aV8hmkNqaprk1aWvxdPMFjJFFykwg/aKdLUoRUBStcvlgLgOo2JAAwvyIiwjBZp XvpZOSrarZeSUQvVH7QDAHFiNIIEcQDDh/nb7HkIercd0jmkENI/SMrNxtS6NLbrgiTDn/ Io8xPdsafQUkxwttPH2kFLtHSB4Me+vZw6UtWOXGdwm5z71Q/36d5TQ7ygj4/g== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1713799127; a=rsa-sha256; cv=none; b=yPQfEwe3vgpAE8ub9hBNdIWJMy08V4zwr1ZDUP/tOJ0Yp2TUY0QmqUIobNOzegcnjA5ajg i68f3oviAkzQQwzJtUEFgLs/rXMCRaBy/zmn3jtnemqDKskQafgQXkLdJ/VyGMkbn1ip70 GYde/az78whPYpG3dYVj6fuTUAWf9Md/0FfOUGEgZupZBMxMextJ/thkYaBuFuG4FTNo6L gIKnyLcCKmMPNF3j0MZ4ikeHCtJi1KEs0ZzngSKrUbm6F85mMkSrCBxe/u5J1Q83U1SCTG p1/9FwCpQUZYo+QQApAEQkVM864kXed1u9eaWLXFL3uCZLLTkZYq1MJHgPiO+Q== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1713799127; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=4P+EAowP2v5Cj80/lY7z4L9n4GpzNBT40UfMY0rrBhY=; b=Gc1BfdqLLJ/xtJ8fKYyxRL6xtcBkH1p8eu4kNvXpe4vDOAfZPLqTsM79bZ+XvzmLovl7kc 3xx63lb5j6kEGuYGUjwYE1Ums4WuPrvdKMgT1WnL93RiLySFmkAhF5yFRxeQUQUSwHUULj CRzNwKMlA2kNaKYOA3ugduHbd1XkIndvJZ+NZ3Dk46i5FnaasUibc2nFPeSKS87+JSQQbQ Wft2QRdlUMCuxIdGMfkB4LWmJQnWvodEh0IviPM4A6BJROfRgNTFY5iRHhWMNdfgxdANDO Lj+eZejaOyM8qdhscynx4MCHLbauKDUhtMStUO4qMs5VFzKUGe10AsUC7H3uMA== Received: from ltc.des.dev (2a02-8428-0993-f001-922e-16ff-fef1-acef.rev.sfr.net [IPv6:2a02:8428:993:f001:922e:16ff:fef1:acef]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) (Authenticated sender: des) by smtp.freebsd.org (Postfix) with ESMTPSA id 4VNTRW2qD4z1MV4; Mon, 22 Apr 2024 15:18:47 +0000 (UTC) (envelope-from des@freebsd.org) Received: by ltc.des.dev (Postfix, from userid 1001) id 3C3FE1F301; Mon, 22 Apr 2024 17:18:46 +0200 (CEST) From: =?utf-8?Q?Dag-Erling_Sm=C3=B8rgrav?= To: mike tancsa Cc: FreeBSD-STABLE Mailing List Subject: Re: block size: 512B configured, 4096B native all of a sudden In-Reply-To: <9a593ca1-4975-438a-afec-d8dd5199dbcf@sentex.net> (mike tancsa's message of "Mon, 22 Apr 2024 10:52:19 -0400") References: <9a593ca1-4975-438a-afec-d8dd5199dbcf@sentex.net> User-Agent: Gnus/5.13 (Gnus v5.13) Date: Mon, 22 Apr 2024 17:18:46 +0200 Message-ID: <86bk618lyh.fsf@ltc.des.dev> List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-stable@freebsd.org Sender: owner-freebsd-stable@FreeBSD.org MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable mike tancsa writes: > I upgraded a RELENG_13 box from last March to one today to bring in > some of the zfs bug fixes. But now I have this warning on a pool that > was not there before. But the special devices (two 2TB samsungs) are > 512 according to smartctl? Any idea why this warning popped up on the > pool all of a sudden? the disks and pool have been the same for a > year or so. what does `sysctl vfs.zfs.vdev.min_auto_ashift` say? > Sector Size: 512 bytes logical/physical The SSD is doing read-copy-update behind the scenes to support a 512-byte sector size for compatibility reasons, the real sector size is unlikely to be less than 4 kB and may actually be significantly larger. DES --=20 Dag-Erling Sm=C3=B8rgrav - des@FreeBSD.org From nobody Mon Apr 22 15:20:38 2024 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4VNTTg1qLQz5HJ7m for ; Mon, 22 Apr 2024 15:20:39 +0000 (UTC) (envelope-from mike@sentex.net) Received: from smarthost1.sentex.ca (smarthost1.sentex.ca [IPv6:2607:f3e0:0:1::12]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smarthost1.sentex.ca", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4VNTTg1QFtz4rFp; Mon, 22 Apr 2024 15:20:39 +0000 (UTC) (envelope-from mike@sentex.net) Authentication-Results: mx1.freebsd.org; none Received: from pyroxene2a.sentex.ca (pyroxene19.sentex.ca [199.212.134.19]) by smarthost1.sentex.ca (8.17.1/8.16.1) with ESMTPS id 43MFKd4n002214 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=FAIL); Mon, 22 Apr 2024 11:20:39 -0400 (EDT) (envelope-from mike@sentex.net) Received: from [IPV6:2607:f3e0:0:4:486a:7a6f:42a:68f5] ([IPv6:2607:f3e0:0:4:486a:7a6f:42a:68f5]) by pyroxene2a.sentex.ca (8.17.1/8.15.2) with ESMTPS id 43MFKcXA036090 (version=TLSv1.3 cipher=TLS_AES_128_GCM_SHA256 bits=128 verify=NO); Mon, 22 Apr 2024 11:20:38 -0400 (EDT) (envelope-from mike@sentex.net) Content-Type: multipart/alternative; boundary="------------i3NhsmX00aFPf00L2TS5AVAO" Message-ID: Date: Mon, 22 Apr 2024 11:20:38 -0400 List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-stable@freebsd.org Sender: owner-freebsd-stable@FreeBSD.org MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Subject: Re: block size: 512B configured, 4096B native all of a sudden To: =?UTF-8?Q?Dag-Erling_Sm=C3=B8rgrav?= Cc: FreeBSD-STABLE Mailing List References: <9a593ca1-4975-438a-afec-d8dd5199dbcf@sentex.net> <86bk618lyh.fsf@ltc.des.dev> Content-Language: en-US From: mike tancsa Autocrypt: addr=mike@sentex.net; keydata= xsBNBFywzOMBCACoNFpwi5MeyEREiCeHtbm6pZJI/HnO+wXdCAWtZkS49weOoVyUj5BEXRZP xflV2ib2hflX4nXqhenaNiia4iaZ9ft3I1ebd7GEbGnsWCvAnob5MvDZyStDAuRxPJK1ya/s +6rOvr+eQiXYNVvfBhrCfrtR/esSkitBGxhUkBjOti8QwzD71JVF5YaOjBAs7jZUKyLGj0kW yDg4jUndudWU7G2yc9GwpHJ9aRSUN8e/mWdIogK0v+QBHfv/dsI6zVB7YuxCC9Fx8WPwfhDH VZC4kdYCQWKXrm7yb4TiVdBh5kgvlO9q3js1yYdfR1x8mjK2bH2RSv4bV3zkNmsDCIxjABEB AAHNHW1pa2UgdGFuY3NhIDxtaWtlQHNlbnRleC5uZXQ+wsCOBBMBCAA4FiEEmuvCXT0aY6hs 4SbWeVOEFl5WrMgFAl+pQfkCGwMFCwkIBwIGFQoJCAsCBBYCAwECHgECF4AACgkQeVOEFl5W rMiN6ggAk3H5vk8QnbvGbb4sinxZt/wDetgk0AOR9NRmtTnPaW+sIJEfGBOz47Xih+f7uWJS j+uvc9Ewn2Z7n8z3ZHJlLAByLVLtcNXGoRIGJ27tevfOaNqgJHBPbFOcXCBBFTx4MYMM4iAZ cDT5vsBTSaM36JZFtHZBKkuFEItbA/N8ZQSHKdTYMIA7A3OCLGbJBqloQ8SlW4MkTzKX4u7R yefAYQ0h20x9IqC5Ju8IsYRFacVZconT16KS81IBceO42vXTN0VexbVF2rZIx3v/NT75r6Vw 0FlXVB1lXOHKydRA2NeleS4NEG2vWqy/9Boj0itMfNDlOhkrA/0DcCurMpnpbM7ATQRcsMzk AQgA1Dpo/xWS66MaOJLwA28sKNMwkEk1Yjs+okOXDOu1F+0qvgE8sVmrOOPvvWr4axtKRSG1 t2QUiZ/ZkW/x/+t0nrM39EANV1VncuQZ1ceIiwTJFqGZQ8kb0+BNkwuNVFHRgXm1qzAJweEt RdsCMohB+H7BL5LGCVG5JaU0lqFU9pFP40HxEbyzxjsZgSE8LwkI6wcu0BLv6K6cLm0EiHPO l5G8kgRi38PS7/6s3R8QDsEtbGsYy6O82k3zSLIjuDBwA9GRaeigGppTxzAHVjf5o9KKu4O7 gC2KKVHPegbXS+GK7DU0fjzX57H5bZ6komE5eY4p3oWT/CwVPSGfPs8jOwARAQABwsB2BBgB CAAgFiEEmuvCXT0aY6hs4SbWeVOEFl5WrMgFAl+pQfkCGwwACgkQeVOEFl5WrMiVqwf9GwU8 c6cylknZX8QwlsVudTC8xr/L17JA84wf03k3d4wxP7bqy5AYy7jboZMbgWXngAE/HPQU95NM aukysSnknzoIpC96XZJ0okLBXVS6Y0ylZQ+HrbIhMpuQPoDweoF5F9wKrsHRoDaUK1VR706X rwm4HUzh7Jk+auuMYfuCh0FVlFBEuiJWMLhg/5WCmcRfiuB6F59ZcUQrwLEZeNhF2XJV4KwB Tlg7HCWO/sy1foE5noaMyACjAtAQE9p5kGYaj+DuRhPdWUTsHNuqrhikzIZd2rrcMid+ktb0 NvtvswzMO059z1YGMtGSqQ4srCArju+XHIdTFdiIYbd7+jeehg== In-Reply-To: <86bk618lyh.fsf@ltc.des.dev> X-Scanned-By: MIMEDefang 2.86 X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:11647, ipnet:2607:f3e0::/32, country:CA] X-Rspamd-Queue-Id: 4VNTTg1QFtz4rFp This is a multi-part message in MIME format. --------------i3NhsmX00aFPf00L2TS5AVAO Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit On 4/22/2024 11:18 AM, Dag-Erling Smørgrav wrote: > mike tancsa writes: >> I upgraded a RELENG_13 box from last March to one today to bring in >> some of the zfs bug fixes. But now I have this warning on a pool that >> was not there before. But the special devices (two 2TB samsungs) are >> 512 according to smartctl? Any idea why this warning popped up on the >> pool all of a sudden? the disks and pool have been the same for a >> year or so. > what does `sysctl vfs.zfs.vdev.min_auto_ashift` say?  sysctl vfs.zfs.vdev.min_auto_ashift vfs.zfs.vdev.min_auto_ashift: 9 >> Sector Size: 512 bytes logical/physical > The SSD is doing read-copy-update behind the scenes to support a > 512-byte sector size for compatibility reasons, the real sector size is > unlikely to be less than 4 kB and may actually be significantly larger. Where what would be picking up the "true" size and why the change from a March 4th system to one today ?     ---Mike --------------i3NhsmX00aFPf00L2TS5AVAO Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: 8bit
On 4/22/2024 11:18 AM, Dag-Erling Smørgrav wrote:
mike tancsa <mike@sentex.net> writes:

I upgraded a RELENG_13 box from last March to one today to bring in
some of the zfs bug fixes.  But now I have this warning on a pool that
was not there before.  But the special devices (two 2TB samsungs) are
512 according to smartctl?  Any idea why this warning popped up on the
pool all of a sudden?  the disks and pool have been the same for a
year or so.

what does `sysctl vfs.zfs.vdev.min_auto_ashift` say?
 sysctl vfs.zfs.vdev.min_auto_ashift
vfs.zfs.vdev.min_auto_ashift: 9

      

        
Sector Size:      512 bytes logical/physical


      

      
The SSD is doing read-copy-update behind the scenes to support a
512-byte sector size for compatibility reasons, the real sector size is
unlikely to be less than 4 kB and may actually be significantly larger.


    

    
Where what would be picking up the "true" size and why the change
      from a March 4th system to one today ?

    
    ---Mike

    

    

  


--------------i3NhsmX00aFPf00L2TS5AVAO--

From nobody Mon Apr 22 15:29:21 2024
X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1])
	by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4VNTgk59j1z5HKDx
	for ; Mon, 22 Apr 2024 15:29:22 +0000 (UTC)
	(envelope-from des@freebsd.org)
Received: from smtp.freebsd.org (smtp.freebsd.org [96.47.72.83])
	(using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)
	 key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256
	 client-signature RSA-PSS (4096 bits) client-digest SHA256)
	(Client CN "smtp.freebsd.org", Issuer "R3" (verified OK))
	by mx1.freebsd.org (Postfix) with ESMTPS id 4VNTgk4lfLz4t7q;
	Mon, 22 Apr 2024 15:29:22 +0000 (UTC)
	(envelope-from des@freebsd.org)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim;
	t=1713799762;
	h=from:from:reply-to:subject:subject:date:date:message-id:message-id:
	 to:to:cc:cc:mime-version:mime-version:content-type:content-type:
	 content-transfer-encoding:content-transfer-encoding:
	 in-reply-to:in-reply-to:references:references;
	bh=9LMEdE01274yuY5Pax6TPkz8rH4mBQGMuTVNlDO0KsI=;
	b=BYqsibnlYo9D+IRDnHDIkH5UfJgtQAtK+0rE5uiCJAtEwUJGGwF8w3kewjayhRXpyg9s4R
	+EaVhPvCO3D7clyJ/GvNjduo8odsk1amBnLqs7TasxCVgjZBXPhIn14tNH1oyv+f1LCGOz
	4s77wYFX2vKRQnZbEZSKtDeA/5QWdF7o6WXltestLjMJJ0IbCgEdZJ2KvNA2BikJxv4Lf+
	ebB0yuBejQ+JFdCrTmvy5DcupDEbTCduHyzFSfSVUewq+iLVWtbm8MCEcxpo39O3f60waR
	5PRYFZW4UkbeRS/HguDKshfha4OmFh4NVaoOz3Z9reSJKnj/Ydkvr/4xqVxbOA==
ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1713799762; a=rsa-sha256; cv=none;
	b=arhtDIpISe7+j0HwaE+81zjO7xOjLKG5UP6gzcJjE0JVcX9Unp3xqftKJrP+FVfT3k7crK
	yqzGIOUYhuTdQsx/Yc4aQ3g1hlZb9+U+Wixx55SpMUhKdiH8gPiJ/Vdzh+hsX6JBhEMYvF
	YF08uX+HQbri+tSRGdVGWryxos1701fRb7QmFKp7f3XBq/xneAb3dCP21TvYypZDUMqB7K
	IGeIs9x6CH8IoLUd8Gc+oQelnxIoK+b0XvAYBhPXuJ9yOI9OI/wxv30eR2zAKxqOM/5uDd
	gDXiviTmTLOrAdotX4O7lg5RKb4X9TLFy/ZVHlIOJrRHPp0FoEgilTfwCeIYug==
ARC-Authentication-Results: i=1;
	mx1.freebsd.org;
	none
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org;
	s=dkim; t=1713799762;
	h=from:from:reply-to:subject:subject:date:date:message-id:message-id:
	 to:to:cc:cc:mime-version:mime-version:content-type:content-type:
	 content-transfer-encoding:content-transfer-encoding:
	 in-reply-to:in-reply-to:references:references;
	bh=9LMEdE01274yuY5Pax6TPkz8rH4mBQGMuTVNlDO0KsI=;
	b=NZ5hD26jupMpBQZ1wtNP95qiMmh/e0Uz9RjyzhRGIjICcxPYMZOD8ecsclmRtXTKFfZQLt
	8YXtJOErCQmZDwa3xwIPV8X6TV/jKkI+o1jY5+Z9Uv/Ljuo5qM9H31/VJjKeAKZr1EoQWB
	8gwEY54Kb0tO/9gOx97N+gYOSHrq+FezV/N/Kfe6dBmYLqgvtq3wj8o44iWVUQVRah/dyH
	ANLOhsFmP1NT608X4qu6cWpsZ6U72KaoOyFt+FiXSnUgEy8jry1e5dTPhQM50S6yp/8OVH
	KjUeqMeT4NwKj9H8swDphKdd8YFfopKPNApLae9QP5U4A+pdLxjcpf1IDq1h5Q==
Received: from ltc.des.dev (163.23.65.37.rev.sfr.net [37.65.23.163])
	(using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)
	 key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256)
	(Client did not present a certificate)
	(Authenticated sender: des)
	by smtp.freebsd.org (Postfix) with ESMTPSA id 4VNTgk3bWTz1NWB;
	Mon, 22 Apr 2024 15:29:22 +0000 (UTC)
	(envelope-from des@freebsd.org)
Received: by ltc.des.dev (Postfix, from userid 1001)
	id 4D0741F219; Mon, 22 Apr 2024 17:29:21 +0200 (CEST)
From: =?utf-8?Q?Dag-Erling_Sm=C3=B8rgrav?= 
To: mike tancsa 
Cc: FreeBSD-STABLE Mailing List 
Subject: Re: block size: 512B configured, 4096B native all of a sudden
In-Reply-To:  (mike tancsa's
	message of "Mon, 22 Apr 2024 11:20:38 -0400")
References: <9a593ca1-4975-438a-afec-d8dd5199dbcf@sentex.net>
	<86bk618lyh.fsf@ltc.des.dev>
	
User-Agent: Gnus/5.13 (Gnus v5.13)
Date: Mon, 22 Apr 2024 17:29:21 +0200
Message-ID: <867cgp8lgu.fsf@ltc.des.dev>
List-Id: Production branch of FreeBSD source code 
List-Archive: https://lists.freebsd.org/archives/freebsd-stable
List-Help: 
List-Post: 
List-Subscribe: 
List-Unsubscribe: 
X-BeenThere: freebsd-stable@freebsd.org
Sender: owner-freebsd-stable@FreeBSD.org
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable

mike tancsa  writes:
> Where what would be picking up the "true" size and why the change from
> a March 4th system to one today ?

https://cgit.freebsd.org/src/commit/?id=3Db7dce5b8e988f47784c55aa096541deda=
7b1aaeb

DES
--=20
Dag-Erling Sm=C3=B8rgrav - des@FreeBSD.org

From nobody Mon Apr 22 15:33:05 2024
X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1])
	by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4VNTm32VHHz5HKq3
	for ; Mon, 22 Apr 2024 15:33:07 +0000 (UTC)
	(envelope-from mike@sentex.net)
Received: from smarthost1.sentex.ca (smarthost1.sentex.ca [IPv6:2607:f3e0:0:1::12])
	(using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)
	 key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256
	 client-signature RSA-PSS (2048 bits) client-digest SHA256)
	(Client CN "smarthost1.sentex.ca", Issuer "R3" (verified OK))
	by mx1.freebsd.org (Postfix) with ESMTPS id 4VNTm24Ds5z4vTT;
	Mon, 22 Apr 2024 15:33:06 +0000 (UTC)
	(envelope-from mike@sentex.net)
Authentication-Results: mx1.freebsd.org;
	none
Received: from pyroxene2a.sentex.ca (pyroxene19.sentex.ca [199.212.134.19])
	by smarthost1.sentex.ca (8.17.1/8.16.1) with ESMTPS id 43MFX6Cf006732
	(version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=FAIL);
	Mon, 22 Apr 2024 11:33:06 -0400 (EDT)
	(envelope-from mike@sentex.net)
Received: from [IPV6:2607:f3e0:0:4:486a:7a6f:42a:68f5] ([IPv6:2607:f3e0:0:4:486a:7a6f:42a:68f5])
	by pyroxene2a.sentex.ca (8.17.1/8.15.2) with ESMTPS id 43MFX5TQ040837
	(version=TLSv1.3 cipher=TLS_AES_128_GCM_SHA256 bits=128 verify=NO);
	Mon, 22 Apr 2024 11:33:05 -0400 (EDT)
	(envelope-from mike@sentex.net)
Message-ID: <57a1cc6b-2bd2-4292-9fde-f8799ffa291a@sentex.net>
Date: Mon, 22 Apr 2024 11:33:05 -0400
List-Id: Production branch of FreeBSD source code 
List-Archive: https://lists.freebsd.org/archives/freebsd-stable
List-Help: 
List-Post: 
List-Subscribe: 
List-Unsubscribe: 
X-BeenThere: freebsd-stable@freebsd.org
Sender: owner-freebsd-stable@FreeBSD.org
MIME-Version: 1.0
User-Agent: Mozilla Thunderbird
Subject: Re: block size: 512B configured, 4096B native all of a sudden
To: =?UTF-8?Q?Dag-Erling_Sm=C3=B8rgrav?= 
Cc: FreeBSD-STABLE Mailing List 
References: <9a593ca1-4975-438a-afec-d8dd5199dbcf@sentex.net>
 <86bk618lyh.fsf@ltc.des.dev>
 
 <867cgp8lgu.fsf@ltc.des.dev>
Content-Language: en-US
From: mike tancsa 
Autocrypt: addr=mike@sentex.net; keydata=
 xsBNBFywzOMBCACoNFpwi5MeyEREiCeHtbm6pZJI/HnO+wXdCAWtZkS49weOoVyUj5BEXRZP
 xflV2ib2hflX4nXqhenaNiia4iaZ9ft3I1ebd7GEbGnsWCvAnob5MvDZyStDAuRxPJK1ya/s
 +6rOvr+eQiXYNVvfBhrCfrtR/esSkitBGxhUkBjOti8QwzD71JVF5YaOjBAs7jZUKyLGj0kW
 yDg4jUndudWU7G2yc9GwpHJ9aRSUN8e/mWdIogK0v+QBHfv/dsI6zVB7YuxCC9Fx8WPwfhDH
 VZC4kdYCQWKXrm7yb4TiVdBh5kgvlO9q3js1yYdfR1x8mjK2bH2RSv4bV3zkNmsDCIxjABEB
 AAHNHW1pa2UgdGFuY3NhIDxtaWtlQHNlbnRleC5uZXQ+wsCOBBMBCAA4FiEEmuvCXT0aY6hs
 4SbWeVOEFl5WrMgFAl+pQfkCGwMFCwkIBwIGFQoJCAsCBBYCAwECHgECF4AACgkQeVOEFl5W
 rMiN6ggAk3H5vk8QnbvGbb4sinxZt/wDetgk0AOR9NRmtTnPaW+sIJEfGBOz47Xih+f7uWJS
 j+uvc9Ewn2Z7n8z3ZHJlLAByLVLtcNXGoRIGJ27tevfOaNqgJHBPbFOcXCBBFTx4MYMM4iAZ
 cDT5vsBTSaM36JZFtHZBKkuFEItbA/N8ZQSHKdTYMIA7A3OCLGbJBqloQ8SlW4MkTzKX4u7R
 yefAYQ0h20x9IqC5Ju8IsYRFacVZconT16KS81IBceO42vXTN0VexbVF2rZIx3v/NT75r6Vw
 0FlXVB1lXOHKydRA2NeleS4NEG2vWqy/9Boj0itMfNDlOhkrA/0DcCurMpnpbM7ATQRcsMzk
 AQgA1Dpo/xWS66MaOJLwA28sKNMwkEk1Yjs+okOXDOu1F+0qvgE8sVmrOOPvvWr4axtKRSG1
 t2QUiZ/ZkW/x/+t0nrM39EANV1VncuQZ1ceIiwTJFqGZQ8kb0+BNkwuNVFHRgXm1qzAJweEt
 RdsCMohB+H7BL5LGCVG5JaU0lqFU9pFP40HxEbyzxjsZgSE8LwkI6wcu0BLv6K6cLm0EiHPO
 l5G8kgRi38PS7/6s3R8QDsEtbGsYy6O82k3zSLIjuDBwA9GRaeigGppTxzAHVjf5o9KKu4O7
 gC2KKVHPegbXS+GK7DU0fjzX57H5bZ6komE5eY4p3oWT/CwVPSGfPs8jOwARAQABwsB2BBgB
 CAAgFiEEmuvCXT0aY6hs4SbWeVOEFl5WrMgFAl+pQfkCGwwACgkQeVOEFl5WrMiVqwf9GwU8
 c6cylknZX8QwlsVudTC8xr/L17JA84wf03k3d4wxP7bqy5AYy7jboZMbgWXngAE/HPQU95NM
 aukysSnknzoIpC96XZJ0okLBXVS6Y0ylZQ+HrbIhMpuQPoDweoF5F9wKrsHRoDaUK1VR706X
 rwm4HUzh7Jk+auuMYfuCh0FVlFBEuiJWMLhg/5WCmcRfiuB6F59ZcUQrwLEZeNhF2XJV4KwB
 Tlg7HCWO/sy1foE5noaMyACjAtAQE9p5kGYaj+DuRhPdWUTsHNuqrhikzIZd2rrcMid+ktb0
 NvtvswzMO059z1YGMtGSqQ4srCArju+XHIdTFdiIYbd7+jeehg==
In-Reply-To: <867cgp8lgu.fsf@ltc.des.dev>
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 8bit
X-Scanned-By: MIMEDefang 2.86
X-Spamd-Bar: ----
X-Rspamd-Pre-Result: action=no action;
	module=replies;
	Message is reply to one we originated
X-Spamd-Result: default: False [-4.00 / 15.00];
	REPLY(-4.00)[];
	ASN(0.00)[asn:11647, ipnet:2607:f3e0::/32, country:CA]
X-Rspamd-Queue-Id: 4VNTm24Ds5z4vTT

On 4/22/2024 11:29 AM, Dag-Erling Smørgrav wrote:
> mike tancsa  writes:
>> Where what would be picking up the "true" size and why the change from
>> a March 4th system to one today ?
> https://cgit.freebsd.org/src/commit/?id=b7dce5b8e988f47784c55aa096541deda7b1aaeb

Well, that explains it :)  I guess the next question is how can I fix 
the issue ? its over 73TB and would take quite a long time to zfs send | 
zre recv. The HDDs are indeed 4K disks. If I offline the 2 SSD disks 
that are part of the special device one by one and resilver, will it fix 
it ?

  zpool status
   pool: zbackup1
  state: ONLINE
status: One or more devices are configured to use a non-native block size.
         Expect reduced performance.
action: Replace affected devices with devices that support the
         configured block size, or migrate data to a properly configured
         pool.
   scan: scrub repaired 0B in 1 days 12:33:12 with 0 errors on Sun Dec 
10 17:45:06 2023
config:

         NAME                               STATE     READ WRITE CKSUM
         zbackup1                           ONLINE       0 0     0
           raidz1-0                         ONLINE       0 0     0
             diskid/DISK-VAGGPZKLp1         ONLINE       0 0     0
             diskid/DISK-VAHZDXALp1         ONLINE       0 0     0
             diskid/DISK-VAJ0S1DLp1         ONLINE       0 0     0
             diskid/DISK-VAHZRMSLp1         ONLINE       0 0     0
             diskid/DISK-VAHZAN4Lp1         ONLINE       0 0     0
           raidz1-2                         ONLINE       0 0     0
             diskid/DISK-1EJD0HUZp1         ONLINE       0 0     0
             diskid/DISK-1EJD5Y7Zp1         ONLINE       0 0     0
             diskid/DISK-1EK5KGUZp1         ONLINE       0 0     0
             diskid/DISK-1EK112WZp1         ONLINE       0 0     0
         special
           mirror-1                         ONLINE       0 0     0
             diskid/DISK-S6PNNM0W619793Pp1  ONLINE       0 0     0  
block size: 512B configured, 4096B native
             diskid/DISK-S6PNNM0W619816Bp1  ONLINE       0 0     0  
block size: 512B configured, 4096B native

     ---Mike


From nobody Mon Apr 22 15:37:50 2024
X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1])
	by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4VNTsW4vTRz5HLH0
	for ; Mon, 22 Apr 2024 15:37:51 +0000 (UTC)
	(envelope-from des@freebsd.org)
Received: from smtp.freebsd.org (smtp.freebsd.org [IPv6:2610:1c1:1:606c::24b:4])
	(using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)
	 key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256
	 client-signature RSA-PSS (4096 bits) client-digest SHA256)
	(Client CN "smtp.freebsd.org", Issuer "R3" (verified OK))
	by mx1.freebsd.org (Postfix) with ESMTPS id 4VNTsW4JXkz3yv1;
	Mon, 22 Apr 2024 15:37:51 +0000 (UTC)
	(envelope-from des@freebsd.org)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim;
	t=1713800271;
	h=from:from:reply-to:subject:subject:date:date:message-id:message-id:
	 to:to:cc:cc:mime-version:mime-version:content-type:content-type:
	 content-transfer-encoding:content-transfer-encoding:
	 in-reply-to:in-reply-to:references:references;
	bh=cr1vvnXTDe9q6PCrsaPPzJ2Ty77PIIG33wRWsrQZTkc=;
	b=QXzcxg2Zagr4uHBAB5XpROHE+KRMlW/iyzrkMozb8Ci3YDobWgbVVY3mIYlSakrfvKn/rv
	gs0MvNU7YvXXoe/wY3fPmdyDSeuo+y3H0c8Y2fb9B3VwWsmo8/AQyXGk70AKVC/93hgKfz
	90BNiMeYQ8V/EL2rzu0jW9paWIxlcI3VSSEr9gy95nvunt+Vrebk7CUNu4M04fb/aWSI0U
	gt6FbOyuYOc0D8WCQ7myLdlCgmrvujgqE6ATtL3UwBMf3OwUOkJ5gaW3LSLYZWyM1Woqey
	7UJL/JnIIpr8SYfM41xwVBfsvWb/EXvlvx/N1yTEPAPycwdxqnQwcmQtqmQzwg==
ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1713800271; a=rsa-sha256; cv=none;
	b=GNBjyYSOZJ5IcxMSySLp6QiKxSaeAeu1noYRcdmhFTPXYGqCHACo/YsKc2vDjCnEvQETRR
	gA7FP+Nml/KIc5fc3vSAQv12fkiiIoNPQ7OpZrmMzmI8Ugi7HhcyPJ8WJCLYAHOJ6Oj2mc
	6u/uxj/j4AIqJFOaXU/gXgFRS7Cyx309W1tqg/FqkjUPOQYQOyoyoWSB0K70jUTBwVUcld
	sF+e4cHYI6HwkQJ3QSrPnS24fn8xX+rTOb6Y/sournDfr+ca7NTThkqYUJyx74wGC8bD0q
	RziGqwB8+axzjI8XHO+ThPQqMQOqR61HE+Rsc+ljJe9pnywwuXxbm70VJ5HWpg==
ARC-Authentication-Results: i=1;
	mx1.freebsd.org;
	none
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org;
	s=dkim; t=1713800271;
	h=from:from:reply-to:subject:subject:date:date:message-id:message-id:
	 to:to:cc:cc:mime-version:mime-version:content-type:content-type:
	 content-transfer-encoding:content-transfer-encoding:
	 in-reply-to:in-reply-to:references:references;
	bh=cr1vvnXTDe9q6PCrsaPPzJ2Ty77PIIG33wRWsrQZTkc=;
	b=oJjcq3YsJLuwWcvkXz/8C9Ew2JG/V9ILALG38tdgnnq3VAeGr33vCI0aWHaem30FdA31wl
	Qxg8M0w1GWRryf34noytMy07EMucEBaG87YkoN7gLCW6i6EjahmxWrtBO3lFCbHE2l0Xe3
	DW6TvaMW1AU3ZfsMN3mZ1IufjdcsoaxHPAv5bdqm21x3RYk2/wYU6mjf4KXqLxORhL/3Zn
	9rbM2c8z9lhOzJ2dQtAxJYumJxw1O/HDaMdb/L7Y71fBeHg3/lz8N+L1Io+nrTtP0nM8Ms
	+zoNSq+UCRUEIY249GPM58wnbtPAGXQs6CUpXtvqDIkTPjAFWx2Rzeyr4zsDgw==
Received: from ltc.des.dev (2a02-8428-0993-f001-922e-16ff-fef1-acef.rev.sfr.net [IPv6:2a02:8428:993:f001:922e:16ff:fef1:acef])
	(using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)
	 key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256)
	(Client did not present a certificate)
	(Authenticated sender: des)
	by smtp.freebsd.org (Postfix) with ESMTPSA id 4VNTsW3BD4z1NWH;
	Mon, 22 Apr 2024 15:37:51 +0000 (UTC)
	(envelope-from des@freebsd.org)
Received: by ltc.des.dev (Postfix, from userid 1001)
	id 53A3A1EB3B; Mon, 22 Apr 2024 17:37:50 +0200 (CEST)
From: =?utf-8?Q?Dag-Erling_Sm=C3=B8rgrav?= 
To: mike tancsa 
Cc: FreeBSD-STABLE Mailing List 
Subject: Re: block size: 512B configured, 4096B native all of a sudden
In-Reply-To: <57a1cc6b-2bd2-4292-9fde-f8799ffa291a@sentex.net> (mike tancsa's
	message of "Mon, 22 Apr 2024 11:33:05 -0400")
References: <9a593ca1-4975-438a-afec-d8dd5199dbcf@sentex.net>
	<86bk618lyh.fsf@ltc.des.dev>
	
	<867cgp8lgu.fsf@ltc.des.dev>
	<57a1cc6b-2bd2-4292-9fde-f8799ffa291a@sentex.net>
User-Agent: Gnus/5.13 (Gnus v5.13)
Date: Mon, 22 Apr 2024 17:37:50 +0200
Message-ID: <8634rd8l2p.fsf@ltc.des.dev>
List-Id: Production branch of FreeBSD source code 
List-Archive: https://lists.freebsd.org/archives/freebsd-stable
List-Help: 
List-Post: 
List-Subscribe: 
List-Unsubscribe: 
X-BeenThere: freebsd-stable@freebsd.org
Sender: owner-freebsd-stable@FreeBSD.org
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable

mike tancsa  writes:
> I guess the next question is how can I fix the issue?  its over 73TB
> and would take quite a long time to zfs send | zre recv.  The HDDs are
> indeed 4K disks.  If I offline the 2 SSD disks that are part of the
> special device one by one and resilver, will it fix it?

No, the ashift is a vdev property.  You'll have to remove one disk from
the pool, create a new pool, send | recv across, then destroy the old
pool and add the remaining disk to the new pool.  Make sure you have a
backup before you start.

DES
--=20
Dag-Erling Sm=C3=B8rgrav - des@FreeBSD.org

From nobody Mon Apr 22 15:44:56 2024
X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1])
	by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4VNV1j14Kvz5HLrk
	for ; Mon, 22 Apr 2024 15:44:57 +0000 (UTC)
	(envelope-from mike@sentex.net)
Received: from smarthost1.sentex.ca (smarthost1.sentex.ca [IPv6:2607:f3e0:0:1::12])
	(using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)
	 key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256
	 client-signature RSA-PSS (2048 bits) client-digest SHA256)
	(Client CN "smarthost1.sentex.ca", Issuer "R3" (verified OK))
	by mx1.freebsd.org (Postfix) with ESMTPS id 4VNV1j0dtTz41jY;
	Mon, 22 Apr 2024 15:44:57 +0000 (UTC)
	(envelope-from mike@sentex.net)
Authentication-Results: mx1.freebsd.org;
	none
Received: from pyroxene2a.sentex.ca (pyroxene19.sentex.ca [199.212.134.19])
	by smarthost1.sentex.ca (8.17.1/8.16.1) with ESMTPS id 43MFiv6c010803
	(version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=FAIL);
	Mon, 22 Apr 2024 11:44:57 -0400 (EDT)
	(envelope-from mike@sentex.net)
Received: from [IPV6:2607:f3e0:0:4:486a:7a6f:42a:68f5] ([IPv6:2607:f3e0:0:4:486a:7a6f:42a:68f5])
	by pyroxene2a.sentex.ca (8.17.1/8.15.2) with ESMTPS id 43MFiuwh045062
	(version=TLSv1.3 cipher=TLS_AES_128_GCM_SHA256 bits=128 verify=NO);
	Mon, 22 Apr 2024 11:44:56 -0400 (EDT)
	(envelope-from mike@sentex.net)
Message-ID: 
Date: Mon, 22 Apr 2024 11:44:56 -0400
List-Id: Production branch of FreeBSD source code 
List-Archive: https://lists.freebsd.org/archives/freebsd-stable
List-Help: 
List-Post: 
List-Subscribe: 
List-Unsubscribe: 
X-BeenThere: freebsd-stable@freebsd.org
Sender: owner-freebsd-stable@FreeBSD.org
MIME-Version: 1.0
User-Agent: Mozilla Thunderbird
Subject: Re: block size: 512B configured, 4096B native all of a sudden
To: =?UTF-8?Q?Dag-Erling_Sm=C3=B8rgrav?= 
Cc: FreeBSD-STABLE Mailing List 
References: <9a593ca1-4975-438a-afec-d8dd5199dbcf@sentex.net>
 <86bk618lyh.fsf@ltc.des.dev>
 
 <867cgp8lgu.fsf@ltc.des.dev>
 <57a1cc6b-2bd2-4292-9fde-f8799ffa291a@sentex.net>
 <8634rd8l2p.fsf@ltc.des.dev>
Content-Language: en-US
From: mike tancsa 
Autocrypt: addr=mike@sentex.net; keydata=
 xsBNBFywzOMBCACoNFpwi5MeyEREiCeHtbm6pZJI/HnO+wXdCAWtZkS49weOoVyUj5BEXRZP
 xflV2ib2hflX4nXqhenaNiia4iaZ9ft3I1ebd7GEbGnsWCvAnob5MvDZyStDAuRxPJK1ya/s
 +6rOvr+eQiXYNVvfBhrCfrtR/esSkitBGxhUkBjOti8QwzD71JVF5YaOjBAs7jZUKyLGj0kW
 yDg4jUndudWU7G2yc9GwpHJ9aRSUN8e/mWdIogK0v+QBHfv/dsI6zVB7YuxCC9Fx8WPwfhDH
 VZC4kdYCQWKXrm7yb4TiVdBh5kgvlO9q3js1yYdfR1x8mjK2bH2RSv4bV3zkNmsDCIxjABEB
 AAHNHW1pa2UgdGFuY3NhIDxtaWtlQHNlbnRleC5uZXQ+wsCOBBMBCAA4FiEEmuvCXT0aY6hs
 4SbWeVOEFl5WrMgFAl+pQfkCGwMFCwkIBwIGFQoJCAsCBBYCAwECHgECF4AACgkQeVOEFl5W
 rMiN6ggAk3H5vk8QnbvGbb4sinxZt/wDetgk0AOR9NRmtTnPaW+sIJEfGBOz47Xih+f7uWJS
 j+uvc9Ewn2Z7n8z3ZHJlLAByLVLtcNXGoRIGJ27tevfOaNqgJHBPbFOcXCBBFTx4MYMM4iAZ
 cDT5vsBTSaM36JZFtHZBKkuFEItbA/N8ZQSHKdTYMIA7A3OCLGbJBqloQ8SlW4MkTzKX4u7R
 yefAYQ0h20x9IqC5Ju8IsYRFacVZconT16KS81IBceO42vXTN0VexbVF2rZIx3v/NT75r6Vw
 0FlXVB1lXOHKydRA2NeleS4NEG2vWqy/9Boj0itMfNDlOhkrA/0DcCurMpnpbM7ATQRcsMzk
 AQgA1Dpo/xWS66MaOJLwA28sKNMwkEk1Yjs+okOXDOu1F+0qvgE8sVmrOOPvvWr4axtKRSG1
 t2QUiZ/ZkW/x/+t0nrM39EANV1VncuQZ1ceIiwTJFqGZQ8kb0+BNkwuNVFHRgXm1qzAJweEt
 RdsCMohB+H7BL5LGCVG5JaU0lqFU9pFP40HxEbyzxjsZgSE8LwkI6wcu0BLv6K6cLm0EiHPO
 l5G8kgRi38PS7/6s3R8QDsEtbGsYy6O82k3zSLIjuDBwA9GRaeigGppTxzAHVjf5o9KKu4O7
 gC2KKVHPegbXS+GK7DU0fjzX57H5bZ6komE5eY4p3oWT/CwVPSGfPs8jOwARAQABwsB2BBgB
 CAAgFiEEmuvCXT0aY6hs4SbWeVOEFl5WrMgFAl+pQfkCGwwACgkQeVOEFl5WrMiVqwf9GwU8
 c6cylknZX8QwlsVudTC8xr/L17JA84wf03k3d4wxP7bqy5AYy7jboZMbgWXngAE/HPQU95NM
 aukysSnknzoIpC96XZJ0okLBXVS6Y0ylZQ+HrbIhMpuQPoDweoF5F9wKrsHRoDaUK1VR706X
 rwm4HUzh7Jk+auuMYfuCh0FVlFBEuiJWMLhg/5WCmcRfiuB6F59ZcUQrwLEZeNhF2XJV4KwB
 Tlg7HCWO/sy1foE5noaMyACjAtAQE9p5kGYaj+DuRhPdWUTsHNuqrhikzIZd2rrcMid+ktb0
 NvtvswzMO059z1YGMtGSqQ4srCArju+XHIdTFdiIYbd7+jeehg==
In-Reply-To: <8634rd8l2p.fsf@ltc.des.dev>
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 8bit
X-Scanned-By: MIMEDefang 2.86
X-Spamd-Bar: ----
X-Rspamd-Pre-Result: action=no action;
	module=replies;
	Message is reply to one we originated
X-Spamd-Result: default: False [-4.00 / 15.00];
	REPLY(-4.00)[];
	ASN(0.00)[asn:11647, ipnet:2607:f3e0::/32, country:CA]
X-Rspamd-Queue-Id: 4VNV1j0dtTz41jY

On 4/22/2024 11:37 AM, Dag-Erling Smørgrav wrote:
> mike tancsa  writes:
>> I guess the next question is how can I fix the issue?  its over 73TB
>> and would take quite a long time to zfs send | zre recv.  The HDDs are
>> indeed 4K disks.  If I offline the 2 SSD disks that are part of the
>> special device one by one and resilver, will it fix it?
> No, the ashift is a vdev property.  You'll have to remove one disk from
> the pool, create a new pool, send | recv across, then destroy the old
> pool and add the remaining disk to the new pool.  Make sure you have a
> backup before you start.

I was afraid of that. So basically I have to copy the entire pool or 
live with the performance penalty :(  73TB is a lot to copy / move.

     ---Mike


From nobody Mon Apr 22 15:49:50 2024
X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1])
	by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4VNV7N2zr3z5HM2l
	for ; Mon, 22 Apr 2024 15:49:52 +0000 (UTC)
	(envelope-from des@freebsd.org)
Received: from smtp.freebsd.org (smtp.freebsd.org [IPv6:2610:1c1:1:606c::24b:4])
	(using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)
	 key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256
	 client-signature RSA-PSS (4096 bits) client-digest SHA256)
	(Client CN "smtp.freebsd.org", Issuer "R3" (verified OK))
	by mx1.freebsd.org (Postfix) with ESMTPS id 4VNV7N1x2tz42yp;
	Mon, 22 Apr 2024 15:49:52 +0000 (UTC)
	(envelope-from des@freebsd.org)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim;
	t=1713800992;
	h=from:from:reply-to:subject:subject:date:date:message-id:message-id:
	 to:to:cc:cc:mime-version:mime-version:content-type:content-type:
	 content-transfer-encoding:content-transfer-encoding:
	 in-reply-to:in-reply-to:references:references;
	bh=1pE6zaWkCpOfx+jGk99jjwXWmYgUqVlfctd6J0fQiGM=;
	b=AyrwMFRK2CzI7QO+OKQFrkoL7wQlCTt7csfeZI0emGqyJ6jNYn+hndrzltkk1zKHgbqRdU
	S7W/hnB9GuPSE+j12mTTlBupkLV5Npqnj4iph0z5xNw2nuT5hqNFZemtTz6g/awiRChlik
	EVTlvcrUrlfUKRuVToUW3A0YWVWix+tVvIHl59GUsMBTamRT1ZlgIHwL4pto7p/ths3ZM1
	oU4NtR1oG77QpF1y77qlvEhgXeVlQLpDJ+YUSguyjt4DEQbUYTMhwPoGVLEiGvNqXQ+pYi
	gdhTlCxBxsrlKLNgRIsfZk/gSMSabW+WUBxJGvqHrfowv/hFkgZRFqpYBwIj/A==
ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1713800992; a=rsa-sha256; cv=none;
	b=nrsw2H29dSf8l8e+VtmaFZmqxcRAVfiv9h0L4ZCb5V1FG1B/EXG//ZsX9aQYCUG0H9Pqnu
	fRY75I34Q6jQT3Rbqm4S0gQubpRp2k6dQDSpMcGFevPLX9z9lR7wWPPo6j90qU4LM1cKJV
	uCdcUTr2dKaSooRumQKH1ad/XLfHCoukqRyypkPSKSIif+joavBNjLURI4BPsiu6zMybZB
	Zmkd1pXQJMbtO146m8JZv0oXLKFdV4sMxz9kVuAY2LupTg9nJo1gTRXChEkatjHiV8qhJR
	O/UNJ1pg5f2lLvzGe66r1TzIOD3PprFnpmikevcuowQMGGqvkAmF067rY/sUGA==
ARC-Authentication-Results: i=1;
	mx1.freebsd.org;
	none
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org;
	s=dkim; t=1713800992;
	h=from:from:reply-to:subject:subject:date:date:message-id:message-id:
	 to:to:cc:cc:mime-version:mime-version:content-type:content-type:
	 content-transfer-encoding:content-transfer-encoding:
	 in-reply-to:in-reply-to:references:references;
	bh=1pE6zaWkCpOfx+jGk99jjwXWmYgUqVlfctd6J0fQiGM=;
	b=huEOGCgsLTAw38DQISmcsXheT+X0t7g3+10JtvsLuK2Zr4JKwia0jYgsYhoJ3cMDWx/BEi
	Ev5akOfBDyzldpp8hfN0W278QLSM9VG0lw8FM7ufpp03PwOb5CA6dtV6E1gzLvchG+US4n
	iwarsrodwtMmYH+BkK7RBts+Ecwl++Zm23E9OfPfndI4jMF0yr6HGkvXZ25E6SrIf3Cf9B
	h1XgWqg44Ux0MFK/V84ROebTZbL9RuRTQ95EKX8vhtpE35bQBGIsrELzZZ2gYcGIfOeOvn
	R2GRmf4RCK0QDrddur6KViX8xb5LS7t63mMZI09BsmaVgxMq4u/7xBQliL3yhA==
Received: from ltc.des.dev (2a02-8428-0993-f001-922e-16ff-fef1-acef.rev.sfr.net [IPv6:2a02:8428:993:f001:922e:16ff:fef1:acef])
	(using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)
	 key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256)
	(Client did not present a certificate)
	(Authenticated sender: des)
	by smtp.freebsd.org (Postfix) with ESMTPSA id 4VNV7N0lzPz1M2v;
	Mon, 22 Apr 2024 15:49:52 +0000 (UTC)
	(envelope-from des@freebsd.org)
Received: by ltc.des.dev (Postfix, from userid 1001)
	id DA1E61B257; Mon, 22 Apr 2024 17:49:50 +0200 (CEST)
From: =?utf-8?Q?Dag-Erling_Sm=C3=B8rgrav?= 
To: mike tancsa 
Cc: FreeBSD-STABLE Mailing List 
Subject: Re: block size: 512B configured, 4096B native all of a sudden
In-Reply-To:  (mike tancsa's
	message of "Mon, 22 Apr 2024 11:44:56 -0400")
References: <9a593ca1-4975-438a-afec-d8dd5199dbcf@sentex.net>
	<86bk618lyh.fsf@ltc.des.dev>
	
	<867cgp8lgu.fsf@ltc.des.dev>
	<57a1cc6b-2bd2-4292-9fde-f8799ffa291a@sentex.net>
	<8634rd8l2p.fsf@ltc.des.dev>
	
User-Agent: Gnus/5.13 (Gnus v5.13)
Date: Mon, 22 Apr 2024 17:49:50 +0200
Message-ID: <86y19575y9.fsf@ltc.des.dev>
List-Id: Production branch of FreeBSD source code 
List-Archive: https://lists.freebsd.org/archives/freebsd-stable
List-Help: 
List-Post: 
List-Subscribe: 
List-Unsubscribe: 
X-BeenThere: freebsd-stable@freebsd.org
Sender: owner-freebsd-stable@FreeBSD.org
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable

mike tancsa  writes:
> I was afraid of that. So basically I have to copy the entire pool or
> live with the performance penalty :(=C2=A0 73TB is a lot to copy / move.

Oh I didn't realize those disks were part of the larger pool, I thought
they were a separate pool named =E2=80=9Cspecial=E2=80=9D.  You might be ab=
le to simply
detach and then re-attach both drives, afaik a draid can function
without its special vdev.

DES
--=20
Dag-Erling Sm=C3=B8rgrav - des@FreeBSD.org

From nobody Mon Apr 22 16:05:03 2024
X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1])
	by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4VNVSy5TfKz5HNV5
	for ; Mon, 22 Apr 2024 16:05:06 +0000 (UTC)
	(envelope-from mike@sentex.net)
Received: from smarthost1.sentex.ca (smarthost1.sentex.ca [IPv6:2607:f3e0:0:1::12])
	(using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)
	 key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256
	 client-signature RSA-PSS (2048 bits) client-digest SHA256)
	(Client CN "smarthost1.sentex.ca", Issuer "R3" (verified OK))
	by mx1.freebsd.org (Postfix) with ESMTPS id 4VNVSy541dz45nW;
	Mon, 22 Apr 2024 16:05:06 +0000 (UTC)
	(envelope-from mike@sentex.net)
Authentication-Results: mx1.freebsd.org;
	none
Received: from pyroxene2a.sentex.ca (pyroxene19.sentex.ca [199.212.134.19])
	by smarthost1.sentex.ca (8.17.1/8.16.1) with ESMTPS id 43MG54P9020766
	(version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=FAIL);
	Mon, 22 Apr 2024 12:05:04 -0400 (EDT)
	(envelope-from mike@sentex.net)
Received: from [IPV6:2607:f3e0:0:4:486a:7a6f:42a:68f5] ([IPv6:2607:f3e0:0:4:486a:7a6f:42a:68f5])
	by pyroxene2a.sentex.ca (8.17.1/8.15.2) with ESMTPS id 43MG52Zr051881
	(version=TLSv1.3 cipher=TLS_AES_128_GCM_SHA256 bits=128 verify=NO);
	Mon, 22 Apr 2024 12:05:03 -0400 (EDT)
	(envelope-from mike@sentex.net)
Content-Type: multipart/alternative;
 boundary="------------8wQQkuVG6IE0W4HytDLZhv06"
Message-ID: <9dd52865-6928-41dc-910b-82988fe6b2af@sentex.net>
Date: Mon, 22 Apr 2024 12:05:03 -0400
List-Id: Production branch of FreeBSD source code 
List-Archive: https://lists.freebsd.org/archives/freebsd-stable
List-Help: 
List-Post: 
List-Subscribe: 
List-Unsubscribe: 
X-BeenThere: freebsd-stable@freebsd.org
Sender: owner-freebsd-stable@FreeBSD.org
MIME-Version: 1.0
User-Agent: Mozilla Thunderbird
Subject: Re: block size: 512B configured, 4096B native all of a sudden
To: =?UTF-8?Q?Dag-Erling_Sm=C3=B8rgrav?= 
Cc: FreeBSD-STABLE Mailing List 
References: <9a593ca1-4975-438a-afec-d8dd5199dbcf@sentex.net>
 <86bk618lyh.fsf@ltc.des.dev>
 
 <867cgp8lgu.fsf@ltc.des.dev>
 <57a1cc6b-2bd2-4292-9fde-f8799ffa291a@sentex.net>
 <8634rd8l2p.fsf@ltc.des.dev>
 
 <86y19575y9.fsf@ltc.des.dev>
Content-Language: en-US
From: mike tancsa 
Autocrypt: addr=mike@sentex.net; keydata=
 xsBNBFywzOMBCACoNFpwi5MeyEREiCeHtbm6pZJI/HnO+wXdCAWtZkS49weOoVyUj5BEXRZP
 xflV2ib2hflX4nXqhenaNiia4iaZ9ft3I1ebd7GEbGnsWCvAnob5MvDZyStDAuRxPJK1ya/s
 +6rOvr+eQiXYNVvfBhrCfrtR/esSkitBGxhUkBjOti8QwzD71JVF5YaOjBAs7jZUKyLGj0kW
 yDg4jUndudWU7G2yc9GwpHJ9aRSUN8e/mWdIogK0v+QBHfv/dsI6zVB7YuxCC9Fx8WPwfhDH
 VZC4kdYCQWKXrm7yb4TiVdBh5kgvlO9q3js1yYdfR1x8mjK2bH2RSv4bV3zkNmsDCIxjABEB
 AAHNHW1pa2UgdGFuY3NhIDxtaWtlQHNlbnRleC5uZXQ+wsCOBBMBCAA4FiEEmuvCXT0aY6hs
 4SbWeVOEFl5WrMgFAl+pQfkCGwMFCwkIBwIGFQoJCAsCBBYCAwECHgECF4AACgkQeVOEFl5W
 rMiN6ggAk3H5vk8QnbvGbb4sinxZt/wDetgk0AOR9NRmtTnPaW+sIJEfGBOz47Xih+f7uWJS
 j+uvc9Ewn2Z7n8z3ZHJlLAByLVLtcNXGoRIGJ27tevfOaNqgJHBPbFOcXCBBFTx4MYMM4iAZ
 cDT5vsBTSaM36JZFtHZBKkuFEItbA/N8ZQSHKdTYMIA7A3OCLGbJBqloQ8SlW4MkTzKX4u7R
 yefAYQ0h20x9IqC5Ju8IsYRFacVZconT16KS81IBceO42vXTN0VexbVF2rZIx3v/NT75r6Vw
 0FlXVB1lXOHKydRA2NeleS4NEG2vWqy/9Boj0itMfNDlOhkrA/0DcCurMpnpbM7ATQRcsMzk
 AQgA1Dpo/xWS66MaOJLwA28sKNMwkEk1Yjs+okOXDOu1F+0qvgE8sVmrOOPvvWr4axtKRSG1
 t2QUiZ/ZkW/x/+t0nrM39EANV1VncuQZ1ceIiwTJFqGZQ8kb0+BNkwuNVFHRgXm1qzAJweEt
 RdsCMohB+H7BL5LGCVG5JaU0lqFU9pFP40HxEbyzxjsZgSE8LwkI6wcu0BLv6K6cLm0EiHPO
 l5G8kgRi38PS7/6s3R8QDsEtbGsYy6O82k3zSLIjuDBwA9GRaeigGppTxzAHVjf5o9KKu4O7
 gC2KKVHPegbXS+GK7DU0fjzX57H5bZ6komE5eY4p3oWT/CwVPSGfPs8jOwARAQABwsB2BBgB
 CAAgFiEEmuvCXT0aY6hs4SbWeVOEFl5WrMgFAl+pQfkCGwwACgkQeVOEFl5WrMiVqwf9GwU8
 c6cylknZX8QwlsVudTC8xr/L17JA84wf03k3d4wxP7bqy5AYy7jboZMbgWXngAE/HPQU95NM
 aukysSnknzoIpC96XZJ0okLBXVS6Y0ylZQ+HrbIhMpuQPoDweoF5F9wKrsHRoDaUK1VR706X
 rwm4HUzh7Jk+auuMYfuCh0FVlFBEuiJWMLhg/5WCmcRfiuB6F59ZcUQrwLEZeNhF2XJV4KwB
 Tlg7HCWO/sy1foE5noaMyACjAtAQE9p5kGYaj+DuRhPdWUTsHNuqrhikzIZd2rrcMid+ktb0
 NvtvswzMO059z1YGMtGSqQ4srCArju+XHIdTFdiIYbd7+jeehg==
In-Reply-To: <86y19575y9.fsf@ltc.des.dev>
X-Scanned-By: MIMEDefang 2.86
X-Spamd-Bar: ----
X-Rspamd-Pre-Result: action=no action;
	module=replies;
	Message is reply to one we originated
X-Spamd-Result: default: False [-4.00 / 15.00];
	REPLY(-4.00)[];
	ASN(0.00)[asn:11647, ipnet:2607:f3e0::/32, country:CA]
X-Rspamd-Queue-Id: 4VNVSy541dz45nW

This is a multi-part message in MIME format.
--------------8wQQkuVG6IE0W4HytDLZhv06
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 8bit

On 4/22/2024 11:49 AM, Dag-Erling Smørgrav wrote:
> mike tancsa  writes:
>> I was afraid of that. So basically I have to copy the entire pool or
>> live with the performance penalty :(  73TB is a lot to copy / move.
> Oh I didn't realize those disks were part of the larger pool, I thought
> they were a separate pool named “special”.  You might be able to simply
> detach and then re-attach both drives, afaik a draid can function
> without its special vdev.

Yeah, its an actual special vdev I added to speed up metadata and small 
file access.  zpool-detach I think only works on mirrors and not raidz 
vdevs.  From searching google, there does not seem to be a way to detach 
a special vdev from a raidz pool.

     ---Mike

--------------8wQQkuVG6IE0W4HytDLZhv06
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: 8bit



  
    
  
  
    
On 4/22/2024 11:49 AM, Dag-Erling
      Smørgrav wrote:

    

    

      
mike tancsa <mike@sentex.net> writes:


      

        
I was afraid of that. So basically I have to copy the entire pool or
live with the performance penalty :(  73TB is a lot to copy / move.


      

      
Oh I didn't realize those disks were part of the larger pool, I thought
they were a separate pool named “special”.  You might be able to simply
detach and then re-attach both drives, afaik a draid can function
without its special vdev.


    

    
Yeah, its an actual special vdev I added to speed up metadata and
      small file access.  zpool-detach I think only works on mirrors and
      not raidz vdevs.  From searching google, there does not seem to be
      a way to detach a special vdev from a raidz pool.

    
    ---Mike

    

    

  


--------------8wQQkuVG6IE0W4HytDLZhv06--

From nobody Mon Apr 22 19:13:08 2024
X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1])
	by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4VNZdy0g8Sz5HjPM
	for ; Mon, 22 Apr 2024 19:13:10 +0000 (UTC)
	(envelope-from mike@sentex.net)
Received: from smarthost1.sentex.ca (smarthost1.sentex.ca [IPv6:2607:f3e0:0:1::12])
	(using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)
	 key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256
	 client-signature RSA-PSS (2048 bits) client-digest SHA256)
	(Client CN "smarthost1.sentex.ca", Issuer "R3" (verified OK))
	by mx1.freebsd.org (Postfix) with ESMTPS id 4VNZdx3Hdzz4fg2;
	Mon, 22 Apr 2024 19:13:09 +0000 (UTC)
	(envelope-from mike@sentex.net)
Authentication-Results: mx1.freebsd.org;
	dkim=none;
	dmarc=none;
	spf=pass (mx1.freebsd.org: domain of mike@sentex.net designates 2607:f3e0:0:1::12 as permitted sender) smtp.mailfrom=mike@sentex.net
Received: from pyroxene2a.sentex.ca (pyroxene19.sentex.ca [199.212.134.19])
	by smarthost1.sentex.ca (8.17.1/8.16.1) with ESMTPS id 43MJD8Of095344
	(version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=FAIL);
	Mon, 22 Apr 2024 15:13:08 -0400 (EDT)
	(envelope-from mike@sentex.net)
Received: from [IPV6:2607:f3e0:0:4:486a:7a6f:42a:68f5] ([IPv6:2607:f3e0:0:4:486a:7a6f:42a:68f5])
	by pyroxene2a.sentex.ca (8.17.1/8.15.2) with ESMTPS id 43MJD7TW018991
	(version=TLSv1.3 cipher=TLS_AES_128_GCM_SHA256 bits=128 verify=NO);
	Mon, 22 Apr 2024 15:13:07 -0400 (EDT)
	(envelope-from mike@sentex.net)
Content-Type: multipart/alternative;
 boundary="------------TeEYKHRauDcwvPTkUFKj80vS"
Message-ID: <01bd9c82-52dd-4983-be08-a9c1810cbaaa@sentex.net>
Date: Mon, 22 Apr 2024 15:13:08 -0400
List-Id: Production branch of FreeBSD source code 
List-Archive: https://lists.freebsd.org/archives/freebsd-stable
List-Help: 
List-Post: 
List-Subscribe: 
List-Unsubscribe: 
X-BeenThere: freebsd-stable@freebsd.org
Sender: owner-freebsd-stable@FreeBSD.org
MIME-Version: 1.0
User-Agent: Mozilla Thunderbird
Subject: Re: block size: 512B configured, 4096B native all of a sudden
From: mike tancsa 
To: =?UTF-8?Q?Dag-Erling_Sm=C3=B8rgrav?= 
Cc: FreeBSD-STABLE Mailing List 
References: <9a593ca1-4975-438a-afec-d8dd5199dbcf@sentex.net>
 <86bk618lyh.fsf@ltc.des.dev>
 
 <867cgp8lgu.fsf@ltc.des.dev>
 <57a1cc6b-2bd2-4292-9fde-f8799ffa291a@sentex.net>
 <8634rd8l2p.fsf@ltc.des.dev>
 
 <86y19575y9.fsf@ltc.des.dev>
 <9dd52865-6928-41dc-910b-82988fe6b2af@sentex.net>
Content-Language: en-US
Autocrypt: addr=mike@sentex.net; keydata=
 xsBNBFywzOMBCACoNFpwi5MeyEREiCeHtbm6pZJI/HnO+wXdCAWtZkS49weOoVyUj5BEXRZP
 xflV2ib2hflX4nXqhenaNiia4iaZ9ft3I1ebd7GEbGnsWCvAnob5MvDZyStDAuRxPJK1ya/s
 +6rOvr+eQiXYNVvfBhrCfrtR/esSkitBGxhUkBjOti8QwzD71JVF5YaOjBAs7jZUKyLGj0kW
 yDg4jUndudWU7G2yc9GwpHJ9aRSUN8e/mWdIogK0v+QBHfv/dsI6zVB7YuxCC9Fx8WPwfhDH
 VZC4kdYCQWKXrm7yb4TiVdBh5kgvlO9q3js1yYdfR1x8mjK2bH2RSv4bV3zkNmsDCIxjABEB
 AAHNHW1pa2UgdGFuY3NhIDxtaWtlQHNlbnRleC5uZXQ+wsCOBBMBCAA4FiEEmuvCXT0aY6hs
 4SbWeVOEFl5WrMgFAl+pQfkCGwMFCwkIBwIGFQoJCAsCBBYCAwECHgECF4AACgkQeVOEFl5W
 rMiN6ggAk3H5vk8QnbvGbb4sinxZt/wDetgk0AOR9NRmtTnPaW+sIJEfGBOz47Xih+f7uWJS
 j+uvc9Ewn2Z7n8z3ZHJlLAByLVLtcNXGoRIGJ27tevfOaNqgJHBPbFOcXCBBFTx4MYMM4iAZ
 cDT5vsBTSaM36JZFtHZBKkuFEItbA/N8ZQSHKdTYMIA7A3OCLGbJBqloQ8SlW4MkTzKX4u7R
 yefAYQ0h20x9IqC5Ju8IsYRFacVZconT16KS81IBceO42vXTN0VexbVF2rZIx3v/NT75r6Vw
 0FlXVB1lXOHKydRA2NeleS4NEG2vWqy/9Boj0itMfNDlOhkrA/0DcCurMpnpbM7ATQRcsMzk
 AQgA1Dpo/xWS66MaOJLwA28sKNMwkEk1Yjs+okOXDOu1F+0qvgE8sVmrOOPvvWr4axtKRSG1
 t2QUiZ/ZkW/x/+t0nrM39EANV1VncuQZ1ceIiwTJFqGZQ8kb0+BNkwuNVFHRgXm1qzAJweEt
 RdsCMohB+H7BL5LGCVG5JaU0lqFU9pFP40HxEbyzxjsZgSE8LwkI6wcu0BLv6K6cLm0EiHPO
 l5G8kgRi38PS7/6s3R8QDsEtbGsYy6O82k3zSLIjuDBwA9GRaeigGppTxzAHVjf5o9KKu4O7
 gC2KKVHPegbXS+GK7DU0fjzX57H5bZ6komE5eY4p3oWT/CwVPSGfPs8jOwARAQABwsB2BBgB
 CAAgFiEEmuvCXT0aY6hs4SbWeVOEFl5WrMgFAl+pQfkCGwwACgkQeVOEFl5WrMiVqwf9GwU8
 c6cylknZX8QwlsVudTC8xr/L17JA84wf03k3d4wxP7bqy5AYy7jboZMbgWXngAE/HPQU95NM
 aukysSnknzoIpC96XZJ0okLBXVS6Y0ylZQ+HrbIhMpuQPoDweoF5F9wKrsHRoDaUK1VR706X
 rwm4HUzh7Jk+auuMYfuCh0FVlFBEuiJWMLhg/5WCmcRfiuB6F59ZcUQrwLEZeNhF2XJV4KwB
 Tlg7HCWO/sy1foE5noaMyACjAtAQE9p5kGYaj+DuRhPdWUTsHNuqrhikzIZd2rrcMid+ktb0
 NvtvswzMO059z1YGMtGSqQ4srCArju+XHIdTFdiIYbd7+jeehg==
In-Reply-To: <9dd52865-6928-41dc-910b-82988fe6b2af@sentex.net>
X-Scanned-By: MIMEDefang 2.86
X-Spamd-Bar: ---
X-Spamd-Result: default: False [-3.39 / 15.00];
	NEURAL_HAM_LONG(-1.00)[-1.000];
	NEURAL_HAM_MEDIUM(-1.00)[-0.999];
	NEURAL_HAM_SHORT(-1.00)[-0.998];
	R_SPF_ALLOW(-0.20)[+ip6:2607:f3e0::/32];
	MIME_GOOD(-0.10)[multipart/alternative,text/plain];
	RCVD_IN_DNSWL_LOW(-0.10)[199.212.134.19:received];
	XM_UA_NO_VERSION(0.01)[];
	ASN(0.00)[asn:11647, ipnet:2607:f3e0::/32, country:CA];
	FREEFALL_USER(0.00)[mike];
	MIME_TRACE(0.00)[0:+,1:+,2:~];
	ARC_NA(0.00)[];
	RCPT_COUNT_TWO(0.00)[2];
	MID_RHS_MATCH_FROM(0.00)[];
	MLMMJ_DEST(0.00)[freebsd-stable@freebsd.org];
	DMARC_NA(0.00)[sentex.net];
	FROM_EQ_ENVFROM(0.00)[];
	FROM_HAS_DN(0.00)[];
	R_DKIM_NA(0.00)[];
	RCVD_COUNT_TWO(0.00)[2];
	TO_DN_ALL(0.00)[];
	TO_MATCH_ENVRCPT_ALL(0.00)[];
	RCVD_TLS_ALL(0.00)[]
X-Rspamd-Queue-Id: 4VNZdx3Hdzz4fg2

This is a multi-part message in MIME format.
--------------TeEYKHRauDcwvPTkUFKj80vS
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 8bit

On 4/22/2024 12:05 PM, mike tancsa wrote:
> On 4/22/2024 11:49 AM, Dag-Erling Smørgrav wrote:
>> mike tancsa  writes:
>>> I was afraid of that. So basically I have to copy the entire pool or
>>> live with the performance penalty :(  73TB is a lot to copy / move.
>> Oh I didn't realize those disks were part of the larger pool, I thought
>> they were a separate pool named “special”.  You might be able to simply
>> detach and then re-attach both drives, afaik a draid can function
>> without its special vdev.
>
> Yeah, its an actual special vdev I added to speed up metadata and 
> small file access.  zpool-detach I think only works on mirrors and not 
> raidz vdevs.  From searching google, there does not seem to be a way 
> to detach a special vdev from a raidz pool.
>
>
I think I  confirmed my suspicion with a quick test pool

truncate -s 100G /quirk-test/junk.raw
truncate -s 100G /quirk-test/junk2.raw

mdconfig -f /quirk-test/junk.raw
mdconfig -f /quirk-test/junk2.raw
gpart create -s gpt md0
gpart create -s gpt md1
gpart add -s 20G -t freebsd-zfs /dev/md0
gpart add -s 20G -t freebsd-zfs /dev/md0
gpart add -s 20G -t freebsd-zfs /dev/md0
gpart add -s 20G -t freebsd-zfs /dev/md1
gpart add -s 20G -t freebsd-zfs /dev/md1
gpart add -s 20G -t freebsd-zfs /dev/md1
zpool create testpool raidz1 /dev/md0p1 /dev/md1p1 /dev/md0p2 /dev/md1p2
zpool add testpool special mirror /dev/md0p3 /dev/md1p3
zpool status


   pool: testpool
  state: ONLINE
config:

         NAME        STATE     READ WRITE CKSUM
         testpool    ONLINE       0     0     0
           raidz1-0  ONLINE       0     0     0
             md0p1   ONLINE       0     0     0
             md1p1   ONLINE       0     0     0
             md0p2   ONLINE       0     0     0
             md1p2   ONLINE       0     0     0
         special
           mirror-1  ONLINE       0     0     0
             md0p3   ONLINE       0     0     0
             md1p3   ONLINE       0     0     0


  # zpool remove testpool mirror-1
cannot remove mirror-1: invalid config; all top-level vdevs must have 
the same sector size and not be raidz.

zpool detach just nukes the mirror I think for the special vdev

#  zpool detach testpool /dev/md1p3

# zpool status
   pool: quirk-test
  state: ONLINE
   scan: resilvered 128G in 00:08:52 with 0 errors on Mon Apr  8 
14:37:29 2024
config:

         NAME        STATE     READ WRITE CKSUM
         quirk-test  ONLINE       0     0     0
           raidz1-0  ONLINE       0     0     0
             da4p1   ONLINE       0     0     0
             da1p1   ONLINE       0     0     0
             da2p1   ONLINE       0     0     0
             da5p1   ONLINE       0     0     0

errors: No known data errors

   pool: testpool
  state: ONLINE
config:

         NAME        STATE     READ WRITE CKSUM
         testpool    ONLINE       0     0     0
           raidz1-0  ONLINE       0     0     0
             md0p1   ONLINE       0     0     0
             md1p1   ONLINE       0     0     0
             md0p2   ONLINE       0     0     0
             md1p2   ONLINE       0     0     0
         special
           md0p3     ONLINE       0     0     0

errors: No known data errors

  # zpool remove testpool /dev/md0p3
cannot remove /dev/md0p3: invalid config; all top-level vdevs must have 
the same sector size and not be raidz.

  # zpool detach testpool /dev/md0p3
cannot detach /dev/md0p3: only applicable to mirror and replacing vdevs


     ---Mike


--------------TeEYKHRauDcwvPTkUFKj80vS
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: 8bit



  
    
  
  
    
On 4/22/2024 12:05 PM, mike tancsa
      wrote:

    

    

      
      
On 4/22/2024 11:49 AM, Dag-Erling
        Smørgrav wrote:

      

      

        
mike tancsa <mike@sentex.net> writes:


        

          
I was afraid of that. So basically I have to copy the entire pool or
live with the performance penalty :(  73TB is a lot to copy / move.


        

        
Oh I didn't realize those disks were part of the larger pool, I thought
they were a separate pool named “special”.  You might be able to simply
detach and then re-attach both drives, afaik a draid can function
without its special vdev.


      

      
Yeah, its an actual special vdev I added to speed up metadata
        and small file access.  zpool-detach I think only works on
        mirrors and not raidz vdevs.  From searching google, there does
        not seem to be a way to detach a special vdev from a raidz pool.

      


      

    

    
I think I  confirmed my suspicion with a quick test pool

    
truncate -s 100G /quirk-test/junk.raw

      truncate -s 100G /quirk-test/junk2.raw

      

      mdconfig -f /quirk-test/junk.raw

      mdconfig -f /quirk-test/junk2.raw

      gpart create -s gpt md0

      gpart create -s gpt md1

      gpart add -s 20G -t freebsd-zfs /dev/md0

      gpart add -s 20G -t freebsd-zfs /dev/md0

      gpart add -s 20G -t freebsd-zfs /dev/md0

      gpart add -s 20G -t freebsd-zfs /dev/md1

      gpart add -s 20G -t freebsd-zfs /dev/md1

      gpart add -s 20G -t freebsd-zfs /dev/md1

      zpool create testpool raidz1 /dev/md0p1 /dev/md1p1 /dev/md0p2
      /dev/md1p2

      zpool add testpool special mirror /dev/md0p3 /dev/md1p3

      zpool status

    


        pool: testpool

       state: ONLINE

      config:

      

              NAME        STATE     READ WRITE CKSUM

              testpool    ONLINE       0     0     0

                raidz1-0  ONLINE       0     0     0

                  md0p1   ONLINE       0     0     0

                  md1p1   ONLINE       0     0     0

                  md0p2   ONLINE       0     0     0

                  md1p2   ONLINE       0     0     0

              special

                mirror-1  ONLINE       0     0     0

                  md0p3   ONLINE       0     0     0

                  md1p3   ONLINE       0     0     0

    

    


    

    
 # zpool remove testpool mirror-1

      cannot remove mirror-1: invalid config; all top-level vdevs must
      have the same sector size and not be raidz.

    
zpool detach just nukes the mirror I think for the special vdev

    
 #  zpool detach testpool /dev/md1p3

      

      # zpool status

        pool: quirk-test

       state: ONLINE

        scan: resilvered 128G in 00:08:52 with 0 errors on Mon Apr  8
      14:37:29 2024

      config:

      

              NAME        STATE     READ WRITE CKSUM

              quirk-test  ONLINE       0     0     0

                raidz1-0  ONLINE       0     0     0

                  da4p1   ONLINE       0     0     0

                  da1p1   ONLINE       0     0     0

                  da2p1   ONLINE       0     0     0

                  da5p1   ONLINE       0     0     0

      

      errors: No known data errors

      

        pool: testpool

       state: ONLINE

      config:

      

              NAME        STATE     READ WRITE CKSUM

              testpool    ONLINE       0     0     0

                raidz1-0  ONLINE       0     0     0

                  md0p1   ONLINE       0     0     0

                  md1p1   ONLINE       0     0     0

                  md0p2   ONLINE       0     0     0

                  md1p2   ONLINE       0     0     0

              special

                md0p3     ONLINE       0     0     0

      

      errors: No known data errors

      

       # zpool remove testpool /dev/md0p3

      cannot remove /dev/md0p3: invalid config; all top-level vdevs must
      have the same sector size and not be raidz.

      

       # zpool detach testpool /dev/md0p3

      cannot detach /dev/md0p3: only applicable to mirror and replacing
      vdevs

    

    


    

    
    ---Mike

    

    

    


    

    

      
 

      
 

  


--------------TeEYKHRauDcwvPTkUFKj80vS--

From nobody Tue Apr 23 05:19:23 2024
X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1])
	by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4VNr5W47TWz5JSW6
	for ; Tue, 23 Apr 2024 05:19:27 +0000 (UTC)
	(envelope-from gerrit.kuehn@aei.mpg.de)
Received: from umail2.aei.mpg.de (umail2.aei.mpg.de [194.94.224.8])
	(using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)
	 key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256)
	(Client did not present a certificate)
	by mx1.freebsd.org (Postfix) with ESMTPS id 4VNr5W1BL4z4fQy;
	Tue, 23 Apr 2024 05:19:27 +0000 (UTC)
	(envelope-from gerrit.kuehn@aei.mpg.de)
Authentication-Results: mx1.freebsd.org;
	none
Received: from arc.aei.uni-hannover.de (ahgate1.aei.uni-hannover.de [130.75.117.49])
	by umail2.aei.mpg.de (Postfix) with ESMTPS id 43A9F201041C;
	Tue, 23 Apr 2024 07:19:24 +0200 (CEST)
Date: Tue, 23 Apr 2024 07:19:23 +0200
From: Gerrit =?UTF-8?B?S8O8aG4=?= 
To: Dag-Erling =?UTF-8?B?U23DuHJncmF2?= 
Cc: freebsd-stable@freebsd.org
Subject: Re: possible regression handling packet fragmentation in 14.0 with
 tftp/pxe
Message-ID: <20240423071923.52b90652@arc.aei.uni-hannover.de>
In-Reply-To: <86o7a18ppl.fsf@ltc.des.dev>
References: <20240419153951.5a23ce5f@arc.aei.uni-hannover.de>
	<86y1999wwe.fsf@ltc.des.dev>
	<20240422075948.5bb856ac@arc.aei.uni-hannover.de>
	<86o7a18ppl.fsf@ltc.des.dev>
Organization: MPG
X-Mailer: Claws Mail 3.19.0 (GTK+ 2.24.33; amd64-portbld-freebsd13.1)
List-Id: Production branch of FreeBSD source code 
List-Archive: https://lists.freebsd.org/archives/freebsd-stable
List-Help: 
List-Post: 
List-Subscribe: 
List-Unsubscribe: 
X-BeenThere: freebsd-stable@freebsd.org
Sender: owner-freebsd-stable@FreeBSD.org
MIME-Version: 1.0
Content-Type: multipart/signed; boundary="Sig_/n=Wql0lmsdt=ZXg9KlPRuki";
 protocol="application/pkcs7-signature"; micalg=SHA384
X-Spamd-Bar: ----
X-Rspamd-Pre-Result: action=no action;
	module=replies;
	Message is reply to one we originated
X-Spamd-Result: default: False [-4.00 / 15.00];
	REPLY(-4.00)[];
	ASN(0.00)[asn:680, ipnet:194.94.0.0/15, country:DE]
X-Rspamd-Queue-Id: 4VNr5W1BL4z4fQy

--Sig_/n=Wql0lmsdt=ZXg9KlPRuki
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

Am Mon, 22 Apr 2024 15:57:42 +0200
schrieb Dag-Erling Sm=C3=B8rgrav :

> Off the top of my head, it means the packet length according to its
> header is longer than the capture length but the MF flag is not set.
> Historically, it meant you needed to increase tcpdump's snaplen, but
> these days it defaults to 256 kB so it shouldn't matter.  It might be a
> bug in bpf, or an interaction between pf and bpf.

So maybe this is rather a red herring than a pointer to the actual
difference in packet handling.

> There were changes in tftpd, but I don't know if that's relevant.

Most certainly not as I didn't touch the server side. The tftpd there is
certainly old, but it worked fine up to FreeBSD 13.3 on the router. It is
the update to 14.0 that triggered the problem.


cu
  Gerrit

--Sig_/n=Wql0lmsdt=ZXg9KlPRuki
Content-Type: application/pkcs7-signature; name=smime.p7s
Content-Transfer-Encoding: base64
Content-Disposition: attachment; filename=smime.p7s

MIAGCSqGSIb3DQEHAqCAMIACAQExDzANBglghkgBZQMEAgIFADCABgkqhkiG9w0B
BwEAAKCCF/QwggQyMIIDGqADAgECAgEBMA0GCSqGSIb3DQEBBQUAMHsxCzAJBgNV
BAYTAkdCMRswGQYDVQQIDBJHcmVhdGVyIE1hbmNoZXN0ZXIxEDAOBgNVBAcMB1Nh
bGZvcmQxGjAYBgNVBAoMEUNvbW9kbyBDQSBMaW1pdGVkMSEwHwYDVQQDDBhBQUEg
Q2VydGlmaWNhdGUgU2VydmljZXMwHhcNMDQwMTAxMDAwMDAwWhcNMjgxMjMxMjM1
OTU5WjB7MQswCQYDVQQGEwJHQjEbMBkGA1UECAwSR3JlYXRlciBNYW5jaGVzdGVy
MRAwDgYDVQQHDAdTYWxmb3JkMRowGAYDVQQKDBFDb21vZG8gQ0EgTGltaXRlZDEh
MB8GA1UEAwwYQUFBIENlcnRpZmljYXRlIFNlcnZpY2VzMIIBIjANBgkqhkiG9w0B
AQEFAAOCAQ8AMIIBCgKCAQEAvkCd9G7h6naHHE1FRI6+RsiDBp3BKv4YH47kAvrz
q11QihYxC5oG0MVwIs1JLVRjzLZuaEYLU+rLTCTAvHJO6vEVrvRUmhIKw3qyM2Di
2olV8yJY897cz++DhqKMlE+faPKYkEaEJ8d2v+PMNSyLXgdkZYLASLCokflhn3Yg
UKiRx2a163hiA1bwihoT6jGjHqCZ/Tj29icyWG8H9Wu4+xQrr7eqzNZjX3OM2gWZ
qDioyxd4NlGs6Z70eDqNzw/ZQuKYDKsvnw4B3u+fmUnxLd+sdE0bmLVHxeUp0fmQ
GMdinL6DxyZ7Poolx8DdneY1aBAgnY/Y3tLDhJwNXugvyQIDAQABo4HAMIG9MB0G
A1UdDgQWBBSgEQojPpbxB+zirynvgqV/0DCktDAOBgNVHQ8BAf8EBAMCAQYwDwYD
VR0TAQH/BAUwAwEB/zB7BgNVHR8EdDByMDigNqA0hjJodHRwOi8vY3JsLmNvbW9k
b2NhLmNvbS9BQUFDZXJ0aWZpY2F0ZVNlcnZpY2VzLmNybDA2oDSgMoYwaHR0cDov
L2NybC5jb21vZG8ubmV0L0FBQUNlcnRpZmljYXRlU2VydmljZXMuY3JsMA0GCSqG
SIb3DQEBBQUAA4IBAQAIVvwC8Jvo/6T61nvGRIDOT8TF9gBYzKa2vBRJaAR26Obu
XewCD2DWjVAYTyZOAePmsKXuv7x0VEG//fwSuMdPWvSJYAV/YLcFSvP28cK/xLl0
hrYtfWvM0vNG3S/G4GrDwzQDLH2W3VrCDqcKmcEFi6sML/NcOs9sN1UJh95TQGxY
7/y2q2VuBPYb3DzgWhXGntnxWUgwIWUDbOzpIXPsmwOh4DetoBUYj/q6As6nLKkQ
EyzU5QgmqyKXYPiQXnTUoppTvfKpaOCibsLXbLGjD56/62jnVvKu8uMrODoJgbVr
hde+Le0/GreyY+L1YiyC1GoAQVDxOYOflek2lphuMIIFgTCCBGmgAwIBAgIQOXJE
Ovkit1HX02wQ3TE1lTANBgkqhkiG9w0BAQwFADB7MQswCQYDVQQGEwJHQjEbMBkG
A1UECAwSR3JlYXRlciBNYW5jaGVzdGVyMRAwDgYDVQQHDAdTYWxmb3JkMRowGAYD
VQQKDBFDb21vZG8gQ0EgTGltaXRlZDEhMB8GA1UEAwwYQUFBIENlcnRpZmljYXRl
IFNlcnZpY2VzMB4XDTE5MDMxMjAwMDAwMFoXDTI4MTIzMTIzNTk1OVowgYgxCzAJ
BgNVBAYTAlVTMRMwEQYDVQQIEwpOZXcgSmVyc2V5MRQwEgYDVQQHEwtKZXJzZXkg
Q2l0eTEeMBwGA1UEChMVVGhlIFVTRVJUUlVTVCBOZXR3b3JrMS4wLAYDVQQDEyVV
U0VSVHJ1c3QgUlNBIENlcnRpZmljYXRpb24gQXV0aG9yaXR5MIICIjANBgkqhkiG
9w0BAQEFAAOCAg8AMIICCgKCAgEAgBJlFzYOw9sIs9CsVw127c0n00ytUINh4qog
TQktZAnczomfzD2p7PbPwdzx07HWezcoEStH2jnGvDoZtF+mvX2do2NCtnbyqTsr
kfjib9DsFiCQCT7i6HTJGLSR1GJk23+jBvGIGGqQIjy8/hPwhxR79uQfjtTkUcYR
Z0YIUcuGFFQ/vDP+fmyc/xadGL1RjjWmp2bIcmfbIWax1Jt4A8BQOujM8Ny8nkz+
rwWWNR9XWrf/zvk9tyy29lTdyOcSOk2uTIq3XJq0tyA9yn8iNK5+O2hmAUTnAU5G
U5szYPeUvlM3kHND8zLDU+/bqv50TmnHa4xgk97Exwzf4TKuzJM7UXiVZ4vuPVb+
DNBpDxsP8yUmazNt925H+nND5X4OpWaxKXwyhGNVicQNwZNUMBkTrNN9N6frXTps
NVzbQdcS2qlJC9/YgIoJk2KOtWbPJYjNhLixP6Q5D9kCnusSTJV882sFqV4Wg8y4
Z+LoE53MW4LTTLPtW//e5XOsIzstAL81VXQJSdhJWBp/kjbmUZIO8yZ9HE0XvMns
QybQv0FfQKlERPSZ51eHnlAfV1SoPv10Yy+xUGUJ5lhCLkMaTLTwJUdZ+gQek9Qm
RkpQgbLevni3/GcV4clXhB4PY9bpYrrWX1Uu6lzGKAgEJTm4Diup8kyXHAc/DVL1
7e8vgg8CAwEAAaOB8jCB7zAfBgNVHSMEGDAWgBSgEQojPpbxB+zirynvgqV/0DCk
tDAdBgNVHQ4EFgQUU3m/WqorSs9UgOHYm8Cd8rIDZsswDgYDVR0PAQH/BAQDAgGG
MA8GA1UdEwEB/wQFMAMBAf8wEQYDVR0gBAowCDAGBgRVHSAAMEMGA1UdHwQ8MDow
OKA2oDSGMmh0dHA6Ly9jcmwuY29tb2RvY2EuY29tL0FBQUNlcnRpZmljYXRlU2Vy
dmljZXMuY3JsMDQGCCsGAQUFBwEBBCgwJjAkBggrBgEFBQcwAYYYaHR0cDovL29j
c3AuY29tb2RvY2EuY29tMA0GCSqGSIb3DQEBDAUAA4IBAQAYh1HcdCE9nIrgJ7cz
0C7M7PDmy14R3iJvm3WOnnL+5Nb+qh+cli3vA0p+rvSNb3I8QzvAP+u431yqqcau
8vzY7qN7Q/aGNnwU4M309z/+3ri0ivCRlv79Q2R+/czSAaF9ffgZGclCKxO/WIu6
pKJmBHaIkU4MiRTOok3JMrO66BQavHHxW/BBC5gACiIDEOUMsfnNkjcZ7Tvx5Dq2
+UUTJnWvu6rvP3t3O9LEApE9GQDTF1w52z97GA1FzZOFli9d31kWTz9RvdVFGD/t
So7oBmF0Ixa1DVBzJ0RHfxBdiSprhTEUxOipakyAvGp4z7h/jnZymQyd/teRCBah
o1+VMIIG5jCCBM6gAwIBAgIQMQJw1DW+mySa+FbQ4eKFSTANBgkqhkiG9w0BAQwF
ADCBiDELMAkGA1UEBhMCVVMxEzARBgNVBAgTCk5ldyBKZXJzZXkxFDASBgNVBAcT
C0plcnNleSBDaXR5MR4wHAYDVQQKExVUaGUgVVNFUlRSVVNUIE5ldHdvcmsxLjAs
BgNVBAMTJVVTRVJUcnVzdCBSU0EgQ2VydGlmaWNhdGlvbiBBdXRob3JpdHkwHhcN
MjAwMjE4MDAwMDAwWhcNMzMwNTAxMjM1OTU5WjBGMQswCQYDVQQGEwJOTDEZMBcG
A1UEChMQR0VBTlQgVmVyZW5pZ2luZzEcMBoGA1UEAxMTR0VBTlQgUGVyc29uYWwg
Q0EgNDCCAiIwDQYJKoZIhvcNAQEBBQADggIPADCCAgoCggIBALNK4iJeJ1vpBFsU
BDUyIBSutNIxQMbNUMAeoUTKr55KYX8tkN5imzNqLaRCypYBPP9wED2AaO6e8njk
bjzJwLgPqDBkW9sG3kmi3GW6cF4Hwr5ysZqve/5EJDhV+9OhfTu/4dMnoR4Q41Hc
jMk9MzLOADAQ0awBZ/29r0d49AUmIKELNeqEqmnTN6fndL7x/2K0TLToZLxqS7sy
/Jvi0wEFr0CfdjcAsioh7KaD+Jizyb1aRKQzJ6Q20VEHX7UqWc1SkzTkbz6xj0S5
ydBBFQh0fNiy+qM/deVpK4HgmPSJrrpQZ+LlbHfWabmwoDPxF71QZVYiqrrAoUrG
RJ+47iLBiIg8miIYS7Hd2ppvAUt24CugMXUjETjQ+oYh09fNi5n/AvoER8UBvTHL
xt+blL0bvL+2z2YiUWk+2Qtn+dD+JU5Z2y71qV7+cr+4YXjvGzF5bYsi8HiwflTb
4Php3y+k1twKtchdcq2QGc0eDG6Y01nRHUiyr8/PtMAsLHEPNZ2wzsA7fb8mftHi
V20ZFmYqknJ8AIOfwdTVA+E62JayOJ+sxadqcmFDorsz/mrPwGZ8+txr4xSuvVjg
0dlv0yuA+1YpBDIYNfL4bkX+IcZ1mTstL4Xw0f4N2iW3bBmnPnYmoYxMM8gflCiT
gss73nBvG2f7v1PD7BDGYNO4iD4vAgMBAAGjggGLMIIBhzAfBgNVHSMEGDAWgBRT
eb9aqitKz1SA4dibwJ3ysgNmyzAdBgNVHQ4EFgQUaQChxyFY+ODFGyCwCt2nUb8T
2eQwDgYDVR0PAQH/BAQDAgGGMBIGA1UdEwEB/wQIMAYBAf8CAQAwHQYDVR0lBBYw
FAYIKwYBBQUHAwIGCCsGAQUFBwMEMDgGA1UdIAQxMC8wLQYEVR0gADAlMCMGCCsG
AQUFBwIBFhdodHRwczovL3NlY3RpZ28uY29tL0NQUzBQBgNVHR8ESTBHMEWgQ6BB
hj9odHRwOi8vY3JsLnVzZXJ0cnVzdC5jb20vVVNFUlRydXN0UlNBQ2VydGlmaWNh
dGlvbkF1dGhvcml0eS5jcmwwdgYIKwYBBQUHAQEEajBoMD8GCCsGAQUFBzAChjNo
dHRwOi8vY3J0LnVzZXJ0cnVzdC5jb20vVVNFUlRydXN0UlNBQWRkVHJ1c3RDQS5j
cnQwJQYIKwYBBQUHMAGGGWh0dHA6Ly9vY3NwLnVzZXJ0cnVzdC5jb20wDQYJKoZI
hvcNAQEMBQADggIBAAoFTnsNjx8TOQD9b+xixsPt7Req4wHMeNw/R5dddEPgQAQA
YJZKz5BEv1cjGbH7nbPH3AxrxhN6OVH40p6OLIo9MXSrrfMzGs7/P+FTCjwgNxFE
tLQ1KC9NboA3asJcl7mIs3l8h9iAgEH1zLUvq2s+5n++NQmbzudDsTFDMapY3kX1
TwyUCTRzmItqcbsYIyg2MeIXWfRtqPqC5R4bufmpzA5BPINLX340Sp/CNQ9QZqw3
VkfyHWwTo+vO9Gm2L6srNamJT6Lb+TeXZvl8UPL5a72O/pH0GgGHjt6z9QzPARna
RKshVWviNK6ST4WmZHllu3CJg0BXqx1vWyswawgvNeWt1qxITacYe9mSWTbNR2Cf
tvTUwerruDSY2jMaZPoNqbjUpuG/blYwWzzvVerBUhviAahPXJF/9V48ybWPBq6q
KOEokW+s3B4ad5sY96KlovEijaIQDip1HO0SD+rLNYaiBcr9MV2aK+DfbZ8w9BaN
CQyFEYwzxIKOVk3bYvzHRk5ihUDascmbk/bkiNl74c/KfuKQmJImaqWoWZR6jBcX
cPV0WUIKz/nILTpFhGojZEQW77by3aezAi9jrEIUBHRG1LwzPbJc2V3SOzYyaJFQ
atzuKZbN1Q9s9y/2x1QXtKwREY8jNgvx0iIfOK35gKgYJJcyDql4XfuEc2nVMIIH
SzCCBTOgAwIBAgIRAMCEqCZW/bEp9AgcdlGEWuEwDQYJKoZIhvcNAQEMBQAwRjEL
MAkGA1UEBhMCTkwxGTAXBgNVBAoTEEdFQU5UIFZlcmVuaWdpbmcxHDAaBgNVBAMT
E0dFQU5UIFBlcnNvbmFsIENBIDQwHhcNMjMwODE1MDAwMDAwWhcNMjYwODE0MjM1
OTU5WjCB0zEOMAwGA1UEERMFODA1MzkxRzBFBgNVBAoMPk1heC1QbGFuY2stR2Vz
ZWxsc2NoYWZ0IHp1ciBGw7ZyZGVydW5nIGRlciBXaXNzZW5zY2hhZnRlbiBlLlYu
MRswGQYDVQQJDBJIb2ZnYXJ0ZW5zdHJhw59lIDgxDzANBgNVBAgTBkJheWVybjEL
MAkGA1UEBhMCREUxFTATBgNVBAMTDEdlcnJpdCBLdWVobjEmMCQGCSqGSIb3DQEJ
ARYXZ2Vycml0Lmt1ZWhuQGFlaS5tcGcuZGUwggIiMA0GCSqGSIb3DQEBAQUAA4IC
DwAwggIKAoICAQCg7n7fRC0hIeomyBYF0RZ0L/jKjURwqPL3vBN+HvDxzp+Wcn0a
Voeia3LPeXvf18d7BeIQ2SVFXWnWzVpVKzv7VUg4OD424GmcQrFXkChSvOc/rLaA
FmNIaKWgYwUOAqmDh3t9JzQTVj6FrAeJwzXmnv42msNUfnhA2dRllOCmilLUqm/5
nOgrImuiA3R1S0CcljAmEr5PnUmKJaanbaq74Jb54gf622cRyWwylMJijMGboDYw
uaGynrLgfo+rWbXc2TASO6pjSQDKAAfXO/NzLgp+BmneN1II9alVUAJRUpFDkgx9
peM+qUJryLtO+veOKElsOe2S4qvk0PaE/MVAcIJiThdY7qde8Q9FyOJsDN5kiX4g
fsKmtF7EdB71Uc8N78L62r7/7Y5WL8gRxXCN8BsmLXSiCylvtIYsbJMDhK6C+37w
9Cg1A8AWeksg1TmCcvolEJy3+bfPx7NlmEfRdkdzuVb1KxfB0z4SbhSwOAR1WYVg
mEAQuj1l9k7suUtdUY4ZeMnRLVPtmQh+bxcJPaRllpHSTYbYVQlSNXkP0al2/J8d
jJHhulOsCX8oYfyQ9a33jHsKUf632Lpg8446ym19UrNPh9pntXRXVhhkw+/tPE8G
BxH81BCvvSUhVu0Nckx8zOWiI1+6Z5t71udnXOEv9lJFvqDlY71lkiu+jQIDAQAB
o4IBpDCCAaAwHwYDVR0jBBgwFoAUaQChxyFY+ODFGyCwCt2nUb8T2eQwHQYDVR0O
BBYEFOsacOXMtCWA1hWcY7A/tb8e/tTSMA4GA1UdDwEB/wQEAwIFoDAMBgNVHRMB
Af8EAjAAMB0GA1UdJQQWMBQGCCsGAQUFBwMEBggrBgEFBQcDAjA/BgNVHSAEODA2
MDQGCysGAQQBsjEBAgJPMCUwIwYIKwYBBQUHAgEWF2h0dHBzOi8vc2VjdGlnby5j
b20vQ1BTMEIGA1UdHwQ7MDkwN6A1oDOGMWh0dHA6Ly9HRUFOVC5jcmwuc2VjdGln
by5jb20vR0VBTlRQZXJzb25hbENBNC5jcmwweAYIKwYBBQUHAQEEbDBqMD0GCCsG
AQUFBzAChjFodHRwOi8vR0VBTlQuY3J0LnNlY3RpZ28uY29tL0dFQU5UUGVyc29u
YWxDQTQuY3J0MCkGCCsGAQUFBzABhh1odHRwOi8vR0VBTlQub2NzcC5zZWN0aWdv
LmNvbTAiBgNVHREEGzAZgRdnZXJyaXQua3VlaG5AYWVpLm1wZy5kZTANBgkqhkiG
9w0BAQwFAAOCAgEAbUB7zWvNZ98vh3u7hzpnbA1K4U9bga1YkpVbOgv7/UY5RiZP
Rk06O18f5TnRSWiiF3XImBG1uVjbcwVKIemliCQRQzVVt2JXOJVT1EafDDe9DK5o
QaXGHY7NAT1lPLEwtgv8hxBBvthMaMa6lpibT/IUi83jHPZUgsGajCgPXd05Bh/L
jCzWDOmHuwFdjRAMQs1VsPYx+OVcRvS1jmw0bT6o5/nruRwF5brxUK39Mftj3sIN
b+UvVkXdAGw5iQWFwllGpwBgo3iESa1R72qkBMWph8D6Jbg795WBgjMULCPTiZkq
eOif9sW1/37AoutSh7VMh7WMrEW9QURVWYR1hYjS0/TMo8aXfPOLtLYoSg/R6i+j
eXqREsJQxMAl0e/JJej1TAFCsWg0r6Dg4mYq636plAr6pu7pJATNVPT0HrsBMYWu
PV2WRH8Obs+n1xe4ftGxE4yDWiL56lnp6tnfVR8qinEqpGBfj7BAwEcO/Na9b+oK
tDEmWHzupKkdmoOWktURY+Q/5RVWoiozNujYljc9iaK3agqBbJ5ZzRyrCKOPLnw4
9b8koO03WkXPqlm59nxAOdJE6ZQ2aQ8ev6ji+UlGnlIvgk70MsRukY2shpAiowb6
bKjKyK3QGNnT4zmL6ixSRmnYhC95U923Yf+hy+6jqS1Ec6kgpREYG53Qv5IxggMs
MIIDKAIBATBbMEYxCzAJBgNVBAYTAk5MMRkwFwYDVQQKExBHRUFOVCBWZXJlbmln
aW5nMRwwGgYDVQQDExNHRUFOVCBQZXJzb25hbCBDQSA0AhEAwISoJlb9sSn0CBx2
UYRa4TANBglghkgBZQMEAgIFAKCBozAYBgkqhkiG9w0BCQMxCwYJKoZIhvcNAQcB
MBwGCSqGSIb3DQEJBTEPFw0yNDA0MjMwNTE5MjNaMCgGCSqGSIb3DQEJDzEbMBkw
CwYJYIZIAWUDBAECMAoGCCqGSIb3DQMHMD8GCSqGSIb3DQEJBDEyBDDf3xPaShCm
EbxkmhDxtqO+Rkr7HFugrNJoBVwxKUR7bot5Y11oCIIj1WJjwfjt+mwwDQYJKoZI
hvcNAQEBBQAEggIAf21RF7RxQ0JUkX2WTyd+9ofqOU7h3cx6FJNuuryC+K7YESvP
mK9GD1zM895zBCkS0jzT2jbC2HGcuen+oBNDJJgYU5QhnwTxIPgKigsOFhuvLkyb
1z2GmYMAmM5AuFi7U/TpNoe4nIbsjmhtk1cYorXadCQNAV/SyB/CO8e3pGgdX34G
gTe8Q3PzZKPxs1xJvxEf4phxuU32wMTxI3pa4e22ezt51bRjalCVWgVUdWanRb/R
nFInanUXQI2Pke7DDjIUBtVqDCVd/cIR6UfmBrqd+xEtjgXYtkmIPBBZsccy1NPW
xcVWZlaAXSMU+CJDfSG+gBzf7120e/oeYu7VjCGYaGTjtae+M/b8aZJdFAKhudZN
WKHL67Zi3UdAlI9yyJHWwRzMjZG3SmwWzWdszGekGzZJJbncN/7sL7FtprjvosFo
Bi2B9XoBszeotDbA9kWhxc+gpkKyCzx162q3sWiNtUAFykDoB1Id2J1Ffdun8GcQ
tpIjRFrGAn3ep15yjraptmz0hAW3UJOTMXy/VOAB4OAK63erd0fUCLh8r01e+2vg
MLLpxc9J8o4BwNEt5EChZcyHNOXgyT9DR8jYs5KEbmqkETmsAF1JmUvdSgkVOyCZ
7WI7tjQcrD85bV89Fw57rt+jem/IDlL2lokTf6I70DTqfB5gAqcKKa2C/3UAAAAA
AAA=

--Sig_/n=Wql0lmsdt=ZXg9KlPRuki--

From nobody Tue Apr 23 14:50:33 2024
X-Original-To: stable@mlmmj.nyi.freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1])
	by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4VP4mh1bFzz5HPZH
	for ; Tue, 23 Apr 2024 14:50:44 +0000 (UTC)
	(envelope-from mgrooms@shrew.net)
Received: from mx2.shrew.net (mx2.shrew.net [204.27.62.58])
	(using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)
	 key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256)
	(Client did not present a certificate)
	by mx1.freebsd.org (Postfix) with ESMTPS id 4VP4mg12wcz4tqg
	for ; Tue, 23 Apr 2024 14:50:43 +0000 (UTC)
	(envelope-from mgrooms@shrew.net)
Authentication-Results: mx1.freebsd.org;
	dkim=pass header.d=shrew.net header.s=default header.b=dnN2oGN6;
	dmarc=none;
	spf=pass (mx1.freebsd.org: domain of mgrooms@shrew.net designates 204.27.62.58 as permitted sender) smtp.mailfrom=mgrooms@shrew.net
Received: from mail.shrew.net (mail1.shrew.prv [10.26.2.18])
	by mx2.shrew.net (8.17.1/8.17.1) with ESMTP id 43NEoYqS019824
	for ; Tue, 23 Apr 2024 09:50:34 -0500 (CDT)
	(envelope-from mgrooms@shrew.net)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=shrew.net; s=default;
	t=1713883834;
	h=from:from:reply-to:subject:subject:date:date:message-id:message-id:
	 to:to:cc:mime-version:mime-version:content-type:content-type:
	 content-transfer-encoding:content-transfer-encoding:
	 in-reply-to:in-reply-to:references:references;
	bh=LUwT7o3iwpBmb4fHOg1SsdOophJbO2dQyndKL8/h/hM=;
	b=dnN2oGN6C8NdZ7eC4VMa9PLBOaJ+/VgCtp3cKeo9iku4U1B7ygNgEfPd2SX1kxuVvuUcfi
	EgGu8MtecQJ39Pi+WQcWMs2lD2aIL1Rm3x8NBVsxnAqrlNJBeJ6SEAoY5pzpXw1EluFM5v
	z+Nv8na5GLM5OJS8PQwXiE1HYAB8naGaZDJ4HuEi9VfTizZjN+jSExyoLUz0eWxUcgJ5bR
	b6C9iNBJHUlpxK7B6JZ40s6H7v1ZTeTUkumayfeadpE5NjTwGPrHVQp5s2mzoNqjrZSMFK
	fu//qw2GvcFqF6tVw1LO+KYNgzOmjzO8ljrdm98BQnxVuFapsKR5Mh2h4wM2KA==
Received: from [10.22.200.32] (unknown [136.62.156.42])
	by mail.shrew.net (Postfix) with ESMTPSA id 9DB363B5FC
	for ; Tue, 23 Apr 2024 09:50:34 -0500 (CDT)
Message-ID: <922446cd-4511-4132-8e8f-9c9144a7f9b1@shrew.net>
Date: Tue, 23 Apr 2024 09:50:33 -0500
List-Id: Production branch of FreeBSD source code 
List-Archive: https://lists.freebsd.org/archives/freebsd-stable
List-Help: 
List-Post: 
List-Subscribe: 
List-Unsubscribe: 
X-BeenThere: freebsd-stable@freebsd.org
Sender: owner-freebsd-stable@FreeBSD.org
MIME-Version: 1.0
User-Agent: Mozilla Thunderbird
Subject: Re: possible regression handling packet fragmentation in 14.0 with
 tftp/pxe
To: stable@freebsd.org
References: <20240419153951.5a23ce5f@arc.aei.uni-hannover.de>
 <86y1999wwe.fsf@ltc.des.dev>
 <20240422075948.5bb856ac@arc.aei.uni-hannover.de>
 <86o7a18ppl.fsf@ltc.des.dev>
 <20240423071923.52b90652@arc.aei.uni-hannover.de>
Content-Language: en-US
From: Matthew Grooms 
In-Reply-To: <20240423071923.52b90652@arc.aei.uni-hannover.de>
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 8bit
X-Spamd-Bar: ---
X-Spamd-Result: default: False [-3.47 / 15.00];
	NEURAL_HAM_LONG(-1.00)[-1.000];
	NEURAL_HAM_MEDIUM(-1.00)[-1.000];
	NEURAL_HAM_SHORT(-0.98)[-0.984];
	R_SPF_ALLOW(-0.20)[+mx];
	R_DKIM_ALLOW(-0.20)[shrew.net:s=default];
	MIME_GOOD(-0.10)[text/plain];
	XM_UA_NO_VERSION(0.01)[];
	FROM_HAS_DN(0.00)[];
	RCVD_VIA_SMTP_AUTH(0.00)[];
	ASN(0.00)[asn:19969, ipnet:204.27.56.0/21, country:US];
	RCPT_COUNT_ONE(0.00)[1];
	MIME_TRACE(0.00)[0:+];
	DMARC_NA(0.00)[shrew.net];
	RCVD_TLS_LAST(0.00)[];
	ARC_NA(0.00)[];
	RCVD_COUNT_TWO(0.00)[2];
	FROM_EQ_ENVFROM(0.00)[];
	MID_RHS_MATCH_FROM(0.00)[];
	TO_DN_NONE(0.00)[];
	PREVIOUSLY_DELIVERED(0.00)[stable@freebsd.org];
	TO_MATCH_ENVRCPT_ALL(0.00)[];
	MLMMJ_DEST(0.00)[stable@freebsd.org];
	DKIM_TRACE(0.00)[shrew.net:+]
X-Rspamd-Queue-Id: 4VP4mg12wcz4tqg

Sorry. I didn't missed some of the previous details here, but I see you 
mention pf below. Did you happen to see this?

https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=276856

-Matthew

On 4/23/24 00:19, Gerrit Kühn wrote:
> Am Mon, 22 Apr 2024 15:57:42 +0200
> schrieb Dag-Erling Smørgrav :
>
>> Off the top of my head, it means the packet length according to its
>> header is longer than the capture length but the MF flag is not set.
>> Historically, it meant you needed to increase tcpdump's snaplen, but
>> these days it defaults to 256 kB so it shouldn't matter.  It might be a
>> bug in bpf, or an interaction between pf and bpf.
> So maybe this is rather a red herring than a pointer to the actual
> difference in packet handling.
>
>> There were changes in tftpd, but I don't know if that's relevant.
> Most certainly not as I didn't touch the server side. The tftpd there is
> certainly old, but it worked fine up to FreeBSD 13.3 on the router. It is
> the update to 14.0 that triggered the problem.
>
>
> cu
>    Gerrit

From nobody Wed Apr 24 05:54:17 2024
X-Original-To: stable@mlmmj.nyi.freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1])
	by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4VPSqJ2lYrz5Js3Y
	for ; Wed, 24 Apr 2024 05:54:20 +0000 (UTC)
	(envelope-from gerrit.kuehn@aei.mpg.de)
Received: from umail2.aei.mpg.de (umail2.aei.mpg.de [194.94.224.8])
	(using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)
	 key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256)
	(Client did not present a certificate)
	by mx1.freebsd.org (Postfix) with ESMTPS id 4VPSqJ0g4rz4Zh5
	for ; Wed, 24 Apr 2024 05:54:20 +0000 (UTC)
	(envelope-from gerrit.kuehn@aei.mpg.de)
Authentication-Results: mx1.freebsd.org;
	none
Received: from arc.aei.uni-hannover.de (ahgate1.aei.uni-hannover.de [130.75.117.49])
	by umail2.aei.mpg.de (Postfix) with ESMTPS id BE725200FA25;
	Wed, 24 Apr 2024 07:54:17 +0200 (CEST)
Date: Wed, 24 Apr 2024 07:54:17 +0200
From: Gerrit =?UTF-8?B?S8O8aG4=?= 
To: Matthew Grooms 
Cc: stable@freebsd.org
Subject: Re: possible regression handling packet fragmentation in 14.0 with
 tftp/pxe
Message-ID: <20240424075417.6640e97f@arc.aei.uni-hannover.de>
In-Reply-To: <922446cd-4511-4132-8e8f-9c9144a7f9b1@shrew.net>
References: <20240419153951.5a23ce5f@arc.aei.uni-hannover.de>
	<86y1999wwe.fsf@ltc.des.dev>
	<20240422075948.5bb856ac@arc.aei.uni-hannover.de>
	<86o7a18ppl.fsf@ltc.des.dev>
	<20240423071923.52b90652@arc.aei.uni-hannover.de>
	<922446cd-4511-4132-8e8f-9c9144a7f9b1@shrew.net>
Organization: MPG
X-Mailer: Claws Mail 3.19.0 (GTK+ 2.24.33; amd64-portbld-freebsd13.1)
List-Id: Production branch of FreeBSD source code 
List-Archive: https://lists.freebsd.org/archives/freebsd-stable
List-Help: 
List-Post: 
List-Subscribe: 
List-Unsubscribe: 
X-BeenThere: freebsd-stable@freebsd.org
Sender: owner-freebsd-stable@FreeBSD.org
MIME-Version: 1.0
Content-Type: multipart/signed; boundary="Sig_/M.HaaghOy1/2ol2ORjl6XY=";
 protocol="application/pkcs7-signature"; micalg=SHA384
X-Spamd-Bar: ----
X-Rspamd-Pre-Result: action=no action;
	module=replies;
	Message is reply to one we originated
X-Spamd-Result: default: False [-4.00 / 15.00];
	REPLY(-4.00)[];
	ASN(0.00)[asn:680, ipnet:194.94.0.0/15, country:DE]
X-Rspamd-Queue-Id: 4VPSqJ0g4rz4Zh5

--Sig_/M.HaaghOy1/2ol2ORjl6XY=
Content-Type: text/plain; charset=US-ASCII
Content-Transfer-Encoding: quoted-printable

Am Tue, 23 Apr 2024 09:50:33 -0500
schrieb Matthew Grooms :

> Sorry. I didn't missed some of the previous details here, but I see you=20
> mention pf below. Did you happen to see this?
>=20
> https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D276856

Ah, great. No, I hadn't seen that before, thanks.
This certainly looks like it might be the cause of the issue I see,
although I'm not sure I fully understand the situation. What I get so far
is that

* 14.0 does not reassemble packets by default anymore when using scrub
  while 13.x did

* 14.0 silently drops fragmented packets by default where 13.x didn't

Is that correct? That would probably explain why tftp couldn't pass my vpn
tunnel anymore.

What I am using in my pf.conf is a simple
---
scrub in all
---

=46rom the bug report I get that either using
---
scrub fragment reassemble
---

or

---
set reassemble yes
---

should be able to fix this and get the old behaviour back?


I remember playing with the "scrub fragment" option last week, but maybe I
didn't try to explicitely turn it on as that was described as default in
the manpage.
Anyway, I'll look into this again, thank you very much for the pointer.



One more question:
Looking at the linked reviews:
https://reviews.freebsd.org/D42355
https://reviews.freebsd.org/D42270

These appear to address the issue. I can get to the actual commit from the
review:
https://reviews.freebsd.org/rGede5d4ff5b39ccbc193c30fb6c093c7c4de9a464

Is there an easy way to find out where this commit ends up, i.e., whether
it is merged into 14.0, 14.1 or so?


cu
  Gerrit

--Sig_/M.HaaghOy1/2ol2ORjl6XY=
Content-Type: application/pkcs7-signature; name=smime.p7s
Content-Transfer-Encoding: base64
Content-Disposition: attachment; filename=smime.p7s

MIAGCSqGSIb3DQEHAqCAMIACAQExDzANBglghkgBZQMEAgIFADCABgkqhkiG9w0B
BwEAAKCCF/QwggQyMIIDGqADAgECAgEBMA0GCSqGSIb3DQEBBQUAMHsxCzAJBgNV
BAYTAkdCMRswGQYDVQQIDBJHcmVhdGVyIE1hbmNoZXN0ZXIxEDAOBgNVBAcMB1Nh
bGZvcmQxGjAYBgNVBAoMEUNvbW9kbyBDQSBMaW1pdGVkMSEwHwYDVQQDDBhBQUEg
Q2VydGlmaWNhdGUgU2VydmljZXMwHhcNMDQwMTAxMDAwMDAwWhcNMjgxMjMxMjM1
OTU5WjB7MQswCQYDVQQGEwJHQjEbMBkGA1UECAwSR3JlYXRlciBNYW5jaGVzdGVy
MRAwDgYDVQQHDAdTYWxmb3JkMRowGAYDVQQKDBFDb21vZG8gQ0EgTGltaXRlZDEh
MB8GA1UEAwwYQUFBIENlcnRpZmljYXRlIFNlcnZpY2VzMIIBIjANBgkqhkiG9w0B
AQEFAAOCAQ8AMIIBCgKCAQEAvkCd9G7h6naHHE1FRI6+RsiDBp3BKv4YH47kAvrz
q11QihYxC5oG0MVwIs1JLVRjzLZuaEYLU+rLTCTAvHJO6vEVrvRUmhIKw3qyM2Di
2olV8yJY897cz++DhqKMlE+faPKYkEaEJ8d2v+PMNSyLXgdkZYLASLCokflhn3Yg
UKiRx2a163hiA1bwihoT6jGjHqCZ/Tj29icyWG8H9Wu4+xQrr7eqzNZjX3OM2gWZ
qDioyxd4NlGs6Z70eDqNzw/ZQuKYDKsvnw4B3u+fmUnxLd+sdE0bmLVHxeUp0fmQ
GMdinL6DxyZ7Poolx8DdneY1aBAgnY/Y3tLDhJwNXugvyQIDAQABo4HAMIG9MB0G
A1UdDgQWBBSgEQojPpbxB+zirynvgqV/0DCktDAOBgNVHQ8BAf8EBAMCAQYwDwYD
VR0TAQH/BAUwAwEB/zB7BgNVHR8EdDByMDigNqA0hjJodHRwOi8vY3JsLmNvbW9k
b2NhLmNvbS9BQUFDZXJ0aWZpY2F0ZVNlcnZpY2VzLmNybDA2oDSgMoYwaHR0cDov
L2NybC5jb21vZG8ubmV0L0FBQUNlcnRpZmljYXRlU2VydmljZXMuY3JsMA0GCSqG
SIb3DQEBBQUAA4IBAQAIVvwC8Jvo/6T61nvGRIDOT8TF9gBYzKa2vBRJaAR26Obu
XewCD2DWjVAYTyZOAePmsKXuv7x0VEG//fwSuMdPWvSJYAV/YLcFSvP28cK/xLl0
hrYtfWvM0vNG3S/G4GrDwzQDLH2W3VrCDqcKmcEFi6sML/NcOs9sN1UJh95TQGxY
7/y2q2VuBPYb3DzgWhXGntnxWUgwIWUDbOzpIXPsmwOh4DetoBUYj/q6As6nLKkQ
EyzU5QgmqyKXYPiQXnTUoppTvfKpaOCibsLXbLGjD56/62jnVvKu8uMrODoJgbVr
hde+Le0/GreyY+L1YiyC1GoAQVDxOYOflek2lphuMIIFgTCCBGmgAwIBAgIQOXJE
Ovkit1HX02wQ3TE1lTANBgkqhkiG9w0BAQwFADB7MQswCQYDVQQGEwJHQjEbMBkG
A1UECAwSR3JlYXRlciBNYW5jaGVzdGVyMRAwDgYDVQQHDAdTYWxmb3JkMRowGAYD
VQQKDBFDb21vZG8gQ0EgTGltaXRlZDEhMB8GA1UEAwwYQUFBIENlcnRpZmljYXRl
IFNlcnZpY2VzMB4XDTE5MDMxMjAwMDAwMFoXDTI4MTIzMTIzNTk1OVowgYgxCzAJ
BgNVBAYTAlVTMRMwEQYDVQQIEwpOZXcgSmVyc2V5MRQwEgYDVQQHEwtKZXJzZXkg
Q2l0eTEeMBwGA1UEChMVVGhlIFVTRVJUUlVTVCBOZXR3b3JrMS4wLAYDVQQDEyVV
U0VSVHJ1c3QgUlNBIENlcnRpZmljYXRpb24gQXV0aG9yaXR5MIICIjANBgkqhkiG
9w0BAQEFAAOCAg8AMIICCgKCAgEAgBJlFzYOw9sIs9CsVw127c0n00ytUINh4qog
TQktZAnczomfzD2p7PbPwdzx07HWezcoEStH2jnGvDoZtF+mvX2do2NCtnbyqTsr
kfjib9DsFiCQCT7i6HTJGLSR1GJk23+jBvGIGGqQIjy8/hPwhxR79uQfjtTkUcYR
Z0YIUcuGFFQ/vDP+fmyc/xadGL1RjjWmp2bIcmfbIWax1Jt4A8BQOujM8Ny8nkz+
rwWWNR9XWrf/zvk9tyy29lTdyOcSOk2uTIq3XJq0tyA9yn8iNK5+O2hmAUTnAU5G
U5szYPeUvlM3kHND8zLDU+/bqv50TmnHa4xgk97Exwzf4TKuzJM7UXiVZ4vuPVb+
DNBpDxsP8yUmazNt925H+nND5X4OpWaxKXwyhGNVicQNwZNUMBkTrNN9N6frXTps
NVzbQdcS2qlJC9/YgIoJk2KOtWbPJYjNhLixP6Q5D9kCnusSTJV882sFqV4Wg8y4
Z+LoE53MW4LTTLPtW//e5XOsIzstAL81VXQJSdhJWBp/kjbmUZIO8yZ9HE0XvMns
QybQv0FfQKlERPSZ51eHnlAfV1SoPv10Yy+xUGUJ5lhCLkMaTLTwJUdZ+gQek9Qm
RkpQgbLevni3/GcV4clXhB4PY9bpYrrWX1Uu6lzGKAgEJTm4Diup8kyXHAc/DVL1
7e8vgg8CAwEAAaOB8jCB7zAfBgNVHSMEGDAWgBSgEQojPpbxB+zirynvgqV/0DCk
tDAdBgNVHQ4EFgQUU3m/WqorSs9UgOHYm8Cd8rIDZsswDgYDVR0PAQH/BAQDAgGG
MA8GA1UdEwEB/wQFMAMBAf8wEQYDVR0gBAowCDAGBgRVHSAAMEMGA1UdHwQ8MDow
OKA2oDSGMmh0dHA6Ly9jcmwuY29tb2RvY2EuY29tL0FBQUNlcnRpZmljYXRlU2Vy
dmljZXMuY3JsMDQGCCsGAQUFBwEBBCgwJjAkBggrBgEFBQcwAYYYaHR0cDovL29j
c3AuY29tb2RvY2EuY29tMA0GCSqGSIb3DQEBDAUAA4IBAQAYh1HcdCE9nIrgJ7cz
0C7M7PDmy14R3iJvm3WOnnL+5Nb+qh+cli3vA0p+rvSNb3I8QzvAP+u431yqqcau
8vzY7qN7Q/aGNnwU4M309z/+3ri0ivCRlv79Q2R+/czSAaF9ffgZGclCKxO/WIu6
pKJmBHaIkU4MiRTOok3JMrO66BQavHHxW/BBC5gACiIDEOUMsfnNkjcZ7Tvx5Dq2
+UUTJnWvu6rvP3t3O9LEApE9GQDTF1w52z97GA1FzZOFli9d31kWTz9RvdVFGD/t
So7oBmF0Ixa1DVBzJ0RHfxBdiSprhTEUxOipakyAvGp4z7h/jnZymQyd/teRCBah
o1+VMIIG5jCCBM6gAwIBAgIQMQJw1DW+mySa+FbQ4eKFSTANBgkqhkiG9w0BAQwF
ADCBiDELMAkGA1UEBhMCVVMxEzARBgNVBAgTCk5ldyBKZXJzZXkxFDASBgNVBAcT
C0plcnNleSBDaXR5MR4wHAYDVQQKExVUaGUgVVNFUlRSVVNUIE5ldHdvcmsxLjAs
BgNVBAMTJVVTRVJUcnVzdCBSU0EgQ2VydGlmaWNhdGlvbiBBdXRob3JpdHkwHhcN
MjAwMjE4MDAwMDAwWhcNMzMwNTAxMjM1OTU5WjBGMQswCQYDVQQGEwJOTDEZMBcG
A1UEChMQR0VBTlQgVmVyZW5pZ2luZzEcMBoGA1UEAxMTR0VBTlQgUGVyc29uYWwg
Q0EgNDCCAiIwDQYJKoZIhvcNAQEBBQADggIPADCCAgoCggIBALNK4iJeJ1vpBFsU
BDUyIBSutNIxQMbNUMAeoUTKr55KYX8tkN5imzNqLaRCypYBPP9wED2AaO6e8njk
bjzJwLgPqDBkW9sG3kmi3GW6cF4Hwr5ysZqve/5EJDhV+9OhfTu/4dMnoR4Q41Hc
jMk9MzLOADAQ0awBZ/29r0d49AUmIKELNeqEqmnTN6fndL7x/2K0TLToZLxqS7sy
/Jvi0wEFr0CfdjcAsioh7KaD+Jizyb1aRKQzJ6Q20VEHX7UqWc1SkzTkbz6xj0S5
ydBBFQh0fNiy+qM/deVpK4HgmPSJrrpQZ+LlbHfWabmwoDPxF71QZVYiqrrAoUrG
RJ+47iLBiIg8miIYS7Hd2ppvAUt24CugMXUjETjQ+oYh09fNi5n/AvoER8UBvTHL
xt+blL0bvL+2z2YiUWk+2Qtn+dD+JU5Z2y71qV7+cr+4YXjvGzF5bYsi8HiwflTb
4Php3y+k1twKtchdcq2QGc0eDG6Y01nRHUiyr8/PtMAsLHEPNZ2wzsA7fb8mftHi
V20ZFmYqknJ8AIOfwdTVA+E62JayOJ+sxadqcmFDorsz/mrPwGZ8+txr4xSuvVjg
0dlv0yuA+1YpBDIYNfL4bkX+IcZ1mTstL4Xw0f4N2iW3bBmnPnYmoYxMM8gflCiT
gss73nBvG2f7v1PD7BDGYNO4iD4vAgMBAAGjggGLMIIBhzAfBgNVHSMEGDAWgBRT
eb9aqitKz1SA4dibwJ3ysgNmyzAdBgNVHQ4EFgQUaQChxyFY+ODFGyCwCt2nUb8T
2eQwDgYDVR0PAQH/BAQDAgGGMBIGA1UdEwEB/wQIMAYBAf8CAQAwHQYDVR0lBBYw
FAYIKwYBBQUHAwIGCCsGAQUFBwMEMDgGA1UdIAQxMC8wLQYEVR0gADAlMCMGCCsG
AQUFBwIBFhdodHRwczovL3NlY3RpZ28uY29tL0NQUzBQBgNVHR8ESTBHMEWgQ6BB
hj9odHRwOi8vY3JsLnVzZXJ0cnVzdC5jb20vVVNFUlRydXN0UlNBQ2VydGlmaWNh
dGlvbkF1dGhvcml0eS5jcmwwdgYIKwYBBQUHAQEEajBoMD8GCCsGAQUFBzAChjNo
dHRwOi8vY3J0LnVzZXJ0cnVzdC5jb20vVVNFUlRydXN0UlNBQWRkVHJ1c3RDQS5j
cnQwJQYIKwYBBQUHMAGGGWh0dHA6Ly9vY3NwLnVzZXJ0cnVzdC5jb20wDQYJKoZI
hvcNAQEMBQADggIBAAoFTnsNjx8TOQD9b+xixsPt7Req4wHMeNw/R5dddEPgQAQA
YJZKz5BEv1cjGbH7nbPH3AxrxhN6OVH40p6OLIo9MXSrrfMzGs7/P+FTCjwgNxFE
tLQ1KC9NboA3asJcl7mIs3l8h9iAgEH1zLUvq2s+5n++NQmbzudDsTFDMapY3kX1
TwyUCTRzmItqcbsYIyg2MeIXWfRtqPqC5R4bufmpzA5BPINLX340Sp/CNQ9QZqw3
VkfyHWwTo+vO9Gm2L6srNamJT6Lb+TeXZvl8UPL5a72O/pH0GgGHjt6z9QzPARna
RKshVWviNK6ST4WmZHllu3CJg0BXqx1vWyswawgvNeWt1qxITacYe9mSWTbNR2Cf
tvTUwerruDSY2jMaZPoNqbjUpuG/blYwWzzvVerBUhviAahPXJF/9V48ybWPBq6q
KOEokW+s3B4ad5sY96KlovEijaIQDip1HO0SD+rLNYaiBcr9MV2aK+DfbZ8w9BaN
CQyFEYwzxIKOVk3bYvzHRk5ihUDascmbk/bkiNl74c/KfuKQmJImaqWoWZR6jBcX
cPV0WUIKz/nILTpFhGojZEQW77by3aezAi9jrEIUBHRG1LwzPbJc2V3SOzYyaJFQ
atzuKZbN1Q9s9y/2x1QXtKwREY8jNgvx0iIfOK35gKgYJJcyDql4XfuEc2nVMIIH
SzCCBTOgAwIBAgIRAMCEqCZW/bEp9AgcdlGEWuEwDQYJKoZIhvcNAQEMBQAwRjEL
MAkGA1UEBhMCTkwxGTAXBgNVBAoTEEdFQU5UIFZlcmVuaWdpbmcxHDAaBgNVBAMT
E0dFQU5UIFBlcnNvbmFsIENBIDQwHhcNMjMwODE1MDAwMDAwWhcNMjYwODE0MjM1
OTU5WjCB0zEOMAwGA1UEERMFODA1MzkxRzBFBgNVBAoMPk1heC1QbGFuY2stR2Vz
ZWxsc2NoYWZ0IHp1ciBGw7ZyZGVydW5nIGRlciBXaXNzZW5zY2hhZnRlbiBlLlYu
MRswGQYDVQQJDBJIb2ZnYXJ0ZW5zdHJhw59lIDgxDzANBgNVBAgTBkJheWVybjEL
MAkGA1UEBhMCREUxFTATBgNVBAMTDEdlcnJpdCBLdWVobjEmMCQGCSqGSIb3DQEJ
ARYXZ2Vycml0Lmt1ZWhuQGFlaS5tcGcuZGUwggIiMA0GCSqGSIb3DQEBAQUAA4IC
DwAwggIKAoICAQCg7n7fRC0hIeomyBYF0RZ0L/jKjURwqPL3vBN+HvDxzp+Wcn0a
Voeia3LPeXvf18d7BeIQ2SVFXWnWzVpVKzv7VUg4OD424GmcQrFXkChSvOc/rLaA
FmNIaKWgYwUOAqmDh3t9JzQTVj6FrAeJwzXmnv42msNUfnhA2dRllOCmilLUqm/5
nOgrImuiA3R1S0CcljAmEr5PnUmKJaanbaq74Jb54gf622cRyWwylMJijMGboDYw
uaGynrLgfo+rWbXc2TASO6pjSQDKAAfXO/NzLgp+BmneN1II9alVUAJRUpFDkgx9
peM+qUJryLtO+veOKElsOe2S4qvk0PaE/MVAcIJiThdY7qde8Q9FyOJsDN5kiX4g
fsKmtF7EdB71Uc8N78L62r7/7Y5WL8gRxXCN8BsmLXSiCylvtIYsbJMDhK6C+37w
9Cg1A8AWeksg1TmCcvolEJy3+bfPx7NlmEfRdkdzuVb1KxfB0z4SbhSwOAR1WYVg
mEAQuj1l9k7suUtdUY4ZeMnRLVPtmQh+bxcJPaRllpHSTYbYVQlSNXkP0al2/J8d
jJHhulOsCX8oYfyQ9a33jHsKUf632Lpg8446ym19UrNPh9pntXRXVhhkw+/tPE8G
BxH81BCvvSUhVu0Nckx8zOWiI1+6Z5t71udnXOEv9lJFvqDlY71lkiu+jQIDAQAB
o4IBpDCCAaAwHwYDVR0jBBgwFoAUaQChxyFY+ODFGyCwCt2nUb8T2eQwHQYDVR0O
BBYEFOsacOXMtCWA1hWcY7A/tb8e/tTSMA4GA1UdDwEB/wQEAwIFoDAMBgNVHRMB
Af8EAjAAMB0GA1UdJQQWMBQGCCsGAQUFBwMEBggrBgEFBQcDAjA/BgNVHSAEODA2
MDQGCysGAQQBsjEBAgJPMCUwIwYIKwYBBQUHAgEWF2h0dHBzOi8vc2VjdGlnby5j
b20vQ1BTMEIGA1UdHwQ7MDkwN6A1oDOGMWh0dHA6Ly9HRUFOVC5jcmwuc2VjdGln
by5jb20vR0VBTlRQZXJzb25hbENBNC5jcmwweAYIKwYBBQUHAQEEbDBqMD0GCCsG
AQUFBzAChjFodHRwOi8vR0VBTlQuY3J0LnNlY3RpZ28uY29tL0dFQU5UUGVyc29u
YWxDQTQuY3J0MCkGCCsGAQUFBzABhh1odHRwOi8vR0VBTlQub2NzcC5zZWN0aWdv
LmNvbTAiBgNVHREEGzAZgRdnZXJyaXQua3VlaG5AYWVpLm1wZy5kZTANBgkqhkiG
9w0BAQwFAAOCAgEAbUB7zWvNZ98vh3u7hzpnbA1K4U9bga1YkpVbOgv7/UY5RiZP
Rk06O18f5TnRSWiiF3XImBG1uVjbcwVKIemliCQRQzVVt2JXOJVT1EafDDe9DK5o
QaXGHY7NAT1lPLEwtgv8hxBBvthMaMa6lpibT/IUi83jHPZUgsGajCgPXd05Bh/L
jCzWDOmHuwFdjRAMQs1VsPYx+OVcRvS1jmw0bT6o5/nruRwF5brxUK39Mftj3sIN
b+UvVkXdAGw5iQWFwllGpwBgo3iESa1R72qkBMWph8D6Jbg795WBgjMULCPTiZkq
eOif9sW1/37AoutSh7VMh7WMrEW9QURVWYR1hYjS0/TMo8aXfPOLtLYoSg/R6i+j
eXqREsJQxMAl0e/JJej1TAFCsWg0r6Dg4mYq636plAr6pu7pJATNVPT0HrsBMYWu
PV2WRH8Obs+n1xe4ftGxE4yDWiL56lnp6tnfVR8qinEqpGBfj7BAwEcO/Na9b+oK
tDEmWHzupKkdmoOWktURY+Q/5RVWoiozNujYljc9iaK3agqBbJ5ZzRyrCKOPLnw4
9b8koO03WkXPqlm59nxAOdJE6ZQ2aQ8ev6ji+UlGnlIvgk70MsRukY2shpAiowb6
bKjKyK3QGNnT4zmL6ixSRmnYhC95U923Yf+hy+6jqS1Ec6kgpREYG53Qv5IxggMs
MIIDKAIBATBbMEYxCzAJBgNVBAYTAk5MMRkwFwYDVQQKExBHRUFOVCBWZXJlbmln
aW5nMRwwGgYDVQQDExNHRUFOVCBQZXJzb25hbCBDQSA0AhEAwISoJlb9sSn0CBx2
UYRa4TANBglghkgBZQMEAgIFAKCBozAYBgkqhkiG9w0BCQMxCwYJKoZIhvcNAQcB
MBwGCSqGSIb3DQEJBTEPFw0yNDA0MjQwNTU0MTdaMCgGCSqGSIb3DQEJDzEbMBkw
CwYJYIZIAWUDBAECMAoGCCqGSIb3DQMHMD8GCSqGSIb3DQEJBDEyBDCGHbmZ9UB3
WWBtJOgbqhrSYbXlghKkMMddvfi7ZiQ9PH0dHx9ehSLbR5SNy2vGIVUwDQYJKoZI
hvcNAQEBBQAEggIAjPOCnRCTtWnO4p4/e09zQ3xCohyoEBkAVUTgDiKU0AEIb+xG
QW0nis7O3OdEMxtixFgJ5kX4O7nGnmQlkfRbdEjGb6HPIN33Y4+jaqZYPUm7nhxq
VzLDcmBxmPoIbdIFO2XA6HuTK6oNoAzQgX3QoaBAIpUENefszfFBOb0spNW5QN9v
vFcp7deS+9FQQtcjhyPcsw6gj2VAqKv359XvEg76gsjE1RJDWLpz9XkrdnpvQGnr
F89SF1Tkj1xa8ml5UWDAHF5l8899XKgG3mxeh3fd72Evfrf8ZFmIDNbvzGScCa4Z
BQ7Rm3yu6KTTYoYTlaBYmmN9uVPBj6Ngl1mSyf3L5QqKAtyG7ppzIKxjQOXScQTC
LdKv6YHzkBcNMg4HOFD9kCTvwNcsT/pxy3AbEhIfyCNq0INmgXofxa/KmRzPOjME
PRy+YukW7JVIPtbO80U6mZAPV4GbtVbHYt9GJVAkQhV/T9aReKpFphSWsRB+I/dn
DuBesNgBTOQLNvYk6FIwNoNVNPRHjADQPdlJxTomrC8D8+Tub2P3v471Mx/bYAxF
XT5ENA95bmf4qTAq7HBnRODHombAZakz/rljpK/7xbr9cAlqkjelovdlPcHE9zp2
I9zFYFkbZhDOJFgZIqB5SxNCqGafBogQLOR//3u/p+uEw2hrhEwOlPPT8GAAAAAA
AAA=

--Sig_/M.HaaghOy1/2ol2ORjl6XY=--

From nobody Wed Apr 24 20:20:07 2024
X-Original-To: stable@mlmmj.nyi.freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1])
	by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4VPr2K4DDzz5J2Qb
	for ; Wed, 24 Apr 2024 20:20:09 +0000 (UTC)
	(envelope-from des@freebsd.org)
Received: from smtp.freebsd.org (smtp.freebsd.org [IPv6:2610:1c1:1:606c::24b:4])
	(using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)
	 key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256
	 client-signature RSA-PSS (4096 bits) client-digest SHA256)
	(Client CN "smtp.freebsd.org", Issuer "R3" (verified OK))
	by mx1.freebsd.org (Postfix) with ESMTPS id 4VPr2K3jqKz4JY5;
	Wed, 24 Apr 2024 20:20:09 +0000 (UTC)
	(envelope-from des@freebsd.org)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim;
	t=1713990009;
	h=from:from:reply-to:subject:subject:date:date:message-id:message-id:
	 to:to:cc:cc:mime-version:mime-version:content-type:content-type:
	 content-transfer-encoding:content-transfer-encoding:
	 in-reply-to:in-reply-to:references:references;
	bh=hn2OCgsrKArKQuK1dLqcGYFWFCWUR6N6sbN84N0p+XM=;
	b=WRXa4sO+11nH6tRmPP6BbaV1i4MkXVryrf2iMnbpLRtbfJzmMLqPaSFOsECHr6K3rflWqE
	ZwfcOZR8c8ojgQGVV8OL68wWxlUG16JEblGcXh5MVT2aWX8xC0bCbr7QWd8HoClwzu10No
	ymUtC/9mdiKF2R51se+faoCPB7VZqwHypUaI8SB5lCGc1JGnEZaLAB3+hb2gRlfe6IfkQo
	Pr4JIqduZ64dxiDV4cpNy9na7yOFFFF0h2uhhS4n9aa6tQt3BTAYAUN5IvUe8+nfcQuvlj
	dduW20FqzO5qNUkWuI7dteoQ7HVk7G1LZLV0RjMFqMVI+9rF/5WtX5EuBmQRig==
ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1713990009; a=rsa-sha256; cv=none;
	b=x9v2B56yNRPiiWt2KcAxsISAXp7KKdogD6QKhav3WtxWc1YgT1ZoEoQbjIF38X4RuWSHVd
	eOH0aN/LrqhfzdkNG8rdmRscgxb8e6krGOeN0ctKO9V7NOit4p8KReTaJE+7ggLIg2mbeo
	vDYAUlD4w+K4M7EtoZJ0TIOrGh7cXQXrLRSRsk7XIqXMwqO/dMzlVUxz5OivnpGRvKSX2l
	f8HLHeHHN5ba+XQuToleo9tqfJ43nc64fGXLxJBTDFveZyNmckHE7Orj8XDBdlBjqH6UYz
	Ux75NoXm4f4urX9bKaDRFJEW1EUwKISaH4b3knDsex5/6IKBdf68G5ec0k+6yQ==
ARC-Authentication-Results: i=1;
	mx1.freebsd.org;
	none
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org;
	s=dkim; t=1713990009;
	h=from:from:reply-to:subject:subject:date:date:message-id:message-id:
	 to:to:cc:cc:mime-version:mime-version:content-type:content-type:
	 content-transfer-encoding:content-transfer-encoding:
	 in-reply-to:in-reply-to:references:references;
	bh=hn2OCgsrKArKQuK1dLqcGYFWFCWUR6N6sbN84N0p+XM=;
	b=lAeNQNFwREGiO9p0y61NdJuSjzJuXc0RDOLlkGBfEXGCHB96xHSQTgDyPAN/uicgJZBJsv
	q2bHVTAXhUbnXIgRV3YUY86BcyUWYuT6iLI9M5+t/kC1TaN7j31IS1uxKy7DViZXP2LwSc
	6DDj7MDHRapRDMnGsiTSl09gzuKNrGPl+YAUY9t0RvEALdA225xW8197ge3YlyLlqMcY68
	1PvHDiBEABeO7CSo0bzdbuB8XIb25lmfH4aCosfsUMPYPJaUskLvMQCm7d1/pv/iZTGF7X
	wqypuQrvKK7GQJ/+JsOHZZwNLcpiuLAKS8odgcXicQfc6OsOMQ0ocBnEGJ3eDQ==
Received: from ltc.des.dev (163.23.65.37.rev.sfr.net [37.65.23.163])
	(using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)
	 key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256)
	(Client did not present a certificate)
	(Authenticated sender: des)
	by smtp.freebsd.org (Postfix) with ESMTPSA id 4VPr2K2X8cz1RsB;
	Wed, 24 Apr 2024 20:20:09 +0000 (UTC)
	(envelope-from des@freebsd.org)
Received: by ltc.des.dev (Postfix, from userid 1001)
	id 7F7531C2D7; Wed, 24 Apr 2024 22:20:07 +0200 (CEST)
From: =?utf-8?Q?Dag-Erling_Sm=C3=B8rgrav?= 
To: Gerrit =?utf-8?Q?K=C3=BChn?= 
Cc: Matthew Grooms ,  stable@freebsd.org
Subject: Re: possible regression handling packet fragmentation in 14.0 with
 tftp/pxe
In-Reply-To: <20240424075417.6640e97f@arc.aei.uni-hannover.de> ("Gerrit
	=?utf-8?Q?K=C3=BChn=22's?= message of "Wed, 24 Apr 2024 07:54:17 +0200")
References: <20240419153951.5a23ce5f@arc.aei.uni-hannover.de>
	<86y1999wwe.fsf@ltc.des.dev>
	<20240422075948.5bb856ac@arc.aei.uni-hannover.de>
	<86o7a18ppl.fsf@ltc.des.dev>
	<20240423071923.52b90652@arc.aei.uni-hannover.de>
	<922446cd-4511-4132-8e8f-9c9144a7f9b1@shrew.net>
	<20240424075417.6640e97f@arc.aei.uni-hannover.de>
User-Agent: Gnus/5.13 (Gnus v5.13)
Date: Wed, 24 Apr 2024 22:20:07 +0200
Message-ID: <864jbq7bt4.fsf@ltc.des.dev>
List-Id: Production branch of FreeBSD source code 
List-Archive: https://lists.freebsd.org/archives/freebsd-stable
List-Help: 
List-Post: 
List-Subscribe: 
List-Unsubscribe: 
X-BeenThere: freebsd-stable@freebsd.org
Sender: owner-freebsd-stable@FreeBSD.org
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable

Gerrit K=C3=BChn  writes:
> Is there an easy way to find out where this commit ends up, i.e., whether
> it is merged into 14.0, 14.1 or so?

I will make sure it gets into 14.1.

DES
--=20
Dag-Erling Sm=C3=B8rgrav - des@FreeBSD.org