Date: Sat, 23 Aug 2025 21:24:18 -0400 From: Karl Denninger <karl@denninger.net> To: freebsd-net@freebsd.org Subject: Re: Intermittent failure of routing/gateway with ix(4) (x86_64) Message-ID: <7f463f6f-3a6e-47db-aab8-7817cc6192a5@denninger.net> In-Reply-To: <6HcKz3OxJSnjZdoCr4I0mksk9RemKJflHVgnkYI8-FydM4mDDldzTm8qthQ0iJCftaETOVeQFde4fz5i1703B8Gd2ZBvPmBwF_MMnhuJ8VM=@brokenco.de> References: <6HcKz3OxJSnjZdoCr4I0mksk9RemKJflHVgnkYI8-FydM4mDDldzTm8qthQ0iJCftaETOVeQFde4fz5i1703B8Gd2ZBvPmBwF_MMnhuJ8VM=@brokenco.de>
next in thread | previous in thread | raw e-mail | index | archive | help
This is a cryptographically signed message in MIME format.
--------------ms040207090405090300060409
Content-Type: multipart/alternative;
boundary="------------0lQDRljpyHJwATE07P2yvZjE"
--------------0lQDRljpyHJwATE07P2yvZjE
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: base64
T24gOC8yMy8yMDI1IDIxOjE1LCBSIFR5bGVyIENyb3kgd3JvdGU6DQo+IEhvd2R5ISBJIGFt
IGhvcGluZyB5J2FsbCBjb3VsZCBoZWxwIG1lIGFkZCBtb3JlIGRlYnVnZ2luZyB0byBhIEZy
ZWVCU0QgMTQueCBiYXNlZCByb3V0ZXIvZ2F0ZXdheS4gVGhlIGRldmljZSBoYXMgdHdvIGl4
KDQpIE5JQ3MgZm9yIHRoZSBXQU4vTEFOLiBQZXJpb2RpY2FsbHkgdGhlIGRldmljZSBzdG9w
cyByb3V0aW5nIHRyYWZmaWMgZW50aXJlbHksIGJ1dCB0aGUgbWFjaGluZSBpcyBzdGlsbCBv
bmxpbmUgYW5kIGludGVyYWN0aXZlLg0KPg0KPiBXaGF0IGlzIHBhcnRpY3VsYXJseSBpbnRl
cmVzdGluZyBpcyB3aGVuIEkgY29uc29sZSBpbnRvIHRoZSBtYWNoaW5lIEkgY2FuIHN0aWxs
IHNlbmQgdHJhZmZpYyBvdXQgZnJvbSB0aGUgZGV2aWNlIG92ZXIgdGhlIFdBTiBpbnRlcmZh
Y2UsIGJ1dCBhbnl0aGluZyB0aGF0IHJlbGllcyBvbiB0aGUgZ2F0ZXdheSBzZWVtcyB0byBm
YWlsLiBJLmUuIHJvdXRpbmcgdG8gYW55IGhvc3Qgb24gdGhlIExBTiBpbnRlcmZhY2UgKGl4
MSkgbm8gbG9uZ2VyIHdvcmtzLg0KPg0KPiBgc2VydmljZSByb3V0aW5nIHJlc3RhcnRgIGRv
ZXMgbm90aGluZywgYHNlcnZpY2UgbmV0aWYgcmVzdGFydGAgYWxzbyBkb2VzIG5vdGhpbmcu
IERvd25pbmcgdGhlIGl4MSBpbnRlcmZhY2UgYW5kIGJyaW5naW5nIGl0IGJhY2sgdXAgZG9l
cyBub3RoaW5nLg0KPg0KPiBBIHJlYm9vdCBob3dldmVyIGRvZXMgcHV0cyBpdCBiYWNrIGlu
dG8gd29ya2luZyBvcmRlci4NCj4NCj4NCj4gT24gb25lIGluc3RhbmNlIHRoZSBjb25zb2xl
IGhhZCBhIGxvdCBvZiBhcnByZXNvbHZlICJjYW5ub3QgYWxsb2NhdGUgbGxpbmZvIiBlcnJv
cnMsIGNoYXNpbmcgdGhhdCByYWJiaXQgbGVkIG5vd2hlcmUuDQo+DQo+IEJlY2F1c2UgdGhp
cyBmcmVlemluZyBiZWhhdmlvciBpcyBpbnRlcm1pdHRlbnQgYnV0IF9kb2VzXyBzZWVtIHRv
IGNvcnJlbGF0ZSB3aXRoIGhpZ2hlciBuZXR3b3JrIHV0aWxpemF0aW9uLCBJJ20gd29uZGVy
aW5nIGlmIHRoZXJlIGFyZSBkZWJ1Z2dpbmcgbG9ncyBJIGNhbiBlbmFibGUsIG9yIGEgd2F5
IHRvIGluc3BlY3QgZHJpdmVyIHNwZWNpZmljIGNvdW50ZXJzIHRoYXQgY291bGQgYmUgb3Zl
cmZsb3dpbmcsIGV0Yz8NCj4NCj4gSSdtIG9wZW4gdG8gYW55IHJlY29tbWVuZGF0aW9ucyB0
aGF0IHByZXZlbnQgbWUgZnJvbSBzZXR0aW5nIHVwIGEgY3JvbiBldmVyeSBtaW51dGUgdG8g
dmFsaWRhdGUgY29ubmVjdGl2aXR5IG9yIHJlYm9vdCB0aGUgYm94ISA6KQ0KPg0KPg0KPiBD
aGVlcnMNCg0KV2hhdCBwaHlzaWNhbCBoYXJkd2FyZSBpcyBvbiB0aGF0IGRyaXZlcj8NCg0K
SSBoYXZlIGEgYm94IGhlcmUgd2l0aCB0d28gaXggaW50ZXJmYWNlcyBpbiBpdCB0aGF0IGlz
IG15IGVkZ2Ugcm91dGVyIA0KYW5kIGJlYXQgdGhlIFNOT1Qgb3V0IG9mIGl0IHdpdGhvdXQg
cHJvYmxlbXMuwqAgVGhpcyBpcyB3aGF0IHRoZSBib290IA0KbWVzc2FnZXMgYXJlIGZvciB0
aGVtIGluIG15IG1hY2hpbmUgaGVyZToNCg0KaXgwOiA8SW50ZWwoUikgWDUyMCA4MjU5OUVT
IChTRkkvU0ZQKyk+IHBvcnQgMHgzMDIwLTB4MzAzZiBtZW0gDQoweDgwYTIwMDAwLTB4ODBh
Mw0KZmZmZiwweDgwYTQ0MDAwLTB4ODBhNDdmZmYgYXQgZGV2aWNlIDAuMCBvbiBwY2k1DQpp
eDA6IFVzaW5nIDIwNDggVFggZGVzY3JpcHRvcnMgYW5kIDIwNDggUlggZGVzY3JpcHRvcnMN
Cml4MDogVXNpbmcgNCBSWCBxdWV1ZXMgNCBUWCBxdWV1ZXMNCml4MDogVXNpbmcgTVNJLVgg
aW50ZXJydXB0cyB3aXRoIDUgdmVjdG9ycw0KaXgwOiBhbGxvY2F0ZWQgZm9yIDQgcXVldWVz
DQppeDA6IGFsbG9jYXRlZCBmb3IgNCByeCBxdWV1ZXMNCml4MDogRXRoZXJuZXQgYWRkcmVz
czogMDA6ZTA6YjQ6Njg6Zjg6OTQNCml4MDogUENJIEV4cHJlc3MgQnVzOiBTcGVlZCA1LjBH
VC9zIFdpZHRoIHg0DQppeDA6IGVUcmFjayAweDgwMDAwM2RlDQppeDA6IG5ldG1hcCBxdWV1
ZXMvc2xvdHM6IFRYIDQvMjA0OCwgUlggNC8yMDQ4DQppeDE6IDxJbnRlbChSKSBYNTIwIDgy
NTk5RVMgKFNGSS9TRlArKT4gcG9ydCAweDMwMDAtMHgzMDFmIG1lbSANCjB4ODBhMDAwMDAt
MHg4MGExDQpmZmZmLDB4ODBhNDAwMDAtMHg4MGE0M2ZmZiBhdCBkZXZpY2UgMC4xIG9uIHBj
aTUNCml4MTogVXNpbmcgMjA0OCBUWCBkZXNjcmlwdG9ycyBhbmQgMjA0OCBSWCBkZXNjcmlw
dG9ycw0KaXgxOiBVc2luZyA0IFJYIHF1ZXVlcyA0IFRYIHF1ZXVlcw0KaXgxOiBVc2luZyBN
U0ktWCBpbnRlcnJ1cHRzIHdpdGggNSB2ZWN0b3JzDQppeDE6IGFsbG9jYXRlZCBmb3IgNCBx
dWV1ZXMNCml4MTogYWxsb2NhdGVkIGZvciA0IHJ4IHF1ZXVlcw0KaXgxOiBFdGhlcm5ldCBh
ZGRyZXNzOiAwMDplMDpiNDo2ODpmODo5NQ0KaXgxOiBQQ0kgRXhwcmVzcyBCdXM6IFNwZWVk
IDUuMEdUL3MgV2lkdGggeDQNCml4MTogZVRyYWNrIDB4ODAwMDAzZGUNCml4MTogbmV0bWFw
IHF1ZXVlcy9zbG90czogVFggNC8yMDQ4LCBSWCA0LzIwNDgNCg0KS2VybmVsIGluZm86DQoN
CiQgdW5hbWUgLXYNCkZyZWVCU0QgMTQuMy1TVEFCTEUgIzAgc3RhYmxlLzE0LW4yNzE0NTYt
NzAwNjhiMzAzMGY5LWRpcnR5OiBNb24gTWF5IDEyIA0KMTg6NTM6NTggRURUIDIwMjUgDQpr
YXJsQE5ld0ZTLmRlbm5pbmdlci5uZXQ6L3dvcmsvT0JKL0Nyb2NoZXQtd29yay1BTUQxNC91
c3Ivc3JjLjE0LVNUQUJMRS9hbWQ2NC5hbWQ2NC9zeXMvR0VORVJJQw0KDQotLSANCkthcmwg
RGVubmluZ2VyDQprYXJsQGRlbm5pbmdlci5uZXQNCi9UaGUgTWFya2V0IFRpY2tlci8NCi9b
Uy9NSU1FIGVuY3J5cHRlZCBlbWFpbCBwcmVmZXJyZWRdLw0K
--------------0lQDRljpyHJwATE07P2yvZjE
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: quoted-printable
<!DOCTYPE html>
<html>
<head>
<meta http-equiv=3D"Content-Type" content=3D"text/html; charset=3DUTF=
-8">
</head>
<body>
<div class=3D"moz-cite-prefix">On 8/23/2025 21:15, R Tyler Croy wrote=
:<br>
</div>
<blockquote type=3D"cite"
cite=3D"mid:6HcKz3OxJSnjZdoCr4I0mksk9RemKJflHVgnkYI8-FydM4mDDldzTm8qthQ0i=
JCftaETOVeQFde4fz5i1703B8Gd2ZBvPmBwF_MMnhuJ8VM=3D@brokenco.de">
<pre wrap=3D"" class=3D"moz-quote-pre">Howdy! I am hoping y'all cou=
ld help me add more debugging to a FreeBSD 14.x based router/gateway. The=
device has two ix(4) NICs for the WAN/LAN. Periodically the device stops=
routing traffic entirely, but the machine is still online and interactiv=
e.
What is particularly interesting is when I console into the machine I can=
still send traffic out from the device over the WAN interface, but anyth=
ing that relies on the gateway seems to fail. I.e. routing to any host on=
the LAN interface (ix1) no longer works.
`service routing restart` does nothing, `service netif restart` also does=
nothing. Downing the ix1 interface and bringing it back up does nothing.=
A reboot however does puts it back into working order.=20
On one instance the console had a lot of arpresolve "cannot allocate llin=
fo" errors, chasing that rabbit led nowhere.
Because this freezing behavior is intermittent but _does_ seem to correla=
te with higher network utilization, I'm wondering if there are debugging =
logs I can enable, or a way to inspect driver specific counters that coul=
d be overflowing, etc?
I'm open to any recommendations that prevent me from setting up a cron ev=
ery minute to validate connectivity or reboot the box! :)
Cheers</pre>
</blockquote>
<p>What physical hardware is on that driver?</p>
<p>I have a box here with two ix interfaces in it that is my edge
router and beat the SNOT out of it without problems.=C2=A0 This is =
what
the boot messages are for them in my machine here:</p>
<p>ix0: <Intel(R) X520 82599ES (SFI/SFP+)> port 0x3020-0x303f
mem 0x80a20000-0x80a3<br>
ffff,0x80a44000-0x80a47fff at device 0.0 on pci5<br>
ix0: Using 2048 TX descriptors and 2048 RX descriptors<br>
ix0: Using 4 RX queues 4 TX queues<br>
ix0: Using MSI-X interrupts with 5 vectors<br>
ix0: allocated for 4 queues<br>
ix0: allocated for 4 rx queues<br>
ix0: Ethernet address: 00:e0:b4:68:f8:94<br>
ix0: PCI Express Bus: Speed 5.0GT/s Width x4<br>
ix0: eTrack 0x800003de<br>
ix0: netmap queues/slots: TX 4/2048, RX 4/2048<br>
ix1: <Intel(R) X520 82599ES (SFI/SFP+)> port 0x3000-0x301f
mem 0x80a00000-0x80a1<br>
ffff,0x80a40000-0x80a43fff at device 0.1 on pci5<br>
ix1: Using 2048 TX descriptors and 2048 RX descriptors<br>
ix1: Using 4 RX queues 4 TX queues<br>
ix1: Using MSI-X interrupts with 5 vectors<br>
ix1: allocated for 4 queues<br>
ix1: allocated for 4 rx queues<br>
ix1: Ethernet address: 00:e0:b4:68:f8:95<br>
ix1: PCI Express Bus: Speed 5.0GT/s Width x4<br>
ix1: eTrack 0x800003de<br>
ix1: netmap queues/slots: TX 4/2048, RX 4/2048<br>
</p>
<p>Kernel info:=C2=A0</p>
<p>$ uname -v<br>
FreeBSD 14.3-STABLE #0 stable/14-n271456-70068b3030f9-dirty: Mon
May 12 18:53:58 EDT 2025=C2=A0 =C2=A0
=C2=A0<a class=3D"moz-txt-link-abbreviated" href=3D"mailto:karl@NewFS.den=
ninger.net:/work/OBJ/Crochet-work-AMD14/usr/src.14-STABLE/amd64.amd64/sys=
/GENERIC">karl@NewFS.denninger.net:/work/OBJ/Crochet-work-AMD14/usr/src.1=
4-STABLE/amd64.amd64/sys/GENERIC</a><br>
<br>
</p>
<div class=3D"moz-signature">-- <br>
Karl Denninger<br>
<a href=3D"mailto:karl@denninger.net" class=3D"moz-txt-link-freetex=
t">karl@denninger.net</a><br>
<i>The Market Ticker</i><br>
<font size=3D"-2"><i>[S/MIME encrypted email preferred]</i></font><=
/div>
</body>
</html>
--------------0lQDRljpyHJwATE07P2yvZjE--
--------------ms040207090405090300060409
Content-Type: application/pkcs7-signature; name="smime.p7s"
Content-Transfer-Encoding: base64
Content-Disposition: attachment; filename="smime.p7s"
Content-Description: S/MIME Cryptographic Signature
MIAGCSqGSIb3DQEHAqCAMIACAQExDzANBglghkgBZQMEAgMFADCABgkqhkiG9w0BBwEAAKCC
C4owggWZMIIDgaADAgECAhRZU8dKdMneRI1Vq5kv0k54Q5rQuDANBgkqhkiG9w0BAQsFADB2
MQswCQYDVQQGEwJVUzESMBAGA1UECAwJVGVubmVzc2VlMRYwFAYDVQQKDA1EZW5uaW5nZXIu
TmV0MRcwFQYDVQQDDA5EZW5uaW5nZXIgUm9vdDEiMCAGCSqGSIb3DQEJARYTYWRtaW5AZGVu
bmluZ2VyLm5ldDAeFw0yNDA1MDkyMTA4MDNaFw00NDA1MDQyMTA4MDNaMF0xCzAJBgNVBAYT
AlVTMRIwEAYDVQQIDAlUZW5uZXNzZWUxFjAUBgNVBAoMDURlbm5pbmdlci5uZXQxIjAgBgNV
BAMMGURlbm5pbmdlci5OZXQgU2lnbmluZyBJbnQwggEiMA0GCSqGSIb3DQEBAQUAA4IBDwAw
ggEKAoIBAQDbR0tSiuLG5HPfo+cWtdeYQ8jc8Bjfuo0GTcNRT0glHnH1apUtInIktUknEZDH
ohahInN+mMBdKg54FCHOiYZrJbyxBIo9FwX7hRmOc+spxmSYWnOd2E/YcGInMK4ZpjPzldzB
Yt1n3zygkhx2bssxTJS3x4nv1qAXfLSZd1VwqoQufifEoPyTtymkkvHLv86vLgqAqooM/cXc
4LSIQ5u2uM308n42r8RkKtp7X1v9fJW8oRZN2XnFZtiUPH44YY2rHqyN2Hea9Y3+TXbldXjo
xhPHTA+JYVFq8KTmbQBqU7YcMhlIG0cSxPeFLMxnP6pqPcIVTAlK+a6YGRFppfjZAgMBAAGj
ggE2MIIBMjAdBgNVHQ4EFgQUH+VuxXhBxaJAQrvDekwkH91hBi4wgbMGA1UdIwSBqzCBqIAU
RFYC4p6L6KITnEvrpx2cyt+PcMmheqR4MHYxCzAJBgNVBAYTAlVTMRIwEAYDVQQIDAlUZW5u
ZXNzZWUxFjAUBgNVBAoMDURlbm5pbmdlci5OZXQxFzAVBgNVBAMMDkRlbm5pbmdlciBSb290
MSIwIAYJKoZIhvcNAQkBFhNhZG1pbkBkZW5uaW5nZXIubmV0ghQZE7NBItWtQsCouuwU6jZ+
HPPwnjAPBgNVHRMBAf8EBTADAQH/MA4GA1UdDwEB/wQEAwIBBjA6BgNVHR8EMzAxMC+gLaAr
hilodHRwOi8vd3d3LmRlbm5pbmdlci5uZXQvcm9vdC1yZXZva2VkLmNybDANBgkqhkiG9w0B
AQsFAAOCAgEAfFbhPc82AfhyUqONs7IccYD36w+OP4nQgwfC4IWf3y/aQAZ2Zk6IITzYqwf7
PFM0bJRT3zi7xyetolqHDhfMJvnOQWpITZiyM/FSKwIvuBsy/uJUqPuqui4XQMYoSbAA1qmI
MW/z7VZZHwaRFoeWE40UirYcf0fNcooBZ72bmd+iBaVyjtZvky0Vgcz0eC6e6LR5kNb23yC6
TkyQIlGyQkK5/afXUYFzk49rOHVbVyxW3oXRfq8Ow6HCrpDGAS8p84S04MFwBVAUfbe4aXs3
bampaI2LzKgkVywyFP14LSvvdjCfLYfnLy1Z9hm2EHMqNHA2tCGdRhWp2d7aZC1MYFqng0ZS
fjPJjqHrI1qPU0p6k9A1GxAtrQlL2v/IUzUnMZkiawFV3qlxMGZf/kTYTUOcJhx1KU4zSLHu
80qO7ldRpp5gHssCAGFbeTu2gp6LxfmaFhLPDBJ1VGfdPx9lUrU/9OcoHczcl5x2Rb8IUZyX
9elzP5WdAU8p5R/DLlOAq24VcabhFtYBCA2dOESLupSfWKNQuJCN/1gz7ysSc+mjnnPV77IO
mpszJfkFFJEDNJlGIVKX1vwwygtC/9Ulox8frgbZlRAYAgDc/YbOBFxticVVre0Y3Ujx6Kzb
tkgZRlgfdZWbT1W5smncqJxg5qAL8e/yTb3fCe2nJ0jhiP4wggXpMIIE0aADAgECAhMAmNFt
CiCF3j+FwQLYtBTmGjzkMA0GCSqGSIb3DQEBCwUAMF0xCzAJBgNVBAYTAlVTMRIwEAYDVQQI
DAlUZW5uZXNzZWUxFjAUBgNVBAoMDURlbm5pbmdlci5uZXQxIjAgBgNVBAMMGURlbm5pbmdl
ci5OZXQgU2lnbmluZyBJbnQwHhcNMjQwNTEwMTkyNjU5WhcNMjkwNTA5MTkyNjU5WjBXMQsw
CQYDVQQGEwJVUzESMBAGA1UECAwJVGVubmVzc2VlMRcwFQYDVQQKDA5LYXJsIERlbm5pbmdl
cjEbMBkGA1UEAwwSa2FybEBkZW5uaW5nZXIubmV0MIICIjANBgkqhkiG9w0BAQEFAAOCAg8A
MIICCgKCAgEAvh1UssVbSYctzobPjwBkbjv/w4WvQNepeRTwE6+sLnXvc41+X9pa5EclPL4Q
l02Vu1m71mSqXGfK9HbWZoivbhefBHOoYb35MSc24PelhwcORbpneWoWc7giQ7QgFlvEe/yj
fs8M0H9fgdzFS5m2lwBQbis8kioSjHB2yt/8I1GE4Mvt1Cur9kga6ML5FAQvo8TYN1stdhrE
13FEv/BWCF4FVT4H2Wa2ySW+R1jkKb74SC6Twg98bGCRTShD5bVylh0+0LXNhzaopIDcI/KK
jm/j3mRjIlmqbGrSpvJsbjjhjhAYQKE1U8FB5TDU4OkFAibblhQit/KjgspPR2o/vOpVFPER
uhZEV1oDGzUJtZlkREIcN2sYBi0p7Y4585ya+b7L10mEenPlyi3eSkGXEuiy/BR2DY6lShwW
DPoQ5602TKmttCSwBdWGoLrQ4jEVEVNt4lku2wPbTHF3KpHJU0g7RbcWoUYn10SOxKathkir
hF3v9U32+QhPELGwqRrH0sL9rWf0qalRtPDHUYl8TebZmYkFqNeSMlqHijl5f4SsQPSj7gx5
4F19Ntm9ZcvuWTmW8QQGWTKHeMuG+BYkVIUSPe6/ZQsbD/xDx7rkyGfNgWIa4W7Wm/B7kaNq
H53tk3wFmNgZQOxMTPF0oTHfW0T2azU6JD0D1AlgoAnSAE0CAwEAAaOCAaYwggGiMDoGCCsG
AQUFBwEBBC4wLDAqBggrBgEFBQcwAYYeaHR0cDovL29jc3AuZGVubmluZ2VyLm5ldDo3Nzc3
MAwGA1UdEwEB/wQCMAAwDgYDVR0PAQH/BAQDAgXgMB0GA1UdJQQWMBQGCCsGAQUFBwMCBggr
BgEFBQcDBDAzBglghkgBhvhCAQ0EJhYkT3BlblNTTCBHZW5lcmF0ZWQgQ2xpZW50IENlcnRp
ZmljYXRlMB0GA1UdDgQWBBSxJZjVnlYLAT3uzvDYgc4742J6UTCBswYDVR0jBIGrMIGogBQf
5W7FeEHFokBCu8N6TCQf3WEGLqF6pHgwdjELMAkGA1UEBhMCVVMxEjAQBgNVBAgMCVRlbm5l
c3NlZTEWMBQGA1UECgwNRGVubmluZ2VyLk5ldDEXMBUGA1UEAwwORGVubmluZ2VyIFJvb3Qx
IjAgBgkqhkiG9w0BCQEWE2FkbWluQGRlbm5pbmdlci5uZXSCFFlTx0p0yd5EjVWrmS/STnhD
mtC4MB0GA1UdEQQWMBSBEmthcmxAZGVubmluZ2VyLm5ldDANBgkqhkiG9w0BAQsFAAOCAQEA
TrQ45/tBN3SiuqItFv/V+CF3h7Hxe0YLsL+A/P+q9ZhxIscaNjaclgQhPA+rUr+l8DGoXJ/w
yAl1E0SSBK+9phIc/9xFOBg3rCy4ngubzP+lHS1t03nMCBSUNsu5qPzqLBPiKaPabUu3Gr9o
koRezSszgM3/zNJfr8cMO93csCK/fBccsMx5q+3nxB5XeT7UciicjfEzUA4m2mQxBmGk9SSU
147Gy8UmdSq57Tw82KqUrQ1pJ6IOzVPLREpwlqGbHykSU3MwtPYPtfQeFVjvO/XcWvoFQjbV
UyhzAqMMYFudxoVLlJQiAgU38OScTLDgKxCO41h7VOjb2mss0zHndzGCBZUwggWRAgEBMHQw
XTELMAkGA1UEBhMCVVMxEjAQBgNVBAgMCVRlbm5lc3NlZTEWMBQGA1UECgwNRGVubmluZ2Vy
Lm5ldDEiMCAGA1UEAwwZRGVubmluZ2VyLk5ldCBTaWduaW5nIEludAITAJjRbQoghd4/hcEC
2LQU5ho85DANBglghkgBZQMEAgMFAKCCAvIwGAYJKoZIhvcNAQkDMQsGCSqGSIb3DQEHATAc
BgkqhkiG9w0BCQUxDxcNMjUwODI0MDEyNDE4WjBPBgkqhkiG9w0BCQQxQgRA3Il6UqroS3id
oqZgORuR/2htzt4anIgo8urUK1bAVoVMzsR2J5lzS10ILtLk9VU6A0CHgY0BgNGmlc4T+3mL
ATCBgwYJKwYBBAGCNxAEMXYwdDBdMQswCQYDVQQGEwJVUzESMBAGA1UECAwJVGVubmVzc2Vl
MRYwFAYDVQQKDA1EZW5uaW5nZXIubmV0MSIwIAYDVQQDDBlEZW5uaW5nZXIuTmV0IFNpZ25p
bmcgSW50AhMAmNFtCiCF3j+FwQLYtBTmGjzkMIGFBgsqhkiG9w0BCRACCzF2oHQwXTELMAkG
A1UEBhMCVVMxEjAQBgNVBAgMCVRlbm5lc3NlZTEWMBQGA1UECgwNRGVubmluZ2VyLm5ldDEi
MCAGA1UEAwwZRGVubmluZ2VyLk5ldCBTaWduaW5nIEludAITAJjRbQoghd4/hcEC2LQU5ho8
5DCCAVcGCSqGSIb3DQEJDzGCAUgwggFEMAsGCWCGSAFlAwQBKjALBglghkgBZQMEAQIwCgYI
KoZIhvcNAwcwDQYIKoZIhvcNAwICAQUwDQYIKoZIhvcNAwICAQUwBwYFKw4DAgcwDQYIKoZI
hvcNAwICAQUwBwYFKw4DAhowCwYJYIZIAWUDBAIBMAsGCWCGSAFlAwQCAjALBglghkgBZQME
AgMwCwYJYIZIAWUDBAIEMAsGCWCGSAFlAwQCBzALBglghkgBZQMEAggwCwYJYIZIAWUDBAIJ
MAsGCWCGSAFlAwQCCjALBgkqhkiG9w0BAQEwCwYJK4EFEIZIPwACMAgGBiuBBAELADAIBgYr
gQQBCwEwCAYGK4EEAQsCMAgGBiuBBAELAzALBgkrgQUQhkg/AAMwCAYGK4EEAQ4AMAgGBiuB
BAEOATAIBgYrgQQBDgIwCAYGK4EEAQ4DMA0GCSqGSIb3DQEBAQUABIICAHjlGF5ipY0jjUj8
5zgNd6w1ih34nr1BmejBkmr02yQCitTZO4sauVrLkLRVIMcajpQQPDbUf6qV4jETQE+jkKcn
lP/CJ6Ztca2mOKnnWRQtXYl23WpV9L/9iFCOAK8Qfz41xaAPD/VypovP8f3j6yvZdTEZMOCQ
sr8NZITzjdOtNDmxZwx1lGq9ei5JlVIYGZ1wg4ORZJRSD1kLq7JoOkHj8Z0+roLZ5G0H9RCx
XWMNZYPhLXn5RTdZJ2t+x+CuJqZ78vXOEkou9y+LOPNp1uuv/0gzAm+ubh6cA2t2nv4mMc2G
GkEqdhEXHwSmldKIX4qQg8WOqCDxIZ8KnltgANaVRjIde9Von16XoqidR93drngPRQ+fOOXG
HGlpltWmdOFu5KlXZCcouNzOGY7zk+7c2zIn/g0mzPiX8BOEl75Aw6KjG4viR1/ZAamQ59uc
3huWq8+MW9zNuevnYB3aLYObrkXd2Qal7ruVMeFAo1zTLAMnnEvShPv3Q0ZuaTiiLhLbLkq6
bztoWy0ki/vbFpdd0gPzTqe/gNnf4RQUNUMtJIQe604PvHvaNun/Ww9fIa33eaBR5IWWKrjU
IfS8GEhy1D0b7MQP79trEbgKyOZTaYnRQyumuWQ1KP1v1ODuxxxZjpOjz/Uf5Z3o/ScbVnyl
kpKUJBxG27Z6oQ0yjZK8AAAAAAAA
--------------ms040207090405090300060409--
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?7f463f6f-3a6e-47db-aab8-7817cc6192a5>