Date: Tue, 12 Jul 2016 09:53:34 -0500 From: Karl Denninger <karl@denninger.net> To: "freebsd-arm@freebsd.org" <freebsd-arm@freebsd.org> Subject: Re: Old problem still present on 11-ALPHA1 - Pi2 Message-ID: <3ad346b7-3c9f-05d6-a8cf-170a060051c9@denninger.net> In-Reply-To: <eff74d4e-2c24-2eec-758a-55e313ad9710@selasky.org> References: <32ad8bb3-f0a6-c86b-1b23-aae9af4442ea@denninger.net> <62d7d041-2de5-639f-5c1e-76f9682e6cc8@selasky.org> <5682bff2-3033-194a-67bf-32ba0cdada37@denninger.net> <20160711205855.GC34367@cicely7.cicely.de> <5f38e923-c1a1-8bb7-83cc-0de6404b6e47@denninger.net> <eff74d4e-2c24-2eec-758a-55e313ad9710@selasky.org>
next in thread | previous in thread | raw e-mail | index | archive | help
This is a cryptographically signed message in MIME format. --------------ms020909060208030104060200 Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: quoted-printable On 7/12/2016 02:40, Hans Petter Selasky wrote: > On 07/12/16 03:28, Karl Denninger wrote: >> It *only* happens if I have the VLANs enabled. If I am running a sing= le >> network on an interface it's fine. > > Did you check the interface statistics? You can also try to enable > debugging for the ethernet interface: "hw.usb.xxxx.debug=3D16" where > xxxx is smsc or something like that. > > Are you sending very big packets? Did you try to set the MTU lower? > > --HPS There is no indication of trouble and the devices it is talking to are all MTU 1500, as is this unit..... root@IPGw:/etc/mail # netstat -i -b -n -I ue0 Name Mtu Network Address Ipkts Ierrs Idrop =20 Ibytes Opkts Oerrs Obytes Coll ue0 1500 <Link#2> b8:27:eb:be:e6:f8 174327 0 0=20 186606323 80559 0 6306399 0 ue0 - 192.168.1.0/2 192.168.1.200 134293 - -=20 181992609 77276 - 5049273 - root@IPGw:/etc/mail # netstat -i -b -n -I ue0.2 Name Mtu Network Address Ipkts Ierrs Idrop =20 Ibytes Opkts Oerrs Obytes Coll ue0.2 1500 <Link#3> b8:27:eb:be:e6:f8 25926 0 0 =20 1562248 1245 0 55796 0 ue0.2 - 70.169.168.0/ 70.169.168.97 76 - - =20 5634 1240 - 86378 - root@IPGw:/etc/mail # netstat -i -b -n -I ue0.3 Name Mtu Network Address Ipkts Ierrs Idrop =20 Ibytes Opkts Oerrs Obytes Coll ue0.3 1500 <Link#4> b8:27:eb:be:e6:f8 431 0 0 =20 74658 174 0 33422 0 ue0.3 - 192.168.4.0/2 192.168.4.200 85 - - =20 30260 85 - 27880 - Note that this CLAIMS no errors and very low traffic levels (as expected; this is just a DHCP server machine and an "emergency" way into the KVM on the servers if they blow up for some reason, as those KVMs are not exposed to the Internet for obvious reasons.) > It's interesting that it flapped down (and then back up) three times > and you have three interfaces. Does it do that consistently? Does it > do it twice if there is only two interface (base plus a vlan)? That's just a function of when I looked since boot. All three "flap" at the same time but the "flap" is fictitious in that the switch never sees the carrier drop on the port. Now, a day later, there are dozens of "flaps" in the dmesg output (in fact that's ALL that's there having rolled the buffer off!) > > Can you share the interface configuration source? Have you checked > your system resources close to an expected flap to see if there is > ballooning resources somewhere? Brendan Gregg has some fantastic > tracing resources. Here are a couple of my favorites (not that I > profess to know anything about dtrace...) Nothing complicated... ifconfig_ue0=3D"inet 192.168.1.200 netmask 255.255.255.0" # # VLAN for inside subnet # vlans_ue0=3D"2 3" ifconfig_ue0_2=3D"inet 70.169.168.97/25" ifconfig_ue0_3=3D"inet 192.168.4.200/24" defaultrouter=3D"70.169.168.1" That's it.... There's no system resource issue; the machine has plenty of RAM and mbufs; and no denied requests being logged anywhere. What this *looks like* is that something in the network stack thinks the interface state has gone down but it in fact has not (the switch doesn't see anything wrong.) As evidence that FreeBSD thinks it has, however, is that it *does* (sometimes) disrupt the snmpd client on this host and unless it is restarted it will stop talking to my network monitor for statistics, so I have to have a cron job that restarts snmpd every few hours or eventually I'll flat-line all the stats out of that host on the monitor console. The machine itself is extremely stable; it has run for months without a crash, only being interrupted by my intentional act (such as a software upgrade.) Then again it rarely is asked to do much since it's purpose in life is to provide a means of setting up a tunnel to internal KVMs in the event that one of the machines behind the Internet gateway (or the gateway itself!) blows up and requires attention from a remote (e.g. using ssh as a tunnel once you're signed into this machine.) --=20 Karl Denninger karl@denninger.net <mailto:karl@denninger.net> /The Market Ticker/ /[S/MIME encrypted email preferred]/ --------------ms020909060208030104060200 Content-Type: application/pkcs7-signature; name="smime.p7s" Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="smime.p7s" Content-Description: S/MIME Cryptographic Signature MIAGCSqGSIb3DQEHAqCAMIACAQExDzANBglghkgBZQMEAgMFADCABgkqhkiG9w0BBwEAAKCC Bl8wggZbMIIEQ6ADAgECAgEpMA0GCSqGSIb3DQEBCwUAMIGQMQswCQYDVQQGEwJVUzEQMA4G A1UECBMHRmxvcmlkYTESMBAGA1UEBxMJTmljZXZpbGxlMRkwFwYDVQQKExBDdWRhIFN5c3Rl bXMgTExDMRwwGgYDVQQDExNDdWRhIFN5c3RlbXMgTExDIENBMSIwIAYJKoZIhvcNAQkBFhND dWRhIFN5c3RlbXMgTExDIENBMB4XDTE1MDQyMTAyMjE1OVoXDTIwMDQxOTAyMjE1OVowWjEL MAkGA1UEBhMCVVMxEDAOBgNVBAgTB0Zsb3JpZGExGTAXBgNVBAoTEEN1ZGEgU3lzdGVtcyBM TEMxHjAcBgNVBAMTFUthcmwgRGVubmluZ2VyIChPQ1NQKTCCAiIwDQYJKoZIhvcNAQEBBQAD ggIPADCCAgoCggIBALmEWPhAdphrWd4K5VTvE5pxL3blRQPyGF3ApjUjgtavqU1Y8pbI3Byg XDj2/Uz9Si8XVj/kNbKEjkRh5SsNvx3Fc0oQ1uVjyCq7zC/kctF7yLzQbvWnU4grAPZ3IuAp 3/fFxIVaXpxEdKmyZAVDhk9az+IgHH43rdJRIMzxJ5vqQMb+n2EjadVqiGPbtG9aZEImlq7f IYDTnKyToi23PAnkPwwT+q1IkI2DTvf2jzWrhLR5DTX0fUYC0nxlHWbjgpiapyJWtR7K2YQO aevQb/3vN9gSojT2h+cBem7QIj6U69rEYcEDvPyCMXEV9VcXdcmW42LSRsPvZcBHFkWAJqMZ Myiz4kumaP+s+cIDaXitR/szoqDKGSHM4CPAZV9Yh8asvxQL5uDxz5wvLPgS5yS8K/o7zDR5 vNkMCyfYQuR6PAJxVOk5Arqvj9lfP3JSVapwbr01CoWDBkpuJlKfpQIEeC/pcCBKknllbMYq yHBO2TipLyO5Ocd1nhN/nOsO+C+j31lQHfOMRZaPQykXVPWG5BbhWT7ttX4vy5hOW6yJgeT/ o3apynlp1cEavkQRS8uJHoQszF6KIrQMID/JfySWvVQ4ksnfzwB2lRomrdrwnQ4eG/HBS+0l eozwOJNDIBlAP+hLe8A5oWZgooIIK/SulUAsfI6Sgd8dTZTTYmlhAgMBAAGjgfQwgfEwNwYI KwYBBQUHAQEEKzApMCcGCCsGAQUFBzABhhtodHRwOi8vY3VkYXN5c3RlbXMubmV0Ojg4ODgw CQYDVR0TBAIwADARBglghkgBhvhCAQEEBAMCBaAwCwYDVR0PBAQDAgXgMCwGCWCGSAGG+EIB DQQfFh1PcGVuU1NMIEdlbmVyYXRlZCBDZXJ0aWZpY2F0ZTAdBgNVHQ4EFgQUxRyULenJaFwX RtT79aNmIB/u5VkwHwYDVR0jBBgwFoAUJHGbnYV9/N3dvbDKkpQDofrTbTUwHQYDVR0RBBYw FIESa2FybEBkZW5uaW5nZXIubmV0MA0GCSqGSIb3DQEBCwUAA4ICAQBPf3cYtmKowmGIYsm6 eBinJu7QVWvxi1vqnBz3KE+HapqoIZS8/PolB/hwiY0UAE1RsjBJ7yEjihVRwummSBvkoOyf G30uPn4yg4vbJkR9lTz8d21fPshWETa6DBh2jx2Qf13LZpr3Pj2fTtlu6xMYKzg7cSDgd2bO sJGH/rcvva9Spkx5Vfq0RyOrYph9boshRN3D4tbWgBAcX9POdXCVfJONDxhfBuPHsJ6vEmPb An+XL5Yl26XYFPiODQ+Qbk44Ot1kt9s7oS3dVUrh92Qv0G3J3DF+Vt6C15nED+f+bk4gScu+ JHT7RjEmfa18GT8DcT//D1zEke1Ymhb41JH+GyZchDRWtjxsS5OBFMzrju7d264zJUFtX7iJ 3xvpKN7VcZKNtB6dLShj3v/XDsQVQWXmR/1YKWZ93C3LpRs2Y5nYdn6gEOpL/WfQFThtfnat HNc7fNs5vjotaYpBl5H8+VCautKbGOs219uQbhGZLYTv6okuKcY8W+4EJEtK0xB08vqr9Jd0 FS9MGjQE++GWo+5eQxFt6nUENHbVYnsr6bYPQsZH0CRNycgTG9MwY/UIXOf4W034UpR82TBG 1LiMsYfb8ahQJhs3wdf1nzipIjRwoZKT1vGXh/cj3gwSr64GfenURBxaFZA5O1acOZUjPrRT n3ci4McYW/0WVVA3lDGCBRMwggUPAgEBMIGWMIGQMQswCQYDVQQGEwJVUzEQMA4GA1UECBMH RmxvcmlkYTESMBAGA1UEBxMJTmljZXZpbGxlMRkwFwYDVQQKExBDdWRhIFN5c3RlbXMgTExD MRwwGgYDVQQDExNDdWRhIFN5c3RlbXMgTExDIENBMSIwIAYJKoZIhvcNAQkBFhNDdWRhIFN5 c3RlbXMgTExDIENBAgEpMA0GCWCGSAFlAwQCAwUAoIICTTAYBgkqhkiG9w0BCQMxCwYJKoZI hvcNAQcBMBwGCSqGSIb3DQEJBTEPFw0xNjA3MTIxNDUzMzRaME8GCSqGSIb3DQEJBDFCBEC9 BIe65fZFdhbJIM7n9ga6XdPnkV2Z4UmyuShcmZVrRQ4Hg4QwxNYQIl8e/bIz9VbrgKONejJU 9G2Gpb5DMPGIMGwGCSqGSIb3DQEJDzFfMF0wCwYJYIZIAWUDBAEqMAsGCWCGSAFlAwQBAjAK BggqhkiG9w0DBzAOBggqhkiG9w0DAgICAIAwDQYIKoZIhvcNAwICAUAwBwYFKw4DAgcwDQYI KoZIhvcNAwICASgwgacGCSsGAQQBgjcQBDGBmTCBljCBkDELMAkGA1UEBhMCVVMxEDAOBgNV BAgTB0Zsb3JpZGExEjAQBgNVBAcTCU5pY2V2aWxsZTEZMBcGA1UEChMQQ3VkYSBTeXN0ZW1z IExMQzEcMBoGA1UEAxMTQ3VkYSBTeXN0ZW1zIExMQyBDQTEiMCAGCSqGSIb3DQEJARYTQ3Vk YSBTeXN0ZW1zIExMQyBDQQIBKTCBqQYLKoZIhvcNAQkQAgsxgZmggZYwgZAxCzAJBgNVBAYT AlVTMRAwDgYDVQQIEwdGbG9yaWRhMRIwEAYDVQQHEwlOaWNldmlsbGUxGTAXBgNVBAoTEEN1 ZGEgU3lzdGVtcyBMTEMxHDAaBgNVBAMTE0N1ZGEgU3lzdGVtcyBMTEMgQ0ExIjAgBgkqhkiG 9w0BCQEWE0N1ZGEgU3lzdGVtcyBMTEMgQ0ECASkwDQYJKoZIhvcNAQEBBQAEggIAtR8coDi0 ZR+2PE4tGSUyFjxRCOfvAvw6wxnkI+hEDaiei45n/0jj+Yjxt4IbkkMaa/daQjoVFJkj7nFT 2IQ6DszwuUSRBBc/bvhw0/OYQ2/xDjzrjJkXoKBCmAD2oDJ3GWXpVSeNNGhI0TjW/H0jwv7N g0WzFbYw5vi4wfXGLdYs9AgbADZYHfPOC6gTfkp2w1yMFaLqpyeMmchEy6MxeM6dPGPk1EAX 6LSRIe83hnUVlUMEZzJRMOKjtRcEWPtbY/wERRNus18Wvftu2yIBbWOexrKfel6/FSKSNmPd iSd+ZykOv5lqLy2q8xbfu8k6eVrlX0YEcuE8NaZa6DGWyX4IPllkph0fqnqf34aFPYSJd1az 75xW3MRgEN4xKNivt5kq3XxyCLTtvqu5Q3zYe495zddl1VTAAKugnKBUJEtCKALoMIiCNX8c /fIA0oce9uI4UjEe9Rx8DcvjrnEQBHlh5SW+KyhLbgb3F31k9ZVGwnKKmg1FO2dmPKSBTN+X zutWpaxccQUEUHhooxmheVHu2X0T17VGECjvoOUcpTNFHIGvpVUstg8/L0uDZadFdt2u8I7k +N9WK9UIhPzFgo28x297IhMK4vmbgQfZPj1lvApyvnqjjmgmUJbnSl7Ii1P5VwXHVcCwXJ5y Ws0ZCo/ETEr9x2W8Es58uor5m+wAAAAAAAA= --------------ms020909060208030104060200--
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?3ad346b7-3c9f-05d6-a8cf-170a060051c9>