Skip site navigation (1)Skip section navigation (2)
Date:      Mon, 11 Jul 2016 12:21:53 -0500
From:      Karl Denninger <karl@denninger.net>
To:        "freebsd-arm@freebsd.org" <freebsd-arm@freebsd.org>
Subject:   Re: Old problem still present on 11-ALPHA1 - Pi2
Message-ID:  <5682bff2-3033-194a-67bf-32ba0cdada37@denninger.net>
In-Reply-To: <62d7d041-2de5-639f-5c1e-76f9682e6cc8@selasky.org>
References:  <32ad8bb3-f0a6-c86b-1b23-aae9af4442ea@denninger.net> <62d7d041-2de5-639f-5c1e-76f9682e6cc8@selasky.org>

next in thread | previous in thread | raw e-mail | index | archive | help
This is a cryptographically signed message in MIME format.

--------------ms080702060605080301070700
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable

On 7/11/2016 11:38, Hans Petter Selasky wrote:
> On 07/11/16 18:15, Karl Denninger wrote:
>> I have two PI2s on the same switch here doing quite-different things.
>>
>> One never shows network problems.  The other one does this:
>>
>> ....
>>
>> ukphy0:  none, 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto
>> ue0: <USB Ethernet> on smsc0
>> ue0: Ethernet address: b8:27:eb:08:12:1c
>> ugen0.4: <Inateck> at usbus0
>> umass0: <Inateck product 0x5136, class 0/0, rev 2.10/0.01, addr 4> on
>> usbus0
>> umass0:  SCSI over Bulk-Only; quirks =3D 0x0100
>> umass0:0:0: Attached to scbus0
>> da0 at umass-sim0 bus 0 scbus0 target 0 lun 0
>> da0: <Inateck  0> Fixed Direct Access SPC-4 SCSI device
>> da0: Serial Number 00000000000000000000
>> da0: 40.000MB/s transfers
>> da0: 476940MB (976773168 512 byte sectors)
>> da0: quirks=3D0x2<NO_6_BYTE>
>> random: unblocking device.
>> smsc0: chip 0xec00, rev. 0002
>> ue0: link state changed to DOWN
>> ue0: link state changed to UP
>> ue0.2: link state changed to UP
>> ue0.3: link state changed to UP
>> ue0: link state changed to DOWN
>> ue0.2: link state changed to DOWN
>> ue0.3: link state changed to DOWN
>> ue0: link state changed to UP
>> ue0.2: link state changed to UP
>> ue0.3: link state changed to UP
>> ue0: link state changed to DOWN
>> ue0.2: link state changed to DOWN
>> ue0.3: link state changed to DOWN
>> ue0: link state changed to UP
>> ue0.2: link state changed to UP
>> ue0.3: link state changed to UP
>> ue0: link state changed to DOWN
>> ue0.2: link state changed to DOWN
>> ue0.3: link state changed to DOWN
>> ue0: link state changed to UP
>> ue0.2: link state changed to UP
>> ue0.3: link state changed to UP
>>
>> Every now and then (every hour or so) the interface flaps.  If I plug =
a
>> USB interface in and use two network cords I *still* get the flapping.=

>> This unit has very low (but non-zero) traffic on the network, while th=
e
>> other actually has *more* traffic on the network yet is completely
>> stable.  Since both are plugged into the same physical switch I doubt
>> the switch itself or its firmware is involved in this.
>>
>> The only difference I can see is that the one that flaps is using
>> vlans.  Specifically, that machine is the network's dhcp server, and i=
t
>> is on three different vlans (untagged and two tagged) so it can provid=
e
>> addresses (and DNS services via unbound) to those VLAN interfaces.
>>
>> This appears to be somehow linked to the ue interface driver, because
>> another machine (Intel based) that is also on multiple vLANs via the e=
m
>> driver does *not* flap.
>>
>> I don't know if this is actually arm related or not; it might not be i=
f
>> Intel machines also use the "ue" driver, but it's very consistent on t=
he
>> PI2 if I want to use vlan tags whether I have one or two interfaces (t=
he
>> second via a USB adapter of course) in use or not.
>>
>> Other than the flapping the box appears to run fine; the flaps do,
>> however, sometimes stop reporting from the snmpd daemon so I have had =
to
>> stick a cron job out there to restart that on a schedule to prevent it=

>> from interrupting reporting to my traffic management tools.  Whether t=
he
>> two are related is not known with certainty (but I suspect it is.)
>>
>
> Did you try to set any media options, like 10MBps instead of 100Mbps ?
>
Yes; it makes no difference.

> What does ifconfig say?
>
> --HPS
No difference -- both are 100BaseTX connected.

Machine with the problem:
% ifconfig ue0
ue0: flags=3D8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 15=
00
        options=3D80009<RXCSUM,VLAN_MTU,LINKSTATE>
        ether b8:27:eb:08:12:1c
        inet 192.168.1.200 netmask 0xffffff00 broadcast 192.168.1.255
        media: Ethernet autoselect (100baseTX <full-duplex>)
        status: active
        nd6 options=3D29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>


Machine without:
% ifconfig ue0
ue0: flags=3D8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 15=
00
        options=3D80009<RXCSUM,VLAN_MTU,LINKSTATE>
        ether b8:27:eb:85:21:de
        inet 192.168.1.214 netmask 0xffffff00 broadcast 192.168.1.255
        media: Ethernet autoselect (100baseTX <full-duplex>)
        status: active
        nd6 options=3D29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>

The only difference I can see between them is that the one that exhibits
the flapping has vlans defined on the interface (which are working
normally.)

Current code on both machines:
% uname -v
FreeBSD 11.0-BETA1 #0 r302526: Sun Jul 10 10:39:31 CDT 2016   =20
karl@NewFS.denninger.net:/pics/CrossBuild/obj/arm.armv6/pics/CrossBuild/s=
rc/sys/RPI2

However, this has been an issue since the first 11-Current builds that
had RPI2 capability in them, so it's not version-dependent either.

I have been unable to find a way to log the *reason* the flap occurs
(e.g. nothing in the logs indicating why it thinks link-sense
disappeared, if it actually thinks it did, or if something in the code
performed what amounted to an interface reset.)

--=20
Karl Denninger
karl@denninger.net <mailto:karl@denninger.net>
/The Market Ticker/
/[S/MIME encrypted email preferred]/

--------------ms080702060605080301070700
Content-Type: application/pkcs7-signature; name="smime.p7s"
Content-Transfer-Encoding: base64
Content-Disposition: attachment; filename="smime.p7s"
Content-Description: S/MIME Cryptographic Signature

MIAGCSqGSIb3DQEHAqCAMIACAQExDzANBglghkgBZQMEAgMFADCABgkqhkiG9w0BBwEAAKCC
Bl8wggZbMIIEQ6ADAgECAgEpMA0GCSqGSIb3DQEBCwUAMIGQMQswCQYDVQQGEwJVUzEQMA4G
A1UECBMHRmxvcmlkYTESMBAGA1UEBxMJTmljZXZpbGxlMRkwFwYDVQQKExBDdWRhIFN5c3Rl
bXMgTExDMRwwGgYDVQQDExNDdWRhIFN5c3RlbXMgTExDIENBMSIwIAYJKoZIhvcNAQkBFhND
dWRhIFN5c3RlbXMgTExDIENBMB4XDTE1MDQyMTAyMjE1OVoXDTIwMDQxOTAyMjE1OVowWjEL
MAkGA1UEBhMCVVMxEDAOBgNVBAgTB0Zsb3JpZGExGTAXBgNVBAoTEEN1ZGEgU3lzdGVtcyBM
TEMxHjAcBgNVBAMTFUthcmwgRGVubmluZ2VyIChPQ1NQKTCCAiIwDQYJKoZIhvcNAQEBBQAD
ggIPADCCAgoCggIBALmEWPhAdphrWd4K5VTvE5pxL3blRQPyGF3ApjUjgtavqU1Y8pbI3Byg
XDj2/Uz9Si8XVj/kNbKEjkRh5SsNvx3Fc0oQ1uVjyCq7zC/kctF7yLzQbvWnU4grAPZ3IuAp
3/fFxIVaXpxEdKmyZAVDhk9az+IgHH43rdJRIMzxJ5vqQMb+n2EjadVqiGPbtG9aZEImlq7f
IYDTnKyToi23PAnkPwwT+q1IkI2DTvf2jzWrhLR5DTX0fUYC0nxlHWbjgpiapyJWtR7K2YQO
aevQb/3vN9gSojT2h+cBem7QIj6U69rEYcEDvPyCMXEV9VcXdcmW42LSRsPvZcBHFkWAJqMZ
Myiz4kumaP+s+cIDaXitR/szoqDKGSHM4CPAZV9Yh8asvxQL5uDxz5wvLPgS5yS8K/o7zDR5
vNkMCyfYQuR6PAJxVOk5Arqvj9lfP3JSVapwbr01CoWDBkpuJlKfpQIEeC/pcCBKknllbMYq
yHBO2TipLyO5Ocd1nhN/nOsO+C+j31lQHfOMRZaPQykXVPWG5BbhWT7ttX4vy5hOW6yJgeT/
o3apynlp1cEavkQRS8uJHoQszF6KIrQMID/JfySWvVQ4ksnfzwB2lRomrdrwnQ4eG/HBS+0l
eozwOJNDIBlAP+hLe8A5oWZgooIIK/SulUAsfI6Sgd8dTZTTYmlhAgMBAAGjgfQwgfEwNwYI
KwYBBQUHAQEEKzApMCcGCCsGAQUFBzABhhtodHRwOi8vY3VkYXN5c3RlbXMubmV0Ojg4ODgw
CQYDVR0TBAIwADARBglghkgBhvhCAQEEBAMCBaAwCwYDVR0PBAQDAgXgMCwGCWCGSAGG+EIB
DQQfFh1PcGVuU1NMIEdlbmVyYXRlZCBDZXJ0aWZpY2F0ZTAdBgNVHQ4EFgQUxRyULenJaFwX
RtT79aNmIB/u5VkwHwYDVR0jBBgwFoAUJHGbnYV9/N3dvbDKkpQDofrTbTUwHQYDVR0RBBYw
FIESa2FybEBkZW5uaW5nZXIubmV0MA0GCSqGSIb3DQEBCwUAA4ICAQBPf3cYtmKowmGIYsm6
eBinJu7QVWvxi1vqnBz3KE+HapqoIZS8/PolB/hwiY0UAE1RsjBJ7yEjihVRwummSBvkoOyf
G30uPn4yg4vbJkR9lTz8d21fPshWETa6DBh2jx2Qf13LZpr3Pj2fTtlu6xMYKzg7cSDgd2bO
sJGH/rcvva9Spkx5Vfq0RyOrYph9boshRN3D4tbWgBAcX9POdXCVfJONDxhfBuPHsJ6vEmPb
An+XL5Yl26XYFPiODQ+Qbk44Ot1kt9s7oS3dVUrh92Qv0G3J3DF+Vt6C15nED+f+bk4gScu+
JHT7RjEmfa18GT8DcT//D1zEke1Ymhb41JH+GyZchDRWtjxsS5OBFMzrju7d264zJUFtX7iJ
3xvpKN7VcZKNtB6dLShj3v/XDsQVQWXmR/1YKWZ93C3LpRs2Y5nYdn6gEOpL/WfQFThtfnat
HNc7fNs5vjotaYpBl5H8+VCautKbGOs219uQbhGZLYTv6okuKcY8W+4EJEtK0xB08vqr9Jd0
FS9MGjQE++GWo+5eQxFt6nUENHbVYnsr6bYPQsZH0CRNycgTG9MwY/UIXOf4W034UpR82TBG
1LiMsYfb8ahQJhs3wdf1nzipIjRwoZKT1vGXh/cj3gwSr64GfenURBxaFZA5O1acOZUjPrRT
n3ci4McYW/0WVVA3lDGCBRMwggUPAgEBMIGWMIGQMQswCQYDVQQGEwJVUzEQMA4GA1UECBMH
RmxvcmlkYTESMBAGA1UEBxMJTmljZXZpbGxlMRkwFwYDVQQKExBDdWRhIFN5c3RlbXMgTExD
MRwwGgYDVQQDExNDdWRhIFN5c3RlbXMgTExDIENBMSIwIAYJKoZIhvcNAQkBFhNDdWRhIFN5
c3RlbXMgTExDIENBAgEpMA0GCWCGSAFlAwQCAwUAoIICTTAYBgkqhkiG9w0BCQMxCwYJKoZI
hvcNAQcBMBwGCSqGSIb3DQEJBTEPFw0xNjA3MTExNzIxNTNaME8GCSqGSIb3DQEJBDFCBEC0
UkIghdRNY/pYt4BizQt76jUrx2DS0jG3PzCJUQP92fx+YhI+/UEgYo1UnEhJ3+ZDtmls7P8A
KDV6on21vAniMGwGCSqGSIb3DQEJDzFfMF0wCwYJYIZIAWUDBAEqMAsGCWCGSAFlAwQBAjAK
BggqhkiG9w0DBzAOBggqhkiG9w0DAgICAIAwDQYIKoZIhvcNAwICAUAwBwYFKw4DAgcwDQYI
KoZIhvcNAwICASgwgacGCSsGAQQBgjcQBDGBmTCBljCBkDELMAkGA1UEBhMCVVMxEDAOBgNV
BAgTB0Zsb3JpZGExEjAQBgNVBAcTCU5pY2V2aWxsZTEZMBcGA1UEChMQQ3VkYSBTeXN0ZW1z
IExMQzEcMBoGA1UEAxMTQ3VkYSBTeXN0ZW1zIExMQyBDQTEiMCAGCSqGSIb3DQEJARYTQ3Vk
YSBTeXN0ZW1zIExMQyBDQQIBKTCBqQYLKoZIhvcNAQkQAgsxgZmggZYwgZAxCzAJBgNVBAYT
AlVTMRAwDgYDVQQIEwdGbG9yaWRhMRIwEAYDVQQHEwlOaWNldmlsbGUxGTAXBgNVBAoTEEN1
ZGEgU3lzdGVtcyBMTEMxHDAaBgNVBAMTE0N1ZGEgU3lzdGVtcyBMTEMgQ0ExIjAgBgkqhkiG
9w0BCQEWE0N1ZGEgU3lzdGVtcyBMTEMgQ0ECASkwDQYJKoZIhvcNAQEBBQAEggIAGMhIei75
rOjmQllMf2j1yJbzXPD0mIkLbjMLR/T7c0JTknqCecuASuPScr9J06F+AEdwzAW37lXw7ajA
MgfcyRDcT+qBZpKZ6mPlEsFHAH5stocdcs0uDew36ig8k8sE4ujApBMXzrcNMfNuQ0rw9q8n
Hb/c/jcUoaZM2EJsL3jztqesIxKJiv0/iG7jfmoIn/fJFtnk5/Pj5QOLby2wvyoI+6NSkGJN
LdgA3Fw6cAjg+bqdX/X0GIlmpNEvAx94jo9UtpzX85HEKKBuEX+REFWYpPVBgwETUWHlOh+X
y/HBH5TnqWjKlNkx6OKQ9jNao2ZDLyYgLjr/qgNvKidNwo+g4oEFROUdtx3yoGApqOrzw9UC
I3woD1ftJjV/bFZxD7XcKQjO3/pxLsMoPnG5p6v3aHhKpVPOuDPqAW4Fd232ABF1lHVwx5b8
Zt/JDo5xb7VpuYAq3efsgpzAMy9XaCBk7kf/7vkQbpq4pKWNUFowUCH6KeW0Iy3WIkxOo1vh
LmICc+oeOwJfCS8OYD2ABDXQv8XsGykJU3l6HG4TwHDOAPW5R8ysXStQIlx0hodl0/iIuDpy
MaiXzc83XYtk7ziS1weLbCsR9068GE1AcZt3v6nhOpqVe3LEyanZCiIdQ3H2zX/FLH8Szdcj
FSl5bUImoUhWrlCEnohVo86teWQAAAAAAAA=
--------------ms080702060605080301070700--



Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?5682bff2-3033-194a-67bf-32ba0cdada37>