Date: Fri, 8 Jun 2007 13:56:55 -0700 From: "David Christensen" <davidch@broadcom.com> To: "Tom Judge" <tom@tomjudge.com> Cc: freebsd-net <freebsd-net@freebsd.org> Subject: RE: Problems with BCE network adapter (Dell PE2950) Message-ID: <09BFF2FA5EAB4A45B6655E151BBDD9030423EE13@NT-IRVA-0750.brcm.ad.broadcom.com> In-Reply-To: <466873FA.9030800@tomjudge.com> References: <46680DB1.9050905@tomjudge.com> <09BFF2FA5EAB4A45B6655E151BBDD9030414B1EC@NT-IRVA-0750.brcm.ad.broadcom.com> <466873FA.9030800@tomjudge.com>
next in thread | previous in thread | raw e-mail | index | archive | help
This is a multi-part message in MIME format. ------_=_NextPart_001_01C7AA0F.8C2996AC Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable Tom, There's already some debug code to watch for unusual size packets. If you can recompile the driver from HEAD with the attached diffs we can printout the first 128 bytes of any unusual sized packets. This does enabled other debugging code so performance will drop but that should be OK since this doesn't present as a performance problem. Dave > -----Original Message----- > From: Tom Judge [mailto:tom@tomjudge.com]=20 > Sent: Thursday, June 07, 2007 2:09 PM > To: David Christensen > Cc: freebsd-net > Subject: Re: Problems with BCE network adapter (Dell PE2950) >=20 > David Christensen wrote: > > It's not a problem I've seen before. The driver seems to be=20 > > passing an Ethernet frame up the stack with a length of -4. > > Is there anything unusual about your network setup like VLAN > > tagging, jumbo frames, or anything else that might cause > > the Ethernet frame to be formatted in an unusual manner? > > The error probably occurs in bce_rx_intr() but I'd need to > > see the packet that's causing the problem to figure out why > > the driver isn't calculating the packet length correctly. > >=20 > > Dave=20 > >=20 > Hi Dave, >=20 > The network is running Jumbo frames (8192 Byte frames). There are 5=20 > PE2950's and 7 PE1950's with this NIC on this network. However it is=20 > always the same system that causes the crash in the same=20 > manner. I will=20 > look into reproducing the error tomorrow with the switch port=20 > mirrored=20 > to a second server (with an em NIC). Hopefully I will get=20 > some useful=20 > dump files from tcpdump.... >=20 > Do you have any idea what the frame might look like that=20 > causes this error? >=20 > Here is the NIC config from the system: >=20 > >> #ifconfig bce0 > >> bce0: flags=3D8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu = 8192 > >> =20 > options=3D3b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU> > >> inet 172.31.0.13 netmask 0xffffff00 broadcast=20 > 172.31.0.255 > >> inet 172.31.0.157 netmask 0xffffffff broadcast=20 > 172.31.0.157 > >> inet 172.31.0.161 netmask 0xffffffff broadcast=20 > 172.31.0.161 > >> ether 00:18:8b:88:d8:81 > >> media: Ethernet autoselect (1000baseTX <full-duplex>) > >> status: active >=20 > If its any use the switch is a Dell PowerConnect 5324. >=20 > Tom >=20 > >> I am seeing some problems with one of my Dell PowerEdge=20 > >> 2950's (running=20 > >> RELENG_6_2) on board bce NICs. The interface seems to=20 > crash with the=20 > >> following errors, to which the fix seems to be and "ifconfig=20 > >> bce0 down;=20 > >> ifconfig bce0 up": > >> > >> Jun 7 12:20:29 gonzo kernel: bce0: discard frame w/o leading=20 > >> ethernet=20 > >> header (len 4294967292 pkt len 4294967292) > >> Jun 7 12:20:29 gonzo last message repeated 54 times > >> Jun 7 12:20:58 gonzo kernel: nfs server nfs-server:/usr/home: not=20 > >> responding > >> > >> > >> Is this a know problem? If so is there a solution? > >> > >> Tom > >> > >> #uname -a > >> FreeBSD gonzo.mintel.co.uk 6.2-RELEASE FreeBSD 6.2-RELEASE=20 > >> #10: Thu Apr=20 > >> 5 10:53:39 BST 2007=20 > >> root@roley.mintel.co.uk:/usr/obj/usr/src/sys/PE2950 amd64=20 > >> amd64 Intel(R)=20 > >> Xeon(R) CPU 5160 @ 3.00GHz FreeBSD > >> > >> > >> ## dmesg.boot snippet > >> bce0: <Broadcom NetXtreme II BCM5708 1000Base-T (B2), v0.9.6> mem=20 > >> 0xf4000000-0xf5ffffff irq 16 at device 0.0 on pci9 > >> bce0: ASIC ID 0x57081020; Revision (B2); PCI-X 64-bit 133MHz > >> miibus0: <MII bus> on bce0 > >> brgphy0: <BCM5708C 10/100/1000baseTX PHY> on miibus0 > >> brgphy0: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX,=20 > 1000baseTX,=20 > >> 1000baseTX-FDX, auto > >> bce0: Ethernet address: 00:18:8b:88:d8:81 > >> > >> ## pciconf -lv snippet > >> bce0@pci9:0:0: class=3D0x020000 card=3D0x01b21028=20 > >> chip=3D0x164c14e4 rev=3D0x12=20 > >> hdr=3D0x00 > >> vendor =3D 'Broadcom Corporation' > >> class =3D network > >> subclass =3D ethernet > >> > >> #ifconfig bce0 > >> bce0: flags=3D8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 8192 > >> =20 > options=3D3b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU> > >> inet 172.31.0.13 netmask 0xffffff00 broadcast 172.31.0.255 > >> inet 172.31.0.157 netmask 0xffffffff broadcast=20 > 172.31.0.157 > >> inet 172.31.0.161 netmask 0xffffffff broadcast=20 > 172.31.0.161 > >> ether 00:18:8b:88:d8:81 > >> media: Ethernet autoselect (1000baseTX <full-duplex>) > >> status: active > >> > >> #Switch port counters > >> console# show interfaces counters ethernet g10 > >> Port InOctets InUcastPkts InMcastPkts InBcastPkts > >> ---------------- ---------- ----------- ----------- ----------- > >> g10 2615415297 87563987 0 13480 > >> > >> Port OutOctets OutUcastPkts OutMcastPkts OutBcastPkts > >> ---------------- ---------- ------------ ------------ ------------ > >> g10 2535595313 136391705 10740316 1420686 > >> > >> FCS Errors: 0 > >> Single Collision Frames: 0 > >> Late Collisions: 0 > >> Excessive Collisions: 0 > >> Internal MAC Tx Errors: 0 > >> Oversize Packets: 0 > >> Internal MAC Rx Errors: 0 > >> Received Pause Frames: 0 > >> Transmitted Pause Frames: 0 > >=20 > > _______________________________________________ > > freebsd-net@freebsd.org mailing list > > http://lists.freebsd.org/mailman/listinfo/freebsd-net > > To unsubscribe, send any mail to=20 > "freebsd-net-unsubscribe@freebsd.org" >=20 >=20 >=20 ------_=_NextPart_001_01C7AA0F.8C2996AC Content-Type: application/octet-stream; name=if_bce.diff Content-Transfer-Encoding: base64 Content-Description: if_bce.diff Content-Disposition: attachment; filename=if_bce.diff LS0tIGlmX2JjZS5jLm9yaWcJRnJpIEp1biAgOCAxMjoxODoyNyAyMDA3CisrKyBpZl9iY2UuYwlG cmkgSnVuICA4IDEzOjMzOjQ5IDIwMDcKQEAgLTcwMCw3ICs3MDAsNyBAQAogCQkJCQkgQkNFX1NI QVJFRF9IV19DRkdfQ09ORklHKTsKIAkJCWlmICh2YWwgJiBCQ0VfU0hBUkVEX0hXX0NGR19QSFlf Ml81RykgewogCQkJCXNjLT5iY2VfcGh5X2ZsYWdzIHw9IEJDRV9QSFlfMl81R19DQVBBQkxFX0ZM QUc7Ci0JCQkJREJQUklOVChzYywgQkNFX1dBUk4sICJGb3VuZCAyLjVHYiBjYXBhYmxlIGFkYXB0 ZXJcbiIpOworCQkJCURCUFJJTlQoc2MsIEJDRV9JTkZPLCAiRm91bmQgMi41R2IgY2FwYWJsZSBh ZGFwdGVyXG4iKTsKIAkJCX0KIAkJfQogCX0KQEAgLTQwODgsOCArNDA4OCwxMCBAQAogCQkJCQki TWluKCVkKSwgQWN0dWFsKCVkKSwgTWF4KCVkKVxuIiwgCiAJCQkJCV9fRklMRV9fLCBfX0xJTkVf XywgKGludCkgQkNFX01JTl9NVFUsIAogCQkJCQlsZW4sIChpbnQpIEJDRV9NQVhfSlVNQk9fRVRI RVJfTVRVX1ZMQU4pOwotCQkJCWJjZV9kdW1wX21idWYoc2MsIG0pOwotCQkgCQliY2VfYnJlYWtw b2ludChzYykpOworLyogRFJDIC0gU3RhcnQgKi8NCisJCQkJYmNlX2R1bXBfbWJ1ZihzYywgbSkp Ow0KKy8qCQkgCQliY2VfYnJlYWtwb2ludChzYykpOyAqLw0KKy8qIERSQyAtIEVuZCAqLwogCiAJ CQlsZW4gLT0gRVRIRVJfQ1JDX0xFTjsKIApAQCAtNjM2OCw4ICs2MzcwLDEwIEBACiBzdGF0aWMg dm9pZAogYmNlX2R1bXBfbWJ1ZihzdHJ1Y3QgYmNlX3NvZnRjICpzYywgc3RydWN0IG1idWYgKm0p CiB7Ci0JdTMyIHZhbF9oaSwgdmFsX2xvOwotCXN0cnVjdCBtYnVmICptcCA9IG07CisJdTMyIHZh bF9oaSwgdmFsX2xvOw0KKwlpbnQgaTsKKwlzdHJ1Y3QgbWJ1ZiAqbXAgPSBtOw0KKwl1X2NoYXIg KmQ7CiAKIAlpZiAobSA9PSBOVUxMKSB7CiAJCUJDRV9QUklOVEYoIm1idWY6IG51bGwgcG9pbnRl clxuIik7CkBAIC02Mzk1LDYgKzYzOTksMjMgQEAKIAkJdmFsX2xvID0gQkNFX0FERFJfTE8obXAt Pm1fZGF0YSk7CiAJCXByaW50ZigiKSBtX2RhdGEgPSAweCUwOFg6JTA4WFxuIiwgCiAJCQkgICB2 YWxfaGksIHZhbF9sbyk7CisNCisJCS8qIFByaW50IHVwIHRvIDEyOCBieXRlcyBvZiBkYXRhIChz aG91bGQgYmUgdGhlIEV0aGVybmV0IGhlYWRlcikgKi8NCisJCWQgPSBtdG9kKG0sIHVfY2hhciAq KTsNCisJCWZvciAoaSA9IDA7IChpIDwgbS0+bV9sZW4gJiYgaSA8IDEyOCk7ICkgew0KKwkJCWlm ICgoaSAlIDE2KSA9PSAwKQ0KKwkJCQlwcmludGYoIjB4JTAyWDogIiwgaSk7DQorCQkJaWYgKGkg PD0gbS0+bV9sZW4pIHsNCisJCQkJcHJpbnRmKCIlMDJYICIsICpkKTsNCisJCQkJZCsrOw0KKwkJ CQlpKys7DQorCQkJfSBlbHNlDQorCQkJCWJyZWFrOw0KKwkJCWlmICgoaSAlIDE2KSA9PSAwKQ0K KwkJCQlwcmludGYoIlxuIik7DQorCQl9DQorCQlpZiAoaSAhPSAxMjgpDQorCQkJcHJpbnRmKCJc biIpOw0KIAogCQlpZiAobXAtPm1fZmxhZ3MgJiBNX1BLVEhEUikgewogCQkJQkNFX1BSSU5URigi LSBtX3BrdGhkcjogZmxhZ3MgPSAoICIpOwo= ------_=_NextPart_001_01C7AA0F.8C2996AC Content-Type: application/octet-stream; name=if_bcereg.diff Content-Transfer-Encoding: base64 Content-Description: if_bcereg.diff Content-Disposition: attachment; filename=if_bcereg.diff LS0tIGlmX2JjZXJlZy5oLm9yaWcJRnJpIEp1biAgOCAxMjoxODozNiAyMDA3CisrKyBpZl9iY2Vy ZWcuaAlGcmkgSnVuICA4IDEzOjMxOjEzIDIwMDcKQEAgLTk5LDggKzk5LDExIEBACiAKIC8qKioq KioqKioqKioqKioqKioqKioqKioqKioqKioqKioqKioqKioqKioqKioqKioqKioqKioqKioqKioq KioqKioqKioqKioqKioqLwogLyogRGVidWdnaW5nIG1hY3JvcyBhbmQgZGVmaW5pdGlvbnMuICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICovCi0vKioqKioqKioqKioqKioq KioqKioqKioqKioqKioqKioqKioqKioqKioqKioqKioqKioqKioqKioqKioqKioqKioqKioqKioq KioqKi8KLSNkZWZpbmUgQkNFX0NQX0xPQUQgCQkJMHgwMDAwMDAwMQorLyoqKioqKioqKioqKioq KioqKioqKioqKioqKioqKioqKioqKioqKioqKioqKioqKioqKioqKioqKioqKioqKioqKioqKioq KioqKiovDQorLyogRFJDIC0gU3RhcnQgKi8NCisjZGVmaW5lIEJDRV9ERUJVRyAxDQorLyogRFJD IC0gRW5kICovCisjZGVmaW5lIEJDRV9DUF9MT0FECQkJCTB4MDAwMDAwMDEKICNkZWZpbmUgQkNF X0NQX1NFTkQJCSAJCTB4MDAwMDAwMDIKICNkZWZpbmUgQkNFX0NQX1JFQ1YJCQkJMHgwMDAwMDAw NAogI2RlZmluZSBCQ0VfQ1BfSU5UUgkJCQkweDAwMDAwMDA4Cg== ------_=_NextPart_001_01C7AA0F.8C2996AC--
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?09BFF2FA5EAB4A45B6655E151BBDD9030423EE13>