Date: Wed, 24 Jan 2007 10:57:41 +0100 From: Robin Gruyters <r.gruyters@yirdis.nl> To: freebsd-stable@freebsd.org Subject: Re: bge Ierr rate increase from 5.3R -> 6.1R Message-ID: <20070124105741.cj2htvoxcs4gg8wk@server.yirdis.net>
next in thread | raw e-mail | index | archive | help
On 13 Dec 2006, at 19:30, Greg Eden wrote:
> On 13 Dec 2006, at 09:18, Gleb Smirnoff wrote:
>
> > D> > Greg Eden wrote:
> > D> >> Hello
> > D> >>
> > D> >> I recently updated two production servers from 5.3 to 6.1 via
> > D> >> cvsup and
> > D> >> buildworld. Since the upgrade I've seen an increase in the =20
> > number of
> > D> >> Input packet errors reported on the bge cards in on both boxes.
> >
> > In 5.3-RELEASE the bge(4) driver did not read the error count from the
> > chip at all. So errors were not accounted.
>
> Many thanks for clearing up the mystery....
>
I have the same problem here. At the moment I only have two servers =20
upgraded from FreeBSD 5.4R to FreeBSD 6.1R and one to FreeBSD 6.2R.
[FreeBSD 6.1R]
Copyright (c) 1992-2006 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
The Regents of the University of California. All rights reserved.
FreeBSD 6.1-RELEASE-p10 #1: Tue Oct 24 10:44:15 CEST 2006
root@server.yirdis.net:/data/obj/data/src_6_1/sys/YIRDIS
Timecounter "i8254" frequency 1193182 Hz quality 0
CPU: Intel(R) Xeon(TM) CPU 3.40GHz (3400.14-MHz 686-class CPU)
Origin =3D "GenuineIntel" Id =3D 0xf41 Stepping =3D 1
=20
Features=3D0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,M=
CA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE>
Features2=3D0x649d<SSE3,RSVD2,MON,DS_CPL,EST,CNTX-ID,CX16,<b14>>
AMD Features=3D0x20000000<LM>
Logical CPUs per core: 2
real memory =3D 2147430400 (2047 MB)
avail memory =3D 2100654080 (2003 MB)
ACPI APIC Table: <HP 00000083>
FreeBSD/SMP: Multiprocessor System Detected: 2 CPUs
cpu0 (BSP): APIC ID: 0
cpu1 (AP): APIC ID: 1
ioapic0 <Version 2.0> irqs 0-23 on motherboard
ioapic1 <Version 2.0> irqs 24-47 on motherboard
ioapic2 <Version 2.0> irqs 48-71 on motherboard
ioapic3 <Version 2.0> irqs 72-95 on motherboard
ioapic4 <Version 2.0> irqs 96-119 on motherboard
acpi0: <HP P51> on motherboard
acpi0: Power Button (fixed)
Timecounter "ACPI-safe" frequency 3579545 Hz quality 1000
acpi_timer0: <24-bit timer at 3.579545MHz> port 0x908-0x90b on acpi0
cpu0: <ACPI CPU> on acpi0
cpu1: <ACPI CPU> on acpi0
pcib0: <ACPI Host-PCI bridge> on acpi0
pci0: <ACPI PCI bus> on pcib0
pcib1: <ACPI PCI-PCI bridge> at device 2.0 on pci0
pci2: <ACPI PCI bus> on pcib1
pcib2: <ACPI PCI-PCI bridge> at device 0.0 on pci2
pci3: <ACPI PCI bus> on pcib2
bge0: <Broadcom BCM5704C Dual Gigabit Ethernet, ASIC rev. 0x2100> mem =20
0xfdef0000-0xfdefffff irq 25 at device 1.0 on pci3
miibus0: <MII bus> on bge0
brgphy0: <BCM5704 10/100/1000baseTX PHY> on miibus0
brgphy0: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseTX, =20
1000baseTX-FDX, auto
bge0: Ethernet address: 00:12:79:d7:bb:99
bge1: <Broadcom BCM5704C Dual Gigabit Ethernet, ASIC rev. 0x2100> mem =20
0xfdee0000-0xfdeeffff irq 26 at device 1.1 on pci3
miibus1: <MII bus> on bge1
brgphy1: <BCM5704 10/100/1000baseTX PHY> on miibus1
brgphy1: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseTX, =20
1000baseTX-FDX, auto
bge1: Ethernet address: 00:12:79:d7:bb:98
pcib3: <ACPI PCI-PCI bridge> at device 0.2 on pci2
pci4: <ACPI PCI bus> on pcib3
ciss0: <HP Smart Array 6i> port 0x4000-0x40ff mem =20
0xfdff0000-0xfdff1fff,0xfdf80000-0xfdfbffff irq 51 at device 3.0 on pci4
ciss0: [GIANT-LOCKED]
pcib4: <ACPI PCI-PCI bridge> at device 6.0 on pci0
pci5: <ACPI PCI bus> on pcib4
pcib5: <ACPI PCI-PCI bridge> at device 0.0 on pci5
pci6: <ACPI PCI bus> on pcib5
pcib6: <ACPI PCI-PCI bridge> at device 0.2 on pci5
pci10: <ACPI PCI bus> on pcib6
pci0: <serial bus, USB> at device 29.0 (no driver attached)
pci0: <serial bus, USB> at device 29.1 (no driver attached)
pci0: <serial bus, USB> at device 29.2 (no driver attached)
pci0: <serial bus, USB> at device 29.3 (no driver attached)
pci0: <serial bus, USB> at device 29.7 (no driver attached)
pcib7: <ACPI PCI-PCI bridge> at device 30.0 on pci0
pci1: <ACPI PCI bus> on pcib7
pci1: <display, VGA> at device 3.0 (no driver attached)
pci1: <base peripheral> at device 4.0 (no driver attached)
pci1: <base peripheral> at device 4.2 (no driver attached)
isab0: <PCI-ISA bridge> at device 31.0 on pci0
isa0: <ISA bus> on isab0
atapci0: <Intel ICH5 UDMA100 controller> port =20
0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0x500-0x50f at device 31.1 on pci0
ata0: <ATA channel 0> on atapci0
ata1: <ATA channel 1> on atapci0
acpi_tz0: <Thermal Zone> on acpi0
atkbdc0: <Keyboard controller (i8042)> port 0x60,0x64 irq 1 on acpi0
atkbd0: <AT Keyboard> irq 1 on atkbdc0
kbd0 at atkbd0
atkbd0: [GIANT-LOCKED]
psm0: <PS/2 Mouse> irq 12 on atkbdc0
psm0: [GIANT-LOCKED]
psm0: model IntelliMouse Explorer, device ID 4
sio0: <Standard PC COM port> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0
sio0: type 16550A
fdc0: <floppy drive controller (FDE)> port 0x3f2-0x3f5 irq 6 drq 2 on acpi0
fdc0: [FAST]
pmtimer0 on isa0
orm0: <ISA Option ROMs> at iomem =20
0xc0000-0xc7fff,0xc8000-0xcbfff,0xcc000-0xcd7ff,0xee000-0xeffff on isa0
sc0: <System console> at flags 0x100 on isa0
sc0: VGA <16 virtual consoles, flags=3D0x300>
sio1: configured irq 3 not in bitmap of probed irqs 0
sio1: port may not be enabled
vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0
Timecounters tick every 1.000 msec
acd0: CDROM <CD-224E/9.9A> at ata0-master PIO4
sa0 at ciss0 bus 33 target 5 lun 0
sa0: <HP C7438A V312> Removable Sequential Access SCSI-3 device
sa0: 135.168MB/s transfers
da0 at ciss0 bus 0 target 0 lun 0
da0: <COMPAQ RAID 1 VOLUME OK> Fixed Direct Access SCSI-0 device
da0: 135.168MB/s transfers
da0: 69459MB (142253280 512 byte sectors: 255H 32S/T 17433C)
da1 at ciss0 bus 0 target 1 lun 0
da1: <COMPAQ RAID 1 VOLUME OK> Fixed Direct Access SCSI-0 device
da1: 135.168MB/s transfers
da1: 69459MB (142253280 512 byte sectors: 255H 32S/T 17433C)
da2 at ciss0 bus 0 target 2 lun 0
da2: <COMPAQ RAID 0 VOLUME OK> Fixed Direct Access SCSI-0 device
da2: 135.168MB/s transfers
da2: 69459MB (142253280 512 byte sectors: 255H 32S/T 17433C)
SMP: AP CPU #1 Launched!
Trying to mount root from ufs:/dev/da0s1a
bge1: link state changed to UP
bge0: link state changed to UP
[/FreeBSD 6.1R]
[FreeBSD 6.2R]
Copyright (c) 1992-2007 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 6.2-RELEASE #1: Mon Jan 15 15:34:19 CET 2007
root@server.yirdis.net:/data/obj/data/src_6_2/sys/YIRDIS
Timecounter "i8254" frequency 1193182 Hz quality 0
CPU: Intel(R) Xeon(TM) CPU 3.00GHz (3000.12-MHz 686-class CPU)
Origin =3D "GenuineIntel" Id =3D 0xf41 Stepping =3D 1
=20
Features=3D0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,M=
CA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE>
Features2=3D0x641d<SSE3,RSVD2,MON,DS_CPL,CNTX-ID,CX16,<b14>>
AMD Features=3D0x20000000<LM>
Logical CPUs per core: 2
real memory =3D 2147430400 (2047 MB)
avail memory =3D 2100547584 (2003 MB)
ACPI APIC Table: <HP 00000083>
Security auditing service present
BSM auditing present
ioapic1: Changing APIC ID to 9
ioapic0 <Version 2.0> irqs 0-23 on motherboard
ioapic1 <Version 2.0> irqs 24-47 on motherboard
ioapic2 <Version 2.0> irqs 48-71 on motherboard
ioapic3 <Version 2.0> irqs 72-95 on motherboard
acpi0: <HP P52> on motherboard
acpi0: Power Button (fixed)
Timecounter "ACPI-safe" frequency 3579545 Hz quality 1000
acpi_timer0: <24-bit timer at 3.579545MHz> port 0x908-0x90b on acpi0
cpu0: <ACPI CPU> on acpi0
pcib0: <ACPI Host-PCI bridge> on acpi0
pci0: <ACPI PCI bus> on pcib0
pcib1: <ACPI PCI-PCI bridge> at device 2.0 on pci0
pci13: <ACPI PCI bus> on pcib1
pcib2: <ACPI PCI-PCI bridge> at device 4.0 on pci0
pci6: <ACPI PCI bus> on pcib2
pcib3: <ACPI PCI-PCI bridge> at device 0.0 on pci6
pci7: <ACPI PCI bus> on pcib3
pcib4: <ACPI PCI-PCI bridge> at device 0.2 on pci6
pci10: <ACPI PCI bus> on pcib4
pcib5: <PCI-PCI bridge> at device 1.0 on pci10
pci11: <PCI bus> on pcib5
ste0: <D-Link DL10050 10/100BaseTX> port 0x5000-0x507f irq 72 at =20
device 4.0 on pci11
miibus0: <MII bus> on ste0
ukphy0: <Generic IEEE 802.3u media interface> on miibus0
ukphy0: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto
ste0: Ethernet address: 00:0d:88:fc:c8:cc
ste1: <D-Link DL10050 10/100BaseTX> port 0x5080-0x50ff irq 73 at =20
device 5.0 on pci11
miibus1: <MII bus> on ste1
ukphy1: <Generic IEEE 802.3u media interface> on miibus1
ukphy1: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto
ste1: Ethernet address: 00:0d:88:fc:c8:cd
ste2: <D-Link DL10050 10/100BaseTX> port 0x5400-0x547f irq 74 at =20
device 6.0 on pci11
miibus2: <MII bus> on ste2
ukphy2: <Generic IEEE 802.3u media interface> on miibus2
ukphy2: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto
ste2: Ethernet address: 00:0d:88:fc:c8:ce
ste3: <D-Link DL10050 10/100BaseTX> port 0x5480-0x54ff irq 75 at =20
device 7.0 on pci11
miibus3: <MII bus> on ste3
ukphy3: <Generic IEEE 802.3u media interface> on miibus3
ukphy3: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto
ste3: Ethernet address: 00:0d:88:fc:c8:cf
pcib6: <ACPI PCI-PCI bridge> at device 6.0 on pci0
pci3: <ACPI PCI bus> on pcib6
pcib7: <ACPI PCI-PCI bridge> at device 28.0 on pci0
pci2: <ACPI PCI bus> on pcib7
ciss0: <HP Smart Array 6i> port 0x4000-0x40ff mem =20
0xfdff0000-0xfdff1fff,0xfdf80000-0xfdfbffff irq 24 at device 1.0 on pci2
ciss0: [GIANT-LOCKED]
bge0: <Broadcom BCM5704 B0, ASIC rev. 0x2100> mem =20
0xfdf70000-0xfdf7ffff irq 25 at device 2.0 on pci2
miibus4: <MII bus> on bge0
brgphy0: <BCM5704 10/100/1000baseTX PHY> on miibus4
brgphy0: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseTX, =20
1000baseTX-FDX, auto
bge0: Ethernet address: 00:12:79:94:ed:12
bge1: <Broadcom BCM5704 B0, ASIC rev. 0x2100> mem =20
0xfdf60000-0xfdf6ffff irq 26 at device 2.1 on pci2
miibus5: <MII bus> on bge1
brgphy1: <BCM5704 10/100/1000baseTX PHY> on miibus5
brgphy1: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseTX, =20
1000baseTX-FDX, auto
bge1: Ethernet address: 00:12:79:94:ed:11
pci0: <serial bus, USB> at device 29.0 (no driver attached)
pci0: <serial bus, USB> at device 29.1 (no driver attached)
pci0: <base peripheral> at device 29.4 (no driver attached)
pci0: <base peripheral, interrupt controller> at device 29.5 (no =20
driver attached)
pci0: <serial bus, USB> at device 29.7 (no driver attached)
pcib8: <ACPI PCI-PCI bridge> at device 30.0 on pci0
pci1: <ACPI PCI bus> on pcib8
pci1: <display, VGA> at device 3.0 (no driver attached)
pci1: <base peripheral> at device 4.0 (no driver attached)
pci1: <base peripheral> at device 4.2 (no driver attached)
isab0: <PCI-ISA bridge> at device 31.0 on pci0
isa0: <ISA bus> on isab0
atapci0: <Intel 6300ESB UDMA100 controller> port =20
0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0x500-0x50f irq 18 at device 31.1 =20
on pci0
ata0: <ATA channel 0> on atapci0
ata1: <ATA channel 1> on atapci0
acpi_tz0: <Thermal Zone> on acpi0
atkbdc0: <Keyboard controller (i8042)> port 0x60,0x64 irq 1 on acpi0
atkbd0: <AT Keyboard> irq 1 on atkbdc0
kbd0 at atkbd0
atkbd0: [GIANT-LOCKED]
psm0: <PS/2 Mouse> irq 12 on atkbdc0
psm0: [GIANT-LOCKED]
psm0: model IntelliMouse Explorer, device ID 4
sio0: <Standard PC COM port> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0
sio0: type 16550A
fdc0: <floppy drive controller (FDE)> port 0x3f2-0x3f5 irq 6 drq 2 on acpi0
fdc0: [FAST]
fd0: <1440-KB 3.5" drive> on fdc0 drive 0
pmtimer0 on isa0
orm0: <ISA Option ROMs> at iomem =20
0xc0000-0xc7fff,0xc8000-0xcbfff,0xee000-0xeffff on isa0
sc0: <System console> at flags 0x100 on isa0
sc0: VGA <16 virtual consoles, flags=3D0x300>
sio1 at port 0x2f8-0x2ff irq 3 on isa0
sio1: type 16550A
vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0
Timecounter "TSC" frequency 3000124702 Hz quality 800
Timecounters tick every 1.000 msec
acd0: CDROM <COMPAQ CD-ROM SN-124/N104> at ata0-master PIO4
da0 at ciss0 bus 0 target 0 lun 0
da0: <COMPAQ RAID 1 VOLUME OK> Fixed Direct Access SCSI-0 device
da0: 135.168MB/s transfers
da0: 69459MB (142253280 512 byte sectors: 255H 32S/T 17433C)
Trying to mount root from ufs:/dev/da0s1a
Accounting enabled
[/FreeBSD 6.2R]
And here is the netstat -ni output from our development server:
[netstat -ni]
Name Mtu Ipkts Ierrs Opkts Oerrs Coll
ste0* 1500 0 0 0 0 0
ste1* 1500 0 0 0 0 0
ste2* 1500 0 0 0 0 0
ste3* 1500 0 0 0 0 0
bge0 1500 9866912 2114443 18835209 0 0
bge0 1500 2004841 - 18833483 - -
bge0 1500 1723393 - 1719554 - -
bge0 1500 82 - 66 - -
bge0 1500 19036813 - 14796159 - -
bge0 1500 38709278 - 35167554 - -
bge0 1500 0 - 0 - -
bge0 1500 621 - 0 - -
bge0 1500 1716 - 0 - -
bge0 1500 184 - 0 - -
bge0 1500 52881 - 2336 - -
bge1* 1500 0 0 0 0 0
pflog 33208 0 0 0 0
lo0 16384 0 51692624 0 0
lo0 16384 6611 - 6611 - -
[...]
Is there a fix for it already, or maybe a workaround?
Regards,
Robin Gruyters
Network and Security Engineer
Yirdis B.V.
I: http://yirdis.com
P: +31 (0)36 5300394
F: +31 (0)36 5489119
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?20070124105741.cj2htvoxcs4gg8wk>