Skip site navigation (1)Skip section navigation (2)
Date:      Mon, 03 Sep 2012 17:10:21 +0300
From:      Krassimir Slavchev <krassi@bulinfo.net>
To:        freebsd-stable@FreeBSD.ORG
Subject:   bce related panic on 8.3-STABLE
Message-ID:  <5044BA4D.2010403@bulinfo.net>

next in thread | raw e-mail | index | archive | help
Hi All,

Today, after upgrading an HP Proliant DL380 G6 to 8.3-STABLE we had the
following panic few minutes after going to multiuser mode:

http://193.194.156.21/bce_crash.jpg

dmesg from 8.3-STABLE kernel (Note the link up/down events):
...
Sep  3 14:19:54 m kernel: bce0: <HP NC382i DP Multifunction Gigabit
Server Adapter (C0)> mem 0xf4000000-0xf5ffffff irq 16 at device 0.0 on pci2
Sep  3 14:19:54 m kernel: miibus0: <MII bus> on bce0
Sep  3 14:19:54 m kernel: brgphy0: <BCM5709C 10/100/1000baseTX PHY> PHY
1 on miibus0
Sep  3 14:19:54 m kernel: brgphy0:  10baseT, 10baseT-FDX, 100baseTX,
100baseTX-FDX, 1000baseT, 1000baseT-master, 1000baseT-FDX,
1000baseT-FDX-master, auto, auto-flow
Sep  3 14:19:54 m kernel: bce0: Ethernet address: 00:26:55:52:27:06
Sep  3 14:19:54 m kernel: bce0: [ITHREAD]
Sep  3 14:19:54 mkernel: bce0: ASIC (0x57092003); Rev (C0); Bus (PCIe
x2, 2.5Gbps); B/C (4.6.4); Bufs (RX:2;TX:2;PG:8); Flags (SPLT|MSI|MFW);
MFW (NCSI 1.0.3)
Sep  3 14:19:54 m kernel: Coal (RX:6,6,18,18; TX:20,20,80,80)
...
Sep  3 14:19:54 m kernel: Trying to mount root from ufs:/dev/da0s1a
Sep  3 14:19:57 m kernel: bce0:
Sep  3 14:19:57 m kernel: bce0: link state changed to UP
Sep  3 14:19:57 m kernel: Gigabit link up!
Sep  3 14:19:57 m kernel: bce0: Gigabit link up!
Sep  3 14:19:58 m kernel: bce1:
Sep  3 14:19:58 m kernel: bce1: link state changed to UP
Sep  3 14:19:58 m kernel: Gigabit link up!
Sep  3 14:19:58 m kernel: bce1: Gigabit link up!
Sep  3 14:20:01 m kernel: bce1: Gigabit link up!
Sep  3 14:20:27 m kernel: bce0: Gigabit link up!
Sep  3 14:24:25 m syslogd: kernel boot file is /boot/kernel/kernel
...


The previous kernel from the middle of May last year (8.2-STABLE):

$sysctl dev.bce.0
dev.bce.0.%desc: HP NC382i DP Multifunction Gigabit Server Adapter (C0)
dev.bce.0.%driver: bce
dev.bce.0.%location: slot=0 function=0
dev.bce.0.%pnpinfo: vendor=0x14e4 device=0x1639 subvendor=0x103c
subdevice=0x7055 class=0x020000
dev.bce.0.%parent: pci2
dev.bce.0.l2fhdr_error_count: 0
dev.bce.0.mbuf_alloc_failed_count: 0
dev.bce.0.mbuf_frag_count: 0
dev.bce.0.dma_map_addr_rx_failed_count: 0
dev.bce.0.dma_map_addr_tx_failed_count: 51
dev.bce.0.unexpected_attention_count: 0
dev.bce.0.stat_IfHcInOctets: 8862469148
dev.bce.0.stat_IfHCInBadOctets: 329986
dev.bce.0.stat_IfHCOutOctets: 89884604332
dev.bce.0.stat_IfHCOutBadOctets: 0
dev.bce.0.stat_IfHCInUcastPkts: 47972963
dev.bce.0.stat_IfHCInMulticastPkts: 0
dev.bce.0.stat_IfHCInBroadcastPkts: 301
dev.bce.0.stat_IfHCOutUcastPkts: 72217877
dev.bce.0.stat_IfHCOutMulticastPkts: 0
dev.bce.0.stat_IfHCOutBroadcastPkts: 45
dev.bce.0.stat_emac_tx_stat_dot3statsinternalmactransmiterrors: 0
dev.bce.0.stat_Dot3StatsCarrierSenseErrors: 0
dev.bce.0.stat_Dot3StatsFCSErrors: 0
dev.bce.0.stat_Dot3StatsAlignmentErrors: 0
dev.bce.0.stat_Dot3StatsSingleCollisionFrames: 0
dev.bce.0.stat_Dot3StatsMultipleCollisionFrames: 0
dev.bce.0.stat_Dot3StatsDeferredTransmissions: 0
dev.bce.0.stat_Dot3StatsExcessiveCollisions: 0
dev.bce.0.stat_Dot3StatsLateCollisions: 0
dev.bce.0.stat_EtherStatsCollisions: 0
dev.bce.0.stat_EtherStatsFragments: 0
dev.bce.0.stat_EtherStatsJabbers: 0
dev.bce.0.stat_EtherStatsUndersizePkts: 0
dev.bce.0.stat_EtherStatsOversizePkts: 0
dev.bce.0.stat_EtherStatsPktsRx64Octets: 28900335
dev.bce.0.stat_EtherStatsPktsRx65Octetsto127Octets: 11130062
dev.bce.0.stat_EtherStatsPktsRx128Octetsto255Octets: 94457
dev.bce.0.stat_EtherStatsPktsRx256Octetsto511Octets: 268122
dev.bce.0.stat_EtherStatsPktsRx512Octetsto1023Octets: 6647988
dev.bce.0.stat_EtherStatsPktsRx1024Octetsto1522Octets: 932300
dev.bce.0.stat_EtherStatsPktsRx1523Octetsto9022Octets: 0
dev.bce.0.stat_EtherStatsPktsTx64Octets: 2695217
dev.bce.0.stat_EtherStatsPktsTx65Octetsto127Octets: 2635924
dev.bce.0.stat_EtherStatsPktsTx128Octetsto255Octets: 2697153
dev.bce.0.stat_EtherStatsPktsTx256Octetsto511Octets: 4127448
dev.bce.0.stat_EtherStatsPktsTx512Octetsto1023Octets: 2505593
dev.bce.0.stat_EtherStatsPktsTx1024Octetsto1522Octets: 57556587
dev.bce.0.stat_EtherStatsPktsTx1523Octetsto9022Octets: 0
dev.bce.0.stat_XonPauseFramesReceived: 0
dev.bce.0.stat_XoffPauseFramesReceived: 0
dev.bce.0.stat_OutXonSent: 0
dev.bce.0.stat_OutXoffSent: 0
dev.bce.0.stat_FlowControlDone: 0
dev.bce.0.stat_MacControlFramesReceived: 0
dev.bce.0.stat_XoffStateEntered: 0
dev.bce.0.stat_IfInFramesL2FilterDiscards: 4331
dev.bce.0.stat_IfInRuleCheckerDiscards: 0
dev.bce.0.stat_IfInFTQDiscards: 0
dev.bce.0.stat_IfInMBUFDiscards: 0
dev.bce.0.stat_IfInRuleCheckerP4Hit: 301
dev.bce.0.stat_CatchupInRuleCheckerDiscards: 0
dev.bce.0.stat_CatchupInFTQDiscards: 0
dev.bce.0.stat_CatchupInMBUFDiscards: 0
dev.bce.0.stat_CatchupInRuleCheckerP4Hit: 0
dev.bce.0.com_no_buffers: 0

$vmstat -i

interrupt                          total       rate
irq1: atkbd0                        2035          0
irq17: atapci0                        35          0
irq22: uhci2 uhci4                 10250          1
cpu0: timer                      4649590        799
irq256: ciss0                    2682286        461
irq257: bce0                    47790473       8221
irq258: bce1                     2746014        472
cpu1: timer                      4646382        799
cpu9: timer                      4646256        799
cpu6: timer                      4646397        799
cpu15: timer                     4646263        799
cpu7: timer                      4646397        799
cpu10: timer                     4646250        799
cpu5: timer                      4646397        799
cpu11: timer                     4646263        799
cpu4: timer                      4646397        799
cpu13: timer                     4646227        799
cpu3: timer                      4646396        799
cpu12: timer                     4646244        799
cpu2: timer                      4646372        799
cpu14: timer                     4646263        799
cpu8: timer                      4646163        799
Total                          127575350      21946

$pciconv -lv
...
bce0@pci0:2:0:0:        class=0x020000 card=0x7055103c chip=0x163914e4
rev=0x20 hdr=0x00
    vendor     = 'Broadcom Corporation'
    device     = 'NetXtreme II Gigabit Ethernet (BCM5709)'
    class      = network
    subclass   = ethernet
bce1@pci0:2:0:1:        class=0x020000 card=0x7055103c chip=0x163914e4
rev=0x20 hdr=0x00
    vendor     = 'Broadcom Corporation'
    device     = 'NetXtreme II Gigabit Ethernet (BCM5709)'
    class      = network
    subclass   = ethernet
bce2@pci0:3:0:0:        class=0x020000 card=0x7055103c chip=0x163914e4
rev=0x20 hdr=0x00
    vendor     = 'Broadcom Corporation'
    device     = 'NetXtreme II Gigabit Ethernet (BCM5709)'
    class      = network
    subclass   = ethernet
bce3@pci0:3:0:1:        class=0x020000 card=0x7055103c chip=0x163914e4
rev=0x20 hdr=0x00
    vendor     = 'Broadcom Corporation'
    device     = 'NetXtreme II Gigabit Ethernet (BCM5709)'
    class      = network
    subclass   = ethernet
...


We had to increase RX_PAGES/TX_PAGES 2 -> 64 to suppress Ierrs shown by
nenstat -ni.


Best Regards



Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?5044BA4D.2010403>