From owner-freebsd-bugs@FreeBSD.ORG Tue Apr 8 02:30:05 2008 Return-Path: Delivered-To: freebsd-bugs@hub.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 5F0481065677 for ; Tue, 8 Apr 2008 02:30:05 +0000 (UTC) (envelope-from gnats@FreeBSD.org) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2001:4f8:fff6::28]) by mx1.freebsd.org (Postfix) with ESMTP id 24A668FC26 for ; Tue, 8 Apr 2008 02:30:05 +0000 (UTC) (envelope-from gnats@FreeBSD.org) Received: from freefall.freebsd.org (gnats@localhost [127.0.0.1]) by freefall.freebsd.org (8.14.2/8.14.2) with ESMTP id m382U5OF028271 for ; Tue, 8 Apr 2008 02:30:05 GMT (envelope-from gnats@freefall.freebsd.org) Received: (from gnats@localhost) by freefall.freebsd.org (8.14.2/8.14.1/Submit) id m382U5lY028264; Tue, 8 Apr 2008 02:30:05 GMT (envelope-from gnats) Resent-Date: Tue, 8 Apr 2008 02:30:05 GMT Resent-Message-Id: <200804080230.m382U5lY028264@freefall.freebsd.org> Resent-From: FreeBSD-gnats-submit@FreeBSD.org (GNATS Filer) Resent-To: freebsd-bugs@FreeBSD.org Resent-Reply-To: FreeBSD-gnats-submit@FreeBSD.org, Greg Himes Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 9195F106566B for ; Tue, 8 Apr 2008 02:24:50 +0000 (UTC) (envelope-from nobody@FreeBSD.org) Received: from www.freebsd.org (www.freebsd.org [IPv6:2001:4f8:fff6::21]) by mx1.freebsd.org (Postfix) with ESMTP id 7ED628FC18 for ; Tue, 8 Apr 2008 02:24:50 +0000 (UTC) (envelope-from nobody@FreeBSD.org) Received: from www.freebsd.org (localhost [127.0.0.1]) by www.freebsd.org (8.14.2/8.14.2) with ESMTP id m382OZZx090708 for ; Tue, 8 Apr 2008 02:24:35 GMT (envelope-from nobody@www.freebsd.org) Received: (from nobody@localhost) by www.freebsd.org (8.14.2/8.14.1/Submit) id m382OZq5090707; Tue, 8 Apr 2008 02:24:35 GMT (envelope-from nobody) Message-Id: <200804080224.m382OZq5090707@www.freebsd.org> Date: Tue, 8 Apr 2008 02:24:35 GMT From: Greg Himes To: freebsd-gnats-submit@FreeBSD.org X-Send-Pr-Version: www-3.1 Cc: Subject: kern/122551: [bge] Broadcom 5715S no carrier on HP BL460c blade using 6.3-RELEASE X-BeenThere: freebsd-bugs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Bug reports List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 08 Apr 2008 02:30:05 -0000 >Number: 122551 >Category: kern >Synopsis: [bge] Broadcom 5715S no carrier on HP BL460c blade using 6.3-RELEASE >Confidential: no >Severity: serious >Priority: medium >Responsible: freebsd-bugs >State: open >Quarter: >Keywords: >Date-Required: >Class: sw-bug >Submitter-Id: current-users >Arrival-Date: Tue Apr 08 02:30:04 UTC 2008 >Closed-Date: >Last-Modified: >Originator: Greg Himes >Release: 6.3-RELEASE >Organization: CHL Design Group >Environment: FreeBSD mail2.laaco.net 6.3-RELEASE FreeBSD 6.3-RELEASE #10: Mon Apr 7 18:19:40 PDT 2008 greg@mail2.laaco.net:/usr/obj/usr/src/sys/LAACO i386 >Description: This problem appears to be similar to earlier bge problems on IBM blades. System is an HP c-Class blade chassis using BL460c blades. Each blade has a dual bce (Broadcom NetXtreme II BCM5708S) interface on-board, along with an add-on HP NC326m mezzanine board which appears as dual bge (Broadcom NetXtreme 5715S) interfaces. Both pairs of interfaces connect to HP Virtual Connect Modules to bring the connections out of the back of the chassis. The bce interfaces work fine, but the bge interfaces show "no carrier", as shown here in the ifconfig output: # ifconfig bce0: flags=8843 mtu 1500 options=3b ether 00:17:a4:77:00:06 media: Ethernet autoselect (1000baseSX ) status: active bce1: flags=8843 mtu 1500 options=3b ether 00:17:a4:77:00:06 media: Ethernet autoselect (1000baseSX ) status: active bge0: flags=8843 mtu 1500 options=1b ether 00:17:a4:77:00:24 media: Ethernet autoselect (none) status: no carrier bge1: flags=8843 mtu 1500 options=1b ether 00:17:a4:77:00:26 media: Ethernet autoselect (none) status: no carrier Here is the dmesg info: FreeBSD 6.3-RELEASE #10: Mon Apr 7 18:19:40 PDT 2008 greg@mail2.laaco.net:/usr/obj/usr/src/sys/LAACO module_register: module pci/bce already exists! Module pci/bce failed to register: 17 module_register: module bce/miibus already exists! Module bce/miibus failed to register: 17 Timecounter "i8254" frequency 1193182 Hz quality 0 CPU: Intel(R) Xeon(R) CPU 5160 @ 3.00GHz (3000.12-MHz 686-class CPU) Origin = "GenuineIntel" Id = 0x6f6 Stepping = 6 Features=0xbfebfbff Features2=0x4e3bd AMD Features=0x20000000 AMD Features2=0x1 Cores per package: 2 real memory = 3487916032 (3326 MB) avail memory = 3408941056 (3251 MB) ACPI APIC Table: FreeBSD/SMP: Multiprocessor System Detected: 4 CPUs cpu0 (BSP): APIC ID: 0 cpu1 (AP): APIC ID: 1 cpu2 (AP): APIC ID: 6 cpu3 (AP): APIC ID: 7 ioapic0 irqs 0-23 on motherboard kbd1 at kbdmux0 ath_hal: 0.9.20.3 (AR5210, AR5211, AR5212, RF5111, RF5112, RF2413, RF5413) hptrr: HPT RocketRAID controller driver v1.1 (Apr 7 2008 18:19:28) acpi0: on motherboard acpi0: Power Button (fixed) Timecounter "ACPI-fast" frequency 3579545 Hz quality 1000 acpi_timer0: <24-bit timer at 3.579545MHz> port 0x908-0x90b on acpi0 acpi_hpet0: iomem 0xfed00000-0xfed003ff on acpi0 Timecounter "HPET" frequency 14318180 Hz quality 900 cpu0: on acpi0 cpu1: on acpi0 cpu2: on acpi0 cpu3: on acpi0 pcib0: on acpi0 pci0: on pcib0 pcib1: at device 2.0 on pci0 pci4: on pcib1 pcib2: at device 0.0 on pci4 pci5: on pcib2 pcib3: at device 0.0 on pci5 pci6: on pcib3 pcib4: at device 0.0 on pci6 pci7: on pcib4 bce0: mem 0xfa000000-0xfbffffff irq 16 at device 0.0 on pci7 miibus0: on bce0 brgphy0: on miibus0 brgphy0: 1000baseSX-FDX, auto bce0: Ethernet address: 00:17:a4:77:00:0a bce0: ASIC (0x57081021); Rev (B2); Bus (PCI-X, 64-bit, 133MHz); F/W (0x01090605); Flags( ) pcib5: at device 1.0 on pci5 pci8: on pcib5 pcib6: at device 0.3 on pci4 pci9: on pcib6 pcib7: at device 3.0 on pci0 pci10: on pcib7 pcib8: at device 0.0 on pci10 pci11: on pcib8 pcib9: at device 4.0 on pci11 pci12: on pcib9 ciss0: port 0x4000-0x40ff mem 0xfdb80000-0xfdbfffff,0xfdb70000-0xfdb77fff irq 18 at device 8.0 on pci11 ciss0: [GIANT-LOCKED] pcib10: at device 4.0 on pci0 pci13: on pcib10 ciss1: port 0x5000-0x50ff mem 0xfdd00000-0xfddfffff,0xfdcf0000-0xfdcf0fff irq 19 at device 0.0 on pci13 ciss1: [GIANT-LOCKED] pcib11: at device 5.0 on pci0 pci16: on pcib11 pcib12: at device 0.0 on pci16 pci17: on pcib12 bge0: mem 0xfdef0000-0xfdefffff,0xfdee0000-0xfdeeffff irq 18 at device 4.0 on pci17 bge0: Ethernet address: 00:17:a4:77:00:24 bge1: mem 0xfded0000-0xfdedffff,0xfdec0000-0xfdecffff irq 19 at device 4.1 on pci17 bge1: Ethernet address: 00:17:a4:77:00:26 pcib13: at device 6.0 on pci0 pci19: on pcib13 isp0: port 0x6000-0x60ff mem 0xfdff0000-0xfdff3fff irq 19 at device 0.0 on pci19 isp0: [GIANT-LOCKED] isp0: Board Type 2422, Chip Revision 0x2, resident F/W Revision 4.0.70 isp1: port 0x6400-0x64ff mem 0xfdfe0000-0xfdfe3fff irq 16 at device 0.1 on pci19 isp1: [GIANT-LOCKED] isp1: Board Type 2422, Chip Revision 0x2, resident F/W Revision 4.0.70 pcib14: at device 7.0 on pci0 pci22: on pcib14 pcib15: at device 28.0 on pci0 pci2: on pcib15 pcib16: at device 0.0 on pci2 pci3: on pcib16 bce1: mem 0xf6000000-0xf7ffffff irq 16 at device 0.0 on pci3 miibus1: on bce1 brgphy1: on miibus1 brgphy1: 1000baseSX-FDX, auto bce1: Ethernet address: 00:17:a4:77:00:08 bce1: ASIC (0x57081021); Rev (B2); Bus (PCI-X, 64-bit, 133MHz); F/W (0x01090605); Flags( ) Timecounters tick every 1.000 msec SMP: AP CPU #1 Launched! SMP: AP CPU #2 Launched! SMP: AP CPU #3 Launched! Here is selected pciconf -lv output: # pciconf -lv pcib4@pci6:0:0: class=0x060400 card=0x00000000 chip=0x01031166 rev=0xc3 hdr=0x01 vendor = 'ServerWorks (Was: Reliance Computer Corp)' device = 'BCM5715 Broadcom dual gigabit, pci bridge' class = bridge subclass = PCI-PCI bce0@pci7:0:0: class=0x020000 card=0x703b103c chip=0x16ac14e4 rev=0x12 hdr=0x00 vendor = 'Broadcom Corporation' device = 'NetXtreme II BCM5708S Gigabit Ethernet' class = network subclass = ethernet pcib8@pci10:0:0: class=0x060400 card=0x00000000 chip=0x01031166 rev=0xb4 hdr=0x01 vendor = 'ServerWorks (Was: Reliance Computer Corp)' device = 'BCM5715 Broadcom dual gigabit, pci bridge' class = bridge subclass = PCI-PCI pcib12@pci16:0:0: class=0x060400 card=0x00000000 chip=0x01031166 rev=0xb5 hdr=0x01 vendor = 'ServerWorks (Was: Reliance Computer Corp)' device = 'BCM5715 Broadcom dual gigabit, pci bridge' class = bridge subclass = PCI-PCI bge0@pci17:4:0: class=0x020000 card=0x1707103c chip=0x167914e4 rev=0xa3 hdr=0x00 vendor = 'Broadcom Corporation' device = 'NetXtreme 5715S Gigabit Ethernet' class = network subclass = ethernet bge1@pci17:4:1: class=0x020000 card=0x1707103c chip=0x167914e4 rev=0xa3 hdr=0x00 vendor = 'Broadcom Corporation' device = 'NetXtreme 5715S Gigabit Ethernet' class = network subclass = ethernet pcib16@pci2:0:0: class=0x060400 card=0x00000000 chip=0x01031166 rev=0xc3 hdr=0x01 vendor = 'ServerWorks (Was: Reliance Computer Corp)' device = 'BCM5715 Broadcom dual gigabit, pci bridge' class = bridge subclass = PCI-PCI bce1@pci3:0:0: class=0x020000 card=0x703b103c chip=0x16ac14e4 rev=0x12 hdr=0x00 vendor = 'Broadcom Corporation' device = 'NetXtreme II BCM5708S Gigabit Ethernet' class = network subclass = ethernet Had same results with HP's 1Gb ethernet pass-thru modules. Have tried manually setting the interfaces with ifconfig to 1000baseSX full-duplex, but still no carrier. bge0: flags=8843 mtu 1500 options=1b ether 00:17:a4:77:00:24 media: Ethernet 1000baseSX (none) status: no carrier >How-To-Repeat: Install HP NC326m mezzanine board on BL460c blade. Boot 6.3-RELEASE. Verify status:no carrier with ifconfig >Fix: >Release-Note: >Audit-Trail: >Unformatted: