From owner-freebsd-net@FreeBSD.ORG Mon Jan 18 16:16:50 2010 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 64BA91065676 for ; Mon, 18 Jan 2010 16:16:50 +0000 (UTC) (envelope-from cowens@greatbaysoftware.com) Received: from portcityhosting.com (bayringfw.portcityweb.com [64.140.243.92]) by mx1.freebsd.org (Postfix) with ESMTP id 0A6A68FC12 for ; Mon, 18 Jan 2010 16:16:49 +0000 (UTC) Received: from [127.0.0.1] ([173.14.128.81]) by portcityhosting.com with MailEnable ESMTP; Mon, 18 Jan 2010 10:36:48 -0500 X-WatchGuard-Mail-Exception: Allow Message-ID: <4B548107.5050603@greatbaysoftware.com> Date: Mon, 18 Jan 2010 10:40:55 -0500 From: Charles Owens MIME-Version: 1.0 To: freebsd-net@freebsd.org Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit X-WatchGuard-AntiVirus: part scanned. clean action=allow X-ME-Bayesian: 0.000000 Subject: "PHY read timeout" with bce2 & 3 on FreeBSD 8.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 18 Jan 2010 16:16:50 -0000 Hello, I'm working with a system (IBM System x3550 M2) that has four onboard bce(4) NICs. Using FreeBSD 8.0, the first two seem to function fine, but the second two do not, yielding messages like this when a cable is inserted: Jan 12 10:37:19 dmz55 kernel: <2<>N2M>NINM IM INISMI AI S AIIS SAA 22cc2,,c , E2EIcIES,SIAS AA E I00 Jan 12 10:37:19 dmz55 kernel: Jan 12 10:37:19 dmz55 kernel: S0 Jan 12 10:37:19 dmz55 kernel: Jan 12 10:37:19 dmz55 kernel: <<22>>A Jan 12 10:37:19 dmz55 kernel: Jan 12 10:37:19 dmz55 kernel: 0 Jan 12 10:37:28 dmz55 kernel: bce2: /usr/src/sys/dev/bce/if_bce.c(1533): Error: PHY read timeout! phy = 1, reg = 0x0001 What's are the best next steps to take in figuring this out? Thanks in advance for any assistance. Kernel boot log appending below. Charles -- Charles Owens Great Bay Software, Inc. Copyright (c) 1992-2009 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 8.0-RELEASE-p1 #0: Mon Dec 7 08:21:01 EST 2009 muck@dmz55.greatbaysoftware.com:/usr/obj/usr/src/sys/PAE Timecounter "i8254" frequency 1193182 Hz quality 0 CPU: Intel(R) Xeon(R) CPU E5504 @ 2.00GHz (2000.08-MHz 686-class CPU) Origin = "GenuineIntel" Id = 0x106a5 Stepping = 5 Features=0xbfebfbff Features2=0x9ce3bd AMD Features=0x28100000 AMD Features2=0x1 TSC: P-state invariant real memory = 4294967296 (4096 MB) avail memory = 4145225728 (3953 MB) ACPI APIC Table: FreeBSD/SMP: Multiprocessor System Detected: 4 CPUs FreeBSD/SMP: 1 package(s) x 4 core(s) cpu0 (BSP): APIC ID: 0 cpu1 (AP): APIC ID: 2 cpu2 (AP): APIC ID: 4 cpu3 (AP): APIC ID: 6 ACPI Warning: Invalid length for Pm1aControlBlock: 32, using default 16 20090521 tbfadt-707 ioapic0 irqs 0-23 on motherboard ioapic1 irqs 24-47 on motherboard ispfw: registered firmware ispfw: registered firmware ispfw: registered firmware ispfw: registered firmware ispfw: registered firmware ispfw: registered firmware ispfw: registered firmware ispfw: registered firmware ispfw: registered firmware ispfw: registered firmware ispfw: registered firmware ispfw: registered firmware ispfw: registered firmware ispfw: registered firmware kbd1 at kbdmux0 acpi0: on motherboard acpi0: [ITHREAD] acpi0: Power Button (fixed) acpi_hpet0: iomem 0xfed00000-0xfed003ff on acpi0 Timecounter "HPET" frequency 14318180 Hz quality 900 Timecounter "ACPI-fast" frequency 3579545 Hz quality 1000 acpi_timer0: <24-bit timer at 3.579545MHz> port 0x588-0x58b on acpi0 pcib0: port 0xcf8-0xcff on acpi0 pci0: on pcib0 pcib1: irq 28 at device 1.0 on pci0 pci11: on pcib1 bce0: mem 0x96000000-0x97ffffff irq 28 at device 0.0 on pci11 miibus0: on bce0 brgphy0: PHY 1 on miibus0 brgphy0: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT, 1000baseT-FDX, auto bce0: Ethernet address: 00:1a:64:e5:57:64 bce0: [ITHREAD] bce0: ASIC (0x57092003); Rev (C0); Bus (PCIe x2, 5Gbps); B/C (4.6.4); Flags (MSI|MFW); MFW (NCSI 1.0.6) bce1: mem 0x98000000-0x99ffffff irq 40 at device 0.1 on pci11 miibus1: on bce1 brgphy1: PHY 1 on miibus1 brgphy1: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT, 1000baseT-FDX, auto bce1: Ethernet address: 00:1a:64:e5:57:66 bce1: [ITHREAD] bce1: ASIC (0x57092003); Rev (C0); Bus (PCIe x2, 5Gbps); B/C (4.6.4); Flags (MSI|MFW); MFW (NCSI 1.0.6) pcib2: irq 29 at device 2.0 on pci0 pci16: on pcib2 bce2: mem 0x92000000-0x93ffffff irq 29 at device 0.0 on pci16 miibus2: on bce2 brgphy2: PHY 1 on miibus2 brgphy2: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT, 1000baseT-FDX, auto bce2: Ethernet address: 00:21:5e:08:14:68 bce2: [ITHREAD] bce2: ASIC (0x57092003); Rev (C0); Bus (PCIe x2, 5Gbps); B/C (4.6.4); Flags (MSI|MFW); MFW (NCSI 1.0.6) bce3: mem 0x94000000-0x95ffffff irq 41 at device 0.1 on pci16 miibus3: on bce3 brgphy3: PHY 1 on miibus3 brgphy3: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT, 1000baseT-FDX, auto bce3: Ethernet address: 00:21:5e:08:14:6a bce3: [ITHREAD] bce3: ASIC (0x57092003); Rev (C0); Bus (PCIe x2, 5Gbps); B/C (4.6.4); Flags (MSI|MFW); MFW (NCSI 1.0.6) pcib3: irq 24 at device 3.0 on pci0 pci21: on pcib3 pcib4: irq 30 at device 7.0 on pci0 pci26: on pcib4 pci0: at device 16.0 (no driver attached) pci0: at device 16.1 (no driver attached) pci0: at device 17.0 (no driver attached) pci0: at device 17.1 (no driver attached) pci0: at device 20.0 (no driver attached) pci0: at device 20.1 (no driver attached) pci0: at device 20.2 (no driver attached) pci0: at device 20.3 (no driver attached) pci0: at device 22.0 (no driver attached) pci0: at device 22.1 (no driver attached) pci0: at device 22.2 (no driver attached) pci0: at device 22.3 (no driver attached) pci0: at device 22.4 (no driver attached) pci0: at device 22.5 (no driver attached) pci0: at device 22.6 (no driver attached) pci0: at device 22.7 (no driver attached) uhci0: port 0x20a0-0x20bf irq 17 at device 26.0 on pci0 uhci0: [ITHREAD] usbus0: on uhci0 uhci1: port 0x2080-0x209f irq 18 at device 26.1 on pci0 uhci1: [ITHREAD] usbus1: on uhci1 ehci0: mem 0x9ba21400-0x9ba217ff irq 19 at device 26.7 on pci0 ehci0: [ITHREAD] usbus2: EHCI version 1.0 usbus2: on ehci0 pcib5: irq 16 at device 28.0 on pci0 pci1: on pcib5 mpt0: port 0x1000-0x10ff mem 0x9b910000-0x9b913fff,0x9b900000-0x9b90ffff irq 16 at device 0.0 on pci1 mpt0: [ITHREAD] mpt0: MPI Version=1.5.20.0 mpt0: Capabilities: ( RAID-0 RAID-1E RAID-1 ) mpt0: 0 Active Volumes (2 Max) mpt0: 0 Hidden Drive Members (14 Max) pcib6: irq 16 at device 28.4 on pci0 pci6: on pcib6 pcib7: irq 16 at device 0.0 on pci6 pci7: on pcib7 vgapci0: mem 0x9a000000-0x9affffff,0x9b800000-0x9b803fff,0x9b000000-0x9b7fffff irq 16 at device 0.0 on pci7 uhci2: port 0x2060-0x207f irq 17 at device 29.0 on pci0 uhci2: [ITHREAD] usbus3: on uhci2 uhci3: port 0x2040-0x205f irq 18 at device 29.1 on pci0 uhci3: [ITHREAD] usbus4: on uhci3 uhci4: port 0x2020-0x203f irq 19 at device 29.2 on pci0 uhci4: [ITHREAD] usbus5: on uhci4 ehci1: mem 0x9ba21000-0x9ba213ff irq 17 at device 29.7 on pci0 ehci1: [ITHREAD] usbus6: EHCI version 1.0 usbus6: on ehci1 pcib8: at device 30.0 on pci0 pci31: on pcib8 isab0: at device 31.0 on pci0 isa0: on isab0 atapci0: port 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0x20f0-0x20ff,0x20e0-0x20ef irq 16 at device 31.2 on pci0 ata0: on atapci0 ata0: [ITHREAD] ata1: on atapci0 ata1: [ITHREAD] pci0: at device 31.3 (no driver attached) atapci1: port 0x2108-0x210f,0x2124-0x2127,0x2100-0x2107,0x2120-0x2123,0x20d0-0x20df,0x20c0-0x20cf irq 21 at device 31.5 on pci0 atapci1: [ITHREAD] ata2: on atapci1 ata2: [ITHREAD] ata3: on atapci1 ata3: [ITHREAD] atrtc0: port 0x70-0x77 irq 8 on acpi0 atrtc0: Warning: Couldn't map I/O. uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0 uart0: [FILTER] uart1: <16550 or compatible> port 0x2f8-0x2ff irq 3 on acpi0 uart1: [FILTER] cpu0: on acpi0 est0: on cpu0 p4tcc0: on cpu0 cpu1: on acpi0 est1: on cpu1 p4tcc1: on cpu1 cpu2: on acpi0 est2: on cpu2 p4tcc2: on cpu2 cpu3: on acpi0 est3: on cpu3 p4tcc3: on cpu3 pmtimer0 on isa0 orm0: at iomem 0xc0000-0xc7fff pnpid ORM0000 on isa0 sc0: at flags 0x100 on isa0 sc0: VGA <16 virtual consoles, flags=0x300> vga0: at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0 atkbdc0: at port 0x60,0x64 on isa0 atkbd0: irq 1 on atkbdc0 kbd0 at atkbd0 atkbd0: [GIANT-LOCKED] atkbd0: [ITHREAD] ppc0: parallel port not found. Timecounters tick every 1.000 msec usbus0: 12Mbps Full Speed USB v1.0 usbus1: 12Mbps Full Speed USB v1.0 usbus2: 480Mbps High Speed USB v2.0 usbus3: 12Mbps Full Speed USB v1.0 usbus4: 12Mbps Full Speed USB v1.0 usbus5: 12Mbps Full Speed USB v1.0 usbus6: 480Mbps High Speed USB v2.0 ugen0.1: at usbus0 uhub0: on usbus0 ugen1.1: at usbus1 uhub1: on usbus1 ugen2.1: at usbus2 uhub2: on usbus2 ugen3.1: at usbus3 uhub3: on usbus3 ugen4.1: at usbus4 uhub4: on usbus4 ugen5.1: at usbus5 uhub5: on usbus5 ugen6.1: at usbus6 uhub6: on usbus6 uhub0: 2 ports with 2 removable, self powered uhub1: 2 ports with 2 removable, self powered uhub3: 2 ports with 2 removable, self powered uhub4: 2 ports with 2 removable, self powered uhub5: 2 ports with 2 removable, self powered acd0: CDRW at ata0-master SATA150 da0 at mpt0 bus 0 target 1 lun 0 da0: Fixed Direct Access SCSI-5 device da0: 300.000MB/s transfers da0: Command Queueing enabled da0: 286102MB (585937500 512 byte sectors: 255H 63S/T 36472C) da1 at mpt0 bus 0 target 2 lun 0 da1: Fixed Direct Access SCSI-5 device da1: 300.000MB/s transfers da1: Command Queueing enabled da1: 286102MB (585937500 512 byte sectors: 255H 63S/T 36472C) SMP: AP CPU #2 Launched! SMP: AP CPU #1 Launched! SMP: AP CPU #3 Launched! Root mount waiting for: usbus6 usbus2 uhub2: 6 ports with 6 removable, self powered uhub6: 6 ports with 6 removable, self powered ugen6.2: at usbus6 ukbd0: on usbus6 kbd2 at ukbd0 ums0: on usbus6 ums0: 3 buttons and [Z] coordinates ID=0 ums1: on usbus6 ums1: 3 buttons and [XYZ] coordinates ID=0 umass0: on usbus6 umass0: 8070i (ATAPI) over Bulk-Only; quirks = 0x0000 Root mount waiting for: usbus6 umass0:2:0:-1: Attached to scbus2 umass1: on usbus6 umass1: SCSI over Bulk-Only; quirks = 0x0000 Root mount waiting for: usbus6 (probe0:umass-sim0:0:0:0): TEST UNIT READY. CDB: 0 0 0 0 0 0 (probe0:umass-sim0:0:0:0): CAM Status: SCSI Status Error (probe0:umass-sim0:0:0:0): SCSI Status: Check Condition (probe0:umass-sim0:0:0:0): UNIT ATTENTION asc:29,0 (probe0:umass-sim0:0:0:0): Power on, reset, or bus device reset occurred (probe0:umass-sim0:0:0:0): Retrying Command (per Sense Data) umass1:3:1:-1: Attached to scbus3 Root mount waiting for: usbus6 (probe0:umass-sim0:0:0:0): TEST UNIT READY. CDB: 0 0 0 0 0 0 (probe0:umass-sim0:0:0:0): CAM Status: SCSI Status Error (probe0:umass-sim0:0:0:0): SCSI Status: Check Condition (probe0:umass-sim0:0:0:0): NOT READY asc:3a,0 (probe0:umass-sim0:0:0:0): Medium not present (probe0:umass-sim0:0:0:0): Unretryable error cd0 at umass-sim0 bus 0 target 0 lun 0 cd0: Removable CD-ROM SCSI-0 device cd0: 40.000MB/s transfers cd0: Attempt to query device size failed: NOT READY, Medium not present (probe1:umass-sim1:1:0:0): TEST UNIT READY. CDB: 0 0 0 0 0 0 (probe1:umass-sim1:1:0:0): CAM Status: SCSI Status Error (probe1:umass-sim1:1:0:0): SCSI Status: Check Condition (probe1:umass-sim1:1:0:0): UNIT ATTENTION asc:29,0 (probe1:umass-sim1:1:0:0): Power on, reset, or bus device reset occurred (probe1:umass-sim1:1:0:0): Retrying Command (per Sense Data) (probe1:umass-sim1:1:0:0): TEST UNIT READY. CDB: 0 0 0 0 0 0 (probe1:umass-sim1:1:0:0): CAM Status: SCSI Status Error (probe1:umass-sim1:1:0:0): SCSI Status: Check Condition (probe1:umass-sim1:1:0:0): NOT READY asc:3a,0 (probe1:umass-sim1:1:0:0): Medium not present (probe1:umass-sim1:1:0:0): Unretryable error da2 at umass-sim1 bus 1 target 0 lun 0 da2: Removable Direct Access SCSI-0 device da2: 40.000MB/s transfers da2: Attempt to query device size failed: NOT READY, Medium not present ugen3.2: at usbus3 Trying to mount root from ufs:/dev/da0s1a WARNING: / was not properly dismounted (probe0:umass-sim1:1:0:1): TEST UNIT READY. CDB: 0 20 0 0 0 0 (probe0:umass-sim1:1:0:1): CAM Status: SCSI Status Error (probe0:umass-sim1:1:0:1): SCSI Status: Check Condition (probe0:umass-sim1:1:0:1): UNIT ATTENTION asc:29,0 (probe0:umass-sim1:1:0:1): Power on, reset, or bus device reset occurred (probe0:umass-sim1:1:0:1): Retrying Command (per Sense Data) ugen5.2: at usbus5 uhub7: on usbus5 (probe0:umass-sim1:1:0:1): TEST UNIT READY. CDB: 0 20 0 0 0 0 (probe0:umass-sim1:1:0:1): CAM Status: SCSI Status Error (probe0:umass-sim1:1:0:1): SCSI Status: Check Condition (probe0:umass-sim1:1:0:1): NOT READY asc:3a,0 (probe0:umass-sim1:1:0:1): Medium not present (probe0:umass-sim1:1:0:1): Unretryable error da3 at umass-sim1 bus 1 target 0 lun 1 da3: Removable Direct Access SCSI-0 device da3: 40.000MB/s transfers da3: Attempt to query device size failed: NOT READY, Medium not present uhub7: 4 ports with 4 removable, self powered ugen5.3: at usbus5 ukbd1: on usbus5 (probe1:umass-sim1:1:0:0): CAM Status: SCSI Status Error (probe1:umass-sim1:1:0:0): SCSI Status: Check Condition (probe1:umass-sim1:1:0:0): UNIT ATTENTION asc:29,0 (probe1:umass-sim1:1:0:0): Power on, reset, or bus device reset occurred (probe1:umass-sim1:1:0:0): Retrying Command (per Sense Data) (probe1:umass-sim1:1:0:0): TEST UNIT READY. CDB: 0 0 0 0 0 0 (probe1:umass-sim1:1:0:0): CAM Status: SCSI Status Error (probe1:umass-sim1:1:0:0): SCSI Status: Check Condition (probe1:umass-sim1:1:0:0): NOT READY asc:3a,0 (probe1:umass-sim1:1:0:0): Medium not present (probe1:umass-sim1:1:0:0): Unretryable error da2 at umass-sim1 bus 1 target 0 lun 0 da2: Removable Direct Access SCSI-0 device da2: 40.000MB/s transfers da2: Attempt to query device size failed: NOT READY, Medium not present ugen3.2: at usbus3 Trying to mount root from ufs:/dev/da0s1a WARNING: / was not properly dismounted (probe0:umass-sim1:1:0:1): TEST UNIT READY. CDB: 0 20 0 0 0 0 (probe0:umass-sim1:1:0:1): CAM Status: SCSI Status Error (probe0:umass-sim1:1:0:1): SCSI Status: Check Condition (probe0:umass-sim1:1:0:1): UNIT ATTENTION asc:29,0 (probe0:umass-sim1:1:0:1): Power on, reset, or bus device reset occurred (probe0:umass-sim1:1:0:1): Retrying Command (per Sense Data) ugen5.2: at usbus5 uhub7: on usbus5 (probe0:umass-sim1:1:0:1): TEST UNIT READY. CDB: 0 20 0 0 0 0 (probe0:umass-sim1:1:0:1): CAM Status: SCSI Status Error (probe0:umass-sim1:1:0:1): SCSI Status: Check Condition (probe0:umass-sim1:1:0:1): NOT READY asc:3a,0 (probe0:umass-sim1:1:0:1): Medium not present (probe0:umass-sim1:1:0:1): Unretryable error da3 at umass-sim1 bus 1 target 0 lun 1 da3: Removable Direct Access SCSI-0 device da3: 40.000MB/s transfers da3: Attempt to query device size failed: NOT READY, Medium not present uhub7: 4 ports with 4 removable, self powered ugen5.3: at usbus5 ukbd1: on usbus5 kbd3 at ukbd1 uhid0: on usbus5 ums2: on usbus5 ums2: 5 buttons and [XYZ] coordinates ID=0 ums3: on usbus5 ums3: 3 buttons and [Z] coordinates ID=0