From owner-freebsd-net@FreeBSD.ORG Thu Oct 25 08:06:43 2012 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 920FD6DB for ; Thu, 25 Oct 2012 08:06:43 +0000 (UTC) (envelope-from remi.pauchet@netasq.com) Received: from work.netasq.com (gwlille.netasq.com [91.212.116.1]) by mx1.freebsd.org (Postfix) with ESMTP id D81A58FC1C for ; Thu, 25 Oct 2012 08:06:42 +0000 (UTC) Received: from [10.2.9.2] (unknown [91.212.116.2]) by work.netasq.com (Postfix) with ESMTPSA id E572227054D6 for ; Thu, 25 Oct 2012 10:06:40 +0200 (CEST) From: =?iso-8859-1?Q?R=E9mi_Pauchet?= Content-Type: multipart/signed; boundary="Apple-Mail=_2CDDC20C-82C3-41DC-9607-42B13FA6F0F1"; protocol="application/pkcs7-signature"; micalg=sha1 Subject: panic ixgbevf / SMP under high network load Date: Thu, 25 Oct 2012 10:06:40 +0200 Message-Id: To: freebsd-net@freebsd.org Mime-Version: 1.0 (Apple Message framework v1283) X-Mailer: Apple Mail (2.1283) X-Content-Filtered-By: Mailman/MimeDel 2.1.14 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 25 Oct 2012 08:06:43 -0000 --Apple-Mail=_2CDDC20C-82C3-41DC-9607-42B13FA6F0F1 Content-Type: multipart/mixed; boundary="Apple-Mail=_E43D5A19-1FB8-4DA3-AD2B-AF15B1B08D3C" --Apple-Mail=_E43D5A19-1FB8-4DA3-AD2B-AF15B1B08D3C Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=iso-8859-1 Hi I'm testing network performance of FreeBSD using vmware esxi 5.1 with = SR-IOV I'm using FreeBSD 8.3 kernel GENERIC, 4 cpus, ixgbevf driver with an = Intel 82599EB dual 10 Gbps network interface After a few seconds of udp ipv4 load (5Gbps x2, frame size 700), I have = the following panic : (kgdb) bt #0 doadump () at pcpu.h:224 #1 0xffffffff8060ab90 in boot (howto=3D260) at = /usr/src/sys/kern/kern_shutdown.c:441 #2 0xffffffff8060b031 in panic (fmt=3DVariable "fmt" is not available. ) at /usr/src/sys/kern/kern_shutdown.c:614 #3 0xffffffff80900b80 in trap_fatal (frame=3D0xc, eva=3DVariable "eva" = is not available. ) at /usr/src/sys/amd64/amd64/trap.c:825 #4 0xffffffff80900ed1 in trap_pfault (frame=3D0xffffff800016a620, = usermode=3D0) at /usr/src/sys/amd64/amd64/trap.c:741 #5 0xffffffff8090138f in trap (frame=3D0xffffff800016a620) at = /usr/src/sys/amd64/amd64/trap.c:478 #6 0xffffffff808e88e4 in calltrap () at = /usr/src/sys/amd64/amd64/exception.S:228 #7 0xffffffff80667ef7 in m_copym (m=3D0x0, off0=3D1500, len=3D1480, = wait=3D1) at /usr/src/sys/kern/uipc_mbuf.c:542 #8 0xffffffff8071c8c2 in ip_fragment (ip=3D0xffffff0001a3700e, = m_frag=3D0xffffff800016a838, mtu=3DVariable "mtu" is not available. ) at /usr/src/sys/netinet/ip_output.c:819 #9 0xffffffff8071d93a in ip_output (m=3D0xffffff00019fd900, = opt=3DVariable "opt" is not available. ) at /usr/src/sys/netinet/ip_output.c:650 #10 0xffffffff8071a13a in ip_forward (m=3D0xffffff00019fd900, = srcrt=3DVariable "srcrt" is not available. ) at /usr/src/sys/netinet/ip_input.c:1521 #11 0xffffffff8071b77c in ip_input (m=3D0xffffff00019fd900) at = /usr/src/sys/netinet/ip_input.c:729 #12 0xffffffff806c652e in netisr_dispatch_src (proto=3D1, = source=3DVariable "source" is not available. ) at /usr/src/sys/net/netisr.c:859 #13 0xffffffff806bc5cd in ether_demux (ifp=3D0xffffff000168e800, = m=3D0xffffff00019fd900) at /usr/src/sys/net/if_ethersubr.c:896 #14 0xffffffff806bc9d7 in ether_input (ifp=3D0xffffff000168e800, = m=3D0xffffff00019fd900) at /usr/src/sys/net/if_ethersubr.c:755 #15 0xffffffff803ee03e in ixv_rxeof (que=3D0xffffff0001643880, = count=3D117) at /usr/src/sys/dev/ixgbe/ixv.c:3256 #16 0xffffffff803ef50b in ixv_handle_que (context=3DVariable "context" = is not available. ) at /usr/src/sys/dev/ixgbe/ixv.c:983 #17 0xffffffff806496d5 in taskqueue_run_locked = (queue=3D0xffffff0001698200) at /usr/src/sys/kern/subr_taskqueue.c:250 #18 0xffffffff8064986e in taskqueue_thread_loop (arg=3DVariable "arg" is = not available. ) at /usr/src/sys/kern/subr_taskqueue.c:387 #19 0xffffffff805dfc9f in fork_exit (callout=3D0xffffffff80649820 = , arg=3D0xffffff00016438d8, = frame=3D0xffffff800016ac50) at /usr/src/sys/kern/kern_fork.c:876 #20 0xffffffff808e8e2e in fork_trampoline () at = /usr/src/sys/amd64/amd64/exception.S:602 I have no issue with only one cpu (but low network performance) Please find the dmesg in attachment Regards, R=E9mi Pauchet --Apple-Mail=_E43D5A19-1FB8-4DA3-AD2B-AF15B1B08D3C Content-Disposition: attachment; filename=dmesg.txt Content-Type: text/plain; x-unix-mode=0644; name="dmesg.txt" Content-Transfer-Encoding: quoted-printable Copyright (c) 1992-2012 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights = reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 8.3-RELEASE #0: Fri Oct 5 11:38:23 CEST 2012 root@bsd:/usr/obj/usr/src/sys/GENERIC amd64 Timecounter "i8254" frequency 1193182 Hz quality 0 CPU: Intel(R) Xeon(R) CPU W3680 @ 3.33GHz (3324.21-MHz = K8-class CPU) Origin =3D "GenuineIntel" Id =3D 0x206c2 Family =3D 6 Model =3D 2c = Stepping =3D 2 = Features=3D0xfa3fbff = Features2=3D0x82982203 AMD Features=3D0x28100800 AMD Features2=3D0x1 TSC: P-state invariant real memory =3D 1073741824 (1024 MB) avail memory =3D 1016238080 (969 MB) ACPI APIC Table: FreeBSD/SMP: Multiprocessor System Detected: 4 CPUs FreeBSD/SMP: 4 package(s) x 1 core(s) cpu0 (BSP): APIC ID: 0 cpu1 (AP): APIC ID: 1 cpu2 (AP): APIC ID: 2 cpu3 (AP): APIC ID: 3 MADT: Forcing active-low polarity and level trigger for SCI ioapic0 irqs 0-23 on motherboard kbd1 at kbdmux0 acpi0: on motherboard acpi0: [ITHREAD] acpi0: Power Button (fixed) acpi_hpet0: iomem 0xfed00000-0xfed003ff on = acpi0 Timecounter "HPET" frequency 14318180 Hz quality 900 Timecounter "ACPI-safe" frequency 3579545 Hz quality 850 acpi_timer0: <24-bit timer at 3.579545MHz> port 0x1008-0x100b on acpi0 cpu0: on acpi0 cpu1: on acpi0 cpu2: on acpi0 cpu3: on acpi0 pcib0: port 0xcf8-0xcff on acpi0 pci0: on pcib0 ixgbe_probe: begin ixgbe_probe: begin pcib1: at device 1.0 on pci0 pci1: on pcib1 ixgbe_probe: begin isab0: at device 7.0 on pci0 isa0: on isab0 ixgbe_probe: begin atapci0: port = 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0x10c0-0x10cf at device 7.1 on pci0 ata0: at channel 0 on atapci0 ata0: [ITHREAD] ata1: at channel 1 on atapci0 ata1: [ITHREAD] ixgbe_probe: begin pci0: at device 7.3 (no driver attached) ixgbe_probe: begin pci0: at device 7.7 (no driver attached) ixgbe_probe: begin vgapci0: port 0x10d0-0x10df mem = 0xd8000000-0xdbffffff,0xd0800000-0xd0ffffff irq 16 at device 15.0 on = pci0 ixgbe_probe: begin mpt0: port 0x1400-0x14ff mem = 0xd0040000-0xd005ffff,0xd0020000-0xd003ffff irq 17 at device 16.0 on = pci0 mpt0: [ITHREAD] mpt0: MPI Version=3D1.2.0.0 ixgbe_probe: begin pcib2: at device 17.0 on pci0 pci2: on pcib2 ixgbe_probe: begin em0: port = 0x2000-0x203f mem 0xd1020000-0xd103ffff,0xd1000000-0xd100ffff irq 18 at = device 0.0 on pci2 em0: Memory Access and/or Bus Master bits were not set! em0: [FILTER] em0: Ethernet address: 00:0c:29:5b:2a:ab ixgbe_probe: begin pcib3: at device 21.0 on pci0 pci3: on pcib3 ixgbe_probe: begin ix0: mem 0xd2404000-0xd2407fff,0xd2400000-0xd2403fff at device 0.0 on = pci3 ix0: Using MSIX interrupts with 2 vectors ix0: [ITHREAD] ix0: [ITHREAD] ix0: Ethernet address: 00:0c:29:5b:2a:10 ixgbe_probe: begin pcib4: at device 21.1 on pci0 pci4: on pcib4 ixgbe_probe: begin pcib5: at device 21.2 on pci0 pci5: on pcib5 ixgbe_probe: begin pcib6: at device 21.3 on pci0 pci6: on pcib6 ixgbe_probe: begin pcib7: at device 21.4 on pci0 pci7: on pcib7 ixgbe_probe: begin pcib8: at device 21.5 on pci0 pci8: on pcib8 ixgbe_probe: begin pcib9: at device 21.6 on pci0 pci9: on pcib9 ixgbe_probe: begin pcib10: at device 21.7 on pci0 pci10: on pcib10 ixgbe_probe: begin pcib11: at device 22.0 on pci0 pci11: on pcib11 ixgbe_probe: begin ix1: mem 0xd2504000-0xd2507fff,0xd2500000-0xd2503fff at device 0.0 on = pci11 ix1: Using MSIX interrupts with 2 vectors ix1: [ITHREAD] ix1: [ITHREAD] ix1: Ethernet address: 00:0c:29:5b:2a:11 ixgbe_probe: begin pcib12: at device 22.1 on pci0 pci12: on pcib12 ixgbe_probe: begin pcib13: at device 22.2 on pci0 pci13: on pcib13 ixgbe_probe: begin pcib14: at device 22.3 on pci0 pci14: on pcib14 ixgbe_probe: begin pcib15: at device 22.4 on pci0 pci15: on pcib15 ixgbe_probe: begin pcib16: at device 22.5 on pci0 pci16: on pcib16 ixgbe_probe: begin pcib17: at device 22.6 on pci0 pci17: on pcib17 ixgbe_probe: begin pcib18: at device 22.7 on pci0 pci18: on pcib18 ixgbe_probe: begin pcib19: at device 23.0 on pci0 pci19: on pcib19 ixgbe_probe: begin pcib20: at device 23.1 on pci0 pci20: on pcib20 ixgbe_probe: begin pcib21: at device 23.2 on pci0 pci21: on pcib21 ixgbe_probe: begin pcib22: at device 23.3 on pci0 pci22: on pcib22 ixgbe_probe: begin pcib23: at device 23.4 on pci0 pci23: on pcib23 ixgbe_probe: begin pcib24: at device 23.5 on pci0 pci24: on pcib24 ixgbe_probe: begin pcib25: at device 23.6 on pci0 pci25: on pcib25 ixgbe_probe: begin pcib26: at device 23.7 on pci0 pci26: on pcib26 ixgbe_probe: begin pcib27: at device 24.0 on pci0 pci27: on pcib27 ixgbe_probe: begin pcib28: at device 24.1 on pci0 pci28: on pcib28 ixgbe_probe: begin pcib29: at device 24.2 on pci0 pci29: on pcib29 ixgbe_probe: begin pcib30: at device 24.3 on pci0 pci30: on pcib30 ixgbe_probe: begin pcib31: at device 24.4 on pci0 pci31: on pcib31 ixgbe_probe: begin pcib32: at device 24.5 on pci0 pci32: on pcib32 ixgbe_probe: begin pcib33: at device 24.6 on pci0 pci33: on pcib33 ixgbe_probe: begin pcib34: at device 24.7 on pci0 pci34: on pcib34 acpi_acad0: on acpi0 atrtc0: port 0x70-0x71 irq 8 on acpi0 atkbdc0: port 0x60,0x64 irq 1 on acpi0 atkbd0: irq 1 on atkbdc0 kbd0 at atkbd0 atkbd0: [GIANT-LOCKED] atkbd0: [ITHREAD] psm0: irq 12 on atkbdc0 psm0: [GIANT-LOCKED] psm0: [ITHREAD] psm0: model IntelliMouse, device ID 3 ppc0: port 0x378-0x37f irq 7 on acpi0 ppc0: Generic chipset (NIBBLE-only) in COMPATIBLE mode ppc0: [ITHREAD] ppbus0: on ppc0 plip0: on ppbus0 plip0: [ITHREAD] lpt0: on ppbus0 lpt0: [ITHREAD] lpt0: Interrupt-driven port ppi0: on ppbus0 uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0 uart0: [FILTER] uart1: <16550 or compatible> port 0x2f8-0x2ff irq 3 on acpi0 uart1: [FILTER] fdc0: port 0x3f0-0x3f5,0x3f7 irq 6 drq 2 on = acpi0 fdc0: [FILTER] fd0: <1440-KB 3.5" drive> on fdc0 drive 0 qpi0: on motherboard orm0: at iomem = 0xc0000-0xc7fff,0xca000-0xcafff,0xdc000-0xdffff,0xe0000-0xe7fff on isa0 sc0: at flags 0x100 on isa0 sc0: VGA <16 virtual consoles, flags=3D0x300> vga0: at port 0x3c0-0x3df iomem 0xa0000-0xbffff on = isa0 acpi_throttle0: on cpu0 acpi_throttle1: on cpu1 acpi_throttle1: failed to attach P_CNT device_attach: acpi_throttle1 attach returned 6 acpi_throttle2: on cpu2 acpi_throttle2: failed to attach P_CNT device_attach: acpi_throttle2 attach returned 6 acpi_throttle3: on cpu3 acpi_throttle3: failed to attach P_CNT device_attach: acpi_throttle3 attach returned 6 Timecounters tick every 10.000 msec acd0: DVDR at ata1-master = UDMA33=20 da0 at mpt0 bus 0 scbus0 target 0 lun 0 da0: Fixed Direct Access SCSI-2 device=20 da0: 320.000MB/s transfers (160.000MHz, offset 127, 16bit) da0: Command Queueing enabled da0: 8192MB (16777216 512 byte sectors: 255H 63S/T 1044C) SMP: AP CPU #3 Launched! SMP: AP CPU #2 Launched! SMP: AP CPU #1 Launched! Trying to mount root from ufs:/dev/da0s1a WARNING: / was not properly dismounted WARNING: /tmp was not properly dismounted WARNING: /usr was not properly dismounted WARNING: /var was not properly dismounted VMware memory control driver initialized Fatal trap 12: page fault while in kernel mode cpuid =3D 2; apic id =3D 02 fault virtual address =3D 0x18 fault code =3D supervisor read data, page not present instruction pointer =3D 0x20:0xffffffff80667ef7 stack pointer =3D 0x28:0xffffff800016a6d0 frame pointer =3D 0x28:0xffffff800016a730 code segment =3D base 0x0, limit 0xfffff, type 0x1b =3D DPL 0, pres 1, long 1, def32 0, gran 1 processor eflags =3D interrupt enabled, resume, IOPL =3D 0 current process =3D 0 (ix0 que) trap number =3D 12 panic: page fault cpuid =3D 2 KDB: stack backtrace: #0 0xffffffff8063de2e at kdb_backtrace+0x5e #1 0xffffffff8060b047 at panic+0x187 #2 0xffffffff80900b80 at trap_fatal+0x290 #3 0xffffffff80900ed1 at trap_pfault+0x201 #4 0xffffffff8090138f at trap+0x3df #5 0xffffffff808e88e4 at calltrap+0x8 #6 0xffffffff8071c8c2 at ip_fragment+0x132 #7 0xffffffff8071d93a at ip_output+0xd7a #8 0xffffffff8071a13a at ip_forward+0x2ea #9 0xffffffff8071b77c at ip_input+0x52c #10 0xffffffff806c652e at netisr_dispatch_src+0x7e #11 0xffffffff806bc5cd at ether_demux+0x14d #12 0xffffffff806bc9d7 at ether_input+0x197 #13 0xffffffff803ee03e at ixv_rxeof+0x19e #14 0xffffffff803ef50b at ixv_handle_que+0x9b #15 0xffffffff806496d5 at taskqueue_run_locked+0x85 #16 0xffffffff8064986e at taskqueue_thread_loop+0x4e #17 0xffffffff805dfc9f at fork_exit+0x11f Uptime: 1m10s Dumping 89 out of 1008 MB: Fatal trap 12: page fault while in kernel mode cpuid =3D 2; apic id =3D 02 fault virtual address =3D 0x18 fault code =3D supervisor read data, page not present instruction pointer =3D 0x20:0xffffffff80667ef7 stack pointer =3D 0x28:0xffffff80001866d0 frame pointer =3D 0x28:0xffffff8000186730 code segment =3D base 0x0, limit 0xfffff, type 0x1b =3D DPL 0, pres 1, long 1, def32 0, gran 1 processor eflags =3D interrupt enabled, resume, IOPL =3D 0 current process =3D 0 (ix1 que) trap number =3D 12 panic: page fault cpuid =3D 2 Fatal trap 12: page fault while in kernel mode cpuid =3D 3; apic id =3D 03 fault virtual address =3D 0x18 fault code =3D supervisor write data, page not present instruction pointer =3D 0x20:0xffffffff803edf6a stack pointer =3D 0x28:0xffffff8000165a40 frame pointer =3D 0x28:0xffffff8000165af0 code segment =3D base 0x0, limit 0xfffff, type 0x1b =3D DPL 0, pres 1, long 1, def32 0, gran 1 processor eflags =3D interrupt enabled, resume, IOPL =3D 0 current process =3D 12 (irq256: ix0:que 0) trap number =3D 12 interrupt storm detected on "irq258:"; throttling interrupt source interrupt storm detected on "irq258:"; throttling interrupt source panic: bufwrite: buffer is not busy??? cpuid =3D 2 ..18%interrupt storm detected on "irq258:"; throttling interrupt source interrupt storm detected on "irq258:"; throttling interrupt source ..36%interrupt storm detected on "irq258:"; throttling interrupt source interrupt storm detected on "irq258:"; throttling interrupt source ..54%interrupt storm detected on "irq258:"; throttling interrupt source interrupt storm detected on "irq258:"; throttling interrupt source ..72%interrupt storm detected on "irq258:"; throttling interrupt source interrupt storm detected on "irq258:"; throttling interrupt source ..90%interrupt storm detected on "irq258:"; throttling interrupt source Dump complete Copyright (c) 1992-2012 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights = reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 8.3-RELEASE #0: Fri Oct 5 11:38:23 CEST 2012 root@bsd:/usr/obj/usr/src/sys/GENERIC amd64 Timecounter "i8254" frequency 1193182 Hz quality 0 CPU: Intel(R) Xeon(R) CPU W3680 @ 3.33GHz (3324.21-MHz = K8-class CPU) Origin =3D "GenuineIntel" Id =3D 0x206c2 Family =3D 6 Model =3D 2c = Stepping =3D 2 = Features=3D0xfa3fbff = Features2=3D0x82982203 AMD Features=3D0x28100800 AMD Features2=3D0x1 TSC: P-state invariant real memory =3D 1073741824 (1024 MB) avail memory =3D 1016238080 (969 MB) ACPI APIC Table: FreeBSD/SMP: Multiprocessor System Detected: 4 CPUs FreeBSD/SMP: 4 package(s) x 1 core(s) cpu0 (BSP): APIC ID: 0 cpu1 (AP): APIC ID: 1 cpu2 (AP): APIC ID: 2 cpu3 (AP): APIC ID: 3 MADT: Forcing active-low polarity and level trigger for SCI ioapic0 irqs 0-23 on motherboard kbd1 at kbdmux0 acpi0: on motherboard acpi0: [ITHREAD] acpi0: Power Button (fixed) acpi_hpet0: iomem 0xfed00000-0xfed003ff on = acpi0 Timecounter "HPET" frequency 14318180 Hz quality 900 Timecounter "ACPI-safe" frequency 3579545 Hz quality 850 acpi_timer0: <24-bit timer at 3.579545MHz> port 0x1008-0x100b on acpi0 cpu0: on acpi0 cpu1: on acpi0 cpu2: on acpi0 cpu3: on acpi0 pcib0: port 0xcf8-0xcff on acpi0 pci0: on pcib0 ixgbe_probe: begin ixgbe_probe: begin pcib1: at device 1.0 on pci0 pci1: on pcib1 ixgbe_probe: begin isab0: at device 7.0 on pci0 isa0: on isab0 ixgbe_probe: begin atapci0: port = 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0x10c0-0x10cf at device 7.1 on pci0 ata0: at channel 0 on atapci0 ata0: [ITHREAD] ata1: at channel 1 on atapci0 ata1: [ITHREAD] ixgbe_probe: begin pci0: at device 7.3 (no driver attached) ixgbe_probe: begin pci0: at device 7.7 (no driver attached) ixgbe_probe: begin vgapci0: port 0x10d0-0x10df mem = 0xd8000000-0xdbffffff,0xd0800000-0xd0ffffff irq 16 at device 15.0 on = pci0 ixgbe_probe: begin mpt0: port 0x1400-0x14ff mem = 0xd0040000-0xd005ffff,0xd0020000-0xd003ffff irq 17 at device 16.0 on = pci0 mpt0: [ITHREAD] mpt0: MPI Version=3D1.2.0.0 ixgbe_probe: begin pcib2: at device 17.0 on pci0 pci2: on pcib2 ixgbe_probe: begin em0: port = 0x2000-0x203f mem 0xd1020000-0xd103ffff,0xd1000000-0xd100ffff irq 18 at = device 0.0 on pci2 em0: Memory Access and/or Bus Master bits were not set! em0: [FILTER] em0: Ethernet address: 00:0c:29:5b:2a:ab ixgbe_probe: begin pcib3: at device 21.0 on pci0 pci3: on pcib3 ixgbe_probe: begin ix0: mem 0xd2404000-0xd2407fff,0xd2400000-0xd2403fff at device 0.0 on = pci3 ix0: Using MSIX interrupts with 2 vectors ix0: [ITHREAD] ix0: [ITHREAD] ix0: Ethernet address: 00:0c:29:5b:2a:10 ixgbe_probe: begin pcib4: at device 21.1 on pci0 pci4: on pcib4 ixgbe_probe: begin pcib5: at device 21.2 on pci0 pci5: on pcib5 ixgbe_probe: begin pcib6: at device 21.3 on pci0 pci6: on pcib6 ixgbe_probe: begin pcib7: at device 21.4 on pci0 pci7: on pcib7 ixgbe_probe: begin pcib8: at device 21.5 on pci0 pci8: on pcib8 ixgbe_probe: begin pcib9: at device 21.6 on pci0 pci9: on pcib9 ixgbe_probe: begin pcib10: at device 21.7 on pci0 pci10: on pcib10 ixgbe_probe: begin pcib11: at device 22.0 on pci0 pci11: on pcib11 ixgbe_probe: begin ix1: mem 0xd2504000-0xd2507fff,0xd2500000-0xd2503fff at device 0.0 on = pci11 ix1: Using MSIX interrupts with 2 vectors ix1: [ITHREAD] ix1: [ITHREAD] ix1: Ethernet address: 00:0c:29:5b:2a:11 ixgbe_probe: begin pcib12: at device 22.1 on pci0 pci12: on pcib12 ixgbe_probe: begin pcib13: at device 22.2 on pci0 pci13: on pcib13 ixgbe_probe: begin pcib14: at device 22.3 on pci0 pci14: on pcib14 ixgbe_probe: begin pcib15: at device 22.4 on pci0 pci15: on pcib15 ixgbe_probe: begin pcib16: at device 22.5 on pci0 pci16: on pcib16 ixgbe_probe: begin pcib17: at device 22.6 on pci0 pci17: on pcib17 ixgbe_probe: begin pcib18: at device 22.7 on pci0 pci18: on pcib18 ixgbe_probe: begin pcib19: at device 23.0 on pci0 pci19: on pcib19 ixgbe_probe: begin pcib20: at device 23.1 on pci0 pci20: on pcib20 ixgbe_probe: begin pcib21: at device 23.2 on pci0 pci21: on pcib21 ixgbe_probe: begin pcib22: at device 23.3 on pci0 pci22: on pcib22 ixgbe_probe: begin pcib23: at device 23.4 on pci0 pci23: on pcib23 ixgbe_probe: begin pcib24: at device 23.5 on pci0 pci24: on pcib24 ixgbe_probe: begin pcib25: at device 23.6 on pci0 pci25: on pcib25 ixgbe_probe: begin pcib26: at device 23.7 on pci0 pci26: on pcib26 ixgbe_probe: begin pcib27: at device 24.0 on pci0 pci27: on pcib27 ixgbe_probe: begin pcib28: at device 24.1 on pci0 pci28: on pcib28 ixgbe_probe: begin pcib29: at device 24.2 on pci0 pci29: on pcib29 ixgbe_probe: begin pcib30: at device 24.3 on pci0 pci30: on pcib30 ixgbe_probe: begin pcib31: at device 24.4 on pci0 pci31: on pcib31 ixgbe_probe: begin pcib32: at device 24.5 on pci0 pci32: on pcib32 ixgbe_probe: begin pcib33: at device 24.6 on pci0 pci33: on pcib33 ixgbe_probe: begin pcib34: at device 24.7 on pci0 pci34: on pcib34 acpi_acad0: on acpi0 atrtc0: port 0x70-0x71 irq 8 on acpi0 atkbdc0: port 0x60,0x64 irq 1 on acpi0 atkbd0: irq 1 on atkbdc0 kbd0 at atkbd0 atkbd0: [GIANT-LOCKED] atkbd0: [ITHREAD] psm0: irq 12 on atkbdc0 psm0: [GIANT-LOCKED] psm0: [ITHREAD] psm0: model IntelliMouse, device ID 3 ppc0: port 0x378-0x37f irq 7 on acpi0 ppc0: Generic chipset (NIBBLE-only) in COMPATIBLE mode ppc0: [ITHREAD] ppbus0: on ppc0 plip0: on ppbus0 plip0: [ITHREAD] lpt0: on ppbus0 lpt0: [ITHREAD] lpt0: Interrupt-driven port ppi0: on ppbus0 uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0 uart0: [FILTER] uart1: <16550 or compatible> port 0x2f8-0x2ff irq 3 on acpi0 uart1: [FILTER] fdc0: port 0x3f0-0x3f5,0x3f7 irq 6 drq 2 on = acpi0 fdc0: [FILTER] fd0: <1440-KB 3.5" drive> on fdc0 drive 0 qpi0: on motherboard orm0: at iomem = 0xc0000-0xc7fff,0xca000-0xcafff,0xdc000-0xdffff,0xe0000-0xe7fff on isa0 sc0: at flags 0x100 on isa0 sc0: VGA <16 virtual consoles, flags=3D0x300> vga0: at port 0x3c0-0x3df iomem 0xa0000-0xbffff on = isa0 acpi_throttle0: on cpu0 acpi_throttle1: on cpu1 acpi_throttle1: failed to attach P_CNT device_attach: acpi_throttle1 attach returned 6 acpi_throttle2: on cpu2 acpi_throttle2: failed to attach P_CNT device_attach: acpi_throttle2 attach returned 6 acpi_throttle3: on cpu3 acpi_throttle3: failed to attach P_CNT device_attach: acpi_throttle3 attach returned 6 Timecounters tick every 10.000 msec acd0: DVDR at ata1-master = UDMA33=20 da0 at mpt0 bus 0 scbus0 target 0 lun 0 da0: Fixed Direct Access SCSI-2 device=20 da0: 320.000MB/s transfers (160.000MHz, offset 127, 16bit) da0: Command Queueing enabled da0: 8192MB (16777216 512 byte sectors: 255H 63S/T 1044C) SMP: AP CPU #3 Launched! SMP: AP CPU #2 Launched! SMP: AP CPU #1 Launched! Trying to mount root from ufs:/dev/da0s1a WARNING: / was not properly dismounted WARNING: /tmp was not properly dismounted WARNING: /tmp: mount pending error: blocks 16 files 4 WARNING: /usr was not properly dismounted WARNING: /var was not properly dismounted VMware memory control driver initialized em0: promiscuous mode enabled em0: promiscuous mode disabled em0: promiscuous mode enabled em0: promiscuous mode disabled em0: promiscuous mode enabled em0: promiscuous mode disabled --Apple-Mail=_E43D5A19-1FB8-4DA3-AD2B-AF15B1B08D3C-- --Apple-Mail=_2CDDC20C-82C3-41DC-9607-42B13FA6F0F1--