From owner-freebsd-net@FreeBSD.ORG Wed May 22 03:05:33 2013 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by hub.freebsd.org (Postfix) with ESMTP id 5BEC64DA for ; Wed, 22 May 2013 03:05:33 +0000 (UTC) (envelope-from giorgiolago@gmail.com) Received: from mail-we0-x22a.google.com (mail-we0-x22a.google.com [IPv6:2a00:1450:400c:c03::22a]) by mx1.freebsd.org (Postfix) with ESMTP id 9964C1D6 for ; Wed, 22 May 2013 03:05:32 +0000 (UTC) Received: by mail-we0-f170.google.com with SMTP id u59so175163wes.29 for ; Tue, 21 May 2013 20:05:31 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:date:message-id:subject:from:to:content-type; bh=k/5EQT7wg3eEa1whlgOaKbTtVgDYOAtSP7gNpPKYLH8=; b=ykN9Qdw8q/yVZKtHcKRVnrCMZ93lrgjRTrW2/wTylSX2MkOpC2v8WloaEyw4gmC8VB qHQH0ar1tRAQNy68W/U4huaQ8l/KnpSCcPpPwOIvYDPBJthqKYAeP/vX1b5zMZXWGl3P kcqvMAC3Sbr93/0c67bV6oFdvSb8/Vi6bfs6NBvhJYRvRLQ5GxcKui95erK/Iqpm6MVt li81NuDhvEwvXw8Z/DnAQXYSYF45iGm8CFrx0LRUkGv1XPalijr2aeC48B/M2wiq8jaa 4p8HuscMTcizIQjTXNo+KlImHDQ0h0swrsLMHUQ/2Rlm8HgDSzPANxKXBVjbTgt89HYl y/vg== MIME-Version: 1.0 X-Received: by 10.180.109.48 with SMTP id hp16mr10069801wib.24.1369191931641; Tue, 21 May 2013 20:05:31 -0700 (PDT) Received: by 10.194.174.231 with HTTP; Tue, 21 May 2013 20:05:31 -0700 (PDT) Date: Wed, 22 May 2013 00:05:31 -0300 Message-ID: Subject: em2: watchdog timeout - resetting From: Giorgio Emanuel To: freebsd-net@freebsd.org Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.14 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 22 May 2013 03:05:33 -0000 Hello, I have a server pfsense in bridge mode to function as transparent FW, the problem is that once I connect the pfsense between my router core and my core switch catalyst a few seconds begin to appear several messages like these: em2: watchdog timeout - resetting em2: watchdog timeout - resetting em2: watchdog timeout - resetting em2: watchdog timeout - resetting And the connection falls back repeatedly and indefinitely. Searching on google did some tweaks: hw.em.rxd =3D "4096" hw.em.txd =3D "4096" hw.em.tx_int_delay =3D "250" hw.em.rx_int_delay =3D "250" hw.em.tx_abs_int_delay =3D "250" hw.em.rx_abs_int_delay =3D "250" hw.em.enable_msix =3D "0" hw.em.msix_queues =3D "2" hw.em.rx_process_limit =3D "-1" hw.em.fc_setting =3D "0" hw.em.num_queues =3D 1 I tried several variations, but also without success. My infrastructure: (7301 cisco router) ------ em1 (pfsense bridge0) em2 ------ sw core cisco catalyst I tried also a fresh installation of pfsense 2.0.3 without success. My network card is an Intel =AE PRO/1000 MT Dual Port Server Adapter PCI-X = on a 32-bit PCI slot, operating bridge in 1 <-> em2. Motherboard ASUS P8H61-V and CPU corei5, I tried disabling all onboard devices, also without success. I have 4 nics identical, tested one per one all without success also. I am using the latest bios from ASUS site, I tried various combinations of bios, also without success. I tried to activate the device polling unsuccessfully to solve the problem. I tried disable acpi on boot menu but the ser without acpi wont boot. I tried disable TOE, FLOW CONTROL, no sucess. This is a link to a troughput 60 Mbits with multiple VLANs (more than 200) Wisp provider. I tested the same server same hardware but using linux (debian 6) did the bridges, and everything worked properly!, so it is clear that this is a problem software (in intel em driver?) Tested on another server (P5VD2MX + Core2Duo) but with the same NIC, and the problem occurs in the same way. I realized that it generates a huge number of interruptions em2 over 200 thousand. #vmstat -i interrupt total rate irq16: em1 12891 40 irq17: em2 546630 1713 irq19: atapci0 5181 16 irq23: ehci0 ehci1 1049 3 cpu0: timer 637069 1997 irq256: em0 1557 4 cpu3: timer 636939 1996 cpu2: timer 636939 1996 cpu1: timer 636938 1996 Total 3115193 9765 Data for debug: [2.0.3-RELEASE] [root@pfsense.localdomain] / root (1): sysctl hw.em hw.em.eee_setting: 0 hw.em.rx_process_limit: 100 hw.em.enable_msix: 0 hw.em.sbp: 0 hw.em.smart_pwr_down: 0 hw.em.txd: 4096 hw.em.rxd: 4096 hw.em.rx_abs_int_delay: 66 hw.em.tx_abs_int_delay: 66 hw.em.rx_int_delay: 0 hw.em.tx_int_delay: 0 [2.0.3-RELEASE] [root@pfsense.localdomain] / root (3): sysctl dev.em.2 dev.em.2.% desc: Intel (R) PRO/1000 Legacy Network Connection 1.0.4 dev.em.2.% driver: in dev.em.2.% location: slot =3D 0 function =3D 1 dev.em.2.% pnpinfo: vendor =3D 0x8086 device =3D 0x1079 subvendor =3D 0x808= 6 subdevice =3D 0x1179 class =3D 0x020000 dev.em.2.% parent: PCI4 dev.em.2.nvm: -1 dev.em.2.rx_int_delay: 0 dev.em.2.tx_int_delay: 0 dev.em.2.rx_abs_int_delay: 66 dev.em.2.tx_abs_int_delay: 66 dev.em.2.rx_processing_limit: 100 dev.em.2.flow_control: 0 dev.em.2.mbuf_alloc_fail: 0 dev.em.2.cluster_alloc_fail: 0 dev.em.2.dropped: 0 dev.em.2.tx_dma_fail: 0 dev.em.2.tx_desc_fail1: 0 dev.em.2.tx_desc_fail2: 0 dev.em.2.rx_overruns: 0 dev.em.2.watchdog_timeouts: 0 dev.em.2.device_control: 1076888137 dev.em.2.rx_control: 32794 dev.em.2.fc_high_water: 47104 dev.em.2.fc_low_water: 45604 dev.em.2.fifo_workaround: 0 dev.em.2.fifo_reset: 0 dev.em.2.txd_head: 243 dev.em.2.txd_tail: 243 dev.em.2.rxd_head: 1374 dev.em.2.rxd_tail: 1373 dev.em.2.mac_stats.excess_coll: 0 dev.em.2.mac_stats.single_coll: 0 dev.em.2.mac_stats.multiple_coll: 0 dev.em.2.mac_stats.late_coll: 0 dev.em.2.mac_stats.collision_count: 0 dev.em.2.mac_stats.symbol_errors: 0 dev.em.2.mac_stats.sequence_errors: 0 dev.em.2.mac_stats.defer_count: 0 dev.em.2.mac_stats.missed_packets: 0 dev.em.2.mac_stats.recv_no_buff: 0 dev.em.2.mac_stats.recv_undersize: 0 dev.em.2.mac_stats.recv_fragmented: 0 dev.em.2.mac_stats.recv_oversize: 0 dev.em.2.mac_stats.recv_jabber: 0 dev.em.2.mac_stats.recv_errs: 0 dev.em.2.mac_stats.crc_errs: 0 dev.em.2.mac_stats.alignment_errs: 0 dev.em.2.mac_stats.coll_ext_errs: 0 dev.em.2.mac_stats.xon_recvd: 0 dev.em.2.mac_stats.xon_txd: 0 dev.em.2.mac_stats.xoff_recvd: 0 dev.em.2.mac_stats.xoff_txd: 0 dev.em.2.mac_stats.total_pkts_recvd: 6681156 dev.em.2.mac_stats.good_pkts_recvd: 6681156 dev.em.2.mac_stats.bcast_pkts_recvd: 17313 dev.em.2.mac_stats.mcast_pkts_recvd: 156511 dev.em.2.mac_stats.rx_frames_64: 1199707 dev.em.2.mac_stats.rx_frames_65_127: 2110104 dev.em.2.mac_stats.rx_frames_128_255: 396 862 dev.em.2.mac_stats.rx_frames_256_511: 196001 dev.em.2.mac_stats.rx_frames_512_1023: 138581 dev.em.2.mac_stats.rx_frames_1024_1522: 2639901 dev.em.2.mac_stats.good_octets_recvd: 4439337234 dev.em.2.mac_stats.good_octets_txd: 15529 dev.em.2.mac_stats.total_pkts_txd: 143 dev.em.2.mac_stats.good_pkts_txd: 143 dev.em.2.mac_stats.bcast_pkts_txd: 104 dev.em.2.mac_stats.mcast_pkts_txd: 39 dev.em.2.mac_stats.tx_frames_64: 48 dev.em.2.mac_stats.tx_frames_65_127: 69 dev.em.2.mac_stats.tx_frames_128_255: 20 dev.em.2.mac_stats.tx_frames_256_511: 6 dev.em.2.mac_stats.tx_frames_512_1023: 0 dev.em.2.mac_stats.tx_frames_1024_1522: 0 dev.em.2.mac_stats.tso_txd: 0 dev.em.2.mac_stats.tso_ctx_fail: 0 #uname -a FreeBSD pfsense.localdomain 8.1-RELEASE-p13 FreeBSD 8.1-RELEASE-p13 #1: Fri Apr 12 10:58:43 EDT 2013 root@snapshots-8_1-amd64.builders.pfsense.org:/usr/obj.pfSense/usr/pfSenses= rc/src/sys/pfSense_SMP.8 amd64 # Pciconf-lvc: em1 @ pci0: 4:0:0: class =3D 0x020000 card =3D 0x11798086 chip =3D 0x107980= 86 rev =3D 0x03 hdr =3D 0x00 class =3D network subclass =3D ethernet cap 01 [dc] =3D powerspec 2 supports D0 D3 current D0 cap 07 [e4] =3D PCI-X 64-bit supports 133MHz, 2048 burst read, 1 split transaction em2 @ pci0: 4:0:1: class =3D 0x020000 card =3D 0x11798086 chip =3D 0x107980= 86 rev =3D 0x03 hdr =3D 0x00 class =3D network subclass =3D ethernet cap 01 [dc] =3D powerspec 2 supports D0 D3 current D0 cap 07 [e4] =3D PCI-X 64-bit supports 133MHz, 2048 burst read, 1 split transaction dmesg Copyright (c) 1992-2010 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 8.1-RELEASE-p13 #1: Fri Apr 12 10:58:43 EDT 2013 root@snapshots-8_1-amd64.builders.pfsense.org:/usr/obj.pfSense/usr/pfSe= nsesrc/src/sys/pfSense_SMP.8 amd64 Timecounter "i8254" frequency 1193182 Hz quality 0 CPU: Intel(R) Core(TM) i5-2310 CPU @ 2.90GHz (2892.73-MHz K8-class CPU) Origin =3D "GenuineIntel" Id =3D 0x206a7 Family =3D 6 Model =3D 2a St= epping =3D 7 Features=3D0xbfebfbff Features2=3D0x179ae3bf,SSE4.1,SSE4.2,POPCNT,,AESNI,XSAVE,> AMD Features=3D0x28100800 AMD Features2=3D0x1 TSC: P-state invariant real memory =3D 8589934592 (8192 MB) avail memory =3D 7952838656 (7584 MB) ACPI APIC Table: FreeBSD/SMP: Multiprocessor System Detected: 4 CPUs FreeBSD/SMP: 1 package(s) x 4 core(s) cpu0 (BSP): APIC ID: 0 cpu1 (AP): APIC ID: 2 cpu2 (AP): APIC ID: 4 cpu3 (AP): APIC ID: 6 ioapic0 irqs 0-23 on motherboard wlan: mac acl policy registered kbd1 at kbdmux0 cryptosoft0: on motherboard padlock0: No ACE support. acpi0: on motherboard acpi0: [ITHREAD] ACPI Error (psargs-0464): [RAMB] Namespace lookup failure, AE_NOT_FOUND ACPI Exception: AE_NOT_FOUND, Could not execute arguments for [RAMW] (Region) (20100331/nsinit-442) acpi0: Power Button (fixed) acpi0: reservation of 67, 1 (4) failed Timecounter "ACPI-fast" frequency 3579545 Hz quality 1000 acpi_timer0: <24-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0 cpu0: on acpi0 cpu1: on acpi0 cpu2: on acpi0 cpu3: on acpi0 acpi_hpet0: iomem 0xfed00000-0xfed003ff on acpi0 Timecounter "HPET" frequency 14318180 Hz quality 900 pcib0: port 0xcf8-0xcff on acpi0 pci0: on pcib0 pcib1: irq 16 at device 1.0 on pci0 pci1: on pcib1 vgapci0: port 0xf000-0xf03f mem 0xf7800000-0xf7bfffff,0xe0000000-0xefffffff irq 16 at device 2.0 on pci0 pci0: at device 22.0 (no driver attached) ehci0: mem 0xf7f04000-0xf7f043ff irq 23 at device 26.0 on pci0 ehci0: [ITHREAD] usbus0: EHCI version 1.0 usbus0: on ehci0 pcib2: irq 16 at device 28.0 on pci0 pci2: on pcib2 em0: port 0xe000-0xe01f mem 0xf7e20000-0xf7e3ffff,0xf7e00000-0xf7e1ffff irq 16 at device 0.0 on pci2 em0: Using an MSI interrupt em0: [FILTER] pcib3: irq 16 at device 28.4 on pci0 pci3: on pcib3 pcib4: irq 16 at device 0.0 on pci3 pci4: on pcib4 em1: port 0xd040-0xd07f mem 0xf7d20000-0xf7d3ffff,0xf7cc0000-0xf7cfffff irq 16 at device 0.0 on pci= 4 em1: [FILTER] em2: port 0xd000-0xd03f mem 0xf7d00000-0xf7d1ffff,0xf7c40000-0xf7c7ffff irq 17 at device 0.1 on pci= 4 em2: [FILTER] ehci1: mem 0xf7f03000-0xf7f033ff irq 23 at device 29.0 on pci0 ehci1: [ITHREAD] usbus1: EHCI version 1.0 usbus1: on ehci1 isab0: at device 31.0 on pci0 isa0: on isab0 atapci0: port 0xf0b0-0xf0b7,0xf0a0-0xf0a3,0xf090-0xf097,0xf080-0xf083,0xf060-0xf07f mem 0xf7f02000-0xf7f027ff irq 19 at device 31.2 on pci0 atapci0: [ITHREAD] atapci0: AHCI v1.30 controller with 4 3Gbps ports, PM not supported ata2: on atapci0 ata2: [ITHREAD] ata3: on atapci0 ata3: [ITHREAD] pci0: at device 31.3 (no driver attached) acpi_button0: on acpi0 acpi_tz0: on acpi0 acpi_tz1: on acpi0 atrtc0: port 0x70-0x77 irq 8 on acpi0 atrtc0: Warning: Couldn't map I/O. sc0: at flags 0x100 on isa0 sc0: VGA <16 virtual consoles, flags=3D0x300> vga0: at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0 atkbdc0: at port 0x60,0x64 on isa0 atkbd0: irq 1 on atkbdc0 kbd0 at atkbd0 atkbd0: [GIANT-LOCKED] atkbd0: [ITHREAD] ppc0: cannot reserve I/O port range coretemp0: on cpu0 est0: on cpu0 p4tcc0: on cpu0 coretemp1: on cpu1 est1: on cpu1 p4tcc1: on cpu1 coretemp2: on cpu2 est2: on cpu2 p4tcc2: on cpu2 coretemp3: on cpu3 est3: on cpu3 p4tcc3: on cpu3 Timecounters tick every 1.000 msec IPsec: Initialized Security Association Processing. usbus0: 480Mbps High Speed USB v2.0 usbus1: 480Mbps High Speed USB v2.0 ad4: 476940MB at ata2-master UDMA100 SATA 3Gb/s ugen0.1: at usbus0 uhub0: on usbus0 ugen1.1: at usbus1 uhub1: on usbus1 acd0: DVDR at ata3-master UDMA100 SATA 1.5Gb/s SMP: AP CPU #1 Launched! SMP: AP CPU #3 Launched! SMP: AP CPU #2 Launched! Root mount waiting for: usbus1 usbus0 uhub0: 2 ports with 2 removable, self powered uhub1: 2 ports with 2 removable, self powered Root mount waiting for: usbus1 usbus0 ugen0.2: at usbus0 uhub2: on usbus0 ugen1.2: at usbus1 uhub3: on usbus1 Root mount waiting for: usbus1 usbus0 uhub2: 4 ports with 4 removable, self powered uhub3: 6 ports with 6 removable, self powered ugen0.3: at usbus0 ukbd0: on usbus0 kbd2 at ukbd0 uhid0: on usbus0 Trying to mount root from ufs:/dev/ad4s1a pflog0: promiscuous mode enabled em2: link state changed to UP bridge0: promiscuous mode enabled pflog0: promiscuous mode disabled Waiting (max 60 seconds) for system process `vnlru' to stop...done Waiting (max 60 seconds) for system process `bufdaemon' to stop...done Waiting (max 60 seconds) for system process `syncer' to stop... Syncing disks, vnodes remaining...0 0 0 done All buffers synced. Copyright (c) 1992-2010 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 8.1-RELEASE-p13 #1: Fri Apr 12 10:58:43 EDT 2013 root@snapshots-8_1-amd64.builders.pfsense.org:/usr/obj.pfSense/usr/pfSe= nsesrc/src/sys/pfSense_SMP.8 amd64 Timecounter "i8254" frequency 1193182 Hz quality 0 CPU: Intel(R) Core(TM) i5-2310 CPU @ 2.90GHz (2892.72-MHz K8-class CPU) Origin =3D "GenuineIntel" Id =3D 0x206a7 Family =3D 6 Model =3D 2a St= epping =3D 7 Features=3D0xbfebfbff Features2=3D0x179ae3bf,SSE4.1,SSE4.2,POPCNT,,AESNI,XSAVE,> AMD Features=3D0x28100800 AMD Features2=3D0x1 TSC: P-state invariant real memory =3D 8589934592 (8192 MB) avail memory =3D 7952838656 (7584 MB) ACPI APIC Table: FreeBSD/SMP: Multiprocessor System Detected: 4 CPUs FreeBSD/SMP: 1 package(s) x 4 core(s) cpu0 (BSP): APIC ID: 0 cpu1 (AP): APIC ID: 2 cpu2 (AP): APIC ID: 4 cpu3 (AP): APIC ID: 6 ioapic0 irqs 0-23 on motherboard wlan: mac acl policy registered kbd1 at kbdmux0 cryptosoft0: on motherboard padlock0: No ACE support. acpi0: on motherboard acpi0: [ITHREAD] ACPI Error (psargs-0464): [RAMB] Namespace lookup failure, AE_NOT_FOUND ACPI Exception: AE_NOT_FOUND, Could not execute arguments for [RAMW] (Region) (20100331/nsinit-442) acpi0: Power Button (fixed) acpi0: reservation of 67, 1 (4) failed Timecounter "ACPI-fast" frequency 3579545 Hz quality 1000 acpi_timer0: <24-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0 cpu0: on acpi0 cpu1: on acpi0 cpu2: on acpi0 cpu3: on acpi0 acpi_hpet0: iomem 0xfed00000-0xfed003ff on acpi0 Timecounter "HPET" frequency 14318180 Hz quality 900 pcib0: port 0xcf8-0xcff on acpi0 pci0: on pcib0 pcib1: irq 16 at device 1.0 on pci0 pci1: on pcib1 vgapci0: port 0xf000-0xf03f mem 0xf7800000-0xf7bfffff,0xe0000000-0xefffffff irq 16 at device 2.0 on pci0 pci0: at device 22.0 (no driver attached) ehci0: mem 0xf7f04000-0xf7f043ff irq 23 at device 26.0 on pci0 ehci0: [ITHREAD] usbus0: EHCI version 1.0 usbus0: on ehci0 pcib2: irq 16 at device 28.0 on pci0 pci2: on pcib2 em0: port 0xe000-0xe01f mem 0xf7e20000-0xf7e3ffff,0xf7e00000-0xf7e1ffff irq 16 at device 0.0 on pci2 em0: Using an MSI interrupt em0: [FILTER] pcib3: irq 16 at device 28.4 on pci0 pci3: on pcib3 pcib4: irq 16 at device 0.0 on pci3 pci4: on pcib4 em1: port 0xd040-0xd07f mem 0xf7d20000-0xf7d3ffff,0xf7cc0000-0xf7cfffff irq 16 at device 0.0 on pci= 4 em1: [FILTER] em2: port 0xd000-0xd03f mem 0xf7d00000-0xf7d1ffff,0xf7c40000-0xf7c7ffff irq 17 at device 0.1 on pci= 4 em2: [FILTER] ehci1: mem 0xf7f03000-0xf7f033ff irq 23 at device 29.0 on pci0 ehci1: [ITHREAD] usbus1: EHCI version 1.0 usbus1: on ehci1 isab0: at device 31.0 on pci0 isa0: on isab0 atapci0: port 0xf0b0-0xf0b7,0xf0a0-0xf0a3,0xf090-0xf097,0xf080-0xf083,0xf060-0xf07f mem 0xf7f02000-0xf7f027ff irq 19 at device 31.2 on pci0 atapci0: [ITHREAD] atapci0: AHCI v1.30 controller with 4 3Gbps ports, PM not supported ata2: on atapci0 ata2: [ITHREAD] ata3: on atapci0 ata3: [ITHREAD] pci0: at device 31.3 (no driver attached) acpi_button0: on acpi0 acpi_tz0: on acpi0 acpi_tz1: on acpi0 atrtc0: port 0x70-0x77 irq 8 on acpi0 atrtc0: Warning: Couldn't map I/O. sc0: at flags 0x100 on isa0 sc0: VGA <16 virtual consoles, flags=3D0x300> vga0: at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0 atkbdc0: at port 0x60,0x64 on isa0 atkbd0: irq 1 on atkbdc0 kbd0 at atkbd0 atkbd0: [GIANT-LOCKED] atkbd0: [ITHREAD] ppc0: cannot reserve I/O port range coretemp0: on cpu0 est0: on cpu0 p4tcc0: on cpu0 coretemp1: on cpu1 est1: on cpu1 p4tcc1: on cpu1 coretemp2: on cpu2 est2: on cpu2 p4tcc2: on cpu2 coretemp3: on cpu3 est3: on cpu3 p4tcc3: on cpu3 Timecounters tick every 1.000 msec IPsec: Initialized Security Association Processing. usbus0: 480Mbps High Speed USB v2.0 usbus1: 480Mbps High Speed USB v2.0 ad4: 476940MB at ata2-master UDMA100 SATA 3Gb/s ugen0.1: at usbus0 uhub0: on usbus0 ugen1.1: at usbus1 uhub1: on usbus1 acd0: DVDR at ata3-master UDMA100 SATA 1.5Gb/s SMP: AP CPU #3 Launched! SMP: AP CPU #2 Launched! SMP: AP CPU #1 Launched! Root mount waiting for: usbus1 usbus0 uhub0: 2 ports with 2 removable, self powered uhub1: 2 ports with 2 removable, self powered Root mount waiting for: usbus1 usbus0 ugen0.2: at usbus0 uhub2: on usbus0 ugen1.2: at usbus1 uhub3: on usbus1 uhub2: 4 ports with 4 removable, self powered uhub3: 6 ports with 6 removable, self powered Root mount waiting for: usbus0 ugen0.3: at usbus0 ukbd0: on usbus0 kbd2 at ukbd0 uhid0: on usbus0 Trying to mount root from ufs:/dev/ad4s1a pflog0: promiscuous mode enabled em2: link state changed to UP bridge0: promiscuous mode enabled