From owner-freebsd-stable@freebsd.org Mon Nov 19 13:10:05 2018 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id D38A0110346E for ; Mon, 19 Nov 2018 13:10:04 +0000 (UTC) (envelope-from hausen@punkt.de) Received: from kagate.punkt.de (kagate.punkt.de [217.29.33.131]) (using TLSv1.2 with cipher DHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id A075874D93 for ; Mon, 19 Nov 2018 13:10:03 +0000 (UTC) (envelope-from hausen@punkt.de) Received: from hugo10.ka.punkt.de (hugo10.ka.punkt.de [217.29.44.10]) by gate1.intern.punkt.de with ESMTP id wAJDA016036898 for ; Mon, 19 Nov 2018 14:10:01 +0100 (CET) Received: from [217.29.46.123] ([217.29.46.123]) by hugo10.ka.punkt.de (8.14.2/8.14.2) with ESMTP id wAJDA0aJ029527 for ; Mon, 19 Nov 2018 14:10:00 +0100 (CET) (envelope-from hausen@punkt.de) From: "Patrick M. Hausen" Content-Type: multipart/mixed; boundary="Apple-Mail=_63BFE956-FF55-4FD2-BDD5-6D81722ABCA4" Mime-Version: 1.0 (Mac OS X Mail 11.5 \(3445.9.1\)) Subject: Memory error logged in /var/log/messages Message-Id: <04F0C04D-7DD7-4079-8D2E-9824B69573D3@punkt.de> Date: Mon, 19 Nov 2018 14:10:00 +0100 To: freebsd-stable@freebsd.org X-Mailer: Apple Mail (2.3445.9.1) X-Rspamd-Queue-Id: A075874D93 X-Spamd-Result: default: False [1.14 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.63)[-0.626,0]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:217.29.32.0/20]; MV_CASE(0.50)[]; HAS_ATTACHMENT(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; TO_DN_NONE(0.00)[]; MIME_GOOD(-0.10)[multipart/mixed,text/plain]; RCPT_COUNT_ONE(0.00)[1]; RCVD_COUNT_THREE(0.00)[3]; DMARC_NA(0.00)[punkt.de]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MX_GOOD(-0.01)[cached: mailin.pluspunkthosting.de]; CTYPE_MIXED_BOGUS(1.00)[]; RCVD_IN_DNSWL_NONE(0.00)[131.33.29.217.list.dnswl.org : 127.0.10.0]; NEURAL_SPAM_SHORT(0.58)[0.579,0]; IP_SCORE(-0.00)[country: DE(-0.01)]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:16188, ipnet:217.29.32.0/20, country:DE]; MID_RHS_MATCH_FROM(0.00)[] X-Rspamd-Server: mx1.freebsd.org X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 19 Nov 2018 13:10:05 -0000 --Apple-Mail=_63BFE956-FF55-4FD2-BDD5-6D81722ABCA4 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=utf-8 Hi all, one of our production servers, 11.2p3 is logging this every couple of = minutes: Nov 19 11:48:06 ph002 kernel: MCA: CPU 0 COR (5) OVER MS channel 3 = memory error Nov 19 11:48:06 ph002 kernel: MCA: Address 0x1f709a48c0 Nov 19 11:48:06 ph002 kernel: MCA: Misc 0x90010000040188c Nov 19 11:48:06 ph002 kernel: MCA: Bank 12, Status 0xcc00010c000800c3 Nov 19 11:48:06 ph002 kernel: MCA: Global Cap 0x0000000007000c16, Status = 0x0000000000000000 Nov 19 11:48:06 ph002 kernel: MCA: Vendor "GenuineIntel", ID 0x406f1, = APIC ID 0 Address and core varies but it is always bank 12. It seems like applications are unaffected, we use, of course ECC memory. Is the OS able to work around these errors and just notifies us or is = in-memory data already getting corrupted? I=E2=80=99m at a bit of a loss identifying which DIMM might be the cause = so I contacted Supermicro support. They answered: > We can't really answer this, we do not know how various OS's map the = memory slots. > Our advise is always to look at IPMI, but if that doesn't log any = issues then we're not sure you're looking at a hardware issue. >=20 > But assuming the OS looks at the ranks of a module as a bank and you = use dual rank memory then it should logically point at DIMMC2. They are right on the IPMI (I told them when opening the case) - = there=E2=80=99s nothing at all in the event log. Can they be correct that it might not even be a hardware issue? If not how can I be sure which DIMM is to blame? Spare parts are ready = but I=E2=80=99d like to have a rather short maintenance break outside regular business hours. I=E2=80=99ll attach a dmesg.boot. HW is a X10DRW-NT mainboard, = SYS-1028R-WTNRT server platform. Thanks for any hints, Patrick --=20 punkt.de GmbH Internet - Dienstleistungen - Beratung Kaiserallee 13a Tel.: 0721 9109-0 Fax: -100 76133 Karlsruhe info@punkt.de http://punkt.de AG Mannheim 108285 Gf: Juergen Egeling --Apple-Mail=_63BFE956-FF55-4FD2-BDD5-6D81722ABCA4 Content-Disposition: attachment; filename=dmesg-boot.txt Content-Type: text/plain; x-unix-mode=0644; name="dmesg-boot.txt" Content-Transfer-Encoding: quoted-printable Copyright (c) 1992-2018 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights = reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 11.2-RELEASE-p3 #4 r338821: Thu Sep 20 12:26:41 CEST 2018 root@backupr05.karlsruhe.punkt.de:/usr/obj/usr/src/sys/VIMAGE amd64 FreeBSD clang version 6.0.0 (tags/RELEASE_600/final 326565) (based on = LLVM 6.0.0) VT(vga): resolution 640x480 CPU: Intel(R) Xeon(R) CPU E5-2630L v4 @ 1.80GHz (1800.04-MHz K8-class = CPU) Origin=3D"GenuineIntel" Id=3D0x406f1 Family=3D0x6 Model=3D0x4f = Stepping=3D1 = Features=3D0xbfebfbff = Features2=3D0x7ffefbff AMD Features=3D0x2c100800 AMD Features2=3D0x121 Structured Extended = Features=3D0x21cbfbb XSAVE Features=3D0x1 VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID,VID,PostIntr TSC: P-state invariant, performance statistics real memory =3D 274873712640 (262140 MB) avail memory =3D 267225935872 (254846 MB) Event timer "LAPIC" quality 600 ACPI APIC Table: FreeBSD/SMP: Multiprocessor System Detected: 40 CPUs FreeBSD/SMP: 2 package(s) x 10 core(s) x 2 hardware threads WARNING: VIMAGE (virtualized network stack) is a highly experimental = feature. ioapic0 irqs 0-23 on motherboard ioapic1 irqs 24-47 on motherboard ioapic2 irqs 48-71 on motherboard SMP: AP CPU #1 Launched! SMP: AP CPU #29 Launched! SMP: AP CPU #6 Launched! SMP: AP CPU #35 Launched! SMP: AP CPU #17 Launched! SMP: AP CPU #24 Launched! SMP: AP CPU #14 Launched! SMP: AP CPU #5 Launched! SMP: AP CPU #19 Launched! SMP: AP CPU #11 Launched! SMP: AP CPU #33 Launched! SMP: AP CPU #12 Launched! SMP: AP CPU #26 Launched! SMP: AP CPU #25 Launched! SMP: AP CPU #18 Launched! SMP: AP CPU #23 Launched! SMP: AP CPU #21 Launched! SMP: AP CPU #34 Launched! SMP: AP CPU #39 Launched! SMP: AP CPU #4 Launched! SMP: AP CPU #30 Launched! SMP: AP CPU #3 Launched! SMP: AP CPU #37 Launched! SMP: AP CPU #13 Launched! SMP: AP CPU #27 Launched! SMP: AP CPU #7 Launched! SMP: AP CPU #36 Launched! SMP: AP CPU #28 Launched! SMP: AP CPU #38 Launched! SMP: AP CPU #22 Launched! SMP: AP CPU #2 Launched! SMP: AP CPU #15 Launched! SMP: AP CPU #20 Launched! SMP: AP CPU #32 Launched! SMP: AP CPU #16 Launched! SMP: AP CPU #31 Launched! SMP: AP CPU #10 Launched! SMP: AP CPU #9 Launched! SMP: AP CPU #8 Launched! Timecounter "TSC" frequency 1800041380 Hz quality 1000 random: entropy device external interface kbd1 at kbdmux0 netmap: loaded module module_register_init: MOD_LOAD (vesa, 0xffffffff8102d580, 0) error 19 random: registering fast source Intel Secure Key RNG random: fast provider: "Intel Secure Key RNG" nexus0 vtvga0: on motherboard cryptosoft0: on motherboard acpi0: <> on motherboard acpi0: Power Button (fixed) cpu0: numa-domain 0 on acpi0 cpu1: numa-domain 0 on acpi0 cpu2: numa-domain 0 on acpi0 cpu3: numa-domain 0 on acpi0 cpu4: numa-domain 0 on acpi0 cpu5: numa-domain 0 on acpi0 cpu6: numa-domain 0 on acpi0 cpu7: numa-domain 0 on acpi0 cpu8: numa-domain 0 on acpi0 cpu9: numa-domain 0 on acpi0 cpu10: numa-domain 0 on acpi0 cpu11: numa-domain 0 on acpi0 cpu12: numa-domain 0 on acpi0 cpu13: numa-domain 0 on acpi0 cpu14: numa-domain 0 on acpi0 cpu15: numa-domain 0 on acpi0 cpu16: numa-domain 0 on acpi0 cpu17: numa-domain 0 on acpi0 cpu18: numa-domain 0 on acpi0 cpu19: numa-domain 0 on acpi0 cpu20: numa-domain 1 on acpi0 cpu21: numa-domain 1 on acpi0 cpu22: numa-domain 1 on acpi0 cpu23: numa-domain 1 on acpi0 cpu24: numa-domain 1 on acpi0 cpu25: numa-domain 1 on acpi0 cpu26: numa-domain 1 on acpi0 cpu27: numa-domain 1 on acpi0 cpu28: numa-domain 1 on acpi0 cpu29: numa-domain 1 on acpi0 cpu30: numa-domain 1 on acpi0 cpu31: numa-domain 1 on acpi0 cpu32: numa-domain 1 on acpi0 cpu33: numa-domain 1 on acpi0 cpu34: numa-domain 1 on acpi0 cpu35: numa-domain 1 on acpi0 cpu36: numa-domain 1 on acpi0 cpu37: numa-domain 1 on acpi0 cpu38: numa-domain 1 on acpi0 cpu39: numa-domain 1 on acpi0 atrtc0: port 0x70-0x71,0x74-0x77 irq 8 on acpi0 atrtc0: registered as a time-of-day clock, resolution 1.000000s Event timer "RTC" frequency 32768 Hz quality 0 attimer0: port 0x40-0x43,0x50-0x53 irq 0 on acpi0 Timecounter "i8254" frequency 1193182 Hz quality 0 Event timer "i8254" frequency 1193182 Hz quality 100 hpet0: iomem 0xfed00000-0xfed003ff on acpi0 Timecounter "HPET" frequency 14318180 Hz quality 950 Event timer "HPET" frequency 14318180 Hz quality 350 Event timer "HPET1" frequency 14318180 Hz quality 340 Event timer "HPET2" frequency 14318180 Hz quality 340 Event timer "HPET3" frequency 14318180 Hz quality 340 Event timer "HPET4" frequency 14318180 Hz quality 340 Event timer "HPET5" frequency 14318180 Hz quality 340 Event timer "HPET6" frequency 14318180 Hz quality 340 Event timer "HPET7" frequency 14318180 Hz quality 340 Timecounter "ACPI-fast" frequency 3579545 Hz quality 900 acpi_timer0: <24-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0 pcib0: on acpi0 pcib0: _OSC returned error 0x10 pci0: on pcib0 pci0: at device 8.2 (no driver attached) pci0: at device 9.2 (no driver attached) pci0: at device 11.1 (no driver attached) pci0: at device 11.2 (no driver attached) pci0: at device 16.1 (no driver attached) pci0: at device 16.6 (no driver attached) pci0: at device 18.1 (no driver attached) pcib1: on acpi0 pcib1: _OSC returned error 0x10 pci1: on pcib1 pci1: at device 8.2 (no driver attached) pci1: at device 9.2 (no driver attached) pci1: at device 11.1 (no driver attached) pci1: at device 11.2 (no driver attached) pci1: at device 16.1 (no driver attached) pci1: at device 16.6 (no driver attached) pci1: at device 18.1 (no driver attached) acpi_syscontainer0: on acpi0 acpi_syscontainer1: on acpi0 pcib2: port 0xcf8-0xcff numa-domain 0 on acpi0 pcib2: _OSC returned error 0x10 pci2: numa-domain 0 on pcib2 pcib3: irq 26 at device 1.0 numa-domain 0 on pci2 pci3: numa-domain 0 on pcib3 ix0: = port 0x6020-0x603f mem 0xc7c00000-0xc7dfffff,0xc7e04000-0xc7e07fff irq = 26 at device 0.0 numa-domain 0 on pci3 ix0: Using MSI-X interrupts with 9 vectors ix0: Ethernet address: 0c:c4:7a:34:ec:ba ix0: PCI Express Bus: Speed 5.0GT/s Width x8 ix0: netmap queues/slots: TX 8/2048, RX 8/2048 ix1: = port 0x6000-0x601f mem 0xc7a00000-0xc7bfffff,0xc7e00000-0xc7e03fff irq = 28 at device 0.1 numa-domain 0 on pci3 ix1: Using MSI-X interrupts with 9 vectors ix1: Ethernet address: 0c:c4:7a:34:ec:bb ix1: PCI Express Bus: Speed 5.0GT/s Width x8 ix1: netmap queues/slots: TX 8/2048, RX 8/2048 pcib4: irq 32 at device 2.0 numa-domain 0 on pci2 pcib4: [GIANT-LOCKED] pcib5: irq 32 at device 2.1 numa-domain 0 on pci2 pcib5: [GIANT-LOCKED] pcib6: irq 40 at device 3.0 numa-domain 0 on pci2 pci4: numa-domain 0 on pcib6 pcib7: at device 0.0 numa-domain 0 on pci4 pci5: numa-domain 0 on pcib7 pcib8: at device 2.0 numa-domain 0 on pci5 pci6: numa-domain 0 on pcib8 igb0: port = 0x4020-0x403f mem 0xc7220000-0xc723ffff,0xc7244000-0xc7247fff irq 45 at = device 0.0 numa-domain 0 on pci6 igb0: Using MSIX interrupts with 9 vectors igb0: Ethernet address: 90:e2:ba:ed:87:bc igb0: Bound queue 0 to cpu 0 igb0: Bound queue 1 to cpu 1 igb0: Bound queue 2 to cpu 2 igb0: Bound queue 3 to cpu 3 igb0: Bound queue 4 to cpu 4 igb0: Bound queue 5 to cpu 5 igb0: Bound queue 6 to cpu 6 igb0: Bound queue 7 to cpu 7 igb0: netmap queues/slots: TX 8/1024, RX 8/1024 igb1: port = 0x4000-0x401f mem 0xc7200000-0xc721ffff,0xc7240000-0xc7243fff irq 46 at = device 0.1 numa-domain 0 on pci6 igb1: Using MSIX interrupts with 9 vectors igb1: Ethernet address: 90:e2:ba:ed:87:bd igb1: Bound queue 0 to cpu 8 igb1: Bound queue 1 to cpu 9 igb1: Bound queue 2 to cpu 10 igb1: Bound queue 3 to cpu 11 igb1: Bound queue 4 to cpu 12 igb1: Bound queue 5 to cpu 13 igb1: Bound queue 6 to cpu 14 igb1: Bound queue 7 to cpu 15 igb1: netmap queues/slots: TX 8/1024, RX 8/1024 pcib9: at device 4.0 numa-domain 0 on pci5 pci7: numa-domain 0 on pcib9 igb2: port = 0x3020-0x303f mem 0xc7120000-0xc713ffff,0xc7144000-0xc7147fff irq 40 at = device 0.0 numa-domain 0 on pci7 igb2: Using MSIX interrupts with 9 vectors igb2: Ethernet address: 90:e2:ba:ed:87:be igb2: Bound queue 0 to cpu 16 igb2: Bound queue 1 to cpu 17 igb2: Bound queue 2 to cpu 18 igb2: Bound queue 3 to cpu 19 igb2: Bound queue 4 to cpu 20 igb2: Bound queue 5 to cpu 21 igb2: Bound queue 6 to cpu 22 igb2: Bound queue 7 to cpu 23 igb2: netmap queues/slots: TX 8/1024, RX 8/1024 igb3: port = 0x3000-0x301f mem 0xc7100000-0xc711ffff,0xc7140000-0xc7143fff irq 44 at = device 0.1 numa-domain 0 on pci7 igb3: Using MSIX interrupts with 9 vectors igb3: Ethernet address: 90:e2:ba:ed:87:bf igb3: Bound queue 0 to cpu 24 igb3: Bound queue 1 to cpu 25 igb3: Bound queue 2 to cpu 26 igb3: Bound queue 3 to cpu 27 igb3: Bound queue 4 to cpu 28 igb3: Bound queue 5 to cpu 29 igb3: Bound queue 6 to cpu 30 igb3: Bound queue 7 to cpu 31 igb3: netmap queues/slots: TX 8/1024, RX 8/1024 pci2: at device 17.0 (no driver attached) ahci0: port = 0x7110-0x7117,0x7100-0x7103,0x70f0-0x70f7,0x70e0-0x70e3,0x7020-0x703f = mem 0xc7338000-0xc73387ff irq 16 at device 17.4 numa-domain 0 on pci2 ahci0: AHCI v1.30 with 4 6Gbps ports, Port Multiplier not supported ahcich0: at channel 0 on ahci0 ahcich1: at channel 1 on ahci0 ahcich2: at channel 2 on ahci0 ahcich3: at channel 3 on ahci0 ahciem0: on ahci0 xhci0: mem 0xc7300000-0xc730ffff = irq 19 at device 20.0 numa-domain 0 on pci2 xhci0: 32 bytes context size, 64-bit DMA usbus0 numa-domain 0 on xhci0 usbus0: 5.0Gbps Super Speed USB v3.0 pci2: at device 22.0 (no driver attached) pci2: at device 22.1 (no driver attached) ehci0: mem 0xc7334000-0xc73343ff = irq 18 at device 26.0 numa-domain 0 on pci2 usbus1: EHCI version 1.0 usbus1 numa-domain 0 on ehci0 usbus1: 480Mbps High Speed USB v2.0 pcib10: irq 16 at device 28.0 numa-domain 0 on = pci2 pci8: numa-domain 0 on pcib10 pcib11: irq 16 at device 28.4 numa-domain 0 on = pci2 pci9: numa-domain 0 on pcib11 pcib12: at device 0.0 numa-domain 0 on pci9 pci10: numa-domain 0 on pcib12 vgapci0: port 0x5000-0x507f mem = 0xc6000000-0xc6ffffff,0xc7000000-0xc701ffff irq 16 at device 0.0 = numa-domain 0 on pci10 vgapci0: Boot video device ehci1: mem 0xc7333000-0xc73333ff = irq 18 at device 29.0 numa-domain 0 on pci2 usbus2: EHCI version 1.0 usbus2 numa-domain 0 on ehci1 usbus2: 480Mbps High Speed USB v2.0 isab0: at device 31.0 numa-domain 0 on pci2 isa0: numa-domain 0 on isab0 ahci1: port = 0x7070-0x7077,0x7060-0x7063,0x7050-0x7057,0x7040-0x7043,0x7000-0x701f = mem 0xc7332000-0xc73327ff irq 16 at device 31.2 numa-domain 0 on pci2 ahci1: AHCI v1.30 with 6 6Gbps ports, Port Multiplier not supported ahcich4: at channel 0 on ahci1 ahcich5: at channel 1 on ahci1 ahcich6: at channel 2 on ahci1 ahcich7: at channel 3 on ahci1 ahcich8: at channel 4 on ahci1 ahcich9: at channel 5 on ahci1 ahciem1: on ahci1 pcib13: numa-domain 1 on acpi0 pcib13: _OSC returned error 0x10 pci11: numa-domain 1 on pcib13 acpi_button0: on acpi0 uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0 uart1: <16550 or compatible> port 0x2f8-0x2ff irq 3 on acpi0 ipmi0: port 0xca2,0xca3 on acpi0 ipmi0: KCS mode found at io 0xca2 on acpi orm0: at iomem 0xc0000-0xc7fff,0xc8000-0xc8fff on isa0 ppc0: cannot reserve I/O port range est0: numa-domain 0 on cpu0 est1: numa-domain 0 on cpu1 est2: numa-domain 0 on cpu2 est3: numa-domain 0 on cpu3 est4: numa-domain 0 on cpu4 est5: numa-domain 0 on cpu5 est6: numa-domain 0 on cpu6 est7: numa-domain 0 on cpu7 est8: numa-domain 0 on cpu8 est9: numa-domain 0 on cpu9 est10: numa-domain 0 on cpu10 est11: numa-domain 0 on cpu11 est12: numa-domain 0 on cpu12 est13: numa-domain 0 on cpu13 est14: numa-domain 0 on cpu14 est15: numa-domain 0 on cpu15 est16: numa-domain 0 on cpu16 est17: numa-domain 0 on cpu17 est18: numa-domain 0 on cpu18 est19: numa-domain 0 on cpu19 est20: numa-domain 1 on cpu20 est21: numa-domain 1 on cpu21 est22: numa-domain 1 on cpu22 est23: numa-domain 1 on cpu23 est24: numa-domain 1 on cpu24 est25: numa-domain 1 on cpu25 est26: numa-domain 1 on cpu26 est27: numa-domain 1 on cpu27 est28: numa-domain 1 on cpu28 est29: numa-domain 1 on cpu29 est30: numa-domain 1 on cpu30 est31: numa-domain 1 on cpu31 est32: numa-domain 1 on cpu32 est33: numa-domain 1 on cpu33 est34: numa-domain 1 on cpu34 est35: numa-domain 1 on cpu35 est36: numa-domain 1 on cpu36 est37: numa-domain 1 on cpu37 est38: numa-domain 1 on cpu38 est39: numa-domain 1 on cpu39 random: unblocking device. ZFS filesystem version: 5 ZFS storage pool version: features support (5000) Timecounters tick every 1.000 msec ipfw2 (+ipv6) initialized, divert loadable, nat loadable, default to = accept, logging disabled ipmi0: IPMI device rev. 1, firmware rev. 3.45, version 2.0 ipmi0: Number of channels 2 ipmi0: Attached watchdog ugen1.1: at usbus1 ugen2.1: at usbus2 ugen0.1: <0x8086 XHCI root HUB> at usbus0 uhub0: on usbus1 ses0 at ahciem0 bus 0 scbus4 target 0 lun 0 uhub1: ses0: SEMB S-E-S 2.00 device <0x8086 XHCI root HUB, class 9/0, rev 3.00/1.00, addr 1> on usbus0 ses0: SEMB SES Device ses1 at ahciem1 bus 0 scbus11 target 0 lun 0 uhub2: ses1: SEMB S-E-S 2.00 device ses1: SEMB SES Device ada0 at ahcich0 bus 0 scbus0 target 0 lun 0 on usbus2 ada0: ACS-2 ATA SATA 3.x device ada0: Serial Number 164011801552 ada0: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 512bytes) ada0: Command Queueing enabled ada0: 488386MB (1000215216 512 byte sectors) ada1 at ahcich1 bus 0 scbus1 target 0 lun 0 ada1: ACS-2 ATA SATA 3.x device ada1: Serial Number 164011801547 ada1: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 512bytes) ada1: Command Queueing enabled ada1: 488386MB (1000215216 512 byte sectors) ada2 at ahcich2 bus 0 scbus2 target 0 lun 0 ada2: ACS-2 ATA SATA 3.x device GEOM_MIRRORada2: Serial Number 164006805582 ada2: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 512bytes) ada2: Command Queueing enabled ada2: 976762MB (2000409264 512 byte sectors) ada3 at ahcich3 bus 0 scbus3 target 0 lun 0 : Device mirror/swap launched (2/2). ada3: ACS-2 ATA SATA 3.x device ada3: Serial Number 164103805747 ada3: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 512bytes) ada3: Command Queueing enabled ada3: 976762MB (2000409264 512 byte sectors) ada4 at ahcich4 bus 0 scbus5 target 0 lun 0 ada4: ACS-2 ATA SATA 3.x device ada4: Serial Number S252NX0H807418W ada4: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 512bytes) ada4: Command Queueing enabled ada4: 976762MB (2000409264 512 byte sectors) ada4: quirks=3D0x3<4K,NCQ_TRIM_BROKEN> ada5 at ahcich5 bus 0 scbus6 target 0 lun 0 ada5: ACS-2 ATA SATA 3.x device ada5: Serial Number 164103802112 ada5: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 512bytes) ada5: Command Queueing enabled ada5: 976762MB (2000409264 512 byte sectors) ada6 at ahcich6 bus 0 scbus7 target 0 lun 0 ada6: ACS-2 ATA SATA 3.x device ada6: Serial Number 164006805318 ada6: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 512bytes) ada6: Command Queueing enabled ada6: 976762MB (2000409264 512 byte sectors) ada7 at ahcich7 bus 0 scbus8 target 0 lun 0 ada7: ACS-2 ATA SATA 3.x device ada7: Serial Number S252NX0H807428B ada7: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 512bytes) ada7: Command Queueing enabled ada7: 976762MB (2000409264 512 byte sectors) ada7: quirks=3D0x3<4K,NCQ_TRIM_BROKEN> Trying to mount root from zfs:zroot/ROOT/default []... Root mount waiting for: usbus2 usbus1 usbus0 uhub0: 2 ports with 2 removable, self powered uhub2: 2 ports with 2 removable, self powered uhub1: 21 ports with 21 removable, self powered Root mount waiting for: usbus2 usbus1 usbus0 ugen0.2: at usbus0 uhub3 numa-domain 0 on uhub1 uhub3: = on usbus0 ugen1.2: at usbus1 uhub4 numa-domain 0 on uhub0 uhub4: = on usbus1 ugen2.2: at usbus2 uhub5 numa-domain 0 on uhub2 uhub5: = on usbus2 uhub3: 4 ports with 3 removable, self powered uhub4: 6 ports with 6 removable, self powered uhub5: 8 ports with 8 removable, self powered ugen0.3: at usbus0 ukbd0 numa-domain 0 on uhub3 ukbd0: = on usbus0 kbd2 at ukbd0 bridge0: Ethernet address: 02:50:51:fe:cc:00 bridge1: Ethernet address: 02:50:51:fe:cc:01 bridge0: changing name to 'inet0' bridge1: changing name to 'mgmt0' igb0: promiscuous mode enabled inet0: link state changed to UP igb1: promiscuous mode enabled mgmt0: link state changed to UP igb0: link state changed to UP igb1: link state changed to UP ums0 numa-domain 0 on uhub3 ums0: = on usbus0 ums0: 3 buttons and [Z] coordinates ID=3D0 CPU: Intel(R) Xeon(R) CPU E5-2630L v4 @ 1.80GHz (1800.04-MHz K8-class = CPU) Origin=3D"GenuineIntel" Id=3D0x406f1 Family=3D0x6 Model=3D0x4f = Stepping=3D1 = Features=3D0xbfebfbff = Features2=3D0x7ffefbff AMD Features=3D0x2c100800 AMD Features2=3D0x121 Structured Extended = Features=3D0x21cbfbb XSAVE Features=3D0x1 VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID,VID,PostIntr TSC: P-state invariant, performance statistics --Apple-Mail=_63BFE956-FF55-4FD2-BDD5-6D81722ABCA4--