Date: Wed, 11 Jul 2018 14:29:59 -0700 From: Jim Long <list@museum.rain.com> To: freebsd-questions@freebsd.org Subject: Disk/ZFS activity crash on 11.2-STABLE Message-ID: <20180711212959.GA81029@g5.umpquanet.com>
next in thread | raw e-mail | index | archive | help
I have a server running a Supermicro X11DPH-T system board (dmesg below) which is unstable under heavy disk read load. The following command is sufficient to trigger a crash: # zfs send -R pool@snapshot > /dev/null That command takes an unpredictable amount of time to trigger the crash, but I have never seen it complete successfully. Further, crash dumps of this are difficult to obtain (see below), despite the fact that dumps are enabled and tested via: # sysctl debug.kdb.panic=1 As disclosure, this machine sometimes exhibits a second failure mode with a "kernel trap 12 with interrupts disabled." This typically occurs on boot, just about the point where the kernel begins enumerating the CPUs. But that is not (yet) my primary concern. I typically perform the 'zfs send' stress test over an ssh session, although the server is nearby on a test bench. I have not yet been at the console when the panic or crash happens, so I am not certain that the kernel is "panicking gracefully," if you'll pardon the oxymoron, I have yet to find any crash dumps in /var/crash after a disk-induced panic. Is a serial console the next step in troubleshooting this? I am fairly strong in bash scripting, but inexperienced in kernel crash debugging. I already have remote syslogging set on this server, so it's feasible to write certain terse tidbits to syslog ("still alive at xx:yy PDT") and/or dump some key statistics every minute to the server's local ZFS pool, and then see what the last stats dump file shows upon reboot. What are some key stats I should capture at periodic intervals while waiting for the 'zfs send' to induce the crash -- iostat? zfs-stats is also installed, but I'm ignorant about what stats I should dump, and how to infer any post-mortem meaning from them. This problem first appeared when doing a backup of this machine. The 'zfs send' was invoked by a remote host over an ssh session with jumbo frames enabled, achieving a throughput of around 115 MB/sec going out over GigE. To eliminate the network driver as a possible point of failure, I discovered that sending the 'zfs send' output to /dev/null was sufficient to trigger the crash. I may try rate-limiting the output pipe with: # zfs send -R pool@snapshot | pv -Wbrat -L 1M > /dev/null to see whether the -L value has any effect on the ability of this command to complete successfully. After I started drafting this write-up, I finally got a crash dump. I ran the stress script: #!/usr/bin/env bash FILE="/var/crash/zfs-stress.start" SLEEP_TIME=10 # if this script causes a crash, then we should expect to see a # crash dump newer than this file: touch $FILE logger "begin $0" zfs destroy -rv tank@stress-test 2> /dev/null zfs snap -r tank@stress-test logger "begin 'zfs send -R tank@stress-test" zfs send -R tank@stress-test > /dev/null & logger "zfs send running in background" while [ -f $FILE ] && sleep $SLEEP_TIME; do logger "still alive @ $(date +%H:%M:%S)" done -- snip while also running 'systat -vm' in one virtual terminal and writing 'zpool iostat -v' to disk every couple seconds. I did finally observe a panic and this time got a dump. One quirk I forgot to mention is that after this ZFS-induced crash, on the next boot, the /etc/rc somehow does not run dhclient on the primary interface, despite its presence in /etc/rc.conf: ifconfig_ixl0="DHCP" I have no idea whether that is at all related, but it does mean that even if the system reboots after a crash, it is inaccessible except by the physical console. I have to log in as root and say 'dhclient ixl0'. On the NEXT boot, the DHCP client is invoked by /etc/rc as one would expect. I have: rc_debug="YES" defined in /etc/rc.conf but I am not seeing any messages that explain why dhclient is not being executed. I would be very grateful to anyone who has time to examine these post-mortems and offer any suggestions on where to go next. Thank you for your time reading this lengthy trouble report. Jim As promised, dmesg: Copyright (c) 1992-2018 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 11.2-STABLE #0 r335674: Tue Jun 26 13:20:24 PDT 2018 root@jimsdesk.example.edu:/usr/obj/usr/src/sys/GENERIC amd64 FreeBSD clang version 6.0.0 (tags/RELEASE_600/final 326565) (based on LLVM 6.0.0) VT(efifb): resolution 1680x1050 CPU: Intel(R) Xeon(R) Gold 5118 CPU @ 2.30GHz (2300.08-MHz K8-class CPU) Origin="GenuineIntel" Id=0x50654 Family=0x6 Model=0x55 Stepping=4 Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE> Features2=0x7ffefbff<SSE3,PCLMULQDQ,DTES64,MON,DS_CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,TSCDLT,AESNI,XSAVE,OSXSAVE,AVX,F16C,RDRAND> AMD Features=0x2c100800<SYSCALL,NX,Page1GB,RDTSCP,LM> AMD Features2=0x121<LAHF,ABM,Prefetch> Structured Extended Features=0xd39ffffb<FSGSBASE,TSCADJ,BMI1,HLE,AVX2,FDPEXC,SMEP,BMI2,ERMS,INVPCID,RTM,PQM,NFPUSG,MPX,PQE,AVX512F,AVX512DQ,RDSEED,ADX,SMAP,CLFLUSHOPT,CLWB,PROCTRACE,AVX512CD,AVX512BW,AVX512VL> Structured Extended Features2=0x8<PKU> Structured Extended Features3=0xc000000<IBPB,STIBP> XSAVE Features=0xf<XSAVEOPT,XSAVEC,XINUSE,XSAVES> VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID,VID,PostIntr TSC: P-state invariant, performance statistics real memory = 103079215104 (98304 MB) avail memory = 98749128704 (94174 MB) Event timer "LAPIC" quality 600 ACPI APIC Table: <SUPERM SMCI--MB> FreeBSD/SMP: Multiprocessor System Detected: 48 CPUs FreeBSD/SMP: 2 package(s) x 12 core(s) x 2 hardware threads ioapic6: Changing APIC ID to 16 ioapic7: Changing APIC ID to 17 ioapic8: Changing APIC ID to 18 ioapic0 <Version 2.0> irqs 0-23 on motherboard ioapic1 <Version 2.0> irqs 24-31 on motherboard ioapic2 <Version 2.0> irqs 32-39 on motherboard ioapic3 <Version 2.0> irqs 40-47 on motherboard ioapic4 <Version 2.0> irqs 48-55 on motherboard ioapic5 <Version 2.0> irqs 72-79 on motherboard ioapic6 <Version 2.0> irqs 80-87 on motherboard ioapic7 <Version 2.0> irqs 88-95 on motherboard ioapic8 <Version 2.0> irqs 96-103 on motherboard SMP: AP CPU #1 Launched! SMP: AP CPU #38 Launched! SMP: AP CPU #2 Launched! SMP: AP CPU #16 Launched! SMP: AP CPU #12 Launched! SMP: AP CPU #6 Launched! SMP: AP CPU #17 Launched! SMP: AP CPU #40 Launched! SMP: AP CPU #29 Launched! SMP: AP CPU #5 Launched! SMP: AP CPU #27 Launched! SMP: AP CPU #19 Launched! SMP: AP CPU #13 Launched! SMP: AP CPU #22 Launched! SMP: AP CPU #4 Launched! SMP: AP CPU #28 Launched! SMP: AP CPU #30 Launched! SMP: AP CPU #11 Launched! SMP: AP CPU #42 Launched! SMP: AP CPU #32 Launched! SMP: AP CPU #3 Launched! SMP: AP CPU #34 Launched! SMP: AP CPU #14 Launched! SMP: AP CPU #37 Launched! SMP: AP CPU #20 Launched! SMP: AP CPU #41 Launched! SMP: AP CPU #21 Launched! SMP: AP CPU #18 Launched! SMP: AP CPU #35 Launched! SMP: AP CPU #23 Launched! SMP: AP CPU #10 Launched! SMP: AP CPU #36 Launched! SMP: AP CPU #31 Launched! SMP: AP CPU #43 Launched! SMP: AP CPU #44 Launched! SMP: AP CPU #45 Launched! SMP: AP CPU #39 Launched! SMP: AP CPU #8 Launched! SMP: AP CPU #24 Launched! SMP: AP CPU #25 Launched! SMP: AP CPU #46 Launched! SMP: AP CPU #9 Launched! SMP: AP CPU #26 Launched! SMP: AP CPU #33 Launched! SMP: AP CPU #15 Launched! SMP: AP CPU #7 Launched! SMP: AP CPU #47 Launched! Timecounter "TSC-low" frequency 1150040467 Hz quality 1000 random: entropy device external interface kbd1 at kbdmux0 netmap: loaded module module_register_init: MOD_LOAD (vesa, 0xffffffff80ff4590, 0) error 19 random: registering fast source Intel Secure Key RNG random: fast provider: "Intel Secure Key RNG" nexus0 cryptosoft0: <software crypto> on motherboard acpi0: <SUPERM SUPERM> on motherboard acpi0: Power Button (fixed) cpu0: <ACPI CPU> numa-domain 0 on acpi0 cpu1: <ACPI CPU> numa-domain 0 on acpi0 cpu2: <ACPI CPU> numa-domain 0 on acpi0 cpu3: <ACPI CPU> numa-domain 0 on acpi0 cpu4: <ACPI CPU> numa-domain 0 on acpi0 cpu5: <ACPI CPU> numa-domain 0 on acpi0 cpu6: <ACPI CPU> numa-domain 0 on acpi0 cpu7: <ACPI CPU> numa-domain 0 on acpi0 cpu8: <ACPI CPU> numa-domain 0 on acpi0 cpu9: <ACPI CPU> numa-domain 0 on acpi0 cpu10: <ACPI CPU> numa-domain 0 on acpi0 cpu11: <ACPI CPU> numa-domain 0 on acpi0 cpu12: <ACPI CPU> numa-domain 0 on acpi0 cpu13: <ACPI CPU> numa-domain 0 on acpi0 cpu14: <ACPI CPU> numa-domain 0 on acpi0 cpu15: <ACPI CPU> numa-domain 0 on acpi0 cpu16: <ACPI CPU> numa-domain 0 on acpi0 cpu17: <ACPI CPU> numa-domain 0 on acpi0 cpu18: <ACPI CPU> numa-domain 0 on acpi0 cpu19: <ACPI CPU> numa-domain 0 on acpi0 cpu20: <ACPI CPU> numa-domain 0 on acpi0 cpu21: <ACPI CPU> numa-domain 0 on acpi0 cpu22: <ACPI CPU> numa-domain 0 on acpi0 cpu23: <ACPI CPU> numa-domain 0 on acpi0 cpu24: <ACPI CPU> numa-domain 1 on acpi0 cpu25: <ACPI CPU> numa-domain 1 on acpi0 cpu26: <ACPI CPU> numa-domain 1 on acpi0 cpu27: <ACPI CPU> numa-domain 1 on acpi0 cpu28: <ACPI CPU> numa-domain 1 on acpi0 cpu29: <ACPI CPU> numa-domain 1 on acpi0 cpu30: <ACPI CPU> numa-domain 1 on acpi0 cpu31: <ACPI CPU> numa-domain 1 on acpi0 cpu32: <ACPI CPU> numa-domain 1 on acpi0 cpu33: <ACPI CPU> numa-domain 1 on acpi0 cpu34: <ACPI CPU> numa-domain 1 on acpi0 cpu35: <ACPI CPU> numa-domain 1 on acpi0 cpu36: <ACPI CPU> numa-domain 1 on acpi0 cpu37: <ACPI CPU> numa-domain 1 on acpi0 cpu38: <ACPI CPU> numa-domain 1 on acpi0 cpu39: <ACPI CPU> numa-domain 1 on acpi0 cpu40: <ACPI CPU> numa-domain 1 on acpi0 cpu41: <ACPI CPU> numa-domain 1 on acpi0 cpu42: <ACPI CPU> numa-domain 1 on acpi0 cpu43: <ACPI CPU> numa-domain 1 on acpi0 cpu44: <ACPI CPU> numa-domain 1 on acpi0 cpu45: <ACPI CPU> numa-domain 1 on acpi0 cpu46: <ACPI CPU> numa-domain 1 on acpi0 cpu47: <ACPI CPU> numa-domain 1 on acpi0 atrtc0: <AT realtime clock> port 0x70-0x71,0x74-0x77 irq 8 on acpi0 atrtc0: registered as a time-of-day clock, resolution 1.000000s Event timer "RTC" frequency 32768 Hz quality 0 attimer0: <AT timer> port 0x40-0x43,0x50-0x53 irq 0 on acpi0 Timecounter "i8254" frequency 1193182 Hz quality 0 Event timer "i8254" frequency 1193182 Hz quality 100 hpet0: <High Precision Event Timer> iomem 0xfed00000-0xfed003ff on acpi0 Timecounter "HPET" frequency 24000000 Hz quality 950 Event timer "HPET" frequency 24000000 Hz quality 350 Event timer "HPET1" frequency 24000000 Hz quality 340 Event timer "HPET2" frequency 24000000 Hz quality 340 Event timer "HPET3" frequency 24000000 Hz quality 340 Event timer "HPET4" frequency 24000000 Hz quality 340 Event timer "HPET5" frequency 24000000 Hz quality 340 Event timer "HPET6" frequency 24000000 Hz quality 340 Event timer "HPET7" frequency 24000000 Hz quality 340 Timecounter "ACPI-fast" frequency 3579545 Hz quality 900 acpi_timer0: <24-bit timer at 3.579545MHz> port 0x508-0x50b on acpi0 acpi_syscontainer0: <System Container> on acpi0 acpi_syscontainer1: <System Container> on acpi0 pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff numa-domain 0 on acpi0 pcib0: _OSC returned error 0x10 pci0: <ACPI PCI bus> numa-domain 0 on pcib0 pci0: <dasp, performance counters> at device 8.1 (no driver attached) pci0: <unknown> at device 17.0 (no driver attached) pci0: <unknown> at device 17.1 (no driver attached) ahci0: <Intel Lewisburg AHCI SATA controller> port 0x3070-0x3077,0x3060-0x3063,0x3020-0x303f mem 0x9d206000-0x9d207fff,0x9d209000-0x9d2090ff,0x9d180000-0x9d1fffff irq 16 at device 17.5 numa-domain 0 on pci0 ahci0: AHCI v1.31 with 6 6Gbps ports, Port Multiplier not supported ahcich0: <AHCI channel> at channel 0 on ahci0 ahcich1: <AHCI channel> at channel 1 on ahci0 ahcich2: <AHCI channel> at channel 2 on ahci0 ahcich3: <AHCI channel> at channel 3 on ahci0 ahcich4: <AHCI channel> at channel 4 on ahci0 ahcich5: <AHCI channel> at channel 5 on ahci0 ahciem0: <AHCI enclosure management bridge> on ahci0 xhci0: <Intel Lewisburg USB 3.0 controller> mem 0x383ffff00000-0x383ffff0ffff irq 16 at device 20.0 numa-domain 0 on pci0 xhci0: 32 bytes context size, 64-bit DMA usbus0: waiting for BIOS to give up control xhci_interrupt: host controller halted usbus0 numa-domain 0 on xhci0 usbus0: 5.0Gbps Super Speed USB v3.0 pci0: <simple comms> at device 22.0 (no driver attached) pci0: <simple comms> at device 22.1 (no driver attached) pci0: <simple comms> at device 22.4 (no driver attached) ahci1: <Intel Lewisburg AHCI SATA controller> port 0x3050-0x3057,0x3040-0x3043,0x3000-0x301f mem 0x9d204000-0x9d205fff,0x9d208000-0x9d2080ff,0x9d100000-0x9d17ffff irq 16 at device 23.0 numa-domain 0 on pci0 ahci1: AHCI v1.31 with 8 6Gbps ports, Port Multiplier not supported ahcich6: <AHCI channel> at channel 0 on ahci1 ahcich7: <AHCI channel> at channel 1 on ahci1 ahcich8: <AHCI channel> at channel 2 on ahci1 ahcich9: <AHCI channel> at channel 3 on ahci1 ahcich10: <AHCI channel> at channel 4 on ahci1 ahcich11: <AHCI channel> at channel 5 on ahci1 ahcich12: <AHCI channel> at channel 6 on ahci1 ahcich13: <AHCI channel> at channel 7 on ahci1 ahciem1: <AHCI enclosure management bridge> on ahci1 pcib1: <ACPI PCI-PCI bridge> irq 16 at device 28.0 numa-domain 0 on pci0 pci1: <ACPI PCI bus> numa-domain 0 on pcib1 pcib2: <ACPI PCI-PCI bridge> irq 17 at device 28.5 numa-domain 0 on pci0 pci2: <ACPI PCI bus> numa-domain 0 on pcib2 pcib3: <ACPI PCI-PCI bridge> irq 17 at device 0.0 numa-domain 0 on pci2 pci3: <ACPI PCI bus> numa-domain 0 on pcib3 vgapci0: <VGA-compatible display> port 0x2000-0x207f mem 0x9c000000-0x9cffffff,0x9d000000-0x9d01ffff irq 17 at device 0.0 numa-domain 0 on pci3 vgapci0: Boot video device isab0: <PCI-ISA bridge> at device 31.0 numa-domain 0 on pci0 isa0: <ISA bus> numa-domain 0 on isab0 pci0: <memory> at device 31.2 (no driver attached) pci0: <serial bus> at device 31.5 (no driver attached) pcib4: <ACPI Host-PCI bridge> numa-domain 0 on acpi0 pcib4: _OSC returned error 0x10 pci4: <ACPI PCI bus> numa-domain 0 on pcib4 pcib5: <ACPI PCI-PCI bridge> irq 39 at device 0.0 numa-domain 0 on pci4 pci5: <ACPI PCI bus> numa-domain 0 on pcib5 pcib6: <ACPI PCI-PCI bridge> mem 0xaae00000-0xaae1ffff irq 32 at device 0.0 numa-domain 0 on pci5 pci6: <ACPI PCI bus> numa-domain 0 on pcib6 pcib7: <PCI-PCI bridge> irq 38 at device 3.0 numa-domain 0 on pci6 pci7: <PCI bus> numa-domain 0 on pcib7 ixl0: <Intel(R) Ethernet Connection 700 Series PF Driver, Version - 1.9.9-k> mem 0xa9000000-0xa9ffffff,0xaa008000-0xaa00ffff irq 38 at device 0.0 numa-domain 0 on pci7 ixl0: using 1024 tx descriptors and 1024 rx descriptors ixl0: fw 3.1.52349 api 1.5 nvm 3.25 etid 800009e7 oem 1.262.0 ixl0: PF-ID[0]: VFs 32, MSIX 129, VF MSIX 5, QPs 768, MDIO shared ixl0: Using MSIX interrupts with 9 vectors ixl0: Allocating 8 queues for PF LAN VSI; 8 queues active ixl0: Ethernet address: ac:1f:6b:61:54:06 ixl0: SR-IOV ready queues is 0xfffffe0001d13000 ixl0: netmap queues/slots: TX 8/1024, RX 8/1024 ixl1: <Intel(R) Ethernet Connection 700 Series PF Driver, Version - 1.9.9-k> mem 0xa8000000-0xa8ffffff,0xaa000000-0xaa007fff irq 38 at device 0.1 numa-domain 0 on pci7 ixl1: using 1024 tx descriptors and 1024 rx descriptors ixl1: fw 3.1.52349 api 1.5 nvm 3.25 etid 800009e7 oem 1.262.0 ixl1: PF-ID[1]: VFs 32, MSIX 129, VF MSIX 5, QPs 768, MDIO shared ixl1: Using MSIX interrupts with 9 vectors ixl1: Allocating 8 queues for PF LAN VSI; 8 queues active ixl1: Ethernet address: ac:1f:6b:61:54:07 ixl1: SR-IOV ready queues is 0xfffffe0001e69000 ixl1: netmap queues/slots: TX 8/1024, RX 8/1024 pcib8: <ACPI Host-PCI bridge> numa-domain 0 on acpi0 pcib8: _OSC returned error 0x10 pci8: <ACPI PCI bus> numa-domain 0 on pcib8 pcib9: <ACPI PCI-PCI bridge> irq 47 at device 2.0 numa-domain 0 on pci8 pci9: <ACPI PCI bus> numa-domain 0 on pcib9 mpr0: <Avago Technologies (LSI) SAS3008> port 0x7000-0x70ff mem 0xb8640000-0xb864ffff,0xb8600000-0xb863ffff irq 42 at device 0.0 numa-domain 0 on pci9 mpr0: Firmware: 15.00.03.00, Driver: 18.03.00.00-fbsd mpr0: IOCCapabilities: 7a85c<ScsiTaskFull,DiagTrace,SnapBuf,EEDP,TransRetry,EventReplay,MSIXIndex,HostDisc,FastPath,RDPQArray> pcib10: <ACPI Host-PCI bridge> numa-domain 0 on acpi0 pcib10: _OSC returned error 0x10 pci10: <ACPI PCI bus> numa-domain 0 on pcib10 pci10: <dasp, performance counters> at device 14.0 (no driver attached) pci10: <dasp, performance counters> at device 15.0 (no driver attached) pci10: <dasp, performance counters> at device 18.0 (no driver attached) pci10: <dasp, performance counters> at device 18.1 (no driver attached) pcib11: <ACPI Host-PCI bridge> numa-domain 1 on acpi0 ixl0: Link is up, 1 Gbps Full Duplex, Requested FEC: None, Negotiated FEC: None, Autoneg: True, Flow Control: None ixl0: link state changed to UP ixl1: Link is up, 1 Gbps Full Duplex, Requested FEC: None, Negotiated FEC: None, Autoneg: True, Flow Control: Full ixl1: link state changed to UP pcib11: _OSC returned error 0x10 pci11: <ACPI PCI bus> numa-domain 1 on pcib11 pci11: <dasp, performance counters> at device 8.1 (no driver attached) pcib12: <ACPI Host-PCI bridge> numa-domain 1 on acpi0 pcib12: _OSC returned error 0x10 pci12: <ACPI PCI bus> numa-domain 1 on pcib12 pcib13: <ACPI Host-PCI bridge> numa-domain 1 on acpi0 pcib13: _OSC returned error 0x10 pci13: <ACPI PCI bus> numa-domain 1 on pcib13 pcib14: <ACPI Host-PCI bridge> numa-domain 1 on acpi0 pcib14: _OSC returned error 0x10 pci14: <ACPI PCI bus> numa-domain 1 on pcib14 pci14: <dasp, performance counters> at device 14.0 (no driver attached) pci14: <dasp, performance counters> at device 15.0 (no driver attached) pci14: <dasp, performance counters> at device 18.0 (no driver attached) pci14: <dasp, performance counters> at device 18.1 (no driver attached) uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0 uart1: <16550 or compatible> port 0x2f8-0x2ff irq 3 on acpi0 orm0: <ISA Option ROM> at iomem 0xc0000-0xc7fff on isa0 ppc0: cannot reserve I/O port range est0: <Enhanced SpeedStep Frequency Control> numa-domain 0 on cpu0 est1: <Enhanced SpeedStep Frequency Control> numa-domain 0 on cpu1 est2: <Enhanced SpeedStep Frequency Control> numa-domain 0 on cpu2 est3: <Enhanced SpeedStep Frequency Control> numa-domain 0 on cpu3 est4: <Enhanced SpeedStep Frequency Control> numa-domain 0 on cpu4 est5: <Enhanced SpeedStep Frequency Control> numa-domain 0 on cpu5 est6: <Enhanced SpeedStep Frequency Control> numa-domain 0 on cpu6 est7: <Enhanced SpeedStep Frequency Control> numa-domain 0 on cpu7 est8: <Enhanced SpeedStep Frequency Control> numa-domain 0 on cpu8 est9: <Enhanced SpeedStep Frequency Control> numa-domain 0 on cpu9 est10: <Enhanced SpeedStep Frequency Control> numa-domain 0 on cpu10 est11: <Enhanced SpeedStep Frequency Control> numa-domain 0 on cpu11 est12: <Enhanced SpeedStep Frequency Control> numa-domain 0 on cpu12 est13: <Enhanced SpeedStep Frequency Control> numa-domain 0 on cpu13 est14: <Enhanced SpeedStep Frequency Control> numa-domain 0 on cpu14 est15: <Enhanced SpeedStep Frequency Control> numa-domain 0 on cpu15 est16: <Enhanced SpeedStep Frequency Control> numa-domain 0 on cpu16 est17: <Enhanced SpeedStep Frequency Control> numa-domain 0 on cpu17 est18: <Enhanced SpeedStep Frequency Control> numa-domain 0 on cpu18 est19: <Enhanced SpeedStep Frequency Control> numa-domain 0 on cpu19 est20: <Enhanced SpeedStep Frequency Control> numa-domain 0 on cpu20 est21: <Enhanced SpeedStep Frequency Control> numa-domain 0 on cpu21 est22: <Enhanced SpeedStep Frequency Control> numa-domain 0 on cpu22 est23: <Enhanced SpeedStep Frequency Control> numa-domain 0 on cpu23 est24: <Enhanced SpeedStep Frequency Control> numa-domain 1 on cpu24 est25: <Enhanced SpeedStep Frequency Control> numa-domain 1 on cpu25 est26: <Enhanced SpeedStep Frequency Control> numa-domain 1 on cpu26 est27: <Enhanced SpeedStep Frequency Control> numa-domain 1 on cpu27 est28: <Enhanced SpeedStep Frequency Control> numa-domain 1 on cpu28 est29: <Enhanced SpeedStep Frequency Control> numa-domain 1 on cpu29 est30: <Enhanced SpeedStep Frequency Control> numa-domain 1 on cpu30 est31: <Enhanced SpeedStep Frequency Control> numa-domain 1 on cpu31 est32: <Enhanced SpeedStep Frequency Control> numa-domain 1 on cpu32 est33: <Enhanced SpeedStep Frequency Control> numa-domain 1 on cpu33 est34: <Enhanced SpeedStep Frequency Control> numa-domain 1 on cpu34 est35: <Enhanced SpeedStep Frequency Control> numa-domain 1 on cpu35 est36: <Enhanced SpeedStep Frequency Control> numa-domain 1 on cpu36 est37: <Enhanced SpeedStep Frequency Control> numa-domain 1 on cpu37 est38: <Enhanced SpeedStep Frequency Control> numa-domain 1 on cpu38 est39: <Enhanced SpeedStep Frequency Control> numa-domain 1 on cpu39 est40: <Enhanced SpeedStep Frequency Control> numa-domain 1 on cpu40 est41: <Enhanced SpeedStep Frequency Control> numa-domain 1 on cpu41 est42: <Enhanced SpeedStep Frequency Control> numa-domain 1 on cpu42 est43: <Enhanced SpeedStep Frequency Control> numa-domain 1 on cpu43 est44: <Enhanced SpeedStep Frequency Control> numa-domain 1 on cpu44 est45: <Enhanced SpeedStep Frequency Control> numa-domain 1 on cpu45 est46: <Enhanced SpeedStep Frequency Control> numa-domain 1 on cpu46 est47: <Enhanced SpeedStep Frequency Control> numa-domain 1 on cpu47 random: unblocking device. ZFS filesystem version: 5 ZFS storage pool version: features support (5000) Timecounters tick every 1.000 msec ugen0.1: <0x8086 XHCI root HUB> at usbus0 mpr0: uhub0: <0x8086 XHCI root HUB, class 9/0, rev 3.00/1.00, addr 1> on usbus0 SAS Address from SAS device page0 = 5000c500955fb571 mpr0: Found device <401<SspTarg>,End Device> <12.0Gbps> handle<0x000a> enclosureHandle<0x0002> slot 0 mpr0: At enclosure level 0 and connector name ( ) mpr0: SAS Address from SAS device page0 = 5000c5009550e4f1 mpr0: Found device <401<SspTarg>,End Device> <12.0Gbps> handle<0x000b> enclosureHandle<0x0002> slot 1 mpr0: At enclosure level 0 and connector name ( ) mpr0: SAS Address from SAS device page0 = 5000c50095518c95 mpr0: Found device <401<SspTarg>,End Device> <12.0Gbps> handle<0x000c> enclosureHandle<0x0002> slot 2 mpr0: At enclosure level 0 and connector name ( ) mpr0: SAS Address from SAS device page0 = 5000c500955fb3c5 mpr0: Found device <401<SspTarg>,End Device> <12.0Gbps> handle<0x000d> enclosureHandle<0x0002> slot 3 mpr0: At enclosure level 0 and connector name ( ) mpr0: SAS Address from SAS device page0 = 5000c500955fb021 mpr0: Found device <401<SspTarg>,End Device> <12.0Gbps> handle<0x000e> enclosureHandle<0x0002> slot 4 mpr0: At enclosure level 0 and connector name ( ) mpr0: SAS Address from SAS device page0 = 5000c5009550e891 mpr0: Found device <401<SspTarg>,End Device> <12.0Gbps> handle<0x000f> enclosureHandle<0x0002> slot 5 mpr0: At enclosure level 0 and connector name ( ) mpr0: SAS Address from SAS device page0 = 500304801eb5dbfd mpr0: Found device <4411<SmpInit,SspTarg,SepDev>,End Device> <12.0Gbps> handle<0x0010> enclosureHandle<0x0002> slot 12 mpr0: At enclosure level 0 and connector name ( ) ses0 at ahciem0 bus 0 scbus6 target 0 lun 0 ses0: <AHCI SGPIO Enclosure 1.00 0001> SEMB S-E-S 2.00 device ses0: SEMB SES Device ses1 at ahciem1 bus 0 scbus15 target 0 lun 0 ses1: <AHCI SGPIO Enclosure 1.00 0001> SEMB S-E-S 2.00 device ses1: SEMB SES Device ses2 at mpr0 bus 0 scbus16 target 20 lun 0 ses2: <LSI SAS3x28 0601> Fixed Enclosure Services SPC-3 SCSI device ses2: 1200.000MB/s transfers ses2: Command Queueing enabled ses2: SCSI-3 ENC Device ada0 at ahcich4 bus 0 scbus4 target 0 lun 0 ada0: <INTEL SSDSC2KB240G7 SCV10121> ACS-3 ATA SATA 3.x device ada0: Serial Number BTYS81150CWH240AGN ada0: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 512bytes) ada0: Command Queueing enabled ada0: 228936MB (468862128 512 byte sectors) ada1 at ahcich5 bus 0 scbus5 target 0 lun 0 ada1: <INTEL SSDSC2KB240G7 SCV10121> ACS-3 ATA SATA 3.x device ada1: Serial Number BTYS814205JS240AGN ada1: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 512bytes) ada1: Command Queueing enabled ada1: 228936MB (468862128 512 byte sectors) uhub0: 26 ports with 26 removable, self powered ses2: pass4,da0: Element descriptor: 'Slot00' da1 at mpr0 bus 0 scbus16 target 9 lun 0 da2 at mpr0 bus 0 scbus16 target 10 lun 0 da0 at mpr0 bus 0 scbus16 target 8 lun 0 da5 at mpr0 bus 0 scbus16 target 13 lun 0 da4 at mpr0 bus 0 scbus16 target 12 lun 0 da2: <SEAGATE ST4000NM0095 K004> Fixed Direct Access SPC-4 SCSI device da2: Serial Number ZC15T3GB0000C832EM0C da2: 1200.000MB/s transfers da2: Command Queueing enabled da2: 3815447MB (976754646 4096 byte sectors) da0: <SEAGATE ST4000NM0095 K004> Fixed Direct Access SPC-4 SCSI device da0: Serial Number ZC1606NJ0000R833G9JK da0: 1200.000MB/s transfers da0: Command Queueing enabled da0: 3815447MB (976754646 4096 byte sectors) da4: <SEAGATE ST4000NM0095 K004> Fixed Direct Access SPC-4 SCSI device da4: Serial Number ZC1606RR0000R833G8YR da4: 1200.000MB/s transfers da4: Command Queueing enabled da4: 3815447MB (976754646 4096 byte sectors) ses2: pass4,da0: SAS Device Slot Element: 1 Phys at Slot 0 ses2: phy 0: SAS device type 1 id 0 da5: da1: <SEAGATE ST4000NM0095 K004> Fixed Direct Access SPC-4 SCSI device da1: Serial Number ZC15V7DV0000C8258M38 ugen0.2: <Dell Dell USB Entry Keyboard> at usbus0 da1: 1200.000MB/s transfers da1: Command Queueing enabled da1: 3815447MB (976754646 4096 byte sectors) <SEAGATE ST4000NM0095 K004> Fixed Direct Access SPC-4 SCSI device ukbd0da5: Serial Number ZC15KB320000R832RAR7 da5: 1200.000MB/s transfers da5: Command Queueing enabled da5: 3815447MB (976754646 4096 byte sectors) numa-domain 0 on uhub0 da3 at mpr0 bus 0 scbus16 target 11 lun 0 ukbd0: <Dell Dell USB Entry Keyboard, class 0/0, rev 1.10/1.15, addr 1> on usbus0 kbd2 at ukbd0 ses2: phy 0: protocols: Initiator( None ) Target( SSP ) ses2: phy 0: parent 500304801eb5dbff addr 5000c500955fb571 da3: <SEAGATE ST4000NM0095 K004> Fixed Direct Access SPC-4 SCSI device da3: Serial Number ZC1606Q80000R833WKE8 da3: 1200.000MB/s transfers da3: Command Queueing enabled da3: 3815447MB (976754646 4096 byte sectors) ses2: pass5,da1: Element descriptor: 'Slot01' ses2: pass5,da1: SAS Device Slot Element: 1 Phys at Slot 1 ses2: phy 0: SAS device type 1 id 0 ses2: phy 0: protocols: Initiator( None ) Target( SSP ) ses2: phy 0: parent 500304801eb5dbff addr 5000c5009550e4f1 ses2: pass6,da2: Element descriptor: 'Slot02' ses2: pass6,da2: SAS Device Slot Element: 1 Phys at Slot 2 ses2: phy 0: SAS device type 1 id 0 ses2: phy 0: protocols: Initiator( None ) Target( SSP ) ses2: phy 0: parent 500304801eb5dbff addr 5000c50095518c95 ses2: pass7,da3: Element descriptor: 'Slot03' ses2: pass7,da3: SAS Device Slot Element: 1 Phys at Slot 3 ses2: phy 0: SAS device type 1 id 0 ses2: phy 0: protocols: Initiator( None ) Target( SSP ) ses2: phy 0: parent 500304801eb5dbff addr 5000c500955fb3c5 ses2: pass8,da4: Element descriptor: 'Slot04' ses2: pass8,da4: SAS Device Slot Element: 1 Phys at Slot 4 ugen0.3: <vendor 0x0557 product 0x7000> at usbus0 ses2: phy 0: SAS device type 1 id 0 ses2: phy 0: protocols: Initiator( None ) Target( SSP ) ses2: phy 0: parent 500304801eb5dbff addr 5000c500955fb021 ses2: pass9,da5: Element descriptor: 'Slot05' ses2: pass9,da5: SAS Device Slot Element: 1 Phys at Slot 5 ses2: phy 0: SAS device type 1 id 0 ses2: phy 0: protocols: Initiator( None ) Target( SSP ) ses2: phy 0: parent 500304801eb5dbff addr 5000c5009550e891 uhub1 numa-domain 0 on uhub0 uhub1: <vendor 0x0557 product 0x7000, class 9/0, rev 2.00/0.00, addr 2> on usbus0 Trying to mount root from zfs:tank/default/root []... Root mount waiting for: usbus0 uhub1: 4 ports with 3 removable, self powered ugen0.4: <vendor 0x0557 product 0x2419> at usbus0 ukbd1 numa-domain 0 on uhub1 ukbd1: <vendor 0x0557 product 0x2419, class 0/0, rev 1.10/1.00, addr 3> on usbus0 kbd3 at ukbd1 lo0: link state changed to UP ums0 numa-domain 0 on uhub1 ums0: <vendor 0x0557 product 0x2419, class 0/0, rev 1.10/1.00, addr 3> on usbus0 ums0: 3 buttons and [Z] coordinates ID=0 And pciconf -lvb: hostb0@pci0:0:0:0: class=0x060000 card=0x098115d9 chip=0x20208086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E DMI3 Registers' class = bridge subclass = HOST-PCI none0@pci0:0:4:0: class=0x088000 card=0x00008086 chip=0x20218086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E CBDMA Registers' class = base peripheral bar [10] = type Memory, range 64, base 0x383ffff2c000, size 16384, enabled none1@pci0:0:4:1: class=0x088000 card=0x00008086 chip=0x20218086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E CBDMA Registers' class = base peripheral bar [10] = type Memory, range 64, base 0x383ffff28000, size 16384, enabled none2@pci0:0:4:2: class=0x088000 card=0x00008086 chip=0x20218086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E CBDMA Registers' class = base peripheral bar [10] = type Memory, range 64, base 0x383ffff24000, size 16384, enabled none3@pci0:0:4:3: class=0x088000 card=0x00008086 chip=0x20218086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E CBDMA Registers' class = base peripheral bar [10] = type Memory, range 64, base 0x383ffff20000, size 16384, enabled none4@pci0:0:4:4: class=0x088000 card=0x00008086 chip=0x20218086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E CBDMA Registers' class = base peripheral bar [10] = type Memory, range 64, base 0x383ffff1c000, size 16384, enabled none5@pci0:0:4:5: class=0x088000 card=0x00008086 chip=0x20218086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E CBDMA Registers' class = base peripheral bar [10] = type Memory, range 64, base 0x383ffff18000, size 16384, enabled none6@pci0:0:4:6: class=0x088000 card=0x00008086 chip=0x20218086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E CBDMA Registers' class = base peripheral bar [10] = type Memory, range 64, base 0x383ffff14000, size 16384, enabled none7@pci0:0:4:7: class=0x088000 card=0x00008086 chip=0x20218086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E CBDMA Registers' class = base peripheral bar [10] = type Memory, range 64, base 0x383ffff10000, size 16384, enabled none8@pci0:0:5:0: class=0x088000 card=0x00008086 chip=0x20248086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E MM/Vt-d Configuration Registers' class = base peripheral none9@pci0:0:5:2: class=0x088000 card=0x00000000 chip=0x20258086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' class = base peripheral ioapic0@pci0:0:5:4: class=0x080020 card=0x20268086 chip=0x20268086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' class = base peripheral subclass = interrupt controller bar [10] = type Memory, range 32, base 0x9d20a000, size 4096, enabled none10@pci0:0:8:0: class=0x088000 card=0x00008086 chip=0x20148086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E Ubox Registers' class = base peripheral none11@pci0:0:8:1: class=0x110100 card=0x00008086 chip=0x20158086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E Ubox Registers' class = dasp subclass = performance counters none12@pci0:0:8:2: class=0x088000 card=0x00008086 chip=0x20168086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E Ubox Registers' class = base peripheral none13@pci0:0:17:0: class=0xff0000 card=0x098115d9 chip=0xa1ec8086 rev=0x09 hdr=0x00 vendor = 'Intel Corporation' none14@pci0:0:17:1: class=0xff0000 card=0x098115d9 chip=0xa1ed8086 rev=0x09 hdr=0x00 vendor = 'Intel Corporation' ahci0@pci0:0:17:5: class=0x010601 card=0x098115d9 chip=0xa1d28086 rev=0x09 hdr=0x00 vendor = 'Intel Corporation' device = 'Lewisburg SSATA Controller [AHCI mode]' class = mass storage subclass = SATA bar [10] = type Memory, range 32, base 0x9d206000, size 8192, enabled bar [14] = type Memory, range 32, base 0x9d209000, size 256, enabled bar [18] = type I/O Port, range 32, base 0x3070, size 8, enabled bar [1c] = type I/O Port, range 32, base 0x3060, size 4, enabled bar [20] = type I/O Port, range 32, base 0x3020, size 32, enabled bar [24] = type Memory, range 32, base 0x9d180000, size 524288, enabled xhci0@pci0:0:20:0: class=0x0c0330 card=0x098115d9 chip=0xa1af8086 rev=0x09 hdr=0x00 vendor = 'Intel Corporation' device = 'Lewisburg USB 3.0 xHCI Controller' class = serial bus subclass = USB bar [10] = type Memory, range 64, base 0x383ffff00000, size 65536, enabled none15@pci0:0:20:2: class=0x118000 card=0x098115d9 chip=0xa1b18086 rev=0x09 hdr=0x00 vendor = 'Intel Corporation' device = 'Lewisburg Thermal Subsystem' class = dasp bar [10] = type Memory, range 64, base 0x383ffff33000, size 4096, enabled none16@pci0:0:22:0: class=0x078000 card=0x098115d9 chip=0xa1ba8086 rev=0x09 hdr=0x00 vendor = 'Intel Corporation' device = 'Lewisburg CSME: HECI' class = simple comms bar [10] = type Memory, range 64, base 0x383ffff32000, size 4096, enabled none17@pci0:0:22:1: class=0x078000 card=0x098115d9 chip=0xa1bb8086 rev=0x09 hdr=0x00 vendor = 'Intel Corporation' device = 'Lewisburg CSME: HECI' class = simple comms bar [10] = type Memory, range 64, base 0x383ffff31000, size 4096, enabled none18@pci0:0:22:4: class=0x078000 card=0x098115d9 chip=0xa1be8086 rev=0x09 hdr=0x00 vendor = 'Intel Corporation' device = 'Lewisburg CSME: HECI' class = simple comms bar [10] = type Memory, range 64, base 0x383ffff30000, size 4096, enabled ahci1@pci0:0:23:0: class=0x010601 card=0x098115d9 chip=0xa1828086 rev=0x09 hdr=0x00 vendor = 'Intel Corporation' device = 'Lewisburg SATA Controller [AHCI mode]' class = mass storage subclass = SATA bar [10] = type Memory, range 32, base 0x9d204000, size 8192, enabled bar [14] = type Memory, range 32, base 0x9d208000, size 256, enabled bar [18] = type I/O Port, range 32, base 0x3050, size 8, enabled bar [1c] = type I/O Port, range 32, base 0x3040, size 4, enabled bar [20] = type I/O Port, range 32, base 0x3000, size 32, enabled bar [24] = type Memory, range 32, base 0x9d100000, size 524288, enabled pcib1@pci0:0:28:0: class=0x060400 card=0x098115d9 chip=0xa1908086 rev=0xf9 hdr=0x01 vendor = 'Intel Corporation' device = 'Lewisburg PCI Express Root Port' class = bridge subclass = PCI-PCI pcib2@pci0:0:28:5: class=0x060400 card=0x098115d9 chip=0xa1958086 rev=0xf9 hdr=0x01 vendor = 'Intel Corporation' device = 'Lewisburg PCI Express Root Port' class = bridge subclass = PCI-PCI isab0@pci0:0:31:0: class=0x060100 card=0x098115d9 chip=0xa1c38086 rev=0x09 hdr=0x00 vendor = 'Intel Corporation' device = 'Lewisburg LPC Controller' class = bridge subclass = PCI-ISA none19@pci0:0:31:2: class=0x058000 card=0x098115d9 chip=0xa1a18086 rev=0x09 hdr=0x00 vendor = 'Intel Corporation' device = 'Lewisburg PMC' class = memory bar [10] = type Memory, range 32, base 0x9d200000, size 16384, enabled none20@pci0:0:31:4: class=0x0c0500 card=0x098115d9 chip=0xa1a38086 rev=0x09 hdr=0x00 vendor = 'Intel Corporation' device = 'Lewisburg SMBus' class = serial bus subclass = SMBus bar [10] = type Memory, range 64, base 0, size 256, disabled bar [20] = type I/O Port, range 32, base 0x780, size 32, enabled none21@pci0:0:31:5: class=0x0c8000 card=0x098115d9 chip=0xa1a48086 rev=0x09 hdr=0x00 vendor = 'Intel Corporation' device = 'Lewisburg SPI Controller' class = serial bus bar [10] = type Memory, range 32, base 0xfe010000, size 4096, enabled pcib3@pci0:2:0:0: class=0x060400 card=0x11501a03 chip=0x11501a03 rev=0x04 hdr=0x01 vendor = 'ASPEED Technology, Inc.' device = 'AST1150 PCI-to-PCI Bridge' class = bridge subclass = PCI-PCI vgapci0@pci0:3:0:0: class=0x030000 card=0x098115d9 chip=0x20001a03 rev=0x41 hdr=0x00 vendor = 'ASPEED Technology, Inc.' device = 'ASPEED Graphics Family' class = display subclass = VGA bar [10] = type Memory, range 32, base 0x9c000000, size 16777216, enabled bar [14] = type Memory, range 32, base 0x9d000000, size 131072, enabled bar [18] = type I/O Port, range 32, base 0x2000, size 128, enabled pcib5@pci0:23:0:0: class=0x060400 card=0x098115d9 chip=0x20308086 rev=0x04 hdr=0x01 vendor = 'Intel Corporation' device = 'Sky Lake-E PCI Express Root Port A' class = bridge subclass = PCI-PCI none22@pci0:23:5:0: class=0x088000 card=0x00008086 chip=0x20348086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' class = base peripheral none23@pci0:23:5:2: class=0x088000 card=0x00000000 chip=0x20358086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E RAS Configuration Registers' class = base peripheral ioapic1@pci0:23:5:4: class=0x080020 card=0x20368086 chip=0x20368086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' class = base peripheral subclass = interrupt controller bar [10] = type Memory, range 32, base 0xaaf00000, size 4096, enabled none24@pci0:23:8:0: class=0x088000 card=0x00008086 chip=0x208d8086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E CHA Registers' class = base peripheral none25@pci0:23:8:1: class=0x088000 card=0x00008086 chip=0x208d8086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E CHA Registers' class = base peripheral none26@pci0:23:8:2: class=0x088000 card=0x00008086 chip=0x208d8086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E CHA Registers' class = base peripheral none27@pci0:23:8:3: class=0x088000 card=0x00008086 chip=0x208d8086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E CHA Registers' class = base peripheral none28@pci0:23:8:4: class=0x088000 card=0x00008086 chip=0x208d8086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E CHA Registers' class = base peripheral none29@pci0:23:8:5: class=0x088000 card=0x00008086 chip=0x208d8086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E CHA Registers' class = base peripheral none30@pci0:23:8:6: class=0x088000 card=0x00008086 chip=0x208d8086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E CHA Registers' class = base peripheral none31@pci0:23:8:7: class=0x088000 card=0x00008086 chip=0x208d8086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E CHA Registers' class = base peripheral none32@pci0:23:9:0: class=0x088000 card=0x00008086 chip=0x208d8086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E CHA Registers' class = base peripheral none33@pci0:23:9:1: class=0x088000 card=0x00008086 chip=0x208d8086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E CHA Registers' class = base peripheral none34@pci0:23:9:2: class=0x088000 card=0x00008086 chip=0x208d8086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E CHA Registers' class = base peripheral none35@pci0:23:9:3: class=0x088000 card=0x00008086 chip=0x208d8086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E CHA Registers' class = base peripheral none36@pci0:23:9:4: class=0x088000 card=0x00008086 chip=0x208d8086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E CHA Registers' class = base peripheral none37@pci0:23:9:5: class=0x088000 card=0x00008086 chip=0x208d8086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E CHA Registers' class = base peripheral none38@pci0:23:9:6: class=0x088000 card=0x00008086 chip=0x208d8086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E CHA Registers' class = base peripheral none39@pci0:23:9:7: class=0x088000 card=0x00008086 chip=0x208d8086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E CHA Registers' class = base peripheral none40@pci0:23:10:0: class=0x088000 card=0x00008086 chip=0x208d8086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E CHA Registers' class = base peripheral none41@pci0:23:10:1: class=0x088000 card=0x00008086 chip=0x208d8086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E CHA Registers' class = base peripheral none42@pci0:23:14:0: class=0x088000 card=0x00008086 chip=0x208e8086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E CHA Registers' class = base peripheral none43@pci0:23:14:1: class=0x088000 card=0x00008086 chip=0x208e8086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E CHA Registers' class = base peripheral none44@pci0:23:14:2: class=0x088000 card=0x00008086 chip=0x208e8086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E CHA Registers' class = base peripheral none45@pci0:23:14:3: class=0x088000 card=0x00008086 chip=0x208e8086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E CHA Registers' class = base peripheral none46@pci0:23:14:4: class=0x088000 card=0x00008086 chip=0x208e8086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E CHA Registers' class = base peripheral none47@pci0:23:14:5: class=0x088000 card=0x00008086 chip=0x208e8086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E CHA Registers' class = base peripheral none48@pci0:23:14:6: class=0x088000 card=0x00008086 chip=0x208e8086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E CHA Registers' class = base peripheral none49@pci0:23:14:7: class=0x088000 card=0x00008086 chip=0x208e8086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E CHA Registers' class = base peripheral none50@pci0:23:15:0: class=0x088000 card=0x00008086 chip=0x208e8086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E CHA Registers' class = base peripheral none51@pci0:23:15:1: class=0x088000 card=0x00008086 chip=0x208e8086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E CHA Registers' class = base peripheral none52@pci0:23:15:2: class=0x088000 card=0x00008086 chip=0x208e8086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E CHA Registers' class = base peripheral none53@pci0:23:15:3: class=0x088000 card=0x00008086 chip=0x208e8086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E CHA Registers' class = base peripheral none54@pci0:23:15:4: class=0x088000 card=0x00008086 chip=0x208e8086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E CHA Registers' class = base peripheral none55@pci0:23:15:5: class=0x088000 card=0x00008086 chip=0x208e8086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E CHA Registers' class = base peripheral none56@pci0:23:15:6: class=0x088000 card=0x00008086 chip=0x208e8086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E CHA Registers' class = base peripheral none57@pci0:23:15:7: class=0x088000 card=0x00008086 chip=0x208e8086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E CHA Registers' class = base peripheral none58@pci0:23:16:0: class=0x088000 card=0x00008086 chip=0x208e8086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E CHA Registers' class = base peripheral none59@pci0:23:16:1: class=0x088000 card=0x00008086 chip=0x208e8086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E CHA Registers' class = base peripheral none60@pci0:23:29:0: class=0x088000 card=0x00008086 chip=0x20548086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E CHA Registers' class = base peripheral none61@pci0:23:29:1: class=0x088000 card=0x00008086 chip=0x20558086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E CHA Registers' class = base peripheral none62@pci0:23:29:2: class=0x088000 card=0x00008086 chip=0x20568086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E CHA Registers' class = base peripheral none63@pci0:23:29:3: class=0x088000 card=0x00008086 chip=0x20578086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E CHA Registers' class = base peripheral none64@pci0:23:30:0: class=0x088000 card=0x00008086 chip=0x20808086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E PCU Registers' class = base peripheral none65@pci0:23:30:1: class=0x088000 card=0x00008086 chip=0x20818086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E PCU Registers' class = base peripheral none66@pci0:23:30:2: class=0x088000 card=0x00008086 chip=0x20828086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E PCU Registers' class = base peripheral none67@pci0:23:30:3: class=0x088000 card=0x00008086 chip=0x20838086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E PCU Registers' class = base peripheral none68@pci0:23:30:4: class=0x088000 card=0x00008086 chip=0x20848086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E PCU Registers' class = base peripheral none69@pci0:23:30:5: class=0x088000 card=0x00008086 chip=0x20858086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E PCU Registers' class = base peripheral none70@pci0:23:30:6: class=0x088000 card=0x00008086 chip=0x20868086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E PCU Registers' class = base peripheral pcib6@pci0:24:0:0: class=0x060400 card=0xdeadbeef chip=0x37c08086 rev=0x09 hdr=0x01 vendor = 'Intel Corporation' class = bridge subclass = PCI-PCI bar [10] = type Memory, range 64, base 0xaae00000, size 131072, enabled pcib7@pci0:25:3:0: class=0x060400 card=0xdeadbeef chip=0x37c58086 rev=0x09 hdr=0x01 vendor = 'Intel Corporation' class = bridge subclass = PCI-PCI ixl0@pci0:26:0:0: class=0x020000 card=0x37d215d9 chip=0x37d28086 rev=0x09 hdr=0x00 vendor = 'Intel Corporation' device = 'Ethernet Connection X722 for 10GBASE-T' class = network subclass = ethernet bar [10] = type Prefetchable Memory, range 64, base 0xa9000000, size 16777216, enabled bar [1c] = type Prefetchable Memory, range 64, base 0xaa008000, size 32768, enabled ixl1@pci0:26:0:1: class=0x020000 card=0x37d215d9 chip=0x37d28086 rev=0x09 hdr=0x00 vendor = 'Intel Corporation' device = 'Ethernet Connection X722 for 10GBASE-T' class = network subclass = ethernet bar [10] = type Prefetchable Memory, range 64, base 0xa8000000, size 16777216, enabled bar [1c] = type Prefetchable Memory, range 64, base 0xaa000000, size 32768, enabled pcib9@pci0:58:2:0: class=0x060400 card=0x098115d9 chip=0x20328086 rev=0x04 hdr=0x01 vendor = 'Intel Corporation' device = 'Sky Lake-E PCI Express Root Port C' class = bridge subclass = PCI-PCI none71@pci0:58:5:0: class=0x088000 card=0x00008086 chip=0x20348086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' class = base peripheral none72@pci0:58:5:2: class=0x088000 card=0x00000000 chip=0x20358086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E RAS Configuration Registers' class = base peripheral ioapic2@pci0:58:5:4: class=0x080020 card=0x20368086 chip=0x20368086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' class = base peripheral subclass = interrupt controller bar [10] = type Memory, range 32, base 0xb8700000, size 4096, enabled none73@pci0:58:8:0: class=0x088000 card=0x00008086 chip=0x20668086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' class = base peripheral none74@pci0:58:9:0: class=0x088000 card=0x00008086 chip=0x20668086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' class = base peripheral none75@pci0:58:10:0: class=0x088000 card=0x00008086 chip=0x20408086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' class = base peripheral none76@pci0:58:10:1: class=0x088000 card=0x00008086 chip=0x20418086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' class = base peripheral none77@pci0:58:10:2: class=0x088000 card=0x00008086 chip=0x20428086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' class = base peripheral none78@pci0:58:10:3: class=0x088000 card=0x00008086 chip=0x20438086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' class = base peripheral none79@pci0:58:10:4: class=0x088000 card=0x00008086 chip=0x20448086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' class = base peripheral none80@pci0:58:10:5: class=0x088000 card=0x00008086 chip=0x20458086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' class = base peripheral none81@pci0:58:10:6: class=0x088000 card=0x00008086 chip=0x20468086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' class = base peripheral none82@pci0:58:10:7: class=0x088000 card=0x00008086 chip=0x20478086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' class = base peripheral none83@pci0:58:11:0: class=0x088000 card=0x00008086 chip=0x20488086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' class = base peripheral none84@pci0:58:11:1: class=0x088000 card=0x00008086 chip=0x20498086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' class = base peripheral none85@pci0:58:11:2: class=0x088000 card=0x00008086 chip=0x204a8086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' class = base peripheral none86@pci0:58:11:3: class=0x088000 card=0x00008086 chip=0x204b8086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' class = base peripheral none87@pci0:58:12:0: class=0x088000 card=0x00008086 chip=0x20408086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' class = base peripheral none88@pci0:58:12:1: class=0x088000 card=0x00008086 chip=0x20418086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' class = base peripheral none89@pci0:58:12:2: class=0x088000 card=0x00008086 chip=0x20428086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' class = base peripheral none90@pci0:58:12:3: class=0x088000 card=0x00008086 chip=0x20438086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' class = base peripheral none91@pci0:58:12:4: class=0x088000 card=0x00008086 chip=0x20448086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' class = base peripheral none92@pci0:58:12:5: class=0x088000 card=0x00008086 chip=0x20458086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' class = base peripheral none93@pci0:58:12:6: class=0x088000 card=0x00008086 chip=0x20468086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' class = base peripheral none94@pci0:58:12:7: class=0x088000 card=0x00008086 chip=0x20478086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' class = base peripheral none95@pci0:58:13:0: class=0x088000 card=0x00008086 chip=0x20488086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' class = base peripheral none96@pci0:58:13:1: class=0x088000 card=0x00008086 chip=0x20498086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' class = base peripheral none97@pci0:58:13:2: class=0x088000 card=0x00008086 chip=0x204a8086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' class = base peripheral none98@pci0:58:13:3: class=0x088000 card=0x00008086 chip=0x204b8086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' class = base peripheral mpr0@pci0:59:0:0: class=0x010700 card=0x080815d9 chip=0x00971000 rev=0x02 hdr=0x00 vendor = 'LSI Logic / Symbios Logic' device = 'SAS3008 PCI-Express Fusion-MPT SAS-3' class = mass storage subclass = SAS bar [10] = type I/O Port, range 32, base 0x7000, size 256, enabled bar [14] = type Memory, range 64, base 0xb8640000, size 65536, enabled bar [1c] = type Memory, range 64, base 0xb8600000, size 262144, enabled none99@pci0:93:5:0: class=0x088000 card=0x00008086 chip=0x20348086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' class = base peripheral none100@pci0:93:5:2: class=0x088000 card=0x00000000 chip=0x20358086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E RAS Configuration Registers' class = base peripheral ioapic3@pci0:93:5:4: class=0x080020 card=0x20368086 chip=0x20368086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' class = base peripheral subclass = interrupt controller bar [10] = type Memory, range 32, base 0xc5f00000, size 4096, enabled none101@pci0:93:14:0: class=0x110100 card=0x00008086 chip=0x20588086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' class = dasp subclass = performance counters none102@pci0:93:14:1: class=0x088000 card=0x00008086 chip=0x20598086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' class = base peripheral none103@pci0:93:15:0: class=0x110100 card=0x00008086 chip=0x20588086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' class = dasp subclass = performance counters none104@pci0:93:15:1: class=0x088000 card=0x00008086 chip=0x20598086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' class = base peripheral none105@pci0:93:18:0: class=0x110100 card=0x00008086 chip=0x204c8086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E M3KTI Registers' class = dasp subclass = performance counters none106@pci0:93:18:1: class=0x110100 card=0x00008086 chip=0x204d8086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E M3KTI Registers' class = dasp subclass = performance counters none107@pci0:93:18:2: class=0x088000 card=0x00008086 chip=0x204e8086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E M3KTI Registers' class = base peripheral none108@pci0:93:21:0: class=0x088000 card=0x00008086 chip=0x20188086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E M2PCI Registers' class = base peripheral none109@pci0:93:22:0: class=0x088000 card=0x00008086 chip=0x20188086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E M2PCI Registers' class = base peripheral none110@pci0:93:22:4: class=0x088000 card=0x00008086 chip=0x20188086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E M2PCI Registers' class = base peripheral none111@pci0:128:4:0: class=0x088000 card=0x00008086 chip=0x20218086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E CBDMA Registers' class = base peripheral bar [10] = type Memory, range 64, base 0x393ffff1c000, size 16384, enabled none112@pci0:128:4:1: class=0x088000 card=0x00008086 chip=0x20218086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E CBDMA Registers' class = base peripheral bar [10] = type Memory, range 64, base 0x393ffff18000, size 16384, enabled none113@pci0:128:4:2: class=0x088000 card=0x00008086 chip=0x20218086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E CBDMA Registers' class = base peripheral bar [10] = type Memory, range 64, base 0x393ffff14000, size 16384, enabled none114@pci0:128:4:3: class=0x088000 card=0x00008086 chip=0x20218086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E CBDMA Registers' class = base peripheral bar [10] = type Memory, range 64, base 0x393ffff10000, size 16384, enabled none115@pci0:128:4:4: class=0x088000 card=0x00008086 chip=0x20218086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E CBDMA Registers' class = base peripheral bar [10] = type Memory, range 64, base 0x393ffff0c000, size 16384, enabled none116@pci0:128:4:5: class=0x088000 card=0x00008086 chip=0x20218086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E CBDMA Registers' class = base peripheral bar [10] = type Memory, range 64, base 0x393ffff08000, size 16384, enabled none117@pci0:128:4:6: class=0x088000 card=0x00008086 chip=0x20218086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E CBDMA Registers' class = base peripheral bar [10] = type Memory, range 64, base 0x393ffff04000, size 16384, enabled none118@pci0:128:4:7: class=0x088000 card=0x00008086 chip=0x20218086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E CBDMA Registers' class = base peripheral bar [10] = type Memory, range 64, base 0x393ffff00000, size 16384, enabled none119@pci0:128:5:0: class=0x088000 card=0x00008086 chip=0x20248086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E MM/Vt-d Configuration Registers' class = base peripheral none120@pci0:128:5:2: class=0x088000 card=0x00000000 chip=0x20258086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' class = base peripheral ioapic4@pci0:128:5:4: class=0x080020 card=0x20268086 chip=0x20268086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' class = base peripheral subclass = interrupt controller bar [10] = type Memory, range 32, base 0xd3700000, size 4096, enabled none121@pci0:128:8:0: class=0x088000 card=0x00008086 chip=0x20148086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E Ubox Registers' class = base peripheral none122@pci0:128:8:1: class=0x110100 card=0x00008086 chip=0x20158086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E Ubox Registers' class = dasp subclass = performance counters none123@pci0:128:8:2: class=0x088000 card=0x00008086 chip=0x20168086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E Ubox Registers' class = base peripheral none124@pci0:133:5:0: class=0x088000 card=0x00008086 chip=0x20348086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' class = base peripheral none125@pci0:133:5:2: class=0x088000 card=0x00000000 chip=0x20358086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E RAS Configuration Registers' class = base peripheral ioapic5@pci0:133:5:4: class=0x080020 card=0x20368086 chip=0x20368086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' class = base peripheral subclass = interrupt controller bar [10] = type Memory, range 32, base 0xe0f00000, size 4096, enabled none126@pci0:133:8:0: class=0x088000 card=0x00008086 chip=0x208d8086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E CHA Registers' class = base peripheral none127@pci0:133:8:1: class=0x088000 card=0x00008086 chip=0x208d8086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E CHA Registers' class = base peripheral none128@pci0:133:8:2: class=0x088000 card=0x00008086 chip=0x208d8086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E CHA Registers' class = base peripheral none129@pci0:133:8:3: class=0x088000 card=0x00008086 chip=0x208d8086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E CHA Registers' class = base peripheral none130@pci0:133:8:4: class=0x088000 card=0x00008086 chip=0x208d8086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E CHA Registers' class = base peripheral none131@pci0:133:8:5: class=0x088000 card=0x00008086 chip=0x208d8086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E CHA Registers' class = base peripheral none132@pci0:133:8:6: class=0x088000 card=0x00008086 chip=0x208d8086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E CHA Registers' class = base peripheral none133@pci0:133:8:7: class=0x088000 card=0x00008086 chip=0x208d8086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E CHA Registers' class = base peripheral none134@pci0:133:9:0: class=0x088000 card=0x00008086 chip=0x208d8086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E CHA Registers' class = base peripheral none135@pci0:133:9:1: class=0x088000 card=0x00008086 chip=0x208d8086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E CHA Registers' class = base peripheral none136@pci0:133:9:2: class=0x088000 card=0x00008086 chip=0x208d8086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E CHA Registers' class = base peripheral none137@pci0:133:9:3: class=0x088000 card=0x00008086 chip=0x208d8086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E CHA Registers' class = base peripheral none138@pci0:133:9:4: class=0x088000 card=0x00008086 chip=0x208d8086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E CHA Registers' class = base peripheral none139@pci0:133:9:5: class=0x088000 card=0x00008086 chip=0x208d8086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E CHA Registers' class = base peripheral none140@pci0:133:9:6: class=0x088000 card=0x00008086 chip=0x208d8086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E CHA Registers' class = base peripheral none141@pci0:133:9:7: class=0x088000 card=0x00008086 chip=0x208d8086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E CHA Registers' class = base peripheral none142@pci0:133:10:0: class=0x088000 card=0x00008086 chip=0x208d8086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E CHA Registers' class = base peripheral none143@pci0:133:10:1: class=0x088000 card=0x00008086 chip=0x208d8086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E CHA Registers' class = base peripheral none144@pci0:133:14:0: class=0x088000 card=0x00008086 chip=0x208e8086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E CHA Registers' class = base peripheral none145@pci0:133:14:1: class=0x088000 card=0x00008086 chip=0x208e8086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E CHA Registers' class = base peripheral none146@pci0:133:14:2: class=0x088000 card=0x00008086 chip=0x208e8086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E CHA Registers' class = base peripheral none147@pci0:133:14:3: class=0x088000 card=0x00008086 chip=0x208e8086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E CHA Registers' class = base peripheral none148@pci0:133:14:4: class=0x088000 card=0x00008086 chip=0x208e8086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E CHA Registers' class = base peripheral none149@pci0:133:14:5: class=0x088000 card=0x00008086 chip=0x208e8086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E CHA Registers' class = base peripheral none150@pci0:133:14:6: class=0x088000 card=0x00008086 chip=0x208e8086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E CHA Registers' class = base peripheral none151@pci0:133:14:7: class=0x088000 card=0x00008086 chip=0x208e8086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E CHA Registers' class = base peripheral none152@pci0:133:15:0: class=0x088000 card=0x00008086 chip=0x208e8086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E CHA Registers' class = base peripheral none153@pci0:133:15:1: class=0x088000 card=0x00008086 chip=0x208e8086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E CHA Registers' class = base peripheral none154@pci0:133:15:2: class=0x088000 card=0x00008086 chip=0x208e8086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E CHA Registers' class = base peripheral none155@pci0:133:15:3: class=0x088000 card=0x00008086 chip=0x208e8086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E CHA Registers' class = base peripheral none156@pci0:133:15:4: class=0x088000 card=0x00008086 chip=0x208e8086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E CHA Registers' class = base peripheral none157@pci0:133:15:5: class=0x088000 card=0x00008086 chip=0x208e8086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E CHA Registers' class = base peripheral none158@pci0:133:15:6: class=0x088000 card=0x00008086 chip=0x208e8086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E CHA Registers' class = base peripheral none159@pci0:133:15:7: class=0x088000 card=0x00008086 chip=0x208e8086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E CHA Registers' class = base peripheral none160@pci0:133:16:0: class=0x088000 card=0x00008086 chip=0x208e8086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E CHA Registers' class = base peripheral none161@pci0:133:16:1: class=0x088000 card=0x00008086 chip=0x208e8086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E CHA Registers' class = base peripheral none162@pci0:133:29:0: class=0x088000 card=0x00008086 chip=0x20548086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E CHA Registers' class = base peripheral none163@pci0:133:29:1: class=0x088000 card=0x00008086 chip=0x20558086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E CHA Registers' class = base peripheral none164@pci0:133:29:2: class=0x088000 card=0x00008086 chip=0x20568086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E CHA Registers' class = base peripheral none165@pci0:133:29:3: class=0x088000 card=0x00008086 chip=0x20578086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E CHA Registers' class = base peripheral none166@pci0:133:30:0: class=0x088000 card=0x00008086 chip=0x20808086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E PCU Registers' class = base peripheral none167@pci0:133:30:1: class=0x088000 card=0x00008086 chip=0x20818086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E PCU Registers' class = base peripheral none168@pci0:133:30:2: class=0x088000 card=0x00008086 chip=0x20828086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E PCU Registers' class = base peripheral none169@pci0:133:30:3: class=0x088000 card=0x00008086 chip=0x20838086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E PCU Registers' class = base peripheral none170@pci0:133:30:4: class=0x088000 card=0x00008086 chip=0x20848086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E PCU Registers' class = base peripheral none171@pci0:133:30:5: class=0x088000 card=0x00008086 chip=0x20858086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E PCU Registers' class = base peripheral none172@pci0:133:30:6: class=0x088000 card=0x00008086 chip=0x20868086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E PCU Registers' class = base peripheral none173@pci0:174:5:0: class=0x088000 card=0x00008086 chip=0x20348086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' class = base peripheral none174@pci0:174:5:2: class=0x088000 card=0x00000000 chip=0x20358086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E RAS Configuration Registers' class = base peripheral ioapic6@pci0:174:5:4: class=0x080020 card=0x20368086 chip=0x20368086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' class = base peripheral subclass = interrupt controller bar [10] = type Memory, range 32, base 0xee700000, size 4096, enabled none175@pci0:174:8:0: class=0x088000 card=0x00008086 chip=0x20668086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' class = base peripheral none176@pci0:174:9:0: class=0x088000 card=0x00008086 chip=0x20668086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' class = base peripheral none177@pci0:174:10:0: class=0x088000 card=0x00008086 chip=0x20408086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' class = base peripheral none178@pci0:174:10:1: class=0x088000 card=0x00008086 chip=0x20418086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' class = base peripheral none179@pci0:174:10:2: class=0x088000 card=0x00008086 chip=0x20428086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' class = base peripheral none180@pci0:174:10:3: class=0x088000 card=0x00008086 chip=0x20438086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' class = base peripheral none181@pci0:174:10:4: class=0x088000 card=0x00008086 chip=0x20448086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' class = base peripheral none182@pci0:174:10:5: class=0x088000 card=0x00008086 chip=0x20458086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' class = base peripheral none183@pci0:174:10:6: class=0x088000 card=0x00008086 chip=0x20468086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' class = base peripheral none184@pci0:174:10:7: class=0x088000 card=0x00008086 chip=0x20478086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' class = base peripheral none185@pci0:174:11:0: class=0x088000 card=0x00008086 chip=0x20488086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' class = base peripheral none186@pci0:174:11:1: class=0x088000 card=0x00008086 chip=0x20498086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' class = base peripheral none187@pci0:174:11:2: class=0x088000 card=0x00008086 chip=0x204a8086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' class = base peripheral none188@pci0:174:11:3: class=0x088000 card=0x00008086 chip=0x204b8086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' class = base peripheral none189@pci0:174:12:0: class=0x088000 card=0x00008086 chip=0x20408086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' class = base peripheral none190@pci0:174:12:1: class=0x088000 card=0x00008086 chip=0x20418086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' class = base peripheral none191@pci0:174:12:2: class=0x088000 card=0x00008086 chip=0x20428086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' class = base peripheral none192@pci0:174:12:3: class=0x088000 card=0x00008086 chip=0x20438086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' class = base peripheral none193@pci0:174:12:4: class=0x088000 card=0x00008086 chip=0x20448086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' class = base peripheral none194@pci0:174:12:5: class=0x088000 card=0x00008086 chip=0x20458086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' class = base peripheral none195@pci0:174:12:6: class=0x088000 card=0x00008086 chip=0x20468086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' class = base peripheral none196@pci0:174:12:7: class=0x088000 card=0x00008086 chip=0x20478086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' class = base peripheral none197@pci0:174:13:0: class=0x088000 card=0x00008086 chip=0x20488086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' class = base peripheral none198@pci0:174:13:1: class=0x088000 card=0x00008086 chip=0x20498086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' class = base peripheral none199@pci0:174:13:2: class=0x088000 card=0x00008086 chip=0x204a8086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' class = base peripheral none200@pci0:174:13:3: class=0x088000 card=0x00008086 chip=0x204b8086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' class = base peripheral none201@pci0:215:5:0: class=0x088000 card=0x00008086 chip=0x20348086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' class = base peripheral none202@pci0:215:5:2: class=0x088000 card=0x00000000 chip=0x20358086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E RAS Configuration Registers' class = base peripheral ioapic7@pci0:215:5:4: class=0x080020 card=0x20368086 chip=0x20368086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' class = base peripheral subclass = interrupt controller bar [10] = type Memory, range 32, base 0xfbf00000, size 4096, enabled none203@pci0:215:14:0: class=0x110100 card=0x00008086 chip=0x20588086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' class = dasp subclass = performance counters none204@pci0:215:14:1: class=0x088000 card=0x00008086 chip=0x20598086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' class = base peripheral none205@pci0:215:15:0: class=0x110100 card=0x00008086 chip=0x20588086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' class = dasp subclass = performance counters none206@pci0:215:15:1: class=0x088000 card=0x00008086 chip=0x20598086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' class = base peripheral none207@pci0:215:18:0: class=0x110100 card=0x00008086 chip=0x204c8086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E M3KTI Registers' class = dasp subclass = performance counters none208@pci0:215:18:1: class=0x110100 card=0x00008086 chip=0x204d8086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E M3KTI Registers' class = dasp subclass = performance counters none209@pci0:215:18:2: class=0x088000 card=0x00008086 chip=0x204e8086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E M3KTI Registers' class = base peripheral none210@pci0:215:21:0: class=0x088000 card=0x00008086 chip=0x20188086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E M2PCI Registers' class = base peripheral none211@pci0:215:22:0: class=0x088000 card=0x00008086 chip=0x20188086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E M2PCI Registers' class = base peripheral none212@pci0:215:22:4: class=0x088000 card=0x00008086 chip=0x20188086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake-E M2PCI Registers' class = base peripheral # grep swap /etc/fstab ; echo #/dev/mirror/swap none swap sw /dev/gpt/swap0 none swap sw #/dev/gpt/swap1 none swap sw # swapinfo -h Device 1024-blocks Used Avail Capacity /dev/gpt/swap0 16777216 0B 16G 0% # ls -ltr /var/crash/ total 3844652 -rw-r--r-- 1 root wheel 5 Jun 21 21:34 minfree -rw------- 1 root wheel 462 Jul 5 11:46 info.0 -rw------- 1 root wheel 5043531776 Jul 5 11:47 vmcore.0 -rw------- 1 root wheel 128912 Jul 5 11:47 core.txt.0 -rw------- 1 root wheel 464 Jul 6 12:24 info.1 -rw------- 1 root wheel 3628683264 Jul 6 12:24 vmcore.1 -rw------- 1 root wheel 127947 Jul 6 12:24 core.txt.1 -rw-r--r-- 1 root wheel 639 Jul 9 12:51 ls.out.0 -rw-r--r-- 1 root wheel 3960 Jul 11 06:36 zpool-iostat.out -rw------- 1 root wheel 464 Jul 11 12:47 info.2 -rw------- 1 root wheel 3777585152 Jul 11 12:48 vmcore.2 -rw------- 1 root wheel 127775 Jul 11 12:48 core.txt.2 -rw-r--r-- 1 root wheel 0 Jul 11 13:12 zfs-stress.start -rw-r--r-- 1 root wheel 2 Jul 11 13:37 bounds -rw------- 1 root wheel 458 Jul 11 13:37 info.3 -rw------- 1 root wheel 7352229888 Jul 11 13:38 vmcore.3 lrwxr-xr-x 1 root wheel 6 Jul 11 13:38 info.last@ -> info.3 lrwxr-xr-x 1 root wheel 8 Jul 11 13:38 vmcore.last@ -> vmcore.3 -rw------- 1 root wheel 143973 Jul 11 13:38 core.txt.3
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?20180711212959.GA81029>