Skip site navigation (1)Skip section navigation (2)


index | | raw e-mail

The NPT exits keeps going up at a rate of about 150k/second. So my assumption is that nested page table faults are not getting handled correctly and it's just repeatedly faulting, likely on the same address.

But at this point, I'm stuck, I don't know exactly what's failing or what might have changed from FreeBSD 14 to 15 to cause this change in behavior. If anyone has any suggestions of other things to try to track this down, I'd appreciate it!

dmesg:

---<<BOOT>>---
Copyright (c) 1992-2025 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
	The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 15.0-STABLE stable/15-n281506-b94c971dd0cf GENERIC amd64
FreeBSD clang version 19.1.7 (https://github.com/llvm/llvm-project.git llvmorg-19.1.7-0-gcd708029e0b2)
VT(efifb): resolution 1024x768
CPU: AMD Ryzen Threadripper 7960X 24-Cores           (4193.85-MHz K8-class CPU)
  Origin="AuthenticAMD"  Id=0xa10f81  Family=0x19  Model=0x18  Stepping=1
  Features=0x178bfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,MMX,FXSR,SSE,SSE2,HTT>
  Features2=0x7efa320b<SSE3,PCLMULQDQ,MON,SSSE3,FMA,CX16,PCID,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,AESNI,XSAVE,OSXSAVE,AVX,F16C,RDRAND>
  AMD Features=0x2e500800<SYSCALL,NX,MMX+,FFXSR,Page1GB,RDTSCP,LM>
  AMD Features2=0x75c237ff<LAHF,CMP,SVM,ExtAPIC,CR8,ABM,SSE4A,MAS,Prefetch,OSVW,IBS,SKINIT,WDT,TCE,Topology,PCXC,PNXC,DBE,PL2I,MWAITX,ADMSKX>
  Structured Extended Features=0xf1bf97a9<FSGSBASE,BMI1,AVX2,SMEP,BMI2,ERMS,INVPCID,PQM,PQE,AVX512F,AVX512DQ,RDSEED,ADX,SMAP,AVX512IFMA,CLFLUSHOPT,CLWB,AVX512CD,SHA,AVX512BW,AVX512VL>
  Structured Extended Features2=0x415fde<AVX512VBMI,UMIP,PKU,OSPKE,AVX512VBMI2,GFNI,VAES,VPCLMULQDQ,AVX512VNNI,AVX512BITALG,AVX512VPOPCNTDQ,LA57,RDPID>
  Structured Extended Features3=0x10000010<FSRM,L1DFL>
  XSAVE Features=0xf<XSAVEOPT,XSAVEC,XINUSE,XSAVES>
  AMD Extended Feature Extensions ID EBX=0x79bef25f<CLZERO,IRPerf,XSaveErPtr,INVLPGB,RDPRU,BE,WBNOINVD,IBPB,INT_WBINVD,IBRS,STIBP,STIBP_ALWAYSON,PREFER_IBRS,SAMEMODE_IBRS,NOLMSLE,INVLPGBNEST,PPIN,SSBD,CPPC,PSFD,BTC_NO,IBPB_RET>
  SVM: NP,NRIP,VClean,AFlush,DAssist,NAsids=32768
  TSC: P-state invariant, performance statistics
real memory  = 137434759168 (131068 MB)
avail memory = 133773152256 (127576 MB)
Event timer "LAPIC" quality 600
ACPI APIC Table: <AMD    A M I >
FreeBSD/SMP: Multiprocessor System Detected: 48 CPUs
FreeBSD/SMP: 1 package(s) x 4 cache groups x 6 core(s) x 2 hardware threads
random: registering fast source Intel Secure Key Seed
random: fast provider: "Intel Secure Key Seed"
random: unblocking device.
ioapic0 <Version 2.1> irqs 0-23
ioapic1 <Version 2.1> irqs 120-151
ioapic2 <Version 2.1> irqs 88-119
ioapic3 <Version 2.1> irqs 24-55
ioapic4 <Version 2.1> irqs 56-87
Launching APs: 22 23 1 10 24 11 25 21 19 16 14 13 29 33 26 31 35 39 40 45 36 47 43 17 32 28 12 18 27 34 30 20 7 2 4 9 5 46 3 41 37 38 42 44 15 8 6
random: entropy device external interface
kbd0 at kbdmux0
efirtc0: <EFI Realtime Clock>
efirtc0: registered as a time-of-day clock, resolution 1.000000s
smbios0: <System Management BIOS> at iomem 0x6e01d000-0x6e01d017
smbios0: Entry point: v3 (64-bit), Version: 3.6
aesni0: <AES-CBC,AES-CCM,AES-GCM,AES-ICM,AES-XTS,SHA1,SHA256>
acpi0: <AMD A M I >
acpi0: Power Button (fixed)
AMD-Vi: IVRS Info VAsize = 64 PAsize = 52 GVAsize = 3 flags:0
attimer0: <AT timer> port 0x40-0x43 irq 0 on acpi0
Timecounter "i8254" frequency 1193182 Hz quality 0
Event timer "i8254" frequency 1193182 Hz quality 100
atrtc0: <AT realtime clock> port 0x70-0x71 on acpi0
atrtc0: registered as a time-of-day clock, resolution 1.000000s
Event timer "RTC" frequency 32768 Hz quality 0
hpet0: <High Precision Event Timer> iomem 0xfed00000-0xfed003ff irq 0,8 on acpi0
Timecounter "HPET" frequency 14318180 Hz quality 950
Event timer "HPET" frequency 14318180 Hz quality 350
Event timer "HPET1" frequency 14318180 Hz quality 350
Event timer "HPET2" frequency 14318180 Hz quality 350
Timecounter "ACPI-fast" frequency 3579545 Hz quality 900
acpi_timer0: <32-bit timer at 3.579545MHz> port 0x808-0x80b on acpi0
acpi_ec0: <Embedded Controller: GPE 0x6> port 0x62,0x66 on acpi0
pcib0: <ACPI Host-PCI bridge> on acpi0
pci0: <ACPI PCI bus> on pcib0
amdviiommu0 at device 0.2 on pci0
pci0: <old, non-VGA display device> at device 1.1 (no driver attached)
pci0: <old, non-VGA display device> at device 1.2 (no driver attached)
pci0: <old, non-VGA display device> at device 1.3 (no driver attached)
pci0: <old, non-VGA display device> at device 1.4 (no driver attached)
pci0: <old, non-VGA display device> at device 1.5 (no driver attached)
pci0: <old, non-VGA display device> at device 1.6 (no driver attached)
pci0: <old, non-VGA display device> at device 1.7 (no driver attached)
pci0: <old, non-VGA display device> at device 2.1 (no driver attached)
pci0: <old, non-VGA display device> at device 2.2 (no driver attached)
pci0: <old, non-VGA display device> at device 3.1 (no driver attached)
pci0: <old, non-VGA display device> at device 3.2 (no driver attached)
pci0: <old, non-VGA display device> at device 3.3 (no driver attached)
pci0: <old, non-VGA display device> at device 3.4 (no driver attached)
pci0: <old, non-VGA display device> at device 3.5 (no driver attached)
pci0: <old, non-VGA display device> at device 3.6 (no driver attached)
pci0: <old, non-VGA display device> at device 3.7 (no driver attached)
pci0: <old, non-VGA display device> at device 4.1 (no driver attached)
pci0: <old, non-VGA display device> at device 4.2 (no driver attached)
pcib1: <ACPI PCI-PCI bridge> at device 7.1 on pci0
pci1: <ACPI PCI bus> on pcib1
xhci0: <XHCI (generic) USB 3.0 controller> mem 0xf3600000-0xf36fffff at device 0.4 on pci1
xhci0: 64 bytes context size, 64-bit DMA
xhci0: xECP capabilities <LEGACY,PROTO,PROTO,PROTO,DEBUG>
usbus0 on xhci0
usbus0: 5.0Gbps Super Speed USB v3.0
pcib2: <ACPI Host-PCI bridge> on acpi0
pci2: <ACPI PCI bus> on pcib2
amdviiommu1 at device 0.2 on pci2
pcib3: <ACPI PCI-PCI bridge> at device 1.1 on pci2
pci3: <ACPI PCI bus> on pcib3
nvme0: <Generic NVMe Device> mem 0xf2500000-0xf2503fff at device 0.0 on pci3
pcib4: <ACPI PCI-PCI bridge> at device 1.2 on pci2
pci4: <ACPI PCI bus> on pcib4
nvme1: <Generic NVMe Device> mem 0xf2400000-0xf2403fff at device 0.0 on pci4
pcib5: <ACPI PCI-PCI bridge> at device 1.3 on pci2
pci5: <ACPI PCI bus> on pcib5
ix0: <Intel(R) X520 82599ES (SFI/SFP+)> port 0x3020-0x303f mem 0xf2080000-0xf20fffff,0xf2104000-0xf2107fff at device 0.0 on pci5
ix0: Using 2048 TX descriptors and 2048 RX descriptors
ix0: Using 16 RX queues 16 TX queues
ix0: Using MSI-X interrupts with 17 vectors
ix0: allocated for 16 queues
ix0: allocated for 16 rx queues
ix0: Ethernet address: 98:b7:85:1f:f8:0e
ix0: PCI Express Bus: Speed 5.0GT/s Width x8
ix0: Option ROM V1-b2960-p0 eTrack 0x800006d1
ix0: netmap queues/slots: TX 16/2048, RX 16/2048
ix1: <Intel(R) X520 82599ES (SFI/SFP+)> port 0x3000-0x301f mem 0xf1f80000-0xf1ffffff,0xf2100000-0xf2103fff at device 0.1 on pci5
ix1: Using 2048 TX descriptors and 2048 RX descriptors
ix1: Using 16 RX queues 16 TX queues
ix1: Using MSI-X interrupts with 17 vectors
ix1: allocated for 16 queues
ix1: allocated for 16 rx queues
ix1: Ethernet address: 98:b7:85:1f:f8:0f
ix1: PCI Express Bus: Speed 5.0GT/s Width x8
ix1: Option ROM V1-b2960-p0 eTrack 0x800006d1
ix1: netmap queues/slots: TX 16/2048, RX 16/2048
pcib6: <ACPI PCI-PCI bridge> at device 3.1 on pci2
pci6: <ACPI PCI bus> on pcib6
mpr0: <Avago Technologies (LSI) SAS3416> port 0x2000-0x20ff mem 0x10020900000-0x100209fffff,0x10020800000-0x100208fffff,0xf2200000-0xf22fffff at device 0.0 on pci6
mpr0: Firmware: 06.00.16.00, Driver: 23.00.00.00-fbsd
mpr0: IOCCapabilities: fa84c<ScsiTaskFull,DiagTrace,EEDP,TransRetry,EventReplay,MSIXIndex,HostDisc,FastPath,RDPQArray,AtomicReqDesc>
pcib7: <ACPI PCI-PCI bridge> at device 7.1 on pci2
pci7: <ACPI PCI bus> on pcib7
pci2: <old, non-VGA display device> at device 7.2 (no driver attached)
pcib8: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0
pci8: <ACPI PCI bus> on pcib8
amdviiommu2 at device 0.2 on pci8
pcib9: <ACPI PCI-PCI bridge> at device 1.1 on pci8
pci9: <ACPI PCI bus> on pcib9
vgapci0: <VGA-compatible display> port 0x1000-0x10ff mem 0x10090000000-0x1009fffffff,0x80320000-0x8033ffff at device 0.0 on pci9
hdac0: <ATI RV910 HDA Controller> mem 0x80340000-0x80343fff at device 0.1 on pci9
pci8: <old, non-VGA display device> at device 3.1 (no driver attached)
pci8: <old, non-VGA display device> at device 3.2 (no driver attached)
pci8: <old, non-VGA display device> at device 3.3 (no driver attached)
pci8: <old, non-VGA display device> at device 3.4 (no driver attached)
pci8: <old, non-VGA display device> at device 3.5 (no driver attached)
pci8: <old, non-VGA display device> at device 3.6 (no driver attached)
pci8: <old, non-VGA display device> at device 3.7 (no driver attached)
pci8: <old, non-VGA display device> at device 4.1 (no driver attached)
pci8: <old, non-VGA display device> at device 4.2 (no driver attached)
pcib10: <ACPI PCI-PCI bridge> at device 5.1 on pci8
pci10: <ACPI PCI bus> on pcib10
pcib11: <ACPI PCI-PCI bridge> at device 5.2 on pci8
pci11: <ACPI PCI bus> on pcib11
pcib12: <ACPI PCI-PCI bridge> at device 5.3 on pci8
pci12: <ACPI PCI bus> on pcib12
pcib13: <ACPI PCI-PCI bridge> at device 5.4 on pci8
pci13: <ACPI PCI bus> on pcib13
pcib14: <ACPI PCI-PCI bridge> at device 7.1 on pci8
pci14: <ACPI PCI bus> on pcib14
xhci1: <XHCI (generic) USB 3.0 controller> mem 0x80100000-0x801fffff at device 0.4 on pci14
xhci1: 64 bytes context size, 64-bit DMA
xhci1: xECP capabilities <LEGACY,PROTO,PROTO,PROTO,DEBUG>
usbus1 on xhci1
usbus1: 5.0Gbps Super Speed USB v3.0
pci14: <encrypt/decrypt> at device 0.5 (no driver attached)
hdac1: <AMD (0x14cc) HDA Controller> mem 0x80200000-0x80207fff at device 0.7 on pci14
isab0: <PCI-ISA bridge> at device 20.3 on pci8
isa0: <ISA bus> on isab0
pcib15: <ACPI Host-PCI bridge> on acpi0
pci15: <ACPI PCI bus> on pcib15
amdviiommu3 at device 0.2 on pci15
pcib16: <ACPI PCI-PCI bridge> at device 3.2 on pci15
pci16: <ACPI PCI bus> on pcib16
pci16: <network, ethernet> at device 0.0 (no driver attached)
pcib17: <ACPI PCI-PCI bridge> at device 3.3 on pci15
pci17: <ACPI PCI bus> on pcib17
igc0: <Intel(R) Ethernet Controller I226-LM> mem 0xf0c00000-0xf0cfffff,0xf0d00000-0xf0d03fff at device 0.0 on pci17
igc0: EEPROM V2.17-0 eTrack 0x80000307
igc0: Using 1024 TX descriptors and 1024 RX descriptors
igc0: Using 4 RX queues 4 TX queues
igc0: Using MSI-X interrupts with 5 vectors
igc0: Ethernet address: 60:cf:84:d8:9c:b4
igc0: netmap queues/slots: TX 4/1024, RX 4/1024
pcib18: <ACPI PCI-PCI bridge> at device 3.4 on pci15
pci18: <ACPI PCI bus> on pcib18
pci18: <network> at device 0.0 (no driver attached)
pcib19: <ACPI PCI-PCI bridge> at device 3.5 on pci15
pci19: <ACPI PCI bus> on pcib19
xhci2: <ASMedia ASM3242 USB 3.2 controller> mem 0xf0e00000-0xf0e07fff at device 0.0 on pci19
xhci2: 32 bytes context size, 64-bit DMA
xhci2: xECP capabilities <LEGACY,PROTO,PROTO,DEBUG>
usbus2 on xhci2
usbus2: 5.0Gbps Super Speed USB v3.0
pcib20: <ACPI PCI-PCI bridge> at device 3.6 on pci15
pci20: <ACPI PCI bus> on pcib20
pcib21: <ACPI PCI-PCI bridge> at device 0.0 on pci20
pci21: <ACPI PCI bus> on pcib21
pcib22: <ACPI PCI-PCI bridge> at device 12.0 on pci21
ACPI Warning: \134_SB.PCI1.GPPE.UP00.DP60._PRT: Return Package has no elements (empty) (20250807/nsprepkg-251)
pci22: <ACPI PCI bus> on pcib22
xhci3: <AMD 600 Series USB 3.2 controller> mem 0xf0b00000-0xf0b07fff at device 0.0 on pci22
xhci3: 32 bytes context size, 64-bit DMA
xhci3: xECP capabilities <LEGACY,PROTO,PROTO,PROTO,DEBUG>
usbus3 on xhci3
usbus3: 5.0Gbps Super Speed USB v3.0
pcib23: <PCI-PCI bridge> at device 13.0 on pci21
pci23: <PCI bus> on pcib23
ahci0: <AMD 600 Series AHCI SATA controller> mem 0xf0a80000-0xf0a803ff at device 0.0 on pci23
ahci0: AHCI v1.31 with 6 6Gbps ports, Port Multiplier supported
ahcich0: <AHCI channel> at channel 0 on ahci0
ahcich1: <AHCI channel> at channel 1 on ahci0
ahcich2: <AHCI channel> at channel 2 on ahci0
ahcich3: <AHCI channel> at channel 3 on ahci0
pcib24: <ACPI PCI-PCI bridge> at device 7.1 on pci15
pci24: <ACPI PCI bus> on pcib24
pci15: <old, non-VGA display device> at device 7.2 (no driver attached)
acpi_button0: <Power Button> on acpi0
acpi_syscontainer0: <System Container> on acpi0
apei0: <ACPI Platform Error Interface> on acpi0
cpu0: <ACPI CPU> on acpi0
uart: ns8250: UART FCR is broken (0x1)
uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0
ivhd0: <AMD-Vi/IOMMU ivhd with EFR> on acpi0
ivhd0: Flag:30<IotlbSup,Coherent>
ivhd0: Features(type:0x11) MsiNumPPR = 0 PNBanks= 2 PNCounters= 4
ivhd0: Extended features[31:0]:a2295afe<PPRSup,<b2>,NXSup,GTSup,<b5>,IASup,GASup,PCSup> HATS = 0x2 GATS = 0x1 GLXSup = 0x1 SmiFSup = 0x1 SmiFRC = 0x2 GAMSup = 0x1 DualPortLogSup = 0x2 DualEventLogSup = 0x2
ivhd0: Extended features[62:32]:25bf732f<USSup,PprOvrflwEarlySup,PPRAutoRspSup,BlKStopMrkSup,PerfOptSup,MsiCapMmioSup,GIOSup,HASup,EPHSup,AttrFWSup,HDSup> Max PASID: 0x2f DevTblSegSup = 0x2 MarcSup = 0x0
ivhd0: supported paging level:7, will use only: 4
ivhd0: device [0xc003 - 0xfffe] config:0
ivhd0: PCI cap 0x190b640f@0x40 feature:19<IOTLB,EFR,CapExt>
ivhd1: <AMD-Vi/IOMMU ivhd with EFR> on acpi0
ivhd1: Flag:30<IotlbSup,Coherent>
ivhd1: Features(type:0x11) MsiNumPPR = 0 PNBanks= 2 PNCounters= 4
ivhd1: Extended features[31:0]:a2295afe<PPRSup,<b2>,NXSup,GTSup,<b5>,IASup,GASup,PCSup> HATS = 0x2 GATS = 0x1 GLXSup = 0x1 SmiFSup = 0x1 SmiFRC = 0x2 GAMSup = 0x1 DualPortLogSup = 0x2 DualEventLogSup = 0x2
ivhd1: Extended features[62:32]:25bf732f<USSup,PprOvrflwEarlySup,PPRAutoRspSup,BlKStopMrkSup,PerfOptSup,MsiCapMmioSup,GIOSup,HASup,EPHSup,AttrFWSup,HDSup> Max PASID: 0x2f DevTblSegSup = 0x2 MarcSup = 0x0
ivhd1: supported paging level:7, will use only: 4
ivhd1: device [0x8003 - 0xbffe] config:0
ivhd1: PCI cap 0x190b640f@0x40 feature:19<IOTLB,EFR,CapExt>
ivhd2: <AMD-Vi/IOMMU ivhd with EFR> on acpi0
ivhd2: Flag:30<IotlbSup,Coherent>
ivhd2: Features(type:0x11) MsiNumPPR = 0 PNBanks= 2 PNCounters= 4
ivhd2: Extended features[31:0]:a2295afe<PPRSup,<b2>,NXSup,GTSup,<b5>,IASup,GASup,PCSup> HATS = 0x2 GATS = 0x1 GLXSup = 0x1 SmiFSup = 0x1 SmiFRC = 0x2 GAMSup = 0x1 DualPortLogSup = 0x2 DualEventLogSup = 0x2
ivhd2: Extended features[62:32]:25bf732f<USSup,PprOvrflwEarlySup,PPRAutoRspSup,BlKStopMrkSup,PerfOptSup,MsiCapMmioSup,GIOSup,HASup,EPHSup,AttrFWSup,HDSup> Max PASID: 0x2f DevTblSegSup = 0x2 MarcSup = 0x0
ivhd2: supported paging level:7, will use only: 4
ivhd2: device [0x3 - 0x3ffe] config:0
ivhd2: device [0xff00 - 0xffff] config:0
ivhd2: PCI cap 0x190b640f@0x40 feature:19<IOTLB,EFR,CapExt>
ivhd3: <AMD-Vi/IOMMU ivhd with EFR> on acpi0
ivhd3: Flag:30<IotlbSup,Coherent>
ivhd3: Features(type:0x11) MsiNumPPR = 0 PNBanks= 2 PNCounters= 4
ivhd3: Extended features[31:0]:a2295afe<PPRSup,<b2>,NXSup,GTSup,<b5>,IASup,GASup,PCSup> HATS = 0x2 GATS = 0x1 GLXSup = 0x1 SmiFSup = 0x1 SmiFRC = 0x2 GAMSup = 0x1 DualPortLogSup = 0x2 DualEventLogSup = 0x2
ivhd3: Extended features[62:32]:25bf732f<USSup,PprOvrflwEarlySup,PPRAutoRspSup,BlKStopMrkSup,PerfOptSup,MsiCapMmioSup,GIOSup,HASup,EPHSup,AttrFWSup,HDSup> Max PASID: 0x2f DevTblSegSup = 0x2 MarcSup = 0x0
ivhd3: supported paging level:7, will use only: 4
ivhd3: device [0x4003 - 0x7ffe] config:0
ivhd3: PCI cap 0x190b640f@0x40 feature:19<IOTLB,EFR,CapExt>
hwpstate0: <Cool`n'Quiet 2.0> on cpu0
cpufreq0: <CPU frequency control> on cpu0
Timecounter "TSC-low" frequency 2096849600 Hz quality 1000
Timecounters tick every 1.000 msec
ugen1.1: <AMD XHCI root HUB> at usbus1
ugen0.1: <AMD XHCI root HUB> at usbus0
ugen2.1: <(0x1b21) XHCI root HUB> at usbus2
ZFS filesystem version: 5
uhub0 on usbus0
uhub0: <AMD XHCI root HUB, class 9/0, rev 3.00/1.00, addr 1> on usbus0
ugen3.1: <AMD XHCI root HUB> at usbus3
ZFS storage pool version: features support (5000)
uhub1 on usbus3
uhub1: <AMD XHCI root HUB, class 9/0, rev 3.00/1.00, addr 1> on usbus3
uhub2 on usbus1
uhub2: <AMD XHCI root HUB, class 9/0, rev 3.00/1.00, addr 1> on usbus1
uhub3 on usbus2
uhub3: <(0x1b21) XHCI root HUB, class 9/0, rev 3.00/1.00, addr 1> on usbus2
hdacc0: <ATI R6xx HDA CODEC> at cad 0 on hdac0
hdaa0: <ATI R6xx Audio Function Group> at nid 1 on hdacc0
mpr0: Found device <c01<SspTarg,Direct>,End Device> <12.0Gbps> handle<0x0012> enclosureHandle<0x0001> slot 12
pcm0: <ATI R6xx (HDMI)>mpr0: At enclosure level 0 and connector name (C3  )
 at nid 3 on hdaa0
mpr0: Found device <881<SataDev,Direct>,End Device> <6.0Gbps> handle<0x0015> enclosureHandle<0x0001> slot 8
mpr0: At enclosure level 0 and connector name (C2  )
hdacc1: <Realtek ALC1220 HDA CODEC>mpr0: Found device <c01<SspTarg,Direct>,End Device> <12.0Gbps> handle<0x0014> enclosureHandle<0x0001> slot 13
 at cad 0 on hdac1
hdaa1: <Realtek ALC1220 Audio Function Group>mpr0: At enclosure level 0 and connector name (C3  )
 at nid 1 on hdacc1
mpr0: Found device <881<SataDev,Direct>,End Device> <6.0Gbps> handle<0x0016> enclosureHandle<0x0001> slot 9
mpr0: At enclosure level 0 and connector name (C2  )
mpr0: Found device <c01<SspTarg,Direct>,End Device> <12.0Gbps> handle<0x0013> enclosureHandle<0x0001> slot 14
mpr0: At enclosure level 0 and connector name (C3  )
pcm1: <Realtek ALC1220 (Rear Analog)> at nid 20 and 26 on hdaa1
mpr0: Found device <881<SataDev,Direct>,End Device> <6.0Gbps> handle<0x0017> enclosureHandle<0x0001> slot 10
mpr0: At enclosure level 0 and connector name (C2  )
mpr0: Found device <881<SataDev,Direct>,End Device> <6.0Gbps> handle<0x0018> enclosureHandle<0x0001> slot 11
pcm2: <Realtek ALC1220 (Front Analog)>mpr0: At enclosure level 0 and connector name (C2  )
 at nid 27 and 25 on hdaa1
mpr0: Found device <881<SataDev,Direct>,End Device> <6.0Gbps> handle<0x0019> enclosureHandle<0x0001> slot 4
mpr0: At enclosure level 0 and connector name (C1  )
mpr0: Found device <881<SataDev,Direct>,End Device> <6.0Gbps> handle<0x001a> enclosureHandle<0x0001> slot 0
pcm3: <Realtek ALC1220 (Rear Digital)>mpr0: At enclosure level 0 and connector name (C0  )
 at nid 30 on hdaa1
mpr0: Found device <881<SataDev,Direct>,End Device> <6.0Gbps> handle<0x001b> enclosureHandle<0x0001> slot 5
mpr0: At enclosure level 0 and connector name (C1  )
mpr0: Found device <881<SataDev,Direct>,End Device> <6.0Gbps> handle<0x001c> enclosureHandle<0x0001> slot 1
mpr0: At enclosure level 0 and connector name (C0  )
mpr0: Found device <881<SataDev,Direct>,End Device> <6.0Gbps> handle<0x001d> enclosureHandle<0x0001> slot 6
mpr0: At enclosure level 0 and connector name (C1  )
mpr0: Found device <881<SataDev,Direct>,End Device> <6.0Gbps> handle<0x001e> enclosureHandle<0x0001> slot 2
mpr0: At enclosure level 0 and connector name (C0  )
mpr0: Found device <881<SataDev,Direct>,End Device> <6.0Gbps> handle<0x001f> enclosureHandle<0x0001> slot 7
mpr0: At enclosure level 0 and connector name (C1  )
mpr0: Found device <881<SataDev,Direct>,End Device> <6.0Gbps> handle<0x0020> enclosureHandle<0x0001> slot 3
mpr0: At enclosure level 0 and connector name (C0  )
mpr0: Found device <5c01<SspTarg,Direct,LsiDev,SepDev>,End Device> <1.5Gbps> handle<0x0011> enclosureHandle<0x0001> slot 16
mpr0: At enclosure level 0 and connector name (C3  )
nda0 at nvme0 bus 0 scbus5 target 0 lun 1
nda0: <INTEL SSDPEKNW010T9 001C BTNR031414DG1P0B>
nda0: Serial Number BTNR031414DG1P0B
nda0: nvme version 1.3
nda0: 976762MB (2000409264 512 byte sectors)
nda1 at nvme1 bus 0 scbus6 target 0 lun 1
nda1: <INTEL SSDPEKNW010T9 001C BTNR0314130D1P0B>
nda1: Serial Number BTNR0314130D1P0B
nda1: nvme version 1.3
nda1: 976762MB (2000409264 512 byte sectors)
ada0 at ahcich0 bus 0 scbus1 target 0 lun 0
ada0: <Samsung SSD 870 EVO 4TB SVT03B6Q> ACS-4 ATA SATA 3.x device
ada0: Serial Number S757NL0Y100358M
ada0: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 512bytes)
ada0: Command Queueing enabled
ada0: 3815447MB (7814037168 512 byte sectors)
ada0: quirks=0x3<4K,NCQ_TRIM_BROKEN>
ada1 at ahcich1 bus 0 scbus2 target 0 lun 0
ada1: <Samsung SSD 870 EVO 4TB SVT03B6Q> ACS-4 ATA SATA 3.x device
ada1: Serial Number S757NL0Y100330N
ada1: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 512bytes)
ada1: Command Queueing enabled
ada1: 3815447MB (7814037168 512 byte sectors)
ada1: quirks=0x3<4K,NCQ_TRIM_BROKEN>
ada2 at ahcich2 bus 0 scbus3 target 0 lun 0
ada2: <Samsung SSD 860 EVO 1TB RVT02B6Q> ACS-4 ATA SATA 3.x device
ada2: Serial Number S3Z8NB0M131938Z
ada2: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 512bytes)
ada2: Command Queueing enabled
ada2: 953869MB (1953525168 512 byte sectors)
ada2: quirks=0x3<4K,NCQ_TRIM_BROKEN>
ada3 at ahcich3 bus 0 scbus4 target 0 lun 0
ada3: <Samsung SSD 860 EVO 1TB RVT02B6Q> ACS-4 ATA SATA 3.x device
ada3: Serial Number S3Z8NB0M123206K
ada3: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 512bytes)
ada3: Command Queueing enabled
ada3: 953869MB (1953525168 512 byte sectors)
ada3: quirks=0x3<4K,NCQ_TRIM_BROKEN>
ses0 at mpr0 bus 0 scbus0 target 16 lun 0
ses0: <LSI VirtualSES 01> Fixed Enclosure Services SPC-4 SCSI device
ses0: Serial Number 500605B00DCA3730
ses0: 150.000MB/s transfers
ses0: SES Device
ses0: da12,pass12,da13,pass13 in Array Device Slot 1, SAS Slot: 1 phys at slot 12
ses0:  phy 0: SAS device type 1 phy 0 Target ( SSP )
ses0:  phy 0: parent 500605b00dca3730 addr 5000c500da929165
ses0: da8,pass8 in Array Device Slot 2, SAS Slot: 1 phys at slot 8
ses0:  phy 0: SATA device
ses0:  phy 0: parent 500605b00dca3731 addr 300605b00dca3731
ses0: da14,pass14,da15,pass15 in Array Device Slot 3, SAS Slot: 1 phys at slot 13
ses0:  phy 0: SAS device type 1 phy 0 Target ( SSP )
ses0:  phy 0: parent 500605b00dca3732 addr 5000c500da939f4d
ses0: da9,pass9 in Array Device Slot 4, SAS Slot: 1 phys at slot 9
ses0:  phy 0: SATA device
ses0:  phy 0: parent 500605b00dca3733 addr 300605b00dca3733
ses0: da16,pass16,da17,pass17 in Array Device Slot 5, SAS Slot: 1 phys at slot 14
ses0:  phy 0: SAS device type 1 phy 0 Target ( SSP )
ses0:  phy 0: parent 500605b00dca3734 addr 5000c500da928881
ses0: da10,pass10 in Array Device Slot 6, SAS Slot: 1 phys at slot 10
ses0:  phy 0: SATA device
ses0:  phy 0: parent 500605b00dca3735 addr 300605b00dca3735
ses0: da11,pass11 in Array Device Slot 8, SAS Slot: 1 phys at slot 11
ses0:  phy 0: SATA device
ses0:  phy 0: parent 500605b00dca3737 addr 300605b00dca3737
ses0: da4,pass4 in Array Device Slot 9, SAS Slot: 1 phys at slot 4
ses0:  phy 0: SATA device
ses0:  phy 0: parent 500605b00dca3738 addr 300605b00dca3738
ses0: da0,pass0 in Array Device Slot 10, SAS Slot: 1 phys at slot 0
ses0:  phy 0: SATA device
ses0:  phy 0: parent 500605b00dca3739 addr 300605b00dca3739
ses0: da5,pass5 in Array Device Slot 11, SAS Slot: 1 phys at slot 5
ses0:  phy 0: SATA device
ses0:  phy 0: parent 500605b00dca373a addr 300605b00dca373a
ses0: da1,pass1 in Array Device Slot 12, SAS Slot: 1 phys at slot 1
ses0:  phy 0: SATA device
ses0:  phy 0: parent 500605b00dca373b addr 300605b00dca373b
ses0: da6,pass6 in Array Device Slot 13, SAS Slot: 1 phys at slot 6
ses0:  phy 0: SATA device
ses0:  phy 0: parent 500605b00dca373c addr 300605b00dca373c
ses0: da2,pass2 in Array Device Slot 14, SAS Slot: 1 phys at slot 2
ses0:  phy 0: SATA device
ses0:  phy 0: parent 500605b00dca373d addr 300605b00dca373d
ses0: da7,pass7 in Array Device Slot 15, SAS Slot: 1 phys at slot 7
ses0:  phy 0: SATA device
ses0:  phy 0: parent 500605b00dca373e addr 300605b00dca373e
ses0: da3,pass3 in Array Device Slot 16, SAS Slot: 1 phys at slot 3
ses0:  phy 0: SATA device
ses0:  phy 0: parent 500605b00dca373f addr 300605b00dca373f
da0 at mpr0 bus 0 scbus0 target 0 lun 0
da0: <ATA ST22000NM000C-3W SN02> Fixed Direct Access SPC-4 SCSI device
da0: Serial Number ZXA0KEPF
da0: 600.000MB/s transfers
da0: Command Queueing enabled
da0: 20981760MB (42970644480 512 byte sectors)
da1 at mpr0 bus 0 scbus0 target 1 lun 0
da1: <ATA ST22000NM000C-3W SN02> Fixed Direct Access SPC-4 SCSI device
da1: Serial Number ZXA0E9KT
da1: 600.000MB/s transfers
da1: Command Queueing enabled
da1: 20981760MB (42970644480 512 byte sectors)
da2 at mpr0 bus 0 scbus0 target 2 lun 0
da2: <ATA ST22000NM000C-3W SN02> Fixed Direct Access SPC-4 SCSI device
da2: Serial Number ZXA0BK40
da2: 600.000MB/s transfers
da2: Command Queueing enabled
da2: 20981760MB (42970644480 512 byte sectors)
da3 at mpr0 bus 0 scbus0 target 3 lun 0
da3: <ATA ST22000NM000C-3W SN02> Fixed Direct Access SPC-4 SCSI device
da3: Serial Number ZXA0EDD5
da3: 600.000MB/s transfers
da3: Command Queueing enabled
da3: 20981760MB (42970644480 512 byte sectors)
da4 at mpr0 bus 0 scbus0 target 4 lun 0
da4: <ATA ST22000NM000C-3W SN02> Fixed Direct Access SPC-4 SCSI device
da4: Serial Number ZXA0AMBM
da4: 600.000MB/s transfers
da4: Command Queueing enabled
da4: 20981760MB (42970644480 512 byte sectors)
da5 at mpr0 bus 0 scbus0 target 5 lun 0
da5: <ATA ST22000NM000C-3W SN02> Fixed Direct Access SPC-4 SCSI device
da5: Serial Number ZXA05EMN
da5: 600.000MB/s transfers
da5: Command Queueing enabled
da5: 20981760MB (42970644480 512 byte sectors)
da6 at mpr0 bus 0 scbus0 target 6 lun 0
da6: <ATA ST22000NM000C-3W SN02> Fixed Direct Access SPC-4 SCSI device
da6: Serial Number ZXA0NBJA
da6: 600.000MB/s transfers
da6: Command Queueing enabled
da6: 20981760MB (42970644480 512 byte sectors)
da7 at mpr0 bus 0 scbus0 target 7 lun 0
da7: <ATA ST22000NM000C-3W SN02> Fixed Direct Access SPC-4 SCSI device
da7: Serial Number ZXA0KP07
da7: 600.000MB/s transfers
da7: Command Queueing enabled
da7: 20981760MB (42970644480 512 byte sectors)
da8 at mpr0 bus 0 scbus0 target 8 lun 0
da8: <ATA ST22000NM000C-3W SN02> Fixed Direct Access SPC-4 SCSI device
da8: Serial Number ZXA0Q3VB
da8: 600.000MB/s transfers
da8: Command Queueing enabled
da8: 20981760MB (42970644480 512 byte sectors)
da9 at mpr0 bus 0 scbus0 target 9 lun 0
da9: <ATA ST22000NM000C-3W SN02> Fixed Direct Access SPC-4 SCSI device
da9: Serial Number ZXA0E2J4
da9: 600.000MB/s transfers
da9: Command Queueing enabled
da9: 20981760MB (42970644480 512 byte sectors)
da10 at mpr0 bus 0 scbus0 target 10 lun 0
da10: <ATA ST22000NM000C-3W SN02> Fixed Direct Access SPC-4 SCSI device
da10: Serial Number ZXA0FXB0
da10: 600.000MB/s transfers
da10: Command Queueing enabled
da10: 20981760MB (42970644480 512 byte sectors)
da11 at mpr0 bus 0 scbus0 target 11 lun 0
da11: <ATA ST22000NM000C-3W SN02> Fixed Direct Access SPC-4 SCSI device
da11: Serial Number ZXA0FNE6
da11: 600.000MB/s transfers
da11: Command Queueing enabled
da11: 20981760MB (42970644480 512 byte sectors)
da12 at mpr0 bus 0 scbus0 target 12 lun 0
da12: <SEAGATE ST14000NM0081 E0A1> Fixed Direct Access SPC-5 SCSI device
da12: Serial Number ZKL2JWRD0000C2514FDE
da12: 1200.000MB/s transfers
da12: Command Queueing enabled
da12: 6675968MB (13672382464 512 byte sectors)
da14 at mpr0 bus 0 scbus0 target 13 lun 0
da14: <SEAGATE ST14000NM0081 E0A1> Fixed Direct Access SPC-5 SCSI device
da14: Serial Number ZKL2K4AB0000C2514EZ8
da14: 1200.000MB/s transfers
da14: Command Queueing enabled
da14: 6675968MB (13672382464 512 byte sectors)
da16 at mpr0 bus 0 scbus0 target 14 lun 0
da16: <SEAGATE ST14000NM0081 E0A1> Fixed Direct Access SPC-5 SCSI device
da16: Serial Number ZKL2JWTN0000C2514FPL
da16: 1200.000MB/s transfers
da16: Command Queueing enabled
da16: 6675968MB (13672382464 512 byte sectors)
da13 at mpr0 bus 0 scbus0 target 12 lun 1
da13: <SEAGATE ST14000NM0081 E0A1> Fixed Direct Access SPC-5 SCSI device
da13: Serial Number ZKL2JWRD0000C2514FDE
da13: 1200.000MB/s transfers
da13: Command Queueing enabled
da13: 6675968MB (13672382464 512 byte sectors)
da15 at mpr0 bus 0 scbus0 target 13 lun 1
da15: <SEAGATE ST14000NM0081 E0A1> Fixed Direct Access SPC-5 SCSI device
da15: Serial Number ZKL2K4AB0000C2514EZ8
da15: 1200.000MB/s transfers
da15: Command Queueing enabled
da15: 6675968MB (13672382464 512 byte sectors)
da17 at mpr0 bus 0 scbus0 target 14 lun 1
da17: <SEAGATE ST14000NM0081 E0A1> Fixed Direct Access SPC-5 SCSI device
da17: Serial Number ZKL2JWTN0000C2514FPL
da17: 1200.000MB/s transfers
da17: Command Queueing enabled
da17: 6675968MB (13672382464 512 byte sectors)
Trying to mount root from zfs:twins []...
uhub3: 2 ports with 2 removable, self powered
uhub2: 4 ports with 4 removable, self powered
uhub0: 4 ports with 4 removable, self powered
ugen0.2: <USB usb keyboard> at usbus0
usbhid0 on uhub0
usbhid0: <USB usb keyboard, class 0/0, rev 1.10/1.10, addr 1> on usbus0
hidbus0: <HID bus> on usbhid0
hkbd0: <USB usb keyboard> on hidbus0
kbd1 at hkbd0
usbhid1 on uhub0
usbhid1: <USB usb keyboard, class 0/0, rev 1.10/1.10, addr 1> on usbus0
hidbus1: <HID bus> on usbhid1
uhub1: 18 ports with 18 removable, self powered
ugen3.2: <MediaTek Inc. WirelessDevice> at usbus3
intsmb0: <AMD FCH SMBus Controller> at device 20.0 on pci8
smbus0: <System Management Bus> on intsmb0
acpi_wmi0: <ACPI-WMI mapping> on acpi0
acpi_wmi0: Embedded MOF found
acpi_wmi1: <ACPI-WMI mapping> on acpi0
acpi_wmi1: Embedded MOF found
acpi_wmi2: <ACPI-WMI mapping> on acpi0
acpi_wmi2: Embedded MOF found
ig4iic0: <Designware I2C Controller> iomem 0xfedc3000-0xfedc3fff irq 11 on acpi0
iicbus0: <Philips I2C bus (ACPI-hinted)> on ig4iic0
ig4iic1: <Designware I2C Controller> iomem 0xfedc4000-0xfedc4fff irq 16 on acpi0
iicbus1: <Philips I2C bus (ACPI-hinted)> on ig4iic1
ig4iic2: <Designware I2C Controller> iomem 0xfedc6000-0xfedc6fff irq 22 on acpi0
iicbus2: <Philips I2C bus (ACPI-hinted)> on ig4iic2
ig4iic3: <Designware I2C Controller> iomem 0xfedcb000-0xfedcbfff irq 23 on acpi0
iicbus3: <Philips I2C bus (ACPI-hinted)> on ig4iic3
iicbus3: <unknown card> at addr 0x40
iicbus3: <unknown card> at addr 0x40
hcons0: <USB usb keyboard Consumer Control> on hidbus1
hsctrl0: <USB usb keyboard System Control> on hidbus1
lo0: link state changed to UP
ix0: link state changed to UP
bridge0: Ethernet address: 58:9c:fc:10:e9:e0
bridge0: changing name to 'vm-public'



help