Date: Fri, 18 Oct 2019 10:34:51 +0200 From: Artur Moor <digunit24@gmail.com> To: edenist <edenist@edenist.net> Cc: freebsd-virtualization@freebsd.org Subject: Re: Alpine Linux (alpine-virt-3.10.2) as guest in bhyve (FreeBSD 12.0-RELEASE-p10) Message-ID: <CAGru6PtYQVsj5NVZkQ9e1muunidXE=ZLQRn7sYxFN5WCzNMxoQ@mail.gmail.com> In-Reply-To: <970C42D5-F891-4EBC-BE29-CE8D25650C28@edenist.net> References: <CAGru6Pts0vze3fZC-5keucMKv-O9Pf8xcK9B=EmTfzuv%2BZ-4xQ@mail.gmail.com> <970C42D5-F891-4EBC-BE29-CE8D25650C28@edenist.net>
next in thread | previous in thread | raw e-mail | index | archive | help
Hi edenist,
thank you for the tip regarding the deactivation some mitigation
features in the kernel of the vm. Disabling the kernel module
'spectre_v2' of the VM does not cause the kernel panic:
root@host:~ # diff /srv/vmm/alpine/alpine.conf
/srv/vmm/alpine/alpine.spectre_v2=3Doff.conf
8c8
< grub_install0=3D"linux /boot/vmlinuz-virt initrd=3D/boot/initramfs-virt
alpine_dev=3Dcdrom:iso9660
modules=3Dloop,squashfs,sd-mod,usb-storage,sr-mod"
---
> grub_install0=3D"linux /boot/vmlinuz-virt initrd=3D/boot/initramfs-virt s=
pectre_v2=3Doff alpine_dev=3Dcdrom:iso9660 modules=3Dloop,squashfs,sd-mod,u=
sb-storage,sr-mod"
Am Fr., 18. Okt. 2019 um 02:42 Uhr schrieb edenist <edenist@edenist.net>:
>
> Hi Artur,
>
> I'm by no means a bhyve expert, but I have had similar kernel panics occu=
r on my linux VMs over the last year. In my experience, it is related to me=
ltdown/spectre mitigations, in particular those which are using features/MS=
Rs implemented through microcode. There appears to be some confusion when a=
linux VM expects CPU features to be available, but they aren't properly ex=
posed on the host.
>
> I would recommend checking which microcode your CPU has and which feature=
s it exposes on the host. Make sure you've got devcpu-data installed which =
will keep your microcode up to date [if that's something you want to happen=
].
>
> Try disabling various mitigation features by passing the relevant kernel =
parameters at boot [on the VM]. They keep changing the syntax, but it will =
be something like pti=3Doff, spectre_v2=3Doff etc.... You may be able to bi=
sect which mitigation is causing the issues.
>
> Hope it helps!
>
>
> On 18 October 2019 1:39:19 am AEDT, Artur Moor <digunit24@gmail.com> wrot=
e:
> >I have trouble with Alpine Linux as a guest in bhyve. When I try to
> >start the installation 'vm install alpine
> >alpine-virt-3.10.2-x86_64.iso' I get the following message in the
> >console of the vm:
> >[ 0.000000] Linux version 4.19.67-0-virt
> >(buildozer@build-3-10-x86_64) (gcc version 8.3.0 (Alpine 8.3.0))
> >#1-Alpine SMP Mon Aug 19 10:05:34 UTC 2019
> >[ 0.000000] Command line: console=3DttyS0
> >BOOT_IMAGE=3D/boot/vmlinuz-virt initrd=3D/boot/initramfs-virt
> >alpine_dev=3Dcdrom:iso9660
> >modules=3Dloop,squashfs,sd-mod,usb-storage,sr-mod
> >[ 0.000000] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating
> >point registers'
> >[ 0.000000] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'
> >[ 0.000000] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'
> >[ 0.000000] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256
> >[ 0.000000] x86/fpu: Enabled xstate features 0x7, context size is
> >832 bytes, using 'standard' format.
> >[ 0.000000] BIOS-provided physical RAM map:
> >[ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fffe]
> >usable
> >[ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000001fffffff]
> >usable
> >[ 0.000000] NX (Execute Disable) protection: active
> >[ 0.000000] SMBIOS 2.6 present.
> >[ 0.000000] DMI: BHYVE, BIOS 1.00 03/14/2014
> >[ 0.000000] tsc: Fast TSC calibration using PIT
> >[ 0.000000] tsc: Detected 3099.325 MHz processor
> >[ 0.000135] last_pfn =3D 0x20000 max_arch_pfn =3D 0x400000000
> >[ 0.000144] Disabled
> >[ 0.000145] x86/PAT: MTRRs disabled, skipping PAT initialization
> >too.
> >[ 0.000147] CPU MTRRs all blank - virtualized system.
> >[ 0.000148] x86/PAT: Configuration [0-7]: WB WT UC- UC WB WT
> >UC- UC
> >[ 0.000173] Using GB pages for direct mapping
> >[ 0.000209] RAMDISK: [mem 0x02aeb000-0x02fbafff]
> >[ 0.000219] ACPI: Early table checksum verification disabled
> >[ 0.000239] ACPI: RSDP 0x00000000000F2400 000024 (v02 BHYVE )
> >[ 0.000241] ACPI: XSDT 0x00000000000F2480 000044 (v01 BHYVE BVXSDT
> > 00000001 INTL 20181003)
> >[ 0.000245] ACPI: APIC 0x00000000000F2500 00005A (v01 BHYVE BVMADT
> > 00000001 INTL 20181003)
> >[ 0.000248] ACPI: FACP 0x00000000000F2600 00010C (v05 BHYVE BVFACP
> > 00000001 INTL 20181003)
> >[ 0.000251] ACPI: DSDT 0x00000000000F2800 00094B (v02 BHYVE BVDSDT
> > 00000001 INTL 20181003)
> >[ 0.000253] ACPI: FACS 0x00000000000F27C0 000040
> >[ 0.000255] ACPI: FACS 0x00000000000F27C0 000040
> >[ 0.000257] ACPI: HPET 0x00000000000F2740 000038 (v01 BHYVE BVHPET
> > 00000001 INTL 20181003)
> >[ 0.000259] ACPI: MCFG 0x00000000000F2780 00003C (v01 BHYVE BVMCFG
> > 00000001 INTL 20181003)
> >[ 0.000264] Setting APIC routing to physical flat.
> >[ 0.000309] Zone ranges:
> >[ 0.000309] DMA [mem 0x0000000000001000-0x0000000000ffffff]
> >[ 0.000311] DMA32 [mem 0x0000000001000000-0x000000001fffffff]
> >[ 0.000312] Normal empty
> >[ 0.000312] Movable zone start for each node
> >[ 0.000313] Early memory node ranges
> >[ 0.000314] node 0: [mem 0x0000000000001000-0x000000000009efff]
> >[ 0.000315] node 0: [mem 0x0000000000100000-0x000000001fffffff]
> >[ 0.000328] Reserved but unavailable: 98 pages
> >[ 0.000329] Initmem setup node 0 [mem
> >0x0000000000001000-0x000000001fffffff]
> >[ 0.007443] ACPI: PM-Timer IO Port: 0x408
> >[ 0.007449] ACPI: LAPIC_NMI (acpi_id[0xff] high edge lint[0x1])
> >[ 0.007475] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000,
> >GSI 0-31
> >[ 0.007476] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 high
> >edge)
> >[ 0.007478] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 low
> >level)
> >[ 0.007482] Using ACPI (MADT) for SMP configuration information
> >[ 0.007483] ACPI: HPET id: 0x80860701 base: 0xfed00000
> >[ 0.007492] smpboot: Allowing 1 CPUs, 0 hotplug CPUs
> >[ 0.007505] [mem 0x20000000-0xffffffff] available for PCI devices
> >[ 0.007506] Booting paravirtualized kernel on bare hardware
> >[ 0.007508] clocksource: refined-jiffies: mask: 0xffffffff
> >max_cycles: 0xffffffff, max_idle_ns: 19112604462750000 ns
> >[ 0.039227] random: get_random_bytes called from
> >start_kernel+0x8e/0x4b0 with crng_init=3D0
> >[ 0.039232] setup_percpu: NR_CPUS:32 nr_cpumask_bits:32
> >nr_cpu_ids:1 nr_node_ids:1
> >[ 0.040672] percpu: Embedded 44 pages/cpu s142104 r8192 d29928
> >u2097152
> >[ 0.040691] Built 1 zonelists, mobility grouping on. Total pages:
> >128905
> >[ 0.040693] Kernel command line: console=3DttyS0
> >BOOT_IMAGE=3D/boot/vmlinuz-virt initrd=3D/boot/initramfs-virt
> >alpine_dev=3Dcdrom:iso9660
> >modules=3Dloop,squashfs,sd-mod,usb-storage,sr-mod
> >[ 0.041084] Dentry cache hash table entries: 65536 (order: 7, 524288
> >bytes)
> >[ 0.041261] Inode-cache hash table entries: 32768 (order: 6, 262144
> >bytes)
> >[ 0.042187] Memory: 491192K/523896K available (8204K kernel code,
> >731K rwdata, 2068K rodata, 1140K init, 608K bss, 32704K reserved, 0K
> >cma-reserved)
> >[ 0.042312] SLUB: HWalign=3D64, Order=3D0-3, MinObjects=3D0, CPUs=3D1=
,
> >Nodes=3D1
> >[ 0.042489] rcu: Hierarchical RCU implementation.
> >[ 0.042490] rcu: RCU restricting CPUs from NR_CPUS=3D32 to
> >nr_cpu_ids=3D1.
> >[ 0.042492] rcu: Adjusting geometry for rcu_fanout_leaf=3D16,
> >nr_cpu_ids=3D1
> >[ 0.042597] NR_IRQS: 4352, nr_irqs: 256, preallocated irqs: 16
> >[ 0.042919] Console: colour EGA 80x25
> >[ 0.099439] console [ttyS0] enabled
> >[ 0.099897] ACPI: Core revision 20180810
> >[ 0.100580] clocksource: hpet: mask: 0xffffffff max_cycles:
> >0xffffffff, max_idle_ns: 113919999973 ns
> >[ 0.101779] APIC: Switch to symmetric I/O mode setup
> >[ 0.103710] ..TIMER: vector=3D0x30 apic1=3D0 pin1=3D2 apic2=3D-1 pin2=
=3D-1
> >[ 0.152418] clocksource: tsc-early: mask: 0xffffffffffffffff
> >max_cycles: 0x2cacc9e0a25, max_idle_ns: 440795241691 ns
> >[ 0.153779] Calibrating delay loop (skipped), value calculated
> >using timer frequency.. 6198.65 BogoMIPS (lpj=3D30993250)
> >[ 0.155179] pid_max: default: 32768 minimum: 301
> >[ 0.155830] Mount-cache hash table entries: 1024 (order: 1, 8192
> >bytes)
> >[ 0.156676] Mountpoint-cache hash table entries: 1024 (order: 1,
> >8192 bytes)
> >[ 0.157888] Last level iTLB entries: 4KB 1024, 2MB 1024, 4MB 512
> >[ 0.158688] Last level dTLB entries: 4KB 1536, 2MB 1536, 4MB 768,
> >1GB 0
> >[ 0.159541] Spectre V1 : Mitigation: usercopy/swapgs barriers and
> >__user pointer sanitization
> >[ 0.160636] Spectre V2 : Spectre mitigation: LFENCE not
> >serializing, switching to generic retpoline
> >[ 0.161800] Spectre V2 : Mitigation: Full generic retpoline
> >[ 0.162503] Spectre V2 : Spectre v2 / SpectreRSB mitigation:
> >Filling RSB on context switch
> >[ 0.163777] Spectre V2 : mitigation: Enabling conditional Indirect
> >Branch Prediction Barrier
> >[ 0.164852] Speculative Store Bypass: Vulnerable
> >[ 0.168104] Freeing SMP alternatives memory: 24K
> >[ 0.173772] smpboot: CPU0: AMD EPYC 7371 16-Core Processor (family:
> >0x17, model: 0x1, stepping: 0x2)
> >[ 0.173772] Performance Events: PMU not available due to
> >virtualization, using software events only.
> >[ 0.173772] rcu: Hierarchical SRCU implementation.
> >[ 0.173772] random: crng done (trusting CPU's manufacturer)
> >[ 0.173772] NMI watchdog: Perf NMI watchdog permanently disabled
> >[ 0.173772] smp: Bringing up secondary CPUs ...
> >[ 0.173772] smp: Brought up 1 node, 1 CPU
> >[ 0.173772] smpboot: Max logical packages: 1
> >[ 0.173772] ----------------
> >[ 0.173772] | NMI testsuite:
> >[ 0.173772] --------------------
> >[ 0.173772] remote IPI: ok |
> >[ 0.173772] local IPI: ok |
> >[ 0.173772] --------------------
> >[ 0.173772] Good, all 2 testcases passed! |
> >[ 0.173772] ---------------------------------
> >[ 0.173779] smpboot: Total of 1 processors activated (6198.65
> >BogoMIPS)
> >[ 0.174744] devtmpfs: initialized
> >[ 0.175250] x86/mm: Memory block size: 128MB
> >[ 0.176042] clocksource: jiffies: mask: 0xffffffff max_cycles:
> >0xffffffff, max_idle_ns: 19112604462750000 ns
> >[ 0.177302] futex hash table entries: 256 (order: 2, 16384 bytes)
> >[ 0.178241] NET: Registered protocol family 16
> >[ 0.178896] audit: initializing netlink subsys (disabled)
> >[ 0.179724] cpuidle: using governor ladder
> >[ 0.180267] cpuidle: using governor menu
> >[ 0.181276] audit: type=3D2000 audit(1571322221.070:1):
> >state=3Dinitialized audit_enabled=3D0 res=3D1
> >[ 0.182637] ACPI FADT declares the system doesn't support PCIe
> >ASPM, so disable it
> >[ 0.183626] ACPI: bus type PCI registered
> >[ 0.183772] acpiphp: ACPI Hot Plug PCI Controller Driver version:
> >0.5
> >[ 0.183907] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem
> >0xe0000000-0xefffffff] (base 0xe0000000)
> >[ 0.185106] PCI: not using MMCONFIG
> >[ 0.185564] PCI: Using configuration type 1 for base access
> >[ 0.186284] PCI: Using configuration type 1 for extended access
> >[ 0.192668] HugeTLB registered 1.00 GiB page size, pre-allocated 0
> >pages
> >[ 0.193776] HugeTLB registered 2.00 MiB page size, pre-allocated 0
> >pages
> >[ 0.194758] ACPI: Added _OSI(Module Device)
> >[ 0.195321] ACPI: Added _OSI(Processor Device)
> >[ 0.195895] ACPI: Added _OSI(3.0 _SCP Extensions)
> >[ 0.196506] ACPI: Added _OSI(Processor Aggregator Device)
> >[ 0.197232] ACPI: Added _OSI(Linux-Dell-Video)
> >[ 0.197813] ACPI: Added _OSI(Linux-Lenovo-NV-HDMI-Audio)
> >[ 0.198743] ACPI: 1 ACPI AML tables successfully acquired and loaded
> >[ 0.199794] ACPI: Interpreter enabled
> >[ 0.200297] ACPI: (supports S0 S5)
> >[ 0.200747] ACPI: Using IOAPIC for interrupt routing
> >[ 0.201408] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem
> >0xe0000000-0xefffffff] (base 0xe0000000)
> >[ 0.202648] PCI: MMCONFIG at [mem 0xe0000000-0xefffffff] reserved
> >in ACPI motherboard resources
> >[ 0.203781] PCI: Using host bridge windows from ACPI; if necessary,
> >use "pci=3Dnocrs" and report a bug
> >[ 0.205787] ACPI: PCI Root Bridge [PC00] (domain 0000 [bus 00])
> >[ 0.206551] acpi PNP0A03:00: _OSC: OS supports [ExtendedConfig ASPM
> >ClockPM Segments MSI]
> >[ 0.207620] acpi PNP0A03:00: _OSC failed (AE_NOT_FOUND); disabling
> >ASPM
> >[ 0.208525] PCI host bridge to bus 0000:00
> >[ 0.209051] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7
> >window]
> >[ 0.209937] pci_bus 0000:00: root bus resource [io 0x0d00-0x1fff
> >window]
> >[ 0.210823] pci_bus 0000:00: root bus resource [io 0x2000-0x207f
> >window]
> >[ 0.211686] pci_bus 0000:00: root bus resource [mem
> >0xc0000000-0xc01fffff window]
> >[ 0.212662] pci_bus 0000:00: root bus resource [mem
> >0xd000000000-0xd0000fffff window]
> >[ 0.213774] pci_bus 0000:00: root bus resource [bus 00]
> >[ 0.217648] ACPI: PCI Interrupt Link [LNKA] (IRQs 3 4 *5 6 7 9 10
> >11 12 14 15)
> >[ 0.218651] ACPI: PCI Interrupt Link [LNKB] (IRQs 3 4 5 *6 7 9 10
> >11 12 14 15)
> >[ 0.219671] ACPI: PCI Interrupt Link [LNKC] (IRQs 3 4 5 6 *7 9 10
> >11 12 14 15)
> >[ 0.220672] ACPI: PCI Interrupt Link [LNKD] (IRQs 3 4 5 6 7 9 10 11
> >12 14 15) *0, disabled.
> >[ 0.221806] ACPI: PCI Interrupt Link [LNKE] (IRQs 3 4 5 6 7 9 10 11
> >12 14 15) *0, disabled.
> >[ 0.222926] ACPI: PCI Interrupt Link [LNKF] (IRQs 3 4 5 6 7 9 10 11
> >12 14 15) *0, disabled.
> >[ 0.223823] ACPI: PCI Interrupt Link [LNKG] (IRQs 3 4 5 6 7 9 10 11
> >12 14 15) *0, disabled.
> >[ 0.224985] ACPI: PCI Interrupt Link [LNKH] (IRQs 3 4 5 6 7 9 10 11
> >12 14 15) *0, disabled.
> >[ 0.226176] SCSI subsystem initialized
> >[ 0.227134] pps_core: LinuxPPS API ver. 1 registered
> >[ 0.227811] pps_core: Software ver. 5.3.6 - Copyright 2005-2007
> >Rodolfo Giometti <giometti@linux.it>
> >[ 0.229053] PTP clock support registered
> >[ 0.229737] PCI: Using ACPI for IRQ routing
> >[ 0.282465] clocksource: Switched to clocksource tsc-early
> >[ 0.283772] VFS: Disk quotas dquot_6.6.0
> >[ 0.283772] VFS: Dquot-cache hash table entries: 512 (order 0, 4096
> >bytes)
> >[ 0.283772] pnp: PnP ACPI init
> >[ 0.283772] system 00:02: [io 0x0220-0x0223] has been reserved
> >[ 0.283772] system 00:02: [io 0x0224-0x0227] has been reserved
> >[ 0.283772] system 00:02: [io 0x04d0-0x04d1] has been reserved
> >[ 0.284356] system 00:02: [io 0x0400-0x0407] has been reserved
> >[ 0.285134] system 00:02: [mem 0xe0000000-0xefffffff] has been
> >reserved
> >[ 0.286071] pnp: PnP ACPI: found 6 devices
> >[ 0.292735] clocksource: acpi_pm: mask: 0xffffff max_cycles:
> >0xffffff, max_idle_ns: 2085701024 ns
> >[ 0.293934] pci 0000:00:03.0: BAR 6: assigned [mem
> >0xc0000800-0xc0000fff pref]
> >[ 0.294869] pci 0000:00:04.0: BAR 6: assigned [mem
> >0xc0001000-0xc00017ff pref]
> >[ 0.295823] pci 0000:00:05.0: BAR 6: assigned [mem
> >0xc0001800-0xc0001fff pref]
> >[ 0.296790] pci 0000:00:1f.0: BAR 6: assigned [mem
> >0xc0006000-0xc00067ff pref]
> >[ 0.297807] NET: Registered protocol family 2
> >[ 0.298456] tcp_listen_portaddr_hash hash table entries: 256
> >(order: 0, 4096 bytes)
> >[ 0.299466] TCP established hash table entries: 4096 (order: 3,
> >32768 bytes)
> >[ 0.300405] TCP bind hash table entries: 4096 (order: 4, 65536
> >bytes)
> >[ 0.301290] TCP: Hash tables configured (established 4096 bind 4096)
> >[ 0.302158] UDP hash table entries: 256 (order: 1, 8192 bytes)
> >[ 0.302919] UDP-Lite hash table entries: 256 (order: 1, 8192 bytes)
> >[ 0.303767] NET: Registered protocol family 1
> >[ 0.304392] pci 0000:00:1f.0: Activating ISA DMA hang workarounds
> >[ 0.305764] Unpacking initramfs...
> >[ 0.366638] Freeing initrd memory: 4928K
> >[ 0.367535] Initialise system trusted keyrings
> >[ 0.368340] workingset: timestamp_bits=3D46 max_order=3D17
> >bucket_order=3D0
> >[ 0.371627] Key type asymmetric registered
> >[ 0.372215] Block layer SCSI generic (bsg) driver version 0.4
> >loaded (major 250)
> >[ 0.373247] io scheduler noop registered
> >[ 0.373787] io scheduler deadline registered (default)
> >[ 0.374466] io scheduler mq-deadline registered (default)
> >[ 0.375099] io scheduler kyber registered
> >[ 0.375764] ERST DBG: ERST support is disabled.
> >[ 0.376430] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled
> >[ 0.398514] 00:03: ttyS0 at I/O 0x3f8 (irq =3D 4, base_baud =3D 11520=
0)
> >is a 16550A
> >[ 0.420753] 00:04: ttyS1 at I/O 0x2f8 (irq =3D 3, base_baud =3D 11520=
0)
> >is a 16550A
> >[ 0.421950] VMware PVSCSI driver - version 1.0.7.0-k
> >[ 0.422869] ahci 0000:00:03.0: SSS flag set, parallel bus scan
> >disabled
> >[ 0.423866] ahci 0000:00:03.0: AHCI 0001.0300 32 slots 6 ports 6
> >Gbps 0x1 impl SATA mode
> >[ 0.424892] ahci 0000:00:03.0: flags: 64bit ncq sntf ilck stag pm
> >led clo pio slum part sxs apst
> >[ 0.426695] scsi host0: ahci
> >[ 0.427181] scsi host1: ahci
> >[ 0.427638] scsi host2: ahci
> >[ 0.428102] scsi host3: ahci
> >[ 0.428562] scsi host4: ahci
> >[ 0.429027] scsi host5: ahci
> >[ 0.429455] ata1: SATA max UDMA/133 abar m1024@0xc0000000 port
> >0xc0000100 irq 32
> >[ 0.430437] ata2: DUMMY
> >[ 0.430752] ata3: DUMMY
> >[ 0.431095] ata4: DUMMY
> >[ 0.431426] ata5: DUMMY
> >[ 0.431745] ata6: DUMMY
> >[ 0.432116] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU]
> >at 0x60,0x64 irq 1,12
> >[ 0.433333] i8042: Warning: Keylock active
> >[ 0.434382] serio: i8042 KBD port at 0x60,0x64 irq 1
> >[ 0.435029] serio: i8042 AUX port at 0x60,0x64 irq 12
> >[ 0.435771] ACPI Error: Could not enable RealTimeClock event
> >(20180810/evxfevnt-184)
> >[ 0.436815] ACPI Warning: Could not enable fixed event -
> >RealTimeClock (4) (20180810/evxface-620)
> >[ 0.438442] input: AT Raw Set 2 keyboard as
> >/devices/platform/i8042/serio0/input/input0
> >[ 0.439904] rtc_cmos 00:05: registered as rtc0
> >[ 0.440508] rtc_cmos 00:05: alarms up to one day, y3k, 114 bytes
> >nvram
> >[ 0.441413] gre: GRE over IPv4 demultiplexor driver
> >[ 0.442040] Key type dns_resolver registered
> >[ 0.442624] sched_clock: Marking stable (374742215,
> >60992938)->(563738129, -128002976)
> >[ 0.443796] registered taskstats version 1
> >[ 0.444344] Loading compiled-in X.509 certificates
> >[ 0.445222] rtc_cmos 00:05: setting system clock to 2019-10-17
> >14:23:41 UTC (1571322221)
> >[ 0.775259] ata1: SATA link up 6.0 Gbps (SStatus 133 SControl 300)
> >[ 0.776094] ata1.00: ATAPI: BHYVE SATA DVD ROM, 001, max UDMA/133
> >[ 0.776965] ata1.00: configured for UDMA/133
> >[ 0.777642] scsi 0:0:0:0: CD-ROM BHYVE BHYVE DVD-ROM
> > 001 PQ: 0 ANSI: 5
> >[ 0.779270] Freeing unused kernel image memory: 1140K
> >[ 0.805193] Write protecting the kernel read-only data: 14336k
> >[ 0.806217] Freeing unused kernel image memory: 2016K
> >[ 0.807114] Freeing unused kernel image memory: 2028K
> >[ 0.807779] rodata_test: all tests were successful
> >[ 0.808405] Run /init as init process
> >[ 0.809435] general protection fault: 0000 [#1] SMP NOPTI
> >[ 0.810155] CPU: 0 PID: 1 Comm: init Not tainted 4.19.67-0-virt
> >#1-Alpine
> >[ 0.811032] Hardware name: BHYVE, BIOS 1.00 03/14/2014
> >[ 0.811738] RIP: 0010:switch_mm_irqs_off+0xa4/0x422
> >[ 0.812352] Code: 48 c1 e8 09 83 e0 01 48 09 c6 65 48 8b 05 33 24
> >fd 4d 48 39 c6 74 15 48 09 f0 a8 01 74 0e b9 49 00 00 00 b8 01 00 00
> >00 31 d2 <0f> 30 65 48 89 35 11 24 fd 4d 0f 1f 44 00 00 eb 2e 65 48 8b
> >05 02
> >[ 0.814784] RSP: 0018:ffffb0518000bcf8 EFLAGS: 00010046
> >[ 0.815475] RAX: 0000000000000001 RBX: 0000000000000000 RCX:
> >0000000000000049
> >[ 0.816413] RDX: 0000000000000000 RSI: ffff9ced1e452c00 RDI:
> >ffff9ced1e690000
> >[ 0.817342] RBP: ffff9ced1e452c00 R08: ffff9ced1f2221f8 R09:
> >0000000000000000
> >[ 0.818279] R10: 000000000000025e R11: ffff9ced1e690080 R12:
> >ffff9ced1e453800
> >[ 0.819216] R13: ffff9ced1e690000 R14: ffff9ced1e453800 R15:
> >ffff9ced1e452c00
> >[ 0.820157] FS: 00007f23ec2cdd48(0000) GS:ffff9ced1f200000(0000)
> >knlGS:0000000000000000
> >[ 0.821185] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
> >[ 0.821959] CR2: 00005639f0bdf8b8 CR3: 000000001eede000 CR4:
> >00000000000406b0
> >[ 0.822864] Call Trace:
> >[ 0.823204] __schedule+0x69b/0x756
> >[ 0.823668] schedule+0x5b/0x6c
> >[ 0.824090] do_wait+0x1bc/0x21e
> >[ 0.824516] kernel_wait4+0xc0/0x115
> >[ 0.825009] ? __ia32_compat_sys_waitid+0x18/0x18
> >[ 0.825623] __se_sys_wait4+0x37/0x86
> >[ 0.826127] ? handle_mm_fault+0x149/0x19f
> >[ 0.826691] ? __do_page_fault+0x36a/0x3fc
> >[ 0.827251] do_syscall_64+0x50/0xeb
> >[ 0.827720] entry_SYSCALL_64_after_hwframe+0x44/0xa9
> >[ 0.828382] RIP: 0033:0x7f23ec290080
> >[ 0.828859] Code: c3 8b 07 85 c0 75 24 49 89 fb 48 89 f0 48 89 d7
> >48 89 ce 4c 89 c2 4d 89 ca 4c 8b 44 24 08 4c 8b 4c 24 10 4c 89 5c 24
> >08 0f 05 <c3> e9 a7 d3 ff ff 41 54 b8 02 00 00 00 49 89 f4 be 00 08 08
> >00 55
> >[ 0.831332] RSP: 002b:00007ffe1e68a808 EFLAGS: 00000246 ORIG_RAX:
> >000000000000003d
> >[ 0.832335] RAX: ffffffffffffffda RBX: 00007f23ec2cdd48 RCX:
> >00007f23ec290080
> >[ 0.833276] RDX: 0000000000000000 RSI: 00007ffe1e68a86c RDI:
> >ffffffffffffffff
> >[ 0.834240] RBP: 000000000000003d R08: 0000000000000000 R09:
> >0000000000000000
> >[ 0.835161] R10: 0000000000000000 R11: 0000000000000246 R12:
> >00005639f10cfce0
> >[ 0.836069] R13: 00007ffe1e68a86c R14: 00005639f0bc3836 R15:
> >0000000000000000
> >[ 0.837030] Modules linked in:
> >[ 0.837437] ---[ end trace f7b78a6a0742f2da ]---
> >[ 0.838032] RIP: 0010:switch_mm_irqs_off+0xa4/0x422
> >[ 0.838669] Code: 48 c1 e8 09 83 e0 01 48 09 c6 65 48 8b 05 33 24
> >fd 4d 48 39 c6 74 15 48 09 f0 a8 01 74 0e b9 49 00 00 00 b8 01 00 00
> >00 31 d2 <0f> 30 65 48 89 35 11 24 fd 4d 0f 1f 44 00 00 eb 2e 65 48 8b
> >05 02
> >[ 0.841119] RSP: 0018:ffffb0518000bcf8 EFLAGS: 00010046
> >[ 0.841813] RAX: 0000000000000001 RBX: 0000000000000000 RCX:
> >0000000000000049
> >[ 0.842771] RDX: 0000000000000000 RSI: ffff9ced1e452c00 RDI:
> >ffff9ced1e690000
> >[ 0.843681] RBP: ffff9ced1e452c00 R08: ffff9ced1f2221f8 R09:
> >0000000000000000
> >[ 0.844622] R10: 000000000000025e R11: ffff9ced1e690080 R12:
> >ffff9ced1e453800
> >[ 0.845560] R13: ffff9ced1e690000 R14: ffff9ced1e453800 R15:
> >ffff9ced1e452c00
> >[ 0.846529] FS: 00007f23ec2cdd48(0000) GS:ffff9ced1f200000(0000)
> >knlGS:0000000000000000
> >[ 0.847627] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
> >[ 0.848383] CR2: 00005639f0bdf8b8 CR3: 000000001eede000 CR4:
> >00000000000406b0
> >
> >Does anyone have an idea how I can fix the problem?
> >
> >root@host:~ # cat /srv/vmm/alpine/vm-bhyve.log
> >Oct 17 16:23:37: initialising
> >Oct 17 16:23:37: [loader: grub]
> >Oct 17 16:23:37: [cpu: 1]
> >Oct 17 16:23:37: [memory: 512M]
> >Oct 17 16:23:37: [hostbridge: standard]
> >Oct 17 16:23:37: [com ports: com1]
> >Oct 17 16:23:37: [uuid: cf6a78d4-f0d1-11e9-ab90-002590b971a4]
> >Oct 17 16:23:37: [utctime: yes]
> >Oct 17 16:23:37: [debug mode: no]
> >Oct 17 16:23:37: [primary disk: disk0.img]
> >Oct 17 16:23:37: [primary disk dev: file]
> >Oct 17 16:23:37: initialising network device tap0
> >Oct 17 16:23:37: adding tap0 -> vm-public (public addm)
> >Oct 17 16:23:37: bring up tap0 -> vm-public (public addm)
> >Oct 17 16:23:37: booting
> >Oct 17 16:23:37: create file /srv/vmm/alpine/device.map
> >Oct 17 16:23:37: -> (cd0) /srv/vmm/.iso/alpine-virt-3.10.2-x86_64.iso
> >Oct 17 16:23:37: -> (hd0) /srv/vmm/alpine/disk0.img
> >Oct 17 16:23:37: create file /srv/vmm/alpine/grub.cfg
> >Oct 17 16:23:37: -> timeout=3D3
> >Oct 17 16:23:37: -> menuentry 'alpine (bhyve install)' {
> >Oct 17 16:23:37: -> root=3Dcd0
> >Oct 17 16:23:37: -> linux /boot/vmlinuz-virt
> >initrd=3D/boot/initramfs-virt alpine_dev=3Dcdrom:iso9660
> >modules=3Dloop,squashfs,sd-mod,usb-storage,sr-mod
> >Oct 17 16:23:37: -> initrd /boot/initramfs-virt
> >Oct 17 16:23:37: -> }
> >Oct 17 16:23:37: /usr/local/sbin/grub-bhyve -c /dev/nmdm-alpine.1A -m
> >/srv/vmm/alpine/device.map -M 512M -r host -d /srv/vmm/alpine alpine
> >Oct 17 16:23:41: [bhyve options: -c 1 -m 512M -AHP -U
> >cf6a78d4-f0d1-11e9-ab90-002590b971a4 -u]
> >Oct 17 16:23:41: [bhyve devices: -s 0,hostbridge -s 31,lpc -s
> >4:0,virtio-blk,/srv/vmm/alpine/disk0.img -s
> >5:0,virtio-net,tap0,mac=3D58:9c:fc:03:fe:9b]
> >Oct 17 16:23:41: [bhyve console: -l com1,/dev/nmdm-alpine.1A]
> >Oct 17 16:23:41: [bhyve iso device: -s
> >3:0,ahci-cd,/srv/vmm/.iso/alpine-virt-3.10.2-x86_64.iso,ro]
> >Oct 17 16:23:41: starting bhyve (run 1)
> >
> >root@host:~ # uname -a
> >FreeBSD host.example.com 12.0-RELEASE-p10 FreeBSD 12.0-RELEASE-p10
> >GENERIC amd64
> >
> >root@host:~ # pkg info
> >bhyve-firmware-1.0_1 Collection of Firmware for bhyve
> >ca_root_nss-3.46.1 Root certificate bundle from the Mozilla
> >Project
> >curl-7.66.0 Command line tool and library for
> >transferring data with URLs
> >dmidecode-3.2 Tool for dumping DMI (SMBIOS) contents
> >in human-readable format
> >e2fsprogs-libuuid-1.45.3 UUID library from e2fsprogs package
> >gettext-runtime-0.20.1 GNU gettext runtime libraries and
> >programs
> >grub2-bhyve-0.40_7 Grub-emu loader for bhyve
> >indexinfo-0.3.1 Utility to regenerate the GNU info page
> >index
> >libestr-0.1.11_1 Library for some string essentials
> >libfastjson-0.99.8 libfastjson is a fork from json-c
> >libffi-3.2.1_3 Foreign Function Interface
> >libgcrypt-1.8.5 General purpose cryptographic library
> >based on the code from GnuPG
> >libgpg-error-1.36 Common error values for all GnuPG
> >components
> >liblogging-1.0.6 Easy to use system logging library
> >libnghttp2-1.39.2 HTTP/2.0 C Library
> >pkg-1.12.0 Package manager
> >python-3.6_3,2 "meta-port" for the default version of
> >Python interpreter
> >python3-3_3 The "meta-port" for version 3 of the
> >Python interpreter
> >python36-3.6.9 Interpreted object-oriented programming
> >language
> >readline-8.0.0 Library for editing command lines as
> >they are typed
> >rsyslog-8.1908.0 Syslogd supporting SQL, TCP, and TLS
> >sudo-1.8.27_1 Allow others to run commands as root
> >uefi-edk2-bhyve-0.2_1,1 UEFI-EDK2 firmware for bhyve
> >uefi-edk2-bhyve-csm-0.2_1,1 UEFI-EDK2 firmware for bhyve with CSM
> >vm-bhyve-1.3.0 Management system for bhyve virtual
> >machines
> >
> >root@host:~ # cat /etc/rc.conf | grep vm
> >vm_enable=3D"YES"
> >vm_dir=3D"zfs:zroot/srv/vmm"
> >
> >root@host:~ # kldstat
> >Id Refs Address Size Name
> > 1 39 0xffffffff80200000 243d228 kernel
> > 2 1 0xffffffff8263e000 3a9a10 zfs.ko
> > 3 2 0xffffffff829e8000 a4f0 opensolaris.ko
> > 4 1 0xffffffff829f3000 32b88 if_bnxt.ko
> > 5 1 0xffffffff82f12000 2678 intpm.ko
> > 6 1 0xffffffff82f15000 b10 smbus.ko
> > 7 1 0xffffffff82f16000 1800 uhid.ko
> > 8 1 0xffffffff82f18000 23a8 ums.ko
> > 9 1 0xffffffff82f1b000 537460 vmm.ko
> >10 1 0xffffffff83453000 b30 nmdm.ko
> >11 1 0xffffffff83454000 6fb3 if_bridge.ko
> >12 1 0xffffffff8345b000 4410 bridgestp.ko
> >13 1 0xffffffff83460000 2e77 if_tap.ko
> >
> >root@host:~ # cat /srv/vmm/alpine/alpine.conf
> >loader=3D"grub"
> >cpu=3D1
> >memory=3D512M
> >network0_type=3D"virtio-net"
> >network0_switch=3D"public"
> >disk0_type=3D"virtio-blk"
> >disk0_name=3D"disk0.img"
> >grub_install0=3D"linux /boot/vmlinuz-virt initrd=3D/boot/initramfs-virt
> >alpine_dev=3Dcdrom:iso9660
> >modules=3Dloop,squashfs,sd-mod,usb-storage,sr-mod"
> >grub_install1=3D"initrd /boot/initramfs-virt"
> >grub_run0=3D"linux /boot/vmlinuz-virt root=3D/dev/vda3 modules=3Dext4"
> >grub_run1=3D"initrd /boot/initramfs-virt"
> >uuid=3D"cf6a78d4-f0d1-11e9-ab90-002590b971a4"
> >network0_mac=3D"58:9c:fc:03:fe:9b"
> >
> >root@host:~ # cat /srv/vmm/alpine/device.map
> >(cd0) /srv/vmm/.iso/alpine-virt-3.10.2-x86_64.iso
> >(hd0) /srv/vmm/alpine/disk0.img
> >
> >root@host:~ # cat /srv/vmm/alpine/grub.cfg
> >timeout=3D3
> >menuentry 'alpine (bhyve install)' {
> > root=3Dcd0
> > linux /boot/vmlinuz-virt initrd=3D/boot/initramfs-virt
> >alpine_dev=3Dcdrom:iso9660
> >modules=3Dloop,squashfs,sd-mod,usb-storage,sr-mod
> > initrd /boot/initramfs-virt
> >}
> >_______________________________________________
> >freebsd-virtualization@freebsd.org mailing list
> >https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization
> >To unsubscribe, send any mail to
> >"freebsd-virtualization-unsubscribe@freebsd.org"
>
> --
> edenist
>
> XMPP+OMEMO/PGP: edenist@comms.edenist.net
> PGP Key ID: 0x3D56E58002FE4317
> PGP Key Fingerprint: 7240 9DD4 DB0A 953A 8F3E A8FF 3D56 E580 02FE 4317
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?CAGru6PtYQVsj5NVZkQ9e1muunidXE=ZLQRn7sYxFN5WCzNMxoQ>