Skip site navigation (1)Skip section navigation (2)
Date:      Fri, 18 Oct 2019 10:34:51 +0200
From:      Artur Moor <digunit24@gmail.com>
To:        edenist <edenist@edenist.net>
Cc:        freebsd-virtualization@freebsd.org
Subject:   Re: Alpine Linux (alpine-virt-3.10.2) as guest in bhyve (FreeBSD 12.0-RELEASE-p10)
Message-ID:  <CAGru6PtYQVsj5NVZkQ9e1muunidXE=ZLQRn7sYxFN5WCzNMxoQ@mail.gmail.com>
In-Reply-To: <970C42D5-F891-4EBC-BE29-CE8D25650C28@edenist.net>
References:  <CAGru6Pts0vze3fZC-5keucMKv-O9Pf8xcK9B=EmTfzuv%2BZ-4xQ@mail.gmail.com> <970C42D5-F891-4EBC-BE29-CE8D25650C28@edenist.net>

next in thread | previous in thread | raw e-mail | index | archive | help
Hi edenist,

thank you for the tip regarding the deactivation some mitigation
features in the kernel of the vm. Disabling the kernel module
'spectre_v2' of the VM does not cause the kernel panic:
root@host:~ # diff /srv/vmm/alpine/alpine.conf
/srv/vmm/alpine/alpine.spectre_v2=3Doff.conf
8c8
< grub_install0=3D"linux /boot/vmlinuz-virt initrd=3D/boot/initramfs-virt
alpine_dev=3Dcdrom:iso9660
modules=3Dloop,squashfs,sd-mod,usb-storage,sr-mod"
---
> grub_install0=3D"linux /boot/vmlinuz-virt initrd=3D/boot/initramfs-virt s=
pectre_v2=3Doff alpine_dev=3Dcdrom:iso9660 modules=3Dloop,squashfs,sd-mod,u=
sb-storage,sr-mod"


Am Fr., 18. Okt. 2019 um 02:42 Uhr schrieb edenist <edenist@edenist.net>:
>
> Hi Artur,
>
> I'm by no means a bhyve expert, but I have had similar kernel panics occu=
r on my linux VMs over the last year. In my experience, it is related to me=
ltdown/spectre mitigations, in particular those which are using features/MS=
Rs implemented through microcode. There appears to be some confusion when a=
 linux VM expects CPU features to be available, but they aren't properly ex=
posed on the host.
>
> I would recommend checking which microcode your CPU has and which feature=
s it exposes on the host. Make sure you've got devcpu-data installed which =
will keep your microcode up to date [if that's something you want to happen=
].
>
> Try disabling various mitigation features by passing the relevant kernel =
parameters at boot [on the VM]. They keep changing the syntax, but it will =
be something like pti=3Doff, spectre_v2=3Doff etc.... You may be able to bi=
sect which mitigation is causing the issues.
>
> Hope it helps!
>
>
> On 18 October 2019 1:39:19 am AEDT, Artur Moor <digunit24@gmail.com> wrot=
e:
> >I have trouble with Alpine Linux as a guest in bhyve. When I try to
> >start the installation 'vm install alpine
> >alpine-virt-3.10.2-x86_64.iso' I get the following message in the
> >console of the vm:
> >[    0.000000] Linux version 4.19.67-0-virt
> >(buildozer@build-3-10-x86_64) (gcc version 8.3.0 (Alpine 8.3.0))
> >#1-Alpine SMP Mon Aug 19 10:05:34 UTC 2019
> >[    0.000000] Command line: console=3DttyS0
> >BOOT_IMAGE=3D/boot/vmlinuz-virt initrd=3D/boot/initramfs-virt
> >alpine_dev=3Dcdrom:iso9660
> >modules=3Dloop,squashfs,sd-mod,usb-storage,sr-mod
> >[    0.000000] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating
> >point registers'
> >[    0.000000] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'
> >[    0.000000] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'
> >[    0.000000] x86/fpu: xstate_offset[2]:  576, xstate_sizes[2]:  256
> >[    0.000000] x86/fpu: Enabled xstate features 0x7, context size is
> >832 bytes, using 'standard' format.
> >[    0.000000] BIOS-provided physical RAM map:
> >[    0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fffe]
> >usable
> >[    0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000001fffffff]
> >usable
> >[    0.000000] NX (Execute Disable) protection: active
> >[    0.000000] SMBIOS 2.6 present.
> >[    0.000000] DMI:  BHYVE, BIOS 1.00 03/14/2014
> >[    0.000000] tsc: Fast TSC calibration using PIT
> >[    0.000000] tsc: Detected 3099.325 MHz processor
> >[    0.000135] last_pfn =3D 0x20000 max_arch_pfn =3D 0x400000000
> >[    0.000144] Disabled
> >[    0.000145] x86/PAT: MTRRs disabled, skipping PAT initialization
> >too.
> >[    0.000147] CPU MTRRs all blank - virtualized system.
> >[    0.000148] x86/PAT: Configuration [0-7]: WB  WT  UC- UC  WB  WT
> >UC- UC
> >[    0.000173] Using GB pages for direct mapping
> >[    0.000209] RAMDISK: [mem 0x02aeb000-0x02fbafff]
> >[    0.000219] ACPI: Early table checksum verification disabled
> >[    0.000239] ACPI: RSDP 0x00000000000F2400 000024 (v02 BHYVE )
> >[    0.000241] ACPI: XSDT 0x00000000000F2480 000044 (v01 BHYVE  BVXSDT
> >  00000001 INTL 20181003)
> >[    0.000245] ACPI: APIC 0x00000000000F2500 00005A (v01 BHYVE  BVMADT
> >  00000001 INTL 20181003)
> >[    0.000248] ACPI: FACP 0x00000000000F2600 00010C (v05 BHYVE  BVFACP
> >  00000001 INTL 20181003)
> >[    0.000251] ACPI: DSDT 0x00000000000F2800 00094B (v02 BHYVE  BVDSDT
> >  00000001 INTL 20181003)
> >[    0.000253] ACPI: FACS 0x00000000000F27C0 000040
> >[    0.000255] ACPI: FACS 0x00000000000F27C0 000040
> >[    0.000257] ACPI: HPET 0x00000000000F2740 000038 (v01 BHYVE  BVHPET
> >  00000001 INTL 20181003)
> >[    0.000259] ACPI: MCFG 0x00000000000F2780 00003C (v01 BHYVE  BVMCFG
> >  00000001 INTL 20181003)
> >[    0.000264] Setting APIC routing to physical flat.
> >[    0.000309] Zone ranges:
> >[    0.000309]   DMA      [mem 0x0000000000001000-0x0000000000ffffff]
> >[    0.000311]   DMA32    [mem 0x0000000001000000-0x000000001fffffff]
> >[    0.000312]   Normal   empty
> >[    0.000312] Movable zone start for each node
> >[    0.000313] Early memory node ranges
> >[    0.000314]   node   0: [mem 0x0000000000001000-0x000000000009efff]
> >[    0.000315]   node   0: [mem 0x0000000000100000-0x000000001fffffff]
> >[    0.000328] Reserved but unavailable: 98 pages
> >[    0.000329] Initmem setup node 0 [mem
> >0x0000000000001000-0x000000001fffffff]
> >[    0.007443] ACPI: PM-Timer IO Port: 0x408
> >[    0.007449] ACPI: LAPIC_NMI (acpi_id[0xff] high edge lint[0x1])
> >[    0.007475] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000,
> >GSI 0-31
> >[    0.007476] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 high
> >edge)
> >[    0.007478] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 low
> >level)
> >[    0.007482] Using ACPI (MADT) for SMP configuration information
> >[    0.007483] ACPI: HPET id: 0x80860701 base: 0xfed00000
> >[    0.007492] smpboot: Allowing 1 CPUs, 0 hotplug CPUs
> >[    0.007505] [mem 0x20000000-0xffffffff] available for PCI devices
> >[    0.007506] Booting paravirtualized kernel on bare hardware
> >[    0.007508] clocksource: refined-jiffies: mask: 0xffffffff
> >max_cycles: 0xffffffff, max_idle_ns: 19112604462750000 ns
> >[    0.039227] random: get_random_bytes called from
> >start_kernel+0x8e/0x4b0 with crng_init=3D0
> >[    0.039232] setup_percpu: NR_CPUS:32 nr_cpumask_bits:32
> >nr_cpu_ids:1 nr_node_ids:1
> >[    0.040672] percpu: Embedded 44 pages/cpu s142104 r8192 d29928
> >u2097152
> >[    0.040691] Built 1 zonelists, mobility grouping on.  Total pages:
> >128905
> >[    0.040693] Kernel command line: console=3DttyS0
> >BOOT_IMAGE=3D/boot/vmlinuz-virt initrd=3D/boot/initramfs-virt
> >alpine_dev=3Dcdrom:iso9660
> >modules=3Dloop,squashfs,sd-mod,usb-storage,sr-mod
> >[    0.041084] Dentry cache hash table entries: 65536 (order: 7, 524288
> >bytes)
> >[    0.041261] Inode-cache hash table entries: 32768 (order: 6, 262144
> >bytes)
> >[    0.042187] Memory: 491192K/523896K available (8204K kernel code,
> >731K rwdata, 2068K rodata, 1140K init, 608K bss, 32704K reserved, 0K
> >cma-reserved)
> >[    0.042312] SLUB: HWalign=3D64, Order=3D0-3, MinObjects=3D0, CPUs=3D1=
,
> >Nodes=3D1
> >[    0.042489] rcu: Hierarchical RCU implementation.
> >[    0.042490] rcu:     RCU restricting CPUs from NR_CPUS=3D32 to
> >nr_cpu_ids=3D1.
> >[    0.042492] rcu: Adjusting geometry for rcu_fanout_leaf=3D16,
> >nr_cpu_ids=3D1
> >[    0.042597] NR_IRQS: 4352, nr_irqs: 256, preallocated irqs: 16
> >[    0.042919] Console: colour EGA 80x25
> >[    0.099439] console [ttyS0] enabled
> >[    0.099897] ACPI: Core revision 20180810
> >[    0.100580] clocksource: hpet: mask: 0xffffffff max_cycles:
> >0xffffffff, max_idle_ns: 113919999973 ns
> >[    0.101779] APIC: Switch to symmetric I/O mode setup
> >[    0.103710] ..TIMER: vector=3D0x30 apic1=3D0 pin1=3D2 apic2=3D-1 pin2=
=3D-1
> >[    0.152418] clocksource: tsc-early: mask: 0xffffffffffffffff
> >max_cycles: 0x2cacc9e0a25, max_idle_ns: 440795241691 ns
> >[    0.153779] Calibrating delay loop (skipped), value calculated
> >using timer frequency.. 6198.65 BogoMIPS (lpj=3D30993250)
> >[    0.155179] pid_max: default: 32768 minimum: 301
> >[    0.155830] Mount-cache hash table entries: 1024 (order: 1, 8192
> >bytes)
> >[    0.156676] Mountpoint-cache hash table entries: 1024 (order: 1,
> >8192 bytes)
> >[    0.157888] Last level iTLB entries: 4KB 1024, 2MB 1024, 4MB 512
> >[    0.158688] Last level dTLB entries: 4KB 1536, 2MB 1536, 4MB 768,
> >1GB 0
> >[    0.159541] Spectre V1 : Mitigation: usercopy/swapgs barriers and
> >__user pointer sanitization
> >[    0.160636] Spectre V2 : Spectre mitigation: LFENCE not
> >serializing, switching to generic retpoline
> >[    0.161800] Spectre V2 : Mitigation: Full generic retpoline
> >[    0.162503] Spectre V2 : Spectre v2 / SpectreRSB mitigation:
> >Filling RSB on context switch
> >[    0.163777] Spectre V2 : mitigation: Enabling conditional Indirect
> >Branch Prediction Barrier
> >[    0.164852] Speculative Store Bypass: Vulnerable
> >[    0.168104] Freeing SMP alternatives memory: 24K
> >[    0.173772] smpboot: CPU0: AMD EPYC 7371 16-Core Processor (family:
> >0x17, model: 0x1, stepping: 0x2)
> >[    0.173772] Performance Events: PMU not available due to
> >virtualization, using software events only.
> >[    0.173772] rcu: Hierarchical SRCU implementation.
> >[    0.173772] random: crng done (trusting CPU's manufacturer)
> >[    0.173772] NMI watchdog: Perf NMI watchdog permanently disabled
> >[    0.173772] smp: Bringing up secondary CPUs ...
> >[    0.173772] smp: Brought up 1 node, 1 CPU
> >[    0.173772] smpboot: Max logical packages: 1
> >[    0.173772] ----------------
> >[    0.173772] | NMI testsuite:
> >[    0.173772] --------------------
> >[    0.173772]   remote IPI:  ok  |
> >[    0.173772]    local IPI:  ok  |
> >[    0.173772] --------------------
> >[    0.173772] Good, all   2 testcases passed! |
> >[    0.173772] ---------------------------------
> >[    0.173779] smpboot: Total of 1 processors activated (6198.65
> >BogoMIPS)
> >[    0.174744] devtmpfs: initialized
> >[    0.175250] x86/mm: Memory block size: 128MB
> >[    0.176042] clocksource: jiffies: mask: 0xffffffff max_cycles:
> >0xffffffff, max_idle_ns: 19112604462750000 ns
> >[    0.177302] futex hash table entries: 256 (order: 2, 16384 bytes)
> >[    0.178241] NET: Registered protocol family 16
> >[    0.178896] audit: initializing netlink subsys (disabled)
> >[    0.179724] cpuidle: using governor ladder
> >[    0.180267] cpuidle: using governor menu
> >[    0.181276] audit: type=3D2000 audit(1571322221.070:1):
> >state=3Dinitialized audit_enabled=3D0 res=3D1
> >[    0.182637] ACPI FADT declares the system doesn't support PCIe
> >ASPM, so disable it
> >[    0.183626] ACPI: bus type PCI registered
> >[    0.183772] acpiphp: ACPI Hot Plug PCI Controller Driver version:
> >0.5
> >[    0.183907] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem
> >0xe0000000-0xefffffff] (base 0xe0000000)
> >[    0.185106] PCI: not using MMCONFIG
> >[    0.185564] PCI: Using configuration type 1 for base access
> >[    0.186284] PCI: Using configuration type 1 for extended access
> >[    0.192668] HugeTLB registered 1.00 GiB page size, pre-allocated 0
> >pages
> >[    0.193776] HugeTLB registered 2.00 MiB page size, pre-allocated 0
> >pages
> >[    0.194758] ACPI: Added _OSI(Module Device)
> >[    0.195321] ACPI: Added _OSI(Processor Device)
> >[    0.195895] ACPI: Added _OSI(3.0 _SCP Extensions)
> >[    0.196506] ACPI: Added _OSI(Processor Aggregator Device)
> >[    0.197232] ACPI: Added _OSI(Linux-Dell-Video)
> >[    0.197813] ACPI: Added _OSI(Linux-Lenovo-NV-HDMI-Audio)
> >[    0.198743] ACPI: 1 ACPI AML tables successfully acquired and loaded
> >[    0.199794] ACPI: Interpreter enabled
> >[    0.200297] ACPI: (supports S0 S5)
> >[    0.200747] ACPI: Using IOAPIC for interrupt routing
> >[    0.201408] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem
> >0xe0000000-0xefffffff] (base 0xe0000000)
> >[    0.202648] PCI: MMCONFIG at [mem 0xe0000000-0xefffffff] reserved
> >in ACPI motherboard resources
> >[    0.203781] PCI: Using host bridge windows from ACPI; if necessary,
> >use "pci=3Dnocrs" and report a bug
> >[    0.205787] ACPI: PCI Root Bridge [PC00] (domain 0000 [bus 00])
> >[    0.206551] acpi PNP0A03:00: _OSC: OS supports [ExtendedConfig ASPM
> >ClockPM Segments MSI]
> >[    0.207620] acpi PNP0A03:00: _OSC failed (AE_NOT_FOUND); disabling
> >ASPM
> >[    0.208525] PCI host bridge to bus 0000:00
> >[    0.209051] pci_bus 0000:00: root bus resource [io  0x0000-0x0cf7
> >window]
> >[    0.209937] pci_bus 0000:00: root bus resource [io  0x0d00-0x1fff
> >window]
> >[    0.210823] pci_bus 0000:00: root bus resource [io  0x2000-0x207f
> >window]
> >[    0.211686] pci_bus 0000:00: root bus resource [mem
> >0xc0000000-0xc01fffff window]
> >[    0.212662] pci_bus 0000:00: root bus resource [mem
> >0xd000000000-0xd0000fffff window]
> >[    0.213774] pci_bus 0000:00: root bus resource [bus 00]
> >[    0.217648] ACPI: PCI Interrupt Link [LNKA] (IRQs 3 4 *5 6 7 9 10
> >11 12 14 15)
> >[    0.218651] ACPI: PCI Interrupt Link [LNKB] (IRQs 3 4 5 *6 7 9 10
> >11 12 14 15)
> >[    0.219671] ACPI: PCI Interrupt Link [LNKC] (IRQs 3 4 5 6 *7 9 10
> >11 12 14 15)
> >[    0.220672] ACPI: PCI Interrupt Link [LNKD] (IRQs 3 4 5 6 7 9 10 11
> >12 14 15) *0, disabled.
> >[    0.221806] ACPI: PCI Interrupt Link [LNKE] (IRQs 3 4 5 6 7 9 10 11
> >12 14 15) *0, disabled.
> >[    0.222926] ACPI: PCI Interrupt Link [LNKF] (IRQs 3 4 5 6 7 9 10 11
> >12 14 15) *0, disabled.
> >[    0.223823] ACPI: PCI Interrupt Link [LNKG] (IRQs 3 4 5 6 7 9 10 11
> >12 14 15) *0, disabled.
> >[    0.224985] ACPI: PCI Interrupt Link [LNKH] (IRQs 3 4 5 6 7 9 10 11
> >12 14 15) *0, disabled.
> >[    0.226176] SCSI subsystem initialized
> >[    0.227134] pps_core: LinuxPPS API ver. 1 registered
> >[    0.227811] pps_core: Software ver. 5.3.6 - Copyright 2005-2007
> >Rodolfo Giometti <giometti@linux.it>
> >[    0.229053] PTP clock support registered
> >[    0.229737] PCI: Using ACPI for IRQ routing
> >[    0.282465] clocksource: Switched to clocksource tsc-early
> >[    0.283772] VFS: Disk quotas dquot_6.6.0
> >[    0.283772] VFS: Dquot-cache hash table entries: 512 (order 0, 4096
> >bytes)
> >[    0.283772] pnp: PnP ACPI init
> >[    0.283772] system 00:02: [io  0x0220-0x0223] has been reserved
> >[    0.283772] system 00:02: [io  0x0224-0x0227] has been reserved
> >[    0.283772] system 00:02: [io  0x04d0-0x04d1] has been reserved
> >[    0.284356] system 00:02: [io  0x0400-0x0407] has been reserved
> >[    0.285134] system 00:02: [mem 0xe0000000-0xefffffff] has been
> >reserved
> >[    0.286071] pnp: PnP ACPI: found 6 devices
> >[    0.292735] clocksource: acpi_pm: mask: 0xffffff max_cycles:
> >0xffffff, max_idle_ns: 2085701024 ns
> >[    0.293934] pci 0000:00:03.0: BAR 6: assigned [mem
> >0xc0000800-0xc0000fff pref]
> >[    0.294869] pci 0000:00:04.0: BAR 6: assigned [mem
> >0xc0001000-0xc00017ff pref]
> >[    0.295823] pci 0000:00:05.0: BAR 6: assigned [mem
> >0xc0001800-0xc0001fff pref]
> >[    0.296790] pci 0000:00:1f.0: BAR 6: assigned [mem
> >0xc0006000-0xc00067ff pref]
> >[    0.297807] NET: Registered protocol family 2
> >[    0.298456] tcp_listen_portaddr_hash hash table entries: 256
> >(order: 0, 4096 bytes)
> >[    0.299466] TCP established hash table entries: 4096 (order: 3,
> >32768 bytes)
> >[    0.300405] TCP bind hash table entries: 4096 (order: 4, 65536
> >bytes)
> >[    0.301290] TCP: Hash tables configured (established 4096 bind 4096)
> >[    0.302158] UDP hash table entries: 256 (order: 1, 8192 bytes)
> >[    0.302919] UDP-Lite hash table entries: 256 (order: 1, 8192 bytes)
> >[    0.303767] NET: Registered protocol family 1
> >[    0.304392] pci 0000:00:1f.0: Activating ISA DMA hang workarounds
> >[    0.305764] Unpacking initramfs...
> >[    0.366638] Freeing initrd memory: 4928K
> >[    0.367535] Initialise system trusted keyrings
> >[    0.368340] workingset: timestamp_bits=3D46 max_order=3D17
> >bucket_order=3D0
> >[    0.371627] Key type asymmetric registered
> >[    0.372215] Block layer SCSI generic (bsg) driver version 0.4
> >loaded (major 250)
> >[    0.373247] io scheduler noop registered
> >[    0.373787] io scheduler deadline registered (default)
> >[    0.374466] io scheduler mq-deadline registered (default)
> >[    0.375099] io scheduler kyber registered
> >[    0.375764] ERST DBG: ERST support is disabled.
> >[    0.376430] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled
> >[    0.398514] 00:03: ttyS0 at I/O 0x3f8 (irq =3D 4, base_baud =3D 11520=
0)
> >is a 16550A
> >[    0.420753] 00:04: ttyS1 at I/O 0x2f8 (irq =3D 3, base_baud =3D 11520=
0)
> >is a 16550A
> >[    0.421950] VMware PVSCSI driver - version 1.0.7.0-k
> >[    0.422869] ahci 0000:00:03.0: SSS flag set, parallel bus scan
> >disabled
> >[    0.423866] ahci 0000:00:03.0: AHCI 0001.0300 32 slots 6 ports 6
> >Gbps 0x1 impl SATA mode
> >[    0.424892] ahci 0000:00:03.0: flags: 64bit ncq sntf ilck stag pm
> >led clo pio slum part sxs apst
> >[    0.426695] scsi host0: ahci
> >[    0.427181] scsi host1: ahci
> >[    0.427638] scsi host2: ahci
> >[    0.428102] scsi host3: ahci
> >[    0.428562] scsi host4: ahci
> >[    0.429027] scsi host5: ahci
> >[    0.429455] ata1: SATA max UDMA/133 abar m1024@0xc0000000 port
> >0xc0000100 irq 32
> >[    0.430437] ata2: DUMMY
> >[    0.430752] ata3: DUMMY
> >[    0.431095] ata4: DUMMY
> >[    0.431426] ata5: DUMMY
> >[    0.431745] ata6: DUMMY
> >[    0.432116] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU]
> >at 0x60,0x64 irq 1,12
> >[    0.433333] i8042: Warning: Keylock active
> >[    0.434382] serio: i8042 KBD port at 0x60,0x64 irq 1
> >[    0.435029] serio: i8042 AUX port at 0x60,0x64 irq 12
> >[    0.435771] ACPI Error: Could not enable RealTimeClock event
> >(20180810/evxfevnt-184)
> >[    0.436815] ACPI Warning: Could not enable fixed event -
> >RealTimeClock (4) (20180810/evxface-620)
> >[    0.438442] input: AT Raw Set 2 keyboard as
> >/devices/platform/i8042/serio0/input/input0
> >[    0.439904] rtc_cmos 00:05: registered as rtc0
> >[    0.440508] rtc_cmos 00:05: alarms up to one day, y3k, 114 bytes
> >nvram
> >[    0.441413] gre: GRE over IPv4 demultiplexor driver
> >[    0.442040] Key type dns_resolver registered
> >[    0.442624] sched_clock: Marking stable (374742215,
> >60992938)->(563738129, -128002976)
> >[    0.443796] registered taskstats version 1
> >[    0.444344] Loading compiled-in X.509 certificates
> >[    0.445222] rtc_cmos 00:05: setting system clock to 2019-10-17
> >14:23:41 UTC (1571322221)
> >[    0.775259] ata1: SATA link up 6.0 Gbps (SStatus 133 SControl 300)
> >[    0.776094] ata1.00: ATAPI: BHYVE SATA DVD ROM, 001, max UDMA/133
> >[    0.776965] ata1.00: configured for UDMA/133
> >[    0.777642] scsi 0:0:0:0: CD-ROM            BHYVE    BHYVE DVD-ROM
> >  001  PQ: 0 ANSI: 5
> >[    0.779270] Freeing unused kernel image memory: 1140K
> >[    0.805193] Write protecting the kernel read-only data: 14336k
> >[    0.806217] Freeing unused kernel image memory: 2016K
> >[    0.807114] Freeing unused kernel image memory: 2028K
> >[    0.807779] rodata_test: all tests were successful
> >[    0.808405] Run /init as init process
> >[    0.809435] general protection fault: 0000 [#1] SMP NOPTI
> >[    0.810155] CPU: 0 PID: 1 Comm: init Not tainted 4.19.67-0-virt
> >#1-Alpine
> >[    0.811032] Hardware name:  BHYVE, BIOS 1.00 03/14/2014
> >[    0.811738] RIP: 0010:switch_mm_irqs_off+0xa4/0x422
> >[    0.812352] Code: 48 c1 e8 09 83 e0 01 48 09 c6 65 48 8b 05 33 24
> >fd 4d 48 39 c6 74 15 48 09 f0 a8 01 74 0e b9 49 00 00 00 b8 01 00 00
> >00 31 d2 <0f> 30 65 48 89 35 11 24 fd 4d 0f 1f 44 00 00 eb 2e 65 48 8b
> >05 02
> >[    0.814784] RSP: 0018:ffffb0518000bcf8 EFLAGS: 00010046
> >[    0.815475] RAX: 0000000000000001 RBX: 0000000000000000 RCX:
> >0000000000000049
> >[    0.816413] RDX: 0000000000000000 RSI: ffff9ced1e452c00 RDI:
> >ffff9ced1e690000
> >[    0.817342] RBP: ffff9ced1e452c00 R08: ffff9ced1f2221f8 R09:
> >0000000000000000
> >[    0.818279] R10: 000000000000025e R11: ffff9ced1e690080 R12:
> >ffff9ced1e453800
> >[    0.819216] R13: ffff9ced1e690000 R14: ffff9ced1e453800 R15:
> >ffff9ced1e452c00
> >[    0.820157] FS:  00007f23ec2cdd48(0000) GS:ffff9ced1f200000(0000)
> >knlGS:0000000000000000
> >[    0.821185] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
> >[    0.821959] CR2: 00005639f0bdf8b8 CR3: 000000001eede000 CR4:
> >00000000000406b0
> >[    0.822864] Call Trace:
> >[    0.823204]  __schedule+0x69b/0x756
> >[    0.823668]  schedule+0x5b/0x6c
> >[    0.824090]  do_wait+0x1bc/0x21e
> >[    0.824516]  kernel_wait4+0xc0/0x115
> >[    0.825009]  ? __ia32_compat_sys_waitid+0x18/0x18
> >[    0.825623]  __se_sys_wait4+0x37/0x86
> >[    0.826127]  ? handle_mm_fault+0x149/0x19f
> >[    0.826691]  ? __do_page_fault+0x36a/0x3fc
> >[    0.827251]  do_syscall_64+0x50/0xeb
> >[    0.827720]  entry_SYSCALL_64_after_hwframe+0x44/0xa9
> >[    0.828382] RIP: 0033:0x7f23ec290080
> >[    0.828859] Code: c3 8b 07 85 c0 75 24 49 89 fb 48 89 f0 48 89 d7
> >48 89 ce 4c 89 c2 4d 89 ca 4c 8b 44 24 08 4c 8b 4c 24 10 4c 89 5c 24
> >08 0f 05 <c3> e9 a7 d3 ff ff 41 54 b8 02 00 00 00 49 89 f4 be 00 08 08
> >00 55
> >[    0.831332] RSP: 002b:00007ffe1e68a808 EFLAGS: 00000246 ORIG_RAX:
> >000000000000003d
> >[    0.832335] RAX: ffffffffffffffda RBX: 00007f23ec2cdd48 RCX:
> >00007f23ec290080
> >[    0.833276] RDX: 0000000000000000 RSI: 00007ffe1e68a86c RDI:
> >ffffffffffffffff
> >[    0.834240] RBP: 000000000000003d R08: 0000000000000000 R09:
> >0000000000000000
> >[    0.835161] R10: 0000000000000000 R11: 0000000000000246 R12:
> >00005639f10cfce0
> >[    0.836069] R13: 00007ffe1e68a86c R14: 00005639f0bc3836 R15:
> >0000000000000000
> >[    0.837030] Modules linked in:
> >[    0.837437] ---[ end trace f7b78a6a0742f2da ]---
> >[    0.838032] RIP: 0010:switch_mm_irqs_off+0xa4/0x422
> >[    0.838669] Code: 48 c1 e8 09 83 e0 01 48 09 c6 65 48 8b 05 33 24
> >fd 4d 48 39 c6 74 15 48 09 f0 a8 01 74 0e b9 49 00 00 00 b8 01 00 00
> >00 31 d2 <0f> 30 65 48 89 35 11 24 fd 4d 0f 1f 44 00 00 eb 2e 65 48 8b
> >05 02
> >[    0.841119] RSP: 0018:ffffb0518000bcf8 EFLAGS: 00010046
> >[    0.841813] RAX: 0000000000000001 RBX: 0000000000000000 RCX:
> >0000000000000049
> >[    0.842771] RDX: 0000000000000000 RSI: ffff9ced1e452c00 RDI:
> >ffff9ced1e690000
> >[    0.843681] RBP: ffff9ced1e452c00 R08: ffff9ced1f2221f8 R09:
> >0000000000000000
> >[    0.844622] R10: 000000000000025e R11: ffff9ced1e690080 R12:
> >ffff9ced1e453800
> >[    0.845560] R13: ffff9ced1e690000 R14: ffff9ced1e453800 R15:
> >ffff9ced1e452c00
> >[    0.846529] FS:  00007f23ec2cdd48(0000) GS:ffff9ced1f200000(0000)
> >knlGS:0000000000000000
> >[    0.847627] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
> >[    0.848383] CR2: 00005639f0bdf8b8 CR3: 000000001eede000 CR4:
> >00000000000406b0
> >
> >Does anyone have an idea how I can fix the problem?
> >
> >root@host:~ # cat /srv/vmm/alpine/vm-bhyve.log
> >Oct 17 16:23:37: initialising
> >Oct 17 16:23:37:  [loader: grub]
> >Oct 17 16:23:37:  [cpu: 1]
> >Oct 17 16:23:37:  [memory: 512M]
> >Oct 17 16:23:37:  [hostbridge: standard]
> >Oct 17 16:23:37:  [com ports: com1]
> >Oct 17 16:23:37:  [uuid: cf6a78d4-f0d1-11e9-ab90-002590b971a4]
> >Oct 17 16:23:37:  [utctime: yes]
> >Oct 17 16:23:37:  [debug mode: no]
> >Oct 17 16:23:37:  [primary disk: disk0.img]
> >Oct 17 16:23:37:  [primary disk dev: file]
> >Oct 17 16:23:37: initialising network device tap0
> >Oct 17 16:23:37: adding tap0 -> vm-public (public addm)
> >Oct 17 16:23:37: bring up tap0 -> vm-public (public addm)
> >Oct 17 16:23:37: booting
> >Oct 17 16:23:37: create file /srv/vmm/alpine/device.map
> >Oct 17 16:23:37:  -> (cd0) /srv/vmm/.iso/alpine-virt-3.10.2-x86_64.iso
> >Oct 17 16:23:37:  -> (hd0) /srv/vmm/alpine/disk0.img
> >Oct 17 16:23:37: create file /srv/vmm/alpine/grub.cfg
> >Oct 17 16:23:37:  -> timeout=3D3
> >Oct 17 16:23:37:  -> menuentry 'alpine (bhyve install)' {
> >Oct 17 16:23:37:  ->     root=3Dcd0
> >Oct 17 16:23:37:  ->     linux /boot/vmlinuz-virt
> >initrd=3D/boot/initramfs-virt alpine_dev=3Dcdrom:iso9660
> >modules=3Dloop,squashfs,sd-mod,usb-storage,sr-mod
> >Oct 17 16:23:37:  ->     initrd /boot/initramfs-virt
> >Oct 17 16:23:37:  -> }
> >Oct 17 16:23:37: /usr/local/sbin/grub-bhyve -c /dev/nmdm-alpine.1A -m
> >/srv/vmm/alpine/device.map -M 512M -r host -d /srv/vmm/alpine alpine
> >Oct 17 16:23:41:  [bhyve options: -c 1 -m 512M -AHP -U
> >cf6a78d4-f0d1-11e9-ab90-002590b971a4 -u]
> >Oct 17 16:23:41:  [bhyve devices: -s 0,hostbridge -s 31,lpc -s
> >4:0,virtio-blk,/srv/vmm/alpine/disk0.img -s
> >5:0,virtio-net,tap0,mac=3D58:9c:fc:03:fe:9b]
> >Oct 17 16:23:41:  [bhyve console: -l com1,/dev/nmdm-alpine.1A]
> >Oct 17 16:23:41:  [bhyve iso device: -s
> >3:0,ahci-cd,/srv/vmm/.iso/alpine-virt-3.10.2-x86_64.iso,ro]
> >Oct 17 16:23:41: starting bhyve (run 1)
> >
> >root@host:~ # uname -a
> >FreeBSD host.example.com 12.0-RELEASE-p10 FreeBSD 12.0-RELEASE-p10
> >GENERIC  amd64
> >
> >root@host:~ # pkg info
> >bhyve-firmware-1.0_1           Collection of Firmware for bhyve
> >ca_root_nss-3.46.1             Root certificate bundle from the Mozilla
> >Project
> >curl-7.66.0                    Command line tool and library for
> >transferring data with URLs
> >dmidecode-3.2                  Tool for dumping DMI (SMBIOS) contents
> >in human-readable format
> >e2fsprogs-libuuid-1.45.3       UUID library from e2fsprogs package
> >gettext-runtime-0.20.1         GNU gettext runtime libraries and
> >programs
> >grub2-bhyve-0.40_7             Grub-emu loader for bhyve
> >indexinfo-0.3.1                Utility to regenerate the GNU info page
> >index
> >libestr-0.1.11_1               Library for some string essentials
> >libfastjson-0.99.8             libfastjson is a fork from json-c
> >libffi-3.2.1_3                 Foreign Function Interface
> >libgcrypt-1.8.5                General purpose cryptographic library
> >based on the code from GnuPG
> >libgpg-error-1.36              Common error values for all GnuPG
> >components
> >liblogging-1.0.6               Easy to use system logging library
> >libnghttp2-1.39.2              HTTP/2.0 C Library
> >pkg-1.12.0                     Package manager
> >python-3.6_3,2                 "meta-port" for the default version of
> >Python interpreter
> >python3-3_3                    The "meta-port" for version 3 of the
> >Python interpreter
> >python36-3.6.9                 Interpreted object-oriented programming
> >language
> >readline-8.0.0                 Library for editing command lines as
> >they are typed
> >rsyslog-8.1908.0               Syslogd supporting SQL, TCP, and TLS
> >sudo-1.8.27_1                  Allow others to run commands as root
> >uefi-edk2-bhyve-0.2_1,1        UEFI-EDK2 firmware for bhyve
> >uefi-edk2-bhyve-csm-0.2_1,1    UEFI-EDK2 firmware for bhyve with CSM
> >vm-bhyve-1.3.0                 Management system for bhyve virtual
> >machines
> >
> >root@host:~ # cat /etc/rc.conf | grep vm
> >vm_enable=3D"YES"
> >vm_dir=3D"zfs:zroot/srv/vmm"
> >
> >root@host:~ # kldstat
> >Id Refs Address                Size Name
> > 1   39 0xffffffff80200000  243d228 kernel
> > 2    1 0xffffffff8263e000   3a9a10 zfs.ko
> > 3    2 0xffffffff829e8000     a4f0 opensolaris.ko
> > 4    1 0xffffffff829f3000    32b88 if_bnxt.ko
> > 5    1 0xffffffff82f12000     2678 intpm.ko
> > 6    1 0xffffffff82f15000      b10 smbus.ko
> > 7    1 0xffffffff82f16000     1800 uhid.ko
> > 8    1 0xffffffff82f18000     23a8 ums.ko
> > 9    1 0xffffffff82f1b000   537460 vmm.ko
> >10    1 0xffffffff83453000      b30 nmdm.ko
> >11    1 0xffffffff83454000     6fb3 if_bridge.ko
> >12    1 0xffffffff8345b000     4410 bridgestp.ko
> >13    1 0xffffffff83460000     2e77 if_tap.ko
> >
> >root@host:~ # cat /srv/vmm/alpine/alpine.conf
> >loader=3D"grub"
> >cpu=3D1
> >memory=3D512M
> >network0_type=3D"virtio-net"
> >network0_switch=3D"public"
> >disk0_type=3D"virtio-blk"
> >disk0_name=3D"disk0.img"
> >grub_install0=3D"linux /boot/vmlinuz-virt initrd=3D/boot/initramfs-virt
> >alpine_dev=3Dcdrom:iso9660
> >modules=3Dloop,squashfs,sd-mod,usb-storage,sr-mod"
> >grub_install1=3D"initrd /boot/initramfs-virt"
> >grub_run0=3D"linux /boot/vmlinuz-virt root=3D/dev/vda3 modules=3Dext4"
> >grub_run1=3D"initrd /boot/initramfs-virt"
> >uuid=3D"cf6a78d4-f0d1-11e9-ab90-002590b971a4"
> >network0_mac=3D"58:9c:fc:03:fe:9b"
> >
> >root@host:~ # cat /srv/vmm/alpine/device.map
> >(cd0) /srv/vmm/.iso/alpine-virt-3.10.2-x86_64.iso
> >(hd0) /srv/vmm/alpine/disk0.img
> >
> >root@host:~ # cat /srv/vmm/alpine/grub.cfg
> >timeout=3D3
> >menuentry 'alpine (bhyve install)' {
> >    root=3Dcd0
> >    linux /boot/vmlinuz-virt initrd=3D/boot/initramfs-virt
> >alpine_dev=3Dcdrom:iso9660
> >modules=3Dloop,squashfs,sd-mod,usb-storage,sr-mod
> >    initrd /boot/initramfs-virt
> >}
> >_______________________________________________
> >freebsd-virtualization@freebsd.org mailing list
> >https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization
> >To unsubscribe, send any mail to
> >"freebsd-virtualization-unsubscribe@freebsd.org"
>
> --
> edenist
>
> XMPP+OMEMO/PGP:      edenist@comms.edenist.net
> PGP Key ID:     0x3D56E58002FE4317
> PGP Key Fingerprint: 7240 9DD4 DB0A 953A 8F3E  A8FF 3D56 E580 02FE 4317



Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?CAGru6PtYQVsj5NVZkQ9e1muunidXE=ZLQRn7sYxFN5WCzNMxoQ>