From owner-freebsd-virtualization@freebsd.org Fri Oct 18 08:35:06 2019 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 0574A14A0FC for ; Fri, 18 Oct 2019 08:35:06 +0000 (UTC) (envelope-from digunit24@gmail.com) Received: from mail-ed1-x532.google.com (mail-ed1-x532.google.com [IPv6:2a00:1450:4864:20::532]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 46vfVJ4ypRz4JHk for ; Fri, 18 Oct 2019 08:35:04 +0000 (UTC) (envelope-from digunit24@gmail.com) Received: by mail-ed1-x532.google.com with SMTP id r18so3899619eds.13 for ; Fri, 18 Oct 2019 01:35:04 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc:content-transfer-encoding; bh=w09R/tqktuuZ1xhm7SGJORbzds0dbNNPhaABnvkzHg0=; b=UqaXqcThXqd7ggKTM3CeBxsmbIZ+4W+B4K3mex3JV0BN6JPZ1vq9FX2HTk+ZpYv96I U3EhQde77mKuw/LN7ESX21MQBkwrLmjlLPqgDorNmVKYCR1+FORu2tQpdV09jbprk5oJ 8y8Us4lwS4Cq0dZxaR1myAo+f+UKz4nhP6yZOwpWr+Xx02hGaTNVDsx01uUQQ6yCEFh6 DDCW/CmagQVnxUQjUD9Qo0fyWietJchvtz8H2FD54W/XavC0pIVU58x2JKePEz4vwQAX vbk3Gy+x65hh8GhGaTMBd4DM1/fXKDzhCe276rb4cmPHBprlpA1fNtLQfnfLhcazmvK/ t3vg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc:content-transfer-encoding; bh=w09R/tqktuuZ1xhm7SGJORbzds0dbNNPhaABnvkzHg0=; b=Aeu3mbR9S/nivIlE4yd248lxR+45L7FTsiVs7kc+tgJo6fBMZaxcVI/xq99hCXqDu9 0TEjJrU0jksWIh9gn1LE+IwbDagbMlEnRai4X098w7EixOFlim677zVlXvoATeuVr0xt CzIUk4Ay41bFBcyaMvmNpRc6T7O0Cpm/0eSH2LfI51qu/+Hl+j1F6CHyjOCInC9l/8J5 IJUwl2rFt4bdVeUFjFwAD7I+BlvqIvrK3aocvFw+IUGWZee18y7h1OoVve8HMkIz9JLI vvTEu3UiRzjhBERise864sjXJf4NCEmbeedJ393JltMLoBmjSgP1tNrBdY0fwaJKun3k CDxQ== X-Gm-Message-State: APjAAAW/ae1oAevVSXDQE4vgT+nPnloOkKAQMYHQD5YW5lJQapekvUTI pUDFWVKYbyBsyRPhcPf0HBv/SMmv5jPJtpk3rEm7nxYE X-Google-Smtp-Source: APXvYqzfGiKMB9va0b51RnUcgCTE1tQ1uYjBH+nerYzc0pbhSxN8B0Mqjp5VIA8Hy7wwzUUtCStazn0KDddFl6EPeIQ= X-Received: by 2002:a17:906:2410:: with SMTP id z16mr7563963eja.120.1571387702776; Fri, 18 Oct 2019 01:35:02 -0700 (PDT) MIME-Version: 1.0 References: <970C42D5-F891-4EBC-BE29-CE8D25650C28@edenist.net> In-Reply-To: <970C42D5-F891-4EBC-BE29-CE8D25650C28@edenist.net> From: Artur Moor Date: Fri, 18 Oct 2019 10:34:51 +0200 Message-ID: Subject: Re: Alpine Linux (alpine-virt-3.10.2) as guest in bhyve (FreeBSD 12.0-RELEASE-p10) To: edenist Cc: freebsd-virtualization@freebsd.org Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Rspamd-Queue-Id: 46vfVJ4ypRz4JHk X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=UqaXqcTh; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of digunit24@gmail.com designates 2a00:1450:4864:20::532 as permitted sender) smtp.mailfrom=digunit24@gmail.com X-Spamd-Result: default: False [-3.00 / 15.00]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36:c]; FREEMAIL_FROM(0.00)[gmail.com]; DKIM_TRACE(0.00)[gmail.com:+]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; FROM_EQ_ENVFROM(0.00)[]; IP_SCORE(0.00)[ip: (-9.52), ipnet: 2a00:1450::/32(-2.85), asn: 15169(-2.09), country: US(-0.05)]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; SH_EMAIL_ZRD(0.00)[192.0.0.0]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; FROM_HAS_DN(0.00)[]; SH_EMAIL_DBL_DONT_QUERY_IPS(0.00)[192.0.0.0]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-virtualization@freebsd.org]; IP_SCORE_FREEMAIL(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com.dwl.dnswl.org : 127.0.5.0]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[2.3.5.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.5.4.1.0.0.a.2.list.dnswl.org : 127.0.5.0]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[] X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 18 Oct 2019 08:35:06 -0000 Hi edenist, thank you for the tip regarding the deactivation some mitigation features in the kernel of the vm. Disabling the kernel module 'spectre_v2' of the VM does not cause the kernel panic: root@host:~ # diff /srv/vmm/alpine/alpine.conf /srv/vmm/alpine/alpine.spectre_v2=3Doff.conf 8c8 < grub_install0=3D"linux /boot/vmlinuz-virt initrd=3D/boot/initramfs-virt alpine_dev=3Dcdrom:iso9660 modules=3Dloop,squashfs,sd-mod,usb-storage,sr-mod" --- > grub_install0=3D"linux /boot/vmlinuz-virt initrd=3D/boot/initramfs-virt s= pectre_v2=3Doff alpine_dev=3Dcdrom:iso9660 modules=3Dloop,squashfs,sd-mod,u= sb-storage,sr-mod" Am Fr., 18. Okt. 2019 um 02:42 Uhr schrieb edenist : > > Hi Artur, > > I'm by no means a bhyve expert, but I have had similar kernel panics occu= r on my linux VMs over the last year. In my experience, it is related to me= ltdown/spectre mitigations, in particular those which are using features/MS= Rs implemented through microcode. There appears to be some confusion when a= linux VM expects CPU features to be available, but they aren't properly ex= posed on the host. > > I would recommend checking which microcode your CPU has and which feature= s it exposes on the host. Make sure you've got devcpu-data installed which = will keep your microcode up to date [if that's something you want to happen= ]. > > Try disabling various mitigation features by passing the relevant kernel = parameters at boot [on the VM]. They keep changing the syntax, but it will = be something like pti=3Doff, spectre_v2=3Doff etc.... You may be able to bi= sect which mitigation is causing the issues. > > Hope it helps! > > > On 18 October 2019 1:39:19 am AEDT, Artur Moor wrot= e: > >I have trouble with Alpine Linux as a guest in bhyve. When I try to > >start the installation 'vm install alpine > >alpine-virt-3.10.2-x86_64.iso' I get the following message in the > >console of the vm: > >[ 0.000000] Linux version 4.19.67-0-virt > >(buildozer@build-3-10-x86_64) (gcc version 8.3.0 (Alpine 8.3.0)) > >#1-Alpine SMP Mon Aug 19 10:05:34 UTC 2019 > >[ 0.000000] Command line: console=3DttyS0 > >BOOT_IMAGE=3D/boot/vmlinuz-virt initrd=3D/boot/initramfs-virt > >alpine_dev=3Dcdrom:iso9660 > >modules=3Dloop,squashfs,sd-mod,usb-storage,sr-mod > >[ 0.000000] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating > >point registers' > >[ 0.000000] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' > >[ 0.000000] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' > >[ 0.000000] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 > >[ 0.000000] x86/fpu: Enabled xstate features 0x7, context size is > >832 bytes, using 'standard' format. > >[ 0.000000] BIOS-provided physical RAM map: > >[ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fffe] > >usable > >[ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000001fffffff] > >usable > >[ 0.000000] NX (Execute Disable) protection: active > >[ 0.000000] SMBIOS 2.6 present. > >[ 0.000000] DMI: BHYVE, BIOS 1.00 03/14/2014 > >[ 0.000000] tsc: Fast TSC calibration using PIT > >[ 0.000000] tsc: Detected 3099.325 MHz processor > >[ 0.000135] last_pfn =3D 0x20000 max_arch_pfn =3D 0x400000000 > >[ 0.000144] Disabled > >[ 0.000145] x86/PAT: MTRRs disabled, skipping PAT initialization > >too. > >[ 0.000147] CPU MTRRs all blank - virtualized system. > >[ 0.000148] x86/PAT: Configuration [0-7]: WB WT UC- UC WB WT > >UC- UC > >[ 0.000173] Using GB pages for direct mapping > >[ 0.000209] RAMDISK: [mem 0x02aeb000-0x02fbafff] > >[ 0.000219] ACPI: Early table checksum verification disabled > >[ 0.000239] ACPI: RSDP 0x00000000000F2400 000024 (v02 BHYVE ) > >[ 0.000241] ACPI: XSDT 0x00000000000F2480 000044 (v01 BHYVE BVXSDT > > 00000001 INTL 20181003) > >[ 0.000245] ACPI: APIC 0x00000000000F2500 00005A (v01 BHYVE BVMADT > > 00000001 INTL 20181003) > >[ 0.000248] ACPI: FACP 0x00000000000F2600 00010C (v05 BHYVE BVFACP > > 00000001 INTL 20181003) > >[ 0.000251] ACPI: DSDT 0x00000000000F2800 00094B (v02 BHYVE BVDSDT > > 00000001 INTL 20181003) > >[ 0.000253] ACPI: FACS 0x00000000000F27C0 000040 > >[ 0.000255] ACPI: FACS 0x00000000000F27C0 000040 > >[ 0.000257] ACPI: HPET 0x00000000000F2740 000038 (v01 BHYVE BVHPET > > 00000001 INTL 20181003) > >[ 0.000259] ACPI: MCFG 0x00000000000F2780 00003C (v01 BHYVE BVMCFG > > 00000001 INTL 20181003) > >[ 0.000264] Setting APIC routing to physical flat. > >[ 0.000309] Zone ranges: > >[ 0.000309] DMA [mem 0x0000000000001000-0x0000000000ffffff] > >[ 0.000311] DMA32 [mem 0x0000000001000000-0x000000001fffffff] > >[ 0.000312] Normal empty > >[ 0.000312] Movable zone start for each node > >[ 0.000313] Early memory node ranges > >[ 0.000314] node 0: [mem 0x0000000000001000-0x000000000009efff] > >[ 0.000315] node 0: [mem 0x0000000000100000-0x000000001fffffff] > >[ 0.000328] Reserved but unavailable: 98 pages > >[ 0.000329] Initmem setup node 0 [mem > >0x0000000000001000-0x000000001fffffff] > >[ 0.007443] ACPI: PM-Timer IO Port: 0x408 > >[ 0.007449] ACPI: LAPIC_NMI (acpi_id[0xff] high edge lint[0x1]) > >[ 0.007475] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, > >GSI 0-31 > >[ 0.007476] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 high > >edge) > >[ 0.007478] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 low > >level) > >[ 0.007482] Using ACPI (MADT) for SMP configuration information > >[ 0.007483] ACPI: HPET id: 0x80860701 base: 0xfed00000 > >[ 0.007492] smpboot: Allowing 1 CPUs, 0 hotplug CPUs > >[ 0.007505] [mem 0x20000000-0xffffffff] available for PCI devices > >[ 0.007506] Booting paravirtualized kernel on bare hardware > >[ 0.007508] clocksource: refined-jiffies: mask: 0xffffffff > >max_cycles: 0xffffffff, max_idle_ns: 19112604462750000 ns > >[ 0.039227] random: get_random_bytes called from > >start_kernel+0x8e/0x4b0 with crng_init=3D0 > >[ 0.039232] setup_percpu: NR_CPUS:32 nr_cpumask_bits:32 > >nr_cpu_ids:1 nr_node_ids:1 > >[ 0.040672] percpu: Embedded 44 pages/cpu s142104 r8192 d29928 > >u2097152 > >[ 0.040691] Built 1 zonelists, mobility grouping on. Total pages: > >128905 > >[ 0.040693] Kernel command line: console=3DttyS0 > >BOOT_IMAGE=3D/boot/vmlinuz-virt initrd=3D/boot/initramfs-virt > >alpine_dev=3Dcdrom:iso9660 > >modules=3Dloop,squashfs,sd-mod,usb-storage,sr-mod > >[ 0.041084] Dentry cache hash table entries: 65536 (order: 7, 524288 > >bytes) > >[ 0.041261] Inode-cache hash table entries: 32768 (order: 6, 262144 > >bytes) > >[ 0.042187] Memory: 491192K/523896K available (8204K kernel code, > >731K rwdata, 2068K rodata, 1140K init, 608K bss, 32704K reserved, 0K > >cma-reserved) > >[ 0.042312] SLUB: HWalign=3D64, Order=3D0-3, MinObjects=3D0, CPUs=3D1= , > >Nodes=3D1 > >[ 0.042489] rcu: Hierarchical RCU implementation. > >[ 0.042490] rcu: RCU restricting CPUs from NR_CPUS=3D32 to > >nr_cpu_ids=3D1. > >[ 0.042492] rcu: Adjusting geometry for rcu_fanout_leaf=3D16, > >nr_cpu_ids=3D1 > >[ 0.042597] NR_IRQS: 4352, nr_irqs: 256, preallocated irqs: 16 > >[ 0.042919] Console: colour EGA 80x25 > >[ 0.099439] console [ttyS0] enabled > >[ 0.099897] ACPI: Core revision 20180810 > >[ 0.100580] clocksource: hpet: mask: 0xffffffff max_cycles: > >0xffffffff, max_idle_ns: 113919999973 ns > >[ 0.101779] APIC: Switch to symmetric I/O mode setup > >[ 0.103710] ..TIMER: vector=3D0x30 apic1=3D0 pin1=3D2 apic2=3D-1 pin2= =3D-1 > >[ 0.152418] clocksource: tsc-early: mask: 0xffffffffffffffff > >max_cycles: 0x2cacc9e0a25, max_idle_ns: 440795241691 ns > >[ 0.153779] Calibrating delay loop (skipped), value calculated > >using timer frequency.. 6198.65 BogoMIPS (lpj=3D30993250) > >[ 0.155179] pid_max: default: 32768 minimum: 301 > >[ 0.155830] Mount-cache hash table entries: 1024 (order: 1, 8192 > >bytes) > >[ 0.156676] Mountpoint-cache hash table entries: 1024 (order: 1, > >8192 bytes) > >[ 0.157888] Last level iTLB entries: 4KB 1024, 2MB 1024, 4MB 512 > >[ 0.158688] Last level dTLB entries: 4KB 1536, 2MB 1536, 4MB 768, > >1GB 0 > >[ 0.159541] Spectre V1 : Mitigation: usercopy/swapgs barriers and > >__user pointer sanitization > >[ 0.160636] Spectre V2 : Spectre mitigation: LFENCE not > >serializing, switching to generic retpoline > >[ 0.161800] Spectre V2 : Mitigation: Full generic retpoline > >[ 0.162503] Spectre V2 : Spectre v2 / SpectreRSB mitigation: > >Filling RSB on context switch > >[ 0.163777] Spectre V2 : mitigation: Enabling conditional Indirect > >Branch Prediction Barrier > >[ 0.164852] Speculative Store Bypass: Vulnerable > >[ 0.168104] Freeing SMP alternatives memory: 24K > >[ 0.173772] smpboot: CPU0: AMD EPYC 7371 16-Core Processor (family: > >0x17, model: 0x1, stepping: 0x2) > >[ 0.173772] Performance Events: PMU not available due to > >virtualization, using software events only. > >[ 0.173772] rcu: Hierarchical SRCU implementation. > >[ 0.173772] random: crng done (trusting CPU's manufacturer) > >[ 0.173772] NMI watchdog: Perf NMI watchdog permanently disabled > >[ 0.173772] smp: Bringing up secondary CPUs ... > >[ 0.173772] smp: Brought up 1 node, 1 CPU > >[ 0.173772] smpboot: Max logical packages: 1 > >[ 0.173772] ---------------- > >[ 0.173772] | NMI testsuite: > >[ 0.173772] -------------------- > >[ 0.173772] remote IPI: ok | > >[ 0.173772] local IPI: ok | > >[ 0.173772] -------------------- > >[ 0.173772] Good, all 2 testcases passed! | > >[ 0.173772] --------------------------------- > >[ 0.173779] smpboot: Total of 1 processors activated (6198.65 > >BogoMIPS) > >[ 0.174744] devtmpfs: initialized > >[ 0.175250] x86/mm: Memory block size: 128MB > >[ 0.176042] clocksource: jiffies: mask: 0xffffffff max_cycles: > >0xffffffff, max_idle_ns: 19112604462750000 ns > >[ 0.177302] futex hash table entries: 256 (order: 2, 16384 bytes) > >[ 0.178241] NET: Registered protocol family 16 > >[ 0.178896] audit: initializing netlink subsys (disabled) > >[ 0.179724] cpuidle: using governor ladder > >[ 0.180267] cpuidle: using governor menu > >[ 0.181276] audit: type=3D2000 audit(1571322221.070:1): > >state=3Dinitialized audit_enabled=3D0 res=3D1 > >[ 0.182637] ACPI FADT declares the system doesn't support PCIe > >ASPM, so disable it > >[ 0.183626] ACPI: bus type PCI registered > >[ 0.183772] acpiphp: ACPI Hot Plug PCI Controller Driver version: > >0.5 > >[ 0.183907] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem > >0xe0000000-0xefffffff] (base 0xe0000000) > >[ 0.185106] PCI: not using MMCONFIG > >[ 0.185564] PCI: Using configuration type 1 for base access > >[ 0.186284] PCI: Using configuration type 1 for extended access > >[ 0.192668] HugeTLB registered 1.00 GiB page size, pre-allocated 0 > >pages > >[ 0.193776] HugeTLB registered 2.00 MiB page size, pre-allocated 0 > >pages > >[ 0.194758] ACPI: Added _OSI(Module Device) > >[ 0.195321] ACPI: Added _OSI(Processor Device) > >[ 0.195895] ACPI: Added _OSI(3.0 _SCP Extensions) > >[ 0.196506] ACPI: Added _OSI(Processor Aggregator Device) > >[ 0.197232] ACPI: Added _OSI(Linux-Dell-Video) > >[ 0.197813] ACPI: Added _OSI(Linux-Lenovo-NV-HDMI-Audio) > >[ 0.198743] ACPI: 1 ACPI AML tables successfully acquired and loaded > >[ 0.199794] ACPI: Interpreter enabled > >[ 0.200297] ACPI: (supports S0 S5) > >[ 0.200747] ACPI: Using IOAPIC for interrupt routing > >[ 0.201408] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem > >0xe0000000-0xefffffff] (base 0xe0000000) > >[ 0.202648] PCI: MMCONFIG at [mem 0xe0000000-0xefffffff] reserved > >in ACPI motherboard resources > >[ 0.203781] PCI: Using host bridge windows from ACPI; if necessary, > >use "pci=3Dnocrs" and report a bug > >[ 0.205787] ACPI: PCI Root Bridge [PC00] (domain 0000 [bus 00]) > >[ 0.206551] acpi PNP0A03:00: _OSC: OS supports [ExtendedConfig ASPM > >ClockPM Segments MSI] > >[ 0.207620] acpi PNP0A03:00: _OSC failed (AE_NOT_FOUND); disabling > >ASPM > >[ 0.208525] PCI host bridge to bus 0000:00 > >[ 0.209051] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 > >window] > >[ 0.209937] pci_bus 0000:00: root bus resource [io 0x0d00-0x1fff > >window] > >[ 0.210823] pci_bus 0000:00: root bus resource [io 0x2000-0x207f > >window] > >[ 0.211686] pci_bus 0000:00: root bus resource [mem > >0xc0000000-0xc01fffff window] > >[ 0.212662] pci_bus 0000:00: root bus resource [mem > >0xd000000000-0xd0000fffff window] > >[ 0.213774] pci_bus 0000:00: root bus resource [bus 00] > >[ 0.217648] ACPI: PCI Interrupt Link [LNKA] (IRQs 3 4 *5 6 7 9 10 > >11 12 14 15) > >[ 0.218651] ACPI: PCI Interrupt Link [LNKB] (IRQs 3 4 5 *6 7 9 10 > >11 12 14 15) > >[ 0.219671] ACPI: PCI Interrupt Link [LNKC] (IRQs 3 4 5 6 *7 9 10 > >11 12 14 15) > >[ 0.220672] ACPI: PCI Interrupt Link [LNKD] (IRQs 3 4 5 6 7 9 10 11 > >12 14 15) *0, disabled. > >[ 0.221806] ACPI: PCI Interrupt Link [LNKE] (IRQs 3 4 5 6 7 9 10 11 > >12 14 15) *0, disabled. > >[ 0.222926] ACPI: PCI Interrupt Link [LNKF] (IRQs 3 4 5 6 7 9 10 11 > >12 14 15) *0, disabled. > >[ 0.223823] ACPI: PCI Interrupt Link [LNKG] (IRQs 3 4 5 6 7 9 10 11 > >12 14 15) *0, disabled. > >[ 0.224985] ACPI: PCI Interrupt Link [LNKH] (IRQs 3 4 5 6 7 9 10 11 > >12 14 15) *0, disabled. > >[ 0.226176] SCSI subsystem initialized > >[ 0.227134] pps_core: LinuxPPS API ver. 1 registered > >[ 0.227811] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 > >Rodolfo Giometti > >[ 0.229053] PTP clock support registered > >[ 0.229737] PCI: Using ACPI for IRQ routing > >[ 0.282465] clocksource: Switched to clocksource tsc-early > >[ 0.283772] VFS: Disk quotas dquot_6.6.0 > >[ 0.283772] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 > >bytes) > >[ 0.283772] pnp: PnP ACPI init > >[ 0.283772] system 00:02: [io 0x0220-0x0223] has been reserved > >[ 0.283772] system 00:02: [io 0x0224-0x0227] has been reserved > >[ 0.283772] system 00:02: [io 0x04d0-0x04d1] has been reserved > >[ 0.284356] system 00:02: [io 0x0400-0x0407] has been reserved > >[ 0.285134] system 00:02: [mem 0xe0000000-0xefffffff] has been > >reserved > >[ 0.286071] pnp: PnP ACPI: found 6 devices > >[ 0.292735] clocksource: acpi_pm: mask: 0xffffff max_cycles: > >0xffffff, max_idle_ns: 2085701024 ns > >[ 0.293934] pci 0000:00:03.0: BAR 6: assigned [mem > >0xc0000800-0xc0000fff pref] > >[ 0.294869] pci 0000:00:04.0: BAR 6: assigned [mem > >0xc0001000-0xc00017ff pref] > >[ 0.295823] pci 0000:00:05.0: BAR 6: assigned [mem > >0xc0001800-0xc0001fff pref] > >[ 0.296790] pci 0000:00:1f.0: BAR 6: assigned [mem > >0xc0006000-0xc00067ff pref] > >[ 0.297807] NET: Registered protocol family 2 > >[ 0.298456] tcp_listen_portaddr_hash hash table entries: 256 > >(order: 0, 4096 bytes) > >[ 0.299466] TCP established hash table entries: 4096 (order: 3, > >32768 bytes) > >[ 0.300405] TCP bind hash table entries: 4096 (order: 4, 65536 > >bytes) > >[ 0.301290] TCP: Hash tables configured (established 4096 bind 4096) > >[ 0.302158] UDP hash table entries: 256 (order: 1, 8192 bytes) > >[ 0.302919] UDP-Lite hash table entries: 256 (order: 1, 8192 bytes) > >[ 0.303767] NET: Registered protocol family 1 > >[ 0.304392] pci 0000:00:1f.0: Activating ISA DMA hang workarounds > >[ 0.305764] Unpacking initramfs... > >[ 0.366638] Freeing initrd memory: 4928K > >[ 0.367535] Initialise system trusted keyrings > >[ 0.368340] workingset: timestamp_bits=3D46 max_order=3D17 > >bucket_order=3D0 > >[ 0.371627] Key type asymmetric registered > >[ 0.372215] Block layer SCSI generic (bsg) driver version 0.4 > >loaded (major 250) > >[ 0.373247] io scheduler noop registered > >[ 0.373787] io scheduler deadline registered (default) > >[ 0.374466] io scheduler mq-deadline registered (default) > >[ 0.375099] io scheduler kyber registered > >[ 0.375764] ERST DBG: ERST support is disabled. > >[ 0.376430] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled > >[ 0.398514] 00:03: ttyS0 at I/O 0x3f8 (irq =3D 4, base_baud =3D 11520= 0) > >is a 16550A > >[ 0.420753] 00:04: ttyS1 at I/O 0x2f8 (irq =3D 3, base_baud =3D 11520= 0) > >is a 16550A > >[ 0.421950] VMware PVSCSI driver - version 1.0.7.0-k > >[ 0.422869] ahci 0000:00:03.0: SSS flag set, parallel bus scan > >disabled > >[ 0.423866] ahci 0000:00:03.0: AHCI 0001.0300 32 slots 6 ports 6 > >Gbps 0x1 impl SATA mode > >[ 0.424892] ahci 0000:00:03.0: flags: 64bit ncq sntf ilck stag pm > >led clo pio slum part sxs apst > >[ 0.426695] scsi host0: ahci > >[ 0.427181] scsi host1: ahci > >[ 0.427638] scsi host2: ahci > >[ 0.428102] scsi host3: ahci > >[ 0.428562] scsi host4: ahci > >[ 0.429027] scsi host5: ahci > >[ 0.429455] ata1: SATA max UDMA/133 abar m1024@0xc0000000 port > >0xc0000100 irq 32 > >[ 0.430437] ata2: DUMMY > >[ 0.430752] ata3: DUMMY > >[ 0.431095] ata4: DUMMY > >[ 0.431426] ata5: DUMMY > >[ 0.431745] ata6: DUMMY > >[ 0.432116] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] > >at 0x60,0x64 irq 1,12 > >[ 0.433333] i8042: Warning: Keylock active > >[ 0.434382] serio: i8042 KBD port at 0x60,0x64 irq 1 > >[ 0.435029] serio: i8042 AUX port at 0x60,0x64 irq 12 > >[ 0.435771] ACPI Error: Could not enable RealTimeClock event > >(20180810/evxfevnt-184) > >[ 0.436815] ACPI Warning: Could not enable fixed event - > >RealTimeClock (4) (20180810/evxface-620) > >[ 0.438442] input: AT Raw Set 2 keyboard as > >/devices/platform/i8042/serio0/input/input0 > >[ 0.439904] rtc_cmos 00:05: registered as rtc0 > >[ 0.440508] rtc_cmos 00:05: alarms up to one day, y3k, 114 bytes > >nvram > >[ 0.441413] gre: GRE over IPv4 demultiplexor driver > >[ 0.442040] Key type dns_resolver registered > >[ 0.442624] sched_clock: Marking stable (374742215, > >60992938)->(563738129, -128002976) > >[ 0.443796] registered taskstats version 1 > >[ 0.444344] Loading compiled-in X.509 certificates > >[ 0.445222] rtc_cmos 00:05: setting system clock to 2019-10-17 > >14:23:41 UTC (1571322221) > >[ 0.775259] ata1: SATA link up 6.0 Gbps (SStatus 133 SControl 300) > >[ 0.776094] ata1.00: ATAPI: BHYVE SATA DVD ROM, 001, max UDMA/133 > >[ 0.776965] ata1.00: configured for UDMA/133 > >[ 0.777642] scsi 0:0:0:0: CD-ROM BHYVE BHYVE DVD-ROM > > 001 PQ: 0 ANSI: 5 > >[ 0.779270] Freeing unused kernel image memory: 1140K > >[ 0.805193] Write protecting the kernel read-only data: 14336k > >[ 0.806217] Freeing unused kernel image memory: 2016K > >[ 0.807114] Freeing unused kernel image memory: 2028K > >[ 0.807779] rodata_test: all tests were successful > >[ 0.808405] Run /init as init process > >[ 0.809435] general protection fault: 0000 [#1] SMP NOPTI > >[ 0.810155] CPU: 0 PID: 1 Comm: init Not tainted 4.19.67-0-virt > >#1-Alpine > >[ 0.811032] Hardware name: BHYVE, BIOS 1.00 03/14/2014 > >[ 0.811738] RIP: 0010:switch_mm_irqs_off+0xa4/0x422 > >[ 0.812352] Code: 48 c1 e8 09 83 e0 01 48 09 c6 65 48 8b 05 33 24 > >fd 4d 48 39 c6 74 15 48 09 f0 a8 01 74 0e b9 49 00 00 00 b8 01 00 00 > >00 31 d2 <0f> 30 65 48 89 35 11 24 fd 4d 0f 1f 44 00 00 eb 2e 65 48 8b > >05 02 > >[ 0.814784] RSP: 0018:ffffb0518000bcf8 EFLAGS: 00010046 > >[ 0.815475] RAX: 0000000000000001 RBX: 0000000000000000 RCX: > >0000000000000049 > >[ 0.816413] RDX: 0000000000000000 RSI: ffff9ced1e452c00 RDI: > >ffff9ced1e690000 > >[ 0.817342] RBP: ffff9ced1e452c00 R08: ffff9ced1f2221f8 R09: > >0000000000000000 > >[ 0.818279] R10: 000000000000025e R11: ffff9ced1e690080 R12: > >ffff9ced1e453800 > >[ 0.819216] R13: ffff9ced1e690000 R14: ffff9ced1e453800 R15: > >ffff9ced1e452c00 > >[ 0.820157] FS: 00007f23ec2cdd48(0000) GS:ffff9ced1f200000(0000) > >knlGS:0000000000000000 > >[ 0.821185] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 > >[ 0.821959] CR2: 00005639f0bdf8b8 CR3: 000000001eede000 CR4: > >00000000000406b0 > >[ 0.822864] Call Trace: > >[ 0.823204] __schedule+0x69b/0x756 > >[ 0.823668] schedule+0x5b/0x6c > >[ 0.824090] do_wait+0x1bc/0x21e > >[ 0.824516] kernel_wait4+0xc0/0x115 > >[ 0.825009] ? __ia32_compat_sys_waitid+0x18/0x18 > >[ 0.825623] __se_sys_wait4+0x37/0x86 > >[ 0.826127] ? handle_mm_fault+0x149/0x19f > >[ 0.826691] ? __do_page_fault+0x36a/0x3fc > >[ 0.827251] do_syscall_64+0x50/0xeb > >[ 0.827720] entry_SYSCALL_64_after_hwframe+0x44/0xa9 > >[ 0.828382] RIP: 0033:0x7f23ec290080 > >[ 0.828859] Code: c3 8b 07 85 c0 75 24 49 89 fb 48 89 f0 48 89 d7 > >48 89 ce 4c 89 c2 4d 89 ca 4c 8b 44 24 08 4c 8b 4c 24 10 4c 89 5c 24 > >08 0f 05 e9 a7 d3 ff ff 41 54 b8 02 00 00 00 49 89 f4 be 00 08 08 > >00 55 > >[ 0.831332] RSP: 002b:00007ffe1e68a808 EFLAGS: 00000246 ORIG_RAX: > >000000000000003d > >[ 0.832335] RAX: ffffffffffffffda RBX: 00007f23ec2cdd48 RCX: > >00007f23ec290080 > >[ 0.833276] RDX: 0000000000000000 RSI: 00007ffe1e68a86c RDI: > >ffffffffffffffff > >[ 0.834240] RBP: 000000000000003d R08: 0000000000000000 R09: > >0000000000000000 > >[ 0.835161] R10: 0000000000000000 R11: 0000000000000246 R12: > >00005639f10cfce0 > >[ 0.836069] R13: 00007ffe1e68a86c R14: 00005639f0bc3836 R15: > >0000000000000000 > >[ 0.837030] Modules linked in: > >[ 0.837437] ---[ end trace f7b78a6a0742f2da ]--- > >[ 0.838032] RIP: 0010:switch_mm_irqs_off+0xa4/0x422 > >[ 0.838669] Code: 48 c1 e8 09 83 e0 01 48 09 c6 65 48 8b 05 33 24 > >fd 4d 48 39 c6 74 15 48 09 f0 a8 01 74 0e b9 49 00 00 00 b8 01 00 00 > >00 31 d2 <0f> 30 65 48 89 35 11 24 fd 4d 0f 1f 44 00 00 eb 2e 65 48 8b > >05 02 > >[ 0.841119] RSP: 0018:ffffb0518000bcf8 EFLAGS: 00010046 > >[ 0.841813] RAX: 0000000000000001 RBX: 0000000000000000 RCX: > >0000000000000049 > >[ 0.842771] RDX: 0000000000000000 RSI: ffff9ced1e452c00 RDI: > >ffff9ced1e690000 > >[ 0.843681] RBP: ffff9ced1e452c00 R08: ffff9ced1f2221f8 R09: > >0000000000000000 > >[ 0.844622] R10: 000000000000025e R11: ffff9ced1e690080 R12: > >ffff9ced1e453800 > >[ 0.845560] R13: ffff9ced1e690000 R14: ffff9ced1e453800 R15: > >ffff9ced1e452c00 > >[ 0.846529] FS: 00007f23ec2cdd48(0000) GS:ffff9ced1f200000(0000) > >knlGS:0000000000000000 > >[ 0.847627] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 > >[ 0.848383] CR2: 00005639f0bdf8b8 CR3: 000000001eede000 CR4: > >00000000000406b0 > > > >Does anyone have an idea how I can fix the problem? > > > >root@host:~ # cat /srv/vmm/alpine/vm-bhyve.log > >Oct 17 16:23:37: initialising > >Oct 17 16:23:37: [loader: grub] > >Oct 17 16:23:37: [cpu: 1] > >Oct 17 16:23:37: [memory: 512M] > >Oct 17 16:23:37: [hostbridge: standard] > >Oct 17 16:23:37: [com ports: com1] > >Oct 17 16:23:37: [uuid: cf6a78d4-f0d1-11e9-ab90-002590b971a4] > >Oct 17 16:23:37: [utctime: yes] > >Oct 17 16:23:37: [debug mode: no] > >Oct 17 16:23:37: [primary disk: disk0.img] > >Oct 17 16:23:37: [primary disk dev: file] > >Oct 17 16:23:37: initialising network device tap0 > >Oct 17 16:23:37: adding tap0 -> vm-public (public addm) > >Oct 17 16:23:37: bring up tap0 -> vm-public (public addm) > >Oct 17 16:23:37: booting > >Oct 17 16:23:37: create file /srv/vmm/alpine/device.map > >Oct 17 16:23:37: -> (cd0) /srv/vmm/.iso/alpine-virt-3.10.2-x86_64.iso > >Oct 17 16:23:37: -> (hd0) /srv/vmm/alpine/disk0.img > >Oct 17 16:23:37: create file /srv/vmm/alpine/grub.cfg > >Oct 17 16:23:37: -> timeout=3D3 > >Oct 17 16:23:37: -> menuentry 'alpine (bhyve install)' { > >Oct 17 16:23:37: -> root=3Dcd0 > >Oct 17 16:23:37: -> linux /boot/vmlinuz-virt > >initrd=3D/boot/initramfs-virt alpine_dev=3Dcdrom:iso9660 > >modules=3Dloop,squashfs,sd-mod,usb-storage,sr-mod > >Oct 17 16:23:37: -> initrd /boot/initramfs-virt > >Oct 17 16:23:37: -> } > >Oct 17 16:23:37: /usr/local/sbin/grub-bhyve -c /dev/nmdm-alpine.1A -m > >/srv/vmm/alpine/device.map -M 512M -r host -d /srv/vmm/alpine alpine > >Oct 17 16:23:41: [bhyve options: -c 1 -m 512M -AHP -U > >cf6a78d4-f0d1-11e9-ab90-002590b971a4 -u] > >Oct 17 16:23:41: [bhyve devices: -s 0,hostbridge -s 31,lpc -s > >4:0,virtio-blk,/srv/vmm/alpine/disk0.img -s > >5:0,virtio-net,tap0,mac=3D58:9c:fc:03:fe:9b] > >Oct 17 16:23:41: [bhyve console: -l com1,/dev/nmdm-alpine.1A] > >Oct 17 16:23:41: [bhyve iso device: -s > >3:0,ahci-cd,/srv/vmm/.iso/alpine-virt-3.10.2-x86_64.iso,ro] > >Oct 17 16:23:41: starting bhyve (run 1) > > > >root@host:~ # uname -a > >FreeBSD host.example.com 12.0-RELEASE-p10 FreeBSD 12.0-RELEASE-p10 > >GENERIC amd64 > > > >root@host:~ # pkg info > >bhyve-firmware-1.0_1 Collection of Firmware for bhyve > >ca_root_nss-3.46.1 Root certificate bundle from the Mozilla > >Project > >curl-7.66.0 Command line tool and library for > >transferring data with URLs > >dmidecode-3.2 Tool for dumping DMI (SMBIOS) contents > >in human-readable format > >e2fsprogs-libuuid-1.45.3 UUID library from e2fsprogs package > >gettext-runtime-0.20.1 GNU gettext runtime libraries and > >programs > >grub2-bhyve-0.40_7 Grub-emu loader for bhyve > >indexinfo-0.3.1 Utility to regenerate the GNU info page > >index > >libestr-0.1.11_1 Library for some string essentials > >libfastjson-0.99.8 libfastjson is a fork from json-c > >libffi-3.2.1_3 Foreign Function Interface > >libgcrypt-1.8.5 General purpose cryptographic library > >based on the code from GnuPG > >libgpg-error-1.36 Common error values for all GnuPG > >components > >liblogging-1.0.6 Easy to use system logging library > >libnghttp2-1.39.2 HTTP/2.0 C Library > >pkg-1.12.0 Package manager > >python-3.6_3,2 "meta-port" for the default version of > >Python interpreter > >python3-3_3 The "meta-port" for version 3 of the > >Python interpreter > >python36-3.6.9 Interpreted object-oriented programming > >language > >readline-8.0.0 Library for editing command lines as > >they are typed > >rsyslog-8.1908.0 Syslogd supporting SQL, TCP, and TLS > >sudo-1.8.27_1 Allow others to run commands as root > >uefi-edk2-bhyve-0.2_1,1 UEFI-EDK2 firmware for bhyve > >uefi-edk2-bhyve-csm-0.2_1,1 UEFI-EDK2 firmware for bhyve with CSM > >vm-bhyve-1.3.0 Management system for bhyve virtual > >machines > > > >root@host:~ # cat /etc/rc.conf | grep vm > >vm_enable=3D"YES" > >vm_dir=3D"zfs:zroot/srv/vmm" > > > >root@host:~ # kldstat > >Id Refs Address Size Name > > 1 39 0xffffffff80200000 243d228 kernel > > 2 1 0xffffffff8263e000 3a9a10 zfs.ko > > 3 2 0xffffffff829e8000 a4f0 opensolaris.ko > > 4 1 0xffffffff829f3000 32b88 if_bnxt.ko > > 5 1 0xffffffff82f12000 2678 intpm.ko > > 6 1 0xffffffff82f15000 b10 smbus.ko > > 7 1 0xffffffff82f16000 1800 uhid.ko > > 8 1 0xffffffff82f18000 23a8 ums.ko > > 9 1 0xffffffff82f1b000 537460 vmm.ko > >10 1 0xffffffff83453000 b30 nmdm.ko > >11 1 0xffffffff83454000 6fb3 if_bridge.ko > >12 1 0xffffffff8345b000 4410 bridgestp.ko > >13 1 0xffffffff83460000 2e77 if_tap.ko > > > >root@host:~ # cat /srv/vmm/alpine/alpine.conf > >loader=3D"grub" > >cpu=3D1 > >memory=3D512M > >network0_type=3D"virtio-net" > >network0_switch=3D"public" > >disk0_type=3D"virtio-blk" > >disk0_name=3D"disk0.img" > >grub_install0=3D"linux /boot/vmlinuz-virt initrd=3D/boot/initramfs-virt > >alpine_dev=3Dcdrom:iso9660 > >modules=3Dloop,squashfs,sd-mod,usb-storage,sr-mod" > >grub_install1=3D"initrd /boot/initramfs-virt" > >grub_run0=3D"linux /boot/vmlinuz-virt root=3D/dev/vda3 modules=3Dext4" > >grub_run1=3D"initrd /boot/initramfs-virt" > >uuid=3D"cf6a78d4-f0d1-11e9-ab90-002590b971a4" > >network0_mac=3D"58:9c:fc:03:fe:9b" > > > >root@host:~ # cat /srv/vmm/alpine/device.map > >(cd0) /srv/vmm/.iso/alpine-virt-3.10.2-x86_64.iso > >(hd0) /srv/vmm/alpine/disk0.img > > > >root@host:~ # cat /srv/vmm/alpine/grub.cfg > >timeout=3D3 > >menuentry 'alpine (bhyve install)' { > > root=3Dcd0 > > linux /boot/vmlinuz-virt initrd=3D/boot/initramfs-virt > >alpine_dev=3Dcdrom:iso9660 > >modules=3Dloop,squashfs,sd-mod,usb-storage,sr-mod > > initrd /boot/initramfs-virt > >} > >_______________________________________________ > >freebsd-virtualization@freebsd.org mailing list > >https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > >To unsubscribe, send any mail to > >"freebsd-virtualization-unsubscribe@freebsd.org" > > -- > edenist > > XMPP+OMEMO/PGP: edenist@comms.edenist.net > PGP Key ID: 0x3D56E58002FE4317 > PGP Key Fingerprint: 7240 9DD4 DB0A 953A 8F3E A8FF 3D56 E580 02FE 4317