From owner-freebsd-virtualization@freebsd.org Sun May 3 20:40:08 2020 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 38B222E750E for ; Sun, 3 May 2020 20:40:08 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 49FdCX0qd4z49Fl for ; Sun, 3 May 2020 20:40:08 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 1C4852E750D; Sun, 3 May 2020 20:40:08 +0000 (UTC) Delivered-To: virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 1C0E72E750C for ; Sun, 3 May 2020 20:40:08 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49FdCX0032z49Fk for ; Sun, 3 May 2020 20:40:07 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits)) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id EE16A18D9D for ; Sun, 3 May 2020 20:40:07 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 043Ke7uY029039 for ; Sun, 3 May 2020 20:40:07 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 043Ke7Ih029038 for virtualization@FreeBSD.org; Sun, 3 May 2020 20:40:07 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 236042] Windows Server 2016 Hyper-V snapshot triggers SCSI errors Date: Sun, 03 May 2020 20:40:05 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 12.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: juraj@lutter.sk X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 03 May 2020 20:40:08 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D236042 Juraj Lutter changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |juraj@lutter.sk --- Comment #14 from Juraj Lutter --- FWIW, I'm seeing this with recent 12-STABLE as well. I will review Andriy's patch. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-virtualization@freebsd.org Sun May 3 21:00:30 2020 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id E693D2B8C38 for ; Sun, 3 May 2020 21:00:30 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 49Fdg25rWmz4JJM for ; Sun, 3 May 2020 21:00:30 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: by mailman.nyi.freebsd.org (Postfix) id C86692B8C31; Sun, 3 May 2020 21:00:30 +0000 (UTC) Delivered-To: virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id C82612B8C30 for ; Sun, 3 May 2020 21:00:30 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49Fdg24gd4z4JJG for ; Sun, 3 May 2020 21:00:30 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits)) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 9942219210 for ; Sun, 3 May 2020 21:00:30 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 043L0Ubc089176 for ; Sun, 3 May 2020 21:00:30 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 043L0ULK089165 for virtualization@FreeBSD.org; Sun, 3 May 2020 21:00:30 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Message-Id: <202005032100.043L0ULK089165@kenobi.freebsd.org> X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@FreeBSD.org using -f From: bugzilla-noreply@FreeBSD.org To: virtualization@FreeBSD.org Subject: Problem reports for virtualization@FreeBSD.org that need special attention Date: Sun, 3 May 2020 21:00:30 +0000 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 03 May 2020 21:00:31 -0000 To view an individual PR, use: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=(Bug Id). The following is a listing of current problems submitted by FreeBSD users, which need special attention. These represent problem reports covering all versions including experimental development code and obsolete releases. Status | Bug Id | Description ------------+-----------+--------------------------------------------------- New | 240945 | [hyper-v] [netvsc] hn network driver incorrectly Open | 245392 | bhyve: PCI passthru built-in rtl8168 to OpenBSD n 2 problems total for which you should take action. From owner-freebsd-virtualization@freebsd.org Mon May 4 08:44:34 2020 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id F05232C967D for ; Mon, 4 May 2020 08:44:34 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 49FxHQ66kDz3Q3G for ; Mon, 4 May 2020 08:44:34 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id D1F222C967C; Mon, 4 May 2020 08:44:34 +0000 (UTC) Delivered-To: virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id D1B372C967B for ; Mon, 4 May 2020 08:44:34 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49FxHQ5GH1z3Q3F for ; Mon, 4 May 2020 08:44:34 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits)) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id AFF5F217B9 for ; Mon, 4 May 2020 08:44:34 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 0448iYB2076535 for ; Mon, 4 May 2020 08:44:34 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 0448iY4i076534 for virtualization@FreeBSD.org; Mon, 4 May 2020 08:44:34 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 246168] Ubuntu 20.04 QEMU Failure with nested FreeBSD bhyve Date: Mon, 04 May 2020 08:44:34 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: new X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bhyve X-Bugzilla-Version: 12.1-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: drum@graphica.com.au X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_id short_desc product version rep_platform op_sys bug_status bug_severity priority component assigned_to reporter Message-ID: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 04 May 2020 08:44:35 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D246168 Bug ID: 246168 Summary: Ubuntu 20.04 QEMU Failure with nested FreeBSD bhyve Product: Base System Version: 12.1-STABLE Hardware: Any OS: Any Status: New Severity: Affects Only Me Priority: --- Component: bhyve Assignee: virtualization@FreeBSD.org Reporter: drum@graphica.com.au BUG: Starting FreeBSD Layer 2 bhyve Guest within Layer 1 FreeBSD VM Host on Laye= r 0 Ubuntu 20.04 KVM / QEMU Host result in Layer 1 Guest / Host Pausing with "Emulation Failure" TESTING: My test scenario is nested virtualisation: Layer 0 - Ubuntu 20.04 Host Layer 1 - FreeBSD 12.1 with OVMF + bhyve hypervisor Guest/Host Layer 2 - FreeBSD 12.1 guest Layer 0 Host is: Ubuntu 20.04 LTS KVM / QEMU / libvirt <> $ virsh -c qemu:///system version --daemon Compiled against library: libvirt 6.0.0 Using library: libvirt 6.0.0 Using API: QEMU 6.0.0 Running hypervisor: QEMU 4.2.0 Running against daemon: 6.0.0 < <> $ cat /proc/cpuinfo | grep -c vmx 64 $ cat /sys/module/kvm_intel/parameters/nested Y <> Layer 1 Guest / Host is: FreeBSD Q35 v4.2 with OVMF: Pass Host VMX support to Layer 1 Guest via <> ... ... hvm /usr/share/OVMF/OVMF_CODE.fd /home/USER/swarm.bhyve.freebsd/OVMF_VARS.fd ... ... > Checked that Layer 1 - FreeBSD Quest / Host has VMX feature available: <> # uname -a FreeBSD swarm.DOMAIN.HERE 12.1-RELEASE FreeBSD 12.1-RELEASE GENERIC amd64 # grep Features /var/run/dmesg.boot=20 =20 Features=3D0xf83fbff =20 Features2=3D0xfffa3223 AMD Features=3D0x2c100800 AMD Features2=3D0x121 Structured Extended Features=3D0x1c0fbb Structured Extended Features2=3D0x4 Structured Extended Features3=3D0xac000400 XSAVE Features=3D0x1 < On Layer 1 FreeBSD Guest / Host start up the Layer 2 guest.. <> # ls FreeBSD-11.2-RELEASE-amd64-bootonly.iso FreeBSD-12.1-RELEASE-amd64-dvd1.iso= =20=20=20=20 bee-hd1-01.img # /usr/sbin/bhyve -c 2 -m 2048 -H -A -s 0:0,hostbridge -s 1:0,lpc -s 2:0,e1000,tap0 -s 3:0,ahci-hd,bee-hd1-01.img -l com1,stdio -s 5:0,ahci-cd,./FreeBSD-12.1-RELEASE-amd64-dvd1.iso bee <> Result is that Layer 1 - FreeBSD Host guest "paused". To Layer 1 machines freezes I cannot get any further diagnostics from this machine, so I run tail on libvirt log from Layer 0 - Ubuntu Host <> char device redirected to /dev/pts/29 (label charserial0) 2020-05-04T06:09:15.310474Z qemu-system-x86_64: warning: host doesn't suppo= rt requested feature: MSR(48FH).vmx-exit-load-perf-global-ctrl [bit 12] 2020-05-04T06:09:15.310531Z qemu-system-x86_64: warning: host doesn't suppo= rt requested feature: MSR(490H).vmx-entry-load-perf-global-ctrl [bit 13] 2020-05-04T06:09:15.312533Z qemu-system-x86_64: warning: host doesn't suppo= rt requested feature: MSR(48FH).vmx-exit-load-perf-global-ctrl [bit 12] 2020-05-04T06:09:15.312548Z qemu-system-x86_64: warning: host doesn't suppo= rt requested feature: MSR(490H).vmx-entry-load-perf-global-ctrl [bit 13] 2020-05-04T06:09:15.313828Z qemu-system-x86_64: warning: host doesn't suppo= rt requested feature: MSR(48FH).vmx-exit-load-perf-global-ctrl [bit 12] 2020-05-04T06:09:15.313841Z qemu-system-x86_64: warning: host doesn't suppo= rt requested feature: MSR(490H).vmx-entry-load-perf-global-ctrl [bit 13] 2020-05-04T06:09:15.315185Z qemu-system-x86_64: warning: host doesn't suppo= rt requested feature: MSR(48FH).vmx-exit-load-perf-global-ctrl [bit 12] 2020-05-04T06:09:15.315201Z qemu-system-x86_64: warning: host doesn't suppo= rt requested feature: MSR(490H).vmx-entry-load-perf-global-ctrl [bit 13] KVM internal error. Suberror: 1 emulation failure EAX=3D00000000 EBX=3D00000000 ECX=3D00000000 EDX=3D00000000 ESI=3D00000000 EDI=3D00000000 EBP=3D00000000 ESP=3D00000000 EIP=3D00000000 EFL=3D00000000 [-------] CPL=3D0 II=3D0 A20=3D1 SMM=3D0 HLT= =3D0 ES =3D0000 00000000 00000000 00008000 DPL=3D0 CS =3D0000 00000000 00000000 00008000 DPL=3D0 SS =3D0000 00000000 00000000 00008000 DPL=3D0 DS =3D0000 00000000 00000000 00008000 DPL=3D0 FS =3D0000 00000000 00000000 00008000 DPL=3D0 GS =3D0000 00000000 00000000 00008000 DPL=3D0 LDT=3D0000 00000000 00000000 00008000 DPL=3D0 TR =3D0000 00000000 00000000 00008000 DPL=3D0 GDT=3D 0000000000000000 00000000 IDT=3D 0000000000000000 00000000 CR0=3D80050033 CR2=3D0000000000000000 CR3=3D0000000000000000 CR4=3D00372060 DR0=3D0000000000000000 DR1=3D0000000000000000 DR2=3D0000000000000000 DR3=3D0000000000000000=20 DR6=3D00000000ffff0ff0 DR7=3D0000000000000400 EFER=3D0000000000000d01 Code=3D ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? = ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? = ?? 2020-05-04T06:35:39.186799Z qemu-system-x86_64: terminating on signal 15 fr= om pid 2155 (/usr/sbin/libvirtd) 2020-05-04 06:35:39.386+0000: shutting down, reason=3Ddestroyed <> I am reporting this bug here as result is very similar to that seen with QE= MU seabios failure reported here: https://bugs.launchpad.net/qemu/+bug/1866870 However in this case my VM Layer 1 VM is using OVMF. NOTE 1: I have also tested with Q35 v3.1 and 2.12 and get the same result. NOTE 2: Due to bug in FreeBSD networking code, I had to compile custom kern= el with "netmap driver disabled". This is known bug in FreeBSD that I have reported separately. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-virtualization@freebsd.org Mon May 4 08:45:08 2020 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 6AACC2C96D9 for ; Mon, 4 May 2020 08:45:08 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 49FxJ42F8gz3Q5l for ; Mon, 4 May 2020 08:45:08 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 4CE3F2C96D8; Mon, 4 May 2020 08:45:08 +0000 (UTC) Delivered-To: virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 4CAA82C96D7 for ; Mon, 4 May 2020 08:45:08 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49FxJ41PZJz3Q5k for ; Mon, 4 May 2020 08:45:08 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits)) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 2B902217BA for ; Mon, 4 May 2020 08:45:08 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 0448j8cG077392 for ; Mon, 4 May 2020 08:45:08 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 0448j8kc077391 for virtualization@FreeBSD.org; Mon, 4 May 2020 08:45:08 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 246168] Ubuntu 20.04 QEMU Failure with nested FreeBSD bhyve Date: Mon, 04 May 2020 08:45:08 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bhyve X-Bugzilla-Version: 12.1-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: drum@graphica.com.au X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: rep_platform bug_severity Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 04 May 2020 08:45:08 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D246168 John Hartley changed: What |Removed |Added ---------------------------------------------------------------------------- Hardware|Any |amd64 Severity|Affects Only Me |Affects Some People --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-virtualization@freebsd.org Mon May 4 08:51:50 2020 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id E2C662C9960 for ; Mon, 4 May 2020 08:51:50 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 49FxRp5nZmz3QVq for ; Mon, 4 May 2020 08:51:50 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id C62762C995F; Mon, 4 May 2020 08:51:50 +0000 (UTC) Delivered-To: virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id C5E442C995E for ; Mon, 4 May 2020 08:51:50 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49FxRp4s5bz3QVp for ; Mon, 4 May 2020 08:51:50 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits)) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id A21D621849 for ; Mon, 4 May 2020 08:51:50 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 0448poYE095691 for ; Mon, 4 May 2020 08:51:50 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 0448pogk095690 for virtualization@FreeBSD.org; Mon, 4 May 2020 08:51:50 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 246168] Ubuntu 20.04 QEMU Failure with nested FreeBSD bhyve Date: Mon, 04 May 2020 08:51:50 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bhyve X-Bugzilla-Version: 12.1-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: drum@graphica.com.au X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 04 May 2020 08:51:50 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D246168 --- Comment #1 from John Hartley --- NOTE: I have cross posted this Bug Report Ubuntu Bug Tracking: https://bugs.launchpad.net/qemu/+bug/1876678 Also note I have done extensive testing of Ubuntu 20.04 Nested virtualisati= on with just Ubuntu hosts and OVMF and the nested virtualisation runs correctl= y, so problem is specific to using FreeBSD / bhyve guest / host. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-virtualization@freebsd.org Mon May 4 12:58:52 2020 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 675922CF768 for ; Mon, 4 May 2020 12:58:52 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 49G2wr2BP7z4B2J for ; Mon, 4 May 2020 12:58:52 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 496602CF767; Mon, 4 May 2020 12:58:52 +0000 (UTC) Delivered-To: virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 492E82CF766 for ; Mon, 4 May 2020 12:58:52 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49G2wr1L9kz4B2H for ; Mon, 4 May 2020 12:58:52 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits)) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 297852478D for ; Mon, 4 May 2020 12:58:52 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 044CwqCN081205 for ; Mon, 4 May 2020 12:58:52 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 044CwqEm081204 for virtualization@FreeBSD.org; Mon, 4 May 2020 12:58:52 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 246121] [bhyve][PATCH] Append Keyboard Layout specified option for using VNC. Date: Mon, 04 May 2020 12:58:50 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bhyve X-Bugzilla-Version: Unspecified X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: aleksandr.fedorov@itglobal.com X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 04 May 2020 12:58:52 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D246121 Aleksandr Fedorov changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |aleksandr.fedorov@itglobal. | |com --- Comment #1 from Aleksandr Fedorov --- It looks interesting, but can we use existing layout files: /usr/share/vt/keymaps or /usr/share/syscons/keymaps? See format description: man 5 kbdmap --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-virtualization@freebsd.org Mon May 4 14:25:20 2020 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 2FA822D1602 for ; Mon, 4 May 2020 14:25:20 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 49G4rc0XLCz4GkX for ; Mon, 4 May 2020 14:25:20 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 124482D1601; Mon, 4 May 2020 14:25:20 +0000 (UTC) Delivered-To: virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 120EE2D1600 for ; Mon, 4 May 2020 14:25:20 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49G4rb6p3Qz4GkW for ; Mon, 4 May 2020 14:25:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits)) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id E4BC0258BE for ; Mon, 4 May 2020 14:25:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 044EPJmP070354 for ; Mon, 4 May 2020 14:25:19 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 044EPJUx070353 for virtualization@FreeBSD.org; Mon, 4 May 2020 14:25:19 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 246168] Ubuntu 20.04 QEMU Failure with nested FreeBSD bhyve Date: Mon, 04 May 2020 14:25:18 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bhyve X-Bugzilla-Version: 12.1-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: rgrimes@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 04 May 2020 14:25:20 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D246168 Rodney W. Grimes changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |rgrimes@FreeBSD.org --- Comment #2 from Rodney W. Grimes --- FreeBSD Bhyve does *not* support nested virtualization as a host, your operating beyond what has been implemented. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-virtualization@freebsd.org Tue May 5 03:03:16 2020 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 7C2012D3940 for ; Tue, 5 May 2020 03:03:16 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 49GPg82RZ2z4Bkx for ; Tue, 5 May 2020 03:03:16 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 53BEE2D393E; Tue, 5 May 2020 03:03:16 +0000 (UTC) Delivered-To: virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 538292D393D for ; Tue, 5 May 2020 03:03:16 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49GPg817DSz4Bkw for ; Tue, 5 May 2020 03:03:16 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits)) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 21CD16EDD for ; Tue, 5 May 2020 03:03:16 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 04533FPw065142 for ; Tue, 5 May 2020 03:03:16 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 04533F5F065141 for virtualization@FreeBSD.org; Tue, 5 May 2020 03:03:15 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 246168] Ubuntu 20.04 QEMU Failure with nested FreeBSD bhyve Date: Tue, 05 May 2020 03:03:15 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bhyve X-Bugzilla-Version: 12.1-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: drum@graphica.com.au X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.30 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 05 May 2020 03:03:16 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D246168 --- Comment #3 from John Hartley --- Hi Rodney, thanks for looking at this bug report. Does your statement, "FreeBSD Bhyve does *not* support nested virtualizatio= n as a host" relate to this nested topology ? Layer 0 - FreeBSD with bhyve hypervisor (on Bare Metal with Intel VT-x VMX support) Layer 1 - FreeBSD with bhyve hypervisor (ie Guest of Layer 0, Host to Layer= 2) Layer 2 - FreeBSD or other OS Guest I ask as bhyve wiki: https://wiki.freebsd.org/bhyve#Q:_Can_I_run_multiple_bhyve_hosts_under_VMwa= re_nested_VT-x_EPT.3F Indicates that there should be ability to run nested topology as per my example: Layer 0 - VMWare or KVM with VT-x EPT Layer 1 - FreeBSD with bhyve hypervisor (ie Guest of Layer 0, Host to Layer= 2) Layer 2 - FreeBSD or other OS Guest I am trying to get this model up and running, as I am wanting to test metri= cs collection from Layer 1 FreeBSD guest/host. Given scarcity of information I know that this is little off the beaten tra= ck, but I did find this example: https://github.com/Suhoy95/SNE-reports-2019-public/tree/4-LIA-2-xen-kvm whi= ch indicated that it had go similar nested topology going, but with Ubuntu 18.= 04 as Layer 0 rather than Ubuntu 20.04 as in my case. Thanks you. John Hartley. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-virtualization@freebsd.org Tue May 5 03:25:33 2020 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 15A4A2D4420 for ; Tue, 5 May 2020 03:25:33 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 49GQ8r6Qslz4D1H for ; Tue, 5 May 2020 03:25:32 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id DA8B02D441F; Tue, 5 May 2020 03:25:32 +0000 (UTC) Delivered-To: virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id DA5162D441E for ; Tue, 5 May 2020 03:25:32 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49GQ8r4YBhz4D1F for ; Tue, 5 May 2020 03:25:32 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits)) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 975A37313 for ; Tue, 5 May 2020 03:25:32 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 0453PWMG053538 for ; Tue, 5 May 2020 03:25:32 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 0453PWBv053526 for virtualization@FreeBSD.org; Tue, 5 May 2020 03:25:32 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 246168] Ubuntu 20.04 QEMU Failure with nested FreeBSD bhyve Date: Tue, 05 May 2020 03:25:30 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bhyve X-Bugzilla-Version: 12.1-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: grehan@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.30 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 05 May 2020 03:25:33 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D246168 Peter Grehan changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |grehan@FreeBSD.org --- Comment #4 from Peter Grehan --- Yours is a valid configuration. This was reported a long while back and discussed extensively in bug 203994, where the fix was to use a kernel version >=3D 4.10. So, this appears to be a regression. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-virtualization@freebsd.org Tue May 5 03:39:42 2020 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 09AB02D489C for ; Tue, 5 May 2020 03:39:42 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 49GQT96GpNz4DWg for ; Tue, 5 May 2020 03:39:41 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id D75992D489B; Tue, 5 May 2020 03:39:41 +0000 (UTC) Delivered-To: virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id D72052D489A for ; Tue, 5 May 2020 03:39:41 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49GQT95Cctz4DWd for ; Tue, 5 May 2020 03:39:41 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits)) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id AE57C750C for ; Tue, 5 May 2020 03:39:41 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 0453dfXQ040076 for ; Tue, 5 May 2020 03:39:41 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 0453dfU2040075 for virtualization@FreeBSD.org; Tue, 5 May 2020 03:39:41 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 246168] Ubuntu 20.04 KVM / QEMU Failure with nested FreeBSD bhyve Date: Tue, 05 May 2020 03:39:41 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bhyve X-Bugzilla-Version: 12.1-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: drum@graphica.com.au X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: short_desc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.30 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 05 May 2020 03:39:42 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D246168 John Hartley changed: What |Removed |Added ---------------------------------------------------------------------------- Summary|Ubuntu 20.04 QEMU Failure |Ubuntu 20.04 KVM / QEMU |with nested FreeBSD bhyve |Failure with nested FreeBSD | |bhyve --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-virtualization@freebsd.org Tue May 5 03:48:21 2020 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 60C162D4CAC for ; Tue, 5 May 2020 03:48:21 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 49GQg91d0yz4DwQ for ; Tue, 5 May 2020 03:48:21 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 37AE72D4CAB; Tue, 5 May 2020 03:48:21 +0000 (UTC) Delivered-To: virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 3777F2D4CAA for ; Tue, 5 May 2020 03:48:21 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49GQg85Yw3z4DwM for ; Tue, 5 May 2020 03:48:20 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits)) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id BA3BA76F6 for ; Tue, 5 May 2020 03:48:20 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 0453mKNC066612 for ; Tue, 5 May 2020 03:48:20 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 0453mKDe066611 for virtualization@FreeBSD.org; Tue, 5 May 2020 03:48:20 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 246168] Ubuntu 20.04 KVM / QEMU Failure with nested FreeBSD bhyve Date: Tue, 05 May 2020 03:48:21 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bhyve X-Bugzilla-Version: 12.1-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: rgrimes@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.30 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 05 May 2020 03:48:21 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D246168 --- Comment #5 from Rodney W. Grimes --- (In reply to Peter Grehan from comment #4) How is running FreeBSD at layer 2, inside of a layer 1 FreeBSD (host) a val= id configuration, I thought we had no support for nesting. Does some magic ha= ppen because the layer 0/bare metal host is running KVM? Now, running FreeBSD at layer 1, inside a layer 0 KVM, I'll agree is valid. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-virtualization@freebsd.org Tue May 5 03:53:05 2020 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 42CC92D50E1 for ; Tue, 5 May 2020 03:53:05 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 49GQmc71KJz4FYT for ; Tue, 5 May 2020 03:53:04 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id F09552D50E0; Tue, 5 May 2020 03:53:04 +0000 (UTC) Delivered-To: virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id F05652D50DF for ; Tue, 5 May 2020 03:53:04 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49GQmc50Bxz4FYR for ; Tue, 5 May 2020 03:53:04 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits)) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id A686A78FC for ; Tue, 5 May 2020 03:53:04 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 0453r4Hi084160 for ; Tue, 5 May 2020 03:53:04 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 0453r4H6084159 for virtualization@FreeBSD.org; Tue, 5 May 2020 03:53:04 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 246168] Ubuntu 20.04 KVM / QEMU Failure with nested FreeBSD bhyve Date: Tue, 05 May 2020 03:53:04 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bhyve X-Bugzilla-Version: 12.1-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: rgrimes@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.30 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 05 May 2020 03:53:05 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D246168 --- Comment #6 from Rodney W. Grimes --- (In reply to Rodney W. Grimes from comment #5) Never mind, I see why, layer 2 is NOT running bhyve, it is just running Fre= eBSD --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-virtualization@freebsd.org Tue May 5 04:50:35 2020 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 3E46B2D680E for ; Tue, 5 May 2020 04:50:35 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 49GS2z0zCbz4JG9 for ; Tue, 5 May 2020 04:50:35 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 213892D680D; Tue, 5 May 2020 04:50:35 +0000 (UTC) Delivered-To: virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 20FCB2D680C for ; Tue, 5 May 2020 04:50:35 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49GS2z08RLz4JG8 for ; Tue, 5 May 2020 04:50:35 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits)) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id F07FE82FE for ; Tue, 5 May 2020 04:50:34 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 0454oYOf061527 for ; Tue, 5 May 2020 04:50:34 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 0454oYWL061526 for virtualization@FreeBSD.org; Tue, 5 May 2020 04:50:34 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 246168] Ubuntu 20.04 KVM / QEMU Failure with nested FreeBSD bhyve Date: Tue, 05 May 2020 04:50:35 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bhyve X-Bugzilla-Version: 12.1-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: drum@graphica.com.au X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.30 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 05 May 2020 04:50:35 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D246168 --- Comment #7 from John Hartley --- Hi Peter & Co, I reviewed the prior bug report and FYI here is some additional information= on my machine: <> ... ... CPU: Intel Core Processor (Broadwell, IBRS) (2600.09-MHz K8-class CPU) Origin=3D"GenuineIntel" Id=3D0x306d2 Family=3D0x6 Model=3D0x3d Steppi= ng=3D2 =20 Features=3D0xf83fbff =20 Features2=3D0xfffa3223 AMD Features=3D0x2c100800 AMD Features2=3D0x121 Structured Extended Features=3D0x1c0fbb Structured Extended Features2=3D0x4 Structured Extended Features3=3D0xac000400 XSAVE Features=3D0x1 IA32_ARCH_CAPS=3D0x8 AMD Extended Feature Extensions ID EBX=3D0x1001000 VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID,VID,PostIntr Hypervisor: Origin =3D "KVMKVMKVM" ... ... > I also did cpuctl load and here are result from cpucontrol (I am not sure how to interpret these or if provided vectors are still valid with FreeBSD 12.1) <> # kldload cpuctl # cpucontrol -m 0x480 /dev/cpuctl0 MSR 0x480: 0x00d81000 0x11e57ed0 # cpucontrol -m 0x482 /dev/cpuctl0 MSR 0x482: 0xfff9fffe 0x0401e172 # cpucontrol -m 0x48b /dev/cpuctl0 MSR 0x48b: 0x00037bff 0x00000000 # cpucontrol -m 0x48c /dev/cpuctl0 MSR 0x48c: 0x00000f01 0x06334041 <> I also saw that in the original but, it appear that issue was that the bhyve KLM was not loading. I my case the vmm module is loading but I am getting runtime failure... Any tips you can provide to help with diagnosis would be appreciated and I = can chase upstream if needed, if this is KVM regression. Thanks. John Hartley --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-virtualization@freebsd.org Tue May 5 09:10:19 2020 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 458B22DDB08 for ; Tue, 5 May 2020 09:10:19 +0000 (UTC) (envelope-from brandon.helsley@hotmail.com) Received: from NAM12-MW2-obe.outbound.protection.outlook.com (mail-mw2nam12olkn2085.outbound.protection.outlook.com [40.92.23.85]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "GlobalSign Organization Validation CA - SHA256 - G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49GYpf2HDpz4ZdD for ; Tue, 5 May 2020 09:10:18 +0000 (UTC) (envelope-from brandon.helsley@hotmail.com) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=mOjK/1/ZxPRAsSV8UjnD78EYZBu/CnRgjmRdSOewkUwcg4LmcT6z8JEk6q3avfzt0LxmUatQz6mvRkkYdXEW4L5gFkYNrpZLsGsGr+zWqYRVpyjHaCyuytZ/YVGLm5WgY/NS/VAk5EhNyvqKLCmRNxqWft2ugEqapZl+ImMpXKGJZMgnN/UwxyD449n/G0Csh2HyP2J8y3r+leeqJvtNVm2WgnrKixEbXe1GCdjwhoRXv919DfNVF5OZIcjIGCvAsss3v0b0OkIvQCaksmnFpH9jdSnm7+5qOPodsFXqfywygWIkGYAPVHDDPTZt1P+SUEQdwWlkBF6gm1v687Lxzw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=Yuxw35A87gtDg3nMzENWXANSdxrGTRqAg0FVmZoDYQI=; b=XlnH22JGPzx3AMNNPMuWxoUbcA3Mc8WBUI6FdzLkHTxtCJBYC6Tw9PXma5kxphKtgLzs36vK7JKWkdC0hNBwlcPPMzCMA2m7Fw9Wo6JQ/ZFHdkNnnqAXoNAZjnVkrGuSrnGmtvMKXJvYuqYnVdqKsxKn09md163mEAIKg/lIuDur0cPDPy3Eyj9QOaWAmd5BJKDS9vHLMyIHxgHMuglDCnUV54RyfrNLo1ZOu8KseOWZVEGnjp3+RTltqzTjfNnHREaSQFObFaBGGA/vQzxu48fTc3dqHf7SlVULxy0uPCfzt2AX0rzq6Yonl5NTrwmc6w0KjuhQBZ9/8nWTKZgeZA== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=none; dmarc=none; dkim=none; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=hotmail.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=Yuxw35A87gtDg3nMzENWXANSdxrGTRqAg0FVmZoDYQI=; b=LGkFuqrizGHb+mkKlpCQl3YaZyhYs2zurHUy1blNyiQWtsUJrpzz7KEHX0Ij/pBEPiMKwZaE/MJ3ZdhbY2B0B8H065aXf/HxRuD+SDknc4P/H4tKx7g4LB+AXLnDrYNiXB2DVc8F0sG7KUJhqi66V4PIvYA/IsdPaaqOACWhqNh57TGkIGTz8AqUTdbP1RnxZaB8XgLVc8vWc6iDZPIi3KYoV0D4//TREeb5dE9sTj1lZgGQhJGCGQWzMMD7+bUUwhMSLH+dhBP7U/y+82ZlYmVvQFwNyOgqRs0jd/2MArbESTDGpnwg1xtOyc6StzGKpyaKKkye8C7JJqUHnemKxQ== Received: from MW2NAM12FT066.eop-nam12.prod.protection.outlook.com (2a01:111:e400:fc65::40) by MW2NAM12HT174.eop-nam12.prod.protection.outlook.com (2a01:111:e400:fc65::193) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.2979.23; Tue, 5 May 2020 09:10:16 +0000 Received: from CY4PR19MB1655.namprd19.prod.outlook.com (2a01:111:e400:fc65::51) by MW2NAM12FT066.mail.protection.outlook.com (2a01:111:e400:fc65::468) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.2979.23 via Frontend Transport; Tue, 5 May 2020 09:10:16 +0000 Received: from CY4PR19MB1655.namprd19.prod.outlook.com ([fe80::387e:fe14:f955:101d]) by CY4PR19MB1655.namprd19.prod.outlook.com ([fe80::387e:fe14:f955:101d%12]) with mapi id 15.20.2979.025; Tue, 5 May 2020 09:10:16 +0000 From: Brandon helsley To: "freebsd-virtualization@freebsd.org" Subject: Bhyve help Thread-Topic: Bhyve help Thread-Index: AQHWIry70sLUVs25TUup9bVixLA8JQ== Date: Tue, 5 May 2020 09:10:16 +0000 Message-ID: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-incomingtopheadermarker: OriginalChecksum:BAB51BDBEF11C4287EF7D0BA739B3314B2D38500CCFB7590898CF0931278F6A1; UpperCasedChecksum:CB8F8138FE6E7FD35CAA0E0022A1AAD322BAAEFA5A629383FA24CB891C94D2BF; SizeAsReceived:6657; Count:42 x-tmn: [psu+Mlf0hzHtY+jVE7yi2XElDt74l8JV] x-ms-publictraffictype: Email x-incomingheadercount: 42 x-eopattributedmessage: 0 x-ms-office365-filtering-correlation-id: 443c26d8-f6a8-442d-86ba-08d7f0d42088 x-ms-traffictypediagnostic: MW2NAM12HT174: x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: r4FufKYN3WbdMg8oNScdIPk5sZpy/tb7kFbGK8rFVJwyyIjlS3/IPl79dU1l5us3qUbp1wrXJ/EfQrPiabjC5Im7k5Ue6XNat/NFEtunysNZ59lmfRniQX+d3C40wSjDzvY1CdXv7mSlxTcjkCp3dzX736XWQbiKCP9r/ESIJYjqeN8mro1tgOgYfXzb7j34iFtwffjBbZv2q6piIWs6K86irAB3CjcxzL2S892l3Z/IucOaCPwGPY9WHGk0gN6D x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:0; SRV:; IPV:NLI; SFV:NSPM; H:CY4PR19MB1655.namprd19.prod.outlook.com; PTR:; CAT:NONE; SFTY:; SFS:; DIR:OUT; SFP:1901; x-ms-exchange-antispam-messagedata: L7VJVMy9QpIFWo8w7iyD5xnSELxPOppmqEYppNfPcbEk6bC74s9lo6yvA4/seez41YXcj55drgRHLGpslISZ5HV0FCxXlcraT3JCPRc0x77WyJrW6aPSK6Kp3sUpIpT8Py/Pqir+7D1UIBmm1eP1sQ== x-ms-exchange-transport-forked: True MIME-Version: 1.0 X-OriginatorOrg: hotmail.com X-MS-Exchange-CrossTenant-RMS-PersistedConsumerOrg: 00000000-0000-0000-0000-000000000000 X-MS-Exchange-CrossTenant-Network-Message-Id: 443c26d8-f6a8-442d-86ba-08d7f0d42088 X-MS-Exchange-CrossTenant-rms-persistedconsumerorg: 00000000-0000-0000-0000-000000000000 X-MS-Exchange-CrossTenant-originalarrivaltime: 05 May 2020 09:10:16.5026 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Internet X-MS-Exchange-CrossTenant-id: 84df9e7f-e9f6-40af-b435-aaaaaaaaaaaa X-MS-Exchange-Transport-CrossTenantHeadersStamped: MW2NAM12HT174 X-Rspamd-Queue-Id: 49GYpf2HDpz4ZdD X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=hotmail.com header.s=selector1 header.b=LGkFuqri; dmarc=pass (policy=none) header.from=hotmail.com; spf=pass (mx1.freebsd.org: domain of brandon.helsley@hotmail.com designates 40.92.23.85 as permitted sender) smtp.mailfrom=brandon.helsley@hotmail.com X-Spamd-Result: default: False [-4.00 / 15.00]; RCVD_TLS_LAST(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; R_DKIM_ALLOW(-0.20)[hotmail.com:s=selector1]; RWL_MAILSPIKE_POSSIBLE(0.00)[85.23.92.40.rep.mailspike.net : 127.0.0.17]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:40.92.0.0/15:c]; FREEMAIL_FROM(0.00)[hotmail.com]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; IP_SCORE_FREEMAIL(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; RCVD_COUNT_THREE(0.00)[4]; IP_SCORE(0.00)[ipnet: 40.64.0.0/10(-3.72), asn: 8075(-3.22), country: US(-0.05)]; DKIM_TRACE(0.00)[hotmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[hotmail.com,none]; RCVD_IN_DNSWL_NONE(0.00)[85.23.92.40.list.dnswl.org : 127.0.3.0]; TO_DN_EQ_ADDR_ALL(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; FREEMAIL_ENVFROM(0.00)[hotmail.com]; ASN(0.00)[asn:8075, ipnet:40.64.0.0/10, country:US]; ARC_ALLOW(-1.00)[i=1]; DWL_DNSWL_NONE(0.00)[hotmail.com.dwl.dnswl.org : 127.0.5.0] Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.30 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.30 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 05 May 2020 09:10:19 -0000 I'm trying to set up bhyve like the example to learn and when doing the phy= sical interface interface get the result no such file or directory the com= mand is: ifconfig bridge0 addm igb0 addm tap0 "In this example, the physical interface is igb0" Sent from Outlook Mobile From owner-freebsd-virtualization@freebsd.org Tue May 5 09:15:30 2020 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id DDE592DDDC2 for ; Tue, 5 May 2020 09:15:30 +0000 (UTC) (envelope-from crowston@protonmail.com) Received: from mail2.protonmail.ch (mail2.protonmail.ch [185.70.40.22]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "protonmail.com", Issuer "SwissSign Server Gold CA 2014 - G22" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49GYwd3FgFz4ZyQ for ; Tue, 5 May 2020 09:15:29 +0000 (UTC) (envelope-from crowston@protonmail.com) Date: Tue, 05 May 2020 09:14:43 +0000 To: Brandon helsley , "freebsd-virtualization@freebsd.org" From: Robert Crowston Reply-To: Robert Crowston Subject: Re: Bhyve help Message-ID: <1NVr2edzkfBDrm41NUc1i3czldPuT_tn_7Y1mlj7ef_uTSXRpKo1BV5wvWTr9F8K14KqN09d5Sy8BjnnaJ9EsAMTQ6rvJl1IiD2TNWcTf2Y=@protonmail.com> In-Reply-To: References: MIME-Version: 1.0 X-Spam-Status: No, score=-1.2 required=7.0 tests=ALL_TRUSTED,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,FREEMAIL_FROM,HTML_MESSAGE shortcircuit=no autolearn=disabled version=3.4.4 X-Spam-Checker-Version: SpamAssassin 3.4.4 (2020-01-24) on mail.protonmail.ch X-Rspamd-Queue-Id: 49GYwd3FgFz4ZyQ X-Spamd-Bar: -- X-Spamd-Result: default: False [-3.00 / 15.00]; TO_DN_EQ_ADDR_SOME(0.00)[]; HAS_REPLYTO(0.00)[crowston@protonmail.com]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:185.70.40.0/24]; FREEMAIL_FROM(0.00)[protonmail.com]; DKIM_TRACE(0.00)[protonmail.com:+]; RCPT_COUNT_TWO(0.00)[2]; MIME_BASE64_TEXT(0.10)[]; DMARC_POLICY_ALLOW(-0.50)[protonmail.com,quarantine]; FREEMAIL_TO(0.00)[hotmail.com]; RCVD_COUNT_ZERO(0.00)[0]; RCVD_IN_DNSWL_LOW(-0.10)[22.40.70.185.list.dnswl.org : 127.0.5.1]; MIME_TRACE(0.00)[0:+,1:+,2:~]; FREEMAIL_ENVFROM(0.00)[protonmail.com]; ASN(0.00)[asn:62371, ipnet:185.70.40.0/24, country:CH]; MID_RHS_MATCH_FROM(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; R_DKIM_ALLOW(-0.20)[protonmail.com:s=protonmail]; REPLYTO_EQ_FROM(0.00)[]; FROM_HAS_DN(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; HAS_PHPMAILER_SIG(0.00)[]; FREEMAIL_REPLYTO(0.00)[protonmail.com]; IP_SCORE_FREEMAIL(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; IP_SCORE(0.00)[ip: (-9.74), ipnet: 185.70.40.0/24(-4.89), asn: 62371(-3.91), country: CH(0.04)]; RWL_MAILSPIKE_POSSIBLE(0.00)[22.40.70.185.rep.mailspike.net : 127.0.0.17] Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: base64 X-Content-Filtered-By: Mailman/MimeDel 2.1.30 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.30 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 05 May 2020 09:15:30 -0000 V2hhdCBhcmUgeW91ciBuZXR3b3JrIGludGVyZmFjZXMgY2FsbGVkIG9uIHlvdXIgbWFjaGluZT8g WW91IHByb2JhYmx5IGhhdmUgdG8gY2hhbmdlIGlnYjAgaW4gdGhlIGV4YW1wbGUgdG8gZW0wIChh biBJbnRlbCBjYXJkKSBvciByZTAgKGEgUmVhbHRlayBjYXJkKS4gVHlwZSDigJxpZmNvbmZpZ+KA nSB0byBsaXN0IGFsbCB0aGUgaW50ZXJmYWNlcywgYW5kIGxvb2sgZm9yIG9uZXMgd2l0aCBhbiBp cCBhZGRyZXNzIHRvIGZpZ3VyZSBpdCBvdXQuCgpPbiBUdWUsIE1heSA1LCAyMDIwIGF0IDEwOjEw LCBCcmFuZG9uIGhlbHNsZXkgPGJyYW5kb24uaGVsc2xleUBob3RtYWlsLmNvbT4gd3JvdGU6Cgo+ IEknbSB0cnlpbmcgdG8gc2V0IHVwIGJoeXZlIGxpa2UgdGhlIGV4YW1wbGUgdG8gbGVhcm4gYW5k IHdoZW4gZG9pbmcgdGhlIHBoeXNpY2FsIGludGVyZmFjZSBpbnRlcmZhY2UgZ2V0IHRoZSByZXN1 bHQgbm8gc3VjaCBmaWxlIG9yIGRpcmVjdG9yeSB0aGUgY29tbWFuZCBpczoKPgo+IGlmY29uZmln IGJyaWRnZTAgYWRkbSBpZ2IwIGFkZG0gdGFwMAo+Cj4gIkluIHRoaXMgZXhhbXBsZSwgdGhlIHBo eXNpY2FsIGludGVyZmFjZSBpcyBpZ2IwIgo+Cj4gU2VudCBmcm9tIE91dGxvb2sgTW9iaWxlPGh0 dHBzOi8vYWthLm1zL2JsaGd0ZT4KPiBfX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19f X19fX19fX19fX19fXwo+IGZyZWVic2QtdmlydHVhbGl6YXRpb25AZnJlZWJzZC5vcmcgbWFpbGlu ZyBsaXN0Cj4gaHR0cHM6Ly9saXN0cy5mcmVlYnNkLm9yZy9tYWlsbWFuL2xpc3RpbmZvL2ZyZWVi c2QtdmlydHVhbGl6YXRpb24KPiBUbyB1bnN1YnNjcmliZSwgc2VuZCBhbnkgbWFpbCB0byAiZnJl ZWJzZC12aXJ0dWFsaXphdGlvbi11bnN1YnNjcmliZUBmcmVlYnNkLm9yZyI= From owner-freebsd-virtualization@freebsd.org Tue May 5 09:21:22 2020 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id CAF732DE29F for ; Tue, 5 May 2020 09:21:22 +0000 (UTC) (envelope-from brandon.helsley@hotmail.com) Received: from NAM11-DM6-obe.outbound.protection.outlook.com (mail-dm6nam11olkn2090.outbound.protection.outlook.com [40.92.19.90]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "GlobalSign Organization Validation CA - SHA256 - G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49GZ3P5dBVz4bps for ; Tue, 5 May 2020 09:21:21 +0000 (UTC) (envelope-from brandon.helsley@hotmail.com) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=mv6Nv6/gISgoUQOCXeN2/dPxInVKWHo/e31CdWVEFPkZc7r5VaDacCERN+FcCN/ZigbsjoM5EXrUvCma5Y3n8ITlO0fcWpY6FbSMeha7D9SHa1BFXtMH0BOl0yAMVD6izVfLesj0iHgBgzd48nHAXjCNJx5ySAlgm/HF60nulqCGdVasmEbpD1GYI4AfI0LxU5HDd9xPGoYAoxgRL5nQD2W7VkUJMAjK+vKYElpnQQPDk/gMoT35OJe9lYtqFbwrtpOMi3G9BKonLjdAT+aukcvHbZ/obbsX7mCJB3pqoAeOL8Wj+UxewUv52kweoIT16H0VkhHkpHCqfA2jjmJeiw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=VUHRgS3nIPMOKRsUzUpX+aCpqQjPjECkumClCv0Owv0=; b=PUGSspAoOB+UfWumrtSKL9DrsGysp9A2uODj0mTz3YeCmaY5sZd+wx3B1v4L+ekTYdsqb7sRMoQzZygIGPQz2coLqtcgE6wFYfKvXke+QjNXzgxKuGn4FYxBGVZU8aDW9IWzheO4KgBq/6x21yz/2PGyuzADS5E53qxKCiJEOtTWuREsgCvk3fD+p0hA021BB6JUDCGbvTPPdI849Z9JRqpK+cZ8ar2hKH6a/dQ1F+eFK0oLekUNiCGTGkbnYddTbo8kINypxmYxjr1vasqQPcvaxKmJTjcmAQ2hYvY9blNhnsAs86J1/O5lNWUZ+6QKO8ybZMr6nhTHnq+VfsUdjQ== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=none; dmarc=none; dkim=none; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=hotmail.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=VUHRgS3nIPMOKRsUzUpX+aCpqQjPjECkumClCv0Owv0=; b=q+PkhfBS+9XodfglhEvSKZl3VOc1OpPpW1B7pOY46d0PmhVpmum8ERW77Ct5dAM471BUhY+XmQZhab/T4qw19JBhMxcJKnI8fAvk+8Ax29BnzfzIPVz/IWR82p4RNz+IqQGwgBq/giXYNRjaj6bHpVE4zy5y8aiWcCMfFk6HH2t5HZk2BO2NxJkQ3keZLVVd3FyPogbIQejeLVWpBk9gg4ZTYp9kWmBaquyWduHp5Qfk15DlxiImq1Z1E2MK8g6OJBeDwSUSms244mJ3liKE/Mg400cKkxyydSO+nab7vlfJfIRkw6RzZAUdvogjvA8DeDnQJGgxaH1CpwyKF1/iLA== Received: from DM6NAM11FT063.eop-nam11.prod.protection.outlook.com (2a01:111:e400:fc4d::42) by DM6NAM11HT038.eop-nam11.prod.protection.outlook.com (2a01:111:e400:fc4d::104) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.2958.27; Tue, 5 May 2020 09:21:19 +0000 Received: from CY4PR19MB1655.namprd19.prod.outlook.com (2a01:111:e400:fc4d::46) by DM6NAM11FT063.mail.protection.outlook.com (2a01:111:e400:fc4d::219) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.2958.19 via Frontend Transport; Tue, 5 May 2020 09:21:19 +0000 Received: from CY4PR19MB1655.namprd19.prod.outlook.com ([fe80::387e:fe14:f955:101d]) by CY4PR19MB1655.namprd19.prod.outlook.com ([fe80::387e:fe14:f955:101d%12]) with mapi id 15.20.2979.025; Tue, 5 May 2020 09:21:19 +0000 From: Brandon helsley To: "freebsd-virtualization@freebsd.org" , Robert Crowston Subject: Re: Bhyve help Thread-Topic: Bhyve help Thread-Index: AQHWIry70sLUVs25TUup9bVixLA8JaiZNcCAgAABqp8= Date: Tue, 5 May 2020 09:21:19 +0000 Message-ID: References: , <1NVr2edzkfBDrm41NUc1i3czldPuT_tn_7Y1mlj7ef_uTSXRpKo1BV5wvWTr9F8K14KqN09d5Sy8BjnnaJ9EsAMTQ6rvJl1IiD2TNWcTf2Y=@protonmail.com> In-Reply-To: <1NVr2edzkfBDrm41NUc1i3czldPuT_tn_7Y1mlj7ef_uTSXRpKo1BV5wvWTr9F8K14KqN09d5Sy8BjnnaJ9EsAMTQ6rvJl1IiD2TNWcTf2Y=@protonmail.com> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-incomingtopheadermarker: OriginalChecksum:FC7EC9EFA1CAF10ED17B9E8CC7B3D54650CB81FAF9418950EA1FDC74EAB50BCD; UpperCasedChecksum:CE422DF3FE1688F4CD3D73948063F175A34B334FE25F9199D933C0DB5CDF80D6; SizeAsReceived:7130; Count:45 x-ms-exchange-messagesentrepresentingtype: 1 x-tmn: [JME/iLlr4M7Bwc8+7IdQSydERadZX6f3] x-ms-publictraffictype: Email x-incomingheadercount: 45 x-eopattributedmessage: 0 x-ms-office365-filtering-correlation-id: 8c561384-6960-4050-e575-08d7f0d5abb7 x-ms-traffictypediagnostic: DM6NAM11HT038: x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: r6Y0q6UmpzruXt7GfZVRFQSdLzuJQSSaKKVbDwXix0wwf1IzABqOUNiJfLdKxI0xoyTpSsM99xWpP3nywfvpQ1x6IMLAR8bOBmNr2++G0QPcEnxyPByz/KBRTsy0vTpza0o3usxHVOeg3+3M2xhVhQ2EeWARPoJO38VAoN2Au37oGqungrlH975rN3TcUX1qJ6sxm5jAxvxd+rXUIfRphv1WXyKD6mf5c2+0RCFf7WF1PZEzK38iQR8Wc98oD6IH x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:0; SRV:; IPV:NLI; SFV:NSPM; H:CY4PR19MB1655.namprd19.prod.outlook.com; PTR:; CAT:NONE; SFTY:; SFS:; DIR:OUT; SFP:1901; x-ms-exchange-antispam-messagedata: m5XYR17ZIW6+dOvGyxs+ZSCPLD9ZkK+BZGm+W5FIuK2oTcxC5yt0xctOGKW/GxrnZPrAG4r0mOLagKmTwrWrJMzlShgA1qnsEqlE6n256185IJviwKtbYBkVWdEwZsiODipi+2GS4vunRyI6GOYLKg== x-ms-exchange-transport-forked: True MIME-Version: 1.0 X-OriginatorOrg: hotmail.com X-MS-Exchange-CrossTenant-RMS-PersistedConsumerOrg: 00000000-0000-0000-0000-000000000000 X-MS-Exchange-CrossTenant-Network-Message-Id: 8c561384-6960-4050-e575-08d7f0d5abb7 X-MS-Exchange-CrossTenant-rms-persistedconsumerorg: 00000000-0000-0000-0000-000000000000 X-MS-Exchange-CrossTenant-originalarrivaltime: 05 May 2020 09:21:19.5030 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Internet X-MS-Exchange-CrossTenant-id: 84df9e7f-e9f6-40af-b435-aaaaaaaaaaaa X-MS-Exchange-Transport-CrossTenantHeadersStamped: DM6NAM11HT038 X-Rspamd-Queue-Id: 49GZ3P5dBVz4bps X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=hotmail.com header.s=selector1 header.b=q+PkhfBS; dmarc=pass (policy=none) header.from=hotmail.com; spf=pass (mx1.freebsd.org: domain of brandon.helsley@hotmail.com designates 40.92.19.90 as permitted sender) smtp.mailfrom=brandon.helsley@hotmail.com X-Spamd-Result: default: False [-4.00 / 15.00]; TO_DN_EQ_ADDR_SOME(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; R_DKIM_ALLOW(-0.20)[hotmail.com:s=selector1]; RWL_MAILSPIKE_POSSIBLE(0.00)[90.19.92.40.rep.mailspike.net : 127.0.0.17]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:40.92.0.0/15]; FREEMAIL_FROM(0.00)[hotmail.com]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; RCVD_TLS_LAST(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; IP_SCORE_FREEMAIL(0.00)[]; RCVD_COUNT_THREE(0.00)[4]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[hotmail.com:+]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[hotmail.com,none]; RCVD_IN_DNSWL_NONE(0.00)[90.19.92.40.list.dnswl.org : 127.0.3.0]; IP_SCORE(0.00)[ipnet: 40.64.0.0/10(-3.72), asn: 8075(-3.22), country: US(-0.05)]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; FREEMAIL_ENVFROM(0.00)[hotmail.com]; ASN(0.00)[asn:8075, ipnet:40.64.0.0/10, country:US]; ARC_ALLOW(-1.00)[i=1]; DWL_DNSWL_NONE(0.00)[hotmail.com.dwl.dnswl.org : 127.0.5.0] Content-Type: text/plain; charset="Windows-1252" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.30 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.30 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 05 May 2020 09:21:22 -0000 I have re0 but the ip address is under wlan0 with my CenturyLink Sent from Outlook Mobile ________________________________ From: Robert Crowston Sent: Tuesday, May 5, 2020 3:14:43 AM To: Brandon helsley ; freebsd-virtualization@f= reebsd.org Subject: Re: Bhyve help What are your network interfaces called on your machine? You probably have = to change igb0 in the example to em0 (an Intel card) or re0 (a Realtek card= ). Type =93ifconfig=94 to list all the interfaces, and look for ones with a= n ip address to figure it out. On Tue, May 5, 2020 at 10:10, Brandon helsley > wrote: I'm trying to set up bhyve like the example to learn and when doing the phy= sical interface interface get the result no such file or directory the comm= and is: ifconfig bridge0 addm igb0 addm tap0 "In this example, the physical interface is igb0" Sent from Outlook Mobile _______________________________________________ freebsd-virtualization@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to "freebsd-virtualization-unsubscribe@freebs= d.org" From owner-freebsd-virtualization@freebsd.org Tue May 5 09:52:39 2020 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id B8CDC2DF618 for ; Tue, 5 May 2020 09:52:39 +0000 (UTC) (envelope-from aryeh.friedman@gmail.com) Received: from mail-il1-x130.google.com (mail-il1-x130.google.com [IPv6:2607:f8b0:4864:20::130]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49GZlV3w0Xz4fVg for ; Tue, 5 May 2020 09:52:38 +0000 (UTC) (envelope-from aryeh.friedman@gmail.com) Received: by mail-il1-x130.google.com with SMTP id b18so1692549ilf.2 for ; Tue, 05 May 2020 02:52:38 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=doQ+peGFxQKfJ0o3+ZKrEHZWd2+Kun/gFSmcMF8Gscc=; b=J0ZH4P82mYjPWRzIajXnOzTRJKrXuaDrQQExiJp9QeoUVQGMJsUk+2ESU879ZiTYvX jkc96Pp0iH7wwPFgnaCAVzs1wBEB1R9e6pWa0xB6qBm7kvkxMBh/tQetKKNDmK2qWjlt Jco1l0S7YX66h6AVPC6WpKszJt02UZv5F6pU7NYs+OTkcW+JVuhm8n+fPUXwJ9o91PMq jBu5JjPvBvWO6Qe4jB0Kt2X4SvokEFeQPtpTfzs4H8W3QgA8vneKUmjFOYSfk1l0jxVn 1bLLEF3MxKL2gkj+idnMkKIGKJQS/CS+J3jpIGzrltfr2F+QQ7+ZdASAV91mHvjEpuAo ghhQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=doQ+peGFxQKfJ0o3+ZKrEHZWd2+Kun/gFSmcMF8Gscc=; b=pbeuucy9nslaMlnEqH8NyadF6nflNFLpn0mFdDzoQf9rZSsOBXk9twR2H2IqYw8pBz Dcnt4XVCCy1br+hiGCQmsePBG5GTYod8G6k1EGyFWkG05Y5f0rB+VbbUd6oJo8F4wmrB nqRue7tjZrlzVE3Qodxcpzk6IEuhl1zAmkxrO9SbTt3gE6xIkY7XxBIfeung4cdRBV70 w30AUvU/M2Q2aB2wK4y1gFstS9y/LsLh1R9qumvA0JGoy0qk3iuZj4m+QuBlwiEyKs/4 ek6l26WSejRv35TzvOcoWPusPup+Tz3CpcDOozPi6OojlIZsF1DndDjsk7RW2ttMOBOH NUdA== X-Gm-Message-State: AGi0PubN0PmFChanAlZKaqjggg3FwUJ2oDgPsvhzbfovc2csYhuifBIu xgNF7PttLjulDofH82t8KfarRxEKBPhj+6ghEiA= X-Google-Smtp-Source: APiQypJmCo+6X4/PJA0BxcOeLbYe6t/KW5zHfNHwWLCpYDdlZ6Zx/DqMc3GuyBqtAcQCaDAsLqO7ihReg1LK9JIg3RY= X-Received: by 2002:a92:dac6:: with SMTP id o6mr2733819ilq.29.1588672357297; Tue, 05 May 2020 02:52:37 -0700 (PDT) MIME-Version: 1.0 References: <1NVr2edzkfBDrm41NUc1i3czldPuT_tn_7Y1mlj7ef_uTSXRpKo1BV5wvWTr9F8K14KqN09d5Sy8BjnnaJ9EsAMTQ6rvJl1IiD2TNWcTf2Y=@protonmail.com> In-Reply-To: From: Aryeh Friedman Date: Tue, 5 May 2020 05:52:26 -0400 Message-ID: Subject: Re: Bhyve help To: Brandon helsley Cc: "freebsd-virtualization@freebsd.org" , Robert Crowston X-Rspamd-Queue-Id: 49GZlV3w0Xz4fVg X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=J0ZH4P82; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of aryehfriedman@gmail.com designates 2607:f8b0:4864:20::130 as permitted sender) smtp.mailfrom=aryehfriedman@gmail.com X-Spamd-Result: default: False [-2.00 / 15.00]; TO_DN_EQ_ADDR_SOME(0.00)[]; TO_DN_SOME(0.00)[]; FREEMAIL_FROM(0.00)[gmail.com]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36:c]; URI_COUNT_ODD(1.00)[15]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; FREEMAIL_TO(0.00)[hotmail.com]; FROM_EQ_ENVFROM(0.00)[]; IP_SCORE(0.00)[ip: (-8.48), ipnet: 2607:f8b0::/32(-0.33), asn: 15169(-0.43), country: US(-0.05)]; MIME_TRACE(0.00)[0:+,1:+,2:~]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; TAGGED_FROM(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com.dwl.dnswl.org : 127.0.5.0]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-virtualization@freebsd.org]; IP_SCORE_FREEMAIL(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[0.3.1.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.b.8.f.7.0.6.2.list.dnswl.org : 127.0.5.0]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[] Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.30 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.30 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 05 May 2020 09:52:39 -0000 On Tue, May 5, 2020 at 5:21 AM Brandon helsley wrote: > I have re0 but the ip address is under wlan0 with my CenturyLink > In order to use vtnet and bridging (both required for bhyve networking) you need to load the load the virtio kernel module as well as the if_tap and vmm modules (the first one provides the host side of the virtual NIC and the second loads the hypervisor components) > > Sent from Outlook Mobile > > ________________________________ > From: Robert Crowston > Sent: Tuesday, May 5, 2020 3:14:43 AM > To: Brandon helsley ; > freebsd-virtualization@freebsd.org > Subject: Re: Bhyve help > > What are your network interfaces called on your machine? You probably hav= e > to change igb0 in the example to em0 (an Intel card) or re0 (a Realtek > card). Type =E2=80=9Cifconfig=E2=80=9D to list all the interfaces, and lo= ok for ones with > an ip address to figure it out. > > On Tue, May 5, 2020 at 10:10, Brandon helsley > wrote: > I'm trying to set up bhyve like the example to learn and when doing the > physical interface interface get the result no such file or directory the > command is: > > ifconfig bridge0 addm igb0 addm tap0 > > "In this example, the physical interface is igb0" > > > Sent from Outlook Mobile > _______________________________________________ > freebsd-virtualization@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > To unsubscribe, send any mail to " > freebsd-virtualization-unsubscribe@freebsd.org" > > > _______________________________________________ > freebsd-virtualization@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > To unsubscribe, send any mail to " > freebsd-virtualization-unsubscribe@freebsd.org" > --=20 Aryeh M. Friedman, Lead Developer, http://www.PetiteCloud.org From owner-freebsd-virtualization@freebsd.org Tue May 5 10:00:48 2020 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 04CEA2DFB04 for ; Tue, 5 May 2020 10:00:48 +0000 (UTC) (envelope-from brandon.helsley@hotmail.com) Received: from NAM10-DM6-obe.outbound.protection.outlook.com (mail-dm6nam10olkn2066.outbound.protection.outlook.com [40.92.41.66]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "GlobalSign Organization Validation CA - SHA256 - G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49GZwt51zPz4g0x for ; Tue, 5 May 2020 10:00:46 +0000 (UTC) (envelope-from brandon.helsley@hotmail.com) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=FFHzSlCerpXbJXh+0MdmPh/WapSOKf7RYh0n1O3d5cxkPA2mIaE53OmF5pDw4qqHAyYArG4Enwf/D+ZHXouyZ/bGIPeCeMumIBJr/lryOELOjBIQzCEBEuH+W+ozqQl49atznWvFEujtu1YB7l01anMlX+xV8pan2ALIUvGz2FV8KQWBnkCJJs25NQoJrOYNhZHdNavF93uqKNUcEyAM9egH8HBgFuuam/BiKTm/4achCwExbjuy/33f9ul84df9VAx8uhX/2E6mcmPXvmhBsDp3oNlcSW4qpjVgis32D23VZZbFMKoD8wGQkoSamJj/TdSUAJzKUF1KBg6S070AlQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=h+GEEKIM2nf/a0FkrObyiDHWKwlKGSzL8MuwbybOXfc=; b=AHiFHrYiLwDdpzjv9yy8Lr2/oQQ28rj3iJLoKaEETHhtv4x8Sgt1yflhJBWfh/SpAT0BLyULlwdcsaaKvAJ2iUlcfsSei85oGl62Irrcsk9dit00LQ2vJyzNA+8JybruyUW5AiJoraIjfgB5Lkg9nwgLcvgHji8y2CnlakyRBE8Fex0bhoB3v9I2hSuppPCwy1P6fzPXKez+nubCc11HdasdEzRqkB2lxtPdfeZAcw+Gzg/AcE8YBvJVV/9jfhGNwwgBMm7k0s+IxlkcVYTLYQV891lfVJjNLwF8tXHnJx8TouA/n6UPE2159WwyH0zCIzuuImJFdtxJp1M+Labfww== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=none; dmarc=none; dkim=none; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=hotmail.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=h+GEEKIM2nf/a0FkrObyiDHWKwlKGSzL8MuwbybOXfc=; b=DcYl2G8I8EHoEXPhHFlpIW62ryvWubaNkaYFn4qWZLXj82oz0y6+c95DNpj+K8mMMA3q+7/WMnITPGyca7t2G9mZXO8kasY8j7i++cSJHUyPIn9MALNC+bdcQIO2Zkdb/xEnIRrcATIZFFQzLy0+a4GGfNWisZfqV0tHppebUIHBK4O/nzbEcDoAN/bPC7mCpL9zHEOy0GseZ/ygWo3cZLwfF5g+/g4xyBPJKoxncKENrutgg9sWRyWhuBkND99V1KcitmBZpJh92H/URxxvi/lcSxqcavaXYjtUJqFykqTDpyS/rOaDcdojR3vkrZBta/CHnRrQEAZNRZveiiZzIQ== Received: from MW2NAM10FT056.eop-nam10.prod.protection.outlook.com (2a01:111:e400:7e87::51) by MW2NAM10HT119.eop-nam10.prod.protection.outlook.com (2a01:111:e400:7e87::482) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.2958.27; Tue, 5 May 2020 10:00:44 +0000 Received: from CY4PR19MB1655.namprd19.prod.outlook.com (2a01:111:e400:7e87::48) by MW2NAM10FT056.mail.protection.outlook.com (2a01:111:e400:7e87::295) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.2958.20 via Frontend Transport; Tue, 5 May 2020 10:00:44 +0000 Received: from CY4PR19MB1655.namprd19.prod.outlook.com ([fe80::387e:fe14:f955:101d]) by CY4PR19MB1655.namprd19.prod.outlook.com ([fe80::387e:fe14:f955:101d%12]) with mapi id 15.20.2979.025; Tue, 5 May 2020 10:00:44 +0000 From: Brandon helsley To: Aryeh Friedman , Aryeh Friedman CC: "freebsd-virtualization@freebsd.org" , Robert Crowston , "freebsd-virtualization@freebsd.org" , Robert Crowston Subject: Re: Bhyve help Thread-Topic: Bhyve help Thread-Index: AQHWIry70sLUVs25TUup9bVixLA8JaiZNcCAgAABqp+AAAjfAIAAAJIb Date: Tue, 5 May 2020 10:00:44 +0000 Message-ID: References: <1NVr2edzkfBDrm41NUc1i3czldPuT_tn_7Y1mlj7ef_uTSXRpKo1BV5wvWTr9F8K14KqN09d5Sy8BjnnaJ9EsAMTQ6rvJl1IiD2TNWcTf2Y=@protonmail.com> , In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-incomingtopheadermarker: OriginalChecksum:72F63A91A5271DFBE06EB8D193637B8D6847E267E662176BF60363B84202495E; UpperCasedChecksum:A20F0F60D51A04E9DFF78D4E3A991BB64726BC00B94063840126DEE312367C4A; SizeAsReceived:7482; Count:46 x-ms-exchange-messagesentrepresentingtype: 1 x-tmn: [srqKJeCGmTAXZ7N0z+6DBx9tyZwI9xbq] x-ms-publictraffictype: Email x-incomingheadercount: 46 x-eopattributedmessage: 0 x-ms-office365-filtering-correlation-id: aeea20e2-789b-47a1-69d9-08d7f0db2d72 x-ms-traffictypediagnostic: MW2NAM10HT119: x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: M57+Nn3FiGNdClmfHisw79Xrz6+CxjkQ+JIJsA3COhsZh0Y3+B0nldlhRFfYg+moNkaEt+tGvs/sJnDT0Z+0ncmdS5x+pxCMM3oBsWFgAD6tM3HkggZhZwTyZ86VpGXECGAeGmQQnMdj5JJDbKZ/C6URvbcX6p0hRoaR+EPk3oz4c4S3H6HWWOK3tE6djJosqILiBHJRBpcGj2AS6DWxapj3CEUuxJcI9UCnTnmRKBEvsxEJekgQYQ7cELo9AtOo x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:0; SRV:; IPV:NLI; SFV:NSPM; H:CY4PR19MB1655.namprd19.prod.outlook.com; PTR:; CAT:NONE; SFTY:; SFS:; DIR:OUT; SFP:1901; x-ms-exchange-antispam-messagedata: 9XP/uBCmo+R97P8gI2sNeArSOsdG292zZR76yHC0bV+WBxsJA90LVSAhc2wzgMyuUHIHW41B8Rz6rb1xVJBcc1ZJvN/9HDtLFJymes9qXX3zeAYXT1QfmXSY8FNv6Tvd9+Ngnz+dt3iNBpITlb1v2Q== x-ms-exchange-transport-forked: True MIME-Version: 1.0 X-OriginatorOrg: hotmail.com X-MS-Exchange-CrossTenant-RMS-PersistedConsumerOrg: 00000000-0000-0000-0000-000000000000 X-MS-Exchange-CrossTenant-Network-Message-Id: aeea20e2-789b-47a1-69d9-08d7f0db2d72 X-MS-Exchange-CrossTenant-rms-persistedconsumerorg: 00000000-0000-0000-0000-000000000000 X-MS-Exchange-CrossTenant-originalarrivaltime: 05 May 2020 10:00:44.6052 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Internet X-MS-Exchange-CrossTenant-id: 84df9e7f-e9f6-40af-b435-aaaaaaaaaaaa X-MS-Exchange-Transport-CrossTenantHeadersStamped: MW2NAM10HT119 X-Rspamd-Queue-Id: 49GZwt51zPz4g0x X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=pass header.d=hotmail.com header.s=selector1 header.b=DcYl2G8I; dmarc=pass (policy=none) header.from=hotmail.com; spf=pass (mx1.freebsd.org: domain of brandon.helsley@hotmail.com designates 40.92.41.66 as permitted sender) smtp.mailfrom=brandon.helsley@hotmail.com X-Spamd-Result: default: False [-1.50 / 15.00]; TO_DN_EQ_ADDR_SOME(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:40.92.0.0/15]; FREEMAIL_FROM(0.00)[hotmail.com]; URI_COUNT_ODD(1.00)[17]; RCPT_COUNT_FIVE(0.00)[6]; RCVD_COUNT_THREE(0.00)[4]; DKIM_TRACE(0.00)[hotmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[hotmail.com,none]; FREEMAIL_TO(0.00)[gmail.com]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; RCVD_TLS_LAST(0.00)[]; FREEMAIL_ENVFROM(0.00)[hotmail.com]; ASN(0.00)[asn:8075, ipnet:40.64.0.0/10, country:US]; ARC_ALLOW(-1.00)[i=1]; DWL_DNSWL_NONE(0.00)[hotmail.com.dwl.dnswl.org : 127.0.5.0]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; R_DKIM_ALLOW(-0.20)[hotmail.com:s=selector1]; FROM_HAS_DN(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; TAGGED_RCPT(0.00)[]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; IP_SCORE_FREEMAIL(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[66.41.92.40.list.dnswl.org : 127.0.3.0]; IP_SCORE(0.00)[ipnet: 40.64.0.0/10(-3.72), asn: 8075(-3.22), country: US(-0.05)]; RWL_MAILSPIKE_POSSIBLE(0.00)[66.41.92.40.rep.mailspike.net : 127.0.0.17]; SUSPICIOUS_RECIPS(1.50)[] Content-Type: text/plain; charset="Windows-1252" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.30 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.30 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 05 May 2020 10:00:48 -0000 The handbook only says vmm doesn't it. I got bhyve to start without virtio = kernel module as well as the if_tap but with vmm modules. I'm at this screen:please choose the appropriate terminal type for your sys= tem.common console types are: ansi, vt100, xterm, cons25w. Console type [vt100]: Sent from Outlook Mobile ________________________________ From: Aryeh Friedman Sent: Tuesday, May 5, 2020 3:52:26 AM To: Brandon helsley Cc: freebsd-virtualization@freebsd.org = ; Robert Crowston Subject: Re: Bhyve help On Tue, May 5, 2020 at 5:21 AM Brandon helsley > wrote: I have re0 but the ip address is under wlan0 with my CenturyLink In order to use vtnet and bridging (both required for bhyve networking) you= need to load the load the virtio kernel module as well as the if_tap and v= mm modules (the first one provides the host side of the virtual NIC and the= second loads the hypervisor components) Sent from Outlook Mobile ________________________________ From: Robert Crowston > Sent: Tuesday, May 5, 2020 3:14:43 AM To: Brandon helsley >; freebsd-virtualization@freebsd.org > Subject: Re: Bhyve help What are your network interfaces called on your machine? You probably have = to change igb0 in the example to em0 (an Intel card) or re0 (a Realtek card= ). Type =93ifconfig=94 to list all the interfaces, and look for ones with a= n ip address to figure it out. On Tue, May 5, 2020 at 10:10, Brandon helsley >> wrote: I'm trying to set up bhyve like the example to learn and when doing the phy= sical interface interface get the result no such file or directory the comm= and is: ifconfig bridge0 addm igb0 addm tap0 "In this example, the physical interface is igb0" Sent from Outlook Mobile _______________________________________________ freebsd-virtualization@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to "freebsd-virtualization-unsubscribe@freebs= d.org" _______________________________________________ freebsd-virtualization@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to "freebsd-virtualization-unsubscribe@freebs= d.org" -- Aryeh M. Friedman, Lead Developer, http://www.PetiteCloud.org From owner-freebsd-virtualization@freebsd.org Tue May 5 10:08:23 2020 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 8B1B72E014D for ; Tue, 5 May 2020 10:08:23 +0000 (UTC) (envelope-from aryeh.friedman@gmail.com) Received: from mail-io1-xd33.google.com (mail-io1-xd33.google.com [IPv6:2607:f8b0:4864:20::d33]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49Gb5f5Qy6z3CSY for ; Tue, 5 May 2020 10:08:22 +0000 (UTC) (envelope-from aryeh.friedman@gmail.com) Received: by mail-io1-xd33.google.com with SMTP id k18so549278ion.0 for ; Tue, 05 May 2020 03:08:22 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=vvDSM2Jbb/+nkvgiBoMpx1spwi8ttZ+3x2RiRCqgX18=; b=Mhsr22h5UTJ0yZ442Z8ILOq6J2F3BFvU5yavdaz+G0doSiExn3XFhqtszjYY+la0B0 efMoQno9Zf3iyR1jDt+5xDHAAcJ/CAxSkJACCwlvQbaShtohl04ji0K8/f+oa2YgnqNy JpFgpME1r+KWXQPL6G5nmBspNx9aRMP8wViGYhsxsowQ2TDz8FM5klpG4KR87rFn6EQD 8dJYxIdoZuZyQbT7Ymc1gMmQ013vPIXYfhCZz/m7K2iFGSCnd5ny8ISf6M0tfAjmumHf IwJv5AdqP+eCYw4/YwU2RidMgVFAvHVN/kIErV7gXk/+jv78ZjKlxMaAEubUzq0zm9zQ Jy/g== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=vvDSM2Jbb/+nkvgiBoMpx1spwi8ttZ+3x2RiRCqgX18=; b=FeY+xq5xcwBO23Iw/CoSpcmydTMyI9XOgrMV243+EMmcLbCBbK3w0hS9a7NwnTOiZh 598hFwgGObYSpbfrxNF9W8g/CJcmWBHlJovWypxGVNuoxS9+CN3V9du93QKuHn6HnbAZ od6L4jJmRdGAIDuYQEqwMQyDJDodO46PV7s+4AIwmXhbX6kh5FZ/JAk4PaDoXFeiiDnP zNYdpQkZwyUMFMHq95JSTqUVxoGoD9OAHiWJZV1wgczmCcHDuZHc0dKOwYmPfW9UvHnH mg33uW4DxqMitGWAoSQlL1r2Z/wif2usK7TrKG8ZNvukS8gpRnSeK+03PrC+3orrEMm1 ZQyA== X-Gm-Message-State: AGi0Puatog5/L9gTVg/zqnj8fW95PqX6GaPLai9yZk8cnKV9EfmAJOuX MFKqKPiD/DElesB+Pryj3VB8Ps3fgocAmfWzN+8= X-Google-Smtp-Source: APiQypL8cgNxQw55SGaSRbaIK93nDe2IqsX12j5fnBF9XRMyQxKtDeYI6d9c40y7B3JMooqsmz6rrnMsp43SPWBWmes= X-Received: by 2002:a02:9f94:: with SMTP id a20mr2666966jam.40.1588673301381; Tue, 05 May 2020 03:08:21 -0700 (PDT) MIME-Version: 1.0 References: <1NVr2edzkfBDrm41NUc1i3czldPuT_tn_7Y1mlj7ef_uTSXRpKo1BV5wvWTr9F8K14KqN09d5Sy8BjnnaJ9EsAMTQ6rvJl1IiD2TNWcTf2Y=@protonmail.com> In-Reply-To: From: Aryeh Friedman Date: Tue, 5 May 2020 06:08:10 -0400 Message-ID: Subject: Re: Bhyve help To: Brandon helsley Cc: "freebsd-virtualization@freebsd.org" , Robert Crowston X-Rspamd-Queue-Id: 49Gb5f5Qy6z3CSY X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=Mhsr22h5; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of aryehfriedman@gmail.com designates 2607:f8b0:4864:20::d33 as permitted sender) smtp.mailfrom=aryehfriedman@gmail.com X-Spamd-Result: default: False [-1.00 / 15.00]; TO_DN_EQ_ADDR_SOME(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36:c]; FREEMAIL_FROM(0.00)[gmail.com]; URI_COUNT_ODD(1.00)[21]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; FREEMAIL_TO(0.00)[hotmail.com]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; TAGGED_FROM(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com.dwl.dnswl.org : 127.0.5.0]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-virtualization@freebsd.org]; IP_SCORE_FREEMAIL(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[3.3.d.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.b.8.f.7.0.6.2.list.dnswl.org : 127.0.5.0]; HTTP_TO_IP(1.00)[]; IP_SCORE(0.00)[ip: (-5.88), ipnet: 2607:f8b0::/32(-0.33), asn: 15169(-0.43), country: US(-0.05)]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[] Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.30 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.30 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 05 May 2020 10:08:23 -0000 On Tue, May 5, 2020 at 6:00 AM Brandon helsley wrote: > The handbook only says vmm doesn't it. I got bhyve to start without virti= o > kernel module as well as the if_tap but with vmm modules. > The handbook section on virtualization (FreeBSD host) is at best awful and misleading your best guide is the bhyve man page (especially the examples there) here is the modules I load for the same set up I recommended you try as a advanced beginners lesson in virtualization and networking. And an example script for using them: /boot/loader.conf: kern.geom.label.disk_ident.enable=3D"0" kern.geom.label.gptid.enable=3D"0" opensolaris_load=3D"YES" zfs_load=3D"YES" ipfw_load=3D"YES" ipdivert_load=3D"YES" linux_load=3D"YES" In the real /boot/loader.conf the following are commented out because PetiteCloud takes care of them when it loads but unless you want to get into more advanced stuff (like how to install non-standard ports) you should uncomment them. vmm_load=3D"YES" if_tap_load=3D"YES" nmdm_load=3D"YES" The script to load the file server VM: #!/bin/sh # # Generated by PetiteCloud 0.2.6 # ifconfig tap12 destroy ifconfig tap12 create ifconfig tap12 up sleep 5 ifconfig bridge0 addm tap12 up bhyvectl --destroy --vm=3Db829e56e9b4289a1 /usr/sbin/bhyve -c cores=3D4 -m 4096 -AI -H -P -w -g 0 -s 0:0,hostbridge -s 1,virtio-net,tap12 -s 2,ahci-hd,/vms/import/win10 -s 29,fbuf,tcp=3D 0.0.0.0:5912,w=3D1920,h=3D1080 -s 30,xhci,tablet -s 31,lpc -l com1,/dev/nmdm12B -l bootrom,/usr/local/share/uefi-firmware/BHYVE_UEFI.fd b829e56e9b4289a1&>/dev/null echo $!>/var/run/petitecloud/b829e56e9b4289a1 sleep 10 > > I'm at this screen:please choose the appropriate terminal type for your > system.common console types are: ansi, vt100, xterm, cons25w. > > Console type [vt100]: > > Sent from Outlook Mobile > ------------------------------ > *From:* Aryeh Friedman > *Sent:* Tuesday, May 5, 2020 3:52:26 AM > *To:* Brandon helsley > *Cc:* freebsd-virtualization@freebsd.org < > freebsd-virtualization@freebsd.org>; Robert Crowston < > crowston@protonmail.com> > *Subject:* Re: Bhyve help > > > > On Tue, May 5, 2020 at 5:21 AM Brandon helsley < > brandon.helsley@hotmail.com> wrote: > > I have re0 but the ip address is under wlan0 with my CenturyLink > > > In order to use vtnet and bridging (both required for bhyve networking) > you need to load the load the virtio kernel module as well as the if_tap > and vmm modules (the first one provides the host side of the virtual NIC > and the second loads the hypervisor components) > > > Sent from Outlook Mobile > > ________________________________ > From: Robert Crowston > Sent: Tuesday, May 5, 2020 3:14:43 AM > To: Brandon helsley ; > freebsd-virtualization@freebsd.org > Subject: Re: Bhyve help > > What are your network interfaces called on your machine? You probably hav= e > to change igb0 in the example to em0 (an Intel card) or re0 (a Realtek > card). Type =E2=80=9Cifconfig=E2=80=9D to list all the interfaces, and lo= ok for ones with > an ip address to figure it out. > > On Tue, May 5, 2020 at 10:10, Brandon helsley > wrote: > I'm trying to set up bhyve like the example to learn and when doing the > physical interface interface get the result no such file or directory the > command is: > > ifconfig bridge0 addm igb0 addm tap0 > > "In this example, the physical interface is igb0" > > > Sent from Outlook Mobile > _______________________________________________ > freebsd-virtualization@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > To unsubscribe, send any mail to " > freebsd-virtualization-unsubscribe@freebsd.org" > > > _______________________________________________ > freebsd-virtualization@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > To unsubscribe, send any mail to " > freebsd-virtualization-unsubscribe@freebsd.org" > > > > -- > Aryeh M. Friedman, Lead Developer, http://www.PetiteCloud.org > --=20 Aryeh M. Friedman, Lead Developer, http://www.PetiteCloud.org From owner-freebsd-virtualization@freebsd.org Tue May 5 11:51:05 2020 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id E2CF12E331E for ; Tue, 5 May 2020 11:51:05 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 49GdN95lb4z3MH2 for ; Tue, 5 May 2020 11:51:05 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id C55BA2E331D; Tue, 5 May 2020 11:51:05 +0000 (UTC) Delivered-To: virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id C52032E331C for ; Tue, 5 May 2020 11:51:05 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49GdN94sGzz3MH0 for ; Tue, 5 May 2020 11:51:05 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits)) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 88212D771 for ; Tue, 5 May 2020 11:51:05 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 045Bp5Sb065480 for ; Tue, 5 May 2020 11:51:05 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 045Bp5Yh065479 for virtualization@FreeBSD.org; Tue, 5 May 2020 11:51:05 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 246121] [bhyve][PATCH] Append Keyboard Layout specified option for using VNC. Date: Tue, 05 May 2020 11:51:05 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bhyve X-Bugzilla-Version: Unspecified X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: koinec@yahoo.co.jp X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.30 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 05 May 2020 11:51:05 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D246121 --- Comment #2 from Koine Yuusuke --- Thank you for you interest in the patch. Unfortunately, I understand that the your suggestions are difficult for the following reasons. The virtual PS2 keyboard driver of the bhyve has a table for converting ASC= II code for keys that can be expressed in ASCII characters and Xorg keysym code for keys that cannot be expressed in ASCII characters (example Enter or Esc= ape key,etc) to ScanCode Set2 of the PS2 keyboard. This patch updates this conversion table based on the layout setting file. The /usr/share/vt/keymaps/* file contain the correspondence of ASCII charac= ters or key names (key names is unique to vt/syscons, not Xorg keysym) correspon= ding to the scancode (for vt/syscons) converted from ScanCode Set2 of the PS2 keyboard device. In addition, I confirmed that the conversion algorithm from ScanCode Set2 of the PS2 keyboard to scancode (for vt/syscons) is implemented in /usr/src/sys/dev/atkbdc/atkbd.c, so I think that it is not impossible to use the /usr/share/vt/keymaps/* file as the basis for the keys that can be represented by ASCII characters. (Since it has not been examined in detail, I don't understand whether ScanC= ode Set2 of the PS2 keyboard can actually be converted from scancode (for vt/syscons) to the reverse.) On the other hand, a key that cannot be represented by ASCII characters can= not be supported because the value of Xorg keysym value doesn't exist in /usr/share/vt/keymaps/* file. (For reference, the value of Xorg keysym value is in the /usr/local/include/X11/keysymdef.h) Therefore, even if the key layout conversion information that can be expres= sed in ASCII characters is acquired from /usr/share/vt/keymaps/* file, the key = that cannot be expressed in ASCII characters cannot be acquired from /usr/share/vt/keymaps/* file, and thus I think that a layout configuration = file for each language is required. If you have a good idea to use /usr/share/vt/keymaps/* file, please let me know. (I also don't want to have a layout configuration file for bhyve apart from /usr/share/vt/keymaps/* file. But I did this because I couldn't think of any other simple way...) - Koine Yuusuke (koinec) --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-virtualization@freebsd.org Tue May 5 22:28:29 2020 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 84EA82C7B0E for ; Tue, 5 May 2020 22:28:29 +0000 (UTC) (envelope-from brandon.helsley@hotmail.com) Received: from NAM10-DM6-obe.outbound.protection.outlook.com (mail-dm6nam10olkn2082b.outbound.protection.outlook.com [IPv6:2a01:111:f400:7e88::82b]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "GlobalSign Organization Validation CA - SHA256 - G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49GvWc1g26z4cbH for ; Tue, 5 May 2020 22:28:27 +0000 (UTC) (envelope-from brandon.helsley@hotmail.com) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=WTn4/befRz0oSBkgf5snoEzkPsykRzQKJbgJb+8czjZaxw4oCIiY8eUQWk4sZQ8T7APax5WEpB1noMDQOuudr5Y80u/qT12gZVo9DePjMTPiCWLtWV7eB8LI5zWJqt+w/tqL7WQzQxsHyb+LlgPN7LfnN0P1sI2J0S9C43Ra/M2USs+HzM1KzAPY3XnLauiLvr7RvGC0dob8X1MZ32wnbWLJ72Z+LiAVfmdz57QQpyx3Kl7o1q3g+2zyQLUv1CdbgW4TPW5szadhYLwBZ7i7Dqc0Ah1eywNeWHN9HCtXotRN0lHAkhy5rZPoS6RaG5SDWEdwOvBpMCRbpcdaHUloRQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=H3TtdMUwRSNlUlMAKlmLflabAVnS0BYvT/3obuWXmVc=; b=U3QXTZpVGm48g4mApyiXUtqHAWA5JuyHZz2fnZHlXI8/SpDM/9/hRrmZY63xHjkBYqBZpHOMWVqA5IvYwywUt+BvUG5lrGu0K3zH8Uhc/xESlCn5ejHV1XWMp5UnRkp3oj0GQByrrLDF4IrV8z25PR9SFSVanij24E8km2p0hYhOcF1wXu0/oSgLVNX83XzilEN9leSKfsKLBsIa0nRSer+due1/FK1lSUpTBoTDxK7BjQNjAqBz2vw1PycpRzOpu0lIjLxOiwPqs+3z3JHiDcWtTCBidT/dwrqnIwXfODsELcrVl/FcsGX9sBuF716KmEX7k+EVPeax0Ch1+lr7CQ== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=none; dmarc=none; dkim=none; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=hotmail.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=H3TtdMUwRSNlUlMAKlmLflabAVnS0BYvT/3obuWXmVc=; b=GnU5dh6wnHZuLH+UbOgb+JB8Sq4TTVbhH8O42M9S1HaEulkEbDuhhpQVyjVG80pO4iGLXu8rStc9uwTtoslgeNczfx5F6yuH0IZh1/qNcdnYdji8UmoPwfeeT6CSfH8aGbaDIHDkUnpyAdAhwcaOedIgi4WmhxuDptFgCNxbfuZr3oq5oldxxRDrb9W+mzcf4jCUF0oCfmFvMQqgZPMuVlrULgahhaG8fL2vPTcL+xXPhnCH+PEq/y1GV5E8N2Ns6mSBL8M26rTrQ1FW2VJjMQ53f0OGgijZ78Han/v3f1QJw7bIt3JEe6sN7UMESzUULRwV4KixvolIuJ2G2T8Gkw== Received: from BN7NAM10FT050.eop-nam10.prod.protection.outlook.com (2a01:111:e400:7e8f::49) by BN7NAM10HT236.eop-nam10.prod.protection.outlook.com (2a01:111:e400:7e8f::374) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.2958.27; Tue, 5 May 2020 22:28:25 +0000 Received: from CY4PR19MB1655.namprd19.prod.outlook.com (2a01:111:e400:7e8f::4d) by BN7NAM10FT050.mail.protection.outlook.com (2a01:111:e400:7e8f::284) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.2958.20 via Frontend Transport; Tue, 5 May 2020 22:28:25 +0000 Received: from CY4PR19MB1655.namprd19.prod.outlook.com ([fe80::387e:fe14:f955:101d]) by CY4PR19MB1655.namprd19.prod.outlook.com ([fe80::387e:fe14:f955:101d%12]) with mapi id 15.20.2979.025; Tue, 5 May 2020 22:28:25 +0000 From: Brandon helsley To: Aryeh Friedman CC: "freebsd-virtualization@freebsd.org" , Robert Crowston Subject: Re: Bhyve help Thread-Topic: Bhyve help Thread-Index: AQHWIry70sLUVs25TUup9bVixLA8JaiZNcCAgAABqp+AAAjfAIAAAJIbgAAD1ACAAM2g1Q== Date: Tue, 5 May 2020 22:28:25 +0000 Message-ID: References: <1NVr2edzkfBDrm41NUc1i3czldPuT_tn_7Y1mlj7ef_uTSXRpKo1BV5wvWTr9F8K14KqN09d5Sy8BjnnaJ9EsAMTQ6rvJl1IiD2TNWcTf2Y=@protonmail.com> , In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-incomingtopheadermarker: OriginalChecksum:831D27D3D45A7F68CD4CC703E74CDCDA2869358EEEB2DA34289D0C8BC88E595D; UpperCasedChecksum:DB1AEF53D1D4CFEF3A1CDAD0BCE665F0E4851BC660470115208B437EBAE468EF; SizeAsReceived:7494; Count:46 x-ms-exchange-messagesentrepresentingtype: 1 x-tmn: [16eFbNps8E+d/MN6XwtE/8xp1UQh+5YJ] x-ms-publictraffictype: Email x-incomingheadercount: 46 x-eopattributedmessage: 0 x-ms-office365-filtering-correlation-id: d3563f99-537a-43bb-317f-08d7f143a071 x-ms-traffictypediagnostic: BN7NAM10HT236: x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: YdTcvYfJ6RKMBmSbtxFOPIqeLxiPmR/aoAP/aZOhxqZSH7jbf5c9oURFn0zE99cFW3PmOJmyzWVyfSoYBgYbf5BsrB/wGIX0ud+r3fjqMDEdmlalbsvqRtFSd9h8y4wY1J3O7l16tjpRxteqdfSMZquWt761ji3UVyVl+8fUlsAOplT08UzzYOWDp/nYtxLshCS4uCaz/cuoFe3Kj1MFr3zpdwAwpDpy9b4vT+Z03/s7MdLo99Z4H8tni1Gt5hnP x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:0; SRV:; IPV:NLI; SFV:NSPM; H:CY4PR19MB1655.namprd19.prod.outlook.com; PTR:; CAT:NONE; SFTY:; SFS:; DIR:OUT; SFP:1901; x-ms-exchange-antispam-messagedata: XGCv/Rjxa1adig3AlafZNRU/fNUMQcCyCh/xHh3/rrkIfl/pmpwVSJVmoUaa6nargweLECpM5BJXMP3+w2ciUpu4OLkoftVQ3W1/KxHdHUAFqROwSq1mVgnbg2X3SDXa3d6QjoP0vOvBQDY2kci0bA== x-ms-exchange-transport-forked: True MIME-Version: 1.0 X-OriginatorOrg: hotmail.com X-MS-Exchange-CrossTenant-RMS-PersistedConsumerOrg: 00000000-0000-0000-0000-000000000000 X-MS-Exchange-CrossTenant-Network-Message-Id: d3563f99-537a-43bb-317f-08d7f143a071 X-MS-Exchange-CrossTenant-rms-persistedconsumerorg: 00000000-0000-0000-0000-000000000000 X-MS-Exchange-CrossTenant-originalarrivaltime: 05 May 2020 22:28:25.1910 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Internet X-MS-Exchange-CrossTenant-id: 84df9e7f-e9f6-40af-b435-aaaaaaaaaaaa X-MS-Exchange-Transport-CrossTenantHeadersStamped: BN7NAM10HT236 X-Rspamd-Queue-Id: 49GvWc1g26z4cbH X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=hotmail.com header.s=selector1 header.b=GnU5dh6w; dmarc=pass (policy=none) header.from=hotmail.com; spf=pass (mx1.freebsd.org: domain of brandon.helsley@hotmail.com designates 2a01:111:f400:7e88::82b as permitted sender) smtp.mailfrom=brandon.helsley@hotmail.com X-Spamd-Result: default: False [-3.00 / 15.00]; TO_DN_EQ_ADDR_SOME(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2a01:111:f400::/48]; FREEMAIL_FROM(0.00)[hotmail.com]; RCVD_COUNT_THREE(0.00)[4]; DKIM_TRACE(0.00)[hotmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[hotmail.com,none]; FREEMAIL_TO(0.00)[gmail.com]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; FREEMAIL_ENVFROM(0.00)[hotmail.com]; ASN(0.00)[asn:8075, ipnet:2a01:111:f000::/36, country:US]; ARC_ALLOW(-1.00)[i=1]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; R_DKIM_ALLOW(-0.20)[hotmail.com:s=selector1]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; TAGGED_RCPT(0.00)[]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; IP_SCORE_FREEMAIL(0.00)[]; DWL_DNSWL_NONE(0.00)[hotmail.com.dwl.dnswl.org : 127.0.5.0]; TO_MATCH_ENVRCPT_SOME(0.00)[]; HTTP_TO_IP(1.00)[]; IP_SCORE(0.00)[ipnet: 2a01:111:f000::/36(-4.18), asn: 8075(-3.23), country: US(-0.05)] Content-Type: text/plain; charset="Windows-1252" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.30 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.30 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 05 May 2020 22:28:29 -0000 Bhyve gets me to Network installation: "some installation files were not fo= und on the boot volume. The next few screens will allow you to configure ne= tworking so that they can be downloaded from the internet." This happens af= ter system components. Sent from Outlook Mobile ________________________________ From: Aryeh Friedman Sent: Tuesday, May 5, 2020 4:08:10 AM To: Brandon helsley Cc: freebsd-virtualization@freebsd.org = ; Robert Crowston Subject: Re: Bhyve help On Tue, May 5, 2020 at 6:00 AM Brandon helsley > wrote: The handbook only says vmm doesn't it. I got bhyve to start without virtio = kernel module as well as the if_tap but with vmm modules. The handbook section on virtualization (FreeBSD host) is at best awful and = misleading your best guide is the bhyve man page (especially the examples t= here) here is the modules I load for the same set up I recommended you try = as a advanced beginners lesson in virtualization and networking. And an e= xample script for using them: /boot/loader.conf: kern.geom.label.disk_ident.enable=3D"0" kern.geom.label.gptid.enable=3D"0" opensolaris_load=3D"YES" zfs_load=3D"YES" ipfw_load=3D"YES" ipdivert_load=3D"YES" linux_load=3D"YES" In the real /boot/loader.conf the following are commented out because Petit= eCloud takes care of them when it loads but unless you want to get into mor= e advanced stuff (like how to install non-standard ports) you should uncomm= ent them. vmm_load=3D"YES" if_tap_load=3D"YES" nmdm_load=3D"YES" The script to load the file server VM: #!/bin/sh # # Generated by PetiteCloud 0.2.6 # ifconfig tap12 destroy ifconfig tap12 create ifconfig tap12 up sleep 5 ifconfig bridge0 addm tap12 up bhyvectl --destroy --vm=3Db829e56e9b4289a1 /usr/sbin/bhyve -c cores=3D4 -m 4096 -AI -H -P -w -g 0 -s 0:0,hostbridge -s= 1,virtio-net,tap12 -s 2,ahci-hd,/vms/import/win10 -s 29,fbuf,tcp=3D0.0.0.= 0:5912,w=3D1920,h=3D1080 -s 30,xhci,tablet -s 31,lpc = -l com1,/dev/nmdm12B -l bootrom,/usr/local/share/uefi-firmware/BHYVE_UEFI.f= d b829e56e9b4289a1&>/dev/null echo $!>/var/run/petitecloud/b829e56e9b4289a1 sleep 10 I'm at this screen:please choose the appropriate terminal type for your sys= tem.common console types are: ansi, vt100, xterm, cons25w. Console type [vt100]: Sent from Outlook Mobile ________________________________ From: Aryeh Friedman > Sent: Tuesday, May 5, 2020 3:52:26 AM To: Brandon helsley > Cc: freebsd-virtualization@freebsd.org >; Robert Crowston > Subject: Re: Bhyve help On Tue, May 5, 2020 at 5:21 AM Brandon helsley > wrote: I have re0 but the ip address is under wlan0 with my CenturyLink In order to use vtnet and bridging (both required for bhyve networking) you= need to load the load the virtio kernel module as well as the if_tap and v= mm modules (the first one provides the host side of the virtual NIC and the= second loads the hypervisor components) Sent from Outlook Mobile ________________________________ From: Robert Crowston > Sent: Tuesday, May 5, 2020 3:14:43 AM To: Brandon helsley >; freebsd-virtualization@freebsd.org > Subject: Re: Bhyve help What are your network interfaces called on your machine? You probably have = to change igb0 in the example to em0 (an Intel card) or re0 (a Realtek card= ). Type =93ifconfig=94 to list all the interfaces, and look for ones with a= n ip address to figure it out. On Tue, May 5, 2020 at 10:10, Brandon helsley >> wrote: I'm trying to set up bhyve like the example to learn and when doing the phy= sical interface interface get the result no such file or directory the comm= and is: ifconfig bridge0 addm igb0 addm tap0 "In this example, the physical interface is igb0" Sent from Outlook Mobile _______________________________________________ freebsd-virtualization@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to "freebsd-virtualization-unsubscribe@freebs= d.org" _______________________________________________ freebsd-virtualization@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to "freebsd-virtualization-unsubscribe@freebs= d.org" -- Aryeh M. Friedman, Lead Developer, http://www.PetiteCloud.org -- Aryeh M. Friedman, Lead Developer, http://www.PetiteCloud.org From owner-freebsd-virtualization@freebsd.org Tue May 5 22:36:49 2020 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id DCCF62C7E66 for ; Tue, 5 May 2020 22:36:49 +0000 (UTC) (envelope-from brandon.helsley@hotmail.com) Received: from NAM10-MW2-obe.outbound.protection.outlook.com (mail-mw2nam10olkn2090.outbound.protection.outlook.com [40.92.42.90]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "GlobalSign Organization Validation CA - SHA256 - G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49GvjD2dtDz4cxF for ; Tue, 5 May 2020 22:36:48 +0000 (UTC) (envelope-from brandon.helsley@hotmail.com) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=QHCKXJZ2gfinpJ7tunAwNvncH943TEK6V2STZlso71cCXgY3qVg2x6CBm7gymBCoipH/8z0Vu1V5IxCjdrJKY94D7Fc4tPtqAnRDiVpWH09IwDye8ACJQ6vrjaLS5+a5ghb6m2TRqZ440caBQoxW7gm6CL7oq+5ynUOyji2PeGNCAEEDvSg7Kqstyw94seStI2MCcqGEwWNr6ODH4gaxkW7S4wmNSSz0GXgHQOt7cZhgw1eWPRzZkaEblJY0gSgM8WTNam5uDtE9KPWyxf6gnYjl1Ry0Lv6rgqYpmco6uXMYnCDMyf3UVSVUaQfDRu9RnECgUalV9xZbjpCcAzroNg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=X71IRVdhy7w+iJckDEK+oCmgBoq6QPlQOjZH4Mr5XC4=; b=lQrDFNvQSYE6SUktofR/GYeZCdhAH2iXrZhM4OW7s+i/AsD6EP7pULi8ILnjvjUyr7yNhAjt1SlJVXuoMBgKF/ktq38swVGv/b+GX91rgfwn+6IYKqLxY86pFD/wCXNTkqjEu14WeAxibJkc04C2doZpkowrd14YyGhb1Wp+zvcbcjnqw96Ri/m3+bFE/CXCI3QB07Gi+/d/iWUAj4LVVi/PhQoe5GLYaflob6hcJZkZeHRVgsqEKIrkqvCzMnJFuCYf/2HW/pshhJWQv66XofTAkRPzrxJabvVkZMebZ76MHInj4v1FcKAYi9KhJgbsLfrUItCfw8d5c/Tp4zcneQ== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=none; dmarc=none; dkim=none; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=hotmail.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=X71IRVdhy7w+iJckDEK+oCmgBoq6QPlQOjZH4Mr5XC4=; b=YvNZME/c1GpQOZy9eDt1sP35Kfwi+S2X4XEJV/Eqm02Zw0NGZ02RoIy9gLh3sYmHHbQEZaGrdgsEGRb/74eFmINM+Q7fQfRs0zWR9JgXj2l314TAwk4elnqzGEei2B9yuX+IDzmh0niEwUTq0VFIfvkr4Ufrng8q+zLGoDlRWoTBirJepgB+t3IzZKBB8UotwJ8oir+cVvOq3JBR+1E60zN2SIJ4m3tEmUA1Qs9N+pJRFb7cZJf0Rb85FQExn173ATcBoN5ndL4qUtpU7SXV06N5PF3/iXPjU5Tu2vMWI1RXGJzB063QGEi7MVgDo2HJKsyxJ2mQWKEwpaytv6a24A== Received: from BN7NAM10FT018.eop-nam10.prod.protection.outlook.com (2a01:111:e400:7e8f::4e) by BN7NAM10HT198.eop-nam10.prod.protection.outlook.com (2a01:111:e400:7e8f::359) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.2958.27; Tue, 5 May 2020 22:36:45 +0000 Received: from CY4PR19MB1655.namprd19.prod.outlook.com (2a01:111:e400:7e8f::46) by BN7NAM10FT018.mail.protection.outlook.com (2a01:111:e400:7e8f::67) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.2958.20 via Frontend Transport; Tue, 5 May 2020 22:36:45 +0000 Received: from CY4PR19MB1655.namprd19.prod.outlook.com ([fe80::387e:fe14:f955:101d]) by CY4PR19MB1655.namprd19.prod.outlook.com ([fe80::387e:fe14:f955:101d%12]) with mapi id 15.20.2979.025; Tue, 5 May 2020 22:36:45 +0000 From: Brandon helsley To: Aryeh Friedman CC: "freebsd-virtualization@freebsd.org" Subject: Re: Bhyve help Thread-Topic: Bhyve help Thread-Index: AQHWIry70sLUVs25TUup9bVixLA8JaiZNcCAgAABqp+AAAjfAIAAAJIbgAAD1ACAAM2g1YAAArlT Date: Tue, 5 May 2020 22:36:45 +0000 Message-ID: References: <1NVr2edzkfBDrm41NUc1i3czldPuT_tn_7Y1mlj7ef_uTSXRpKo1BV5wvWTr9F8K14KqN09d5Sy8BjnnaJ9EsAMTQ6rvJl1IiD2TNWcTf2Y=@protonmail.com> , , In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-incomingtopheadermarker: OriginalChecksum:58039BD64DCAFC5DA6C86EA30F750DE7AAB00899BA08AEBA42A04BDE9E93C713; UpperCasedChecksum:AF1E2DA9EE33401B87330B8153EEE9E9807B96EEF8C3A9E7BFFFB8FE9F7D0BFC; SizeAsReceived:7518; Count:46 x-ms-exchange-messagesentrepresentingtype: 1 x-tmn: [BwQwjDH4J+9YiRE7QvKiTBTBF9qzHiS7] x-ms-publictraffictype: Email x-incomingheadercount: 46 x-eopattributedmessage: 0 x-ms-office365-filtering-correlation-id: c584e184-15a9-40c5-abf4-08d7f144caac x-ms-traffictypediagnostic: BN7NAM10HT198: x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: wzNRDLImd8rFVaJIHHQFzcLve8B4RoEXliDyDm864N5mlx5Rx8trCQ9uZGFDeJx6kfe+kbjH2rRW252L+b+Nd+KHZ1Lm3nnKfFJE6p55mui0Cd8QpRdiX5bnq4JL3rKDtCceeCuikzIVB4M2F1c1Im/8MWRhW+5sn2OxmjMHcfjzq0Qa4Lz4Lw71E5uHfNXFZqhGZDsTt9JP1vaxY6m/1FZtHn8vT6hBDJWR9LaBoeksvtpjPSoBXX6Uu8V7ag8Y x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:0; SRV:; IPV:NLI; SFV:NSPM; H:CY4PR19MB1655.namprd19.prod.outlook.com; PTR:; CAT:NONE; SFTY:; SFS:; DIR:OUT; SFP:1901; x-ms-exchange-antispam-messagedata: YUf42WfghZXwzbz62AOgA/29KmFWXtDNnJTlhMtiF6EAcf0HzEy7XYq6tH1dGbsofENBqg5C+Udee6uoH6WPmOSDdLQyJwlwMHqF7Bmahk1BjqcT9aTAp5etwiJcfKRMG5pXzIUhKjK1gw2g+Ubnjg== x-ms-exchange-transport-forked: True MIME-Version: 1.0 X-OriginatorOrg: hotmail.com X-MS-Exchange-CrossTenant-RMS-PersistedConsumerOrg: 00000000-0000-0000-0000-000000000000 X-MS-Exchange-CrossTenant-Network-Message-Id: c584e184-15a9-40c5-abf4-08d7f144caac X-MS-Exchange-CrossTenant-rms-persistedconsumerorg: 00000000-0000-0000-0000-000000000000 X-MS-Exchange-CrossTenant-originalarrivaltime: 05 May 2020 22:36:45.5459 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Internet X-MS-Exchange-CrossTenant-id: 84df9e7f-e9f6-40af-b435-aaaaaaaaaaaa X-MS-Exchange-Transport-CrossTenantHeadersStamped: BN7NAM10HT198 X-Rspamd-Queue-Id: 49GvjD2dtDz4cxF X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=hotmail.com header.s=selector1 header.b=YvNZME/c; dmarc=pass (policy=none) header.from=hotmail.com; spf=pass (mx1.freebsd.org: domain of brandon.helsley@hotmail.com designates 40.92.42.90 as permitted sender) smtp.mailfrom=brandon.helsley@hotmail.com X-Spamd-Result: default: False [-3.00 / 15.00]; TO_DN_EQ_ADDR_SOME(0.00)[]; TO_DN_SOME(0.00)[]; FREEMAIL_FROM(0.00)[hotmail.com]; R_SPF_ALLOW(-0.20)[+ip4:40.92.0.0/15]; URI_COUNT_ODD(1.00)[33]; RCVD_COUNT_THREE(0.00)[4]; DKIM_TRACE(0.00)[hotmail.com:+]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[hotmail.com,none]; FREEMAIL_TO(0.00)[gmail.com]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; FREEMAIL_ENVFROM(0.00)[hotmail.com]; ASN(0.00)[asn:8075, ipnet:40.64.0.0/10, country:US]; ARC_ALLOW(-1.00)[i=1]; DWL_DNSWL_NONE(0.00)[hotmail.com.dwl.dnswl.org : 127.0.5.0]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; R_DKIM_ALLOW(-0.20)[hotmail.com:s=selector1]; FROM_HAS_DN(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; TAGGED_RCPT(0.00)[]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; IP_SCORE_FREEMAIL(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[90.42.92.40.list.dnswl.org : 127.0.3.0]; IP_SCORE(0.00)[ipnet: 40.64.0.0/10(-3.73), asn: 8075(-3.23), country: US(-0.05)]; RWL_MAILSPIKE_POSSIBLE(0.00)[90.42.92.40.rep.mailspike.net : 127.0.0.17] Content-Type: text/plain; charset="Windows-1252" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.30 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.30 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 05 May 2020 22:36:49 -0000 Also error while fetching ftp://ftp4.us.freebsd.org/pub/FreeBSD/releases/and64/and64/12.1-RELEASE/bas= e.txz: no address record Sent from Outlook Mobile ________________________________ From: owner-freebsd-virtualization@freebsd.org on behalf of Brandon helsley Sent: Tuesday, May 5, 2020 4:28:25 PM To: Aryeh Friedman Cc: freebsd-virtualization@freebsd.org Subject: Re: Bhyve help Bhyve gets me to Network installation: "some installation files were not fo= und on the boot volume. The next few screens will allow you to configure ne= tworking so that they can be downloaded from the internet." This happens af= ter system components. Sent from Outlook Mobile ________________________________ From: Aryeh Friedman Sent: Tuesday, May 5, 2020 4:08:10 AM To: Brandon helsley Cc: freebsd-virtualization@freebsd.org = ; Robert Crowston Subject: Re: Bhyve help On Tue, May 5, 2020 at 6:00 AM Brandon helsley > wrote: The handbook only says vmm doesn't it. I got bhyve to start without virtio = kernel module as well as the if_tap but with vmm modules. The handbook section on virtualization (FreeBSD host) is at best awful and = misleading your best guide is the bhyve man page (especially the examples t= here) here is the modules I load for the same set up I recommended you try = as a advanced beginners lesson in virtualization and networking. And an e= xample script for using them: /boot/loader.conf: kern.geom.label.disk_ident.enable=3D"0" kern.geom.label.gptid.enable=3D"0" opensolaris_load=3D"YES" zfs_load=3D"YES" ipfw_load=3D"YES" ipdivert_load=3D"YES" linux_load=3D"YES" In the real /boot/loader.conf the following are commented out because Petit= eCloud takes care of them when it loads but unless you want to get into mor= e advanced stuff (like how to install non-standard ports) you should uncomm= ent them. vmm_load=3D"YES" if_tap_load=3D"YES" nmdm_load=3D"YES" The script to load the file server VM: #!/bin/sh # # Generated by PetiteCloud 0.2.6 # ifconfig tap12 destroy ifconfig tap12 create ifconfig tap12 up sleep 5 ifconfig bridge0 addm tap12 up bhyvectl --destroy --vm=3Db829e56e9b4289a1 /usr/sbin/bhyve -c cores=3D4 -m 4096 -AI -H -P -w -g 0 -s 0:0,hostbridge -s= 1,virtio-net,tap12 -s 2,ahci-hd,/vms/import/win10 -s 29,fbuf,tcp=3D0.0.0.= 0:5912,w=3D1920,h=3D1080 -s 30,xhci,tablet -s 31,lpc = -l com1,/dev/nmdm12B -l bootrom,/usr/local/share/uefi-firmware/BHYVE_UEFI.f= d b829e56e9b4289a1&>/dev/null echo $!>/var/run/petitecloud/b829e56e9b4289a1 sleep 10 I'm at this screen:please choose the appropriate terminal type for your sys= tem.common console types are: ansi, vt100, xterm, cons25w. Console type [vt100]: Sent from Outlook Mobile ________________________________ From: Aryeh Friedman > Sent: Tuesday, May 5, 2020 3:52:26 AM To: Brandon helsley > Cc: freebsd-virtualization@freebsd.org >; Robert Crowston > Subject: Re: Bhyve help On Tue, May 5, 2020 at 5:21 AM Brandon helsley > wrote: I have re0 but the ip address is under wlan0 with my CenturyLink In order to use vtnet and bridging (both required for bhyve networking) you= need to load the load the virtio kernel module as well as the if_tap and v= mm modules (the first one provides the host side of the virtual NIC and the= second loads the hypervisor components) Sent from Outlook Mobile ________________________________ From: Robert Crowston > Sent: Tuesday, May 5, 2020 3:14:43 AM To: Brandon helsley >; freebsd-virtualization@freebsd.org > Subject: Re: Bhyve help What are your network interfaces called on your machine? You probably have = to change igb0 in the example to em0 (an Intel card) or re0 (a Realtek card= ). Type =93ifconfig=94 to list all the interfaces, and look for ones with a= n ip address to figure it out. On Tue, May 5, 2020 at 10:10, Brandon helsley >> wrote: I'm trying to set up bhyve like the example to learn and when doing the phy= sical interface interface get the result no such file or directory the comm= and is: ifconfig bridge0 addm igb0 addm tap0 "In this example, the physical interface is igb0" Sent from Outlook Mobile _______________________________________________ freebsd-virtualization@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to "freebsd-virtualization-unsubscribe@freebs= d.org" _______________________________________________ freebsd-virtualization@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to "freebsd-virtualization-unsubscribe@freebs= d.org" -- Aryeh M. Friedman, Lead Developer, http://www.PetiteCloud.org -- Aryeh M. Friedman, Lead Developer, http://www.PetiteCloud.org _______________________________________________ freebsd-virtualization@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to "freebsd-virtualization-unsubscribe@freebs= d.org" From owner-freebsd-virtualization@freebsd.org Tue May 5 23:03:04 2020 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 963972D899B for ; Tue, 5 May 2020 23:03:04 +0000 (UTC) (envelope-from aryeh.friedman@gmail.com) Received: from mail-il1-x12f.google.com (mail-il1-x12f.google.com [IPv6:2607:f8b0:4864:20::12f]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49GwHW61CBz4fjH for ; Tue, 5 May 2020 23:03:03 +0000 (UTC) (envelope-from aryeh.friedman@gmail.com) Received: by mail-il1-x12f.google.com with SMTP id r2so189628ilo.6 for ; Tue, 05 May 2020 16:03:03 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=sks8ywUaFeNQlIEFLO9SNf/2CKRb8FnYk3akWx/uPDM=; b=irz2ij1AbNg4s+3ZbpqtKxG8vNR1nKyAsmH3fmpDw93/xN1fY/MA2j8JVB+pf5pzIC P3HT1LeY3LShMonqZZ8vz3DWqKM5Yfi2rPrZ5QIFG+zNCo7jPYK/ch+kLz5MzKyq3kN+ ZmT6qfTd6uM2tL362p0qkQpxsD87vAf6RSWzT7bEdFrdDdPhoMw7ONQPqey7bGU0DkkR 6EqZ/ukcvpoijsN51ODdjBO0Lu6sIG2QCn5jS4zJu/QuRvGfdgoiOtcuaZqz6MyYOUNg m4+xTlLIMTshUkNOkINNUYUHIFhQbuZ/+dyscl0eflepgL6P0zQTa/dRU1oofgdfJ/+Y nkiQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=sks8ywUaFeNQlIEFLO9SNf/2CKRb8FnYk3akWx/uPDM=; b=Yg1y+hnHNB19H2mP6GRTLlPfm4O4Nf4y1Yc2d1x9TKip3F0o/rNB9mPVJIKNMk3YxU 78Va+sNslPbPPKKJvA8YZFmZ2O7c07UZSXaMdQ4ahvdS7md0aNRk8y7Xn39/Wk6CPUfE Cmg4CP978QbFLZhHAgLtZrsEt0owWZIAxrPT/Z7eOpOfXJCaf5qCdMGwxxKGUSP55SyI gbBS5P+x0C+3+dP71SEK5Al8uHH+H32cRl6wTBL58ynGJqZfcc/HiiKRly16kA5G2HzW CTKA3G4ruRklbQIcfh5TxHWB+lFEirjvwA/R4xO8D5xGwTEa8yU9X+akoqeZqD9PlGuj CaWg== X-Gm-Message-State: AGi0PubmII0mS7h5t6Mn5ICido3G7XKxZiISfevDbfZRcxzv1eW+GMkh S6kw6wfuxNqYKKhoU26V/3EPiyUjHTGf/ZRvXiRfXqC+ X-Google-Smtp-Source: APiQypJQGakXHP9VxONifuvLsq2VMFoyu2vfZfuQOH+JwoBdMF5v9SHsPQsyc6CpWFW3+OmX3Mk7gqsy1LI9UNcWCN0= X-Received: by 2002:a92:ca81:: with SMTP id t1mr6055541ilo.187.1588719782845; Tue, 05 May 2020 16:03:02 -0700 (PDT) MIME-Version: 1.0 References: <1NVr2edzkfBDrm41NUc1i3czldPuT_tn_7Y1mlj7ef_uTSXRpKo1BV5wvWTr9F8K14KqN09d5Sy8BjnnaJ9EsAMTQ6rvJl1IiD2TNWcTf2Y=@protonmail.com> In-Reply-To: From: Aryeh Friedman Date: Tue, 5 May 2020 19:02:50 -0400 Message-ID: Subject: Re: Bhyve help To: Brandon helsley Cc: "freebsd-virtualization@freebsd.org" , Robert Crowston X-Rspamd-Queue-Id: 49GwHW61CBz4fjH X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=irz2ij1A; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of aryehfriedman@gmail.com designates 2607:f8b0:4864:20::12f as permitted sender) smtp.mailfrom=aryehfriedman@gmail.com X-Spamd-Result: default: False [-2.00 / 15.00]; TO_DN_EQ_ADDR_SOME(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36:c]; FREEMAIL_FROM(0.00)[gmail.com]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; FREEMAIL_TO(0.00)[hotmail.com]; FROM_EQ_ENVFROM(0.00)[]; IP_SCORE(0.00)[ip: (-8.73), ipnet: 2607:f8b0::/32(-0.33), asn: 15169(-0.43), country: US(-0.05)]; MIME_TRACE(0.00)[0:+,1:+,2:~]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; TAGGED_FROM(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com.dwl.dnswl.org : 127.0.5.0]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-virtualization@freebsd.org]; IP_SCORE_FREEMAIL(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[f.2.1.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.b.8.f.7.0.6.2.list.dnswl.org : 127.0.5.0]; HTTP_TO_IP(1.00)[]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[] Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.30 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.30 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 05 May 2020 23:03:04 -0000 When setting up a VM you also need to add the tap it is on to the bridge as well your physical NIC On Tue, May 5, 2020 at 6:28 PM Brandon helsley wrote: > Bhyve gets me to Network installation: "some installation files were not > found on the boot volume. The next few screens will allow you to configur= e > networking so that they can be downloaded from the internet." This happen= s > after system components. > > Sent from Outlook Mobile > ------------------------------ > *From:* Aryeh Friedman > *Sent:* Tuesday, May 5, 2020 4:08:10 AM > *To:* Brandon helsley > *Cc:* freebsd-virtualization@freebsd.org < > freebsd-virtualization@freebsd.org>; Robert Crowston < > crowston@protonmail.com> > *Subject:* Re: Bhyve help > > > > On Tue, May 5, 2020 at 6:00 AM Brandon helsley < > brandon.helsley@hotmail.com> wrote: > > The handbook only says vmm doesn't it. I got bhyve to start without virti= o > kernel module as well as the if_tap but with vmm modules. > > > The handbook section on virtualization (FreeBSD host) is at best awful an= d > misleading your best guide is the bhyve man page (especially the examples > there) here is the modules I load for the same set up I recommended you t= ry > as a advanced beginners lesson in virtualization and networking. And an > example script for using them: > > /boot/loader.conf: > > kern.geom.label.disk_ident.enable=3D"0" > kern.geom.label.gptid.enable=3D"0" > opensolaris_load=3D"YES" > zfs_load=3D"YES" > ipfw_load=3D"YES" > > ipdivert_load=3D"YES" > linux_load=3D"YES" > > In the real /boot/loader.conf the following are commented out because > PetiteCloud takes care of them when it loads but unless you want to get > into more advanced stuff (like how to install non-standard ports) you > should uncomment them. > > vmm_load=3D"YES" > if_tap_load=3D"YES" > nmdm_load=3D"YES" > > The script to load the file server VM: > > #!/bin/sh > # > # Generated by PetiteCloud 0.2.6 > # > > ifconfig tap12 destroy > ifconfig tap12 create > ifconfig tap12 up > sleep 5 > ifconfig bridge0 addm tap12 up > bhyvectl --destroy --vm=3Db829e56e9b4289a1 > /usr/sbin/bhyve -c cores=3D4 -m 4096 -AI -H -P -w -g 0 -s 0:0,hostbridge = -s > 1,virtio-net,tap12 -s 2,ahci-hd,/vms/import/win10 -s 29,fbuf,tcp=3D > 0.0.0.0:5912,w=3D1920,h=3D1080 -s 30,xhci,tablet -s 31,lpc -l > com1,/dev/nmdm12B -l bootrom,/usr/local/share/uefi-firmware/BHYVE_UEFI.fd > b829e56e9b4289a1&>/dev/null > echo $!>/var/run/petitecloud/b829e56e9b4289a1 > sleep 10 > > > I'm at this screen:please choose the appropriate terminal type for your > system.common console types are: ansi, vt100, xterm, cons25w. > > Console type [vt100]: > > Sent from Outlook Mobile > ------------------------------ > *From:* Aryeh Friedman > *Sent:* Tuesday, May 5, 2020 3:52:26 AM > *To:* Brandon helsley > *Cc:* freebsd-virtualization@freebsd.org < > freebsd-virtualization@freebsd.org>; Robert Crowston < > crowston@protonmail.com> > *Subject:* Re: Bhyve help > > > > On Tue, May 5, 2020 at 5:21 AM Brandon helsley < > brandon.helsley@hotmail.com> wrote: > > I have re0 but the ip address is under wlan0 with my CenturyLink > > > In order to use vtnet and bridging (both required for bhyve networking) > you need to load the load the virtio kernel module as well as the if_tap > and vmm modules (the first one provides the host side of the virtual NIC > and the second loads the hypervisor components) > > > Sent from Outlook Mobile > > ________________________________ > From: Robert Crowston > Sent: Tuesday, May 5, 2020 3:14:43 AM > To: Brandon helsley ; > freebsd-virtualization@freebsd.org > Subject: Re: Bhyve help > > What are your network interfaces called on your machine? You probably hav= e > to change igb0 in the example to em0 (an Intel card) or re0 (a Realtek > card). Type =E2=80=9Cifconfig=E2=80=9D to list all the interfaces, and lo= ok for ones with > an ip address to figure it out. > > On Tue, May 5, 2020 at 10:10, Brandon helsley > wrote: > I'm trying to set up bhyve like the example to learn and when doing the > physical interface interface get the result no such file or directory the > command is: > > ifconfig bridge0 addm igb0 addm tap0 > > "In this example, the physical interface is igb0" > > > Sent from Outlook Mobile > _______________________________________________ > freebsd-virtualization@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > To unsubscribe, send any mail to " > freebsd-virtualization-unsubscribe@freebsd.org" > > > _______________________________________________ > freebsd-virtualization@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > To unsubscribe, send any mail to " > freebsd-virtualization-unsubscribe@freebsd.org" > > > > -- > Aryeh M. Friedman, Lead Developer, http://www.PetiteCloud.org > > > > -- > Aryeh M. Friedman, Lead Developer, http://www.PetiteCloud.org > --=20 Aryeh M. Friedman, Lead Developer, http://www.PetiteCloud.org From owner-freebsd-virtualization@freebsd.org Tue May 5 23:55:05 2020 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 944752D9A00 for ; Tue, 5 May 2020 23:55:05 +0000 (UTC) (envelope-from brandon.helsley@hotmail.com) Received: from NAM10-DM6-obe.outbound.protection.outlook.com (mail-dm6nam10olkn2109.outbound.protection.outlook.com [40.92.41.109]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "GlobalSign Organization Validation CA - SHA256 - G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49GxRX141Dz3DcD for ; Tue, 5 May 2020 23:55:03 +0000 (UTC) (envelope-from brandon.helsley@hotmail.com) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=h9S7PGiTrVYtfNQj9f41snu+I+TQY5+V0+g2hjrncLAenIFFVDa6eHBtillxqNRVf2+/d81RZ9FDyZkp5HpdOl+pbr03gAXo176a5Zy8mVrbk5ZBxIqh088Cn4uAxIKA1TaNfWw6LmUGTnUngIRmNQFonh1QiVQD1O+tSGwd1TJ4BdxYSuopMuXWJNfSwVTrkRL7CLgfzZlDci+srZ6nkrLpQtc8GK0Gg5lxP20gzbfReh0HJXTISRzg0tH04GXiLttiRk3dGiT4JEp6ck23H+QNmqQicJVc+050ZPBCnuJk7RbC4aR2DzbOLc3ULR/IX00RASJ2NmVC7FMZR6Ln3g== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=Xg1Q18pF4XRq3B84dzTqT3tYqiFIf7amc1Hekk6lhdA=; b=D3BPU0WMQmJqdAgp/A6+d0PbvYWV44b6FtYm0CRqZdWazdFyDU+iEgjOIYz1Usf9Bo3w4n2PUxkXaEFFuU22qZQVrKWg83qX8SLMPpyxfCanKCy9+vjbO9j+Kxljuxe8l/zO25HiOSUMLtVOSHRXMEKBbYAA8aP3gNB0XKEbU0f2uYG9x4eSPnx8Kzy0I2BuyCEtcfPs/gJofd+y+i4B5+JhYvGoPTcrXweNBmAocNGlprQC0v9rqPAdb4N6VuLu3UJqWIxtRRVJllsFxhQiV/O5PcAsiYFzTM59e0sLpDqc5I+vT/mPOxv3EQRwxrmtg64kM8tX2TQl9pZvZhqPtg== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=none; dmarc=none; dkim=none; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=hotmail.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=Xg1Q18pF4XRq3B84dzTqT3tYqiFIf7amc1Hekk6lhdA=; b=PhGJiyXfE4hDmtuxpOC65jpeWGMvTy2933Sdfi9qXI1gQL7oYSbBJQL3IbXKAU3kQrfVKMYFL+u5hgtsS4N+K2X0yJKBbP3LyauhKrS4ae0FjL1YRVFfSiwQd9hoC6plomLRsVetRReV8zSu+I7D60Sn7s3mviIcmmQ6VIZEtt0590qrhR9pcEarODqY7kt6Yii2/215R5aKY0KfqD1yKp0MrzODHdHEKaK3Ng9lWjUpPEgXmZcDTfa5drDuzYvOMnC2Qz0dLrQ6ew3RfZBaztLfeVFTntObflf1hWgnt1kXgM9Nmzf3Wta4a4ERRGllwX7gX0AoDWqdu6nxFGGxqA== Received: from DM6NAM10FT006.eop-nam10.prod.protection.outlook.com (2a01:111:e400:7e86::4b) by DM6NAM10HT169.eop-nam10.prod.protection.outlook.com (2a01:111:e400:7e86::191) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.2958.27; Tue, 5 May 2020 23:55:02 +0000 Received: from CY4PR19MB1655.namprd19.prod.outlook.com (2a01:111:e400:7e86::48) by DM6NAM10FT006.mail.protection.outlook.com (2a01:111:e400:7e86::270) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.2958.20 via Frontend Transport; Tue, 5 May 2020 23:55:02 +0000 Received: from CY4PR19MB1655.namprd19.prod.outlook.com ([fe80::387e:fe14:f955:101d]) by CY4PR19MB1655.namprd19.prod.outlook.com ([fe80::387e:fe14:f955:101d%12]) with mapi id 15.20.2979.025; Tue, 5 May 2020 23:55:01 +0000 From: Brandon helsley To: Aryeh Friedman CC: "freebsd-virtualization@freebsd.org" , Robert Crowston Subject: Re: Bhyve help Thread-Topic: Bhyve help Thread-Index: AQHWIry70sLUVs25TUup9bVixLA8JaiZNcCAgAABqp+AAAjfAIAAAJIbgAAD1ACAAM2g1YAACtAAgAAOYAM= Date: Tue, 5 May 2020 23:55:01 +0000 Message-ID: References: <1NVr2edzkfBDrm41NUc1i3czldPuT_tn_7Y1mlj7ef_uTSXRpKo1BV5wvWTr9F8K14KqN09d5Sy8BjnnaJ9EsAMTQ6rvJl1IiD2TNWcTf2Y=@protonmail.com> , In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-incomingtopheadermarker: OriginalChecksum:AC95546B2F28C69053BA9D7A24C76228E4D554A9E640852D270248B299CAA01C; UpperCasedChecksum:65E21620556C2161D648C1D3299EE833E96988560806939E3A689DA9EB9824E1; SizeAsReceived:7651; Count:46 x-ms-exchange-messagesentrepresentingtype: 1 x-tmn: [gTMvWlEu5oeV89THf61amXGHtQIkGo1e] x-ms-publictraffictype: Email x-incomingheadercount: 46 x-eopattributedmessage: 0 x-ms-office365-filtering-correlation-id: 3342b129-93c7-4871-d253-08d7f14fb9e8 x-ms-traffictypediagnostic: DM6NAM10HT169: x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: 036LUtADu3OxVhpI2+/buy9xcV/obXCoNc0eC9dznekBUCejj9oyKmZW6vmt6bD7BZWjDyUxA0UjgntZhkNtedNVbwAixxSmL+3S5yu4aT530Y31JT0QVEwNH4dcIPheP40hQV0iyO6lGWBUecBRjKUdUiwj3dmqtrlcDhsr5GgXZ7QUzOoatuKIgAuh7LKFOcqlKI+NFM6xkzcDJKmnMZNOVQ3AURUrxrqCej+xERcEYH/te4lxs8rvoh73Q3lR x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:0; SRV:; IPV:NLI; SFV:NSPM; H:CY4PR19MB1655.namprd19.prod.outlook.com; PTR:; CAT:NONE; SFTY:; SFS:; DIR:OUT; SFP:1901; x-ms-exchange-antispam-messagedata: IvhyXsNN6KAX9H8QNVxuBiw84TklWZ/7ZBcp12z+rePANmbwF1UOZqYHhG4RoI/SxqMQIWkBLLPW5Km9PNixBR2BA14OkSnbg/ysHs3lsxxrY2N/Ovy6BYRs8Fh0lB7u8HoaapPUL1O99G3Zv3Z6iA== x-ms-exchange-transport-forked: True MIME-Version: 1.0 X-OriginatorOrg: hotmail.com X-MS-Exchange-CrossTenant-RMS-PersistedConsumerOrg: 00000000-0000-0000-0000-000000000000 X-MS-Exchange-CrossTenant-Network-Message-Id: 3342b129-93c7-4871-d253-08d7f14fb9e8 X-MS-Exchange-CrossTenant-rms-persistedconsumerorg: 00000000-0000-0000-0000-000000000000 X-MS-Exchange-CrossTenant-originalarrivaltime: 05 May 2020 23:55:01.9478 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Internet X-MS-Exchange-CrossTenant-id: 84df9e7f-e9f6-40af-b435-aaaaaaaaaaaa X-MS-Exchange-Transport-CrossTenantHeadersStamped: DM6NAM10HT169 X-Rspamd-Queue-Id: 49GxRX141Dz3DcD X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=pass header.d=hotmail.com header.s=selector1 header.b=PhGJiyXf; dmarc=pass (policy=none) header.from=hotmail.com; spf=pass (mx1.freebsd.org: domain of brandon.helsley@hotmail.com designates 40.92.41.109 as permitted sender) smtp.mailfrom=brandon.helsley@hotmail.com X-Spamd-Result: default: False [-2.00 / 15.00]; TO_DN_EQ_ADDR_SOME(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:40.92.0.0/15]; FREEMAIL_FROM(0.00)[hotmail.com]; URI_COUNT_ODD(1.00)[29]; RCVD_COUNT_THREE(0.00)[4]; DKIM_TRACE(0.00)[hotmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[hotmail.com,none]; FREEMAIL_TO(0.00)[gmail.com]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; FREEMAIL_ENVFROM(0.00)[hotmail.com]; ASN(0.00)[asn:8075, ipnet:40.64.0.0/10, country:US]; ARC_ALLOW(-1.00)[i=1]; DWL_DNSWL_NONE(0.00)[hotmail.com.dwl.dnswl.org : 127.0.5.0]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; R_DKIM_ALLOW(-0.20)[hotmail.com:s=selector1]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; TAGGED_RCPT(0.00)[]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; IP_SCORE_FREEMAIL(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[109.41.92.40.list.dnswl.org : 127.0.3.0]; HTTP_TO_IP(1.00)[]; IP_SCORE(0.00)[ipnet: 40.64.0.0/10(-3.73), asn: 8075(-3.23), country: US(-0.05)]; RWL_MAILSPIKE_POSSIBLE(0.00)[109.41.92.40.rep.mailspike.net : 127.0.0.17] Content-Type: text/plain; charset="Windows-1252" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.30 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.30 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 05 May 2020 23:55:05 -0000 Well how do i add a tap to the bridge the VM is on as well as my physical n= ic Sent from Outlook Mobile ________________________________ From: Aryeh Friedman Sent: Tuesday, May 5, 2020 5:02:50 PM To: Brandon helsley Cc: freebsd-virtualization@freebsd.org = ; Robert Crowston Subject: Re: Bhyve help When setting up a VM you also need to add the tap it is on to the bridge as= well your physical NIC On Tue, May 5, 2020 at 6:28 PM Brandon helsley > wrote: Bhyve gets me to Network installation: "some installation files were not fo= und on the boot volume. The next few screens will allow you to configure ne= tworking so that they can be downloaded from the internet." This happens af= ter system components. Sent from Outlook Mobile ________________________________ From: Aryeh Friedman > Sent: Tuesday, May 5, 2020 4:08:10 AM To: Brandon helsley > Cc: freebsd-virtualization@freebsd.org >; Robert Crowston > Subject: Re: Bhyve help On Tue, May 5, 2020 at 6:00 AM Brandon helsley > wrote: The handbook only says vmm doesn't it. I got bhyve to start without virtio = kernel module as well as the if_tap but with vmm modules. The handbook section on virtualization (FreeBSD host) is at best awful and = misleading your best guide is the bhyve man page (especially the examples t= here) here is the modules I load for the same set up I recommended you try = as a advanced beginners lesson in virtualization and networking. And an e= xample script for using them: /boot/loader.conf: kern.geom.label.disk_ident.enable=3D"0" kern.geom.label.gptid.enable=3D"0" opensolaris_load=3D"YES" zfs_load=3D"YES" ipfw_load=3D"YES" ipdivert_load=3D"YES" linux_load=3D"YES" In the real /boot/loader.conf the following are commented out because Petit= eCloud takes care of them when it loads but unless you want to get into mor= e advanced stuff (like how to install non-standard ports) you should uncomm= ent them. vmm_load=3D"YES" if_tap_load=3D"YES" nmdm_load=3D"YES" The script to load the file server VM: #!/bin/sh # # Generated by PetiteCloud 0.2.6 # ifconfig tap12 destroy ifconfig tap12 create ifconfig tap12 up sleep 5 ifconfig bridge0 addm tap12 up bhyvectl --destroy --vm=3Db829e56e9b4289a1 /usr/sbin/bhyve -c cores=3D4 -m 4096 -AI -H -P -w -g 0 -s 0:0,hostbridge -s= 1,virtio-net,tap12 -s 2,ahci-hd,/vms/import/win10 -s 29,fbuf,tcp=3D0.0.0.= 0:5912,w=3D1920,h=3D1080 -s 30,xhci,tablet -s 31,lpc = -l com1,/dev/nmdm12B -l bootrom,/usr/local/share/uefi-firmware/BHYVE_UEFI.f= d b829e56e9b4289a1&>/dev/null echo $!>/var/run/petitecloud/b829e56e9b4289a1 sleep 10 I'm at this screen:please choose the appropriate terminal type for your sys= tem.common console types are: ansi, vt100, xterm, cons25w. Console type [vt100]: Sent from Outlook Mobile ________________________________ From: Aryeh Friedman > Sent: Tuesday, May 5, 2020 3:52:26 AM To: Brandon helsley > Cc: freebsd-virtualization@freebsd.org >; Robert Crowston > Subject: Re: Bhyve help On Tue, May 5, 2020 at 5:21 AM Brandon helsley > wrote: I have re0 but the ip address is under wlan0 with my CenturyLink In order to use vtnet and bridging (both required for bhyve networking) you= need to load the load the virtio kernel module as well as the if_tap and v= mm modules (the first one provides the host side of the virtual NIC and the= second loads the hypervisor components) Sent from Outlook Mobile ________________________________ From: Robert Crowston > Sent: Tuesday, May 5, 2020 3:14:43 AM To: Brandon helsley >; freebsd-virtualization@freebsd.org > Subject: Re: Bhyve help What are your network interfaces called on your machine? You probably have = to change igb0 in the example to em0 (an Intel card) or re0 (a Realtek card= ). Type =93ifconfig=94 to list all the interfaces, and look for ones with a= n ip address to figure it out. On Tue, May 5, 2020 at 10:10, Brandon helsley >> wrote: I'm trying to set up bhyve like the example to learn and when doing the phy= sical interface interface get the result no such file or directory the comm= and is: ifconfig bridge0 addm igb0 addm tap0 "In this example, the physical interface is igb0" Sent from Outlook Mobile _______________________________________________ freebsd-virtualization@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to "freebsd-virtualization-unsubscribe@freebs= d.org" _______________________________________________ freebsd-virtualization@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to "freebsd-virtualization-unsubscribe@freebs= d.org" -- Aryeh M. Friedman, Lead Developer, http://www.PetiteCloud.org -- Aryeh M. Friedman, Lead Developer, http://www.PetiteCloud.org -- Aryeh M. Friedman, Lead Developer, http://www.PetiteCloud.org From owner-freebsd-virtualization@freebsd.org Wed May 6 00:06:00 2020 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id A78512DA14F for ; Wed, 6 May 2020 00:06:00 +0000 (UTC) (envelope-from paul@redbarn.org) Received: from family.redbarn.org (family.redbarn.org [IPv6:2001:559:8000:cd::5]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 49Gxh74qmwz3FHH for ; Wed, 6 May 2020 00:05:59 +0000 (UTC) (envelope-from paul@redbarn.org) Received: from linux-9daj.localnet (vixp1.redbarn.org [24.104.150.140]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by family.redbarn.org (Postfix) with ESMTPSA id 3C46FB074C; Wed, 6 May 2020 00:05:51 +0000 (UTC) From: Paul Vixie To: Brandon helsley Cc: "freebsd-virtualization@freebsd.org" Subject: Re: Bhyve help Date: Wed, 06 May 2020 00:05:50 +0000 Message-ID: <6137996.WnNEjcd478@linux-9daj> Organization: none In-Reply-To: References: MIME-Version: 1.0 Content-Transfer-Encoding: 7Bit Content-Type: text/plain; charset="us-ascii" X-Rspamd-Queue-Id: 49Gxh74qmwz3FHH X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of paul@redbarn.org designates 2001:559:8000:cd::5 as permitted sender) smtp.mailfrom=paul@redbarn.org X-Spamd-Result: default: False [-1.50 / 15.00]; ARC_NA(0.00)[]; TO_DN_EQ_ADDR_SOME(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2001:559:8000::/48]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; MID_RHS_NOT_FQDN(0.50)[]; DMARC_NA(0.00)[redbarn.org]; HAS_ORG_HEADER(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; NEURAL_HAM_MEDIUM(-0.99)[-0.993,0]; IP_SCORE(-0.20)[ipnet: 2001:558::/29(-0.34), asn: 7922(-0.64), country: US(-0.05)]; FREEMAIL_TO(0.00)[hotmail.com]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; CTE_CASE(0.50)[]; ASN(0.00)[asn:7922, ipnet:2001:558::/29, country:US]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_ALL(0.00)[]; RCVD_COUNT_TWO(0.00)[2] X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.30 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 06 May 2020 00:06:00 -0000 On Tuesday, 5 May 2020 23:55:01 UTC Brandon helsley wrote: > Well how do i add a tap to the bridge the VM is on as well as my physical > nic my rc.conf has evolved as follows: autobridge_interfaces="bridge0" autobridge_bridge0="tap* igb1" ifconfig_igb1="up media 1000baseTX fib 1" cloned_interfaces="bridge0 tap0 tap1 tap2 tap3 tap4 tap5 tap6 tap7" ifconfig_bridge0="inet 24.104.150.210/27 fib 1" ifconfig_bridge0_ipv6="inet6 2001:559:8000:cd::2/64 fib 1 auto_linklocal up" ifconfig_tap0="up fib 1" ifconfig_tap1="up fib 1" ifconfig_tap2="up fib 1" ifconfig_tap3="up fib 1" ifconfig_tap4="up fib 1" ifconfig_tap5="up fib 1" ifconfig_tap6="up fib 1" ifconfig_tap7="up fib 1" it's going to be very different if you need nat and dhcp. mine is all static. -- Paul From owner-freebsd-virtualization@freebsd.org Wed May 6 00:12:20 2020 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 530632DA3D1 for ; Wed, 6 May 2020 00:12:20 +0000 (UTC) (envelope-from freebsd@grem.de) Received: from mail.evolve.de (mail.evolve.de [213.239.217.29]) (using TLSv1.2 with cipher ECDHE-RSA-CHACHA20-POLY1305 (256/256 bits)) (Client CN "mail.evolve.de", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49GxqQ63sGz3FdY for ; Wed, 6 May 2020 00:12:18 +0000 (UTC) (envelope-from freebsd@grem.de) Received: by mail.evolve.de (OpenSMTPD) with ESMTP id cbcf495f; Wed, 6 May 2020 00:12:15 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha1; c=relaxed; d=grem.de; h=content-type :content-transfer-encoding:mime-version:subject:from:in-reply-to :date:cc:message-id:references:to; s=20180501; bh=0IGad+i4IFwtXK BAeerUSR8b6uk=; b=b6GhnSC9xKiP21MhwEp1dRjOGK/ReRuJ/NcwcivtK/GMOh mvb3uMYGSCjrhdjSzUCPLjNY1wJ2kF8U0CIvmrWoTRcSnpHkdrSvz3ovAvSTRIPl gODYylMmNvDhbG2rW3YBWtSgwvQQ/8ig++EGbW9GQPl4bfPc/62/mqSLKGHxu0RB JbvUnZyB6lPUJdmrUV9EPkcJhY8c3JJE/29bYm8o6xryNCa5tQ70Yb/zwhab1HHk 7dH0lSx29iY5iJBPP38r6+8Ih+o00r1OLrYNaVqISYE13RmE3CXDN6MNESzCMasH bO1l+3mifRv4MnisNcbS6EEnPguFK12vBWsD+L7A== DomainKey-Signature: a=rsa-sha1; c=nofws; d=grem.de; h=content-type :content-transfer-encoding:mime-version:subject:from:in-reply-to :date:cc:message-id:references:to; q=dns; s=20180501; b=mTKCEn5R pUzRtYUuoZO/6TPg0yL/vkd4OCuMnvQuxAVE/YsM/AIw2orFOo/4zjyyqNKmvfjX aarRpiaBlPEUgb+v8zDmqizml3/cinz2qzpTV68NurSKGKxDNrMNt5xzzUphxXsi Iu7PXbGXQIz2+Y2tIxSVyXtGj/C7mjKkzYeOhllm6OkUdYc5YvTulcM/raNzAH9l 0ymCWrCulPkVAGZkztY1N0ArHOgh3DGYCjKtuu4XVtBSvh2aauQAk8+SeVD48lj/ VysXioBtyXSV+pkPTCQLC3Ug2QcyTX/eIhOpYP9MgrnfOOYfFKIY0Z/40KR/AHEn sZVvNVe5tlWtFA== Received: by mail.evolve.de (OpenSMTPD) with ESMTPSA id d9ec6471 (TLSv1.2:ECDHE-RSA-CHACHA20-POLY1305:256:NO); Wed, 6 May 2020 00:12:14 +0000 (UTC) Mime-Version: 1.0 (1.0) Subject: Re: Bhyve help From: Michael Gmelin In-Reply-To: Date: Wed, 6 May 2020 02:12:14 +0200 Cc: Aryeh Friedman , "freebsd-virtualization@freebsd.org" Message-Id: References: To: Brandon helsley X-Mailer: iPhone Mail (17E262) X-Rspamd-Queue-Id: 49GxqQ63sGz3FdY X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=grem.de header.s=20180501 header.b=b6GhnSC9; dmarc=none; spf=pass (mx1.freebsd.org: domain of freebsd@grem.de designates 213.239.217.29 as permitted sender) smtp.mailfrom=freebsd@grem.de X-Spamd-Result: default: False [-2.27 / 15.00]; TO_DN_EQ_ADDR_SOME(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:213.239.217.29/32]; MV_CASE(0.50)[]; URI_COUNT_ODD(1.00)[27]; RCVD_COUNT_THREE(0.00)[3]; DKIM_TRACE(0.00)[grem.de:+]; FREEMAIL_TO(0.00)[hotmail.com]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; IP_SCORE(-1.27)[ip: (-4.78), ipnet: 213.239.192.0/18(-0.05), asn: 24940(-1.50), country: DE(-0.02)]; ASN(0.00)[asn:24940, ipnet:213.239.192.0/18, country:DE]; MID_RHS_MATCH_FROM(0.00)[]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; R_DKIM_ALLOW(-0.20)[grem.de:s=20180501]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; TAGGED_RCPT(0.00)[]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; DMARC_NA(0.00)[grem.de]; TO_MATCH_ENVRCPT_SOME(0.00)[]; FREEMAIL_CC(0.00)[gmail.com]; RCVD_TLS_ALL(0.00)[] Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.30 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.30 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 06 May 2020 00:12:20 -0000 You might want to read https://blog.grem.de/ayvn It also covers using vm-bhyve to manage vms and will explain some things abo= ut configuring the network. > On 6. May 2020, at 01:55, Brandon helsley wr= ote: >=20 > =EF=BB=BFWell how do i add a tap to the bridge the VM is on as well as my p= hysical nic >=20 > Sent from Outlook Mobile >=20 > ________________________________ > From: Aryeh Friedman > Sent: Tuesday, May 5, 2020 5:02:50 PM > To: Brandon helsley > Cc: freebsd-virtualization@freebsd.org ; Robert Crowston > Subject: Re: Bhyve help >=20 > When setting up a VM you also need to add the tap it is on to the bridge a= s well your physical NIC >=20 > On Tue, May 5, 2020 at 6:28 PM Brandon helsley > wrote: > Bhyve gets me to Network installation: "some installation files were not f= ound on the boot volume. The next few screens will allow you to configure ne= tworking so that they can be downloaded from the internet." This happens aft= er system components. >=20 > Sent from Outlook Mobile > ________________________________ > From: Aryeh Friedman > > Sent: Tuesday, May 5, 2020 4:08:10 AM > To: Brandon helsley > > Cc: freebsd-virtualization@freebsd.org >; Robert Crowston > > Subject: Re: Bhyve help >=20 >=20 >=20 > On Tue, May 5, 2020 at 6:00 AM Brandon helsley > wrote: > The handbook only says vmm doesn't it. I got bhyve to start without virtio= kernel module as well as the if_tap but with vmm modules. >=20 > The handbook section on virtualization (FreeBSD host) is at best awful and= misleading your best guide is the bhyve man page (especially the examples t= here) here is the modules I load for the same set up I recommended you try a= s a advanced beginners lesson in virtualization and networking. And an exa= mple script for using them: >=20 > /boot/loader.conf: >=20 > kern.geom.label.disk_ident.enable=3D"0" > kern.geom.label.gptid.enable=3D"0" > opensolaris_load=3D"YES" > zfs_load=3D"YES" > ipfw_load=3D"YES" > ipdivert_load=3D"YES" > linux_load=3D"YES" >=20 > In the real /boot/loader.conf the following are commented out because Peti= teCloud takes care of them when it loads but unless you want to get into mor= e advanced stuff (like how to install non-standard ports) you should uncomme= nt them. >=20 > vmm_load=3D"YES" > if_tap_load=3D"YES" > nmdm_load=3D"YES" >=20 > The script to load the file server VM: >=20 > #!/bin/sh > # > # Generated by PetiteCloud 0.2.6 > # >=20 > ifconfig tap12 destroy > ifconfig tap12 create > ifconfig tap12 up > sleep 5 > ifconfig bridge0 addm tap12 up > bhyvectl --destroy --vm=3Db829e56e9b4289a1 > /usr/sbin/bhyve -c cores=3D4 -m 4096 -AI -H -P -w -g 0 -s 0:0,hostbridge -= s 1,virtio-net,tap12 -s 2,ahci-hd,/vms/import/win10 -s 29,fbuf,tcp=3D0.0.0.= 0:5912,w=3D1920,h=3D1080 -s 30,xhci,tablet -s 31,lpc -= l com1,/dev/nmdm12B -l bootrom,/usr/local/share/uefi-firmware/BHYVE_UEFI.fd b= 829e56e9b4289a1&>/dev/null > echo $!>/var/run/petitecloud/b829e56e9b4289a1 > sleep 10 >=20 > I'm at this screen:please choose the appropriate terminal type for your sy= stem.common console types are: ansi, vt100, xterm, cons25w. >=20 > Console type [vt100]: >=20 > Sent from Outlook Mobile > ________________________________ > From: Aryeh Friedman > > Sent: Tuesday, May 5, 2020 3:52:26 AM > To: Brandon helsley > > Cc: freebsd-virtualization@freebsd.org >; Robert Crowston > > Subject: Re: Bhyve help >=20 >=20 >=20 > On Tue, May 5, 2020 at 5:21 AM Brandon helsley > wrote: > I have re0 but the ip address is under wlan0 with my CenturyLink >=20 > In order to use vtnet and bridging (both required for bhyve networking) yo= u need to load the load the virtio kernel module as well as the if_tap and v= mm modules (the first one provides the host side of the virtual NIC and the s= econd loads the hypervisor components) >=20 > Sent from Outlook Mobile >=20 > ________________________________ > From: Robert Crowston > > Sent: Tuesday, May 5, 2020 3:14:43 AM > To: Brandon helsley >; freebsd-virtualization@freebsd.org > > Subject: Re: Bhyve help >=20 > What are your network interfaces called on your machine? You probably have= to change igb0 in the example to em0 (an Intel card) or re0 (a Realtek card= ). Type =E2=80=9Cifconfig=E2=80=9D to list all the interfaces, and look for o= nes with an ip address to figure it out. >=20 > On Tue, May 5, 2020 at 10:10, Brandon helsley >> wrote: > I'm trying to set up bhyve like the example to learn and when doing the ph= ysical interface interface get the result no such file or directory the comm= and is: >=20 > ifconfig bridge0 addm igb0 addm tap0 >=20 > "In this example, the physical interface is igb0" >=20 >=20 > Sent from Outlook Mobile > _______________________________________________ > freebsd-virtualization@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > To unsubscribe, send any mail to "freebsd-virtualization-unsubscribe@freeb= sd.org" >=20 >=20 > _______________________________________________ > freebsd-virtualization@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > To unsubscribe, send any mail to "freebsd-virtualization-unsubscribe@freeb= sd.org" >=20 >=20 > -- > Aryeh M. Friedman, Lead Developer, http://www.PetiteCloud.org >=20 >=20 > -- > Aryeh M. Friedman, Lead Developer, http://www.PetiteCloud.org >=20 >=20 > -- > Aryeh M. Friedman, Lead Developer, http://www.PetiteCloud.org > _______________________________________________ > freebsd-virtualization@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > To unsubscribe, send any mail to "freebsd-virtualization-unsubscribe@freeb= sd.org" From owner-freebsd-virtualization@freebsd.org Wed May 6 07:35:51 2020 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 42F25138B33 for ; Wed, 6 May 2020 07:35:51 +0000 (UTC) (envelope-from ml@netfence.it) Received: from soth.netfence.it (net-2-44-121-52.cust.vodafonedsl.it [2.44.121.52]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "mailserver.netfence.it", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49H7gB0NWyz4F2n for ; Wed, 6 May 2020 07:35:49 +0000 (UTC) (envelope-from ml@netfence.it) Received: from alamar.ventu (alamar.local.netfence.it [10.1.2.18]) (authenticated bits=0) by soth.netfence.it (8.15.2/8.15.2) with ESMTPSA id 0467ZcgA078351 (version=TLSv1.3 cipher=TLS_AES_128_GCM_SHA256 bits=128 verify=NO); Wed, 6 May 2020 09:35:40 +0200 (CEST) (envelope-from ml@netfence.it) X-Authentication-Warning: soth.netfence.it: Host alamar.local.netfence.it [10.1.2.18] claimed to be alamar.ventu Subject: Re: bhyve win-guest benchmark comparing To: Jason Tubnor , FreeBSD virtualization References: <9e7f4c01-6cd1-4045-1a5b-69c804b3881b@omnilan.de> <20200419172345.Horde.alwm2Bn67wrcUt5a0zVjQ9f@app.eeeit.de> <69553fba-4ee5-67dc-a052-b58bb8100061@netfence.it> <20200420090934.d6gkjg5er5ij36d2@nexus.home.palmen-it.de> From: Andrea Venturoli Message-ID: <93773166-888d-c1cc-007e-d51b432a6d8a@netfence.it> Date: Wed, 6 May 2020 09:35:38 +0200 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:68.0) Gecko/20100101 Thunderbird/68.7.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 49H7gB0NWyz4F2n X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=pass (policy=none) header.from=netfence.it; spf=pass (mx1.freebsd.org: domain of ml@netfence.it designates 2.44.121.52 as permitted sender) smtp.mailfrom=ml@netfence.it X-Spamd-Result: default: False [-4.71 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:2.44.121.52]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; HAS_XAW(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[netfence.it,none]; IP_SCORE(-1.91)[ip: (-8.91), ipnet: 2.44.0.0/16(-4.45), asn: 30722(3.79), country: IT(0.03)]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:30722, ipnet:2.44.0.0/16, country:IT]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_TLS_ALL(0.00)[]; RCVD_COUNT_TWO(0.00)[2] X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.30 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 06 May 2020 07:35:51 -0000 On 2020-04-20 12:06, Jason Tubnor wrote: > On Mon., 20 Apr. 2020, 7:09 pm Felix Palmen, wrote: > >> >>> Xeon are not affected, since they have vAPIC, so they should be already >>> running as fast as possible. Correct? >> >> I don't know the details, but on my Xeon E3-1240L v5, it did have a huge >> effect. I confirm this made a huge effect on a Xeon E3-1220, while it (obviously) made no difference on a Ryzen 7 2700. I'll try this ASAP on a Core i5-9400 and a Core(TM) i5-7400 :) bye & Thanks av. From owner-freebsd-virtualization@freebsd.org Wed May 6 21:08:03 2020 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id ED4102DFA45 for ; Wed, 6 May 2020 21:08:03 +0000 (UTC) (envelope-from akgupt3@gmail.com) Received: from mail-wr1-x431.google.com (mail-wr1-x431.google.com [IPv6:2a00:1450:4864:20::431]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49HThL4T4lz4Bpp for ; Wed, 6 May 2020 21:08:02 +0000 (UTC) (envelope-from akgupt3@gmail.com) Received: by mail-wr1-x431.google.com with SMTP id w7so3011298wre.13 for ; Wed, 06 May 2020 14:08:02 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=+yo7Xbg+TPeNxLXVwBG8tRsZQh17TBSB6VKk3S/261w=; b=YtwqlQvLHh69RCjWAMfijWKqm47/bbiZQ5/R5DAyAx0o1GdZy6ElRDTusDmgBLCDNh 7t2e7oqa9L70d4yNl3556Id3vwk/DjGiJkAYC38zDWUsQ9vqYsA/Sj20donNvhK7qIrO Ha39nWOMBt8OhkxjCIQ4Dk6MAllPY5XP040Aun1eyIUhhxOREbYUr8K1BPaI68jg5ZPl bTnTHmWKlMQcKttG0+V1KOEbwexF89t5F+VOE+3xp9QdnQuw7ZOF98yt1+grLFw1+7Oz A6N3WFlwfJcZUAvDfHVot9vOCi3sHgebIMEvcHLhAX+++AaFyMOQ4W1Nnk4Sf7POkRhs 1LAA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=+yo7Xbg+TPeNxLXVwBG8tRsZQh17TBSB6VKk3S/261w=; b=G5MtY/eyjPVNoQyxeMEScD5DClDBsha/VCo+/plEKsxM0yJDnXOLC/wlo8vi5any7p M5gmdyaNn6S2KMytdQ7gfeBstekL0w94zPbyzJRs2oSzh9UN49FGWce/EDrwjFRQePY8 LUA+E7sY9aEhBjZBKNGYR+A4Xlv/FGSYcBif8a8pdr7ZfHKz1HRUmeVj/aUFokT1P/k6 sSYssxk40cm8Pbu+WbHTke2Q4zFzqlY103qGBFQEISRk/g5NfVLMtqeZw100H93zFVCO b0oYVkPTpTm+mY0N6H5g9Ajww7hkmfkwl823rhwwdtFbQFkhqX1cYF2m4HzKuR3Jjoo4 lyGA== X-Gm-Message-State: AGi0PuadrQ2Lg3QRL0KbB+2L1BcXfaX7O2xHaOIi8eY6XGvCqbrmVDd9 5Viw3h228RzEzrDas0S6vozfU006TvOt8jOHjPHkLmXd+UA= X-Google-Smtp-Source: APiQypL4PY2eUHYb89Cg5cu7p2RaIdocV0Viq0g6qt4VSMzm6Nr8RB8RGiSRlxed5zlzLKF8HHoQcm+TjZThWPN6wqk= X-Received: by 2002:a5d:4284:: with SMTP id k4mr11396570wrq.284.1588799279851; Wed, 06 May 2020 14:07:59 -0700 (PDT) MIME-Version: 1.0 References: <9e7f4c01-6cd1-4045-1a5b-69c804b3881b@omnilan.de> <20200419172345.Horde.alwm2Bn67wrcUt5a0zVjQ9f@app.eeeit.de> <69553fba-4ee5-67dc-a052-b58bb8100061@netfence.it> <20200420090934.d6gkjg5er5ij36d2@nexus.home.palmen-it.de> <93773166-888d-c1cc-007e-d51b432a6d8a@netfence.it> In-Reply-To: <93773166-888d-c1cc-007e-d51b432a6d8a@netfence.it> From: Anish Date: Wed, 6 May 2020 14:07:48 -0700 Message-ID: Subject: Re: bhyve win-guest benchmark comparing To: Andrea Venturoli Cc: Jason Tubnor , FreeBSD virtualization X-Rspamd-Queue-Id: 49HThL4T4lz4Bpp X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=YtwqlQvL; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of akgupt3@gmail.com designates 2a00:1450:4864:20::431 as permitted sender) smtp.mailfrom=akgupt3@gmail.com X-Spamd-Result: default: False [-2.00 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36]; FREEMAIL_FROM(0.00)[gmail.com]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-virtualization@freebsd.org]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; IP_SCORE_FREEMAIL(0.00)[]; URI_COUNT_ODD(1.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; RCVD_IN_DNSWL_NONE(0.00)[1.3.4.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.5.4.1.0.0.a.2.list.dnswl.org : 127.0.5.0]; IP_SCORE(0.00)[ip: (-9.00), ipnet: 2a00:1450::/32(-2.30), asn: 15169(-0.43), country: US(-0.05)]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com.dwl.dnswl.org : 127.0.5.0] Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.30 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.30 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 06 May 2020 21:08:04 -0000 > confirm this made a huge effect on a Xeon E3-1220, while it (obviously) made no difference on a Ryzen 7 2700. Bhyve is missing support for AMD AVIC, which is interrupt h/w assist similar to Intel vAPIC. AVIC I think is available only in Ryzen gen1. It is on my TODO list. -Anish On Wed, May 6, 2020 at 12:35 AM Andrea Venturoli wrote: > On 2020-04-20 12:06, Jason Tubnor wrote: > > On Mon., 20 Apr. 2020, 7:09 pm Felix Palmen, wrote: > > > >> > >>> Xeon are not affected, since they have vAPIC, so they should be already > >>> running as fast as possible. Correct? > >> > >> I don't know the details, but on my Xeon E3-1240L v5, it did have a huge > >> effect. > > I confirm this made a huge effect on a Xeon E3-1220, while it > (obviously) made no difference on a Ryzen 7 2700. > > I'll try this ASAP on a Core i5-9400 and a Core(TM) i5-7400 :) > > bye & Thanks > av. > _______________________________________________ > freebsd-virtualization@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > To unsubscribe, send any mail to " > freebsd-virtualization-unsubscribe@freebsd.org" > From owner-freebsd-virtualization@freebsd.org Thu May 7 08:43:18 2020 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id E3C6D13E018 for ; Thu, 7 May 2020 08:43:18 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 49Hn6Z39Tsz3Kn5 for ; Thu, 7 May 2020 08:43:18 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 6CD5113E017; Thu, 7 May 2020 08:43:18 +0000 (UTC) Delivered-To: virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 6C9CB13E016 for ; Thu, 7 May 2020 08:43:18 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49Hn6Z2Jrsz3Kn4 for ; Thu, 7 May 2020 08:43:18 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits)) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4ADEDE41D for ; Thu, 7 May 2020 08:43:18 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 0478hIxf088376 for ; Thu, 7 May 2020 08:43:18 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 0478hIBW088375 for virtualization@FreeBSD.org; Thu, 7 May 2020 08:43:18 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 246168] Ubuntu 20.04 KVM / QEMU Failure with nested FreeBSD bhyve Date: Thu, 07 May 2020 08:43:18 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bhyve X-Bugzilla-Version: 12.1-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: grehan@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.30 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 07 May 2020 08:43:19 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D246168 --- Comment #8 from Peter Grehan --- I was able to get this working fine, and the cause of the problem is clear looking back at the posted logs. <> # ls FreeBSD-11.2-RELEASE-amd64-bootonly.iso FreeBSD-12.1-RELEASE-amd64-dvd1.iso= =20=20=20=20 bee-hd1-01.img # /usr/sbin/bhyve -c 2 -m 2048 -H -A -s 0:0,hostbridge -s 1:0,lpc -s 2:0,e1000,tap0 -s 3:0,ahci-hd,bee-hd1-01.img -l com1,stdio -s 5:0,ahci-cd,./FreeBSD-12.1-RELEASE-amd64-dvd1.iso bee bhyve has to be started with either a UEFI ROM image, or using a separate loader (bhyveload/grub-bhyve). This wasn't done in this case, which will re= sult in registers partly set to power-on state, which will result in a triple-fa= ult or some other error. This can be seen in the register dump from KVM, where all the GP registers = are zero including the RIP. The fix to run a FreeBSD guest is to use bhyveload before running bhyve. For the example given, this would be # /usr/sbin/bhyveload -m 2048 -d ./FreeBSD-12.1-RELEASE-amd64-dvd1.iso bee ... and then run the bhyve command. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-virtualization@freebsd.org Thu May 7 11:28:49 2020 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id B5A782C46FB for ; Thu, 7 May 2020 11:28:49 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 49HrnX34g2z429B for ; Thu, 7 May 2020 11:28:48 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id BB0D22C46FA; Thu, 7 May 2020 11:28:47 +0000 (UTC) Delivered-To: virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id B6D5B2C46F8 for ; Thu, 7 May 2020 11:28:47 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49HrnV6s6pz428T for ; Thu, 7 May 2020 11:28:46 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits)) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 719DF183C6 for ; Thu, 7 May 2020 11:28:46 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 047BSkPC034333 for ; Thu, 7 May 2020 11:28:46 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 047BSkK5034332 for virtualization@FreeBSD.org; Thu, 7 May 2020 11:28:46 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 225791] ena driver causing kernel panics on AWS EC2 Date: Thu, 07 May 2020 11:28:45 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.1-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: commit-hook@freebsd.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.30 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 07 May 2020 11:28:50 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D225791 --- Comment #36 from commit-hook@freebsd.org --- A commit references this bug: Author: mw Date: Thu May 7 11:28:40 UTC 2020 New revision: 360777 URL: https://svnweb.freebsd.org/changeset/base/360777 Log: Optimize ENA Rx refill for low memory conditions Sometimes, especially when there is not much memory in the system left, allocating mbuf jumbo clusters (like 9KB or 16KB) can take a lot of time and it is not guaranteed that it'll succeed. In that situation, the fallback will work, but if the refill needs to take a place for a lot of descriptors at once, the time spent in m_getjcl looking for memory can cause system unresponsiveness due to high priority of the Rx task. This can also lead to driver reset, because Tx cleanup routine is being blocked and timer service could detect that Tx packets aren't cleaned up. The reset routine can further create another unresponsiveness - Rx rings are being refilled there, so m_getjcl will again burn the CPU. This was causing NVMe driver timeouts and resets, because network driver is having higher priority. Instead of 16KB jumbo clusters for the Rx buffers, 9KB clusters are enough - ENA MTU is being set to 9K anyway, so it's very unlikely that more space than 9KB will be needed. However, 9KB jumbo clusters can still cause issues, so by default the page size mbuf cluster will be used for the Rx descriptors. This can have= a small (~2%) impact on the throughput of the device, so to restore original behavior, one must change sysctl "hw.ena.enable_9k_mbufs" to "1" in "/boot/loader.conf" file. As a part of this patch (important fix), the version of the driver was updated to v2.1.2. Submitted by: cperciva Reviewed by: Michal Krawczyk Reviewed by: Ido Segev Reviewed by: Guy Tzalik MFC after: 3 days PR: 225791, 234838, 235856, 236989, 243531 Differential Revision: https://reviews.freebsd.org/D24546 Changes: head/sys/dev/ena/ena.c head/sys/dev/ena/ena.h head/sys/dev/ena/ena_sysctl.c head/sys/dev/ena/ena_sysctl.h --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-virtualization@freebsd.org Thu May 7 11:28:53 2020 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 06B6B2C4731 for ; Thu, 7 May 2020 11:28:53 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 49Hrnc5JM2z42Cs for ; Thu, 7 May 2020 11:28:52 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 96F852C4720; Thu, 7 May 2020 11:28:52 +0000 (UTC) Delivered-To: virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 96A5A2C471F for ; Thu, 7 May 2020 11:28:52 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49Hrnc02MPz42Cd for ; Thu, 7 May 2020 11:28:51 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits)) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 60F56183D9 for ; Thu, 7 May 2020 11:28:51 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 047BSpXg034530 for ; Thu, 7 May 2020 11:28:51 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 047BSp3S034529 for virtualization@FreeBSD.org; Thu, 7 May 2020 11:28:51 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 234838] ena drop-outs on 12.0-RELEASE Date: Thu, 07 May 2020 11:28:50 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 12.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: commit-hook@freebsd.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.30 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 07 May 2020 11:28:53 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D234838 --- Comment #22 from commit-hook@freebsd.org --- A commit references this bug: Author: mw Date: Thu May 7 11:28:40 UTC 2020 New revision: 360777 URL: https://svnweb.freebsd.org/changeset/base/360777 Log: Optimize ENA Rx refill for low memory conditions Sometimes, especially when there is not much memory in the system left, allocating mbuf jumbo clusters (like 9KB or 16KB) can take a lot of time and it is not guaranteed that it'll succeed. In that situation, the fallback will work, but if the refill needs to take a place for a lot of descriptors at once, the time spent in m_getjcl looking for memory can cause system unresponsiveness due to high priority of the Rx task. This can also lead to driver reset, because Tx cleanup routine is being blocked and timer service could detect that Tx packets aren't cleaned up. The reset routine can further create another unresponsiveness - Rx rings are being refilled there, so m_getjcl will again burn the CPU. This was causing NVMe driver timeouts and resets, because network driver is having higher priority. Instead of 16KB jumbo clusters for the Rx buffers, 9KB clusters are enough - ENA MTU is being set to 9K anyway, so it's very unlikely that more space than 9KB will be needed. However, 9KB jumbo clusters can still cause issues, so by default the page size mbuf cluster will be used for the Rx descriptors. This can have= a small (~2%) impact on the throughput of the device, so to restore original behavior, one must change sysctl "hw.ena.enable_9k_mbufs" to "1" in "/boot/loader.conf" file. As a part of this patch (important fix), the version of the driver was updated to v2.1.2. Submitted by: cperciva Reviewed by: Michal Krawczyk Reviewed by: Ido Segev Reviewed by: Guy Tzalik MFC after: 3 days PR: 225791, 234838, 235856, 236989, 243531 Differential Revision: https://reviews.freebsd.org/D24546 Changes: head/sys/dev/ena/ena.c head/sys/dev/ena/ena.h head/sys/dev/ena/ena_sysctl.c head/sys/dev/ena/ena_sysctl.h --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-virtualization@freebsd.org Thu May 7 11:28:55 2020 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 2E4A92C475B for ; Thu, 7 May 2020 11:28:55 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 49Hrnf5qCnz42F4 for ; Thu, 7 May 2020 11:28:54 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id C33902C474C; Thu, 7 May 2020 11:28:54 +0000 (UTC) Delivered-To: virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id AE9152C474B for ; Thu, 7 May 2020 11:28:54 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49Hrnf48JGz42Dr for ; Thu, 7 May 2020 11:28:54 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits)) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 8481B183E7 for ; Thu, 7 May 2020 11:28:54 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 047BSshY034677 for ; Thu, 7 May 2020 11:28:54 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 047BSsbk034676 for virtualization@FreeBSD.org; Thu, 7 May 2020 11:28:54 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 243531] Unstable ena and nvme on AWS Date: Thu, 07 May 2020 11:28:54 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 12.1-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: commit-hook@freebsd.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.30 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 07 May 2020 11:28:55 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D243531 --- Comment #11 from commit-hook@freebsd.org --- A commit references this bug: Author: mw Date: Thu May 7 11:28:41 UTC 2020 New revision: 360777 URL: https://svnweb.freebsd.org/changeset/base/360777 Log: Optimize ENA Rx refill for low memory conditions Sometimes, especially when there is not much memory in the system left, allocating mbuf jumbo clusters (like 9KB or 16KB) can take a lot of time and it is not guaranteed that it'll succeed. In that situation, the fallback will work, but if the refill needs to take a place for a lot of descriptors at once, the time spent in m_getjcl looking for memory can cause system unresponsiveness due to high priority of the Rx task. This can also lead to driver reset, because Tx cleanup routine is being blocked and timer service could detect that Tx packets aren't cleaned up. The reset routine can further create another unresponsiveness - Rx rings are being refilled there, so m_getjcl will again burn the CPU. This was causing NVMe driver timeouts and resets, because network driver is having higher priority. Instead of 16KB jumbo clusters for the Rx buffers, 9KB clusters are enough - ENA MTU is being set to 9K anyway, so it's very unlikely that more space than 9KB will be needed. However, 9KB jumbo clusters can still cause issues, so by default the page size mbuf cluster will be used for the Rx descriptors. This can have= a small (~2%) impact on the throughput of the device, so to restore original behavior, one must change sysctl "hw.ena.enable_9k_mbufs" to "1" in "/boot/loader.conf" file. As a part of this patch (important fix), the version of the driver was updated to v2.1.2. Submitted by: cperciva Reviewed by: Michal Krawczyk Reviewed by: Ido Segev Reviewed by: Guy Tzalik MFC after: 3 days PR: 225791, 234838, 235856, 236989, 243531 Differential Revision: https://reviews.freebsd.org/D24546 Changes: head/sys/dev/ena/ena.c head/sys/dev/ena/ena.h head/sys/dev/ena/ena_sysctl.c head/sys/dev/ena/ena_sysctl.h --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-virtualization@freebsd.org Thu May 7 11:28:54 2020 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 397142C4746 for ; Thu, 7 May 2020 11:28:54 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 49Hrnd5wq4z42DV for ; Thu, 7 May 2020 11:28:53 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id C64722C473D; Thu, 7 May 2020 11:28:53 +0000 (UTC) Delivered-To: virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id C48A42C473C for ; Thu, 7 May 2020 11:28:53 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49Hrnd4GBhz42DK for ; Thu, 7 May 2020 11:28:53 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits)) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 82FB0183E5 for ; Thu, 7 May 2020 11:28:53 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 047BSrUW034646 for ; Thu, 7 May 2020 11:28:53 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 047BSrlT034643 for virtualization@FreeBSD.org; Thu, 7 May 2020 11:28:53 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 236989] AWS EC2 lockups "Missing interrupt" Date: Thu, 07 May 2020 11:28:52 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 12.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: commit-hook@freebsd.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.30 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 07 May 2020 11:28:54 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D236989 --- Comment #20 from commit-hook@freebsd.org --- A commit references this bug: Author: mw Date: Thu May 7 11:28:41 UTC 2020 New revision: 360777 URL: https://svnweb.freebsd.org/changeset/base/360777 Log: Optimize ENA Rx refill for low memory conditions Sometimes, especially when there is not much memory in the system left, allocating mbuf jumbo clusters (like 9KB or 16KB) can take a lot of time and it is not guaranteed that it'll succeed. In that situation, the fallback will work, but if the refill needs to take a place for a lot of descriptors at once, the time spent in m_getjcl looking for memory can cause system unresponsiveness due to high priority of the Rx task. This can also lead to driver reset, because Tx cleanup routine is being blocked and timer service could detect that Tx packets aren't cleaned up. The reset routine can further create another unresponsiveness - Rx rings are being refilled there, so m_getjcl will again burn the CPU. This was causing NVMe driver timeouts and resets, because network driver is having higher priority. Instead of 16KB jumbo clusters for the Rx buffers, 9KB clusters are enough - ENA MTU is being set to 9K anyway, so it's very unlikely that more space than 9KB will be needed. However, 9KB jumbo clusters can still cause issues, so by default the page size mbuf cluster will be used for the Rx descriptors. This can have= a small (~2%) impact on the throughput of the device, so to restore original behavior, one must change sysctl "hw.ena.enable_9k_mbufs" to "1" in "/boot/loader.conf" file. As a part of this patch (important fix), the version of the driver was updated to v2.1.2. Submitted by: cperciva Reviewed by: Michal Krawczyk Reviewed by: Ido Segev Reviewed by: Guy Tzalik MFC after: 3 days PR: 225791, 234838, 235856, 236989, 243531 Differential Revision: https://reviews.freebsd.org/D24546 Changes: head/sys/dev/ena/ena.c head/sys/dev/ena/ena.h head/sys/dev/ena/ena_sysctl.c head/sys/dev/ena/ena_sysctl.h --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-virtualization@freebsd.org Thu May 7 11:28:56 2020 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 4C1502C4785 for ; Thu, 7 May 2020 11:28:56 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 49Hrnh0hm2z42Fg for ; Thu, 7 May 2020 11:28:56 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 136F72C4783; Thu, 7 May 2020 11:28:56 +0000 (UTC) Delivered-To: virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 130332C4782 for ; Thu, 7 May 2020 11:28:56 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49Hrng52DPz42FS for ; Thu, 7 May 2020 11:28:55 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits)) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 9E4F3183EA for ; Thu, 7 May 2020 11:28:55 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 047BStsc034694 for ; Thu, 7 May 2020 11:28:55 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 047BStax034693 for virtualization@FreeBSD.org; Thu, 7 May 2020 11:28:55 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 235856] FreeBSD freezes on AWS EC2 t3 machines Date: Thu, 07 May 2020 11:28:55 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 12.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: commit-hook@freebsd.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.30 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 07 May 2020 11:28:56 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D235856 --- Comment #55 from commit-hook@freebsd.org --- A commit references this bug: Author: mw Date: Thu May 7 11:28:41 UTC 2020 New revision: 360777 URL: https://svnweb.freebsd.org/changeset/base/360777 Log: Optimize ENA Rx refill for low memory conditions Sometimes, especially when there is not much memory in the system left, allocating mbuf jumbo clusters (like 9KB or 16KB) can take a lot of time and it is not guaranteed that it'll succeed. In that situation, the fallback will work, but if the refill needs to take a place for a lot of descriptors at once, the time spent in m_getjcl looking for memory can cause system unresponsiveness due to high priority of the Rx task. This can also lead to driver reset, because Tx cleanup routine is being blocked and timer service could detect that Tx packets aren't cleaned up. The reset routine can further create another unresponsiveness - Rx rings are being refilled there, so m_getjcl will again burn the CPU. This was causing NVMe driver timeouts and resets, because network driver is having higher priority. Instead of 16KB jumbo clusters for the Rx buffers, 9KB clusters are enough - ENA MTU is being set to 9K anyway, so it's very unlikely that more space than 9KB will be needed. However, 9KB jumbo clusters can still cause issues, so by default the page size mbuf cluster will be used for the Rx descriptors. This can have= a small (~2%) impact on the throughput of the device, so to restore original behavior, one must change sysctl "hw.ena.enable_9k_mbufs" to "1" in "/boot/loader.conf" file. As a part of this patch (important fix), the version of the driver was updated to v2.1.2. Submitted by: cperciva Reviewed by: Michal Krawczyk Reviewed by: Ido Segev Reviewed by: Guy Tzalik MFC after: 3 days PR: 225791, 234838, 235856, 236989, 243531 Differential Revision: https://reviews.freebsd.org/D24546 Changes: head/sys/dev/ena/ena.c head/sys/dev/ena/ena.h head/sys/dev/ena/ena_sysctl.c head/sys/dev/ena/ena_sysctl.h --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-virtualization@freebsd.org Thu May 7 12:00:44 2020 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id AB0062C622A for ; Thu, 7 May 2020 12:00:44 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 49HsVN4B6nz44wD for ; Thu, 7 May 2020 12:00:44 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 8F74D2C6221; Thu, 7 May 2020 12:00:44 +0000 (UTC) Delivered-To: virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 8F3062C6220 for ; Thu, 7 May 2020 12:00:44 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49HsVN3MLNz44wB for ; Thu, 7 May 2020 12:00:44 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits)) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 6EE1D189F9 for ; Thu, 7 May 2020 12:00:44 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 047C0ig5014516 for ; Thu, 7 May 2020 12:00:44 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 047C0iUi014513 for virtualization@FreeBSD.org; Thu, 7 May 2020 12:00:44 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 236989] AWS EC2 lockups "Missing interrupt" Date: Thu, 07 May 2020 12:00:44 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 12.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: cao@bus.net X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.30 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 07 May 2020 12:00:44 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D236989 --- Comment #21 from Charles O'Donnell --- Colin, At this point we are at 10 days uptime. Below are select excerpts from vmst= at logging. It appears to follow the path you predicted. I can attach the full hourly log if it is of interest. Best. DAY 8 (first uptick of=20 =3D=3D=3D> Tue May 5 17:00:00 EDT 2020 mbuf_jumbo_page: 4096, 490945, 0, 31,40308027, 0, 0 mbuf_jumbo_9k: 9216, 145465, 7668, 286,58743917, 7, 0 mbuf_jumbo_16k: 16384, 81824, 0, 0, 0, 0, 0 dev.ena.0.queue7.rx_ring.mjum_alloc_fail: 0 dev.ena.0.queue6.rx_ring.mjum_alloc_fail: 0 dev.ena.0.queue5.rx_ring.mjum_alloc_fail: 0 dev.ena.0.queue4.rx_ring.mjum_alloc_fail: 0 dev.ena.0.queue3.rx_ring.mjum_alloc_fail: 0 dev.ena.0.queue2.rx_ring.mjum_alloc_fail: 0 dev.ena.0.queue1.rx_ring.mjum_alloc_fail: 0 dev.ena.0.queue0.rx_ring.mjum_alloc_fail: 0 DAY 9 =3D=3D=3D> Wed May 6 04:00:00 EDT 2020 mbuf_jumbo_page: 4096, 490945, 97, 446,41133523, 0, 0 mbuf_jumbo_9k: 9216, 145465, 7645, 412,59865306, 9, 0 mbuf_jumbo_16k: 16384, 81824, 0, 0, 0, 0, 0 dev.ena.0.queue7.rx_ring.mjum_alloc_fail: 0 dev.ena.0.queue6.rx_ring.mjum_alloc_fail: 0 dev.ena.0.queue5.rx_ring.mjum_alloc_fail: 0 dev.ena.0.queue4.rx_ring.mjum_alloc_fail: 0 dev.ena.0.queue3.rx_ring.mjum_alloc_fail: 0 dev.ena.0.queue2.rx_ring.mjum_alloc_fail: 0 dev.ena.0.queue1.rx_ring.mjum_alloc_fail: 0 dev.ena.0.queue0.rx_ring.mjum_alloc_fail: 0 =3D=3D=3D> Wed May 6 05:00:00 EDT 2020 mbuf_jumbo_page: 4096, 490945, 367, 449,41875931, 0, 0 mbuf_jumbo_9k: 9216, 145465, 7253, 108,60877108, 241, 0 mbuf_jumbo_16k: 16384, 81824, 0, 0, 0, 0, 0 dev.ena.0.queue7.rx_ring.mjum_alloc_fail: 0 dev.ena.0.queue6.rx_ring.mjum_alloc_fail: 0 dev.ena.0.queue5.rx_ring.mjum_alloc_fail: 0 dev.ena.0.queue4.rx_ring.mjum_alloc_fail: 0 dev.ena.0.queue3.rx_ring.mjum_alloc_fail: 0 dev.ena.0.queue2.rx_ring.mjum_alloc_fail: 0 dev.ena.0.queue1.rx_ring.mjum_alloc_fail: 0 dev.ena.0.queue0.rx_ring.mjum_alloc_fail: 0 =3D=3D=3D> Wed May 6 06:00:00 EDT 2020 mbuf_jumbo_page: 4096, 490945, 34, 41,42115282, 0, 0 mbuf_jumbo_9k: 9216, 145465, 7719, 267,61217632, 243, 0 mbuf_jumbo_16k: 16384, 81824, 0, 0, 0, 0, 0 dev.ena.0.queue7.rx_ring.mjum_alloc_fail: 0 dev.ena.0.queue6.rx_ring.mjum_alloc_fail: 0 dev.ena.0.queue5.rx_ring.mjum_alloc_fail: 0 dev.ena.0.queue4.rx_ring.mjum_alloc_fail: 0 dev.ena.0.queue3.rx_ring.mjum_alloc_fail: 0 dev.ena.0.queue2.rx_ring.mjum_alloc_fail: 0 dev.ena.0.queue1.rx_ring.mjum_alloc_fail: 0 dev.ena.0.queue0.rx_ring.mjum_alloc_fail: 0 DAY 10 =3D=3D=3D> Thu May 7 07:00:00 EDT 2020 mbuf_jumbo_page: 4096, 490945, 0, 65,45067065, 0, 0 mbuf_jumbo_9k: 9216, 145465, 7647, 322,65796230,1640, 0 mbuf_jumbo_16k: 16384, 81824, 0, 0, 0, 0, 0 dev.ena.0.queue7.rx_ring.mjum_alloc_fail: 0 dev.ena.0.queue6.rx_ring.mjum_alloc_fail: 0 dev.ena.0.queue5.rx_ring.mjum_alloc_fail: 0 dev.ena.0.queue4.rx_ring.mjum_alloc_fail: 0 dev.ena.0.queue3.rx_ring.mjum_alloc_fail: 0 dev.ena.0.queue2.rx_ring.mjum_alloc_fail: 0 dev.ena.0.queue1.rx_ring.mjum_alloc_fail: 0 dev.ena.0.queue0.rx_ring.mjum_alloc_fail: 0 --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-virtualization@freebsd.org Thu May 7 12:13:09 2020 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 341642C6C17 for ; Thu, 7 May 2020 12:13:09 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 49Hsmj0hRzz45fw for ; Thu, 7 May 2020 12:13:09 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 177712C6C16; Thu, 7 May 2020 12:13:09 +0000 (UTC) Delivered-To: virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 173E82C6C15 for ; Thu, 7 May 2020 12:13:09 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49Hsmh4k4Mz45fs for ; Thu, 7 May 2020 12:13:08 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits)) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 9D62C18DAE for ; Thu, 7 May 2020 12:13:08 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 047CD8DT058920 for ; Thu, 7 May 2020 12:13:08 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 047CD8nA058911 for virtualization@FreeBSD.org; Thu, 7 May 2020 12:13:08 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 235856] FreeBSD freezes on AWS EC2 t3 machines Date: Thu, 07 May 2020 12:13:08 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 12.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: mail@rubenvos.com X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.30 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 07 May 2020 12:13:09 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D235856 --- Comment #56 from mail@rubenvos.com --- (In reply to Colin Percival from comment #54) Hi Colin, Good to see the problem has been identified, and patched! Our machines have not yet frozen again after applying the patch you mention= ed on 2020-04-02 . Will this commit (360777) be released as an errata (I don't know of a more official term I'm affraid)? I'm asking because I would like to know whether= or not we can switch back to using freebsd-update for implementing the fix or should continue to compile our kernels manually. Regards, Ruben --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-virtualization@freebsd.org Thu May 7 13:48:13 2020 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 62FA72D9C63 for ; Thu, 7 May 2020 13:48:13 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 49HvtP1xR3z4CRP for ; Thu, 7 May 2020 13:48:13 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 428442D9C62; Thu, 7 May 2020 13:48:13 +0000 (UTC) Delivered-To: virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 424682D9C61 for ; Thu, 7 May 2020 13:48:13 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49HvtP16XNz4CRM for ; Thu, 7 May 2020 13:48:13 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits)) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 21AC919F0E for ; Thu, 7 May 2020 13:48:13 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 047DmDF7032696 for ; Thu, 7 May 2020 13:48:13 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 047DmDb4032695 for virtualization@FreeBSD.org; Thu, 7 May 2020 13:48:13 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 236989] AWS EC2 lockups "Missing interrupt" Date: Thu, 07 May 2020 13:48:13 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 12.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: cao@bus.net X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.30 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 07 May 2020 13:48:13 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D236989 --- Comment #22 from Charles O'Donnell --- Addendum to previous post, no downtime or freezes as of yet. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-virtualization@freebsd.org Thu May 7 17:13:52 2020 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id E11362DED61 for ; Thu, 7 May 2020 17:13:52 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 49J0Rh5jzVz4RL7 for ; Thu, 7 May 2020 17:13:52 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id C44552DED60; Thu, 7 May 2020 17:13:52 +0000 (UTC) Delivered-To: virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id C40642DED5F for ; Thu, 7 May 2020 17:13:52 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49J0Rh4rLkz4RL6 for ; Thu, 7 May 2020 17:13:52 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits)) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id A19B21C7E3 for ; Thu, 7 May 2020 17:13:52 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 047HDqgn082394 for ; Thu, 7 May 2020 17:13:52 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 047HDqhu082393 for virtualization@FreeBSD.org; Thu, 7 May 2020 17:13:52 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 236989] AWS EC2 lockups "Missing interrupt" Date: Thu, 07 May 2020 17:13:52 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 12.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: cperciva@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.30 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 07 May 2020 17:13:52 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D236989 --- Comment #23 from Colin Percival --- (In reply to Charles O'Donnell from comment #22) Thanks! We ended up going with a slightly more conservative patch than the= one I provided above (defaulting to 4k buffers rather than switching, since we weren't sure if we could switch fast enough) but your statistics are useful (and confirm the decision to go with the more conservative option -- you ha= ve 1640 failed 9k allocations which will have added some network latency during busy periods). I suggest waiting until we get the Errata Notice out and then switching ove= r to the patch we send out with that. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-virtualization@freebsd.org Thu May 7 17:15:09 2020 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id E4FD52DEDE3 for ; Thu, 7 May 2020 17:15:09 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 49J0T932Ntz4RPk for ; Thu, 7 May 2020 17:15:09 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 6828B2DEDE2; Thu, 7 May 2020 17:15:09 +0000 (UTC) Delivered-To: virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 67F122DEDE1 for ; Thu, 7 May 2020 17:15:09 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49J0T92Bryz4RPj for ; Thu, 7 May 2020 17:15:09 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits)) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 46E9E1C7EE for ; Thu, 7 May 2020 17:15:09 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 047HF9XF084082 for ; Thu, 7 May 2020 17:15:09 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 047HF95u084081 for virtualization@FreeBSD.org; Thu, 7 May 2020 17:15:09 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 235856] FreeBSD freezes on AWS EC2 t3 machines Date: Thu, 07 May 2020 17:15:07 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 12.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: cperciva@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.30 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 07 May 2020 17:15:10 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D235856 --- Comment #57 from Colin Percival --- (In reply to mail from comment #56) Yes, we're planning on doing an Errata Notice for this. I suggest waiting until that comes out, then getting the fix with freebsd-update. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-virtualization@freebsd.org Thu May 7 17:31:01 2020 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 8498C2DF4F2 for ; Thu, 7 May 2020 17:31:01 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 49J0qT2zXbz4SWW for ; Thu, 7 May 2020 17:31:01 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 662F42DF4F1; Thu, 7 May 2020 17:31:01 +0000 (UTC) Delivered-To: virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 65F1F2DF4F0 for ; Thu, 7 May 2020 17:31:01 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49J0qT26bXz4SWV for ; Thu, 7 May 2020 17:31:01 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits)) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 441F51CA0C for ; Thu, 7 May 2020 17:31:01 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 047HV1C6049594 for ; Thu, 7 May 2020 17:31:01 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 047HV1S1049572 for virtualization@FreeBSD.org; Thu, 7 May 2020 17:31:01 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 236989] AWS EC2 lockups "Missing interrupt" Date: Thu, 07 May 2020 17:31:00 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 12.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: cao@bus.net X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.30 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 07 May 2020 17:31:01 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D236989 --- Comment #24 from Charles O'Donnell --- New development. See three notes below. N.B. the system appears to have fully recovered. Normally I would have expe= cted a freeze. 1. CPU alarm from a custom AWS monitor at 16:43 UTC (12:43 PM ET): Alarm Details: - Name: Starch CPU - Description:=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20 - State Change: OK -> ALARM - Reason for State Change: Threshold Crossed: 1 datapoint [31.4 (07/05/20 16:38:00)] was greater than or equal to the threshold (30.0). - Timestamp: Thursday 07 May, 2020 16:43:35 UTC - AWS Account: 539612714288 - Alarm Arn:=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20 arn:aws:cloudwatch:us-east-1:539612714288:alarm:Starch CPU Threshold: - The alarm is in the ALARM state when the metric is GreaterThanOrEqualToThreshold 30.0 for 300 seconds.=20 2. Sudden jump in failed 9k mbufs between 12:00 and 13:00 ET: =3D=3D=3D> Thu May 7 10:00:00 EDT 2020 mbuf_jumbo_page: 4096, 490945, 0, 56,45464111, 0, 0 mbuf_jumbo_9k: 9216, 145465, 7538, 450,66361278,1640, 0 mbuf_jumbo_16k: 16384, 81824, 0, 0, 0, 0, 0 dev.ena.0.queue7.rx_ring.mjum_alloc_fail: 0 dev.ena.0.queue6.rx_ring.mjum_alloc_fail: 0 dev.ena.0.queue5.rx_ring.mjum_alloc_fail: 0 dev.ena.0.queue4.rx_ring.mjum_alloc_fail: 0 dev.ena.0.queue3.rx_ring.mjum_alloc_fail: 0 dev.ena.0.queue2.rx_ring.mjum_alloc_fail: 0 dev.ena.0.queue1.rx_ring.mjum_alloc_fail: 0 dev.ena.0.queue0.rx_ring.mjum_alloc_fail: 0 =3D=3D=3D> Thu May 7 11:00:00 EDT 2020 mbuf_jumbo_page: 4096, 490945, 16, 113,45658689, 0, 0 mbuf_jumbo_9k: 9216, 145465, 7592, 397,66645310,1642, 0 mbuf_jumbo_16k: 16384, 81824, 0, 0, 0, 0, 0 dev.ena.0.queue7.rx_ring.mjum_alloc_fail: 0 dev.ena.0.queue6.rx_ring.mjum_alloc_fail: 0 dev.ena.0.queue5.rx_ring.mjum_alloc_fail: 0 dev.ena.0.queue4.rx_ring.mjum_alloc_fail: 0 dev.ena.0.queue3.rx_ring.mjum_alloc_fail: 0 dev.ena.0.queue2.rx_ring.mjum_alloc_fail: 0 dev.ena.0.queue1.rx_ring.mjum_alloc_fail: 0 dev.ena.0.queue0.rx_ring.mjum_alloc_fail: 0 =3D=3D=3D> Thu May 7 12:00:00 EDT 2020 mbuf_jumbo_page: 4096, 490945, 182, 31,45730287, 0, 0 mbuf_jumbo_9k: 9216, 145465, 7461, 259,66753693,1693, 0 mbuf_jumbo_16k: 16384, 81824, 0, 0, 0, 0, 0 dev.ena.0.queue7.rx_ring.mjum_alloc_fail: 0 dev.ena.0.queue6.rx_ring.mjum_alloc_fail: 0 dev.ena.0.queue5.rx_ring.mjum_alloc_fail: 0 dev.ena.0.queue4.rx_ring.mjum_alloc_fail: 0 dev.ena.0.queue3.rx_ring.mjum_alloc_fail: 0 dev.ena.0.queue2.rx_ring.mjum_alloc_fail: 0 dev.ena.0.queue1.rx_ring.mjum_alloc_fail: 0 dev.ena.0.queue0.rx_ring.mjum_alloc_fail: 0 =3D=3D=3D> Thu May 7 13:00:00 EDT 2020 mbuf_jumbo_page: 4096, 490945, 119, 109,46249719, 0, 0 mbuf_jumbo_9k: 9216, 145465, 7863, 207,67594999,2577, 0 mbuf_jumbo_16k: 16384, 81824, 0, 0, 0, 0, 0 dev.ena.0.queue7.rx_ring.mjum_alloc_fail: 0 dev.ena.0.queue6.rx_ring.mjum_alloc_fail: 0 dev.ena.0.queue5.rx_ring.mjum_alloc_fail: 0 dev.ena.0.queue4.rx_ring.mjum_alloc_fail: 0 dev.ena.0.queue3.rx_ring.mjum_alloc_fail: 0 dev.ena.0.queue2.rx_ring.mjum_alloc_fail: 0 dev.ena.0.queue1.rx_ring.mjum_alloc_fail: 0 dev.ena.0.queue0.rx_ring.mjum_alloc_fail: 0 3: ena0 reset at 12:43 ET: May 7 12:43:19 s4 kernel: ena0: The number of lost tx completion is above = the threshold (129 > 128). Reset the device May 7 12:43:19 s4 kernel: ena0: Trigger reset is on May 7 12:43:19 s4 kernel: ena0: device is going DOWN May 7 12:43:22 s4 kernel: ena0: free uncompleted tx mbuf qid 3 idx 0x319en= a0: free uncompleted tx mbuf qid 7 idx 0x173 May 7 12:43:23 s4 kernel: ena0: ena0: device is going UP May 7 12:43:23 s4 kernel: link is UP May 7 12:45:00 s4 kernel: ena0: The number of lost tx completion is above = the threshold (129 > 128). Reset the device May 7 12:45:00 s4 kernel: ena0: Trigger reset is on May 7 12:45:00 s4 kernel: ena0: device is going DOWN May 7 12:45:04 s4 kernel: ena0: free uncompleted tx mbuf qid 3 idx 0x102 May 7 12:45:04 s4 kernel: ena0: ena0: device is going UP May 7 12:45:04 s4 kernel: link is UP May 7 12:45:26 s4 kernel: ena0: The number of lost tx completion is above = the threshold (129 > 128). Reset the device May 7 12:45:26 s4 kernel: ena0: Trigger reset is on May 7 12:45:26 s4 kernel: ena0: device is going DOWN May 7 12:45:29 s4 kernel: ena0: free uncompleted tx mbuf qid 1 idx 0x3c7en= a0: free uncompleted tx mbuf qid 2 idx 0x2c5ena0: free uncompleted tx mbuf qid 6 idx 0x2abena0: free uncompleted tx mbuf qid 7 idx 0x241 May 7 12:45:30 s4 kernel:=20 May 7 12:45:30 s4 kernel: stray irq265 May 7 12:45:30 s4 kernel: ena0: ena0: device is going UP May 7 12:45:30 s4 kernel: link is UP May 7 12:46:05 s4 kernel: ena0: Keep alive watchdog timeout. May 7 12:46:05 s4 kernel: ena0: Trigger reset is on May 7 12:46:05 s4 kernel: ena0: device is going DOWN May 7 12:46:07 s4 kernel: ena0: free uncompleted tx mbuf qid 1 idx 0x123en= a0: free uncompleted tx mbuf qid 3 idx 0xeeena0: free uncompleted tx mbuf qid 6= idx 0x208 May 7 12:46:08 s4 kernel: ena0: ena0: device is going UP May 7 12:46:08 s4 kernel: link is UP May 7 12:46:36 s4 kernel: ena0: The number of lost tx completion is above = the threshold (129 > 128). Reset the device May 7 12:46:36 s4 kernel: ena0: Trigger reset is on May 7 12:46:36 s4 kernel: ena0: device is going DOWN May 7 12:46:37 s4 kernel: ena0: free uncompleted tx mbuf qid 0 idx 0x2c2en= a0: free uncompleted tx mbuf qid 1 idx 0x135ena0: free uncompleted tx mbuf qid 2 idx 0xeeena0: free uncompleted tx mbuf qid 3 idx 0x373ena0: free uncomplete= d tx mbuf qid 4 idx 0x88ena0: free uncompleted t> May 7 12:46:38 s4 kernel: ena0: ena0: device is going UP May 7 12:46:38 s4 kernel: link is UP --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-virtualization@freebsd.org Thu May 7 17:41:33 2020 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id E60F12DF80B for ; Thu, 7 May 2020 17:41:33 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 49J13d5r3Dz4T8s for ; Thu, 7 May 2020 17:41:33 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id C83E92DF80A; Thu, 7 May 2020 17:41:33 +0000 (UTC) Delivered-To: virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id C80072DF809 for ; Thu, 7 May 2020 17:41:33 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49J13d4npxz4T8n for ; Thu, 7 May 2020 17:41:33 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits)) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 926791CD41 for ; Thu, 7 May 2020 17:41:33 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 047HfXxC078239 for ; Thu, 7 May 2020 17:41:33 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 047HfXLg078238 for virtualization@FreeBSD.org; Thu, 7 May 2020 17:41:33 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 236989] AWS EC2 lockups "Missing interrupt" Date: Thu, 07 May 2020 17:41:33 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 12.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: cperciva@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.30 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 07 May 2020 17:41:34 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D236989 --- Comment #25 from Colin Percival --- Aha! That's exactly the "not switching from 9k to 4k fast enough" case we = were worried about. Good to know that we were justified in going with the more conservative option. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-virtualization@freebsd.org Sat May 9 06:05:41 2020 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 4345F2DD9E3 for ; Sat, 9 May 2020 06:05:41 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 49JxWn155yz4JZh for ; Sat, 9 May 2020 06:05:41 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 2381E2DD9E2; Sat, 9 May 2020 06:05:41 +0000 (UTC) Delivered-To: virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 2344F2DD9E1 for ; Sat, 9 May 2020 06:05:41 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49JxWn08ysz4JZg for ; Sat, 9 May 2020 06:05:41 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits)) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id D6D1CF5D8 for ; Sat, 9 May 2020 06:05:40 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 04965eFY000547 for ; Sat, 9 May 2020 06:05:40 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 04965eQS000523 for virtualization@FreeBSD.org; Sat, 9 May 2020 06:05:40 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 246321] Key press timing/repeat issue on UEFI VNC console for OpenBSD => 6.6 guest Date: Sat, 09 May 2020 06:05:39 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: new X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bhyve X-Bugzilla-Version: Unspecified X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: jason@tubnor.net X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_id short_desc product version rep_platform op_sys bug_status bug_severity priority component assigned_to reporter Message-ID: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.32 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 09 May 2020 06:05:41 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D246321 Bug ID: 246321 Summary: Key press timing/repeat issue on UEFI VNC console for OpenBSD =3D> 6.6 guest Product: Base System Version: Unspecified Hardware: amd64 OS: Any Status: New Severity: Affects Some People Priority: --- Component: bhyve Assignee: virtualization@FreeBSD.org Reporter: jason@tubnor.net When using the UEFI terminal console for an OpenBSD 6.6 or later guest, the= re appears to be some sort of timing issue with the emulated VNC keyboard. Aft= er booting the installer or and installed 6.6/6.7 operating system, a key press can exhibit shorter than usual delay before repeat, therefor echoing more characters than desired into the console as well as an increase in the character repeat per second. Another side affect is the login delay time. This is usually set to 300 sec= onds on a a default install. If you try logging into the console, this delay ti= me reduces to 58 seconds. How to reproduce (this was tested on a variety of hardware including Xeon a= nd Atom based hosts): Using 11.3 to 13-HEAD, configure a bhyve guest and install from miniroot66.= fs or miniroot67.fs https://openbsd.cs.toronto.edu/pub/OpenBSD/6.6/amd64/miniroot66.fs https://openbsd.cs.toronto.edu/pub/OpenBSD/snapshots/amd64/miniroot67.fs Once at the Install/Upgrade prompt, select Shell. Start typing a sentence = as you normally do to see the issue. To replicate the shortened timeout issue on the login prompt, either try to= get the install down with the key press issue, install using miniroot65.fs[1] a= nd then perform a syspatch/sysupgrade to bring it up to 6.6 or install via UEFI-serial and at the OpenBSD boot loader, issue 'set tty com0' to install= via the bhyve serial console. Once installed, type root and the incorrect password. Start a timing device to see the difference between the reported= 300 seconds of timeout and the actual time elapsed. [1] An archive of an older, unsupported OpenBSD 6.5 release can be found he= re:=20 https://mirror.cdn.ar18.org/pub/archive/OpenBSD/6.5/amd64/miniroot65.fs --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-virtualization@freebsd.org Sat May 9 07:42:20 2020 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 25CED2DF805 for ; Sat, 9 May 2020 07:42:20 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 49JzgJ0Gjfz4PPq for ; Sat, 9 May 2020 07:42:20 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 090062DF6FB; Sat, 9 May 2020 07:42:20 +0000 (UTC) Delivered-To: virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 08C202DF6FA for ; Sat, 9 May 2020 07:42:20 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49JzgH6YV4z4PPn for ; Sat, 9 May 2020 07:42:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits)) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id DC7F618763 for ; Sat, 9 May 2020 07:42:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 0497gJ8Z076591 for ; Sat, 9 May 2020 07:42:19 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 0497gJLt076575 for virtualization@FreeBSD.org; Sat, 9 May 2020 07:42:19 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 246168] Ubuntu 20.04 KVM / QEMU Failure with nested FreeBSD bhyve Date: Sat, 09 May 2020 07:42:19 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bhyve X-Bugzilla-Version: 12.1-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: drum@graphica.com.au X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.32 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 09 May 2020 07:42:20 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D246168 --- Comment #9 from John Hartley --- (In reply to Peter Grehan from comment #8) Hi Peter, thanks for reviewing. I have done further testing: A. Running bhyveload first as per your feedback Result: Brings up FreeBSD Loader and then get to "/dev/entropy not found message and closes machine <> # bhyvectl --vm=3Dbee --get-stats > bee-vm-stats-01.txt # cat bee-vm-stats-01.txt=20 vcpu0 stats: number of times in/out was intercepted 0 number of times cpuid was intercepted 0 vm exits due to nested page fault 0 vm exits for instruction emulation 0 number of vm exits for unknown reason 0 number of times astpending at exit 0 number of times idle requested at exit 0 number of vm exits handled in userspace 0 number of times rendezvous pending at exit 0 number of vm exits due to exceptions 0 number of NMIs delivered to vcpu 0 number of ExtINTs delivered to vcpu 0 Resident memory 0 Wired memory 0 vcpu total runtime 0 EOI without any in-service interrupt 0 error interrupts generated by vlapic 0 timer interrupts generated by vlapic 0 corrected machine check interrupts generated by vlapic 0 lvts triggered[0] 0 lvts triggered[1] 0 lvts triggered[2] 0 lvts triggered[3] 0 lvts triggered[4] 0 lvts triggered[5] 0 lvts triggered[6] 0 ipis sent to vcpu[0] 0 ipis sent to vcpu[1] 0 ipis sent to vcpu[2] 0 ipis sent to vcpu[3] 0 ipis sent to vcpu[4] 0 ipis sent to vcpu[5] 0 ipis sent to vcpu[6] 0 ipis sent to vcpu[7] 0 ipis sent to vcpu[8] 0 ipis sent to vcpu[9] 0 ipis sent to vcpu[10] 0 ipis sent to vcpu[11] 0 ipis sent to vcpu[12] 0 ipis sent to vcpu[13] 0 ipis sent to vcpu[14] 0 ipis sent to vcpu[15] 0 number of ticks vcpu was idle 0 vcpu migration across host cpus 0 total number of vm exits 0 vm exits due to external interrupt 0 Number of vpid invalidations saved 0 Number of vpid invalidations done 0 number of times hlt was intercepted 0 number of times %cr access was intercepted 0 number of times rdmsr was intercepted 0 number of times wrmsr was intercepted 0 number of monitor trap exits 0 number of times pause was intercepted 0 vm exits due to interrupt window opening 0 vm exits due to nmi window opening 0 <> This was then followed with invoking Bhyve, as per original posting. This again results in Layer 1 - FreeBSD VM going to pause with same error v= ia Layer 0 - /var/log/libvirt/qemu/VM.log <> char device redirected to /dev/pts/27 (label charserial0) 2020-05-09T06:28:07.870436Z qemu-system-x86_64: warning: host doesn't suppo= rt requested feature: MSR(48FH).vmx-exit-load-perf-global-ctrl [bit 12] 2020-05-09T06:28:07.870499Z qemu-system-x86_64: warning: host doesn't suppo= rt requested feature: MSR(490H).vmx-entry-load-perf-global-ctrl [bit 13] 2020-05-09T06:28:07.872528Z qemu-system-x86_64: warning: host doesn't suppo= rt requested feature: MSR(48FH).vmx-exit-load-perf-global-ctrl [bit 12] 2020-05-09T06:28:07.872543Z qemu-system-x86_64: warning: host doesn't suppo= rt requested feature: MSR(490H).vmx-entry-load-perf-global-ctrl [bit 13] 2020-05-09T06:28:07.873742Z qemu-system-x86_64: warning: host doesn't suppo= rt requested feature: MSR(48FH).vmx-exit-load-perf-global-ctrl [bit 12] 2020-05-09T06:28:07.873757Z qemu-system-x86_64: warning: host doesn't suppo= rt requested feature: MSR(490H).vmx-entry-load-perf-global-ctrl [bit 13] 2020-05-09T06:28:07.874950Z qemu-system-x86_64: warning: host doesn't suppo= rt requested feature: MSR(48FH).vmx-exit-load-perf-global-ctrl [bit 12] 2020-05-09T06:28:07.874964Z qemu-system-x86_64: warning: host doesn't suppo= rt requested feature: MSR(490H).vmx-entry-load-perf-global-ctrl [bit 13] KVM internal error. Suberror: 1 emulation failure EAX=3D00000000 EBX=3D00000000 ECX=3D00000000 EDX=3D00000000 ESI=3D00000000 EDI=3D00000000 EBP=3D00000000 ESP=3D00000000 EIP=3D00000000 EFL=3D00000000 [-------] CPL=3D0 II=3D0 A20=3D1 SMM=3D0 HLT= =3D0 ES =3D0000 00000000 00000000 00008000 DPL=3D0 CS =3D0000 00000000 00000000 00008000 DPL=3D0 SS =3D0000 00000000 00000000 00008000 DPL=3D0 DS =3D0000 00000000 00000000 00008000 DPL=3D0 FS =3D0000 00000000 00000000 00008000 DPL=3D0 GS =3D0000 00000000 00000000 00008000 DPL=3D0 LDT=3D0000 00000000 00000000 00008000 DPL=3D0 TR =3D0000 00000000 00000000 00008000 DPL=3D0 GDT=3D 0000000000000000 00000000 IDT=3D 0000000000000000 00000000 CR0=3D80050033 CR2=3D0000000000000000 CR3=3D0000000000000000 CR4=3D00372060 DR0=3D0000000000000000 DR1=3D0000000000000000 DR2=3D0000000000000000 DR3=3D0000000000000000=20 DR6=3D00000000ffff0ff0 DR7=3D0000000000000400 EFER=3D0000000000000d01 Code=3D ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? = ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? = ?? 2020-05-09T06:42:45.518166Z qemu-system-x86_64: terminating on signal 15 fr= om pid 2119 (/usr/sbin/libvirtd) 2020-05-09 06:42:45.919+0000: shutting down, reason=3Ddestroyed <> B. Running bhyve with UEFI rom rather than BIOS: # bhyve -c 2 -m 2048 -H -A -s 0:0,hostbridge -s 1:0,lpc -s 3:0,ahci-hd,bee-hd1-01.img -l com1,stdio -s 5:0,ahci-cd,./FreeBSD-12.1-RELEASE-amd64-dvd1.iso -l bootrom,/usr/local/share/uefi-firmware/BHYVE_UEFI.fd bee <> $ cd /var/log/libvirt/qemu $ sudo tail -f swarm-bhyve-freebsd.log=20 [sudo] password for XXX:=20 -msg timestamp=3Don char device redirected to /dev/pts/27 (label charserial0) 2020-05-09T07:21:12.156910Z qemu-system-x86_64: warning: host doesn't suppo= rt requested feature: MSR(48FH).vmx-exit-load-perf-global-ctrl [bit 12] 2020-05-09T07:21:12.156975Z qemu-system-x86_64: warning: host doesn't suppo= rt requested feature: MSR(490H).vmx-entry-load-perf-global-ctrl [bit 13] 2020-05-09T07:21:12.158959Z qemu-system-x86_64: warning: host doesn't suppo= rt requested feature: MSR(48FH).vmx-exit-load-perf-global-ctrl [bit 12] 2020-05-09T07:21:12.158973Z qemu-system-x86_64: warning: host doesn't suppo= rt requested feature: MSR(490H).vmx-entry-load-perf-global-ctrl [bit 13] 2020-05-09T07:21:12.160187Z qemu-system-x86_64: warning: host doesn't suppo= rt requested feature: MSR(48FH).vmx-exit-load-perf-global-ctrl [bit 12] 2020-05-09T07:21:12.160201Z qemu-system-x86_64: warning: host doesn't suppo= rt requested feature: MSR(490H).vmx-entry-load-perf-global-ctrl [bit 13] 2020-05-09T07:21:12.161459Z qemu-system-x86_64: warning: host doesn't suppo= rt requested feature: MSR(48FH).vmx-exit-load-perf-global-ctrl [bit 12] 2020-05-09T07:21:12.161471Z qemu-system-x86_64: warning: host doesn't suppo= rt requested feature: MSR(490H).vmx-entry-load-perf-global-ctrl [bit 13] KVM internal error. Suberror: 1 emulation failure EAX=3D00000000 EBX=3D00000000 ECX=3D00000000 EDX=3D00000f00 ESI=3D00000000 EDI=3D00000000 EBP=3D00000000 ESP=3D00000000 EIP=3D00000000 EFL=3D00000000 [-------] CPL=3D0 II=3D0 A20=3D1 SMM=3D0 HLT= =3D0 ES =3D0000 00000000 00000000 00008000 DPL=3D0 CS =3D0000 00000000 00000000 00008000 DPL=3D0 SS =3D0000 00000000 00000000 00008000 DPL=3D0 DS =3D0000 00000000 00000000 00008000 DPL=3D0 FS =3D0000 00000000 00000000 00008000 DPL=3D0 GS =3D0000 00000000 00000000 00008000 DPL=3D0 LDT=3D0000 00000000 00000000 00008000 DPL=3D0 TR =3D0000 00000000 00000000 00008000 DPL=3D0 GDT=3D 0000000000000000 00000000 IDT=3D 0000000000000000 00000000 CR0=3D80050033 CR2=3D0000000000000000 CR3=3D0000000000000000 CR4=3D00372060 DR0=3D0000000000000000 DR1=3D0000000000000000 DR2=3D0000000000000000 DR3=3D0000000000000000=20 DR6=3D00000000ffff0ff0 DR7=3D0000000000000400 EFER=3D0000000000000d01 Code=3D ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? = ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? = ?? 2020-05-09T07:30:48.814754Z qemu-system-x86_64: terminating on signal 15 fr= om pid 2119 (/usr/sbin/libvirtd) 2020-05-09 07:30:49.015+0000: shutting down, reason=3Ddestroyed <> So there must be some variation between my and your setup. I am running test on: Lenovo x3650 M5 Server with 2 x CPU=20 QEMU Q35 V4.2 with OVMF Layer 1 FreeBSD 12.1 VM with 2 x vmxnet3 vNICs (1 for machine access and 1 for tap0 use) Due to bug with FreeBSD 12.1 and QEMU with netmap I have recompiled my Laye= r 1 FreeBSD kernel with "dev netmap" removed. Could you possibly suggest way to get better diagnostics Thanks. Cheers, John Hartley. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-virtualization@freebsd.org Sat May 9 07:53:36 2020 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 0AE852DFACA for ; Sat, 9 May 2020 07:53:36 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 49JzwH6Ww3z4Pmj for ; Sat, 9 May 2020 07:53:35 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id DF9442DFAC9; Sat, 9 May 2020 07:53:35 +0000 (UTC) Delivered-To: virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id DF5C92DFAC8 for ; Sat, 9 May 2020 07:53:35 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49JzwH42Tgz4Pmg for ; Sat, 9 May 2020 07:53:35 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits)) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 85F7C18A6F for ; Sat, 9 May 2020 07:53:35 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 0497rZF8004069 for ; Sat, 9 May 2020 07:53:35 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 0497rZxL004068 for virtualization@FreeBSD.org; Sat, 9 May 2020 07:53:35 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 246321] Key press timing/repeat issue on UEFI VNC console for OpenBSD => 6.6 guest Date: Sat, 09 May 2020 07:53:35 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bhyve X-Bugzilla-Version: Unspecified X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: grehan@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.32 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 09 May 2020 07:53:36 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D246321 Peter Grehan changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |grehan@FreeBSD.org --- Comment #1 from Peter Grehan --- Which VNC clients/versions (and host o/s's) ? --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-virtualization@freebsd.org Sat May 9 09:50:04 2020 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id A919E2E2606 for ; Sat, 9 May 2020 09:50:04 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 49K2Vh45tGz4WTM for ; Sat, 9 May 2020 09:50:04 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 8AEBC2E2605; Sat, 9 May 2020 09:50:04 +0000 (UTC) Delivered-To: virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 8AB0F2E2604 for ; Sat, 9 May 2020 09:50:04 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49K2Vh3Cqsz4WTL for ; Sat, 9 May 2020 09:50:04 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits)) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 69DB519F72 for ; Sat, 9 May 2020 09:50:04 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 0499o4JD093461 for ; Sat, 9 May 2020 09:50:04 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 0499o4CF093460 for virtualization@FreeBSD.org; Sat, 9 May 2020 09:50:04 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 246168] Ubuntu 20.04 KVM / QEMU Failure with nested FreeBSD bhyve Date: Sat, 09 May 2020 09:50:04 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bhyve X-Bugzilla-Version: 12.1-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: grehan@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.32 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 09 May 2020 09:50:04 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D246168 --- Comment #10 from Peter Grehan --- I used a laptop-class CPU when trying the repro (core i5-8250U). In particu= lar, there is a difference in VT-x features as reported by the L1 guest: VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID vs your system: VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID,VID,PostIntr The one of interest here is that KVM is emulating APIC-virtualization (VID,PostIntr). One thing to try is to disable this feature in the L1 guest. In /boot/loader.conf, put an entry=20 hw.vmm.vmx.use_apic_vid=3D0 After (re)booting the L1 guest, the status of this parameter can be checked with: # sysctl hw.vmm.vmx.cap.virtual_interrupt_delivery hw.vmm.vmx.cap.virtual_interrupt_delivery: 0 <- should be zero --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-virtualization@freebsd.org Sat May 9 13:55:03 2020 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 585A02EA684 for ; Sat, 9 May 2020 13:55:03 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 49K7xM1g7bz3Mrq for ; Sat, 9 May 2020 13:55:03 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 3720D2EA683; Sat, 9 May 2020 13:55:03 +0000 (UTC) Delivered-To: virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 36E4E2EA682 for ; Sat, 9 May 2020 13:55:03 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49K7xM0hHYz3Mrn for ; Sat, 9 May 2020 13:55:03 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits)) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id ED1D41CF1B for ; Sat, 9 May 2020 13:55:02 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 049Dt23u010620 for ; Sat, 9 May 2020 13:55:02 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 049Dt21Q010619 for virtualization@FreeBSD.org; Sat, 9 May 2020 13:55:02 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 246168] Ubuntu 20.04 KVM / QEMU Failure with nested FreeBSD bhyve Date: Sat, 09 May 2020 13:55:02 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bhyve X-Bugzilla-Version: 12.1-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: drum@graphica.com.au X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.32 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 09 May 2020 13:55:03 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D246168 --- Comment #11 from John Hartley --- (In reply to Peter Grehan from comment #10) Hi Peter, you have eagle eyes. Your suggestion worked and I now have Layer 3 - FreeBSD UEFI guest doing an install. I also tried to see if disabling X2APIC via QEMU fixed the problem via: This did not work, but it did turn off the feature correct in Layer 1 - Gue= st / Host. Here is output from sysctl on Layer 1 - FreeBSD Guest Host <> # sysctl hw.vmm hw.vmm.amdvi.domain_id: 0 hw.vmm.amdvi.disable_io_fault: 0 hw.vmm.amdvi.ptp_level: 4 hw.vmm.amdvi.host_ptp: 1 hw.vmm.amdvi.enable: 0 hw.vmm.amdvi.count: 0 hw.vmm.npt.pmap_flags: 0 hw.vmm.svm.num_asids: 0 hw.vmm.svm.disable_npf_assist: 0 hw.vmm.svm.features: 4294967295 hw.vmm.svm.vmcb_clean: 1023 hw.vmm.vmx.l1d_flush_sw: 0 hw.vmm.vmx.l1d_flush: 0 hw.vmm.vmx.vpid_alloc_failed: 0 hw.vmm.vmx.posted_interrupt_vector: -1 hw.vmm.vmx.cap.posted_interrupts: 0 hw.vmm.vmx.cap.virtual_interrupt_delivery: 0 hw.vmm.vmx.cap.invpcid: 1 hw.vmm.vmx.cap.monitor_trap: 1 hw.vmm.vmx.cap.unrestricted_guest: 1 hw.vmm.vmx.cap.pause_exit: 1 hw.vmm.vmx.cap.halt_exit: 1 hw.vmm.vmx.initialized: 1 hw.vmm.vmx.cr4_zeros_mask: 18446744073705934848 hw.vmm.vmx.cr4_ones_mask: 8192 hw.vmm.vmx.cr0_zeros_mask: 18446744071025197056 hw.vmm.vmx.cr0_ones_mask: 32 hw.vmm.vmx.no_flush_rsb: 0 hw.vmm.ept.pmap_flags: 1531 hw.vmm.vrtc.flag_broken_time: 1 hw.vmm.ppt.devices: 0 hw.vmm.iommu.enable: 1 hw.vmm.iommu.initialized: 0 hw.vmm.bhyve_xcpuids: 0 hw.vmm.topology.cpuid_leaf_b: 1 hw.vmm.create: beavis hw.vmm.destroy: beavis hw.vmm.trace_guest_exceptions: 0 hw.vmm.ipinum: 251 hw.vmm.halt_detection: 1 <> So have work around. Do think believe this needs fix within FreeBSD bhyve or is issue with QEMU / KVM ? NOTE: I also tested with FreeBSD 13 CURRENT and this had same problem. Thanks again for help on this. Cheers, John Hartley --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-virtualization@freebsd.org Sat May 9 20:33:42 2020 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id C65642F5048 for ; Sat, 9 May 2020 20:33:42 +0000 (UTC) (envelope-from jmg@gold.funkthat.com) Received: from gold.funkthat.com (gate2.funkthat.com [208.87.223.18]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "gate2.funkthat.com", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49KJnK6rjlz4JL3; Sat, 9 May 2020 20:33:41 +0000 (UTC) (envelope-from jmg@gold.funkthat.com) Received: from gold.funkthat.com (localhost [127.0.0.1]) by gold.funkthat.com (8.15.2/8.15.2) with ESMTPS id 049KXas3044529 (version=TLSv1.2 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=NO); Sat, 9 May 2020 13:33:37 -0700 (PDT) (envelope-from jmg@gold.funkthat.com) Received: (from jmg@localhost) by gold.funkthat.com (8.15.2/8.15.2/Submit) id 049KXajl044528; Sat, 9 May 2020 13:33:36 -0700 (PDT) (envelope-from jmg) Date: Sat, 9 May 2020 13:33:36 -0700 From: John-Mark Gurney To: vbox@FreeBSD.org, mjg@FreeBSD.org Cc: freebsd-virtualization@freebsd.org Subject: patch to make vboxvfs work again Message-ID: <20200509203336.GN4213@funkthat.com> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="j/HO4hzKTNbM1mOX" Content-Disposition: inline X-Operating-System: FreeBSD 11.3-STABLE amd64 X-PGP-Fingerprint: D87A 235F FB71 1F3F 55B7 ED9B D5FF 5A51 C0AC 3D65 X-Files: The truth is out there X-URL: https://www.funkthat.com/ X-Resume: https://www.funkthat.com/~jmg/resume.html X-TipJar: bitcoin:13Qmb6AeTgQecazTWph4XasEsP7nGRbAPE X-to-the-FBI-CIA-and-NSA: HI! HOW YA DOIN? can i haz chizburger? User-Agent: Mutt/1.6.1 (2016-04-27) X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.4.3 (gold.funkthat.com [127.0.0.1]); Sat, 09 May 2020 13:33:37 -0700 (PDT) X-Rspamd-Queue-Id: 49KJnK6rjlz4JL3 X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=none (mx1.freebsd.org: domain of jmg@gold.funkthat.com has no SPF policy when checking 208.87.223.18) smtp.mailfrom=jmg@gold.funkthat.com X-Spamd-Result: default: False [-0.47 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.84)[-0.837,0]; RCVD_TLS_ALL(0.00)[]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-0.38)[-0.376,0]; HAS_ATTACHMENT(0.00)[]; MIME_GOOD(-0.10)[multipart/mixed,text/plain]; TO_DN_NONE(0.00)[]; AUTH_NA(1.00)[]; DMARC_NA(0.00)[funkthat.com]; IP_SCORE(-0.46)[ip: (-1.19), ipnet: 208.87.216.0/21(-0.59), asn: 32354(-0.47), country: US(-0.05)]; R_SPF_NA(0.00)[]; FORGED_SENDER(0.30)[jmg@funkthat.com,jmg@gold.funkthat.com]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; ASN(0.00)[asn:32354, ipnet:208.87.216.0/21, country:US]; FROM_NEQ_ENVFROM(0.00)[jmg@funkthat.com,jmg@gold.funkthat.com]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_COUNT_TWO(0.00)[2] X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.32 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 09 May 2020 20:33:42 -0000 --j/HO4hzKTNbM1mOX Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Hello virtualbox maintainer(s), Attached is a patch to make VirtualBox vboxvfs work again. I've only tested under -current. mjg, what is the correct way to make this patch work on past versions of FreeBSD? would a simple #ifdef VFS_VOP_VECTOR_REGISTER wrapper around the call work? Thanks. -- John-Mark Gurney Voice: +1 415 225 5579 "All that I will do, has been done, All that I have, has not." --j/HO4hzKTNbM1mOX Content-Type: text/x-diff; charset=us-ascii Content-Disposition: attachment; filename="virtualbox-ose.patch" Index: virtualbox-ose/files/patch-src_VBox_Additions_freebsd_vboxvfs_Makefile.kmk =================================================================== --- virtualbox-ose/files/patch-src_VBox_Additions_freebsd_vboxvfs_Makefile.kmk (revision 534710) +++ virtualbox-ose/files/patch-src_VBox_Additions_freebsd_vboxvfs_Makefile.kmk (working copy) @@ -1,8 +1,10 @@ ---- src/VBox/Additions/freebsd/vboxvfs/Makefile.kmk.orig 2017-04-28 16:59:22.000000000 +0200 -+++ src/VBox/Additions/freebsd/vboxvfs/Makefile.kmk 2017-07-13 00:52:49.020669620 +0200 -@@ -33,32 +33,36 @@ +--- src/VBox/Additions/freebsd/vboxvfs/Makefile.kmk.orig 2019-10-10 18:06:51.000000000 +0000 ++++ src/VBox/Additions/freebsd/vboxvfs/Makefile.kmk 2020-05-09 06:51:51.411749000 +0000 +@@ -32,33 +32,38 @@ + . \ $(vboxvfs_0_OUTDIR) vboxvfs_SOURCES = \ ++ bcmp.c \ vboxvfs_vfsops.c \ - vboxvfs_vnops.c + vboxvfs_vnops.c \ Index: virtualbox-ose/files/patch-src_VBox_Additions_freebsd_vboxvfs_bcmp.c =================================================================== --- virtualbox-ose/files/patch-src_VBox_Additions_freebsd_vboxvfs_bcmp.c (nonexistent) +++ virtualbox-ose/files/patch-src_VBox_Additions_freebsd_vboxvfs_bcmp.c (working copy) @@ -0,0 +1,12 @@ +--- src/VBox/Additions/freebsd/vboxvfs/bcmp.c.orig 2020-05-09 06:57:06.229140000 +0000 ++++ src/VBox/Additions/freebsd/vboxvfs/bcmp.c 2020-05-09 06:54:55.886751000 +0000 +@@ -0,0 +1,9 @@ ++#include ++ ++int bcmp(const void *b1, const void *b2, size_t len); ++ ++int ++bcmp(const void *b1, const void *b2, size_t len) ++{ ++ return __builtin_memcmp((b1), (b2), (len)); ++} Property changes on: virtualbox-ose/files/patch-src_VBox_Additions_freebsd_vboxvfs_bcmp.c ___________________________________________________________________ Added: fbsd:nokeywords ## -0,0 +1 ## +yes \ No newline at end of property Added: svn:eol-style ## -0,0 +1 ## +native \ No newline at end of property Added: svn:mime-type ## -0,0 +1 ## +text/plain \ No newline at end of property Index: virtualbox-ose/files/patch-src_VBox_Additions_freebsd_vboxvfs_vboxvfs__vnops.c =================================================================== --- virtualbox-ose/files/patch-src_VBox_Additions_freebsd_vboxvfs_vboxvfs__vnops.c (revision 534793) +++ virtualbox-ose/files/patch-src_VBox_Additions_freebsd_vboxvfs_vboxvfs__vnops.c (working copy) @@ -1,5 +1,5 @@ ---- src/VBox/Additions/freebsd/vboxvfs/vboxvfs_vnops.c.orig 2019-10-10 18:06:51 UTC -+++ src/VBox/Additions/freebsd/vboxvfs/vboxvfs_vnops.c +--- src/VBox/Additions/freebsd/vboxvfs/vboxvfs_vnops.c.orig 2019-10-10 18:06:51.000000000 +0000 ++++ src/VBox/Additions/freebsd/vboxvfs/vboxvfs_vnops.c 2020-05-09 07:07:49.485808000 +0000 @@ -1,10 +1,6 @@ -/* $Id: vboxvfs_vnops.c $ */ -/** @file @@ -12,7 +12,7 @@ * * This file is part of VirtualBox Open Source Edition (OSE), as * available from http://www.virtualbox.org. This file is free software; -@@ -14,228 +10,1338 @@ +@@ -14,228 +10,1339 @@ * VirtualBox OSE distribution. VirtualBox OSE is distributed in the * hope that it will be useful, but WITHOUT ANY WARRANTY of any kind. */ @@ -172,6 +172,7 @@ + .vop_write = vboxfs_write, + .vop_bmap = VOP_EOPNOTSUPP }; ++VFS_VOP_VECTOR_REGISTER(vboxfs_vnodeops); -static int vboxvfs_access(struct vop_access_args *ap) +static uint64_t --j/HO4hzKTNbM1mOX-- From owner-freebsd-virtualization@freebsd.org Sat May 9 21:18:03 2020 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 91D452F6362 for ; Sat, 9 May 2020 21:18:03 +0000 (UTC) (envelope-from mjguzik@gmail.com) Received: from mail-wr1-x42c.google.com (mail-wr1-x42c.google.com [IPv6:2a00:1450:4864:20::42c]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49KKmV0zmYz4LmZ; Sat, 9 May 2020 21:18:01 +0000 (UTC) (envelope-from mjguzik@gmail.com) Received: by mail-wr1-x42c.google.com with SMTP id i15so6077798wrx.10; Sat, 09 May 2020 14:18:01 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=NozMTRC55zz0lX5Qh7AgzijEmyhxRBZhU0AaijnKsXg=; b=NvbGMtpGNuYmtKqcbwJh0ao5cWZPHCDhhCZ7UT7NPn9YlRv19r8aG4DY8kBOW9C0KF OOhdsrT66WVE+xSsO+LUZ+MSVolv9Zk9sH+QzNCnA4Eo5GJufeVfe4nIeGJhEs5iVy3X 3P80i6o2WRv10qD3X1PERSOxxGXXGbLB1q6hPE9JNJbpgEkSH90N5+5pU/nnMHnsOJmH 8Qk30qnnasWni19JgjWunedXSxal562J+h73GVwNFkA5W3SxUb+RT4HKSlqAAHanDviS QTgZB9x13eHZKOnlCjNY2xdRsTcnDvl/bMcVLFYfv46WYaczoJSXFmotlVLOtgiG69FL CiEw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=NozMTRC55zz0lX5Qh7AgzijEmyhxRBZhU0AaijnKsXg=; b=Vz1Qhnn81edpeqGNvob9Ah+85d9jRuYkKy1YJ5uzrOsq9emDEc8XMnKp1w7+AruB0d r39btAoVoHfUol9TeEYIQr4YZPBs/fYwj1DIsARbRjQCmcsm0wRu7kl4auQYcCBHwHEg zJiq331Sm3cMD+/CsEAFMS/7lJi/1N0n/qHRyxF6iq21AVxtWp4po1KXpNspxOpvfRCD V7LN3F0U19e1G7mlWlkkBSP3UHggeqJundOTGil4HSTiQqAvynJBZ/CxksaMKR6Mgdmi nEUQx38YBiYUfyUvIp0Q/lkvJpEXjxi0+RcFtrAOGA5Tyz0pi0oUl5/CpHTFPT2qpryv 3X8A== X-Gm-Message-State: AGi0PuYGqMHorqgmr5ORPEFKP/fWPILNdAO4xtaUdYT/xGuQFUJV3ZKX VxjTeSAcu4G4PruVBDSiqaelq8TbaJtb9d757xG3QjlR X-Google-Smtp-Source: APiQypK8jCMWBZm1A+S3scJGjDH520rTmugfbhfVS/pRdszu0/Wdb6Ygb2k71SiYN9aEyJzYtRSbPd5oecqq/3/0DfY= X-Received: by 2002:adf:cd92:: with SMTP id q18mr10401194wrj.237.1589059080487; Sat, 09 May 2020 14:18:00 -0700 (PDT) MIME-Version: 1.0 Received: by 2002:adf:a55a:0:0:0:0:0 with HTTP; Sat, 9 May 2020 14:17:59 -0700 (PDT) In-Reply-To: <20200509203336.GN4213@funkthat.com> References: <20200509203336.GN4213@funkthat.com> From: Mateusz Guzik Date: Sat, 9 May 2020 23:17:59 +0200 Message-ID: Subject: Re: patch to make vboxvfs work again To: John-Mark Gurney Cc: vbox@freebsd.org, freebsd-virtualization@freebsd.org Content-Type: text/plain; charset="UTF-8" X-Rspamd-Queue-Id: 49KKmV0zmYz4LmZ X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=NvbGMtpG; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of mjguzik@gmail.com designates 2a00:1450:4864:20::42c as permitted sender) smtp.mailfrom=mjguzik@gmail.com X-Spamd-Result: default: False [-3.00 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36:c]; FREEMAIL_FROM(0.00)[gmail.com]; MIME_GOOD(-0.10)[text/plain]; IP_SCORE(0.00)[ip: (-9.13), ipnet: 2a00:1450::/32(-2.29), asn: 15169(-0.43), country: US(-0.05)]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; TO_DN_SOME(0.00)[]; IP_SCORE_FREEMAIL(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; RCVD_IN_DNSWL_NONE(0.00)[c.2.4.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.5.4.1.0.0.a.2.list.dnswl.org : 127.0.5.0]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com.dwl.dnswl.org : 127.0.5.0] X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.32 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 09 May 2020 21:18:03 -0000 That will do the trick indeed. I don't know about that bcmp thingy, ideally it would be needed. I presume there is a sufficient header mess which makes this to be the easiest hack. On 5/9/20, John-Mark Gurney wrote: > Hello virtualbox maintainer(s), > > Attached is a patch to make VirtualBox vboxvfs work again. I've only > tested under -current. > > mjg, what is the correct way to make this patch work on past versions > of FreeBSD? would a simple #ifdef VFS_VOP_VECTOR_REGISTER wrapper > around the call work? > > Thanks. > > -- > John-Mark Gurney Voice: +1 415 225 5579 > > "All that I will do, has been done, All that I have, has not." > -- Mateusz Guzik From owner-freebsd-virtualization@freebsd.org Sat May 9 21:33:06 2020 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 714D12F6A38 for ; Sat, 9 May 2020 21:33:06 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 49KL5t2Q2Kz4Mn8 for ; Sat, 9 May 2020 21:33:06 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 52A682F6A37; Sat, 9 May 2020 21:33:06 +0000 (UTC) Delivered-To: virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 5264A2F6A36 for ; Sat, 9 May 2020 21:33:06 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49KL5t1HLxz4Mn7 for ; Sat, 9 May 2020 21:33:06 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits)) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 2779522676 for ; Sat, 9 May 2020 21:33:06 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 049LX6ke035571 for ; Sat, 9 May 2020 21:33:06 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 049LX62H035570 for virtualization@FreeBSD.org; Sat, 9 May 2020 21:33:06 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 246168] Ubuntu 20.04 KVM / QEMU Failure with nested FreeBSD bhyve Date: Sat, 09 May 2020 21:33:06 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bhyve X-Bugzilla-Version: 12.1-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: grehan@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.32 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 09 May 2020 21:33:06 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D246168 --- Comment #12 from Peter Grehan --- Glad to hear that worked. x2apic is fine - it has to be explicitly enabled in bhyve for a guest to us= e. This would appear to be a bug in kvm since apic-virtualization in bhyve has been working fine on h/w for a number of years now. However, the fact that = it fails almost immediately (on first guest entry perhaps) would indicate it m= ay not be difficult to fix. --=20 You are receiving this mail because: You are the assignee for the bug.=