From owner-freebsd-virtualization@freebsd.org Sun Jan 10 11:28:15 2021 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id E0A1C4C873F for ; Sun, 10 Jan 2021 11:28:15 +0000 (UTC) (envelope-from ml@netfence.it) Received: from soth.netfence.it (mailserver.netfence.it [78.134.96.152]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "mailserver.netfence.it", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4DDF2Q6G7tz4VNQ; Sun, 10 Jan 2021 11:28:14 +0000 (UTC) (envelope-from ml@netfence.it) Received: from alamar.ventu (alamar.local.netfence.it [10.1.2.18]) (authenticated bits=0) by soth.netfence.it (8.16.1/8.16.1) with ESMTPSA id 10ABSBx0082651 (version=TLSv1.3 cipher=TLS_AES_128_GCM_SHA256 bits=128 verify=NO); Sun, 10 Jan 2021 12:28:12 +0100 (CET) (envelope-from ml@netfence.it) X-Authentication-Warning: soth.netfence.it: Host alamar.local.netfence.it [10.1.2.18] claimed to be alamar.ventu Subject: Re: VirtualBox can't read VDI anymore From: Andrea Venturoli To: vbox@FreeBSD.org, freebsd-virtualization@freebsd.org References: <4f894683-d6dc-c878-6e92-fb0832b85a49@netfence.it> Message-ID: <8937b6db-0e68-90cd-da86-084c98c241fc@netfence.it> Date: Sun, 10 Jan 2021 12:28:11 +0100 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:78.0) Gecko/20100101 Thunderbird/78.6.0 MIME-Version: 1.0 In-Reply-To: <4f894683-d6dc-c878-6e92-fb0832b85a49@netfence.it> Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 4DDF2Q6G7tz4VNQ X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=pass (policy=none) header.from=netfence.it; spf=pass (mx1.freebsd.org: domain of ml@netfence.it designates 78.134.96.152 as permitted sender) smtp.mailfrom=ml@netfence.it X-Spamd-Result: default: False [-3.80 / 15.00]; RCVD_TLS_ALL(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; FROM_HAS_DN(0.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[78.134.96.152:from]; TO_MATCH_ENVRCPT_ALL(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:78.134.96.152]; MIME_GOOD(-0.10)[text/plain]; TO_DN_NONE(0.00)[]; HAS_XAW(0.00)[]; SPAMHAUS_ZRD(0.00)[78.134.96.152:from:127.0.2.255]; ARC_NA(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[netfence.it,none]; NEURAL_HAM_SHORT(-1.00)[-0.998]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:35612, ipnet:78.134.0.0/17, country:IT]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[freebsd-virtualization] X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 10 Jan 2021 11:28:15 -0000 On 1/8/21 7:58 PM, Andrea Venturoli wrote: > Hello. > > I'm tracking the quarterly port branches and building my packages with > poudriere. > Today I switched from 2020Q4 to 2021Q1 and upgraded VirtualBox from > 5.2.44_3 to 5.2.44_4. > After that I can no longer start any guest. > What I get: >> VDI: error reading pre-header in '....vdi' (VERR_DEV_IO_ERROR). >> VD: error VERR_VD_VDI_INVALID_HEADER opening image file '....vdi' >> (VERR_VD_VDI_INVALID_HEADER). >> Failed to open image '....vdi' in read-write mode >> (VERR_VD_VDI_INVALID_HEADER). >> AHCI: Failed to attach drive to Port0 (VERR_VD_VDI_INVALID_HEADER). >> >> >> Result Code: NS_ERROR_FAILURE (0x80004005) >> Component: ConsoleWrap >> Interface: IConsole {872da645-4a9b-1727-bee2-5585105b9eed} > > Any hint? > > > > Does this have anything to do with the following: >> emulators/virtualbox-ose: Turn off aio usage and make VirtualBox use >> generic >> Unix implementation. I can confirm reverting this change makes VirtualBox work again for me. (Noted also on #168298). bye av. From owner-freebsd-virtualization@freebsd.org Sun Jan 10 11:28:16 2021 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id E70D24C8896 for ; Sun, 10 Jan 2021 11:28:16 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 4DDF2S5kS9z4VHn for ; Sun, 10 Jan 2021 11:28:16 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id C462F4C8821; Sun, 10 Jan 2021 11:28:16 +0000 (UTC) Delivered-To: virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id C41EC4C86DC for ; Sun, 10 Jan 2021 11:28:16 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4DDF2S4vbtz4VHm for ; Sun, 10 Jan 2021 11:28:16 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 97C70276A8 for ; Sun, 10 Jan 2021 11:28:16 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 10ABSG9T057677 for ; Sun, 10 Jan 2021 11:28:16 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 10ABSGPa057676 for virtualization@FreeBSD.org; Sun, 10 Jan 2021 11:28:16 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 168298] VirtualBox using AIO on a zvol crashes Date: Sun, 10 Jan 2021 11:28:16 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.1-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: ml@netfence.it X-Bugzilla-Status: Closed X-Bugzilla-Resolution: Works As Intended X-Bugzilla-Priority: Normal X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 10 Jan 2021 11:28:17 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D168298 ml@netfence.it changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |ml@netfence.it --- Comment #38 from ml@netfence.it --- (In reply to commit-hook from comment #28) This patch broke VirtualBox for me (12.2amd/64, with VDI files accessed via NFSv4). Starting any machine, I get: VDI: error reading pre-header in '....vdi' (VERR_DEV_IO_ERROR). VD: error VERR_VD_VDI_INVALID_HEADER opening image file '....vdi' (VERR_VD_VDI_INVALID_HEADER). Failed to open image '....vdi' in read-write mode (VERR_VD_VDI_INVALID_HEAD= ER). AHCI: Failed to attach drive to Port0 (VERR_VD_VDI_INVALID_HEADER). Result Code: NS_ERROR_FAILURE (0x80004005) Component: ConsoleWrap Interface: IConsole {872da645-4a9b-1727-bee2-5585105b9eed}=20 I can confirm reverting this brings VBox in a working state again. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-virtualization@freebsd.org Sun Jan 10 21:01:11 2021 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 057B54D9A9E for ; Sun, 10 Jan 2021 21:01:11 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 4DDTlT0QLCz3h25 for ; Sun, 10 Jan 2021 21:01:08 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: by mailman.nyi.freebsd.org (Postfix) id C09724D9B02; Sun, 10 Jan 2021 21:01:08 +0000 (UTC) Delivered-To: virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id C00424D9939 for ; Sun, 10 Jan 2021 21:01:08 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4DDTlR4NDPz3R8j for ; Sun, 10 Jan 2021 21:01:07 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 2D3936F2E for ; Sun, 10 Jan 2021 21:01:06 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 10AL16j4072337 for ; Sun, 10 Jan 2021 21:01:06 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 10AL162a072336 for virtualization@FreeBSD.org; Sun, 10 Jan 2021 21:01:06 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Message-Id: <202101102101.10AL162a072336@kenobi.freebsd.org> X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@FreeBSD.org using -f From: bugzilla-noreply@FreeBSD.org To: virtualization@FreeBSD.org Subject: Problem reports for virtualization@FreeBSD.org that need special attention Date: Sun, 10 Jan 2021 21:01:06 +0000 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.34 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 10 Jan 2021 21:01:11 -0000 To view an individual PR, use: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=(Bug Id). The following is a listing of current problems submitted by FreeBSD users, which need special attention. These represent problem reports covering all versions including experimental development code and obsolete releases. Status | Bug Id | Description ------------+-----------+--------------------------------------------------- In Progress | 247208 | mpt(4): VMWare virtualized LSI controller panics New | 240945 | [hyper-v] [netvsc] hn network driver incorrectly 2 problems total for which you should take action. From owner-freebsd-virtualization@freebsd.org Mon Jan 11 19:29:29 2021 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 7FF314E3B72 for ; Mon, 11 Jan 2021 19:29:29 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 4DF3gF31HHz4kFj for ; Mon, 11 Jan 2021 19:29:29 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 65B1E4E3D59; Mon, 11 Jan 2021 19:29:29 +0000 (UTC) Delivered-To: virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 657294E3E53 for ; Mon, 11 Jan 2021 19:29:29 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4DF3gF2KGxz4kW8 for ; Mon, 11 Jan 2021 19:29:29 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4355920086 for ; Mon, 11 Jan 2021 19:29:29 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 10BJTTsf019187 for ; Mon, 11 Jan 2021 19:29:29 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 10BJTTr9019186 for virtualization@FreeBSD.org; Mon, 11 Jan 2021 19:29:29 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 252445] recent 12.2-STABLE panics on ESXi 4.1.0 Date: Mon, 11 Jan 2021 19:29:29 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 12.2-STABLE X-Bugzilla-Keywords: panic, regression X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: zarychtam@plan-b.pwste.edu.pl X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 11 Jan 2021 19:29:29 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D252445 --- Comment #10 from Marek Zarychta --- So far the patch seems to be a reliable solution. Is anything that prevents= it from being committed to HEAD? Should we expect it to be MFCed to stable/12 = or directly committed to this branch or should we cope with it on our own? Anyway thanks again for providing us with this patch which perfectly solves= the issue. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-virtualization@freebsd.org Tue Jan 12 10:31:06 2021 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id D97B84D1E09 for ; Tue, 12 Jan 2021 10:31:06 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 4DFRgZ5ZBDz4k2y for ; Tue, 12 Jan 2021 10:31:06 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id BF2924D1C48; Tue, 12 Jan 2021 10:31:06 +0000 (UTC) Delivered-To: virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id BEF074D177F for ; Tue, 12 Jan 2021 10:31:06 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4DFRgZ4zrlz4kGT for ; Tue, 12 Jan 2021 10:31:06 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 9E5242B698 for ; Tue, 12 Jan 2021 10:31:06 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 10CAV6ro099016 for ; Tue, 12 Jan 2021 10:31:06 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 10CAV6nn099015 for virtualization@FreeBSD.org; Tue, 12 Jan 2021 10:31:06 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 251583] FreeBSD/EC2 breakage w/ encrypted EBS volumes Date: Tue, 12 Jan 2021 10:31:06 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 12.2-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: mybenext@benext.eu X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 12 Jan 2021 10:31:06 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D251583 --- Comment #5 from myBeNext --- We're getting the same. Other than using non-encrypted disks, is there a kn= own work around for this? --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-virtualization@freebsd.org Tue Jan 12 23:45:02 2021 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 316C24E9CBF for ; Tue, 12 Jan 2021 23:45:02 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 4DFnHf0j9Qz4qxl for ; Tue, 12 Jan 2021 23:45:02 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 182754E9EA5; Tue, 12 Jan 2021 23:45:02 +0000 (UTC) Delivered-To: virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 17EE74E9CBE for ; Tue, 12 Jan 2021 23:45:02 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4DFnHf05TFz4r5P for ; Tue, 12 Jan 2021 23:45:02 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id E7AC45678 for ; Tue, 12 Jan 2021 23:45:01 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 10CNj1c7076447 for ; Tue, 12 Jan 2021 23:45:01 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 10CNj17r076446 for virtualization@FreeBSD.org; Tue, 12 Jan 2021 23:45:01 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 251583] FreeBSD/EC2 breakage w/ encrypted EBS volumes Date: Tue, 12 Jan 2021 23:45:02 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 12.2-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: georgewilliamfoster@gmail.com X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 12 Jan 2021 23:45:02 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D251583 --- Comment #6 from Billy --- My workaround is as follows: 1. Launch an instance with an unencrypted disk. 2. Attached an encrypted disk to the instance. 3. Run bsdinstall to set up the encrypted disk with a fresh installation of FreeBSD. 4. Detach both disks from the instance. 5. Attach the encrypted disk to the instance as /dev/sda1 so that the insta= nce boots from the fresh installation. I personally like this approach because it lets me customize the install ra= ther than use the settings selected in the AMI. That said, if you like the AMI version, you can probably skip the bsdinstall step and instead just dd from a working unencrypted disk to an attached encrypted disk. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-virtualization@freebsd.org Wed Jan 13 11:56:01 2021 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 075034DA2A8; Wed, 13 Jan 2021 11:56:01 +0000 (UTC) (envelope-from andrei.cos.martin@gmail.com) Received: from mail-pj1-x1032.google.com (mail-pj1-x1032.google.com [IPv6:2607:f8b0:4864:20::1032]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4DG5W374zDz4Yfr; Wed, 13 Jan 2021 11:55:59 +0000 (UTC) (envelope-from andrei.cos.martin@gmail.com) Received: by mail-pj1-x1032.google.com with SMTP id u4so1036574pjn.4; Wed, 13 Jan 2021 03:55:59 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:from:date:message-id:subject:to; bh=WTpwsDMkRyFPEBB5XP9FrIts92LKxTVHeU9xF7tyXz8=; b=r7ApbPwxldfCnf+gMVN4krAKzsseQay/J/3dUPDNJ3rPedoyQ8R+kytfXFMDGSRd10 h/7opfFs9sx6Vs9g04T4ebFPxjc6D05T3gBMJTg7Iv3G9dWg8nyoH7wp1OBJOuUusqJB VjfTkbcn4CLIBqWRXcQQIDyF8t6lvlFFuWiEUd4d8dQIV9VXSYLIa6XBuubiemBKSfPg 81aGacJKtF+0F8ENtlTHEkK+cPCZE1ovjrsVBOyguwVLj5bEUwhX/30O4vquz6KIb4Tf eN9yQHY3+IX1I/Ud41HPBNW54RICjEf6sJcZLcyY3XldKa5ErEdd5qLjgVbuotksIOfK g3rw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=WTpwsDMkRyFPEBB5XP9FrIts92LKxTVHeU9xF7tyXz8=; b=kGEtHLOMIFOFBY9T0xjFxMVc+962IzKaQFMuZdwwykcJ0esSOCdMVc+ugX4l0jF56v 6rHwN3Rouew5fymY1KlLRhZ7anvWemFTX12bSc4J3EqHo6ZAMc8m8injlSPKGLtFY7fE gNIFFFqqTIUqHCfy80St2r3rqbj6PPstKn6bOQslEH9toP3XCodX/EKYjxtpU1J73sZj q5fHYSEK9xUTH2acTcI8EVetBgXaX2XF7x0ggusjcauhSImdeAMJ4nc4DRP2LLBHwZlW 2Loaz7dZ11es4YfJtjxiw4r+OYIeoj2BveC4CUHLwCGLb3ck9iOQ9KTsn1VLPzp0jALi 831g== X-Gm-Message-State: AOAM532kKymZU23x2m+HjjJMfa0CH/ZouzGTeYgfSZQU/PID0LeXH8Ne Mn7iLd/2oF1bVkEugDqplR9NWv6rr3cJFnRrHixtqQanphU= X-Google-Smtp-Source: ABdhPJyOyx4ptNVkEz7neB5r/KO98nKJaBYJeQuCOqc8uda0tz90cgIblG6ejG9suiNqu+T3qjbfWw+wWnqNzZEjmdg= X-Received: by 2002:a17:90a:73c5:: with SMTP id n5mr2027648pjk.118.1610538958569; Wed, 13 Jan 2021 03:55:58 -0800 (PST) MIME-Version: 1.0 From: Andrei Martin Date: Wed, 13 Jan 2021 13:55:47 +0200 Message-ID: Subject: [bhyve][arm64] Number of allowed vcpus To: freebsd-arm@freebsd.org, freebsd-virtualization@freebsd.org, Mihai Carabas , Darius Mihai , Elena Mihailescu X-Rspamd-Queue-Id: 4DG5W374zDz4Yfr X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=r7ApbPwx; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of andreicosmartin@gmail.com designates 2607:f8b0:4864:20::1032 as permitted sender) smtp.mailfrom=andreicosmartin@gmail.com X-Spamd-Result: default: False [-3.99 / 15.00]; RBL_SENDERSCORE_FAIL(0.00)[2607:f8b0:4864:20::1032:server fail]; TO_DN_SOME(0.00)[]; FREEMAIL_FROM(0.00)[gmail.com]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; RCPT_COUNT_FIVE(0.00)[5]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; NEURAL_HAM_SHORT(-0.99)[-0.991]; FREEMAIL_TO(0.00)[freebsd.org,gmail.com]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; TAGGED_FROM(0.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[2607:f8b0:4864:20::1032:from]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; FROM_HAS_DN(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; TAGGED_RCPT(0.00)[]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; SPAMHAUS_ZRD(0.00)[2607:f8b0:4864:20::1032:from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::1032:from]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-arm,freebsd-virtualization] Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.34 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 13 Jan 2021 11:56:01 -0000 Hello, While working on enabling multiple virtual cpus for the arm64 virtual machine I used the bhyve's "-c N" parameter to create N cpus (it gets only the cpus, in contrast to the amd64). If N is smaller than the number of cores described in the device tree it will enable only N and if it's larger it will enable only the number of cores from the device tree. I don't know if it is the best approach. Another way would be to enable all the cpus from the device tree, no more, no less. Do you have any suggestions? Andrei From owner-freebsd-virtualization@freebsd.org Wed Jan 13 12:01:55 2021 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 9CEFC4DA557; Wed, 13 Jan 2021 12:01:55 +0000 (UTC) (envelope-from mihai.carabas@gmail.com) Received: from mail-lj1-x231.google.com (mail-lj1-x231.google.com [IPv6:2a00:1450:4864:20::231]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4DG5dt6DCRz4ZRZ; Wed, 13 Jan 2021 12:01:54 +0000 (UTC) (envelope-from mihai.carabas@gmail.com) Received: by mail-lj1-x231.google.com with SMTP id f17so2195536ljg.12; Wed, 13 Jan 2021 04:01:54 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=q+GkIxyP3KkX3NJtJCxwGmKLUT63/2x+qzpgmGpfLtc=; b=Un4TU2um/dfgTFhyFDyOotQVDvq13CeU5Hyysbc2fvqqZRS1S7Ue0tpg/k4jaRCD8h G0zzgakYejZnzeuYBE7gtyzyov3NPRgHgMJo8AJ48cN4Yrs3IDOBROxOV3eyajIlg/On 7yNkzIFIno4ow+kDxMZzlopxzzqFBv0b3MVcZ+jyseEbkWDNckE+2nq4R3bi4djt6Vw+ cwm9yEM5y6uJq8tN0usq+W9NnNboPGRuG5YTnlu/9S0J6x9l40tsVcoAy7InCWRm5tBQ q3SS1S8ixIHTISJ+WQtXqTkpSZAmCBP4KWcsUos5MDIk+zY7V1Vz7vLfdwKQdXyEuCNy J8IA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=q+GkIxyP3KkX3NJtJCxwGmKLUT63/2x+qzpgmGpfLtc=; b=qyEIOx6a91qbbKbFK3SZ7K9aqnnv9GfrXJ3FiYApbqXEnF7vd0FLrzJHFMm95Rs8Jz GEanqb1fmbEjs91dGbFcd23VsQswCiFHPXwhcRc3xOgidzxAga38NHL2WXvWxFwRZ2X3 Q+XOs0qKKFniqytXb3+x/AKGR1pMMEJD+plkxWIrJxug+agQxSri/RvBU4TGm8bnp76v 3VHRZidtKNWyD62VVXDlc99AWdgI7BJzKvxYoFm/8hmDDV2Ow6O1Fz2ENcmnUHnu+iZu R0w1hKg9wByW5gIsYCFztXwZQQCdt/3oGsXjUEbfrFgHQhHxaKIBjvPqX1hYWW+PKOl6 acVQ== X-Gm-Message-State: AOAM533f4BjmvL1MaaFgsL/gcTcUisOnoKp5uYPuTDcLKH1vbFjj1cCs GxbptXcuPaGPPCXQeFmZFQVMANuuvLBZY8XMd7k= X-Google-Smtp-Source: ABdhPJy48+rjv6MkVW7Z/1yF5fEtckrYWYRau7NScACS3YjXwaToWJgXbbsqvkSC9GUM5xOLKwa8WAW97MxKRZ61TdQ= X-Received: by 2002:a2e:3619:: with SMTP id d25mr811609lja.378.1610539312751; Wed, 13 Jan 2021 04:01:52 -0800 (PST) MIME-Version: 1.0 References: In-Reply-To: From: Mihai Carabas Date: Wed, 13 Jan 2021 14:01:43 +0200 Message-ID: Subject: Re: [bhyve][arm64] Number of allowed vcpus To: Andrei Martin Cc: freebsd-arm@freebsd.org, freebsd-virtualization@freebsd.org, Darius Mihai , Elena Mihailescu X-Rspamd-Queue-Id: 4DG5dt6DCRz4ZRZ X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=Un4TU2um; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of mihaicarabas@gmail.com designates 2a00:1450:4864:20::231 as permitted sender) smtp.mailfrom=mihaicarabas@gmail.com X-Spamd-Result: default: False [-0.75 / 15.00]; MAILMAN_DEST(0.00)[freebsd-arm,freebsd-virtualization]; TO_DN_SOME(0.00)[]; FREEMAIL_FROM(0.00)[gmail.com]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36]; RCPT_COUNT_FIVE(0.00)[5]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; FREEMAIL_TO(0.00)[gmail.com]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; TAGGED_FROM(0.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[2a00:1450:4864:20::231:from]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; FROM_HAS_DN(0.00)[]; NEURAL_SPAM_SHORT(0.75)[0.754]; NEURAL_HAM_LONG(-1.00)[-1.000]; TAGGED_RCPT(0.00)[]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; SPAMHAUS_ZRD(0.00)[2a00:1450:4864:20::231:from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[2a00:1450:4864:20::231:from]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[]; SUSPICIOUS_RECIPS(1.50)[]; FREEMAIL_CC(0.00)[freebsd.org,gmail.com] Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.34 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 13 Jan 2021 12:01:55 -0000 Hello, >From my perspective bhyve should use what is stated in the device tree if no parameter is given and throw an error when N is greater than the device tree value. Mihai On Wed, Jan 13, 2021 at 1:55 PM Andrei Martin wrote: > Hello, > > While working on enabling multiple virtual cpus for the arm64 virtual > machine > I used the bhyve's "-c N" parameter to create N cpus (it gets only the > cpus, in contrast to the amd64). If N is smaller than the number of cores > described in the device tree it will enable only N and if it's larger it > will enable only the number of cores from the device tree. > > I don't know if it is the best approach. Another way would be to enable > all the cpus from the device tree, no more, no less. > > Do you have any suggestions? > > Andrei > From owner-freebsd-virtualization@freebsd.org Wed Jan 13 12:45:45 2021 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 3F64A4DBDFE for ; Wed, 13 Jan 2021 12:45:45 +0000 (UTC) (envelope-from ml@netfence.it) Received: from soth.netfence.it (mailserver.netfence.it [78.134.96.152]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "mailserver.netfence.it", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4DG6cR5CSNz4d34 for ; Wed, 13 Jan 2021 12:45:43 +0000 (UTC) (envelope-from ml@netfence.it) Received: from alamar.ventu (alamar.local.netfence.it [10.1.2.18]) (authenticated bits=0) by soth.netfence.it (8.16.1/8.16.1) with ESMTPSA id 10DCjZQi026680 (version=TLSv1.3 cipher=TLS_AES_128_GCM_SHA256 bits=128 verify=NO) for ; Wed, 13 Jan 2021 13:45:35 +0100 (CET) (envelope-from ml@netfence.it) X-Authentication-Warning: soth.netfence.it: Host alamar.local.netfence.it [10.1.2.18] claimed to be alamar.ventu To: freebsd-virtualization@freebsd.org From: Andrea Venturoli Subject: After 12.1->12.2 upgrade FreeBSD bhyve guest does not start anymore Message-ID: <0ed9c5b2-8113-02c4-ae7b-4dc41d3c0e02@netfence.it> Date: Wed, 13 Jan 2021 13:45:35 +0100 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:78.0) Gecko/20100101 Thunderbird/78.6.1 MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 4DG6cR5CSNz4d34 X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=pass (policy=none) header.from=netfence.it; spf=pass (mx1.freebsd.org: domain of ml@netfence.it designates 78.134.96.152 as permitted sender) smtp.mailfrom=ml@netfence.it X-Spamd-Result: default: False [-3.80 / 15.00]; RCVD_TLS_ALL(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; FROM_HAS_DN(0.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[78.134.96.152:from]; TO_MATCH_ENVRCPT_ALL(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:78.134.96.152]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-virtualization@freebsd.org]; HAS_XAW(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; RBL_SENDERSCORE_FAIL(0.00)[78.134.96.152:server fail]; SPAMHAUS_ZRD(0.00)[78.134.96.152:from:127.0.2.255]; TO_DN_NONE(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; DMARC_POLICY_ALLOW(-0.50)[netfence.it,none]; NEURAL_HAM_SHORT(-1.00)[-1.000]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:35612, ipnet:78.134.0.0/17, country:IT]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[freebsd-virtualization] X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 13 Jan 2021 12:45:45 -0000 Hello. Due to a 12.x specific bug, I run a 11.3 guest using vm-bhyve. This is its config: > loader="bhyveload" > cpu=1 > memory=512M > network0_type="virtio-net" > network0_switch="public" > disk0_type="virtio-blk" > disk0_name="disk0" > disk0_dev="sparse-zvol" > uuid="..." > network0_mac="..." On monday I upgraded the host from 12.1 to 12.2 and, since then, it won't boot automatically, but will stop at the loader prompt. Dmesg: > /boot/kernel/kernel text=0x1564b08 data=0x145330+0x4cdf30 syms=[0x8+0x16daf0+0x8+0x186a43] > /boot/entropy size=0x1000 > Booting... > Copyright (c) 1992-2019 The FreeBSD Project. > Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 > The Regents of the University of California. All rights reserved. > FreeBSD is a registered trademark of The FreeBSD Foundation. > FreeBSD 11.3-RELEASE #0 r349754: Fri Jul 5 04:45:24 UTC 2019 > root@releng2.nyi.freebsd.org:/usr/obj/usr/src/sys/GENERIC amd64 > FreeBSD clang version 8.0.0 (tags/RELEASE_800/final 356365) (based on LLVM 8.0.0) > VT: init without driver. > CPU: Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz (3000.12-MHz K8-class CPU) > Origin="GenuineIntel" Id=0x906e9 Family=0x6 Model=0x9e Stepping=9 > Features=0x9f83fbff > Features2=0xfeda7a17 > AMD Features=0x24100800 > AMD Features2=0x121 > Structured Extended Features=0x40729 > Structured Extended Features3=0x400 > XSAVE Features=0x1 > TSC: P-state invariant > Hypervisor: Origin = "bhyve bhyve " > real memory = 536870912 (512 MB) > avail memory = 474779648 (452 MB) > Event timer "LAPIC" quality 600 > ACPI APIC Table: > ioapic0 irqs 0-31 on motherboard > Timecounter "TSC-low" frequency 1500060031 Hz quality 1000 > random: entropy device external interface > kbd1 at kbdmux0 > 000.000029 [4213] netmap_init netmap: loaded module > module_register_init: MOD_LOAD (vesa, 0xffffffff81005eb0, 0) error 19 > random: registering fast source Intel Secure Key RNG > random: fast provider: "Intel Secure Key RNG" > nexus0 > cryptosoft0: on motherboard > acpi0: on motherboard > acpi0: Power Button (fixed) > atrtc0: port 0x70-0x71 irq 8 on acpi0 > atrtc0: registered as a time-of-day clock, resolution 1.000000s > Event timer "RTC" frequency 32768 Hz quality 0 > attimer0: port 0x40-0x43 irq 0 on acpi0 > Timecounter "i8254" frequency 1193182 Hz quality 0 > Event timer "i8254" frequency 1193182 Hz quality 100 > hpet0: iomem 0xfed00000-0xfed003ff on acpi0 > Timecounter "HPET" frequency 16777216 Hz quality 950 > Event timer "HPET" frequency 16777216 Hz quality 550 > Event timer "HPET1" frequency 16777216 Hz quality 450 > Event timer "HPET2" frequency 16777216 Hz quality 450 > Event timer "HPET3" frequency 16777216 Hz quality 450 > Event timer "HPET4" frequency 16777216 Hz quality 450 > Event timer "HPET5" frequency 16777216 Hz quality 450 > Event timer "HPET6" frequency 16777216 Hz quality 450 > Event timer "HPET7" frequency 16777216 Hz quality 450 > Timecounter "ACPI-fast" frequency 3579545 Hz quality 900 > acpi_timer0: <32-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0 > pcib0: port 0xcf8-0xcff on acpi0 > pcib0: could not evaluate _ADR - AE_NOT_FOUND > pci0: on pcib0 > virtio_pci0: port 0x2000-0x207f mem 0xc0000000-0xc0001fff irq 16 at device 4.0 on pci0 > vtblk0: on virtio_pci0 > vtblk0: 10240MB (20971520 512 byte sectors) > virtio_pci1: port 0x2080-0x209f mem 0xc0002000-0xc0003fff irq 17 at device 5.0 on pci0 > vtnet0: on virtio_pci1 > vtnet0: Ethernet address: 58:9c:fc:09:e1:26 > vtnet0: netmap queues/slots: TX 1/1024, RX 1/512 > 000.000566 [ 503] vtnet_netmap_attach vtnet attached txq=1, txd=1024 rxq=1, rxd=512 > isab0: at device 31.0 on pci0 > isa0: on isab0 > atkbdc0: port 0x60,0x64 irq 1 on acpi0 > atkbd0: irq 1 on atkbdc0 > kbd0 at atkbd0 > atkbd0: [GIANT-LOCKED] > driver bug: Unable to set devclass (class: atkbdc devname: (unknown)) > psm0: irq 12 on atkbdc0 > psm0: [GIANT-LOCKED] > psm0: model Generic PS/2 mouse, device ID 0 > uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0 > uart0: console (9600,n,8,1) > uart1: <16550 or compatible> port 0x2f8-0x2ff irq 3 on acpi0 > vga0: at port 0x3b0-0x3bb iomem 0xb0000-0xb7fff on isa0 > ppc0: cannot reserve I/O port range > Timecounters tick every 10.000 msec > usb_needs_explore_all: no devclass > > Loader variables: > > Manual root filesystem specification: > : [options] > Mount using filesystem > and with the specified (optional) option list. > > eg. ufs:/dev/da0s1a > zfs:tank > cd9660:/dev/cd0 ro > (which is equivalent to: mount -t cd9660 -o ro /dev/cd0 /) > > ? List valid disk boot devices > . Yield 1 second (for background tasks) > Abort manual input > > mountroot> Then, if I just type "ufs:/dev/vtbd0a" it will start correctly. Can anyone explain why this happens and how to avoid it? bye & Thanks av. From owner-freebsd-virtualization@freebsd.org Wed Jan 13 14:29:11 2021 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 110F54DE73E for ; Wed, 13 Jan 2021 14:29:11 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 4DG8vp5NNmz4kDm for ; Wed, 13 Jan 2021 14:29:10 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id B6C364DE6FC; Wed, 13 Jan 2021 14:29:10 +0000 (UTC) Delivered-To: virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id B687F4DE5FC for ; Wed, 13 Jan 2021 14:29:10 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4DG8vp4dY1z4kW5 for ; Wed, 13 Jan 2021 14:29:10 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 8D98718F23 for ; Wed, 13 Jan 2021 14:29:10 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 10DETAlv066302 for ; Wed, 13 Jan 2021 14:29:10 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 10DETA3E066301 for virtualization@FreeBSD.org; Wed, 13 Jan 2021 14:29:10 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 251583] FreeBSD/EC2 breakage w/ encrypted EBS volumes Date: Wed, 13 Jan 2021 14:29:10 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 12.2-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: mybenext@benext.eu X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 13 Jan 2021 14:29:11 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D251583 --- Comment #7 from myBeNext --- Thank you for your quick response I will try this and confirm asap! --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-virtualization@freebsd.org Wed Jan 13 14:55:55 2021 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id C94754DF824; Wed, 13 Jan 2021 14:55:55 +0000 (UTC) (envelope-from freebsd-rwg@gndrsh.dnsmgr.net) Received: from gndrsh.dnsmgr.net (br1.CN84in.dnsmgr.net [69.59.192.140]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4DG9Vc33jFz4mNl; Wed, 13 Jan 2021 14:55:51 +0000 (UTC) (envelope-from freebsd-rwg@gndrsh.dnsmgr.net) Received: from gndrsh.dnsmgr.net (localhost [127.0.0.1]) by gndrsh.dnsmgr.net (8.13.3/8.13.3) with ESMTP id 10DEtho7041741; Wed, 13 Jan 2021 06:55:43 -0800 (PST) (envelope-from freebsd-rwg@gndrsh.dnsmgr.net) Received: (from freebsd-rwg@localhost) by gndrsh.dnsmgr.net (8.13.3/8.13.3/Submit) id 10DEthxJ041740; Wed, 13 Jan 2021 06:55:43 -0800 (PST) (envelope-from freebsd-rwg) From: "Rodney W. Grimes" Message-Id: <202101131455.10DEthxJ041740@gndrsh.dnsmgr.net> Subject: Re: [bhyve][arm64] Number of allowed vcpus In-Reply-To: To: Mihai Carabas Date: Wed, 13 Jan 2021 06:55:43 -0800 (PST) CC: Andrei Martin , freebsd-arm@freebsd.org, freebsd-virtualization@freebsd.org X-Mailer: ELM [version 2.4ME+ PL121h (25)] MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Type: text/plain; charset=US-ASCII X-Rspamd-Queue-Id: 4DG9Vc33jFz4mNl X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=none (mx1.freebsd.org: domain of freebsd-rwg@gndrsh.dnsmgr.net has no SPF policy when checking 69.59.192.140) smtp.mailfrom=freebsd-rwg@gndrsh.dnsmgr.net X-Spamd-Result: default: False [-2.10 / 15.00]; RBL_SENDERSCORE_FAIL(0.00)[69.59.192.140:server fail]; TO_DN_SOME(0.00)[]; NEURAL_HAM_SHORT(-1.00)[-1.000]; FREEMAIL_TO(0.00)[gmail.com]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; R_DKIM_NA(0.00)[]; ASN(0.00)[asn:13868, ipnet:69.59.192.0/19, country:US]; MIME_TRACE(0.00)[0:+]; MID_RHS_MATCH_FROM(0.00)[]; ARC_NA(0.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[69.59.192.140:from]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[4]; NEURAL_HAM_LONG(-1.00)[-1.000]; TAGGED_RCPT(0.00)[]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[dnsmgr.net]; AUTH_NA(1.00)[]; SPAMHAUS_ZRD(0.00)[69.59.192.140:from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; R_SPF_NA(0.00)[no SPF record]; RCVD_COUNT_TWO(0.00)[2]; FREEMAIL_CC(0.00)[gmail.com,freebsd.org]; MAILMAN_DEST(0.00)[freebsd-arm,freebsd-virtualization] X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 13 Jan 2021 14:55:55 -0000 > Hello, > > >From my perspective bhyve should use what is stated in the device tree if > no parameter is given and throw an error when N is greater than the device > tree value. > > Mihai That seems to be one reasonable solution. I am not very informed on what the CPU over commit situation is on an ARM cpu with respect to virtualization. I would also propose as an alternative to just do what was asked by the user, which is the current amd64 implementation, OR do as asked and emmit a warning message. I would ask given what was said above: isnt this the same situation as if the sum of all VM VCPU's is more than the total cores in the system? That is a very common situation, and one we must not restrict. > On Wed, Jan 13, 2021 at 1:55 PM Andrei Martin > wrote: > > > Hello, > > > > While working on enabling multiple virtual cpus for the arm64 virtual > > machine > > I used the bhyve's "-c N" parameter to create N cpus (it gets only the > > cpus, in contrast to the amd64). If N is smaller than the number of cores > > described in the device tree it will enable only N and if it's larger it > > will enable only the number of cores from the device tree. > > > > I don't know if it is the best approach. Another way would be to enable > > all the cpus from the device tree, no more, no less. > > > > Do you have any suggestions? > > > > Andrei > > > _______________________________________________ > freebsd-virtualization@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > To unsubscribe, send any mail to "freebsd-virtualization-unsubscribe@freebsd.org" > -- Rod Grimes rgrimes@freebsd.org From owner-freebsd-virtualization@freebsd.org Wed Jan 13 15:00:41 2021 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 760734DF660; Wed, 13 Jan 2021 15:00:41 +0000 (UTC) (envelope-from mihai.carabas@gmail.com) Received: from mail-lf1-x12f.google.com (mail-lf1-x12f.google.com [IPv6:2a00:1450:4864:20::12f]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4DG9c84ZSnz4mdW; Wed, 13 Jan 2021 15:00:40 +0000 (UTC) (envelope-from mihai.carabas@gmail.com) Received: by mail-lf1-x12f.google.com with SMTP id m25so3159950lfc.11; Wed, 13 Jan 2021 07:00:40 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=R4uPsGy1SSxpksfFbwvwThDOA18CQUAhIYp6B74MiFY=; b=bAl1JIJ8kMqExinQEpDJZ9OIOx7AXaA2ofjee2xwHM+yHv9ZMKk0ARXUKnt4L5EzRX ZCZ2XceM+y+yxaMm97UGqk6Mq7jp/NfLvmzxh7ItkL1dYwKlYz5Wxyco2v/I/BoVZ88D pf4qfVObDqMJZGdNEZQdvto5HRIgdYutish/SSlmUHpHvz3sgtz/zqCpEwsFhnw0JoOF qabrOSmd1u4i9694a8DaodaM3rrn0t4VvM7XWvo4lRNP5bnsE9WILyJa7AMhXFwv5rws GdKJtnr6iKEf+TtJ0XkOjNUxokpM/8ikVtiIMsnkULK36/04yxuEuz5vWEH5tgr3sanS bIrw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=R4uPsGy1SSxpksfFbwvwThDOA18CQUAhIYp6B74MiFY=; b=jUlSZ124oS5xsrjlU+VJHY3aoughToRgozHKm0PxN1ntETmW4CXjMqV26PWf5aJcS8 n9MdyDKM3mAEPXofDm3XLGYT8jwnxY65OiWtImc8+prTSW01NpYZuocy8co03OSOFkMR 3EIPzsv9iiEiCzojHghbWN6+zPvXpWul54k8fh/N7rCK6WM6tMgf/mvoMq5baKZDfvXL +7IojGgaykL0ahqOltOUElLlv3AnrXg7GlMCNmCEYrHwVPhxK96jJQNRIRvmSDpMod1D NbVPXrI3GxTsmW/0c0HKjaEsPmZtpjqefz9Xo+atMETqJbEXwjRt0iD6JUvcB3g+ixGx b7rQ== X-Gm-Message-State: AOAM530NjjgO8AyM3xyHVVdrstHY2nGaDkjaWMLC5CO/yofjTjRwMVoL tk9yCXbW5Q1Vdr/3bmDN4fORzqeovNJJ8gxOPYw= X-Google-Smtp-Source: ABdhPJyfJNJCozWMPwzL/M+JgTGTZvBA6bSX9ibTy329xZc7gjZEM/R4glYCOFyYvc6HbgQmJaE8FK2nFW0ViXvui54= X-Received: by 2002:a05:6512:33a4:: with SMTP id i4mr1105506lfg.520.1610550037357; Wed, 13 Jan 2021 07:00:37 -0800 (PST) MIME-Version: 1.0 References: <202101131455.10DEthxJ041740@gndrsh.dnsmgr.net> In-Reply-To: <202101131455.10DEthxJ041740@gndrsh.dnsmgr.net> From: Mihai Carabas Date: Wed, 13 Jan 2021 17:00:27 +0200 Message-ID: Subject: Re: [bhyve][arm64] Number of allowed vcpus To: "Rodney W. Grimes" Cc: Andrei Martin , freebsd-arm@freebsd.org, freebsd-virtualization@freebsd.org X-Rspamd-Queue-Id: 4DG9c84ZSnz4mdW X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=bAl1JIJ8; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of mihaicarabas@gmail.com designates 2a00:1450:4864:20::12f as permitted sender) smtp.mailfrom=mihaicarabas@gmail.com X-Spamd-Result: default: False [-2.00 / 15.00]; RBL_SENDERSCORE_FAIL(0.00)[2a00:1450:4864:20::12f:server fail]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36:c]; FREEMAIL_FROM(0.00)[gmail.com]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; TAGGED_FROM(0.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[2a00:1450:4864:20::12f:from]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[4]; NEURAL_SPAM_SHORT(1.00)[0.999]; NEURAL_HAM_LONG(-1.00)[-1.000]; TAGGED_RCPT(0.00)[]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; SPAMHAUS_ZRD(0.00)[2a00:1450:4864:20::12f:from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[2a00:1450:4864:20::12f:from]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-arm,freebsd-virtualization]; FREEMAIL_CC(0.00)[gmail.com,freebsd.org] Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.34 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 13 Jan 2021 15:00:41 -0000 On Wed, Jan 13, 2021 at 4:55 PM Rodney W. Grimes < freebsd-rwg@gndrsh.dnsmgr.net> wrote: > > Hello, > > > > >From my perspective bhyve should use what is stated in the device tree > if > > no parameter is given and throw an error when N is greater than the > device > > tree value. > > > > Mihai > > That seems to be one reasonable solution. I am not very informed on what > the CPU over commit situation is on an ARM cpu with respect to > virtualization. > > I would also propose as an alternative to just do what was asked by the > user, which is the current amd64 implementation, OR do as asked and > emmit a warning message. > > I would ask given what was said above: isnt this the same situation as > if the sum of all VM VCPU's is more than the total cores in the system? > That is a very common situation, and one we must not restrict. > We are talking here about the device tree of the guest. If you boot up a guest with a device tree of X vcpus, why specify something else on the command line? > > > On Wed, Jan 13, 2021 at 1:55 PM Andrei Martin < > andrei.cos.martin@gmail.com> > > wrote: > > > > > Hello, > > > > > > While working on enabling multiple virtual cpus for the arm64 virtual > > > machine > > > I used the bhyve's "-c N" parameter to create N cpus (it gets only the > > > cpus, in contrast to the amd64). If N is smaller than the number of > cores > > > described in the device tree it will enable only N and if it's larger > it > > > will enable only the number of cores from the device tree. > > > > > > I don't know if it is the best approach. Another way would be to enable > > > all the cpus from the device tree, no more, no less. > > > > > > Do you have any suggestions? > > > > > > Andrei > > > > > _______________________________________________ > > freebsd-virtualization@freebsd.org mailing list > > https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > > To unsubscribe, send any mail to " > freebsd-virtualization-unsubscribe@freebsd.org" > > > > -- > Rod Grimes > rgrimes@freebsd.org > From owner-freebsd-virtualization@freebsd.org Wed Jan 13 15:21:40 2021 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 6EB1E4E0274; Wed, 13 Jan 2021 15:21:40 +0000 (UTC) (envelope-from freebsd-rwg@gndrsh.dnsmgr.net) Received: from gndrsh.dnsmgr.net (br1.CN84in.dnsmgr.net [69.59.192.140]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4DGB4M2pX4z4pJF; Wed, 13 Jan 2021 15:21:39 +0000 (UTC) (envelope-from freebsd-rwg@gndrsh.dnsmgr.net) Received: from gndrsh.dnsmgr.net (localhost [127.0.0.1]) by gndrsh.dnsmgr.net (8.13.3/8.13.3) with ESMTP id 10DFLbDq041912; Wed, 13 Jan 2021 07:21:37 -0800 (PST) (envelope-from freebsd-rwg@gndrsh.dnsmgr.net) Received: (from freebsd-rwg@localhost) by gndrsh.dnsmgr.net (8.13.3/8.13.3/Submit) id 10DFLbPj041911; Wed, 13 Jan 2021 07:21:37 -0800 (PST) (envelope-from freebsd-rwg) From: "Rodney W. Grimes" Message-Id: <202101131521.10DFLbPj041911@gndrsh.dnsmgr.net> Subject: Re: [bhyve][arm64] Number of allowed vcpus In-Reply-To: To: Mihai Carabas Date: Wed, 13 Jan 2021 07:21:37 -0800 (PST) CC: "Rodney W. Grimes" , Andrei Martin , freebsd-arm@freebsd.org, freebsd-virtualization@freebsd.org X-Mailer: ELM [version 2.4ME+ PL121h (25)] MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Type: text/plain; charset=US-ASCII X-Rspamd-Queue-Id: 4DGB4M2pX4z4pJF X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=none (mx1.freebsd.org: domain of freebsd-rwg@gndrsh.dnsmgr.net has no SPF policy when checking 69.59.192.140) smtp.mailfrom=freebsd-rwg@gndrsh.dnsmgr.net X-Spamd-Result: default: False [-2.10 / 15.00]; RBL_SENDERSCORE_FAIL(0.00)[69.59.192.140:server fail]; TO_DN_SOME(0.00)[]; RCPT_COUNT_FIVE(0.00)[5]; NEURAL_HAM_SHORT(-1.00)[-1.000]; FREEMAIL_TO(0.00)[gmail.com]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; R_DKIM_NA(0.00)[]; ASN(0.00)[asn:13868, ipnet:69.59.192.0/19, country:US]; MIME_TRACE(0.00)[0:+]; MID_RHS_MATCH_FROM(0.00)[]; ARC_NA(0.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[69.59.192.140:from]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FROM_HAS_DN(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; TAGGED_RCPT(0.00)[]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[dnsmgr.net]; AUTH_NA(1.00)[]; SPAMHAUS_ZRD(0.00)[69.59.192.140:from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; R_SPF_NA(0.00)[no SPF record]; RCVD_COUNT_TWO(0.00)[2]; FREEMAIL_CC(0.00)[gndrsh.dnsmgr.net,gmail.com,freebsd.org]; MAILMAN_DEST(0.00)[freebsd-arm,freebsd-virtualization] X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 13 Jan 2021 15:21:40 -0000 > On Wed, Jan 13, 2021 at 4:55 PM Rodney W. Grimes < > freebsd-rwg@gndrsh.dnsmgr.net> wrote: > > > > Hello, > > > > > > >From my perspective bhyve should use what is stated in the device tree > > if > > > no parameter is given and throw an error when N is greater than the > > device > > > tree value. > > > > > > Mihai > > > > That seems to be one reasonable solution. I am not very informed on what > > the CPU over commit situation is on an ARM cpu with respect to > > virtualization. > > > > I would also propose as an alternative to just do what was asked by the > > user, which is the current amd64 implementation, OR do as asked and > > emmit a warning message. > > > > I would ask given what was said above: isnt this the same situation as > > if the sum of all VM VCPU's is more than the total cores in the system? > > That is a very common situation, and one we must not restrict. > > > > We are talking here about the device tree of the guest. If you boot up a > guest with a device tree of X vcpus, why specify something else on the > command line? Oh, that is/was not clear from the original post, it did not specify which device tree was being discussed. How do we even see the guest device tree (again, pointing to my lack of knowledge on the ARM bhyve implementation.) Also would this not be about the same as taking my flash card out of a 4 CPU system and plugging it into a 8 CPU system without updating the device tree? What would real hardware do here? > > > On Wed, Jan 13, 2021 at 1:55 PM Andrei Martin < > > andrei.cos.martin@gmail.com> > > > wrote: > > > > > > > Hello, > > > > > > > > While working on enabling multiple virtual cpus for the arm64 virtual > > > > machine > > > > I used the bhyve's "-c N" parameter to create N cpus (it gets only the > > > > cpus, in contrast to the amd64). If N is smaller than the number of > > cores > > > > described in the device tree it will enable only N and if it's larger > > it > > > > will enable only the number of cores from the device tree. > > > > > > > > I don't know if it is the best approach. Another way would be to enable > > > > all the cpus from the device tree, no more, no less. > > > > > > > > Do you have any suggestions? > > > > > > > > Andrei > > > > > > > _______________________________________________ > > > freebsd-virtualization@freebsd.org mailing list > > > https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > > > To unsubscribe, send any mail to " > > freebsd-virtualization-unsubscribe@freebsd.org" > > > > > > > -- > > Rod Grimes > > rgrimes@freebsd.org > > -- Rod Grimes rgrimes@freebsd.org From owner-freebsd-virtualization@freebsd.org Wed Jan 13 15:32:07 2021 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 371434E04FE for ; Wed, 13 Jan 2021 15:32:07 +0000 (UTC) (envelope-from ian@freebsd.org) Received: from outbound2k.ore.mailhop.org (outbound2k.ore.mailhop.org [54.148.219.64]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4DGBJQ5M8Nz4pxZ for ; Wed, 13 Jan 2021 15:32:06 +0000 (UTC) (envelope-from ian@freebsd.org) ARC-Seal: i=1; a=rsa-sha256; t=1610551925; cv=none; d=outbound.mailhop.org; s=arc-outbound20181012; b=O/vDriKaQm1RWteyIOysa03VnwKBY+ILObSMo7pnHgJBiJrNZn0FqSyc5/edyxRyXaNiSEW985CLJ v3I+Q8035aeFprFXEoKafxRF2MmxxUm4pc59eIwOZQkzTc75BeFEEmTEg6xdXQYAKFGY7k8gYos5rG yA4786J8q6ebcegfzFKBFdZobo/XwnqlTOtt+ZAe8NOkd1hTppUVJURKlJmKlJLhgeC/V19v1bbLfe dgIHQpmegG49hi2TQOhHjPpX0UsNls5Ejw/s9ZMkd38lFjWQTu9vdobHD7kAW8RAsjF7ZbZXzPOhej H80AkBR8htSHZCAwnf6oNw3Jn4YQ4kQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=outbound.mailhop.org; s=arc-outbound20181012; h=content-transfer-encoding:mime-version:content-type:references:in-reply-to: date:cc:to:from:subject:message-id:dkim-signature:from; bh=OMhOJIkKfH+9cL+kXS6tqc7ntptXPrUC5SI4UatwLI8=; b=O1KZkKynYOs+HASB+nraikAlutf5gWofAfesoFf/WXDPRRxRzqigb08BSSaxGGFMF3AsJPxMVTFvj b37XMp2nEsqdgWf5kGDfb5Ao1efj67HLy/r8iApy84dGg0jPmevPKQ7pYI+NkplGPNF+XrictsbGMb 0DFE1JtT3imPDdO2IYbV+sYbPTdFvIDwyXyrO+VJ32xI2cwDaAUpt+h7YNqdnK61SmdT3SxC6iROGR xkRlsbddFDeTItMJl9cW8k0YXN2ijr8wjWcY64/iHkB8Gg98W0ktfzH0FCXwFDV3BkSGm6MBY5WrZt wec5Z1sieU3Lmm8Oxesb3iND8+BxUyA== ARC-Authentication-Results: i=1; outbound4.ore.mailhop.org; spf=softfail smtp.mailfrom=freebsd.org smtp.remote-ip=67.177.211.60; dmarc=none header.from=freebsd.org; arc=none header.oldest-pass=0; DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=outbound.mailhop.org; s=dkim-high; h=content-transfer-encoding:mime-version:content-type:references:in-reply-to: date:cc:to:from:subject:message-id:from; bh=OMhOJIkKfH+9cL+kXS6tqc7ntptXPrUC5SI4UatwLI8=; b=cwBweLMEnqvcNUejruylUZVRYIJOuqkWAKuWqLZHoGDWO5Qg2r2YOoyAUMTHWzAAtJrRdbOKE9tVD fEKeoCcnVUWZNauH6mvYYBS6Hd6qcZTJKGyI9NhpIqdoD5feBctHwPPmvZ/7bJ0KNKexsOFBx6DmYB jpAm3KEKjkyvxA9L8Y5Ez86xl4RSsH3kO7x8j1bH8/YT/9h5qOjF1XUQXUqO8ZVYzMvlfkMaxFslEk RvA4I4eya6Y3tm9IDMZGs4pHGWeX46AqSd0JvGlWUYc2odoPjrWUp0aROsKlhlvCYOMtBBOV9UFHwk pKDvRjhe7hOctXoc6UBkkUsDIrQUaDw== X-MHO-RoutePath: aGlwcGll X-MHO-User: 7c3b6466-55b4-11eb-9e76-df46ed8f892f X-Report-Abuse-To: https://support.duocircle.com/support/solutions/articles/5000540958-duocircle-standard-smtp-abuse-information X-Originating-IP: 67.177.211.60 X-Mail-Handler: DuoCircle Outbound SMTP Received: from ilsoft.org (c-67-177-211-60.hsd1.co.comcast.net [67.177.211.60]) by outbound4.ore.mailhop.org (Halon) with ESMTPSA id 7c3b6466-55b4-11eb-9e76-df46ed8f892f; Wed, 13 Jan 2021 15:32:04 +0000 (UTC) Received: from rev (rev [172.22.42.240]) by ilsoft.org (8.15.2/8.15.2) with ESMTP id 10DFW2ga062026; Wed, 13 Jan 2021 08:32:02 -0700 (MST) (envelope-from ian@freebsd.org) Message-ID: <8fe56acedba54911107cd97e6a4752701d0bd5a0.camel@freebsd.org> Subject: Re: [bhyve][arm64] Number of allowed vcpus From: Ian Lepore To: Mihai Carabas , "Rodney W. Grimes" Cc: freebsd-arm@freebsd.org, freebsd-virtualization@freebsd.org Date: Wed, 13 Jan 2021 08:32:02 -0700 In-Reply-To: References: <202101131455.10DEthxJ041740@gndrsh.dnsmgr.net> Content-Type: text/plain; charset="ASCII" X-Mailer: Evolution 3.28.5 FreeBSD GNOME Team Mime-Version: 1.0 Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 4DGBJQ5M8Nz4pxZ X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [0.00 / 15.00]; TAGGED_RCPT(0.00)[]; ASN(0.00)[asn:16509, ipnet:54.148.0.0/15, country:US]; local_wl_from(0.00)[freebsd.org] X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 13 Jan 2021 15:32:07 -0000 On Wed, 2021-01-13 at 17:00 +0200, Mihai Carabas wrote: > We are talking here about the device tree of the guest. If you boot > up a guest with a device tree of X vcpus, why specify something else > on the command line? Because typing a command line arg is a lot easier than recompiling a device tree. IMO, these sorts of situations should always be thought of in terms of "the source of info closest to the current/interactive user rules". In device drivers I often code logic to get paramters first from devicetree data, then it can be overriden with device hints, and then that can be overridden by sysctl or tunable info (when all 3 apply). -- Ian From owner-freebsd-virtualization@freebsd.org Wed Jan 13 18:31:05 2021 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id ED93F4E4C2C for ; Wed, 13 Jan 2021 18:31:05 +0000 (UTC) (envelope-from allanjude@freebsd.org) Received: from tor1-11.mx.scaleengine.net (tor1-11.mx.scaleengine.net [IPv6:2001:470:1:474::25]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4DGGGx3Q7Lz3KBn; Wed, 13 Jan 2021 18:31:05 +0000 (UTC) (envelope-from allanjude@freebsd.org) Received: from [10.1.1.2] (Seawolf.HML3.ScaleEngine.net [209.51.186.28]) (Authenticated sender: allanjude.freebsd@scaleengine.com) by tor1-11.mx.scaleengine.net (Postfix) with ESMTPSA id AEC851A96B; Wed, 13 Jan 2021 18:30:59 +0000 (UTC) DKIM-Filter: OpenDKIM Filter v2.10.3 tor1-11.mx.scaleengine.net AEC851A96B Subject: Re: After 12.1->12.2 upgrade FreeBSD bhyve guest does not start anymore To: freebsd-virtualization@freebsd.org References: <0ed9c5b2-8113-02c4-ae7b-4dc41d3c0e02@netfence.it> Cc: Toomas Soome From: Allan Jude Message-ID: Date: Wed, 13 Jan 2021 13:30:59 -0500 User-Agent: Mozilla/5.0 (Windows NT 6.1; Win64; x64; rv:78.0) Gecko/20100101 Thunderbird/78.6.0 MIME-Version: 1.0 In-Reply-To: <0ed9c5b2-8113-02c4-ae7b-4dc41d3c0e02@netfence.it> Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: 8bit X-Rspamd-Queue-Id: 4DGGGx3Q7Lz3KBn X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [0.00 / 15.00]; local_wl_from(0.00)[freebsd.org]; ASN(0.00)[asn:6939, ipnet:2001:470::/32, country:US] X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 13 Jan 2021 18:31:06 -0000 On 2021-01-13 07:45, Andrea Venturoli wrote: > Hello. > > Due to a 12.x specific bug, I run a 11.3 guest using vm-bhyve. > This is its config: >> loader="bhyveload" >> cpu=1 >> memory=512M >> network0_type="virtio-net" >> network0_switch="public" >> disk0_type="virtio-blk" >> disk0_name="disk0" >> disk0_dev="sparse-zvol" >> uuid="..." >> network0_mac="..." > > On monday I upgraded the host from 12.1 to 12.2 and, since then, it > won't boot automatically, but will stop at the loader prompt. > > Dmesg: >> /boot/kernel/kernel text=0x1564b08 data=0x145330+0x4cdf30 >> syms=[0x8+0x16daf0+0x8+0x186a43] >> /boot/entropy size=0x1000 >> Booting... >> Copyright (c) 1992-2019 The FreeBSD Project. >> Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 >>         The Regents of the University of California. All rights reserved. >> FreeBSD is a registered trademark of The FreeBSD Foundation. >> FreeBSD 11.3-RELEASE #0 r349754: Fri Jul  5 04:45:24 UTC 2019 >>     root@releng2.nyi.freebsd.org:/usr/obj/usr/src/sys/GENERIC amd64 >> FreeBSD clang version 8.0.0 (tags/RELEASE_800/final 356365) (based on >> LLVM 8.0.0) >> VT: init without driver. >> CPU: Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz (3000.12-MHz K8-class CPU) >>   Origin="GenuineIntel"  Id=0x906e9  Family=0x6  Model=0x9e  Stepping=9 >>   >> Features=0x9f83fbff >> >>   >> Features2=0xfeda7a17 >> >>   AMD Features=0x24100800 >>   AMD Features2=0x121 >>   Structured Extended >> Features=0x40729 >>   Structured Extended Features3=0x400 >>   XSAVE Features=0x1 >>   TSC: P-state invariant >> Hypervisor: Origin = "bhyve bhyve " >> real memory  = 536870912 (512 MB) >> avail memory = 474779648 (452 MB) >> Event timer "LAPIC" quality 600 >> ACPI APIC Table: >> ioapic0 irqs 0-31 on motherboard >> Timecounter "TSC-low" frequency 1500060031 Hz quality 1000 >> random: entropy device external interface >> kbd1 at kbdmux0 >> 000.000029 [4213] netmap_init               netmap: loaded module >> module_register_init: MOD_LOAD (vesa, 0xffffffff81005eb0, 0) error 19 >> random: registering fast source Intel Secure Key RNG >> random: fast provider: "Intel Secure Key RNG" >> nexus0 >> cryptosoft0: on motherboard >> acpi0: on motherboard >> acpi0: Power Button (fixed) >> atrtc0: port 0x70-0x71 irq 8 on acpi0 >> atrtc0: registered as a time-of-day clock, resolution 1.000000s >> Event timer "RTC" frequency 32768 Hz quality 0 >> attimer0: port 0x40-0x43 irq 0 on acpi0 >> Timecounter "i8254" frequency 1193182 Hz quality 0 >> Event timer "i8254" frequency 1193182 Hz quality 100 >> hpet0: iomem 0xfed00000-0xfed003ff on acpi0 >> Timecounter "HPET" frequency 16777216 Hz quality 950 >> Event timer "HPET" frequency 16777216 Hz quality 550 >> Event timer "HPET1" frequency 16777216 Hz quality 450 >> Event timer "HPET2" frequency 16777216 Hz quality 450 >> Event timer "HPET3" frequency 16777216 Hz quality 450 >> Event timer "HPET4" frequency 16777216 Hz quality 450 >> Event timer "HPET5" frequency 16777216 Hz quality 450 >> Event timer "HPET6" frequency 16777216 Hz quality 450 >> Event timer "HPET7" frequency 16777216 Hz quality 450 >> Timecounter "ACPI-fast" frequency 3579545 Hz quality 900 >> acpi_timer0: <32-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0 >> pcib0: port 0xcf8-0xcff on acpi0 >> pcib0: could not evaluate _ADR - AE_NOT_FOUND >> pci0: on pcib0 >> virtio_pci0: port 0x2000-0x207f mem >> 0xc0000000-0xc0001fff irq 16 at device 4.0 on pci0 >> vtblk0: on virtio_pci0 >> vtblk0: 10240MB (20971520 512 byte sectors) >> virtio_pci1: port 0x2080-0x209f mem >> 0xc0002000-0xc0003fff irq 17 at device 5.0 on pci0 >> vtnet0: on virtio_pci1 >> vtnet0: Ethernet address: 58:9c:fc:09:e1:26 >> vtnet0: netmap queues/slots: TX 1/1024, RX 1/512 >> 000.000566 [ 503] vtnet_netmap_attach       vtnet attached txq=1, >> txd=1024 rxq=1, rxd=512 >> isab0: at device 31.0 on pci0 >> isa0: on isab0 >> atkbdc0: port 0x60,0x64 irq 1 on acpi0 >> atkbd0: irq 1 on atkbdc0 >> kbd0 at atkbd0 >> atkbd0: [GIANT-LOCKED] >> driver bug: Unable to set devclass (class: atkbdc devname: (unknown)) >> psm0: irq 12 on atkbdc0 >> psm0: [GIANT-LOCKED] >> psm0: model Generic PS/2 mouse, device ID 0 >> uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0 >> uart0: console (9600,n,8,1) >> uart1: <16550 or compatible> port 0x2f8-0x2ff irq 3 on acpi0 >> vga0: at port 0x3b0-0x3bb iomem 0xb0000-0xb7fff on isa0 >> ppc0: cannot reserve I/O port range >> Timecounters tick every 10.000 msec >> usb_needs_explore_all: no devclass >> >> Loader variables: >> >> Manual root filesystem specification: >>   : [options] >>       Mount using filesystem >>       and with the specified (optional) option list. >> >>     eg. ufs:/dev/da0s1a >>         zfs:tank >>         cd9660:/dev/cd0 ro >>           (which is equivalent to: mount -t cd9660 -o ro /dev/cd0 /) >> >>   ?               List valid disk boot devices >>   .               Yield 1 second (for background tasks) >>       Abort manual input >> >> mountroot> > > Then, if I just type "ufs:/dev/vtbd0a" it will start correctly. > > > Can anyone explain why this happens and how to avoid it? > > >  bye & Thanks >     av. > _______________________________________________ > freebsd-virtualization@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > To unsubscribe, send any mail to > "freebsd-virtualization-unsubscribe@freebsd.org" Do you happen to have a ZFS partition? I think some changes to some of the bootstrap (pre-loader) code that is shared with bhyve-load, means it always prefers ZFS over UFS (normally for booting a real machine, you use a different bootstrap for UFS than for ZFS, but bhyve-load is a special case. -- Allan Jude From owner-freebsd-virtualization@freebsd.org Wed Jan 13 18:50:25 2021 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id CF7D54E53BE for ; Wed, 13 Jan 2021 18:50:25 +0000 (UTC) (envelope-from ml@netfence.it) Received: from soth.netfence.it (mailserver.netfence.it [78.134.96.152]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "mailserver.netfence.it", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4DGGjD3hrDz3Llh for ; Wed, 13 Jan 2021 18:50:23 +0000 (UTC) (envelope-from ml@netfence.it) Received: from alamar.ventu (alamar.local.netfence.it [10.1.2.18]) (authenticated bits=0) by soth.netfence.it (8.16.1/8.16.1) with ESMTPSA id 10DIoJu4094623 (version=TLSv1.3 cipher=TLS_AES_128_GCM_SHA256 bits=128 verify=NO) for ; Wed, 13 Jan 2021 19:50:20 +0100 (CET) (envelope-from ml@netfence.it) X-Authentication-Warning: soth.netfence.it: Host alamar.local.netfence.it [10.1.2.18] claimed to be alamar.ventu Subject: Re: After 12.1->12.2 upgrade FreeBSD bhyve guest does not start anymore To: freebsd-virtualization@freebsd.org References: <0ed9c5b2-8113-02c4-ae7b-4dc41d3c0e02@netfence.it> From: Andrea Venturoli Message-ID: <0b45bff7-b6a1-2880-43ce-a6bb20625d70@netfence.it> Date: Wed, 13 Jan 2021 19:50:19 +0100 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:78.0) Gecko/20100101 Thunderbird/78.6.1 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 4DGGjD3hrDz3Llh X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=pass (policy=none) header.from=netfence.it; spf=pass (mx1.freebsd.org: domain of ml@netfence.it designates 78.134.96.152 as permitted sender) smtp.mailfrom=ml@netfence.it X-Spamd-Result: default: False [-3.77 / 15.00]; RCVD_TLS_ALL(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; FROM_HAS_DN(0.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[78.134.96.152:from]; TO_MATCH_ENVRCPT_ALL(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:78.134.96.152]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-virtualization@freebsd.org]; HAS_XAW(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; SPAMHAUS_ZRD(0.00)[78.134.96.152:from:127.0.2.255]; TO_DN_NONE(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; DMARC_POLICY_ALLOW(-0.50)[netfence.it,none]; NEURAL_HAM_SHORT(-0.97)[-0.967]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:35612, ipnet:78.134.0.0/17, country:IT]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[freebsd-virtualization] X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 13 Jan 2021 18:50:25 -0000 On 1/13/21 7:30 PM, Allan Jude wrote: > Do you happen to have a ZFS partition? Not sure what you mean: _ the host is all ZFS based; _ the guest has only an UFS partition. > I think some changes to some of the bootstrap (pre-loader) code that is > shared with bhyve-load, means it always prefers ZFS over UFS (normally > for booting a real machine, you use a different bootstrap for UFS than > for ZFS, but bhyve-load is a special case. I'm not following you here. Could you provide some pointers that explain this more in depth? bye & Thanks av. From owner-freebsd-virtualization@freebsd.org Thu Jan 14 04:47:27 2021 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id E47DC4D4A2A for ; Thu, 14 Jan 2021 04:47:27 +0000 (UTC) (envelope-from jtubnor@gmail.com) Received: from mail-wm1-f42.google.com (mail-wm1-f42.google.com [209.85.128.42]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4DGWy71hKCz4lYP for ; Thu, 14 Jan 2021 04:47:27 +0000 (UTC) (envelope-from jtubnor@gmail.com) Received: by mail-wm1-f42.google.com with SMTP id n16so4773359wmc.0 for ; Wed, 13 Jan 2021 20:47:27 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=XCLDy19pGnPPTXSqmoZeEDosijFTyFpVmBByCxX0O0U=; b=otnJuZP5xmQQ3m0pxwisvBVEzogbD2cXGdITSDw+DPQLMN14vC+bSonDEtWOGgDSeS myQqb7EboudAEfdP8SrScZq91RnegHXG4WYpz9q3SQ9GobmZopO8trQBCPiYLtDqFNNd ghnBuEysIDs6ZheN70FdoVMlQkVQ2ikN11nFF3bTbiEUyhdM1W3Ah83EOJm1tcIS4wcW pWaEB14rK5XoMWkpV9wHQZkyoNiN+0ZKhysbcATANygcoz7NvWoVAzMAu8pLxwgpqTur 3r8K+2Jp2zTRYGecGVOcMAdYUFz8fxugZtjunjUPQnhbsKZSffjNsFeEqPg6qzZZdZ9S sTaw== X-Gm-Message-State: AOAM5335mFnusJp52lHI0J+5sCMf35GW32UHIXv1pcATnGJ30k710+X8 mcg8XRlnvJyQgIIwwdyoQrCwxS2srbZuNKeXuIOplr2n X-Google-Smtp-Source: ABdhPJwS8ASEZalfcjdH5q4z0c5t+ioIkll6r04FsivdkhPdmnzGwnporvUSIyDgRWXZDxwaXKx3D09lCoMdheOXItw= X-Received: by 2002:a1c:cc14:: with SMTP id h20mr2034903wmb.180.1610599645737; Wed, 13 Jan 2021 20:47:25 -0800 (PST) MIME-Version: 1.0 References: <0ed9c5b2-8113-02c4-ae7b-4dc41d3c0e02@netfence.it> <0b45bff7-b6a1-2880-43ce-a6bb20625d70@netfence.it> In-Reply-To: <0b45bff7-b6a1-2880-43ce-a6bb20625d70@netfence.it> From: Jason Tubnor Date: Thu, 14 Jan 2021 15:47:15 +1100 Message-ID: Subject: Re: After 12.1->12.2 upgrade FreeBSD bhyve guest does not start anymore To: Andrea Venturoli Cc: "freebsd-virtualization@freebsd.org" X-Rspamd-Queue-Id: 4DGWy71hKCz4lYP X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of jtubnor@gmail.com designates 209.85.128.42 as permitted sender) smtp.mailfrom=jtubnor@gmail.com X-Spamd-Result: default: False [-0.98 / 15.00]; TO_DN_EQ_ADDR_SOME(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:209.85.128.0/17]; NEURAL_HAM_SHORT(-0.98)[-0.983]; RCPT_COUNT_TWO(0.00)[2]; FORGED_SENDER(0.30)[jason@tubnor.net,jtubnor@gmail.com]; MIME_TRACE(0.00)[0:+,1:+,2:~]; RBL_DBL_DONT_QUERY_IPS(0.00)[209.85.128.42:from]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:209.85.128.0/17, country:US]; FROM_NEQ_ENVFROM(0.00)[jason@tubnor.net,jtubnor@gmail.com]; ARC_NA(0.00)[]; FROM_HAS_DN(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-virtualization@freebsd.org]; DMARC_NA(0.00)[tubnor.net]; NEURAL_SPAM_MEDIUM(1.00)[1.000]; SPAMHAUS_ZRD(0.00)[209.85.128.42:from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[209.85.128.42:from]; R_DKIM_NA(0.00)[]; RWL_MAILSPIKE_POSSIBLE(0.00)[209.85.128.42:from]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-virtualization] Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.34 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 14 Jan 2021 04:47:28 -0000 On Thu, 14 Jan 2021 at 05:50, Andrea Venturoli wrote: > > > > I think some changes to some of the bootstrap (pre-loader) code that is > > shared with bhyve-load, means it always prefers ZFS over UFS (normally > > for booting a real machine, you use a different bootstrap for UFS than > > for ZFS, but bhyve-load is a special case. > > I'm not following you here. > Could you provide some pointers that explain this more in depth? > Is your guest running within a zvol? What is the volmode parameter set to on that zvol? Cheers, Jason From owner-freebsd-virtualization@freebsd.org Thu Jan 14 07:52:44 2021 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 306F54D895B for ; Thu, 14 Jan 2021 07:52:44 +0000 (UTC) (envelope-from ml@netfence.it) Received: from soth.netfence.it (mailserver.netfence.it [78.134.96.152]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "mailserver.netfence.it", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4DGc3t6ZFGz3ChY for ; Thu, 14 Jan 2021 07:52:42 +0000 (UTC) (envelope-from ml@netfence.it) Received: from alamar.ventu (alamar.local.netfence.it [10.1.2.18]) (authenticated bits=0) by soth.netfence.it (8.16.1/8.16.1) with ESMTPSA id 10E7qcCX094828 (version=TLSv1.3 cipher=TLS_AES_128_GCM_SHA256 bits=128 verify=NO); Thu, 14 Jan 2021 08:52:39 +0100 (CET) (envelope-from ml@netfence.it) X-Authentication-Warning: soth.netfence.it: Host alamar.local.netfence.it [10.1.2.18] claimed to be alamar.ventu Subject: Re: After 12.1->12.2 upgrade FreeBSD bhyve guest does not start anymore To: Jason Tubnor Cc: "freebsd-virtualization@freebsd.org" References: <0ed9c5b2-8113-02c4-ae7b-4dc41d3c0e02@netfence.it> <0b45bff7-b6a1-2880-43ce-a6bb20625d70@netfence.it> From: Andrea Venturoli Message-ID: Date: Thu, 14 Jan 2021 08:52:37 +0100 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:78.0) Gecko/20100101 Thunderbird/78.6.1 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 4DGc3t6ZFGz3ChY X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=pass (policy=none) header.from=netfence.it; spf=pass (mx1.freebsd.org: domain of ml@netfence.it designates 78.134.96.152 as permitted sender) smtp.mailfrom=ml@netfence.it X-Spamd-Result: default: False [-1.80 / 15.00]; TO_DN_EQ_ADDR_SOME(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; RCVD_TLS_ALL(0.00)[]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:78.134.96.152]; MID_RHS_MATCH_FROM(0.00)[]; MIME_GOOD(-0.10)[text/plain]; HAS_XAW(0.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[78.134.96.152:from]; NEURAL_SPAM_MEDIUM(1.00)[1.000]; SPAMHAUS_ZRD(0.00)[78.134.96.152:from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[netfence.it,none]; NEURAL_HAM_SHORT(-1.00)[-0.999]; ARC_NA(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:35612, ipnet:78.134.0.0/17, country:IT]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[freebsd-virtualization] X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 14 Jan 2021 07:52:44 -0000 On 1/14/21 5:47 AM, Jason Tubnor wrote: > Is your guest running within a zvol? Yes! I've got disk0_dev="sparse-zvol" in my vm-bhyve config file. > What is the volmode parameter set to on that zvol? # zfs get volmode zroot/vm/f11b/disk0 NAME PROPERTY VALUE SOURCE zroot/vm/f11b/disk0 volmode default default # sysctl vfs.zfs.vol.mode vfs.zfs.vol.mode: 1 I.e. "geom" Should I change that to "dev"? While I know I can change only one volume at a time, how would this impact Windows VMs? bye & Thanks av. From owner-freebsd-virtualization@freebsd.org Thu Jan 14 12:59:03 2021 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 84EAE4E14C0 for ; Thu, 14 Jan 2021 12:59:03 +0000 (UTC) (envelope-from SRS0=35cs=GR=freebsd.org=grehan@iredmail.onthenet.com.au) Received: from alto.onthenet.com.au (alto.OntheNet.com.au [203.13.68.12]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4DGksL4FJmz3pTZ for ; Thu, 14 Jan 2021 12:59:01 +0000 (UTC) (envelope-from SRS0=35cs=GR=freebsd.org=grehan@iredmail.onthenet.com.au) Received: from iredmail.onthenet.com.au (iredmail.onthenet.com.au [203.13.68.150]) by alto.onthenet.com.au (Postfix) with ESMTPS id 6AEC8209C00F for ; Thu, 14 Jan 2021 22:58:54 +1000 (AEST) Received: from iredmail.onthenet.com.au (iredmail.onthenet.com.au [127.0.0.1]) by iredmail.onthenet.com.au (Postfix) with ESMTP id 52BD220C79A7 for ; Thu, 14 Jan 2021 22:58:54 +1000 (AEST) Received: from iredmail.onthenet.com.au ([127.0.0.1]) by iredmail.onthenet.com.au (iredmail.onthenet.com.au [127.0.0.1]) (amavisd-new, port 10026) with ESMTP id nbsVw9M4ocz6 for ; Thu, 14 Jan 2021 22:58:54 +1000 (AEST) Received: from MacBook-Air-4.local (CPE-120-29-56-125.dsl.OntheNet.net [120.29.56.125]) by iredmail.onthenet.com.au (Postfix) with ESMTPSA id 0FE6F20B4AA4; Thu, 14 Jan 2021 22:58:54 +1000 (AEST) Subject: Re: [bhyve][arm64] Number of allowed vcpus To: Andrei Martin References: Cc: freebsd-arm@freebsd.org, freebsd-virtualization@freebsd.org, Elena Mihailescu , Darius Mihai , Mihai Carabas From: Peter Grehan Message-ID: <6270e79e-f442-9509-94c7-840779a99cb2@freebsd.org> Date: Thu, 14 Jan 2021 22:58:53 +1000 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.14; rv:78.0) Gecko/20100101 Thunderbird/78.5.1 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 7bit X-CMAE-Score: 0 X-CMAE-Analysis: v=2.3 cv=BZdDLol2 c=1 sm=1 tr=0 a=A6CF0fG5TOl4vs6YHvqXgw==:117 a=m3qNZo/yBXrAh/Cjk+GdxQ==:17 a=IkcTkHD0fZMA:10 a=EmqxpYm9HcoA:10 a=e4bApMnwJW7y-YsUrZUA:9 a=QEXdDO2ut3YA:10 X-Rspamd-Queue-Id: 4DGksL4FJmz3pTZ X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=none (mx1.freebsd.org: domain of SRS0=35cs=GR=freebsd.org=grehan@iredmail.onthenet.com.au has no SPF policy when checking 203.13.68.12) smtp.mailfrom=SRS0=35cs=GR=freebsd.org=grehan@iredmail.onthenet.com.au X-Spamd-Result: default: False [0.10 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_DN_SOME(0.00)[]; RWL_MAILSPIKE_GOOD(0.00)[203.13.68.12:from]; RCPT_COUNT_FIVE(0.00)[6]; NEURAL_HAM_SHORT(-1.00)[-1.000]; FREEMAIL_TO(0.00)[gmail.com]; FORGED_SENDER(0.30)[grehan@freebsd.org,SRS0=35cs=GR=freebsd.org=grehan@iredmail.onthenet.com.au]; RCVD_IN_DNSWL_LOW(-0.10)[203.13.68.12:from]; RCVD_TLS_LAST(0.00)[]; R_DKIM_NA(0.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[203.13.68.12:from]; MIME_TRACE(0.00)[0:+]; FROM_NEQ_ENVFROM(0.00)[grehan@freebsd.org,SRS0=35cs=GR=freebsd.org=grehan@iredmail.onthenet.com.au]; ASN(0.00)[asn:9313, ipnet:203.13.68.0/23, country:AU]; MID_RHS_MATCH_FROM(0.00)[]; ARC_NA(0.00)[]; RCVD_COUNT_FIVE(0.00)[5]; FROM_HAS_DN(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; TAGGED_RCPT(0.00)[]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-virtualization@freebsd.org]; AUTH_NA(1.00)[]; DMARC_NA(0.00)[freebsd.org]; SPAMHAUS_ZRD(0.00)[203.13.68.12:from:127.0.2.255]; NEURAL_SPAM_MEDIUM(1.00)[1.000]; TO_MATCH_ENVRCPT_SOME(0.00)[]; R_SPF_NA(0.00)[no SPF record]; FREEMAIL_CC(0.00)[freebsd.org,gmail.com]; MAILMAN_DEST(0.00)[freebsd-virtualization] X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 14 Jan 2021 12:59:03 -0000 Hi Andrei, > While working on enabling multiple virtual cpus for the arm64 virtual > machine > I used the bhyve's "-c N" parameter to create N cpus (it gets only the > cpus, in contrast to the amd64). If N is smaller than the number of cores > described in the device tree it will enable only N and if it's larger it > will enable only the number of cores from the device tree. > > I don't know if it is the best approach. Another way would be to enable all > the cpus from the device tree, no more, no less. > > Do you have any suggestions? My suggestion to generate the device tree based on VM configuration. bhyve on amd64 already does this for ACPI tables. (I do understand that this is more difficult for bhyveload on ARM64 since the device tree has to be known at load time, and bhyveload is only given a subset of parameters: however it may be possible to reserve space at a fixed location and then have bhyve copy a generated table into that region). later, Peter. From owner-freebsd-virtualization@freebsd.org Thu Jan 14 21:04:32 2021 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 045D64EDC73 for ; Thu, 14 Jan 2021 21:04:32 +0000 (UTC) (envelope-from jtubnor@gmail.com) Received: from mail-wr1-f49.google.com (mail-wr1-f49.google.com [209.85.221.49]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4DGxdW1RBsz3D8f for ; Thu, 14 Jan 2021 21:04:30 +0000 (UTC) (envelope-from jtubnor@gmail.com) Received: by mail-wr1-f49.google.com with SMTP id d13so7188868wrc.13 for ; Thu, 14 Jan 2021 13:04:30 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=NUY39k09HPHmutBPu9kc8+vmTw5lkQxNsSfT9e7DuMs=; b=FW0Uf5QoNZHNfO4BwgZ392Rx2kLKzi2g/Lu0tHhC3WZ+62CG7+bEeVyMLEqA8yTyBx C/6iWxcpsNBV6m5tfwJs+SKtY1hfBmEOLsgL9RXMfpJaeJaBKe/KiZ/d55UxYnCNswSH TmLdz9ukwkrbHac5U9ZZVvBtsDUP2m6KXa3/DfPpSUQYT7eYCB/kF4P1pw4E4EmwdvAI cN6BKRMEVy4eMxIWYWISoarH8eH88iWOyzzWF0H4fH7yTp8d4hAJVYitn9gZ6AuGGUqg gMTVRv1Gdc4EL5tzPHIvR/vd+32SSXVlNn1YAhIff7qYF4lL+gDHeTo6BCWqf4S/Y58V y2aA== X-Gm-Message-State: AOAM533CLgdBwK2TugV635MzpuP5CDHk/TKSR4WzUzZ7yg6Iiz+pl4wi Zx5pudNHMr0rUAmgaT4Sn5VdqtJoA2eas5rmWdvxM3qx X-Google-Smtp-Source: ABdhPJzKhCkT3zis/G33iLVPmxQj4SzKzpafTkGeNvWU2bso4/GGlSAC3rCGX4HMVQjjUcf+JwsVHEfKd3hme9ZqOwY= X-Received: by 2002:a05:6000:4b:: with SMTP id k11mr9834376wrx.76.1610658269262; Thu, 14 Jan 2021 13:04:29 -0800 (PST) MIME-Version: 1.0 References: <0ed9c5b2-8113-02c4-ae7b-4dc41d3c0e02@netfence.it> <0b45bff7-b6a1-2880-43ce-a6bb20625d70@netfence.it> In-Reply-To: From: Jason Tubnor Date: Fri, 15 Jan 2021 08:04:19 +1100 Message-ID: Subject: Re: After 12.1->12.2 upgrade FreeBSD bhyve guest does not start anymore To: Andrea Venturoli Cc: "freebsd-virtualization@freebsd.org" X-Rspamd-Queue-Id: 4DGxdW1RBsz3D8f X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of jtubnor@gmail.com designates 209.85.221.49 as permitted sender) smtp.mailfrom=jtubnor@gmail.com X-Spamd-Result: default: False [-1.00 / 15.00]; TO_DN_EQ_ADDR_SOME(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:209.85.128.0/17:c]; RCPT_COUNT_TWO(0.00)[2]; FORGED_SENDER(0.30)[jason@tubnor.net,jtubnor@gmail.com]; MIME_TRACE(0.00)[0:+,1:+,2:~]; FREEMAIL_ENVFROM(0.00)[gmail.com]; RBL_DBL_DONT_QUERY_IPS(0.00)[209.85.221.49:from]; R_DKIM_NA(0.00)[]; FROM_NEQ_ENVFROM(0.00)[jason@tubnor.net,jtubnor@gmail.com]; ASN(0.00)[asn:15169, ipnet:209.85.128.0/17, country:US]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FROM_HAS_DN(0.00)[]; NEURAL_SPAM_SHORT(1.00)[1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-virtualization@freebsd.org]; DMARC_NA(0.00)[tubnor.net]; SPAMHAUS_ZRD(0.00)[209.85.221.49:from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[209.85.221.49:from]; RWL_MAILSPIKE_POSSIBLE(0.00)[209.85.221.49:from]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-virtualization] Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.34 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 14 Jan 2021 21:04:32 -0000 On Thu, 14 Jan 2021 at 18:52, Andrea Venturoli wrote: > > > # sysctl vfs.zfs.vol.mode > vfs.zfs.vol.mode: 1 > > I.e. "geom" > > Should I change that to "dev"? > > While I know I can change only one volume at a time, how would this > impact Windows VMs? We clearly define volmode=dev on the zvol for all guests to prevent the host geom activities taking hold of the volume. Setting it to 'dev' will make the host ignore it and won't cause issues when bhyve goes to use it. This should fix the problem you are having. Let us know how you get on. Cheers, Jason. From owner-freebsd-virtualization@freebsd.org Thu Jan 14 22:55:29 2021 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id A0A094D129A for ; Thu, 14 Jan 2021 22:55:29 +0000 (UTC) (envelope-from angela@de.rideequipment.com) Received: from rideequipment.com (rideequipment.com [192.255.234.240]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4DH05X0Kjhz3Mmd for ; Thu, 14 Jan 2021 22:55:27 +0000 (UTC) (envelope-from angela@de.rideequipment.com) Received: from rideequipment.com (localhost [127.0.0.1]) by rideequipment.com (Postfix) with ESMTP id 4DH05W00XWz2NKs for ; Fri, 15 Jan 2021 06:55:26 +0800 (CST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d= de.rideequipment.com; h=content-type:subject:date:reply-to:to :from:mime-version:message-id; s=dkim; t=1610664926; x= 1642200927; bh=XD4fHL71ylHtFBjPKWUDSVYbljC1JTBRhI/P41ataHM=; b=q eQ/XQTw2C4xEG7fSCpifiQb4G2xXPHngZqh+n788JerEHStwzAsQ5vKLPne/D0Nn ZETB7GVp35gBi2FZUDdR7oEf4n8ikNx/YHzuFCwavQwVMn+VlKoNSt7zbOMfgcde yTDk0ODiGOR+R8uCnGY6LtWC0Q2Jza9zeRqmzeWTTb+Q0Z+qULTpKpYeNQnRE8VW 2SZtf7UxSVEBOeiwuRYBeISuW4lOKm4IdgCR/GBkgbaYGiachremsUy+htkcj6k4 stPrGpEzjbv1lK9AavIINax5q58deOdm0je1oUsbcwQPBKw3NjsPBttLkTPjVK9q XAmg8v6U+N7pn74Q9RyuQ== Received: from rideequipment.com ([127.0.0.1]) by rideequipment.com (rideequipment.com [127.0.0.1]) (amavisd-new, port 10026) with ESMTP id 8QR2DM23IoFv for ; Fri, 15 Jan 2021 06:55:26 +0800 (CST) Received: from DESKTOP-NVH9VDP (unknown [180.162.97.240]) by rideequipment.com (Postfix) with ESMTPSA id 4DH05V2xqWz2NJy for ; Fri, 15 Jan 2021 06:55:26 +0800 (CST) Message-ID: <20210115065522628.angela@de.rideequipment.com> MIME-Version: 1.0 Sender: "angela" From: "angela" To: "Freebsd-virtualization" Reply-To: exportercs@vip.163.com Date: 15 Jan 2021 06:55:25 +0800 Subject: sex toy and sex doll factory X-Rspamd-Queue-Id: 4DH05X0Kjhz3Mmd X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=pass header.d=de.rideequipment.com header.s=dkim header.b=q eQ/XQT; dmarc=pass (policy=none) header.from=de.rideequipment.com; spf=pass (mx1.freebsd.org: domain of angela@de.rideequipment.com designates 192.255.234.240 as permitted sender) smtp.mailfrom=angela@de.rideequipment.com X-Spamd-Result: default: False [-1.03 / 15.00]; HAS_REPLYTO(0.00)[exportercs@vip.163.com]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_SPF_ALLOW(-0.20)[+a]; RCVD_COUNT_THREE(0.00)[4]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[de.rideequipment.com:+]; DMARC_POLICY_ALLOW(-0.50)[de.rideequipment.com,none]; NEURAL_HAM_SHORT(-1.00)[-1.000]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[192.255.234.240:from]; ASN(0.00)[asn:54290, ipnet:192.255.234.0/23, country:US]; MIME_TRACE(0.00)[0:+,1:+,2:~]; RECEIVED_SPAMHAUS_PBL(0.00)[180.162.97.240:received]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[de.rideequipment.com:s=dkim]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-virtualization@freebsd.org]; FREEMAIL_REPLYTO(0.00)[vip.163.com]; NEURAL_SPAM_MEDIUM(0.92)[0.919]; REPLYTO_DOM_NEQ_FROM_DOM(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; MANY_INVISIBLE_PARTS(0.05)[1]; SPAMHAUS_ZRD(0.00)[192.255.234.240:from:127.0.2.255]; MID_CONTAINS_FROM(1.00)[]; MAILMAN_DEST(0.00)[freebsd-virtualization] Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.34 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 14 Jan 2021 22:55:29 -0000 how are you?We produce and supply sex toy and sex dollin China.Co= ntact me please, let's discuss any possibility of cooperation.hav= e a nice day!Mr Jack chen Sale Director =20 From owner-freebsd-virtualization@freebsd.org Fri Jan 15 08:43:23 2021 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id DCFC64DD05B for ; Fri, 15 Jan 2021 08:43:23 +0000 (UTC) (envelope-from ml@netfence.it) Received: from soth.netfence.it (mailserver.netfence.it [78.134.96.152]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "mailserver.netfence.it", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4DHF7t4WlKz4cVd for ; Fri, 15 Jan 2021 08:43:22 +0000 (UTC) (envelope-from ml@netfence.it) Received: from alamar.ventu (alamar.local.netfence.it [10.1.2.18]) (authenticated bits=0) by soth.netfence.it (8.16.1/8.16.1) with ESMTPSA id 10F8hDK5038728 (version=TLSv1.3 cipher=TLS_AES_128_GCM_SHA256 bits=128 verify=NO); Fri, 15 Jan 2021 09:43:14 +0100 (CET) (envelope-from ml@netfence.it) X-Authentication-Warning: soth.netfence.it: Host alamar.local.netfence.it [10.1.2.18] claimed to be alamar.ventu Subject: Re: After 12.1->12.2 upgrade FreeBSD bhyve guest does not start anymore To: Jason Tubnor Cc: "freebsd-virtualization@freebsd.org" References: <0ed9c5b2-8113-02c4-ae7b-4dc41d3c0e02@netfence.it> <0b45bff7-b6a1-2880-43ce-a6bb20625d70@netfence.it> From: Andrea Venturoli Message-ID: <4a54bba1-75d4-1e9e-69a3-e5ec549d33c3@netfence.it> Date: Fri, 15 Jan 2021 09:43:13 +0100 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:78.0) Gecko/20100101 Thunderbird/78.6.1 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 8bit X-Rspamd-Queue-Id: 4DHF7t4WlKz4cVd X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=pass (policy=none) header.from=netfence.it; spf=pass (mx1.freebsd.org: domain of ml@netfence.it designates 78.134.96.152 as permitted sender) smtp.mailfrom=ml@netfence.it X-Spamd-Result: default: False [-3.80 / 15.00]; TO_DN_EQ_ADDR_SOME(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; RCVD_TLS_ALL(0.00)[]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:78.134.96.152]; MID_RHS_MATCH_FROM(0.00)[]; MIME_GOOD(-0.10)[text/plain]; HAS_XAW(0.00)[]; ARC_NA(0.00)[]; SPAMHAUS_ZRD(0.00)[78.134.96.152:from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[78.134.96.152:from]; NEURAL_HAM_LONG(-1.00)[-1.000]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[netfence.it,none]; NEURAL_HAM_SHORT(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:35612, ipnet:78.134.0.0/17, country:IT]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[freebsd-virtualization] X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 15 Jan 2021 08:43:23 -0000 On 1/14/21 10:04 PM, Jason Tubnor wrote: > We clearly define volmode=dev on the zvol for all guests to prevent the > host geom activities taking hold of the volume.  Setting it to 'dev' > will make the host ignore it and won't cause issues when bhyve goes to > use it. > > This should fix the problem you are having.  Let us know how you get on. I tried this, but it did not help. I still need to connect to the guest via (virtual) serial line and manually specify the root device in order to boot it. bye & thanks av. From owner-freebsd-virtualization@freebsd.org Fri Jan 15 13:00:50 2021 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 7788B4E52B6; Fri, 15 Jan 2021 13:00:50 +0000 (UTC) (envelope-from andrei.cos.martin@gmail.com) Received: from mail-pl1-x634.google.com (mail-pl1-x634.google.com [IPv6:2607:f8b0:4864:20::634]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4DHLrx5hmqz4v8T; Fri, 15 Jan 2021 13:00:49 +0000 (UTC) (envelope-from andrei.cos.martin@gmail.com) Received: by mail-pl1-x634.google.com with SMTP id s15so4661319plr.9; Fri, 15 Jan 2021 05:00:49 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to; bh=Tq0epQ3abQiApC9J55dqC5pJKfs/ZIo4Ws+HXcK3Jxc=; b=dDxnsKCMgJwOoi9jqqDi0/cQJXxuxvOp+1rZyzS0tMmhhvR9rRvutGiqNhV7fW0AVx lMWcvsNHf+zSi2O+MOZhxbntNw77pbIF3F/7wjIVO4MF109E8gNChGtWNwm5kevBK8QG kG072Ck4pXxlAcqTywMFk26sQcd9UMTlZcvOMysw/vBfgWJcqNn1rUwZr+Yz7i13KUCS MEWUFUpi0kN3QeWYzjcJ9l8gPRflK24Sct1E1CMzayCOIws4IGE8i0rwU26X75KntDTR FUD9i2IgITixSSl7YvllvvgKq5OJHwXovW0i13TW7CR2BRPi0i97FRd3IUlSTHr3Q78i mCqg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to; bh=Tq0epQ3abQiApC9J55dqC5pJKfs/ZIo4Ws+HXcK3Jxc=; b=V5RdccoL9lXsFvYl20Y4r9cbm1PQ8v6Mv3V3PMTy7vENqQpkOK2mGmNtpI3E3xJjqY +ZZc7EMCThGZJTQwUmY/rkcvhCYpmVJloorby4NGLVNicMHwG9txLxuVI2r1GbCAcXe2 me3Sfk9x+VNBiBQ6/luMHPObcX0gtusYRXIEmxT6kRhv0YXXFmk8jTd2NBV0QVEOZj1k CZUH7GxDG7xQPzY5Rk8Reiay5LBLIy4J0JOJToa3BQaCjIN+EzSQq3fcC/u7FkEwf5Xy xFnvbQzcEPV+TPkuVz09udZRPl220UHhFM00PSl+O/ohymkyntzjxaGqvVP47VAxzNha GkmA== X-Gm-Message-State: AOAM530cgm/OM6Jd8YpMcjP7zwERxWR9Sqx0iYeE+Z2AkoktgoPOkvHM WQgLWmrnVGgoGOuOe86fWz/+7IChvKESqzkdxWkOya3RnNE= X-Google-Smtp-Source: ABdhPJy4tupDbrEoIglVV/CUdgj5cf+ZYXHeb0tzvQZ0YoCg97MMJy+6eRNQ8d03psUfygwefHqDNJCtbAwU4Wz8snQ= X-Received: by 2002:a17:90a:a608:: with SMTP id c8mr10332241pjq.61.1610715648668; Fri, 15 Jan 2021 05:00:48 -0800 (PST) MIME-Version: 1.0 References: In-Reply-To: From: Andrei Martin Date: Fri, 15 Jan 2021 15:00:37 +0200 Message-ID: Subject: Re: [bhyve][arm64] Number of allowed vcpus To: freebsd-arm@freebsd.org, freebsd-virtualization@freebsd.org, Mihai Carabas , Darius Mihai , Elena Mihailescu X-Rspamd-Queue-Id: 4DHLrx5hmqz4v8T X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=dDxnsKCM; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of andreicosmartin@gmail.com designates 2607:f8b0:4864:20::634 as permitted sender) smtp.mailfrom=andreicosmartin@gmail.com X-Spamd-Result: default: False [-2.00 / 15.00]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36:c]; FREEMAIL_FROM(0.00)[gmail.com]; RCPT_COUNT_FIVE(0.00)[5]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; FREEMAIL_TO(0.00)[freebsd.org,gmail.com]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; RBL_DBL_DONT_QUERY_IPS(0.00)[2607:f8b0:4864:20::634:from]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; TAGGED_FROM(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; FROM_HAS_DN(0.00)[]; NEURAL_SPAM_SHORT(1.00)[1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; TAGGED_RCPT(0.00)[]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; SPAMHAUS_ZRD(0.00)[2607:f8b0:4864:20::634:from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::634:from]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-arm,freebsd-virtualization] Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.34 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 15 Jan 2021 13:00:50 -0000 Thanks for you responses and sorry for not specifying the guest's device tree. I've summed up your proposals and sketched and algorithm: N - the number of vcpus from the '-c' parameter X - the number of vcpus from the device tree if there isn't the parameter -> start the vm with X vcpus if there is the parameter --> if N <= X -> start the vm with N parameters |-> if N > X -> throw an error I believe this gives the opportunity to rebuild the device tree and use all vcpus (first branch) or let the device tree as it is (more vcpus) but use only a subset of them. Is this alright? Thanks, Andrei On Wed, Jan 13, 2021 at 1:55 PM Andrei Martin wrote: > Hello, > > While working on enabling multiple virtual cpus for the arm64 virtual > machine > I used the bhyve's "-c N" parameter to create N cpus (it gets only the > cpus, in contrast to the amd64). If N is smaller than the number of cores > described in the device tree it will enable only N and if it's larger it > will enable only the number of cores from the device tree. > > I don't know if it is the best approach. Another way would be to enable > all the cpus from the device tree, no more, no less. > > Do you have any suggestions? > > Andrei > From owner-freebsd-virtualization@freebsd.org Sat Jan 16 03:38:14 2021 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 305464D1241 for ; Sat, 16 Jan 2021 03:38:14 +0000 (UTC) (envelope-from SRS0=Nbek=GT=freebsd.org=grehan@iredmail.onthenet.com.au) Received: from alto.onthenet.com.au (alto.OntheNet.com.au [203.13.68.12]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4DHkKJ6vRDz4l6G for ; Sat, 16 Jan 2021 03:38:12 +0000 (UTC) (envelope-from SRS0=Nbek=GT=freebsd.org=grehan@iredmail.onthenet.com.au) Received: from iredmail.onthenet.com.au (iredmail.onthenet.com.au [203.13.68.150]) by alto.onthenet.com.au (Postfix) with ESMTPS id D26242094A5E for ; Sat, 16 Jan 2021 13:38:06 +1000 (AEST) Received: from iredmail.onthenet.com.au (iredmail.onthenet.com.au [127.0.0.1]) by iredmail.onthenet.com.au (Postfix) with ESMTP id B99A720B4D20 for ; Sat, 16 Jan 2021 13:38:06 +1000 (AEST) Received: from iredmail.onthenet.com.au ([127.0.0.1]) by iredmail.onthenet.com.au (iredmail.onthenet.com.au [127.0.0.1]) (amavisd-new, port 10026) with ESMTP id IXqVATHk8X_u for ; Sat, 16 Jan 2021 13:38:06 +1000 (AEST) Received: from MacBook-Air-4.local (unknown [120.29.44.245]) by iredmail.onthenet.com.au (Postfix) with ESMTPSA id 7314F20B4AA4; Sat, 16 Jan 2021 13:38:05 +1000 (AEST) Subject: Re: [bhyve][arm64] Number of allowed vcpus To: Andrei Martin References: Cc: freebsd-arm@freebsd.org, freebsd-virtualization@freebsd.org, Mihai Carabas , Elena Mihailescu , Darius Mihai From: Peter Grehan Message-ID: Date: Sat, 16 Jan 2021 13:38:05 +1000 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.14; rv:78.0) Gecko/20100101 Thunderbird/78.5.1 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 7bit X-CMAE-Score: 0 X-CMAE-Analysis: v=2.3 cv=BZdDLol2 c=1 sm=1 tr=0 a=A6CF0fG5TOl4vs6YHvqXgw==:117 a=vPr5hKY0Sloooc5EDKN//A==:17 a=IkcTkHD0fZMA:10 a=EmqxpYm9HcoA:10 a=6KiUTCuZYJAcem8CLqcA:9 a=QEXdDO2ut3YA:10 X-Rspamd-Queue-Id: 4DHkKJ6vRDz4l6G X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=none (mx1.freebsd.org: domain of SRS0=Nbek=GT=freebsd.org=grehan@iredmail.onthenet.com.au has no SPF policy when checking 203.13.68.12) smtp.mailfrom=SRS0=Nbek=GT=freebsd.org=grehan@iredmail.onthenet.com.au X-Spamd-Result: default: False [-1.90 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_DN_SOME(0.00)[]; RWL_MAILSPIKE_GOOD(0.00)[203.13.68.12:from]; RCPT_COUNT_FIVE(0.00)[6]; NEURAL_HAM_SHORT(-1.00)[-1.000]; FREEMAIL_TO(0.00)[gmail.com]; FORGED_SENDER(0.30)[grehan@freebsd.org,SRS0=Nbek=GT=freebsd.org=grehan@iredmail.onthenet.com.au]; RCVD_IN_DNSWL_LOW(-0.10)[203.13.68.12:from]; RCVD_TLS_LAST(0.00)[]; R_DKIM_NA(0.00)[]; ASN(0.00)[asn:9313, ipnet:203.13.68.0/23, country:AU]; MIME_TRACE(0.00)[0:+]; MID_RHS_MATCH_FROM(0.00)[]; FROM_NEQ_ENVFROM(0.00)[grehan@freebsd.org,SRS0=Nbek=GT=freebsd.org=grehan@iredmail.onthenet.com.au]; RBL_DBL_DONT_QUERY_IPS(0.00)[203.13.68.12:from]; RCVD_COUNT_FIVE(0.00)[5]; ARC_NA(0.00)[]; FROM_HAS_DN(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; TAGGED_RCPT(0.00)[]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-virtualization@freebsd.org]; AUTH_NA(1.00)[]; DMARC_NA(0.00)[freebsd.org]; SPAMHAUS_ZRD(0.00)[203.13.68.12:from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; R_SPF_NA(0.00)[no SPF record]; FREEMAIL_CC(0.00)[freebsd.org,gmail.com]; MAILMAN_DEST(0.00)[freebsd-virtualization] X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 16 Jan 2021 03:38:14 -0000 Hi Andrei, > I've summed up your proposals and sketched and algorithm: > N - the number of vcpus from the '-c' parameter > X - the number of vcpus from the device tree > > if there isn't the parameter -> start the vm with X vcpus > if there is the parameter --> if N <= X -> start the vm with N parameters > |-> if N > X -> throw an error > > I believe this gives the opportunity to rebuild the device tree and use all > vcpus (first branch) > or let the device tree as it is (more vcpus) but use only a subset of them. > Is this alright? If you are going to have the ability to rebuild the device tree, you might as well do it every time. If a user hasn't specified how many vCPUs on the command line, it's safe to assume a default of 1. later, Peter.