From owner-freebsd-virtualization@freebsd.org Thu Jan 14 21:04:32 2021 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 045D64EDC73 for ; Thu, 14 Jan 2021 21:04:32 +0000 (UTC) (envelope-from jtubnor@gmail.com) Received: from mail-wr1-f49.google.com (mail-wr1-f49.google.com [209.85.221.49]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4DGxdW1RBsz3D8f for ; Thu, 14 Jan 2021 21:04:30 +0000 (UTC) (envelope-from jtubnor@gmail.com) Received: by mail-wr1-f49.google.com with SMTP id d13so7188868wrc.13 for ; Thu, 14 Jan 2021 13:04:30 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=NUY39k09HPHmutBPu9kc8+vmTw5lkQxNsSfT9e7DuMs=; b=FW0Uf5QoNZHNfO4BwgZ392Rx2kLKzi2g/Lu0tHhC3WZ+62CG7+bEeVyMLEqA8yTyBx C/6iWxcpsNBV6m5tfwJs+SKtY1hfBmEOLsgL9RXMfpJaeJaBKe/KiZ/d55UxYnCNswSH TmLdz9ukwkrbHac5U9ZZVvBtsDUP2m6KXa3/DfPpSUQYT7eYCB/kF4P1pw4E4EmwdvAI cN6BKRMEVy4eMxIWYWISoarH8eH88iWOyzzWF0H4fH7yTp8d4hAJVYitn9gZ6AuGGUqg gMTVRv1Gdc4EL5tzPHIvR/vd+32SSXVlNn1YAhIff7qYF4lL+gDHeTo6BCWqf4S/Y58V y2aA== X-Gm-Message-State: AOAM533CLgdBwK2TugV635MzpuP5CDHk/TKSR4WzUzZ7yg6Iiz+pl4wi Zx5pudNHMr0rUAmgaT4Sn5VdqtJoA2eas5rmWdvxM3qx X-Google-Smtp-Source: ABdhPJzKhCkT3zis/G33iLVPmxQj4SzKzpafTkGeNvWU2bso4/GGlSAC3rCGX4HMVQjjUcf+JwsVHEfKd3hme9ZqOwY= X-Received: by 2002:a05:6000:4b:: with SMTP id k11mr9834376wrx.76.1610658269262; Thu, 14 Jan 2021 13:04:29 -0800 (PST) MIME-Version: 1.0 References: <0ed9c5b2-8113-02c4-ae7b-4dc41d3c0e02@netfence.it> <0b45bff7-b6a1-2880-43ce-a6bb20625d70@netfence.it> In-Reply-To: From: Jason Tubnor Date: Fri, 15 Jan 2021 08:04:19 +1100 Message-ID: Subject: Re: After 12.1->12.2 upgrade FreeBSD bhyve guest does not start anymore To: Andrea Venturoli Cc: "freebsd-virtualization@freebsd.org" X-Rspamd-Queue-Id: 4DGxdW1RBsz3D8f X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of jtubnor@gmail.com designates 209.85.221.49 as permitted sender) smtp.mailfrom=jtubnor@gmail.com X-Spamd-Result: default: False [-1.00 / 15.00]; TO_DN_EQ_ADDR_SOME(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:209.85.128.0/17:c]; RCPT_COUNT_TWO(0.00)[2]; FORGED_SENDER(0.30)[jason@tubnor.net,jtubnor@gmail.com]; MIME_TRACE(0.00)[0:+,1:+,2:~]; FREEMAIL_ENVFROM(0.00)[gmail.com]; RBL_DBL_DONT_QUERY_IPS(0.00)[209.85.221.49:from]; R_DKIM_NA(0.00)[]; FROM_NEQ_ENVFROM(0.00)[jason@tubnor.net,jtubnor@gmail.com]; ASN(0.00)[asn:15169, ipnet:209.85.128.0/17, country:US]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FROM_HAS_DN(0.00)[]; NEURAL_SPAM_SHORT(1.00)[1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-virtualization@freebsd.org]; DMARC_NA(0.00)[tubnor.net]; SPAMHAUS_ZRD(0.00)[209.85.221.49:from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[209.85.221.49:from]; RWL_MAILSPIKE_POSSIBLE(0.00)[209.85.221.49:from]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-virtualization] Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.34 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 14 Jan 2021 21:04:32 -0000 On Thu, 14 Jan 2021 at 18:52, Andrea Venturoli wrote: > > > # sysctl vfs.zfs.vol.mode > vfs.zfs.vol.mode: 1 > > I.e. "geom" > > Should I change that to "dev"? > > While I know I can change only one volume at a time, how would this > impact Windows VMs? We clearly define volmode=dev on the zvol for all guests to prevent the host geom activities taking hold of the volume. Setting it to 'dev' will make the host ignore it and won't cause issues when bhyve goes to use it. This should fix the problem you are having. Let us know how you get on. Cheers, Jason.