From nobody Mon Dec 2 19:53:34 2024 X-Original-To: freebsd-virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Y2Dxx2PhCz5gLlt for ; Mon, 02 Dec 2024 19:54:13 +0000 (UTC) (envelope-from marietto2008@gmail.com) Received: from mail-pl1-x62a.google.com (mail-pl1-x62a.google.com [IPv6:2607:f8b0:4864:20::62a]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "WR4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Y2Dxw4QQqz4r08 for ; Mon, 2 Dec 2024 19:54:12 +0000 (UTC) (envelope-from marietto2008@gmail.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20230601 header.b=E8xkQNqM; spf=pass (mx1.freebsd.org: domain of marietto2008@gmail.com designates 2607:f8b0:4864:20::62a as permitted sender) smtp.mailfrom=marietto2008@gmail.com; dmarc=pass (policy=none) header.from=gmail.com Received: by mail-pl1-x62a.google.com with SMTP id d9443c01a7336-21539e1d09cso42354195ad.1 for ; Mon, 02 Dec 2024 11:54:12 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1733169250; x=1733774050; darn=freebsd.org; h=to:subject:message-id:date:from:mime-version:from:to:cc:subject :date:message-id:reply-to; bh=FDH6q69zzcRaTw4DVlpnshLrr1NcfGRtf33A6lqyXmQ=; b=E8xkQNqMuA5sFMQUcW6cyPT53PqsnOPekFV5LwYDjNnDzdVVRzEkqK4bqXsjCsOwGW rq6Mx/AwPcYec/Rhu6g6FLELnGw0UZmXgBYAxbNV3TOuiGs18iu1C54PevTQAgo05TNn V5usV24S7j5n0ON9oYZ4IJOM76jCFSJLBKs9seR/DUmNEQ0sN2a9T8gTMQ4J4h6p88GA nKnluty0loji8ULmOc9OoqBYgvghsgJS3ubUfT4uJjt46ed6WpSqgVJwGmukJUQb/q42 hukPgkPVzsAK6VKw/QV4X7cjpCEONbHnfPp66EHAWsHjhj1VV3q0VGMTNhtxE8wgGiWO jrbg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1733169250; x=1733774050; h=to:subject:message-id:date:from:mime-version:x-gm-message-state :from:to:cc:subject:date:message-id:reply-to; bh=FDH6q69zzcRaTw4DVlpnshLrr1NcfGRtf33A6lqyXmQ=; b=Iwr26ZdODRJrkUbWvw+MS0DkQsXm16zwslmmF4MzKSkezQM9+ftr1hR7iWGkj7ZwFE YdnI5W024BL5qea4aby2IjEeDWdp3gSI7pdLBspXtxZTc5f8EZAPhOxI+qgykvqxW1/q rsKTRj1a/FWlRXAEK2Dyb6O9ZkOt933ToaLIHJYHDwluAlk4rwCzgG760EeUyLQtUXdS GU00X9XYCF6MFNdh5cx1H9/lUDV6rgzzHHnHc85fx9mwsLMALw4wTcRlibFxaRlwhiY6 LpaHauVSz3fDJjhdw/ym1tSkjMnu37dddjAhYMnmr1Lo0BAR1RXYBP3Z/6Y/avJWJUqM qU2w== X-Forwarded-Encrypted: i=1; AJvYcCXG6owv+zoNWwVm3GsiEuu1dDq35rb8//WLmEl1p3PwFj2cf/TCBRURWV0tJusXIuPzV8t6fTtIXJ3sQ1pN3dDn85byl0ND@freebsd.org X-Gm-Message-State: AOJu0Yy4b3Nx18H7p+0kqqCVs2p2sXry1zuCRnhkoAybARTsc7e4S3W8 +iQcWKvCw4KfvLZQFqAlU6BklaDZ27mv+ty55Pp8nOGZOcSV7XqGM0qVFuCvs5Zt7socVhW8Ddu uBuZzg2GnSN6EOGJ/03YQOpEQSZQ24u+1WTyBaA== X-Gm-Gg: ASbGncvb+9q0rHniaCsNMrN7L5IvbS8KhxCfIo/bArCaLJeTWvSgOBE/LBkN3uHMisg WdNORGim/RgLNIvZ/NNIPoEvI0QLT1T9p X-Google-Smtp-Source: AGHT+IEV7niefaQwCveKX20zYBYNhx6zZBRHeukVJkDSLdBqDxftNqyxcJAq+0aXYU2YFagbJAoK+fj/a3hKQsxI3O8= X-Received: by 2002:a17:903:2350:b0:215:7e49:81f5 with SMTP id d9443c01a7336-2157e498436mr107289375ad.42.1733169250144; Mon, 02 Dec 2024 11:54:10 -0800 (PST) List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-virtualization@freebsd.org Sender: owner-freebsd-virtualization@FreeBSD.org MIME-Version: 1.0 From: Mario Marietto Date: Mon, 2 Dec 2024 20:53:34 +0100 Message-ID: Subject: Failed to emulate instruction sequence [ 41f646040874064c017d88eb144c89 ] at 0xbea5fcf9 To: =?UTF-8?Q?Corvin_K=C3=B6hne?= , FreeBSD virtualization Content-Type: multipart/alternative; boundary="0000000000007d9c6c06284ee95c" X-Spamd-Result: default: False [-1.58 / 15.00]; HTTP_TO_IP(1.00)[]; URI_COUNT_ODD(1.00)[1]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.58)[-0.578]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36:c]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20230601]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; FREEMAIL_ENVFROM(0.00)[gmail.com]; RCVD_TLS_LAST(0.00)[]; FREEMAIL_FROM(0.00)[gmail.com]; TO_DN_ALL(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; RCPT_COUNT_TWO(0.00)[2]; ARC_NA(0.00)[]; FROM_HAS_DN(0.00)[]; MISSING_XM_UA(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-virtualization@freebsd.org]; TO_MATCH_ENVRCPT_SOME(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; MID_RHS_MATCH_FROMTLD(0.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; MLMMJ_DEST(0.00)[freebsd-virtualization@freebsd.org]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; RCVD_COUNT_ONE(0.00)[1]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::62a:from] X-Rspamd-Queue-Id: 4Y2Dxw4QQqz4r08 X-Spamd-Bar: - --0000000000007d9c6c06284ee95c Content-Type: text/plain; charset="UTF-8" Hello to everyone. Recently I've upgraded one of my FreeBSD systems and I see a strange error when I try to boot Android 7.1.1. I have never seen this error before and I also have another system where I haven't applied the latest pkg upgrades where Android is still able to boot. The bhyve parameters that I use in both systems are the following : /usr/sbin/./bhyve -S -c sockets=2,cores=2,threads=2 -m 8G -w -H -A \ -s 0,hostbridge \ -s 1,ahci-hd,/mnt/zroot-133/bhyve/img/Android/DarkMatter-qemu.img,bootindex=1 \ -s 8:0,passthru,4/0/0 \ -s 11,hda,play=/dev/dsp,rec=/dev/dsp \ -s 13,virtio-net,tap13 \ -s 29,fbuf,tcp=0.0.0.0:5913,w=1440,h=900,wait \ -s 30,xhci,tablet \ -s 31,lpc \ -l bootrom,/usr/local/share/uefi-firmware/BHYVE_UEFI_CODE.fd,/usr/local/share/uefi-firmware/BHYVE_UEFI_VARS.fd \ vm0:13 < /dev/null & sleep 5 && vncviewer 0:13 && echo vncviewer 0:13 & The error I get on this ZFS system : FreeBSD marietto 14.1-RELEASE-p5 FreeBSD 14.1-RELEASE-p5 GENERIC amd64 is : *Failed to emulate instruction sequence [ 41f646040874064c017d88eb144c89 ] at 0xbea5fcf9* But I don't get this error on the system installed on the UFS disk (it is also 14.1-RELEASE-p5 FreeBSD 14.1-RELEASE-p5 GENERIC amd64). Any suggestions about how I can fix it ? Thanks very much. -- Mario. --0000000000007d9c6c06284ee95c Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
Hello to everyone.

Recently = I've upgraded one of my FreeBSD systems and I see a strange error when = I try to boot Android 7.1.1. I have never seen this error before and I also= have another system where I haven't applied the latest pkg upgrades wh= ere Android is still able to boot.
The bhyve parameters that= I use in both systems are the following :

/usr/sb= in/./bhyve -S -c sockets=3D2,cores=3D2,threads=3D2 -m 8G -w -H -A \
-s 0= ,hostbridge \
-s 1,ahci-hd,/mnt/zroot-133/bhyve/img/Android/DarkMatter-q= emu.img,bootindex=3D1 \
-s 8:0,passthru,4/0/0 \
-s 11,hda,play=3D/dev= /dsp,rec=3D/dev/dsp \
-s 13,virtio-net,tap13 \
-s 29,fbuf,tcp=3D0.0.0.0:5913,w=3D1440,h=3D900,wait \
-s 3= 0,xhci,tablet \
-s 31,lpc \
-l bootrom,/usr/local/share/uefi-firmware= /BHYVE_UEFI_CODE.fd,/usr/local/share/uefi-firmware/BHYVE_UEFI_VARS.fd \
= vm0:13 < /dev/null & sleep 5 && vncviewer 0:13 && ec= ho vncviewer 0:13 &

The error I get on this ZF= S system :

FreeBSD marietto 14.1-RELEASE-p5 FreeBS= D 14.1-RELEASE-p5 GENERIC amd64

is :
Failed to emulate instruction sequence [ 41f646040874064c017= d88eb144c89 ] at 0xbea5fcf9

But I don'= t get this error on the system installed on the UFS disk (it is also 14.1-R= ELEASE-p5 FreeBSD 14.1-RELEASE-p5 GENERIC amd64). Any suggestions about how= I can fix it ?

Thanks very much.

--
Mario.
--0000000000007d9c6c06284ee95c-- From nobody Mon Dec 2 20:14:14 2024 X-Original-To: freebsd-virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Y2FPF65DHz5gMp8 for ; Mon, 02 Dec 2024 20:14:25 +0000 (UTC) (envelope-from mp@freebsd.org) Received: from smtp.freebsd.org (smtp.freebsd.org [IPv6:2610:1c1:1:606c::24b:4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R10" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Y2FPF5VrWz4tTC for ; Mon, 2 Dec 2024 20:14:25 +0000 (UTC) (envelope-from mp@freebsd.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1733170465; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=qLrtCxm1GdSwNogNyVS36BBIy/0kAekO8HZm3EYskaU=; b=LXCg51O15/Wh3lLbYE4K3/JjsqrdPlc4WTuLndY/zonBN+ADrG9/yo5ek0KOJ77x9mYL32 p47smB6gEVXpSelXGKH1RKIwO8Ai+SJLOryQDSagPMPixTaD3O2yJK9HUqfP8xPnLA9HOf tGaT6YsJyIsVw1yXYql91VbhPaCqDAeVzBQpodmbCpHeIPkjeMSafz9EU4tiIYgFviQQ50 w4ygQjeY4zClU8z0mzuj66mRPI7k5jpHzIBBJqWouLjbgxI/5Pa1UjuWvNDu8IS2Iw874u fuUlG1SYFrM/F7BCd9rvwU5/vtMHXItkxKbupWkfrVkTpxi5XKVL9e6dpudBPQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1733170465; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=qLrtCxm1GdSwNogNyVS36BBIy/0kAekO8HZm3EYskaU=; b=Iay8ELPDD4RHp5/wDeWmWwO1rgYxRlwiMu40Oo+1UkkQNmkktUB83evQyUvNJC9+LEho7t DK+MIa7HTZgLznfZRz92BD6wlRIYey6srB8HOvw4hMhEkSlQY4zoQoHprVtjfzN/jvOW+y E9cR0qak8UMzNKLRvUrsdB8yAKfCXJTNC0pJ73t7wX1dzVjPD5dG8ErQCV2NbMwRsZ0+wF X6AhIT1/HWdOGeR4yQ2Whh4IQ0NcPz16Kj3NcNv4w+Q9HwPRykmEpbN4IGi0hK3xoLTQhA akrKMQerAP2PwgZnrtfVbumHp2nJnPwY8x1MJQjF56NN/EdHX5zSlymGNTlFzA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1733170465; a=rsa-sha256; cv=none; b=EcCFZ6LKwvnV99G0hzyfotTOb8TAsxT13f7JD+oyvGT/cbDcAPtpmLEBsVjxaVqOOrZLwm 4OyR1ulSO9asNxKnOXo3wnSWhWeQFul3KXz+pBJGp3HjAv15oQYtaXxWhBGGiJSuJtR9z2 5JDiNWbiW8G/JfzTmRi++jSV+JbpCrxjdjJrRjCkoOm6oIK1qh0ShU+C0RyetMupN9dFMI yeiIh6l0FwxyyjM8jGOPnD2oggIej5ulhrk7CjS7CvELQPn0vWMB5lu/uSzTVxGPn5H+Al BQS2pDlhz2oOSzaTfh8b5FJkWWxPWC75wxGggxjklWRkJJ5uT2lU86UB+yy80A== Received: from mail-qt1-f175.google.com (mail-qt1-f175.google.com [209.85.160.175]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "WR4" (verified OK)) (Authenticated sender: mp) by smtp.freebsd.org (Postfix) with ESMTPSA id 4Y2FPF4x4dz1Bg7 for ; Mon, 2 Dec 2024 20:14:25 +0000 (UTC) (envelope-from mp@freebsd.org) Received: by mail-qt1-f175.google.com with SMTP id d75a77b69052e-46684744070so41438701cf.1 for ; Mon, 02 Dec 2024 12:14:25 -0800 (PST) X-Forwarded-Encrypted: i=1; AJvYcCWZ75S3Y6QH7AS9I/UcMncrLuENzSQiWVgTGIyx95QExiE8xtSWi6VeEEkbyznplOiQ7tNXnYXhzRDgaiX+cqldMpl583yE@freebsd.org X-Gm-Message-State: AOJu0YxoXbSBHJunh6u8lyw45Gl67H9oWHV4BhzzB5hhs4m3iawrTqqc UZsXcJt/SECCk7B0ZcOkhC2HnILiTLXQCY25dNpscvpe6XIxKIFneldZi85kkGKFoeb3x3Z71Bz RVIZRUF9T79xOgwmAiqaf43VbQDMlA+eSbdIDVA== X-Google-Smtp-Source: AGHT+IGYipjU8OSnCues8iYbFsokJWolTeA0NRfppZ8Ym/IbzHCpR5bibjweT+JHXRhhdyyueHqTTZc6LcinaZYC8u0= X-Received: by 2002:ad4:5ecc:0:b0:6d8:a5f7:f108 with SMTP id 6a1803df08f44-6d8a5f7f871mr77060036d6.26.1733170465246; Mon, 02 Dec 2024 12:14:25 -0800 (PST) List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-virtualization@freebsd.org Sender: owner-freebsd-virtualization@FreeBSD.org MIME-Version: 1.0 References: In-Reply-To: From: Mark Peek Date: Mon, 2 Dec 2024 12:14:14 -0800 X-Gmail-Original-Message-ID: Message-ID: Subject: Re: Failed to emulate instruction sequence [ 41f646040874064c017d88eb144c89 ] at 0xbea5fcf9 To: Mario Marietto Cc: =?UTF-8?Q?Corvin_K=C3=B6hne?= , FreeBSD virtualization Content-Type: multipart/alternative; boundary="000000000000eab7e506284f3150" --000000000000eab7e506284f3150 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable On Mon, Dec 2, 2024 at 11:54=E2=80=AFAM Mario Marietto wrote: > Hello to everyone. > > Recently I've upgraded one of my FreeBSD systems and I see a strange erro= r > when I try to boot Android 7.1.1. I have never seen this error before and= I > also have another system where I haven't applied the latest pkg upgrades > where Android is still able to boot. > The bhyve parameters that I use in both systems are the following : > > /usr/sbin/./bhyve -S -c sockets=3D2,cores=3D2,threads=3D2 -m 8G -w -H -A = \ > -s 0,hostbridge \ > -s > 1,ahci-hd,/mnt/zroot-133/bhyve/img/Android/DarkMatter-qemu.img,bootindex= =3D1 \ > -s 8:0,passthru,4/0/0 \ > -s 11,hda,play=3D/dev/dsp,rec=3D/dev/dsp \ > -s 13,virtio-net,tap13 \ > -s 29,fbuf,tcp=3D0.0.0.0:5913,w=3D1440,h=3D900,wait \ > -s 30,xhci,tablet \ > -s 31,lpc \ > -l > bootrom,/usr/local/share/uefi-firmware/BHYVE_UEFI_CODE.fd,/usr/local/shar= e/uefi-firmware/BHYVE_UEFI_VARS.fd > \ > vm0:13 < /dev/null & sleep 5 && vncviewer 0:13 && echo vncviewer 0:13 & > > The error I get on this ZFS system : > > FreeBSD marietto 14.1-RELEASE-p5 FreeBSD 14.1-RELEASE-p5 GENERIC amd64 > > is : > > *Failed to emulate instruction sequence [ 41f646040874064c017d88eb144c89 = ] > at 0xbea5fcf9* > > But I don't get this error on the system installed on the UFS disk (it is > also 14.1-RELEASE-p5 FreeBSD 14.1-RELEASE-p5 GENERIC amd64). Any > suggestions about how I can fix it ? > This looks like a duplication of this bug: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D282852 I need to tweak the patch (attached to the bug) before submitting for review. Note that both the kernel and bhyve need to be recompiled after applying the patch. Mark --000000000000eab7e506284f3150 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
On Mon, Dec 2, 2024 at 11:54=E2=80=AFAM M= ario Marietto <marietto2008@gm= ail.com> wrote:
H= ello to everyone.

Recently I've upgraded one o= f my FreeBSD systems and I see a strange error when I try to boot Android 7= .1.1. I have never seen this error before and I also have another system wh= ere I haven't applied the latest pkg upgrades where Android is still ab= le to boot.
The bhyve parameters that I use in both systems = are the following :

/usr/sbin/./bhyve -S -c socket= s=3D2,cores=3D2,threads=3D2 -m 8G -w -H -A \
-s 0,hostbridge \
-s 1,a= hci-hd,/mnt/zroot-133/bhyve/img/Android/DarkMatter-qemu.img,bootindex=3D1 \=
-s 8:0,passthru,4/0/0 \
-s 11,hda,play=3D/dev/dsp,rec=3D/dev/dsp \-s 13,virtio-net,tap13 \
-s 29,fbuf,tcp=3D0.0.0.0:5913,w=3D1440,h=3D900,wait \
-s 30,xhc= i,tablet \
-s 31,lpc \
-l bootrom,/usr/local/share/uefi-firmware/BHYV= E_UEFI_CODE.fd,/usr/local/share/uefi-firmware/BHYVE_UEFI_VARS.fd \
vm0:1= 3 < /dev/null & sleep 5 && vncviewer 0:13 && echo vn= cviewer 0:13 &

The error I get on this ZFS sys= tem :

FreeBSD marietto 14.1-RELEASE-p5 FreeBSD 14.= 1-RELEASE-p5 GENERIC amd64

is :

Failed to emulate instruction sequence [ 41f646040874064c017d88eb= 144c89 ] at 0xbea5fcf9

But I don't get= this error on the system installed on the UFS disk (it is also 14.1-RELEAS= E-p5 FreeBSD 14.1-RELEASE-p5 GENERIC amd64). Any suggestions about how I ca= n fix it ?


This = looks like a duplication of this bug:
https://bugs.freebsd.org/bugzilla/show= _bug.cgi?id=3D282852

I need to tweak the patch= (attached to the bug) before submitting for review. Note that both the ker= nel and bhyve need to be recompiled after applying the patch.
Mark
=C2=A0
--000000000000eab7e506284f3150-- From nobody Mon Dec 2 21:04:57 2024 X-Original-To: freebsd-virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Y2GXJ2k5Yz5gRKb for ; Mon, 02 Dec 2024 21:05:36 +0000 (UTC) (envelope-from marietto2008@gmail.com) Received: from mail-pl1-x62c.google.com (mail-pl1-x62c.google.com [IPv6:2607:f8b0:4864:20::62c]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "WR4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Y2GXJ0fjKz419l; Mon, 2 Dec 2024 21:05:36 +0000 (UTC) (envelope-from marietto2008@gmail.com) Authentication-Results: mx1.freebsd.org; none Received: by mail-pl1-x62c.google.com with SMTP id d9443c01a7336-21577f65bdeso13331725ad.0; Mon, 02 Dec 2024 13:05:36 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1733173534; x=1733778334; darn=freebsd.org; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=HpFV+5khVZE7q1hIKaiQ8Z/y/ajKTGR1C4pkBwJyuCc=; b=N7T94QBIVpV7aep8hnLnrBVRy1A8OTXO9iuOmuFi5mHQFwxmIbkv42RGrVHz5hnsCG u7rzZEC5ljCxnI17b4J364N1XcdgyF9DBNRinTg2W6set+oCptHd7WkQvj4rqL97gx8v Zdlp0hQliAbd7p9pU3Ec46XwAygEP15wiJ37CIPHCbV6RFZcWfLE7OeAn6qq/OPV0ATb UhQ16iuevwdlgwcuz2VYOJgttdPIoIzxwpQ3foDhJfT3KGWIOCsPI0G3prgjB88oH2Oo 5gSXFRfsfHoh9ZoLEz1m1ecZAU9I+kYzFoD4RPbJAkw0rlugVOlljG8fUFUKzjwRdwEQ PwRQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1733173534; x=1733778334; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=HpFV+5khVZE7q1hIKaiQ8Z/y/ajKTGR1C4pkBwJyuCc=; b=ZRc+Se7Af/8L+ms1KTX7LSUiMqSN+lVEfeRZ4yagPSTB+Iv73BI7kgVmIBj/fLA4N1 PwaGler3x6vcjtzQvUKw9iGX9snsLwgJkFVCFpmXjqkNXUV28LAgODBquyvLcULzCUTX kBLu+V9LxCOgh9XipCoTkX7cEbjPq9R4NuD+cNXHoPvtxpLIGdnjIVs3BREWW3eYxTuZ idb9p5RoaA3HEFQ/AAjleb+MyLiNakSQGu2fMke5pwaKCUdXeks0EXA45m9swB5KwFMA DczCVekTkj/84KRYSkdF/W03ks+LEse4A7jrruhgQPNa7JxoeofNyQquI92baFPPCnJg NI5g== X-Forwarded-Encrypted: i=1; AJvYcCWReG/HZAKQLb1hj8p6GOEZ7ZdGD0dF3UrdFX7cTrUQtFT002+RaR58/rB8oyrnxPj7ALb4cgKnh7uxnLfcAX7Uaj7U13Jj@freebsd.org X-Gm-Message-State: AOJu0YxgmEFn/x/FgiHWwPTEajtkQHJyPS++JXAkP2/km5FsIGILxklh mKhyoJiYQf/QTBq3XiB8NfR9pMFlQ4fhDWXwDQ5H/cF8HvvrkkNNFTjhX6y3PW8gRKAJJDaFe5d w729gn7lishMSX8Ur3PYRvlft5WPVz/+WrD0= X-Gm-Gg: ASbGnctroxBjUdx2rroPMYkxjl0ENursEy9+rBMwURT3UKXkytfyemwTlD9DRdHtE3V W6IR051yh/jUbvfJzCgzJa6cq1Kzew8Av X-Google-Smtp-Source: AGHT+IEjYw9Z/GJOfUFnUA32ij2xlvXmiFZs2AsDzQaX0DvsetiBLc70nDsqEQZqWuB5E3HKOzQJaiqy8VyN4y4G/VQ= X-Received: by 2002:a17:903:191:b0:215:ba2b:cd55 with SMTP id d9443c01a7336-215ba2bd12amr5097725ad.2.1733173534104; Mon, 02 Dec 2024 13:05:34 -0800 (PST) List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-virtualization@freebsd.org Sender: owner-freebsd-virtualization@FreeBSD.org MIME-Version: 1.0 References: In-Reply-To: From: Mario Marietto Date: Mon, 2 Dec 2024 22:04:57 +0100 Message-ID: Subject: Re: Failed to emulate instruction sequence [ 41f646040874064c017d88eb144c89 ] at 0xbea5fcf9 To: Mark Peek Cc: =?UTF-8?Q?Corvin_K=C3=B6hne?= , FreeBSD virtualization Content-Type: multipart/alternative; boundary="000000000000d5a35a06284fe80f" X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US] X-Rspamd-Queue-Id: 4Y2GXJ0fjKz419l X-Spamd-Bar: ---- --000000000000d5a35a06284fe80f Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Hello Mark, I see that your patch is about to modify the code of the vmm.ko module. I've just exchanged the vmm.ko module that I'm using on the ZFS system with the module that I use on the UFS system (where I don't see the error) but this operation didn't solve the problem. I suspect that the wrong code is not inside the vmm.ko module. Can you offer a quick technical explanation of the reason why the exchange of the modules does not work for me ? On Mon, Dec 2, 2024 at 9:14=E2=80=AFPM Mark Peek wrote: > On Mon, Dec 2, 2024 at 11:54=E2=80=AFAM Mario Marietto > wrote: > >> Hello to everyone. >> >> Recently I've upgraded one of my FreeBSD systems and I see a strange >> error when I try to boot Android 7.1.1. I have never seen this error bef= ore >> and I also have another system where I haven't applied the latest pkg >> upgrades where Android is still able to boot. >> The bhyve parameters that I use in both systems are the following : >> >> /usr/sbin/./bhyve -S -c sockets=3D2,cores=3D2,threads=3D2 -m 8G -w -H -A= \ >> -s 0,hostbridge \ >> -s >> 1,ahci-hd,/mnt/zroot-133/bhyve/img/Android/DarkMatter-qemu.img,bootindex= =3D1 \ >> -s 8:0,passthru,4/0/0 \ >> -s 11,hda,play=3D/dev/dsp,rec=3D/dev/dsp \ >> -s 13,virtio-net,tap13 \ >> -s 29,fbuf,tcp=3D0.0.0.0:5913,w=3D1440,h=3D900,wait \ >> -s 30,xhci,tablet \ >> -s 31,lpc \ >> -l >> bootrom,/usr/local/share/uefi-firmware/BHYVE_UEFI_CODE.fd,/usr/local/sha= re/uefi-firmware/BHYVE_UEFI_VARS.fd >> \ >> vm0:13 < /dev/null & sleep 5 && vncviewer 0:13 && echo vncviewer 0:13 & >> >> The error I get on this ZFS system : >> >> FreeBSD marietto 14.1-RELEASE-p5 FreeBSD 14.1-RELEASE-p5 GENERIC amd64 >> >> is : >> >> *Failed to emulate instruction sequence [ 41f646040874064c017d88eb144c89 >> ] at 0xbea5fcf9* >> >> But I don't get this error on the system installed on the UFS disk (it i= s >> also 14.1-RELEASE-p5 FreeBSD 14.1-RELEASE-p5 GENERIC amd64). Any >> suggestions about how I can fix it ? >> > > > This looks like a duplication of this bug: > https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D282852 > > I need to tweak the patch (attached to the bug) before submitting for > review. Note that both the kernel and bhyve need to be recompiled after > applying the patch. > > Mark > > --=20 Mario. --000000000000d5a35a06284fe80f Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
Hello Mark,

I see that your = patch is about to modify the code of the vmm.ko module. I've just excha= nged the vmm.ko module that I'm using on the ZFS system with the module= that I use on the UFS system (where I don't see the error) but this op= eration didn't solve the problem. I suspect that the wrong code is not = inside the vmm.ko module. Can you offer a quick technical explanation of th= e reason why the exchange of the modules does not work for me ?
<= /div>
On Mon, Dec 2, 2024 at 9:14=E2=80=AFPM Mark Peek <<= a href=3D"mailto:mp@freebsd.org">mp@freebsd.org> wrote:
On Mon, Dec 2, 2024 at 11:54=E2=80=AFAM Mario Marietto <marietto2008@gmail.com> wrote:
/usr/sbin/./bhyve -S -c sockets=3D2,cores=3D2,threads=3D2 -m 8= G -w -H -A \
-s 0,hostbridge \
-s 1,ahci-hd,/mnt/zroot-133/bhyve/img/= Android/DarkMatter-qemu.img,bootindex=3D1 \
-s 8:0,passthru,4/0/0 \
-= s 11,hda,play=3D/dev/dsp,rec=3D/dev/dsp \
-s 13,virtio-net,tap13 \
-s= 29,fbuf,tcp=3D0.0.0.0:59= 13,w=3D1440,h=3D900,wait \
-s 30,xhci,tablet \
-s 31,lpc \
-l = bootrom,/usr/local/share/uefi-firmware/BHYVE_UEFI_CODE.fd,/usr/local/share/= uefi-firmware/BHYVE_UEFI_VARS.fd \
vm0:13 < /dev/null & sleep 5 &= amp;& vncviewer 0:13 && echo vncviewer 0:13 &
The error I get on this ZFS system :

F= reeBSD marietto 14.1-RELEASE-p5 FreeBSD 14.1-RELEASE-p5 GENERIC amd64
=

is :

Failed to emulate inst= ruction sequence [ 41f646040874064c017d88eb144c89 ] at 0xbea5fcf9

But I don't get this error on the system instal= led on the UFS disk (it is also 14.1-RELEASE-p5 FreeBSD 14.1-RELEASE-p5 GEN= ERIC amd64). Any suggestions about how I can fix it ?


This looks like a duplication of this= bug:
https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D= 282852

I need to tweak the patch (attached to = the bug) before submitting for review. Note that both the kernel and bhyve = need to be recompiled after applying the patch.

Ma= rk
=C2=A0


--
Ma= rio.
--000000000000d5a35a06284fe80f-- From nobody Mon Dec 2 21:07:45 2024 X-Original-To: freebsd-virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Y2GbY585qz5gRYK for ; Mon, 02 Dec 2024 21:08:25 +0000 (UTC) (envelope-from marietto2008@gmail.com) Received: from mail-pg1-x530.google.com (mail-pg1-x530.google.com [IPv6:2607:f8b0:4864:20::530]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "WR4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Y2GbX2BYkz41q0; Mon, 2 Dec 2024 21:08:24 +0000 (UTC) (envelope-from marietto2008@gmail.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20230601 header.b=DXpAf8P8; spf=pass (mx1.freebsd.org: domain of marietto2008@gmail.com designates 2607:f8b0:4864:20::530 as permitted sender) smtp.mailfrom=marietto2008@gmail.com; dmarc=pass (policy=none) header.from=gmail.com Received: by mail-pg1-x530.google.com with SMTP id 41be03b00d2f7-7fbc65f6c72so4507427a12.1; Mon, 02 Dec 2024 13:08:24 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1733173702; x=1733778502; darn=freebsd.org; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=3hTNSLC4XjFtZtoKGjbOR5kSOZJFGB8tCp6PPKPaKW8=; b=DXpAf8P8V9xpF2arIQKh9hGlx82MaMmRSz1KFWIVJnkZdWB7Q1VH4M0GYRVP1KsxYt U00XR6FFdDP91DlZFStV6PlzYULjGKdw/qJcII3VMT+T39roPGQ8AHQq/GXJW61k7mPZ 1n3gtWNW9T9Z1HrQ5Q3R5J2Ea8+EJGpzKJwXmVyxRt3HxaaoWYgZgWgoRsAF3Yss7a4Q BEQKzurq60i91DqXXdd6h+wBlG9fREZ6cB4hDe6FzQdKSqE7ie1EXTGyWPNv5v4Crz20 g9+3t0cfGt+mIuZUjVb6yAs+boR3aAdoL7ZXZQC2Rlo238G+i5TzPJtllMS+w2C6Di9o GrxA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1733173702; x=1733778502; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=3hTNSLC4XjFtZtoKGjbOR5kSOZJFGB8tCp6PPKPaKW8=; b=JPe4aj0DopcPbeIsPYwCqHceqg8wFdF7qDAQP4y9B9Sac9znk354CJOWFugxxObRTY Dg/aKaJFubWsGgr4Kuw2vCJ4RUaD7DPe8U8GeIbuB1HcVkX7SCRdYooKVf9cGknycmN0 mYwAKG/542nImBr6C8StxB2aHmXOg2YZDGaseoqN0AvunefYw3rSId7+ZXl1KzzVRZFI i7I3nyuU4bhG/I0bemmMW7qIrNpvbQjjf3z9d2WrybE35j//m45Dc0jRwrriQxJ//GHR 3zJ0WpwXFeLQsCZwSUzvhDyc3KpTl5JIvUCJBv187s9mBUfv8DGeDYlH1IrlqGkZlJuc zB+w== X-Forwarded-Encrypted: i=1; AJvYcCX4TksYn90ObDQjeqd0RxPtbx7mjKVxdwH8hFqTrSUiNcVcQRPUlB6/avyM3DuseGqMlOOViL6+YEHwyKbgj7VjMfN+pH1h@freebsd.org X-Gm-Message-State: AOJu0YxKvBL/8sh9KGL+fEKTTiGjtazgwaAu1zES2LPVMr/IGMNfmpsD IYXc2VcbH7mzf/VZDE9KOYANkRMudbb/+vEjRgKZ7FZSt6F9NB//V0w9X3B2uWqkSj7LXafmWZk 9NM9OlPBNcSGaSmtqGqc6hpIDMT1AORMmsv8= X-Gm-Gg: ASbGncs9TvyLZ6neLP/MkDVk9X4J4Adk64oZAKNfmtUibi0qR3/9nzKoH+st9MEj8aW gcVIf+0BldiKsq+W5Kim5hke3ipOi4K48 X-Google-Smtp-Source: AGHT+IGQ3wgMXJdLXANbFGa2bn1UwaCEobFb+pfiN7/IF5LXoSo760nVq9lngN73bgfJgDYDJEA5D8svkXbd8j0rKrU= X-Received: by 2002:a17:90b:5405:b0:2ee:fb6b:7d7e with SMTP id 98e67ed59e1d1-2eefb6b7e27mr1077883a91.30.1733173701999; Mon, 02 Dec 2024 13:08:21 -0800 (PST) List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-virtualization@freebsd.org Sender: owner-freebsd-virtualization@FreeBSD.org MIME-Version: 1.0 References: In-Reply-To: From: Mario Marietto Date: Mon, 2 Dec 2024 22:07:45 +0100 Message-ID: Subject: Re: Failed to emulate instruction sequence [ 41f646040874064c017d88eb144c89 ] at 0xbea5fcf9 To: Mark Peek Cc: =?UTF-8?Q?Corvin_K=C3=B6hne?= , FreeBSD virtualization Content-Type: multipart/alternative; boundary="000000000000d785b406284ff21d" X-Spamd-Result: default: False [-1.55 / 15.00]; HTTP_TO_IP(1.00)[]; URI_COUNT_ODD(1.00)[5]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.55)[-0.546]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20230601]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; RCVD_TLS_LAST(0.00)[]; ARC_NA(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; TO_DN_ALL(0.00)[]; FREEMAIL_ENVFROM(0.00)[gmail.com]; FREEMAIL_FROM(0.00)[gmail.com]; FROM_HAS_DN(0.00)[]; MISSING_XM_UA(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; MID_RHS_MATCH_FROMTLD(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; MLMMJ_DEST(0.00)[freebsd-virtualization@freebsd.org]; RCVD_COUNT_ONE(0.00)[1]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::530:from]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim] X-Rspamd-Queue-Id: 4Y2GbX2BYkz41q0 X-Spamd-Bar: - --000000000000d785b406284ff21d Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable I forgot to say that I have also exchanged the whole boot folder. And nope,even this didn't work. On Mon, Dec 2, 2024 at 10:04=E2=80=AFPM Mario Marietto wrote: > Hello Mark, > > I see that your patch is about to modify the code of the vmm.ko module. > I've just exchanged the vmm.ko module that I'm using on the ZFS system wi= th > the module that I use on the UFS system (where I don't see the error) but > this operation didn't solve the problem. I suspect that the wrong code is > not inside the vmm.ko module. Can you offer a quick technical explanation > of the reason why the exchange of the modules does not work for me ? > > On Mon, Dec 2, 2024 at 9:14=E2=80=AFPM Mark Peek wrote: > >> On Mon, Dec 2, 2024 at 11:54=E2=80=AFAM Mario Marietto >> wrote: >> >>> Hello to everyone. >>> >>> Recently I've upgraded one of my FreeBSD systems and I see a strange >>> error when I try to boot Android 7.1.1. I have never seen this error be= fore >>> and I also have another system where I haven't applied the latest pkg >>> upgrades where Android is still able to boot. >>> The bhyve parameters that I use in both systems are the following : >>> >>> /usr/sbin/./bhyve -S -c sockets=3D2,cores=3D2,threads=3D2 -m 8G -w -H -= A \ >>> -s 0,hostbridge \ >>> -s >>> 1,ahci-hd,/mnt/zroot-133/bhyve/img/Android/DarkMatter-qemu.img,bootinde= x=3D1 \ >>> -s 8:0,passthru,4/0/0 \ >>> -s 11,hda,play=3D/dev/dsp,rec=3D/dev/dsp \ >>> -s 13,virtio-net,tap13 \ >>> -s 29,fbuf,tcp=3D0.0.0.0:5913,w=3D1440,h=3D900,wait \ >>> -s 30,xhci,tablet \ >>> -s 31,lpc \ >>> -l >>> bootrom,/usr/local/share/uefi-firmware/BHYVE_UEFI_CODE.fd,/usr/local/sh= are/uefi-firmware/BHYVE_UEFI_VARS.fd >>> \ >>> vm0:13 < /dev/null & sleep 5 && vncviewer 0:13 && echo vncviewer 0:13 & >>> >>> The error I get on this ZFS system : >>> >>> FreeBSD marietto 14.1-RELEASE-p5 FreeBSD 14.1-RELEASE-p5 GENERIC amd64 >>> >>> is : >>> >>> *Failed to emulate instruction sequence [ 41f646040874064c017d88eb144c8= 9 >>> ] at 0xbea5fcf9* >>> >>> But I don't get this error on the system installed on the UFS disk (it >>> is also 14.1-RELEASE-p5 FreeBSD 14.1-RELEASE-p5 GENERIC amd64). Any >>> suggestions about how I can fix it ? >>> >> >> >> This looks like a duplication of this bug: >> https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D282852 >> >> I need to tweak the patch (attached to the bug) before submitting for >> review. Note that both the kernel and bhyve need to be recompiled after >> applying the patch. >> >> Mark >> >> > > > -- > Mario. > --=20 Mario. --000000000000d785b406284ff21d Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
I forgot to say that I have also exchanged the whole boot = folder. And nope,even this didn't work.

On Mon= , Dec 2, 2024 at 10:04=E2=80=AFPM Mario Marietto <marietto2008@gmail.com> wrote:
Hello Mark,=

I see that your patch is about to modify the code= of the vmm.ko module. I've just exchanged the vmm.ko module that I'= ;m using on the ZFS system with the module that I use on the UFS system (wh= ere I don't see the error) but this operation didn't solve the prob= lem. I suspect that the wrong code is not inside the vmm.ko module. Can you= offer a quick technical explanation of the reason why the exchange of the = modules does not work for me ?

On Mon, Dec 2, 2024 at 9:14=E2=80= =AFPM Mark Peek <mp@= freebsd.org> wrote:
On Mon, Dec 2, 2024 at 11:54= =E2=80=AFAM Mario Marietto <marietto2008@gmail.com> wrote:
Hello to everyone.

Recently I've upgra= ded one of my FreeBSD systems and I see a strange error when I try to boot = Android 7.1.1. I have never seen this error before and I also have another = system where I haven't applied the latest pkg upgrades where Android is= still able to boot.
The bhyve parameters that I use in both= systems are the following :

/usr/sbin/./bhyve -S = -c sockets=3D2,cores=3D2,threads=3D2 -m 8G -w -H -A \
-s 0,hostbridge \<= br>-s 1,ahci-hd,/mnt/zroot-133/bhyve/img/Android/DarkMatter-qemu.img,bootin= dex=3D1 \
-s 8:0,passthru,4/0/0 \
-s 11,hda,play=3D/dev/dsp,rec=3D/de= v/dsp \
-s 13,virtio-net,tap13 \
-s 29,fbuf,tcp=3D0.0.0.0:5913,w=3D1440,h=3D900,wait \
= -s 30,xhci,tablet \
-s 31,lpc \
-l bootrom,/usr/local/share/uefi-firm= ware/BHYVE_UEFI_CODE.fd,/usr/local/share/uefi-firmware/BHYVE_UEFI_VARS.fd \=
vm0:13 < /dev/null & sleep 5 && vncviewer 0:13 &&= ; echo vncviewer 0:13 &

The error I get on thi= s ZFS system :

FreeBSD marietto 14.1-RELEASE-p5 Fr= eeBSD 14.1-RELEASE-p5 GENERIC amd64

is :

Failed to emulate instruction sequence [ 41f646040874064= c017d88eb144c89 ] at 0xbea5fcf9

But I don&= #39;t get this error on the system installed on the UFS disk (it is also 14= .1-RELEASE-p5 FreeBSD 14.1-RELEASE-p5 GENERIC amd64). Any suggestions about= how I can fix it ?


<= div>This looks like a duplication of this bug:
https://bug= s.freebsd.org/bugzilla/show_bug.cgi?id=3D282852

I need to tweak the patch (attached to the bug) before submitting for rev= iew. Note that both the kernel and bhyve need to be recompiled after applyi= ng the patch.

Mark
=C2=A0


--
Ma= rio.


--
Ma= rio.
--000000000000d785b406284ff21d-- From nobody Mon Dec 2 21:16:41 2024 X-Original-To: freebsd-virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Y2GnJ56GQz5gSKw for ; Mon, 02 Dec 2024 21:16:52 +0000 (UTC) (envelope-from mp@freebsd.org) Received: from smtp.freebsd.org (smtp.freebsd.org [96.47.72.83]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R10" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Y2GnJ4gppz43hq for ; Mon, 2 Dec 2024 21:16:52 +0000 (UTC) (envelope-from mp@freebsd.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1733174212; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=eWRgypieEob4kKbH40Z3m6/1gj/IWMaUSeHgssiCN4k=; b=nTGQ5tPKsIVTAw9pzX3CDAGc5bGYMUj7ZBafF7XlK3RXiJ5wWyoG205uFfvm4ITDODOI4f 8TLPFj237l0nBggfCYkX4Cx8aNXBT4eadsli8hmoVNIbnncSaiuI8ULFQz4WIyYI9Lg0W4 yqEk5JEQPVQVngfDXHHwehjnvBdYqGIWwufl1g62bIxtkBCAwFO/haMa57EyOG5odPVO79 ll2T2tsxsxTn8ysSqLZ78qsZo1bS/reIDs3f/yEtUlG3nRDvj6sCpuB3sXcxg76X97Z+Ub aVSCNmgtukpKrMVDVPPM7/6f+XGxZW4Rm6O3u+zvZrK9Ystw3RnsFVOsdmsD+g== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1733174212; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=eWRgypieEob4kKbH40Z3m6/1gj/IWMaUSeHgssiCN4k=; b=WtkDPheNfi9VPJJjAc02JX4QiKTvwpBhKSh91WRyd8xL7AaS7syzqZU5vcekZ7Skw2cavM 0nx3XOmYuQI9/sqcBudQogNQpkRA3Ik7r3PyCSd1Ld51oFoI/Xd4L8hYlM00nPy/nbectV iqgoDHRTQWCWNddnO+5eXRvV8gzSTOiF5aaKxxyYMFAahtFBQvAoEhtVtT8aGiyhe9QGQp Ese3VxIAP/3qi4YbpQC6S9JyFnBNT5g5xG6YdUZpmGssREsSSr12yqrOw5MlwU9BcyIj4R GdDlZ0fdsiaa6Q9SAALgDD8bV9k3nEbBr8Ptc4YWPWfa+cTGpEUGpLYSaOu4Hw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1733174212; a=rsa-sha256; cv=none; b=Gt1VqRI73EiF65oE7Ov4phO0NNxH/9LTb0xZUHWTIwJZGSJJJb44iZVY+EW9ylbtDVKA52 iWHA60DQfES0wFc9sdiyQwh36DqQsxY2hotzwgJmlnp8yl8xM66olrZ8BqdI+G7EZK0R6h SGw2It9rfz18ZmcOmTo8xdvLnq6yCRdgBS97FT3fuH0VNF27VxkkcaLRX76ETjTyBok2MI ZMxP6pC8BdYd70guIf4ZYyvfYo0oJgeZCtUGs6/MT1bCxJDg1/DfcDr3aK+dmpUGginxQZ 8EjM7pXsSBW/fapvIdSd+1XqoAPdXv9WiK/rT7VpIxzo8Xmnf82ZSsMB0bKfow== Received: from mail-qk1-f178.google.com (mail-qk1-f178.google.com [209.85.222.178]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "WR4" (verified OK)) (Authenticated sender: mp) by smtp.freebsd.org (Postfix) with ESMTPSA id 4Y2GnJ47pZz1FbX for ; Mon, 2 Dec 2024 21:16:52 +0000 (UTC) (envelope-from mp@freebsd.org) Received: by mail-qk1-f178.google.com with SMTP id af79cd13be357-7b65f8cb347so357035985a.3 for ; Mon, 02 Dec 2024 13:16:52 -0800 (PST) X-Forwarded-Encrypted: i=1; AJvYcCXRsEZq6W1tmo6qK+XzK/6CRvKwEZcYgsBLuGMPvxEb2j0HGnEayC/6rQyg8lEAljOBtB+RB4ii1RK116vPR1q5XFOgmyia@freebsd.org X-Gm-Message-State: AOJu0YzRU6QOqhgdKL8bJD7HuRAHABfIr0pk6+R3/yVlx+CgT9NWmLQO EcKtV5qZlHt8gB4E9qNxMRDWNjPL8+k90SOEnEOuZKFT7wjz76kEidvWwKaSyYWeXntE8igC+Rz XfUwPVd1eQXtPcAGDwvekbj2naSC68u4EVZYeCw== X-Google-Smtp-Source: AGHT+IE2ZKK57SzKxUs1VXSQVGsgy3hDNk5SIS1i73J6DAwofK9ZAafxD3GdFy+uOaeuuTIQgu8T3iumnicJ+1oLsho= X-Received: by 2002:a05:6214:d84:b0:6d4:1ea3:981d with SMTP id 6a1803df08f44-6d8b740282emr1590996d6.43.1733174212109; Mon, 02 Dec 2024 13:16:52 -0800 (PST) List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-virtualization@freebsd.org Sender: owner-freebsd-virtualization@FreeBSD.org MIME-Version: 1.0 References: In-Reply-To: From: Mark Peek Date: Mon, 2 Dec 2024 13:16:41 -0800 X-Gmail-Original-Message-ID: Message-ID: Subject: Re: Failed to emulate instruction sequence [ 41f646040874064c017d88eb144c89 ] at 0xbea5fcf9 To: Mario Marietto Cc: Mark Peek , =?UTF-8?Q?Corvin_K=C3=B6hne?= , FreeBSD virtualization Content-Type: multipart/alternative; boundary="0000000000003f47f806285011af" --0000000000003f47f806285011af Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable On Mon, Dec 2, 2024 at 1:05=E2=80=AFPM Mario Marietto wrote: > Hello Mark, > > I see that your patch is about to modify the code of the vmm.ko module. > I've just exchanged the vmm.ko module that I'm using on the ZFS system wi= th > the module that I use on the UFS system (where I don't see the error) but > this operation didn't solve the problem. I suspect that the wrong code is > not inside the vmm.ko module. Can you offer a quick technical explanation > of the reason why the exchange of the modules does not work for me ? > I'm assuming you applied the patch and rebuilt the vmm.ko module. Did you also recompile the bhyve binary per my comments in my last message? The emulated instructions are detected in vmm.ko but are emulated in the bhyve binary. In other words, vmm_instruction_emul.c is used in both vmm.ko and bhyve. Mark --0000000000003f47f806285011af Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
On Mon, Dec 2, 2024 at 1:05=E2=80=AFPM Ma= rio Marietto <marietto2008@gma= il.com> wrote:
He= llo Mark,

I see that your patch is about to modify= the code of the vmm.ko module. I've just exchanged the vmm.ko module t= hat I'm using on the ZFS system with the module that I use on the UFS s= ystem (where I don't see the error) but this operation didn't solve= the problem. I suspect that the wrong code is not inside the vmm.ko module= . Can you offer a quick technical explanation of the reason why the exchang= e of the modules does not work for me ?

I'm assuming you applied the patch and rebuilt the vmm.ko modu= le. Did you also recompile the bhyve binary per my comments in my last mess= age? The emulated instructions are detected in vmm.ko but are emulated in t= he bhyve binary. In other words, vmm_instruction_emul.c is used in both vmm= .ko and bhyve.

Mark=C2=A0
--0000000000003f47f806285011af-- From nobody Mon Dec 2 21:34:28 2024 X-Original-To: freebsd-virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Y2HBM1ts5z5gT64 for ; Mon, 02 Dec 2024 21:35:07 +0000 (UTC) (envelope-from marietto2008@gmail.com) Received: from mail-pj1-x102a.google.com (mail-pj1-x102a.google.com [IPv6:2607:f8b0:4864:20::102a]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "WR4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Y2HBM061tz458n; Mon, 2 Dec 2024 21:35:07 +0000 (UTC) (envelope-from marietto2008@gmail.com) Authentication-Results: mx1.freebsd.org; none Received: by mail-pj1-x102a.google.com with SMTP id 98e67ed59e1d1-2ee6abf124aso2643185a91.3; Mon, 02 Dec 2024 13:35:06 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1733175305; x=1733780105; darn=freebsd.org; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=W59pfqJUiQ7ueFzhUETu0seFbfCMN/DPtsvSPMMYwZI=; b=fe8HBcHHoAGmpboJ6JEsdy70b0jiX3pxuwbh3LFdzl8Ys4rFktaRnw+qUJMwsqvBjQ bHOYeNrwR+ScbEUz+K+gWMHYIu+NL6uSDr2MHZ+VS3opIr/qWFle5XRcuWKEMI0tpDFD pBmUMNHE7Wr+aATCgk3HG/ely0HhHI9Gj+NP/nlQc+zh6FPSfdhS2gnbEj49QL3YaisK B3DvK+4/9X88cMc2SOLoqK8L0TtbqPpjkW9k1kStz0nepP9Uz8OEAPGMRmKmwIFtd9BV gWMbCW1bJRbCTBV4I8CoAUQqN/dBMuIsobx7+H88q5OGhKVH8WEinYMiv3kEEvtREswL UzXA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1733175305; x=1733780105; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=W59pfqJUiQ7ueFzhUETu0seFbfCMN/DPtsvSPMMYwZI=; b=WGNjXe4pL9EScu4Wfe4VycSyEj9/Gz9kMPaDerr27gx12T3ySZQnCzCyEj4UPKNx9N BVJ3trfN9GYc/LiPcG0M3NV0dvtO3eAspEjhsMQVG87a8ImJUGjy+1c3gwFgLUspwYMa PWcSST4cbke4Jo6EIuD7fUiMY6IrpiSzfuR/SUFMc+Gwfw2JRFPBbWIso7mmvFzlZ13l py8fbaF5yKWTlsacitpJIyANKeFc6+eAvNi/2lTo7HXycHb+GZH5YDWu6hyo6wm2gVTB afVdbE6AqntItlf48RiSTkwZNHtvO7CGsnPC+5XelGGxSf0vWLdcezxhoYM6imS6u5vR Y2og== X-Forwarded-Encrypted: i=1; AJvYcCXa3VxacDcJR6est5B6ua1DvW62Q9mRyvjwAoRSYQj7bn8HSf0PyID1XhWc5O7wOgL3DcqO8d32Kzmuh5JYNxzIG5hJN5T1@freebsd.org X-Gm-Message-State: AOJu0Yw2cnMrQsY8QMdNirhxZeyidzWHNAbJa2JIz1dCemZiWLzXv9H5 JVlrFXO4RkP2euJKw0Mw8MLhGUmsggdxvzVRj1r9OL0A+i+GcimvmhP/C8md6TlgbCnpUN8fP7l pQeP/TrO3Nba+It42WObTtDooAbQF/rzvM9QQ8A== X-Gm-Gg: ASbGncuGIVF00iYtl3H64clExrlRfTTaeCS5a7T4qwADZWsWd28WPVwDG3Sg1gnKqXT 7h2pT7JewaVBlJarDhe7IdCwqrga7o3Pz X-Google-Smtp-Source: AGHT+IHdnopJssHJpWNLCXxrJsXFIADbW32TnFVvDzhoJfw/hHC7b7UFHtuFmQiumz26SyhS9xvaNl75aGvuCKx2+dM= X-Received: by 2002:a17:90b:3944:b0:2ee:9902:18b4 with SMTP id 98e67ed59e1d1-2ef01244d2dmr109753a91.27.1733175304941; Mon, 02 Dec 2024 13:35:04 -0800 (PST) List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-virtualization@freebsd.org Sender: owner-freebsd-virtualization@FreeBSD.org MIME-Version: 1.0 References: In-Reply-To: From: Mario Marietto Date: Mon, 2 Dec 2024 22:34:28 +0100 Message-ID: Subject: Re: Failed to emulate instruction sequence [ 41f646040874064c017d88eb144c89 ] at 0xbea5fcf9 To: Mark Peek Cc: =?UTF-8?Q?Corvin_K=C3=B6hne?= , FreeBSD virtualization Content-Type: multipart/alternative; boundary="00000000000062799506285052a6" X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US] X-Rspamd-Queue-Id: 4Y2HBM061tz458n X-Spamd-Bar: ---- --00000000000062799506285052a6 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Yes,I have also exchanged the bhyve binary. Now I'm trying to apply your patch and then I will rebuild vmm. I see that your code is : [0xF6] =3D { /* XXX Group 3 extended opcode - not just TEST */ .op_byte =3D 0xF6, .op_type =3D VIE_OP_TYPE_TEST, .op_flags =3D VIE_OP_F_IMM, }, but it seems wrong. Shouldn't be .op_flags =3D VIE_OP_F_IMM8 ? On Mon, Dec 2, 2024 at 10:16=E2=80=AFPM Mark Peek wrote: > On Mon, Dec 2, 2024 at 1:05=E2=80=AFPM Mario Marietto > wrote: > >> Hello Mark, >> >> I see that your patch is about to modify the code of the vmm.ko module. >> I've just exchanged the vmm.ko module that I'm using on the ZFS system w= ith >> the module that I use on the UFS system (where I don't see the error) bu= t >> this operation didn't solve the problem. I suspect that the wrong code i= s >> not inside the vmm.ko module. Can you offer a quick technical explanatio= n >> of the reason why the exchange of the modules does not work for me ? >> > > I'm assuming you applied the patch and rebuilt the vmm.ko module. Did you > also recompile the bhyve binary per my comments in my last message? The > emulated instructions are detected in vmm.ko but are emulated in the bhyv= e > binary. In other words, vmm_instruction_emul.c is used in both vmm.ko and > bhyve. > > Mark > --=20 Mario. --00000000000062799506285052a6 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
Yes,I have also exchanged the bhyve binary. Now I'= ;m trying to apply your patch and then I will rebuild vmm.
I= see that your code is :

[0xF6] =3D {
=C2= =A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 /* XXX Group 3 extende= d opcode - not just TEST */
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0 .op_byte =3D 0xF6,
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A0 .op_type =3D VIE_OP_TYPE_TEST,
=C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 .op_flags =3D VIE_OP_F_IMM,
=C2=A0 = =C2=A0 =C2=A0 =C2=A0 },

but it seems wrong. Should= n't be .op_flags =3D VIE_OP_F_IMM8 ?

On Mon,= Dec 2, 2024 at 10:16=E2=80=AFPM Mark Peek <mp@freebsd.org> wrote:
On Mon, Dec 2, 2024 a= t 1:05=E2=80=AFPM Mario Marietto <marietto2008@gmail.com> wrote:
Hello Mark,

I see that your patch is= about to modify the code of the vmm.ko module. I've just exchanged the= vmm.ko module that I'm using on the ZFS system with the module that I = use on the UFS system (where I don't see the error) but this operation = didn't solve the problem. I suspect that the wrong code is not inside t= he vmm.ko module. Can you offer a quick technical explanation of the reason= why the exchange of the modules does not work for me ?

I'm assuming you applied the patch and rebuilt= the vmm.ko module. Did you also recompile the bhyve binary per my comments= in my last message? The emulated instructions are detected in vmm.ko but a= re emulated in the bhyve binary. In other words, vmm_instruction_emul.c is = used in both vmm.ko and bhyve.

Mark=C2=A0


--
Ma= rio.
--00000000000062799506285052a6-- From nobody Mon Dec 2 22:06:32 2024 X-Original-To: freebsd-virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Y2HvP4551z5gWdS for ; Mon, 02 Dec 2024 22:07:13 +0000 (UTC) (envelope-from marietto2008@gmail.com) Received: from mail-pj1-x1036.google.com (mail-pj1-x1036.google.com [IPv6:2607:f8b0:4864:20::1036]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "WR4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Y2HvN1xtVz475r; Mon, 2 Dec 2024 22:07:12 +0000 (UTC) (envelope-from marietto2008@gmail.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20230601 header.b=WiGKbC2C; spf=pass (mx1.freebsd.org: domain of marietto2008@gmail.com designates 2607:f8b0:4864:20::1036 as permitted sender) smtp.mailfrom=marietto2008@gmail.com; dmarc=pass (policy=none) header.from=gmail.com Received: by mail-pj1-x1036.google.com with SMTP id 98e67ed59e1d1-2ee76befe58so2288071a91.2; Mon, 02 Dec 2024 14:07:12 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1733177231; x=1733782031; darn=freebsd.org; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=wOxVeXQgxEvY75/Jr6sO0V2ZirKKQIcXovlGQLoNQ1s=; b=WiGKbC2CxUzthc51AFjaAolh726+nBdf7FFxOic73uIrndg4Bzyl24KPVpVB9X57Q8 wqgzgkpkqywKQM1+MoKzXz4R/kgFKTgnhW/kr1saxI1wYEtB1fUqOCe+mJP8Wy599jrf KOS3wh3OnaL8y8zt+rdy9MoGPgX2qL3YQdjnl/DAgnBrq0uXZlexUergHChdyEFJOEZX X+fsSIqo3o//dJKx8HQJWzzoJKMXjURMcHt9xd1S7bvWUJsy12atQouF+HGE3dKR0oSF VDsMuu/8V+mGjIcSxmOoNTYyrqYRTfijSZMCJuRxaeQ8tq3KD0JHfD8AyjHFbG/cP/AB ObFw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1733177231; x=1733782031; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=wOxVeXQgxEvY75/Jr6sO0V2ZirKKQIcXovlGQLoNQ1s=; b=bPOUg1PbKu8u4DBCG7kChWv0E6GbYzm3YQiQ7NAGhFhfw5lTmGTWfcB8zRe4ppKIhb JPogD3S1yz8jzxKZz9+WqnltQwtsBX22paAwzcdQOZBWlqejXFYhbtv3GlZ8qBFuPtyJ E27pwswAoM4m+hinANkFiL4Pq8eD1UMpkBuNYdXfRf/fnxiw3j7GJXMhPJbeOQ0IEmvd 15tOkQBCguFc0YIckwvEfAp84T3IvI5ysHO72NyV9T6eEQ6zETZBXSznXcCit2l4KXeD IjF/o5pc+43o9L6qs++MY+Stq5dUjS1zozMw6J04k0HYOoyAwbhDx+zHSCnIXDBff5Pn ZbKQ== X-Forwarded-Encrypted: i=1; AJvYcCX4UHQ3tRBP15NcNWleezANSj50+k/mcDSIcsJpKCzjwujV/iwe+yN+rqWXkndHQvWfnADc4sfXmVGJ7Gcq/vi2uISs/EVl@freebsd.org X-Gm-Message-State: AOJu0YyVUor+aW4XamoPv9iuITNnNEakHF//0RdSECwbaWys4oDfn5U9 KWXVxtxriBaraWH2FdBVeFRKTQCJiIHdPhWFUt1Mh7DGtq/b9BtkckckFRsCQM3H5n9xQ9KHyn6 DgGQpf4ly6PKgaEbixjHat0JSX9qLi2t1V0w= X-Gm-Gg: ASbGncti5g7AruXP4fm32jmdi0BmARdjdOL97V9Esp8gbfUwyU+fH6BZzWyoQjZ3Mzo Njn7/obN1ugFfeHq0AopfffLLBWKe2+PF X-Google-Smtp-Source: AGHT+IHdI60h2pe7ECqyaNcY6ONRMKJxwZZDgEGrfWEdOozeVRPEya0ug9Q/jc54oKACW3mZgM4VDcJ0c19grVpOMiE= X-Received: by 2002:a17:90b:2686:b0:2ee:aed6:9ec2 with SMTP id 98e67ed59e1d1-2ef011e9eefmr289180a91.14.1733177230126; Mon, 02 Dec 2024 14:07:10 -0800 (PST) List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-virtualization@freebsd.org Sender: owner-freebsd-virtualization@FreeBSD.org MIME-Version: 1.0 References: In-Reply-To: From: Mario Marietto Date: Mon, 2 Dec 2024 23:06:32 +0100 Message-ID: Subject: Re: Failed to emulate instruction sequence [ 41f646040874064c017d88eb144c89 ] at 0xbea5fcf9 To: Mark Peek Cc: =?UTF-8?Q?Corvin_K=C3=B6hne?= , FreeBSD virtualization Content-Type: multipart/alternative; boundary="000000000000227761062850c574" X-Spamd-Result: default: False [-3.97 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.97)[-0.974]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20230601]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36:c]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; MISSING_XM_UA(0.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; ARC_NA(0.00)[]; FREEMAIL_FROM(0.00)[gmail.com]; RCVD_COUNT_ONE(0.00)[1]; FREEMAIL_ENVFROM(0.00)[gmail.com]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; MIME_TRACE(0.00)[0:+,1:+,2:~]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::1036:from]; MLMMJ_DEST(0.00)[freebsd-virtualization@freebsd.org]; FROM_EQ_ENVFROM(0.00)[]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_TLS_LAST(0.00)[]; TO_DN_ALL(0.00)[]; MID_RHS_MATCH_FROMTLD(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+] X-Rspamd-Queue-Id: 4Y2HvN1xtVz475r X-Spamd-Bar: --- --000000000000227761062850c574 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Can you tell me if the compilation ended without errors ? [root@marietto /usr/src/sys/modules/vmm]=3D=3D> ls Makefile [root@marietto /usr/src/sys/modules/vmm]=3D=3D> make [Creating objdir /usr/obj/usr/src/amd64.amd64/sys/modules/vmm...] machine -> /usr/src/sys/amd64/include x86 -> /usr/src/sys/x86/include i386 -> /usr/src/sys/i386/include :> opt_acpi.h :> opt_bhyve_snapshot.h :> opt_ddb.h awk -f /usr/src/sys/tools/makeobjops.awk /usr/src/sys/kern/device_if.m -h awk -f /usr/src/sys/tools/makeobjops.awk /usr/src/sys/kern/bus_if.m -h awk -f /usr/src/sys/tools/makeobjops.awk /usr/src/sys/dev/pci/pci_if.m -h awk -f /usr/src/sys/tools/makeobjops.awk /usr/src/sys/dev/pci/pcib_if.m -h awk -f /usr/src/sys/tools/makeobjops.awk /usr/src/sys/dev/acpica/acpi_if.m -h awk -f /usr/src/sys/tools/vnode_if.awk /usr/src/sys/kern/vnode_if.src -p awk -f /usr/src/sys/tools/vnode_if.awk /usr/src/sys/kern/vnode_if.src -q awk -f /usr/src/sys/tools/vnode_if.awk /usr/src/sys/kern/vnode_if.src -h awk -f /usr/src/sys/tools/makeobjops.awk /usr/src/sys/amd64/vmm/amd/ivhd_if.m -c awk -f /usr/src/sys/tools/makeobjops.awk /usr/src/sys/amd64/vmm/amd/ivhd_if.m -h touch opt_global.h cc -c -O2 -pipe -DVMM_KEEP_STATS -fno-strict-aliasing -Werror -D_KERNEL -DKLD_MODULE -nostdinc -I/usr/src/sys/amd64/vmm -I/usr/src/sys/amd64/vmm/io -I/usr/src/sys/amd64/vmm/intel -I/usr/src/sys/amd64/vmm/amd -include /usr/obj/usr/src/amd64.amd64/sys/modules/vmm/opt_global.h -I. -I/usr/src/sys -I/usr/src/sys/contrib/ck/include -fno-omit-frame-pointer -mno-omit-leaf-frame-pointer -fdebug-prefix-map=3D./machine=3D/usr/src/sys/amd64/include -fdebug-prefix-map=3D./x86=3D/usr/src/sys/x86/include -fdebug-prefix-map=3D./i386=3D/usr/src/sys/i386/include -MD -MF.depend.genoffset.o -MTgenoffset.o -mcmodel=3Dkernel -mno-red-zone -mno-mmx -mno-sse -msoft-float -fno-asynchronous-unwind-tables -ffreestanding -fwrapv -fstack-protector -Wall -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith -Wcast-qual -Wundef -Wno-pointer-sign -D__printf__=3D__freebsd_kprintf__ -Wmissing-include-dirs -fdiagnostics-show-option -Wno-unknown-pragmas -Wno-error=3Dtautological-compare -Wno-error=3Dempty-body -Wno-error=3Dparentheses-equality -Wno-error=3Dunused-function -Wno-error=3Dpointer-sign -Wno-error=3Dshift-negative-value -Wno-address-of-packed-member -Wno-format-zero-length -mno-aes -mno-avx -std=3Dgnu99 -fcommon /usr/src/sys/kern/genoffset.c sh /usr/src/sys/kern/genoffset.sh genoffset.o > offset.inc cc -c -O2 -pipe -DVMM_KEEP_STATS -fno-strict-aliasing -Werror -D_KERNEL -DKLD_MODULE -nostdinc -I/usr/src/sys/amd64/vmm -I/usr/src/sys/amd64/vmm/io -I/usr/src/sys/amd64/vmm/intel -I/usr/src/sys/amd64/vmm/amd -include /usr/obj/usr/src/amd64.amd64/sys/modules/vmm/opt_global.h -I. -I/usr/src/sys -I/usr/src/sys/contrib/ck/include -fno-omit-frame-pointer -mno-omit-leaf-frame-pointer -fdebug-prefix-map=3D./machine=3D/usr/src/sys/amd64/include -fdebug-prefix-map=3D./x86=3D/usr/src/sys/x86/include -fdebug-prefix-map=3D./i386=3D/usr/src/sys/i386/include -mcmodel=3Dkernel -mno-red-zone -mno-mmx -mno-sse -msoft-float -fno-asynchronous-unwind-tables -ffreestanding -fwrapv -fstack-protector -Wall -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith -Wcast-qual -Wundef -Wno-pointer-sign -D__printf__=3D__freebsd_kprintf__ -Wmissing-include-dirs -fdiagnostics-show-option -Wno-unknown-pragmas -Wno-error=3Dtautological-compare -Wno-error=3Dempty-body -Wno-error=3Dparentheses-equality -Wno-error=3Dunused-function -Wno-error=3Dpointer-sign -Wno-error=3Dshift-negative-value -Wno-address-of-packed-member -Wno-format-zero-length -mno-aes -mno-avx -std=3Dgnu99 -fcommon /usr/src/sys/amd64/vmm/intel/vmx_genassym.c sh /usr/src/sys/kern/genassym.sh vmx_genassym.o > vmx_assym.h cc -c -O2 -pipe -DVMM_KEEP_STATS -fno-strict-aliasing -Werror -D_KERNEL -DKLD_MODULE -nostdinc -I/usr/src/sys/amd64/vmm -I/usr/src/sys/amd64/vmm/io -I/usr/src/sys/amd64/vmm/intel -I/usr/src/sys/amd64/vmm/amd -include /usr/obj/usr/src/amd64.amd64/sys/modules/vmm/opt_global.h -I. -I/usr/src/sys -I/usr/src/sys/contrib/ck/include -fno-omit-frame-pointer -mno-omit-leaf-frame-pointer -fdebug-prefix-map=3D./machine=3D/usr/src/sys/amd64/include -fdebug-prefix-map=3D./x86=3D/usr/src/sys/x86/include -fdebug-prefix-map=3D./i386=3D/usr/src/sys/i386/include -mcmodel=3Dkernel -mno-red-zone -mno-mmx -mno-sse -msoft-float -fno-asynchronous-unwind-tables -ffreestanding -fwrapv -fstack-protector -Wall -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith -Wcast-qual -Wundef -Wno-pointer-sign -D__printf__=3D__freebsd_kprintf__ -Wmissing-include-dirs -fdiagnostics-show-option -Wno-unknown-pragmas -Wno-error=3Dtautological-compare -Wno-error=3Dempty-body -Wno-error=3Dparentheses-equality -Wno-error=3Dunused-function -Wno-error=3Dpointer-sign -Wno-error=3Dshift-negative-value -Wno-address-of-packed-member -Wno-format-zero-length -mno-aes -mno-avx -std=3Dgnu99 -fcommon /usr/src/sys/amd64/vmm/amd/svm_genassym.c sh /usr/src/sys/kern/genassym.sh svm_genassym.o > svm_assym.h cc -O2 -pipe -fno-common -DVMM_KEEP_STATS -fno-strict-aliasing -Werror -D_KERNEL -DKLD_MODULE -nostdinc -I/usr/src/sys/amd64/vmm -I/usr/src/sys/amd64/vmm/io -I/usr/src/sys/amd64/vmm/intel -I/usr/src/sys/amd64/vmm/amd -include /usr/obj/usr/src/amd64.amd64/sys/modules/vmm/opt_global.h -I. -I/usr/src/sys -I/usr/src/sys/contrib/ck/include -fno-common -fno-omit-frame-pointer -mno-omit-leaf-frame-pointer -fdebug-prefix-map=3D./machine=3D/usr/src/sys/amd64/include -fdebug-prefix-map=3D./x86=3D/usr/src/sys/x86/include -fdebug-prefix-map=3D./i386=3D/usr/src/sys/i386/include -MD -MF.depend.vmm.o -MTvmm.o -mcmodel=3Dkernel -mno-red-zone -mno-mmx -mno-ss= e -msoft-float -fno-asynchronous-unwind-tables -ffreestanding -fwrapv -fstack-protector -Wall -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith -Wcast-qual -Wundef -Wno-pointer-sign -D__printf__=3D__freebsd_kprintf__ -Wmissing-include-dirs -fdiagnostics-show-option -Wno-unknown-pragmas -Wno-error=3Dtautological-compare -Wno-error=3Dempty-body -Wno-error=3Dparentheses-equality -Wno-error=3Dunused-function -Wno-error=3Dpointer-sign -Wno-error=3Dshift-negative-value -Wno-address-of-packed-member -Wno-format-zero-length -mno-aes -mno-avx -std=3Dgnu99 -c /usr/src/sys/amd64/vmm/vmm.c -o vmm.o cc -O2 -pipe -fno-common -DVMM_KEEP_STATS -fno-strict-aliasing -Werror -D_KERNEL -DKLD_MODULE -nostdinc -I/usr/src/sys/amd64/vmm -I/usr/src/sys/amd64/vmm/io -I/usr/src/sys/amd64/vmm/intel -I/usr/src/sys/amd64/vmm/amd -include /usr/obj/usr/src/amd64.amd64/sys/modules/vmm/opt_global.h -I. -I/usr/src/sys -I/usr/src/sys/contrib/ck/include -fno-common -fno-omit-frame-pointer -mno-omit-leaf-frame-pointer -fdebug-prefix-map=3D./machine=3D/usr/src/sys/amd64/include -fdebug-prefix-map=3D./x86=3D/usr/src/sys/x86/include -fdebug-prefix-map=3D./i386=3D/usr/src/sys/i386/include -MD -MF.depend.vmm_dev.o -MTvmm_dev.o -mcmodel=3Dkernel -mno-red-zone -mno-mmx -mno-sse -msoft-float -fno-asynchronous-unwind-tables -ffreestanding -fwrapv -fstack-protector -Wall -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith -Wcast-qual -Wundef -Wno-pointer-sign -D__printf__=3D__freebsd_kprintf__ -Wmissing-include-dirs -fdiagnostics-show-option -Wno-unknown-pragmas -Wno-error=3Dtautological-compare -Wno-error=3Dempty-body -Wno-error=3Dparentheses-equality -Wno-error=3Dunused-function -Wno-error=3Dpointer-sign -Wno-error=3Dshift-negative-value -Wno-address-of-packed-member -Wno-format-zero-length -mno-aes -mno-avx -std=3Dgnu99 -c /usr/src/sys/amd64/vmm/vmm_dev.c -o vmm_dev.o cc -O2 -pipe -fno-common -DVMM_KEEP_STATS -fno-strict-aliasing -Werror -D_KERNEL -DKLD_MODULE -nostdinc -I/usr/src/sys/amd64/vmm -I/usr/src/sys/amd64/vmm/io -I/usr/src/sys/amd64/vmm/intel -I/usr/src/sys/amd64/vmm/amd -include /usr/obj/usr/src/amd64.amd64/sys/modules/vmm/opt_global.h -I. -I/usr/src/sys -I/usr/src/sys/contrib/ck/include -fno-common -fno-omit-frame-pointer -mno-omit-leaf-frame-pointer -fdebug-prefix-map=3D./machine=3D/usr/src/sys/amd64/include -fdebug-prefix-map=3D./x86=3D/usr/src/sys/x86/include -fdebug-prefix-map=3D./i386=3D/usr/src/sys/i386/include -MD -MF.depend.vmm_host.o -MTvmm_host.o -mcmodel=3Dkernel -mno-red-zone -mno-m= mx -mno-sse -msoft-float -fno-asynchronous-unwind-tables -ffreestanding -fwrapv -fstack-protector -Wall -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith -Wcast-qual -Wundef -Wno-pointer-sign -D__printf__=3D__freebsd_kprintf__ -Wmissing-include-dirs -fdiagnostics-show-option -Wno-unknown-pragmas -Wno-error=3Dtautological-compare -Wno-error=3Dempty-body -Wno-error=3Dparentheses-equality -Wno-error=3Dunused-function -Wno-error=3Dpointer-sign -Wno-error=3Dshift-negative-value -Wno-address-of-packed-member -Wno-format-zero-length -mno-aes -mno-avx -std=3Dgnu99 -c /usr/src/sys/amd64/vmm/vmm_host.c -o vmm_host.o cc -O2 -pipe -fno-common -DVMM_KEEP_STATS -fno-strict-aliasing -Werror -D_KERNEL -DKLD_MODULE -nostdinc -I/usr/src/sys/amd64/vmm -I/usr/src/sys/amd64/vmm/io -I/usr/src/sys/amd64/vmm/intel -I/usr/src/sys/amd64/vmm/amd -include /usr/obj/usr/src/amd64.amd64/sys/modules/vmm/opt_global.h -I. -I/usr/src/sys -I/usr/src/sys/contrib/ck/include -fno-common -fno-omit-frame-pointer -mno-omit-leaf-frame-pointer -fdebug-prefix-map=3D./machine=3D/usr/src/sys/amd64/include -fdebug-prefix-map=3D./x86=3D/usr/src/sys/x86/include -fdebug-prefix-map=3D./i386=3D/usr/src/sys/i386/include -MD -MF.depend.vmm_instruction_emul.o -MTvmm_instruction_emul.o -mcmodel=3Dkernel -mno-red-zone -mno-mmx -mno-sse -msoft-float -fno-asynchronous-unwind-tables -ffreestanding -fwrapv -fstack-protector -Wall -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith -Wcast-qual -Wundef -Wno-pointer-sign -D__printf__=3D__freebsd_kprintf__ -Wmissing-include-dirs -fdiagnostics-show-option -Wno-unknown-pragmas -Wno-error=3Dtautological-compare -Wno-error=3Dempty-body -Wno-error=3Dparentheses-equality -Wno-error=3Dunused-function -Wno-error=3Dpointer-sign -Wno-error=3Dshift-negative-value -Wno-address-of-packed-member -Wno-format-zero-length -mno-aes -mno-avx -std=3Dgnu99 -c /usr/src/sys/amd64/vmm/vmm_instruction_emul.c -o vmm_instruction_emul.o cc -O2 -pipe -fno-common -DVMM_KEEP_STATS -fno-strict-aliasing -Werror -D_KERNEL -DKLD_MODULE -nostdinc -I/usr/src/sys/amd64/vmm -I/usr/src/sys/amd64/vmm/io -I/usr/src/sys/amd64/vmm/intel -I/usr/src/sys/amd64/vmm/amd -include /usr/obj/usr/src/amd64.amd64/sys/modules/vmm/opt_global.h -I. -I/usr/src/sys -I/usr/src/sys/contrib/ck/include -fno-common -fno-omit-frame-pointer -mno-omit-leaf-frame-pointer -fdebug-prefix-map=3D./machine=3D/usr/src/sys/amd64/include -fdebug-prefix-map=3D./x86=3D/usr/src/sys/x86/include -fdebug-prefix-map=3D./i386=3D/usr/src/sys/i386/include -MD -MF.depend.vmm_ioport.o -MTvmm_ioport.o -mcmodel=3Dkernel -mno-red-zone -mno-mmx -mno-sse -msoft-float -fno-asynchronous-unwind-tables -ffreestanding -fwrapv -fstack-protector -Wall -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith -Wcast-qual -Wundef -Wno-pointer-sign -D__printf__=3D__freebsd_kprintf__ -Wmissing-include-dirs -fdiagnostics-show-option -Wno-unknown-pragmas -Wno-error=3Dtautological-compare -Wno-error=3Dempty-body -Wno-error=3Dparentheses-equality -Wno-error=3Dunused-function -Wno-error=3Dpointer-sign -Wno-error=3Dshift-negative-value -Wno-address-of-packed-member -Wno-format-zero-length -mno-aes -mno-avx -std=3Dgnu99 -c /usr/src/sys/amd64/vmm/vmm_ioport.c -o vmm_ioport.o cc -O2 -pipe -fno-common -DVMM_KEEP_STATS -fno-strict-aliasing -Werror -D_KERNEL -DKLD_MODULE -nostdinc -I/usr/src/sys/amd64/vmm -I/usr/src/sys/amd64/vmm/io -I/usr/src/sys/amd64/vmm/intel -I/usr/src/sys/amd64/vmm/amd -include /usr/obj/usr/src/amd64.amd64/sys/modules/vmm/opt_global.h -I. -I/usr/src/sys -I/usr/src/sys/contrib/ck/include -fno-common -fno-omit-frame-pointer -mno-omit-leaf-frame-pointer -fdebug-prefix-map=3D./machine=3D/usr/src/sys/amd64/include -fdebug-prefix-map=3D./x86=3D/usr/src/sys/x86/include -fdebug-prefix-map=3D./i386=3D/usr/src/sys/i386/include -MD -MF.depend.vmm_lapic.o -MTvmm_lapic.o -mcmodel=3Dkernel -mno-red-zone -mno-mmx -mno-sse -msoft-float -fno-asynchronous-unwind-tables -ffreestanding -fwrapv -fstack-protector -Wall -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith -Wcast-qual -Wundef -Wno-pointer-sign -D__printf__=3D__freebsd_kprintf__ -Wmissing-include-dirs -fdiagnostics-show-option -Wno-unknown-pragmas -Wno-error=3Dtautological-compare -Wno-error=3Dempty-body -Wno-error=3Dparentheses-equality -Wno-error=3Dunused-function -Wno-error=3Dpointer-sign -Wno-error=3Dshift-negative-value -Wno-address-of-packed-member -Wno-format-zero-length -mno-aes -mno-avx -std=3Dgnu99 -c /usr/src/sys/amd64/vmm/vmm_lapic.c -o vmm_lapic.o cc -O2 -pipe -fno-common -DVMM_KEEP_STATS -fno-strict-aliasing -Werror -D_KERNEL -DKLD_MODULE -nostdinc -I/usr/src/sys/amd64/vmm -I/usr/src/sys/amd64/vmm/io -I/usr/src/sys/amd64/vmm/intel -I/usr/src/sys/amd64/vmm/amd -include /usr/obj/usr/src/amd64.amd64/sys/modules/vmm/opt_global.h -I. -I/usr/src/sys -I/usr/src/sys/contrib/ck/include -fno-common -fno-omit-frame-pointer -mno-omit-leaf-frame-pointer -fdebug-prefix-map=3D./machine=3D/usr/src/sys/amd64/include -fdebug-prefix-map=3D./x86=3D/usr/src/sys/x86/include -fdebug-prefix-map=3D./i386=3D/usr/src/sys/i386/include -MD -MF.depend.vmm_mem.o -MTvmm_mem.o -mcmodel=3Dkernel -mno-red-zone -mno-mmx -mno-sse -msoft-float -fno-asynchronous-unwind-tables -ffreestanding -fwrapv -fstack-protector -Wall -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith -Wcast-qual -Wundef -Wno-pointer-sign -D__printf__=3D__freebsd_kprintf__ -Wmissing-include-dirs -fdiagnostics-show-option -Wno-unknown-pragmas -Wno-error=3Dtautological-compare -Wno-error=3Dempty-body -Wno-error=3Dparentheses-equality -Wno-error=3Dunused-function -Wno-error=3Dpointer-sign -Wno-error=3Dshift-negative-value -Wno-address-of-packed-member -Wno-format-zero-length -mno-aes -mno-avx -std=3Dgnu99 -c /usr/src/sys/amd64/vmm/vmm_mem.c -o vmm_mem.o cc -O2 -pipe -fno-common -DVMM_KEEP_STATS -fno-strict-aliasing -Werror -D_KERNEL -DKLD_MODULE -nostdinc -I/usr/src/sys/amd64/vmm -I/usr/src/sys/amd64/vmm/io -I/usr/src/sys/amd64/vmm/intel -I/usr/src/sys/amd64/vmm/amd -include /usr/obj/usr/src/amd64.amd64/sys/modules/vmm/opt_global.h -I. -I/usr/src/sys -I/usr/src/sys/contrib/ck/include -fno-common -fno-omit-frame-pointer -mno-omit-leaf-frame-pointer -fdebug-prefix-map=3D./machine=3D/usr/src/sys/amd64/include -fdebug-prefix-map=3D./x86=3D/usr/src/sys/x86/include -fdebug-prefix-map=3D./i386=3D/usr/src/sys/i386/include -MD -MF.depend.vmm_stat.o -MTvmm_stat.o -mcmodel=3Dkernel -mno-red-zone -mno-m= mx -mno-sse -msoft-float -fno-asynchronous-unwind-tables -ffreestanding -fwrapv -fstack-protector -Wall -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith -Wcast-qual -Wundef -Wno-pointer-sign -D__printf__=3D__freebsd_kprintf__ -Wmissing-include-dirs -fdiagnostics-show-option -Wno-unknown-pragmas -Wno-error=3Dtautological-compare -Wno-error=3Dempty-body -Wno-error=3Dparentheses-equality -Wno-error=3Dunused-function -Wno-error=3Dpointer-sign -Wno-error=3Dshift-negative-value -Wno-address-of-packed-member -Wno-format-zero-length -mno-aes -mno-avx -std=3Dgnu99 -c /usr/src/sys/amd64/vmm/vmm_stat.c -o vmm_stat.o cc -O2 -pipe -fno-common -DVMM_KEEP_STATS -fno-strict-aliasing -Werror -D_KERNEL -DKLD_MODULE -nostdinc -I/usr/src/sys/amd64/vmm -I/usr/src/sys/amd64/vmm/io -I/usr/src/sys/amd64/vmm/intel -I/usr/src/sys/amd64/vmm/amd -include /usr/obj/usr/src/amd64.amd64/sys/modules/vmm/opt_global.h -I. -I/usr/src/sys -I/usr/src/sys/contrib/ck/include -fno-common -fno-omit-frame-pointer -mno-omit-leaf-frame-pointer -fdebug-prefix-map=3D./machine=3D/usr/src/sys/amd64/include -fdebug-prefix-map=3D./x86=3D/usr/src/sys/x86/include -fdebug-prefix-map=3D./i386=3D/usr/src/sys/i386/include -MD -MF.depend.vmm_util.o -MTvmm_util.o -mcmodel=3Dkernel -mno-red-zone -mno-m= mx -mno-sse -msoft-float -fno-asynchronous-unwind-tables -ffreestanding -fwrapv -fstack-protector -Wall -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith -Wcast-qual -Wundef -Wno-pointer-sign -D__printf__=3D__freebsd_kprintf__ -Wmissing-include-dirs -fdiagnostics-show-option -Wno-unknown-pragmas -Wno-error=3Dtautological-compare -Wno-error=3Dempty-body -Wno-error=3Dparentheses-equality -Wno-error=3Dunused-function -Wno-error=3Dpointer-sign -Wno-error=3Dshift-negative-value -Wno-address-of-packed-member -Wno-format-zero-length -mno-aes -mno-avx -std=3Dgnu99 -c /usr/src/sys/amd64/vmm/vmm_util.c -o vmm_util.o cc -O2 -pipe -fno-common -DVMM_KEEP_STATS -fno-strict-aliasing -Werror -D_KERNEL -DKLD_MODULE -nostdinc -I/usr/src/sys/amd64/vmm -I/usr/src/sys/amd64/vmm/io -I/usr/src/sys/amd64/vmm/intel -I/usr/src/sys/amd64/vmm/amd -include /usr/obj/usr/src/amd64.amd64/sys/modules/vmm/opt_global.h -I. -I/usr/src/sys -I/usr/src/sys/contrib/ck/include -fno-common -fno-omit-frame-pointer -mno-omit-leaf-frame-pointer -fdebug-prefix-map=3D./machine=3D/usr/src/sys/amd64/include -fdebug-prefix-map=3D./x86=3D/usr/src/sys/x86/include -fdebug-prefix-map=3D./i386=3D/usr/src/sys/i386/include -MD -MF.depend.x86.o -MTx86.o -mcmodel=3Dkernel -mno-red-zone -mno-mmx -mno-ss= e -msoft-float -fno-asynchronous-unwind-tables -ffreestanding -fwrapv -fstack-protector -Wall -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith -Wcast-qual -Wundef -Wno-pointer-sign -D__printf__=3D__freebsd_kprintf__ -Wmissing-include-dirs -fdiagnostics-show-option -Wno-unknown-pragmas -Wno-error=3Dtautological-compare -Wno-error=3Dempty-body -Wno-error=3Dparentheses-equality -Wno-error=3Dunused-function -Wno-error=3Dpointer-sign -Wno-error=3Dshift-negative-value -Wno-address-of-packed-member -Wno-format-zero-length -mno-aes -mno-avx -std=3Dgnu99 -c /usr/src/sys/amd64/vmm/x86.c -o x86.o cc -O2 -pipe -fno-common -DVMM_KEEP_STATS -fno-strict-aliasing -Werror -D_KERNEL -DKLD_MODULE -nostdinc -I/usr/src/sys/amd64/vmm -I/usr/src/sys/amd64/vmm/io -I/usr/src/sys/amd64/vmm/intel -I/usr/src/sys/amd64/vmm/amd -include /usr/obj/usr/src/amd64.amd64/sys/modules/vmm/opt_global.h -I. -I/usr/src/sys -I/usr/src/sys/contrib/ck/include -fno-common -fno-omit-frame-pointer -mno-omit-leaf-frame-pointer -fdebug-prefix-map=3D./machine=3D/usr/src/sys/amd64/include -fdebug-prefix-map=3D./x86=3D/usr/src/sys/x86/include -fdebug-prefix-map=3D./i386=3D/usr/src/sys/i386/include -MD -MF.depend.iommu.o -MTiommu.o -mcmodel=3Dkernel -mno-red-zone -mno-mmx -mno-sse -msoft-float -fno-asynchronous-unwind-tables -ffreestanding -fwrapv -fstack-protector -Wall -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith -Wcast-qual -Wundef -Wno-pointer-sign -D__printf__=3D__freebsd_kprintf__ -Wmissing-include-dirs -fdiagnostics-show-option -Wno-unknown-pragmas -Wno-error=3Dtautological-compare -Wno-error=3Dempty-body -Wno-error=3Dparentheses-equality -Wno-error=3Dunused-function -Wno-error=3Dpointer-sign -Wno-error=3Dshift-negative-value -Wno-address-of-packed-member -Wno-format-zero-length -mno-aes -mno-avx -std=3Dgnu99 -c /usr/src/sys/amd64/vmm/io/iommu.c -o iommu.o cc -O2 -pipe -fno-common -DVMM_KEEP_STATS -fno-strict-aliasing -Werror -D_KERNEL -DKLD_MODULE -nostdinc -I/usr/src/sys/amd64/vmm -I/usr/src/sys/amd64/vmm/io -I/usr/src/sys/amd64/vmm/intel -I/usr/src/sys/amd64/vmm/amd -include /usr/obj/usr/src/amd64.amd64/sys/modules/vmm/opt_global.h -I. -I/usr/src/sys -I/usr/src/sys/contrib/ck/include -fno-common -fno-omit-frame-pointer -mno-omit-leaf-frame-pointer -fdebug-prefix-map=3D./machine=3D/usr/src/sys/amd64/include -fdebug-prefix-map=3D./x86=3D/usr/src/sys/x86/include -fdebug-prefix-map=3D./i386=3D/usr/src/sys/i386/include -MD -MF.depend.ppt.o -MTppt.o -mcmodel=3Dkernel -mno-red-zone -mno-mmx -mno-ss= e -msoft-float -fno-asynchronous-unwind-tables -ffreestanding -fwrapv -fstack-protector -Wall -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith -Wcast-qual -Wundef -Wno-pointer-sign -D__printf__=3D__freebsd_kprintf__ -Wmissing-include-dirs -fdiagnostics-show-option -Wno-unknown-pragmas -Wno-error=3Dtautological-compare -Wno-error=3Dempty-body -Wno-error=3Dparentheses-equality -Wno-error=3Dunused-function -Wno-error=3Dpointer-sign -Wno-error=3Dshift-negative-value -Wno-address-of-packed-member -Wno-format-zero-length -mno-aes -mno-avx -std=3Dgnu99 -c /usr/src/sys/amd64/vmm/io/ppt.c -o ppt.o cc -O2 -pipe -fno-common -DVMM_KEEP_STATS -fno-strict-aliasing -Werror -D_KERNEL -DKLD_MODULE -nostdinc -I/usr/src/sys/amd64/vmm -I/usr/src/sys/amd64/vmm/io -I/usr/src/sys/amd64/vmm/intel -I/usr/src/sys/amd64/vmm/amd -include /usr/obj/usr/src/amd64.amd64/sys/modules/vmm/opt_global.h -I. -I/usr/src/sys -I/usr/src/sys/contrib/ck/include -fno-common -fno-omit-frame-pointer -mno-omit-leaf-frame-pointer -fdebug-prefix-map=3D./machine=3D/usr/src/sys/amd64/include -fdebug-prefix-map=3D./x86=3D/usr/src/sys/x86/include -fdebug-prefix-map=3D./i386=3D/usr/src/sys/i386/include -MD -MF.depend.vatpic.o -MTvatpic.o -mcmodel=3Dkernel -mno-red-zone -mno-mmx -mno-sse -msoft-float -fno-asynchronous-unwind-tables -ffreestanding -fwrapv -fstack-protector -Wall -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith -Wcast-qual -Wundef -Wno-pointer-sign -D__printf__=3D__freebsd_kprintf__ -Wmissing-include-dirs -fdiagnostics-show-option -Wno-unknown-pragmas -Wno-error=3Dtautological-compare -Wno-error=3Dempty-body -Wno-error=3Dparentheses-equality -Wno-error=3Dunused-function -Wno-error=3Dpointer-sign -Wno-error=3Dshift-negative-value -Wno-address-of-packed-member -Wno-format-zero-length -mno-aes -mno-avx -std=3Dgnu99 -c /usr/src/sys/amd64/vmm/io/vatpic.c -o vatpic.o cc -O2 -pipe -fno-common -DVMM_KEEP_STATS -fno-strict-aliasing -Werror -D_KERNEL -DKLD_MODULE -nostdinc -I/usr/src/sys/amd64/vmm -I/usr/src/sys/amd64/vmm/io -I/usr/src/sys/amd64/vmm/intel -I/usr/src/sys/amd64/vmm/amd -include /usr/obj/usr/src/amd64.amd64/sys/modules/vmm/opt_global.h -I. -I/usr/src/sys -I/usr/src/sys/contrib/ck/include -fno-common -fno-omit-frame-pointer -mno-omit-leaf-frame-pointer -fdebug-prefix-map=3D./machine=3D/usr/src/sys/amd64/include -fdebug-prefix-map=3D./x86=3D/usr/src/sys/x86/include -fdebug-prefix-map=3D./i386=3D/usr/src/sys/i386/include -MD -MF.depend.vatpit.o -MTvatpit.o -mcmodel=3Dkernel -mno-red-zone -mno-mmx -mno-sse -msoft-float -fno-asynchronous-unwind-tables -ffreestanding -fwrapv -fstack-protector -Wall -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith -Wcast-qual -Wundef -Wno-pointer-sign -D__printf__=3D__freebsd_kprintf__ -Wmissing-include-dirs -fdiagnostics-show-option -Wno-unknown-pragmas -Wno-error=3Dtautological-compare -Wno-error=3Dempty-body -Wno-error=3Dparentheses-equality -Wno-error=3Dunused-function -Wno-error=3Dpointer-sign -Wno-error=3Dshift-negative-value -Wno-address-of-packed-member -Wno-format-zero-length -mno-aes -mno-avx -std=3Dgnu99 -c /usr/src/sys/amd64/vmm/io/vatpit.c -o vatpit.o cc -O2 -pipe -fno-common -DVMM_KEEP_STATS -fno-strict-aliasing -Werror -D_KERNEL -DKLD_MODULE -nostdinc -I/usr/src/sys/amd64/vmm -I/usr/src/sys/amd64/vmm/io -I/usr/src/sys/amd64/vmm/intel -I/usr/src/sys/amd64/vmm/amd -include /usr/obj/usr/src/amd64.amd64/sys/modules/vmm/opt_global.h -I. -I/usr/src/sys -I/usr/src/sys/contrib/ck/include -fno-common -fno-omit-frame-pointer -mno-omit-leaf-frame-pointer -fdebug-prefix-map=3D./machine=3D/usr/src/sys/amd64/include -fdebug-prefix-map=3D./x86=3D/usr/src/sys/x86/include -fdebug-prefix-map=3D./i386=3D/usr/src/sys/i386/include -MD -MF.depend.vhpet.o -MTvhpet.o -mcmodel=3Dkernel -mno-red-zone -mno-mmx -mno-sse -msoft-float -fno-asynchronous-unwind-tables -ffreestanding -fwrapv -fstack-protector -Wall -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith -Wcast-qual -Wundef -Wno-pointer-sign -D__printf__=3D__freebsd_kprintf__ -Wmissing-include-dirs -fdiagnostics-show-option -Wno-unknown-pragmas -Wno-error=3Dtautological-compare -Wno-error=3Dempty-body -Wno-error=3Dparentheses-equality -Wno-error=3Dunused-function -Wno-error=3Dpointer-sign -Wno-error=3Dshift-negative-value -Wno-address-of-packed-member -Wno-format-zero-length -mno-aes -mno-avx -std=3Dgnu99 -c /usr/src/sys/amd64/vmm/io/vhpet.c -o vhpet.o cc -O2 -pipe -fno-common -DVMM_KEEP_STATS -fno-strict-aliasing -Werror -D_KERNEL -DKLD_MODULE -nostdinc -I/usr/src/sys/amd64/vmm -I/usr/src/sys/amd64/vmm/io -I/usr/src/sys/amd64/vmm/intel -I/usr/src/sys/amd64/vmm/amd -include /usr/obj/usr/src/amd64.amd64/sys/modules/vmm/opt_global.h -I. -I/usr/src/sys -I/usr/src/sys/contrib/ck/include -fno-common -fno-omit-frame-pointer -mno-omit-leaf-frame-pointer -fdebug-prefix-map=3D./machine=3D/usr/src/sys/amd64/include -fdebug-prefix-map=3D./x86=3D/usr/src/sys/x86/include -fdebug-prefix-map=3D./i386=3D/usr/src/sys/i386/include -MD -MF.depend.vioapic.o -MTvioapic.o -mcmodel=3Dkernel -mno-red-zone -mno-mmx -mno-sse -msoft-float -fno-asynchronous-unwind-tables -ffreestanding -fwrapv -fstack-protector -Wall -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith -Wcast-qual -Wundef -Wno-pointer-sign -D__printf__=3D__freebsd_kprintf__ -Wmissing-include-dirs -fdiagnostics-show-option -Wno-unknown-pragmas -Wno-error=3Dtautological-compare -Wno-error=3Dempty-body -Wno-error=3Dparentheses-equality -Wno-error=3Dunused-function -Wno-error=3Dpointer-sign -Wno-error=3Dshift-negative-value -Wno-address-of-packed-member -Wno-format-zero-length -mno-aes -mno-avx -std=3Dgnu99 -c /usr/src/sys/amd64/vmm/io/vioapic.c -o vioapic.o cc -O2 -pipe -fno-common -DVMM_KEEP_STATS -fno-strict-aliasing -Werror -D_KERNEL -DKLD_MODULE -nostdinc -I/usr/src/sys/amd64/vmm -I/usr/src/sys/amd64/vmm/io -I/usr/src/sys/amd64/vmm/intel -I/usr/src/sys/amd64/vmm/amd -include /usr/obj/usr/src/amd64.amd64/sys/modules/vmm/opt_global.h -I. -I/usr/src/sys -I/usr/src/sys/contrib/ck/include -fno-common -fno-omit-frame-pointer -mno-omit-leaf-frame-pointer -fdebug-prefix-map=3D./machine=3D/usr/src/sys/amd64/include -fdebug-prefix-map=3D./x86=3D/usr/src/sys/x86/include -fdebug-prefix-map=3D./i386=3D/usr/src/sys/i386/include -MD -MF.depend.vlapic.o -MTvlapic.o -mcmodel=3Dkernel -mno-red-zone -mno-mmx -mno-sse -msoft-float -fno-asynchronous-unwind-tables -ffreestanding -fwrapv -fstack-protector -Wall -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith -Wcast-qual -Wundef -Wno-pointer-sign -D__printf__=3D__freebsd_kprintf__ -Wmissing-include-dirs -fdiagnostics-show-option -Wno-unknown-pragmas -Wno-error=3Dtautological-compare -Wno-error=3Dempty-body -Wno-error=3Dparentheses-equality -Wno-error=3Dunused-function -Wno-error=3Dpointer-sign -Wno-error=3Dshift-negative-value -Wno-address-of-packed-member -Wno-format-zero-length -mno-aes -mno-avx -std=3Dgnu99 -c /usr/src/sys/amd64/vmm/io/vlapic.c -o vlapic.o cc -O2 -pipe -fno-common -DVMM_KEEP_STATS -fno-strict-aliasing -Werror -D_KERNEL -DKLD_MODULE -nostdinc -I/usr/src/sys/amd64/vmm -I/usr/src/sys/amd64/vmm/io -I/usr/src/sys/amd64/vmm/intel -I/usr/src/sys/amd64/vmm/amd -include /usr/obj/usr/src/amd64.amd64/sys/modules/vmm/opt_global.h -I. -I/usr/src/sys -I/usr/src/sys/contrib/ck/include -fno-common -fno-omit-frame-pointer -mno-omit-leaf-frame-pointer -fdebug-prefix-map=3D./machine=3D/usr/src/sys/amd64/include -fdebug-prefix-map=3D./x86=3D/usr/src/sys/x86/include -fdebug-prefix-map=3D./i386=3D/usr/src/sys/i386/include -MD -MF.depend.vpmtmr.o -MTvpmtmr.o -mcmodel=3Dkernel -mno-red-zone -mno-mmx -mno-sse -msoft-float -fno-asynchronous-unwind-tables -ffreestanding -fwrapv -fstack-protector -Wall -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith -Wcast-qual -Wundef -Wno-pointer-sign -D__printf__=3D__freebsd_kprintf__ -Wmissing-include-dirs -fdiagnostics-show-option -Wno-unknown-pragmas -Wno-error=3Dtautological-compare -Wno-error=3Dempty-body -Wno-error=3Dparentheses-equality -Wno-error=3Dunused-function -Wno-error=3Dpointer-sign -Wno-error=3Dshift-negative-value -Wno-address-of-packed-member -Wno-format-zero-length -mno-aes -mno-avx -std=3Dgnu99 -c /usr/src/sys/amd64/vmm/io/vpmtmr.c -o vpmtmr.o cc -O2 -pipe -fno-common -DVMM_KEEP_STATS -fno-strict-aliasing -Werror -D_KERNEL -DKLD_MODULE -nostdinc -I/usr/src/sys/amd64/vmm -I/usr/src/sys/amd64/vmm/io -I/usr/src/sys/amd64/vmm/intel -I/usr/src/sys/amd64/vmm/amd -include /usr/obj/usr/src/amd64.amd64/sys/modules/vmm/opt_global.h -I. -I/usr/src/sys -I/usr/src/sys/contrib/ck/include -fno-common -fno-omit-frame-pointer -mno-omit-leaf-frame-pointer -fdebug-prefix-map=3D./machine=3D/usr/src/sys/amd64/include -fdebug-prefix-map=3D./x86=3D/usr/src/sys/x86/include -fdebug-prefix-map=3D./i386=3D/usr/src/sys/i386/include -MD -MF.depend.vrtc.o -MTvrtc.o -mcmodel=3Dkernel -mno-red-zone -mno-mmx -mno-sse -msoft-float -fno-asynchronous-unwind-tables -ffreestanding -fwrapv -fstack-protector -Wall -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith -Wcast-qual -Wundef -Wno-pointer-sign -D__printf__=3D__freebsd_kprintf__ -Wmissing-include-dirs -fdiagnostics-show-option -Wno-unknown-pragmas -Wno-error=3Dtautological-compare -Wno-error=3Dempty-body -Wno-error=3Dparentheses-equality -Wno-error=3Dunused-function -Wno-error=3Dpointer-sign -Wno-error=3Dshift-negative-value -Wno-address-of-packed-member -Wno-format-zero-length -mno-aes -mno-avx -std=3Dgnu99 -c /usr/src/sys/amd64/vmm/io/vrtc.c -o vrtc.o cc -O2 -pipe -fno-common -DVMM_KEEP_STATS -fno-strict-aliasing -Werror -D_KERNEL -DKLD_MODULE -nostdinc -I/usr/src/sys/amd64/vmm -I/usr/src/sys/amd64/vmm/io -I/usr/src/sys/amd64/vmm/intel -I/usr/src/sys/amd64/vmm/amd -include /usr/obj/usr/src/amd64.amd64/sys/modules/vmm/opt_global.h -I. -I/usr/src/sys -I/usr/src/sys/contrib/ck/include -fno-common -fno-omit-frame-pointer -mno-omit-leaf-frame-pointer -fdebug-prefix-map=3D./machine=3D/usr/src/sys/amd64/include -fdebug-prefix-map=3D./x86=3D/usr/src/sys/x86/include -fdebug-prefix-map=3D./i386=3D/usr/src/sys/i386/include -MD -MF.depend.ept.o -MTept.o -mcmodel=3Dkernel -mno-red-zone -mno-mmx -mno-ss= e -msoft-float -fno-asynchronous-unwind-tables -ffreestanding -fwrapv -fstack-protector -Wall -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith -Wcast-qual -Wundef -Wno-pointer-sign -D__printf__=3D__freebsd_kprintf__ -Wmissing-include-dirs -fdiagnostics-show-option -Wno-unknown-pragmas -Wno-error=3Dtautological-compare -Wno-error=3Dempty-body -Wno-error=3Dparentheses-equality -Wno-error=3Dunused-function -Wno-error=3Dpointer-sign -Wno-error=3Dshift-negative-value -Wno-address-of-packed-member -Wno-format-zero-length -mno-aes -mno-avx -std=3Dgnu99 -c /usr/src/sys/amd64/vmm/intel/ept.c -o ept.o cc -O2 -pipe -fno-common -DVMM_KEEP_STATS -fno-strict-aliasing -Werror -D_KERNEL -DKLD_MODULE -nostdinc -I/usr/src/sys/amd64/vmm -I/usr/src/sys/amd64/vmm/io -I/usr/src/sys/amd64/vmm/intel -I/usr/src/sys/amd64/vmm/amd -include /usr/obj/usr/src/amd64.amd64/sys/modules/vmm/opt_global.h -I. -I/usr/src/sys -I/usr/src/sys/contrib/ck/include -fno-common -fno-omit-frame-pointer -mno-omit-leaf-frame-pointer -fdebug-prefix-map=3D./machine=3D/usr/src/sys/amd64/include -fdebug-prefix-map=3D./x86=3D/usr/src/sys/x86/include -fdebug-prefix-map=3D./i386=3D/usr/src/sys/i386/include -MD -MF.depend.vmcs.o -MTvmcs.o -mcmodel=3Dkernel -mno-red-zone -mno-mmx -mno-sse -msoft-float -fno-asynchronous-unwind-tables -ffreestanding -fwrapv -fstack-protector -Wall -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith -Wcast-qual -Wundef -Wno-pointer-sign -D__printf__=3D__freebsd_kprintf__ -Wmissing-include-dirs -fdiagnostics-show-option -Wno-unknown-pragmas -Wno-error=3Dtautological-compare -Wno-error=3Dempty-body -Wno-error=3Dparentheses-equality -Wno-error=3Dunused-function -Wno-error=3Dpointer-sign -Wno-error=3Dshift-negative-value -Wno-address-of-packed-member -Wno-format-zero-length -mno-aes -mno-avx -std=3Dgnu99 -c /usr/src/sys/amd64/vmm/intel/vmcs.c -o vmcs.o cc -O2 -pipe -fno-common -DVMM_KEEP_STATS -fno-strict-aliasing -Werror -D_KERNEL -DKLD_MODULE -nostdinc -I/usr/src/sys/amd64/vmm -I/usr/src/sys/amd64/vmm/io -I/usr/src/sys/amd64/vmm/intel -I/usr/src/sys/amd64/vmm/amd -include /usr/obj/usr/src/amd64.amd64/sys/modules/vmm/opt_global.h -I. -I/usr/src/sys -I/usr/src/sys/contrib/ck/include -fno-common -fno-omit-frame-pointer -mno-omit-leaf-frame-pointer -fdebug-prefix-map=3D./machine=3D/usr/src/sys/amd64/include -fdebug-prefix-map=3D./x86=3D/usr/src/sys/x86/include -fdebug-prefix-map=3D./i386=3D/usr/src/sys/i386/include -MD -MF.depend.vmx_msr.o -MTvmx_msr.o -mcmodel=3Dkernel -mno-red-zone -mno-mmx -mno-sse -msoft-float -fno-asynchronous-unwind-tables -ffreestanding -fwrapv -fstack-protector -Wall -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith -Wcast-qual -Wundef -Wno-pointer-sign -D__printf__=3D__freebsd_kprintf__ -Wmissing-include-dirs -fdiagnostics-show-option -Wno-unknown-pragmas -Wno-error=3Dtautological-compare -Wno-error=3Dempty-body -Wno-error=3Dparentheses-equality -Wno-error=3Dunused-function -Wno-error=3Dpointer-sign -Wno-error=3Dshift-negative-value -Wno-address-of-packed-member -Wno-format-zero-length -mno-aes -mno-avx -std=3Dgnu99 -c /usr/src/sys/amd64/vmm/intel/vmx_msr.c -o vmx_msr.o cc -c -x assembler-with-cpp -DLOCORE -O2 -pipe -fno-common -DVMM_KEEP_STATS -fno-strict-aliasing -Werror -D_KERNEL -DKLD_MODULE -nostdinc -I/usr/src/sys/amd64/vmm -I/usr/src/sys/amd64/vmm/io -I/usr/src/sys/amd64/vmm/intel -I/usr/src/sys/amd64/vmm/amd -include /usr/obj/usr/src/amd64.amd64/sys/modules/vmm/opt_global.h -I. -I/usr/src/sys -I/usr/src/sys/contrib/ck/include -fno-common -fno-omit-frame-pointer -mno-omit-leaf-frame-pointer -fdebug-prefix-map=3D./machine=3D/usr/src/sys/amd64/include -fdebug-prefix-map=3D./x86=3D/usr/src/sys/x86/include -fdebug-prefix-map=3D./i386=3D/usr/src/sys/i386/include -MD -MF.depend.vmx_support.o -MTvmx_support.o -mcmodel=3Dkernel -mno-red-zone -mno-mmx -mno-sse -msoft-float -fno-asynchronous-unwind-tables -ffreestanding -fwrapv -fstack-protector -Wall -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith -Wcast-qual -Wundef -Wno-pointer-sign -D__printf__=3D__freebsd_kprintf__ -Wmissing-include-dirs -fdiagnostics-show-option -Wno-unknown-pragmas -Wno-error=3Dtautological-compare -Wno-error=3Dempty-body -Wno-error=3Dparentheses-equality -Wno-error=3Dunused-function -Wno-error=3Dpointer-sign -Wno-error=3Dshift-negative-value -Wno-address-of-packed-member -Wno-format-zero-length -mno-aes -mno-avx -std=3Dgnu99 /usr/src/sys/amd64/vmm/intel/vmx_support.S -o vmx_support.o cc -O2 -pipe -fno-common -DVMM_KEEP_STATS -fno-strict-aliasing -Werror -D_KERNEL -DKLD_MODULE -nostdinc -I/usr/src/sys/amd64/vmm -I/usr/src/sys/amd64/vmm/io -I/usr/src/sys/amd64/vmm/intel -I/usr/src/sys/amd64/vmm/amd -include /usr/obj/usr/src/amd64.amd64/sys/modules/vmm/opt_global.h -I. -I/usr/src/sys -I/usr/src/sys/contrib/ck/include -fno-common -fno-omit-frame-pointer -mno-omit-leaf-frame-pointer -fdebug-prefix-map=3D./machine=3D/usr/src/sys/amd64/include -fdebug-prefix-map=3D./x86=3D/usr/src/sys/x86/include -fdebug-prefix-map=3D./i386=3D/usr/src/sys/i386/include -MD -MF.depend.vmx.o -MTvmx.o -mcmodel=3Dkernel -mno-red-zone -mno-mmx -mno-ss= e -msoft-float -fno-asynchronous-unwind-tables -ffreestanding -fwrapv -fstack-protector -Wall -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith -Wcast-qual -Wundef -Wno-pointer-sign -D__printf__=3D__freebsd_kprintf__ -Wmissing-include-dirs -fdiagnostics-show-option -Wno-unknown-pragmas -Wno-error=3Dtautological-compare -Wno-error=3Dempty-body -Wno-error=3Dparentheses-equality -Wno-error=3Dunused-function -Wno-error=3Dpointer-sign -Wno-error=3Dshift-negative-value -Wno-address-of-packed-member -Wno-format-zero-length -mno-aes -mno-avx -std=3Dgnu99 -c /usr/src/sys/amd64/vmm/intel/vmx.c -o vmx.o cc -O2 -pipe -fno-common -DVMM_KEEP_STATS -fno-strict-aliasing -Werror -D_KERNEL -DKLD_MODULE -nostdinc -I/usr/src/sys/amd64/vmm -I/usr/src/sys/amd64/vmm/io -I/usr/src/sys/amd64/vmm/intel -I/usr/src/sys/amd64/vmm/amd -include /usr/obj/usr/src/amd64.amd64/sys/modules/vmm/opt_global.h -I. -I/usr/src/sys -I/usr/src/sys/contrib/ck/include -fno-common -fno-omit-frame-pointer -mno-omit-leaf-frame-pointer -fdebug-prefix-map=3D./machine=3D/usr/src/sys/amd64/include -fdebug-prefix-map=3D./x86=3D/usr/src/sys/x86/include -fdebug-prefix-map=3D./i386=3D/usr/src/sys/i386/include -MD -MF.depend.vtd.o -MTvtd.o -mcmodel=3Dkernel -mno-red-zone -mno-mmx -mno-ss= e -msoft-float -fno-asynchronous-unwind-tables -ffreestanding -fwrapv -fstack-protector -Wall -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith -Wcast-qual -Wundef -Wno-pointer-sign -D__printf__=3D__freebsd_kprintf__ -Wmissing-include-dirs -fdiagnostics-show-option -Wno-unknown-pragmas -Wno-error=3Dtautological-compare -Wno-error=3Dempty-body -Wno-error=3Dparentheses-equality -Wno-error=3Dunused-function -Wno-error=3Dpointer-sign -Wno-error=3Dshift-negative-value -Wno-address-of-packed-member -Wno-format-zero-length -mno-aes -mno-avx -std=3Dgnu99 -c /usr/src/sys/amd64/vmm/intel/vtd.c -o vtd.o cc -O2 -pipe -fno-common -DVMM_KEEP_STATS -fno-strict-aliasing -Werror -D_KERNEL -DKLD_MODULE -nostdinc -I/usr/src/sys/amd64/vmm -I/usr/src/sys/amd64/vmm/io -I/usr/src/sys/amd64/vmm/intel -I/usr/src/sys/amd64/vmm/amd -include /usr/obj/usr/src/amd64.amd64/sys/modules/vmm/opt_global.h -I. -I/usr/src/sys -I/usr/src/sys/contrib/ck/include -fno-common -fno-omit-frame-pointer -mno-omit-leaf-frame-pointer -fdebug-prefix-map=3D./machine=3D/usr/src/sys/amd64/include -fdebug-prefix-map=3D./x86=3D/usr/src/sys/x86/include -fdebug-prefix-map=3D./i386=3D/usr/src/sys/i386/include -MD -MF.depend.vmcb.o -MTvmcb.o -mcmodel=3Dkernel -mno-red-zone -mno-mmx -mno-sse -msoft-float -fno-asynchronous-unwind-tables -ffreestanding -fwrapv -fstack-protector -Wall -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith -Wcast-qual -Wundef -Wno-pointer-sign -D__printf__=3D__freebsd_kprintf__ -Wmissing-include-dirs -fdiagnostics-show-option -Wno-unknown-pragmas -Wno-error=3Dtautological-compare -Wno-error=3Dempty-body -Wno-error=3Dparentheses-equality -Wno-error=3Dunused-function -Wno-error=3Dpointer-sign -Wno-error=3Dshift-negative-value -Wno-address-of-packed-member -Wno-format-zero-length -mno-aes -mno-avx -std=3Dgnu99 -c /usr/src/sys/amd64/vmm/amd/vmcb.c -o vmcb.o cc -O2 -pipe -fno-common -DVMM_KEEP_STATS -fno-strict-aliasing -Werror -D_KERNEL -DKLD_MODULE -nostdinc -I/usr/src/sys/amd64/vmm -I/usr/src/sys/amd64/vmm/io -I/usr/src/sys/amd64/vmm/intel -I/usr/src/sys/amd64/vmm/amd -include /usr/obj/usr/src/amd64.amd64/sys/modules/vmm/opt_global.h -I. -I/usr/src/sys -I/usr/src/sys/contrib/ck/include -fno-common -fno-omit-frame-pointer -mno-omit-leaf-frame-pointer -fdebug-prefix-map=3D./machine=3D/usr/src/sys/amd64/include -fdebug-prefix-map=3D./x86=3D/usr/src/sys/x86/include -fdebug-prefix-map=3D./i386=3D/usr/src/sys/i386/include -MD -MF.depend.amdiommu.o -MTamdiommu.o -mcmodel=3Dkernel -mno-red-zone -mno-m= mx -mno-sse -msoft-float -fno-asynchronous-unwind-tables -ffreestanding -fwrapv -fstack-protector -Wall -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith -Wcast-qual -Wundef -Wno-pointer-sign -D__printf__=3D__freebsd_kprintf__ -Wmissing-include-dirs -fdiagnostics-show-option -Wno-unknown-pragmas -Wno-error=3Dtautological-compare -Wno-error=3Dempty-body -Wno-error=3Dparentheses-equality -Wno-error=3Dunused-function -Wno-error=3Dpointer-sign -Wno-error=3Dshift-negative-value -Wno-address-of-packed-member -Wno-format-zero-length -mno-aes -mno-avx -std=3Dgnu99 -c /usr/src/sys/amd64/vmm/amd/amdiommu.c -o amdiommu.o cc -O2 -pipe -fno-common -DVMM_KEEP_STATS -fno-strict-aliasing -Werror -D_KERNEL -DKLD_MODULE -nostdinc -I/usr/src/sys/amd64/vmm -I/usr/src/sys/amd64/vmm/io -I/usr/src/sys/amd64/vmm/intel -I/usr/src/sys/amd64/vmm/amd -include /usr/obj/usr/src/amd64.amd64/sys/modules/vmm/opt_global.h -I. -I/usr/src/sys -I/usr/src/sys/contrib/ck/include -fno-common -fno-omit-frame-pointer -mno-omit-leaf-frame-pointer -fdebug-prefix-map=3D./machine=3D/usr/src/sys/amd64/include -fdebug-prefix-map=3D./x86=3D/usr/src/sys/x86/include -fdebug-prefix-map=3D./i386=3D/usr/src/sys/i386/include -MD -MF.depend.ivhd_if.o -MTivhd_if.o -mcmodel=3Dkernel -mno-red-zone -mno-mmx -mno-sse -msoft-float -fno-asynchronous-unwind-tables -ffreestanding -fwrapv -fstack-protector -Wall -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith -Wcast-qual -Wundef -Wno-pointer-sign -D__printf__=3D__freebsd_kprintf__ -Wmissing-include-dirs -fdiagnostics-show-option -Wno-unknown-pragmas -Wno-error=3Dtautological-compare -Wno-error=3Dempty-body -Wno-error=3Dparentheses-equality -Wno-error=3Dunused-function -Wno-error=3Dpointer-sign -Wno-error=3Dshift-negative-value -Wno-address-of-packed-member -Wno-format-zero-length -mno-aes -mno-avx -std=3Dgnu99 -c ivhd_if.c -o ivhd_if.o cc -O2 -pipe -fno-common -DVMM_KEEP_STATS -fno-strict-aliasing -Werror -D_KERNEL -DKLD_MODULE -nostdinc -I/usr/src/sys/amd64/vmm -I/usr/src/sys/amd64/vmm/io -I/usr/src/sys/amd64/vmm/intel -I/usr/src/sys/amd64/vmm/amd -include /usr/obj/usr/src/amd64.amd64/sys/modules/vmm/opt_global.h -I. -I/usr/src/sys -I/usr/src/sys/contrib/ck/include -fno-common -fno-omit-frame-pointer -mno-omit-leaf-frame-pointer -fdebug-prefix-map=3D./machine=3D/usr/src/sys/amd64/include -fdebug-prefix-map=3D./x86=3D/usr/src/sys/x86/include -fdebug-prefix-map=3D./i386=3D/usr/src/sys/i386/include -MD -MF.depend.svm.o -MTsvm.o -mcmodel=3Dkernel -mno-red-zone -mno-mmx -mno-ss= e -msoft-float -fno-asynchronous-unwind-tables -ffreestanding -fwrapv -fstack-protector -Wall -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith -Wcast-qual -Wundef -Wno-pointer-sign -D__printf__=3D__freebsd_kprintf__ -Wmissing-include-dirs -fdiagnostics-show-option -Wno-unknown-pragmas -Wno-error=3Dtautological-compare -Wno-error=3Dempty-body -Wno-error=3Dparentheses-equality -Wno-error=3Dunused-function -Wno-error=3Dpointer-sign -Wno-error=3Dshift-negative-value -Wno-address-of-packed-member -Wno-format-zero-length -mno-aes -mno-avx -std=3Dgnu99 -c /usr/src/sys/amd64/vmm/amd/svm.c -o svm.o cc -c -x assembler-with-cpp -DLOCORE -O2 -pipe -fno-common -DVMM_KEEP_STATS -fno-strict-aliasing -Werror -D_KERNEL -DKLD_MODULE -nostdinc -I/usr/src/sys/amd64/vmm -I/usr/src/sys/amd64/vmm/io -I/usr/src/sys/amd64/vmm/intel -I/usr/src/sys/amd64/vmm/amd -include /usr/obj/usr/src/amd64.amd64/sys/modules/vmm/opt_global.h -I. -I/usr/src/sys -I/usr/src/sys/contrib/ck/include -fno-common -fno-omit-frame-pointer -mno-omit-leaf-frame-pointer -fdebug-prefix-map=3D./machine=3D/usr/src/sys/amd64/include -fdebug-prefix-map=3D./x86=3D/usr/src/sys/x86/include -fdebug-prefix-map=3D./i386=3D/usr/src/sys/i386/include -MD -MF.depend.svm_support.o -MTsvm_support.o -mcmodel=3Dkernel -mno-red-zone -mno-mmx -mno-sse -msoft-float -fno-asynchronous-unwind-tables -ffreestanding -fwrapv -fstack-protector -Wall -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith -Wcast-qual -Wundef -Wno-pointer-sign -D__printf__=3D__freebsd_kprintf__ -Wmissing-include-dirs -fdiagnostics-show-option -Wno-unknown-pragmas -Wno-error=3Dtautological-compare -Wno-error=3Dempty-body -Wno-error=3Dparentheses-equality -Wno-error=3Dunused-function -Wno-error=3Dpointer-sign -Wno-error=3Dshift-negative-value -Wno-address-of-packed-member -Wno-format-zero-length -mno-aes -mno-avx -std=3Dgnu99 /usr/src/sys/amd64/vmm/amd/svm_support.S -o svm_support.o cc -O2 -pipe -fno-common -DVMM_KEEP_STATS -fno-strict-aliasing -Werror -D_KERNEL -DKLD_MODULE -nostdinc -I/usr/src/sys/amd64/vmm -I/usr/src/sys/amd64/vmm/io -I/usr/src/sys/amd64/vmm/intel -I/usr/src/sys/amd64/vmm/amd -include /usr/obj/usr/src/amd64.amd64/sys/modules/vmm/opt_global.h -I. -I/usr/src/sys -I/usr/src/sys/contrib/ck/include -fno-common -fno-omit-frame-pointer -mno-omit-leaf-frame-pointer -fdebug-prefix-map=3D./machine=3D/usr/src/sys/amd64/include -fdebug-prefix-map=3D./x86=3D/usr/src/sys/x86/include -fdebug-prefix-map=3D./i386=3D/usr/src/sys/i386/include -MD -MF.depend.npt.o -MTnpt.o -mcmodel=3Dkernel -mno-red-zone -mno-mmx -mno-ss= e -msoft-float -fno-asynchronous-unwind-tables -ffreestanding -fwrapv -fstack-protector -Wall -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith -Wcast-qual -Wundef -Wno-pointer-sign -D__printf__=3D__freebsd_kprintf__ -Wmissing-include-dirs -fdiagnostics-show-option -Wno-unknown-pragmas -Wno-error=3Dtautological-compare -Wno-error=3Dempty-body -Wno-error=3Dparentheses-equality -Wno-error=3Dunused-function -Wno-error=3Dpointer-sign -Wno-error=3Dshift-negative-value -Wno-address-of-packed-member -Wno-format-zero-length -mno-aes -mno-avx -std=3Dgnu99 -c /usr/src/sys/amd64/vmm/amd/npt.c -o npt.o cc -O2 -pipe -fno-common -DVMM_KEEP_STATS -fno-strict-aliasing -Werror -D_KERNEL -DKLD_MODULE -nostdinc -I/usr/src/sys/amd64/vmm -I/usr/src/sys/amd64/vmm/io -I/usr/src/sys/amd64/vmm/intel -I/usr/src/sys/amd64/vmm/amd -include /usr/obj/usr/src/amd64.amd64/sys/modules/vmm/opt_global.h -I. -I/usr/src/sys -I/usr/src/sys/contrib/ck/include -fno-common -fno-omit-frame-pointer -mno-omit-leaf-frame-pointer -fdebug-prefix-map=3D./machine=3D/usr/src/sys/amd64/include -fdebug-prefix-map=3D./x86=3D/usr/src/sys/x86/include -fdebug-prefix-map=3D./i386=3D/usr/src/sys/i386/include -MD -MF.depend.ivrs_drv.o -MTivrs_drv.o -mcmodel=3Dkernel -mno-red-zone -mno-m= mx -mno-sse -msoft-float -fno-asynchronous-unwind-tables -ffreestanding -fwrapv -fstack-protector -Wall -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith -Wcast-qual -Wundef -Wno-pointer-sign -D__printf__=3D__freebsd_kprintf__ -Wmissing-include-dirs -fdiagnostics-show-option -Wno-unknown-pragmas -Wno-error=3Dtautological-compare -Wno-error=3Dempty-body -Wno-error=3Dparentheses-equality -Wno-error=3Dunused-function -Wno-error=3Dpointer-sign -Wno-error=3Dshift-negative-value -Wno-address-of-packed-member -Wno-format-zero-length -mno-aes -mno-avx -std=3Dgnu99 -c /usr/src/sys/amd64/vmm/amd/ivrs_drv.c -o ivrs_drv.o cc -O2 -pipe -fno-common -DVMM_KEEP_STATS -fno-strict-aliasing -Werror -D_KERNEL -DKLD_MODULE -nostdinc -I/usr/src/sys/amd64/vmm -I/usr/src/sys/amd64/vmm/io -I/usr/src/sys/amd64/vmm/intel -I/usr/src/sys/amd64/vmm/amd -include /usr/obj/usr/src/amd64.amd64/sys/modules/vmm/opt_global.h -I. -I/usr/src/sys -I/usr/src/sys/contrib/ck/include -fno-common -fno-omit-frame-pointer -mno-omit-leaf-frame-pointer -fdebug-prefix-map=3D./machine=3D/usr/src/sys/amd64/include -fdebug-prefix-map=3D./x86=3D/usr/src/sys/x86/include -fdebug-prefix-map=3D./i386=3D/usr/src/sys/i386/include -MD -MF.depend.amdvi_hw.o -MTamdvi_hw.o -mcmodel=3Dkernel -mno-red-zone -mno-m= mx -mno-sse -msoft-float -fno-asynchronous-unwind-tables -ffreestanding -fwrapv -fstack-protector -Wall -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith -Wcast-qual -Wundef -Wno-pointer-sign -D__printf__=3D__freebsd_kprintf__ -Wmissing-include-dirs -fdiagnostics-show-option -Wno-unknown-pragmas -Wno-error=3Dtautological-compare -Wno-error=3Dempty-body -Wno-error=3Dparentheses-equality -Wno-error=3Dunused-function -Wno-error=3Dpointer-sign -Wno-error=3Dshift-negative-value -Wno-address-of-packed-member -Wno-format-zero-length -mno-aes -mno-avx -std=3Dgnu99 -c /usr/src/sys/amd64/vmm/amd/amdvi_hw.c -o amdvi_hw.o cc -O2 -pipe -fno-common -DVMM_KEEP_STATS -fno-strict-aliasing -Werror -D_KERNEL -DKLD_MODULE -nostdinc -I/usr/src/sys/amd64/vmm -I/usr/src/sys/amd64/vmm/io -I/usr/src/sys/amd64/vmm/intel -I/usr/src/sys/amd64/vmm/amd -include /usr/obj/usr/src/amd64.amd64/sys/modules/vmm/opt_global.h -I. -I/usr/src/sys -I/usr/src/sys/contrib/ck/include -fno-common -fno-omit-frame-pointer -mno-omit-leaf-frame-pointer -fdebug-prefix-map=3D./machine=3D/usr/src/sys/amd64/include -fdebug-prefix-map=3D./x86=3D/usr/src/sys/x86/include -fdebug-prefix-map=3D./i386=3D/usr/src/sys/i386/include -MD -MF.depend.svm_msr.o -MTsvm_msr.o -mcmodel=3Dkernel -mno-red-zone -mno-mmx -mno-sse -msoft-float -fno-asynchronous-unwind-tables -ffreestanding -fwrapv -fstack-protector -Wall -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith -Wcast-qual -Wundef -Wno-pointer-sign -D__printf__=3D__freebsd_kprintf__ -Wmissing-include-dirs -fdiagnostics-show-option -Wno-unknown-pragmas -Wno-error=3Dtautological-compare -Wno-error=3Dempty-body -Wno-error=3Dparentheses-equality -Wno-error=3Dunused-function -Wno-error=3Dpointer-sign -Wno-error=3Dshift-negative-value -Wno-address-of-packed-member -Wno-format-zero-length -mno-aes -mno-avx -std=3Dgnu99 -c /usr/src/sys/amd64/vmm/amd/svm_msr.c -o svm_msr.o ld -m elf_x86_64_fbsd -d -warn-common --build-id=3Dsha1 -T /usr/src/sys/conf/ldscript.kmod.amd64 -r -o vmm.ko vmm.o vmm_dev.o vmm_host.o vmm_instruction_emul.o vmm_ioport.o vmm_lapic.o vmm_mem.o vmm_stat.o vmm_util.o x86.o iommu.o ppt.o vatpic.o vatpit.o vhpet.o vioapic.o vlapic.o vpmtmr.o vrtc.o ept.o vmcs.o vmx_msr.o vmx_support.o vmx.o vtd.o vmcb.o amdiommu.o ivhd_if.o svm.o svm_support.o npt.o ivrs_drv.o amdvi_hw.o svm_msr.o ld: warning: svm_support.o: missing .note.GNU-stack section implies executable stack ld: NOTE: This behaviour is deprecated and will be removed in a future version of the linker :> export_syms awk -f /usr/src/sys/conf/kmod_syms.awk vmm.ko export_syms | xargs -J% objcopy % vmm.ko objcopy --strip-debug vmm.ko now the patched vmm.ko should be ready ? On Mon, Dec 2, 2024 at 10:34=E2=80=AFPM Mario Marietto wrote: > Yes,I have also exchanged the bhyve binary. Now I'm trying to apply your > patch and then I will rebuild vmm. > I see that your code is : > > [0xF6] =3D { > /* XXX Group 3 extended opcode - not just TEST */ > .op_byte =3D 0xF6, > .op_type =3D VIE_OP_TYPE_TEST, > .op_flags =3D VIE_OP_F_IMM, > }, > > but it seems wrong. Shouldn't be .op_flags =3D VIE_OP_F_IMM8 ? > > On Mon, Dec 2, 2024 at 10:16=E2=80=AFPM Mark Peek wrote: > >> On Mon, Dec 2, 2024 at 1:05=E2=80=AFPM Mario Marietto >> wrote: >> >>> Hello Mark, >>> >>> I see that your patch is about to modify the code of the vmm.ko module. >>> I've just exchanged the vmm.ko module that I'm using on the ZFS system = with >>> the module that I use on the UFS system (where I don't see the error) b= ut >>> this operation didn't solve the problem. I suspect that the wrong code = is >>> not inside the vmm.ko module. Can you offer a quick technical explanati= on >>> of the reason why the exchange of the modules does not work for me ? >>> >> >> I'm assuming you applied the patch and rebuilt the vmm.ko module. Did yo= u >> also recompile the bhyve binary per my comments in my last message? The >> emulated instructions are detected in vmm.ko but are emulated in the bhy= ve >> binary. In other words, vmm_instruction_emul.c is used in both vmm.ko an= d >> bhyve. >> >> Mark >> > > > -- > Mario. > --=20 Mario. --000000000000227761062850c574 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
Can you tell me if the compilation ended without erro= rs ?

[root@marietto /usr/src/sys/modules/vmm]= =3D=3D> ls
Makefile

=
[root@marietto /usr/src/sys/modules/vmm]=3D=3D> make

=
[Creating objdir /usr/obj/usr/src/amd64.amd64/sys/modules/vmm...= ]
machine -> /usr/src/sys/amd64/include
x86 -> /usr/src/sys/x= 86/include
i386 -> /usr/src/sys/i386/include
:> opt_acpi.h
:= > opt_bhyve_snapshot.h
:> opt_ddb.h
awk -f /usr/src/sys/tools/m= akeobjops.awk /usr/src/sys/kern/device_if.m -h
awk -f /usr/src/sys/tools= /makeobjops.awk /usr/src/sys/kern/bus_if.m -h
awk -f /usr/src/sys/tools/= makeobjops.awk /usr/src/sys/dev/pci/pci_if.m -h
awk -f /usr/src/sys/tool= s/makeobjops.awk /usr/src/sys/dev/pci/pcib_if.m -h
awk -f /usr/src/sys/t= ools/makeobjops.awk /usr/src/sys/dev/acpica/acpi_if.m -h
awk -f /usr/src= /sys/tools/vnode_if.awk /usr/src/sys/kern/vnode_if.src -p
awk -f /usr/sr= c/sys/tools/vnode_if.awk /usr/src/sys/kern/vnode_if.src -q
awk -f /usr/s= rc/sys/tools/vnode_if.awk /usr/src/sys/kern/vnode_if.src -h
awk -f /usr/= src/sys/tools/makeobjops.awk /usr/src/sys/amd64/vmm/amd/ivhd_if.m -c
awk= -f /usr/src/sys/tools/makeobjops.awk /usr/src/sys/amd64/vmm/amd/ivhd_if.m = -h
touch opt_global.h
cc -c -O2 -pipe -DVMM_KEEP_STATS -fno-strict-al= iasing -Werror -D_KERNEL -DKLD_MODULE -nostdinc -I/usr/src/sys/amd64/vmm -I= /usr/src/sys/amd64/vmm/io -I/usr/src/sys/amd64/vmm/intel -I/usr/src/sys/amd= 64/vmm/amd -include /usr/obj/usr/src/amd64.amd64/sys/modules/vmm/opt_global= .h -I. -I/usr/src/sys -I/usr/src/sys/contrib/ck/include -fno-omit-frame-poi= nter -mno-omit-leaf-frame-pointer -fdebug-prefix-map=3D./machine=3D/usr/src= /sys/amd64/include -fdebug-prefix-map=3D./x86=3D/usr/src/sys/x86/include -f= debug-prefix-map=3D./i386=3D/usr/src/sys/i386/include -MD -MF.depend.genoff= set.o -MTgenoffset.o -mcmodel=3Dkernel -mno-red-zone -mno-mmx -mno-sse -mso= ft-float -fno-asynchronous-unwind-tables -ffreestanding -fwrapv -fstack-pro= tector -Wall -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith -Wcas= t-qual -Wundef -Wno-pointer-sign -D__printf__=3D__freebsd_kprintf__ -Wmissi= ng-include-dirs -fdiagnostics-show-option -Wno-unknown-pragmas -Wno-error= =3Dtautological-compare -Wno-error=3Dempty-body -Wno-error=3Dparentheses-eq= uality -Wno-error=3Dunused-function -Wno-error=3Dpointer-sign -Wno-error=3D= shift-negative-value -Wno-address-of-packed-member -Wno-format-zero-length = -mno-aes -mno-avx -std=3Dgnu99 -fcommon =C2=A0/usr/src/sys/kern/genoffset.c=
sh /usr/src/sys/kern/genoffset.sh genoffset.o > offset.inc
cc -c = -O2 -pipe -DVMM_KEEP_STATS -fno-strict-aliasing -Werror -D_KERNEL -DKLD_MOD= ULE -nostdinc -I/usr/src/sys/amd64/vmm -I/usr/src/sys/amd64/vmm/io -I/usr/s= rc/sys/amd64/vmm/intel -I/usr/src/sys/amd64/vmm/amd -include /usr/obj/usr/s= rc/amd64.amd64/sys/modules/vmm/opt_global.h -I. -I/usr/src/sys -I/usr/src/s= ys/contrib/ck/include -fno-omit-frame-pointer -mno-omit-leaf-frame-pointer = -fdebug-prefix-map=3D./machine=3D/usr/src/sys/amd64/include -fdebug-prefix-= map=3D./x86=3D/usr/src/sys/x86/include -fdebug-prefix-map=3D./i386=3D/usr/s= rc/sys/i386/include -mcmodel=3Dkernel -mno-red-zone -mno-mmx -mno-sse -msof= t-float -fno-asynchronous-unwind-tables -ffreestanding -fwrapv -fstack-prot= ector -Wall -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith -Wcast= -qual -Wundef -Wno-pointer-sign -D__printf__=3D__freebsd_kprintf__ -Wmissin= g-include-dirs -fdiagnostics-show-option -Wno-unknown-pragmas -Wno-error=3D= tautological-compare -Wno-error=3Dempty-body -Wno-error=3Dparentheses-equal= ity -Wno-error=3Dunused-function -Wno-error=3Dpointer-sign -Wno-error=3Dshi= ft-negative-value -Wno-address-of-packed-member -Wno-format-zero-length -mn= o-aes -mno-avx -std=3Dgnu99 -fcommon /usr/src/sys/amd64/vmm/intel/vmx_genas= sym.c
sh /usr/src/sys/kern/genassym.sh vmx_genassym.o > vmx_assym.hcc -c -O2 -pipe -DVMM_KEEP_STATS -fno-strict-aliasing -Werror -D_KERNEL -= DKLD_MODULE -nostdinc -I/usr/src/sys/amd64/vmm -I/usr/src/sys/amd64/vmm/io = -I/usr/src/sys/amd64/vmm/intel -I/usr/src/sys/amd64/vmm/amd -include /usr/o= bj/usr/src/amd64.amd64/sys/modules/vmm/opt_global.h -I. -I/usr/src/sys -I/u= sr/src/sys/contrib/ck/include -fno-omit-frame-pointer -mno-omit-leaf-frame-= pointer -fdebug-prefix-map=3D./machine=3D/usr/src/sys/amd64/include -fdebug= -prefix-map=3D./x86=3D/usr/src/sys/x86/include -fdebug-prefix-map=3D./i386= =3D/usr/src/sys/i386/include -mcmodel=3Dkernel -mno-red-zone -mno-mmx -mno-= sse -msoft-float -fno-asynchronous-unwind-tables -ffreestanding -fwrapv -fs= tack-protector -Wall -Wstrict-prototypes -Wmissing-prototypes -Wpointer-ari= th -Wcast-qual -Wundef -Wno-pointer-sign -D__printf__=3D__freebsd_kprintf__= -Wmissing-include-dirs -fdiagnostics-show-option -Wno-unknown-pragmas -Wno= -error=3Dtautological-compare -Wno-error=3Dempty-body -Wno-error=3Dparenthe= ses-equality -Wno-error=3Dunused-function -Wno-error=3Dpointer-sign -Wno-er= ror=3Dshift-negative-value -Wno-address-of-packed-member -Wno-format-zero-l= ength -mno-aes -mno-avx -std=3Dgnu99 -fcommon /usr/src/sys/amd64/vmm/amd/sv= m_genassym.c
sh /usr/src/sys/kern/genassym.sh svm_genassym.o > svm_as= sym.h
cc =C2=A0-O2 -pipe -fno-common =C2=A0-DVMM_KEEP_STATS -fno-strict-= aliasing -Werror -D_KERNEL -DKLD_MODULE -nostdinc =C2=A0-I/usr/src/sys/amd6= 4/vmm -I/usr/src/sys/amd64/vmm/io -I/usr/src/sys/amd64/vmm/intel -I/usr/src= /sys/amd64/vmm/amd -include /usr/obj/usr/src/amd64.amd64/sys/modules/vmm/op= t_global.h -I. -I/usr/src/sys -I/usr/src/sys/contrib/ck/include -fno-common= =C2=A0-fno-omit-frame-pointer -mno-omit-leaf-frame-pointer -fdebug-prefix-= map=3D./machine=3D/usr/src/sys/amd64/include -fdebug-prefix-map=3D./x86=3D/= usr/src/sys/x86/include -fdebug-prefix-map=3D./i386=3D/usr/src/sys/i386/inc= lude =C2=A0 =C2=A0 -MD =C2=A0-MF.depend.vmm.o -MTvmm.o -mcmodel=3Dkernel -m= no-red-zone -mno-mmx -mno-sse -msoft-float =C2=A0-fno-asynchronous-unwind-t= ables -ffreestanding -fwrapv -fstack-protector -Wall -Wstrict-prototypes -W= missing-prototypes -Wpointer-arith -Wcast-qual -Wundef -Wno-pointer-sign -D= __printf__=3D__freebsd_kprintf__ -Wmissing-include-dirs -fdiagnostics-show-= option -Wno-unknown-pragmas -Wno-error=3Dtautological-compare -Wno-error=3D= empty-body -Wno-error=3Dparentheses-equality -Wno-error=3Dunused-function -= Wno-error=3Dpointer-sign -Wno-error=3Dshift-negative-value -Wno-address-of-= packed-member -Wno-format-zero-length =C2=A0 -mno-aes -mno-avx =C2=A0-std= =3Dgnu99 -c /usr/src/sys/amd64/vmm/vmm.c -o vmm.o
cc =C2=A0-O2 -pipe -fn= o-common =C2=A0-DVMM_KEEP_STATS -fno-strict-aliasing -Werror -D_KERNEL -DKL= D_MODULE -nostdinc =C2=A0-I/usr/src/sys/amd64/vmm -I/usr/src/sys/amd64/vmm/= io -I/usr/src/sys/amd64/vmm/intel -I/usr/src/sys/amd64/vmm/amd -include /us= r/obj/usr/src/amd64.amd64/sys/modules/vmm/opt_global.h -I. -I/usr/src/sys -= I/usr/src/sys/contrib/ck/include -fno-common =C2=A0-fno-omit-frame-pointer = -mno-omit-leaf-frame-pointer -fdebug-prefix-map=3D./machine=3D/usr/src/sys/= amd64/include -fdebug-prefix-map=3D./x86=3D/usr/src/sys/x86/include -fdebug= -prefix-map=3D./i386=3D/usr/src/sys/i386/include =C2=A0 =C2=A0 -MD =C2=A0-M= F.depend.vmm_dev.o -MTvmm_dev.o -mcmodel=3Dkernel -mno-red-zone -mno-mmx -m= no-sse -msoft-float =C2=A0-fno-asynchronous-unwind-tables -ffreestanding -f= wrapv -fstack-protector -Wall -Wstrict-prototypes -Wmissing-prototypes -Wpo= inter-arith -Wcast-qual -Wundef -Wno-pointer-sign -D__printf__=3D__freebsd_= kprintf__ -Wmissing-include-dirs -fdiagnostics-show-option -Wno-unknown-pra= gmas -Wno-error=3Dtautological-compare -Wno-error=3Dempty-body -Wno-error= =3Dparentheses-equality -Wno-error=3Dunused-function -Wno-error=3Dpointer-s= ign -Wno-error=3Dshift-negative-value -Wno-address-of-packed-member -Wno-fo= rmat-zero-length =C2=A0 -mno-aes -mno-avx =C2=A0-std=3Dgnu99 -c /usr/src/sy= s/amd64/vmm/vmm_dev.c -o vmm_dev.o
cc =C2=A0-O2 -pipe -fno-common =C2=A0= -DVMM_KEEP_STATS -fno-strict-aliasing -Werror -D_KERNEL -DKLD_MODULE -nostd= inc =C2=A0-I/usr/src/sys/amd64/vmm -I/usr/src/sys/amd64/vmm/io -I/usr/src/s= ys/amd64/vmm/intel -I/usr/src/sys/amd64/vmm/amd -include /usr/obj/usr/src/a= md64.amd64/sys/modules/vmm/opt_global.h -I. -I/usr/src/sys -I/usr/src/sys/c= ontrib/ck/include -fno-common =C2=A0-fno-omit-frame-pointer -mno-omit-leaf-= frame-pointer -fdebug-prefix-map=3D./machine=3D/usr/src/sys/amd64/include -= fdebug-prefix-map=3D./x86=3D/usr/src/sys/x86/include -fdebug-prefix-map=3D.= /i386=3D/usr/src/sys/i386/include =C2=A0 =C2=A0 -MD =C2=A0-MF.depend.vmm_ho= st.o -MTvmm_host.o -mcmodel=3Dkernel -mno-red-zone -mno-mmx -mno-sse -msoft= -float =C2=A0-fno-asynchronous-unwind-tables -ffreestanding -fwrapv -fstack= -protector -Wall -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith -= Wcast-qual -Wundef -Wno-pointer-sign -D__printf__=3D__freebsd_kprintf__ -Wm= issing-include-dirs -fdiagnostics-show-option -Wno-unknown-pragmas -Wno-err= or=3Dtautological-compare -Wno-error=3Dempty-body -Wno-error=3Dparentheses-= equality -Wno-error=3Dunused-function -Wno-error=3Dpointer-sign -Wno-error= =3Dshift-negative-value -Wno-address-of-packed-member -Wno-format-zero-leng= th =C2=A0 -mno-aes -mno-avx =C2=A0-std=3Dgnu99 -c /usr/src/sys/amd64/vmm/vm= m_host.c -o vmm_host.o
cc =C2=A0-O2 -pipe -fno-common =C2=A0-DVMM_KEEP_S= TATS -fno-strict-aliasing -Werror -D_KERNEL -DKLD_MODULE -nostdinc =C2=A0-I= /usr/src/sys/amd64/vmm -I/usr/src/sys/amd64/vmm/io -I/usr/src/sys/amd64/vmm= /intel -I/usr/src/sys/amd64/vmm/amd -include /usr/obj/usr/src/amd64.amd64/s= ys/modules/vmm/opt_global.h -I. -I/usr/src/sys -I/usr/src/sys/contrib/ck/in= clude -fno-common =C2=A0-fno-omit-frame-pointer -mno-omit-leaf-frame-pointe= r -fdebug-prefix-map=3D./machine=3D/usr/src/sys/amd64/include -fdebug-prefi= x-map=3D./x86=3D/usr/src/sys/x86/include -fdebug-prefix-map=3D./i386=3D/usr= /src/sys/i386/include =C2=A0 =C2=A0 -MD =C2=A0-MF.depend.vmm_instruction_em= ul.o -MTvmm_instruction_emul.o -mcmodel=3Dkernel -mno-red-zone -mno-mmx -mn= o-sse -msoft-float =C2=A0-fno-asynchronous-unwind-tables -ffreestanding -fw= rapv -fstack-protector -Wall -Wstrict-prototypes -Wmissing-prototypes -Wpoi= nter-arith -Wcast-qual -Wundef -Wno-pointer-sign -D__printf__=3D__freebsd_k= printf__ -Wmissing-include-dirs -fdiagnostics-show-option -Wno-unknown-prag= mas -Wno-error=3Dtautological-compare -Wno-error=3Dempty-body -Wno-error=3D= parentheses-equality -Wno-error=3Dunused-function -Wno-error=3Dpointer-sign= -Wno-error=3Dshift-negative-value -Wno-address-of-packed-member -Wno-forma= t-zero-length =C2=A0 -mno-aes -mno-avx =C2=A0-std=3Dgnu99 -c /usr/src/sys/a= md64/vmm/vmm_instruction_emul.c -o vmm_instruction_emul.o
cc =C2=A0-O2 -= pipe -fno-common =C2=A0-DVMM_KEEP_STATS -fno-strict-aliasing -Werror -D_KER= NEL -DKLD_MODULE -nostdinc =C2=A0-I/usr/src/sys/amd64/vmm -I/usr/src/sys/am= d64/vmm/io -I/usr/src/sys/amd64/vmm/intel -I/usr/src/sys/amd64/vmm/amd -inc= lude /usr/obj/usr/src/amd64.amd64/sys/modules/vmm/opt_global.h -I. -I/usr/s= rc/sys -I/usr/src/sys/contrib/ck/include -fno-common =C2=A0-fno-omit-frame-= pointer -mno-omit-leaf-frame-pointer -fdebug-prefix-map=3D./machine=3D/usr/= src/sys/amd64/include -fdebug-prefix-map=3D./x86=3D/usr/src/sys/x86/include= -fdebug-prefix-map=3D./i386=3D/usr/src/sys/i386/include =C2=A0 =C2=A0 -MD = =C2=A0-MF.depend.vmm_ioport.o -MTvmm_ioport.o -mcmodel=3Dkernel -mno-red-zo= ne -mno-mmx -mno-sse -msoft-float =C2=A0-fno-asynchronous-unwind-tables -ff= reestanding -fwrapv -fstack-protector -Wall -Wstrict-prototypes -Wmissing-p= rototypes -Wpointer-arith -Wcast-qual -Wundef -Wno-pointer-sign -D__printf_= _=3D__freebsd_kprintf__ -Wmissing-include-dirs -fdiagnostics-show-option -W= no-unknown-pragmas -Wno-error=3Dtautological-compare -Wno-error=3Dempty-bod= y -Wno-error=3Dparentheses-equality -Wno-error=3Dunused-function -Wno-error= =3Dpointer-sign -Wno-error=3Dshift-negative-value -Wno-address-of-packed-me= mber -Wno-format-zero-length =C2=A0 -mno-aes -mno-avx =C2=A0-std=3Dgnu99 -c= /usr/src/sys/amd64/vmm/vmm_ioport.c -o vmm_ioport.o
cc =C2=A0-O2 -pipe = -fno-common =C2=A0-DVMM_KEEP_STATS -fno-strict-aliasing -Werror -D_KERNEL -= DKLD_MODULE -nostdinc =C2=A0-I/usr/src/sys/amd64/vmm -I/usr/src/sys/amd64/v= mm/io -I/usr/src/sys/amd64/vmm/intel -I/usr/src/sys/amd64/vmm/amd -include = /usr/obj/usr/src/amd64.amd64/sys/modules/vmm/opt_global.h -I. -I/usr/src/sy= s -I/usr/src/sys/contrib/ck/include -fno-common =C2=A0-fno-omit-frame-point= er -mno-omit-leaf-frame-pointer -fdebug-prefix-map=3D./machine=3D/usr/src/s= ys/amd64/include -fdebug-prefix-map=3D./x86=3D/usr/src/sys/x86/include -fde= bug-prefix-map=3D./i386=3D/usr/src/sys/i386/include =C2=A0 =C2=A0 -MD =C2= =A0-MF.depend.vmm_lapic.o -MTvmm_lapic.o -mcmodel=3Dkernel -mno-red-zone -m= no-mmx -mno-sse -msoft-float =C2=A0-fno-asynchronous-unwind-tables -ffreest= anding -fwrapv -fstack-protector -Wall -Wstrict-prototypes -Wmissing-protot= ypes -Wpointer-arith -Wcast-qual -Wundef -Wno-pointer-sign -D__printf__=3D_= _freebsd_kprintf__ -Wmissing-include-dirs -fdiagnostics-show-option -Wno-un= known-pragmas -Wno-error=3Dtautological-compare -Wno-error=3Dempty-body -Wn= o-error=3Dparentheses-equality -Wno-error=3Dunused-function -Wno-error=3Dpo= inter-sign -Wno-error=3Dshift-negative-value -Wno-address-of-packed-member = -Wno-format-zero-length =C2=A0 -mno-aes -mno-avx =C2=A0-std=3Dgnu99 -c /usr= /src/sys/amd64/vmm/vmm_lapic.c -o vmm_lapic.o
cc =C2=A0-O2 -pipe -fno-co= mmon =C2=A0-DVMM_KEEP_STATS -fno-strict-aliasing -Werror -D_KERNEL -DKLD_MO= DULE -nostdinc =C2=A0-I/usr/src/sys/amd64/vmm -I/usr/src/sys/amd64/vmm/io -= I/usr/src/sys/amd64/vmm/intel -I/usr/src/sys/amd64/vmm/amd -include /usr/ob= j/usr/src/amd64.amd64/sys/modules/vmm/opt_global.h -I. -I/usr/src/sys -I/us= r/src/sys/contrib/ck/include -fno-common =C2=A0-fno-omit-frame-pointer -mno= -omit-leaf-frame-pointer -fdebug-prefix-map=3D./machine=3D/usr/src/sys/amd6= 4/include -fdebug-prefix-map=3D./x86=3D/usr/src/sys/x86/include -fdebug-pre= fix-map=3D./i386=3D/usr/src/sys/i386/include =C2=A0 =C2=A0 -MD =C2=A0-MF.de= pend.vmm_mem.o -MTvmm_mem.o -mcmodel=3Dkernel -mno-red-zone -mno-mmx -mno-s= se -msoft-float =C2=A0-fno-asynchronous-unwind-tables -ffreestanding -fwrap= v -fstack-protector -Wall -Wstrict-prototypes -Wmissing-prototypes -Wpointe= r-arith -Wcast-qual -Wundef -Wno-pointer-sign -D__printf__=3D__freebsd_kpri= ntf__ -Wmissing-include-dirs -fdiagnostics-show-option -Wno-unknown-pragmas= -Wno-error=3Dtautological-compare -Wno-error=3Dempty-body -Wno-error=3Dpar= entheses-equality -Wno-error=3Dunused-function -Wno-error=3Dpointer-sign -W= no-error=3Dshift-negative-value -Wno-address-of-packed-member -Wno-format-z= ero-length =C2=A0 -mno-aes -mno-avx =C2=A0-std=3Dgnu99 -c /usr/src/sys/amd6= 4/vmm/vmm_mem.c -o vmm_mem.o
cc =C2=A0-O2 -pipe -fno-common =C2=A0-DVMM_= KEEP_STATS -fno-strict-aliasing -Werror -D_KERNEL -DKLD_MODULE -nostdinc = =C2=A0-I/usr/src/sys/amd64/vmm -I/usr/src/sys/amd64/vmm/io -I/usr/src/sys/a= md64/vmm/intel -I/usr/src/sys/amd64/vmm/amd -include /usr/obj/usr/src/amd64= .amd64/sys/modules/vmm/opt_global.h -I. -I/usr/src/sys -I/usr/src/sys/contr= ib/ck/include -fno-common =C2=A0-fno-omit-frame-pointer -mno-omit-leaf-fram= e-pointer -fdebug-prefix-map=3D./machine=3D/usr/src/sys/amd64/include -fdeb= ug-prefix-map=3D./x86=3D/usr/src/sys/x86/include -fdebug-prefix-map=3D./i38= 6=3D/usr/src/sys/i386/include =C2=A0 =C2=A0 -MD =C2=A0-MF.depend.vmm_stat.o= -MTvmm_stat.o -mcmodel=3Dkernel -mno-red-zone -mno-mmx -mno-sse -msoft-flo= at =C2=A0-fno-asynchronous-unwind-tables -ffreestanding -fwrapv -fstack-pro= tector -Wall -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith -Wcas= t-qual -Wundef -Wno-pointer-sign -D__printf__=3D__freebsd_kprintf__ -Wmissi= ng-include-dirs -fdiagnostics-show-option -Wno-unknown-pragmas -Wno-error= =3Dtautological-compare -Wno-error=3Dempty-body -Wno-error=3Dparentheses-eq= uality -Wno-error=3Dunused-function -Wno-error=3Dpointer-sign -Wno-error=3D= shift-negative-value -Wno-address-of-packed-member -Wno-format-zero-length = =C2=A0 -mno-aes -mno-avx =C2=A0-std=3Dgnu99 -c /usr/src/sys/amd64/vmm/vmm_s= tat.c -o vmm_stat.o
cc =C2=A0-O2 -pipe -fno-common =C2=A0-DVMM_KEEP_STAT= S -fno-strict-aliasing -Werror -D_KERNEL -DKLD_MODULE -nostdinc =C2=A0-I/us= r/src/sys/amd64/vmm -I/usr/src/sys/amd64/vmm/io -I/usr/src/sys/amd64/vmm/in= tel -I/usr/src/sys/amd64/vmm/amd -include /usr/obj/usr/src/amd64.amd64/sys/= modules/vmm/opt_global.h -I. -I/usr/src/sys -I/usr/src/sys/contrib/ck/inclu= de -fno-common =C2=A0-fno-omit-frame-pointer -mno-omit-leaf-frame-pointer -= fdebug-prefix-map=3D./machine=3D/usr/src/sys/amd64/include -fdebug-prefix-m= ap=3D./x86=3D/usr/src/sys/x86/include -fdebug-prefix-map=3D./i386=3D/usr/sr= c/sys/i386/include =C2=A0 =C2=A0 -MD =C2=A0-MF.depend.vmm_util.o -MTvmm_uti= l.o -mcmodel=3Dkernel -mno-red-zone -mno-mmx -mno-sse -msoft-float =C2=A0-f= no-asynchronous-unwind-tables -ffreestanding -fwrapv -fstack-protector -Wal= l -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith -Wcast-qual -Wun= def -Wno-pointer-sign -D__printf__=3D__freebsd_kprintf__ -Wmissing-include-= dirs -fdiagnostics-show-option -Wno-unknown-pragmas -Wno-error=3Dtautologic= al-compare -Wno-error=3Dempty-body -Wno-error=3Dparentheses-equality -Wno-e= rror=3Dunused-function -Wno-error=3Dpointer-sign -Wno-error=3Dshift-negativ= e-value -Wno-address-of-packed-member -Wno-format-zero-length =C2=A0 -mno-a= es -mno-avx =C2=A0-std=3Dgnu99 -c /usr/src/sys/amd64/vmm/vmm_util.c -o vmm_= util.o
cc =C2=A0-O2 -pipe -fno-common =C2=A0-DVMM_KEEP_STATS -fno-strict= -aliasing -Werror -D_KERNEL -DKLD_MODULE -nostdinc =C2=A0-I/usr/src/sys/amd= 64/vmm -I/usr/src/sys/amd64/vmm/io -I/usr/src/sys/amd64/vmm/intel -I/usr/sr= c/sys/amd64/vmm/amd -include /usr/obj/usr/src/amd64.amd64/sys/modules/vmm/o= pt_global.h -I. -I/usr/src/sys -I/usr/src/sys/contrib/ck/include -fno-commo= n =C2=A0-fno-omit-frame-pointer -mno-omit-leaf-frame-pointer -fdebug-prefix= -map=3D./machine=3D/usr/src/sys/amd64/include -fdebug-prefix-map=3D./x86=3D= /usr/src/sys/x86/include -fdebug-prefix-map=3D./i386=3D/usr/src/sys/i386/in= clude =C2=A0 =C2=A0 -MD =C2=A0-MF.depend.x86.o -MTx86.o -mcmodel=3Dkernel -= mno-red-zone -mno-mmx -mno-sse -msoft-float =C2=A0-fno-asynchronous-unwind-= tables -ffreestanding -fwrapv -fstack-protector -Wall -Wstrict-prototypes -= Wmissing-prototypes -Wpointer-arith -Wcast-qual -Wundef -Wno-pointer-sign -= D__printf__=3D__freebsd_kprintf__ -Wmissing-include-dirs -fdiagnostics-show= -option -Wno-unknown-pragmas -Wno-error=3Dtautological-compare -Wno-error= =3Dempty-body -Wno-error=3Dparentheses-equality -Wno-error=3Dunused-functio= n -Wno-error=3Dpointer-sign -Wno-error=3Dshift-negative-value -Wno-address-= of-packed-member -Wno-format-zero-length =C2=A0 -mno-aes -mno-avx =C2=A0-st= d=3Dgnu99 -c /usr/src/sys/amd64/vmm/x86.c -o x86.o
cc =C2=A0-O2 -pipe -f= no-common =C2=A0-DVMM_KEEP_STATS -fno-strict-aliasing -Werror -D_KERNEL -DK= LD_MODULE -nostdinc =C2=A0-I/usr/src/sys/amd64/vmm -I/usr/src/sys/amd64/vmm= /io -I/usr/src/sys/amd64/vmm/intel -I/usr/src/sys/amd64/vmm/amd -include /u= sr/obj/usr/src/amd64.amd64/sys/modules/vmm/opt_global.h -I. -I/usr/src/sys = -I/usr/src/sys/contrib/ck/include -fno-common =C2=A0-fno-omit-frame-pointer= -mno-omit-leaf-frame-pointer -fdebug-prefix-map=3D./machine=3D/usr/src/sys= /amd64/include -fdebug-prefix-map=3D./x86=3D/usr/src/sys/x86/include -fdebu= g-prefix-map=3D./i386=3D/usr/src/sys/i386/include =C2=A0 =C2=A0 -MD =C2=A0-= MF.depend.iommu.o -MTiommu.o -mcmodel=3Dkernel -mno-red-zone -mno-mmx -mno-= sse -msoft-float =C2=A0-fno-asynchronous-unwind-tables -ffreestanding -fwra= pv -fstack-protector -Wall -Wstrict-prototypes -Wmissing-prototypes -Wpoint= er-arith -Wcast-qual -Wundef -Wno-pointer-sign -D__printf__=3D__freebsd_kpr= intf__ -Wmissing-include-dirs -fdiagnostics-show-option -Wno-unknown-pragma= s -Wno-error=3Dtautological-compare -Wno-error=3Dempty-body -Wno-error=3Dpa= rentheses-equality -Wno-error=3Dunused-function -Wno-error=3Dpointer-sign -= Wno-error=3Dshift-negative-value -Wno-address-of-packed-member -Wno-format-= zero-length =C2=A0 -mno-aes -mno-avx =C2=A0-std=3Dgnu99 -c /usr/src/sys/amd= 64/vmm/io/iommu.c -o iommu.o
cc =C2=A0-O2 -pipe -fno-common =C2=A0-DVMM_= KEEP_STATS -fno-strict-aliasing -Werror -D_KERNEL -DKLD_MODULE -nostdinc = =C2=A0-I/usr/src/sys/amd64/vmm -I/usr/src/sys/amd64/vmm/io -I/usr/src/sys/a= md64/vmm/intel -I/usr/src/sys/amd64/vmm/amd -include /usr/obj/usr/src/amd64= .amd64/sys/modules/vmm/opt_global.h -I. -I/usr/src/sys -I/usr/src/sys/contr= ib/ck/include -fno-common =C2=A0-fno-omit-frame-pointer -mno-omit-leaf-fram= e-pointer -fdebug-prefix-map=3D./machine=3D/usr/src/sys/amd64/include -fdeb= ug-prefix-map=3D./x86=3D/usr/src/sys/x86/include -fdebug-prefix-map=3D./i38= 6=3D/usr/src/sys/i386/include =C2=A0 =C2=A0 -MD =C2=A0-MF.depend.ppt.o -MTp= pt.o -mcmodel=3Dkernel -mno-red-zone -mno-mmx -mno-sse -msoft-float =C2=A0-= fno-asynchronous-unwind-tables -ffreestanding -fwrapv -fstack-protector -Wa= ll -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith -Wcast-qual -Wu= ndef -Wno-pointer-sign -D__printf__=3D__freebsd_kprintf__ -Wmissing-include= -dirs -fdiagnostics-show-option -Wno-unknown-pragmas -Wno-error=3Dtautologi= cal-compare -Wno-error=3Dempty-body -Wno-error=3Dparentheses-equality -Wno-= error=3Dunused-function -Wno-error=3Dpointer-sign -Wno-error=3Dshift-negati= ve-value -Wno-address-of-packed-member -Wno-format-zero-length =C2=A0 -mno-= aes -mno-avx =C2=A0-std=3Dgnu99 -c /usr/src/sys/amd64/vmm/io/ppt.c -o ppt.o=
cc =C2=A0-O2 -pipe -fno-common =C2=A0-DVMM_KEEP_STATS -fno-strict-alias= ing -Werror -D_KERNEL -DKLD_MODULE -nostdinc =C2=A0-I/usr/src/sys/amd64/vmm= -I/usr/src/sys/amd64/vmm/io -I/usr/src/sys/amd64/vmm/intel -I/usr/src/sys/= amd64/vmm/amd -include /usr/obj/usr/src/amd64.amd64/sys/modules/vmm/opt_glo= bal.h -I. -I/usr/src/sys -I/usr/src/sys/contrib/ck/include -fno-common =C2= =A0-fno-omit-frame-pointer -mno-omit-leaf-frame-pointer -fdebug-prefix-map= =3D./machine=3D/usr/src/sys/amd64/include -fdebug-prefix-map=3D./x86=3D/usr= /src/sys/x86/include -fdebug-prefix-map=3D./i386=3D/usr/src/sys/i386/includ= e =C2=A0 =C2=A0 -MD =C2=A0-MF.depend.vatpic.o -MTvatpic.o -mcmodel=3Dkernel= -mno-red-zone -mno-mmx -mno-sse -msoft-float =C2=A0-fno-asynchronous-unwin= d-tables -ffreestanding -fwrapv -fstack-protector -Wall -Wstrict-prototypes= -Wmissing-prototypes -Wpointer-arith -Wcast-qual -Wundef -Wno-pointer-sign= -D__printf__=3D__freebsd_kprintf__ -Wmissing-include-dirs -fdiagnostics-sh= ow-option -Wno-unknown-pragmas -Wno-error=3Dtautological-compare -Wno-error= =3Dempty-body -Wno-error=3Dparentheses-equality -Wno-error=3Dunused-functio= n -Wno-error=3Dpointer-sign -Wno-error=3Dshift-negative-value -Wno-address-= of-packed-member -Wno-format-zero-length =C2=A0 -mno-aes -mno-avx =C2=A0-st= d=3Dgnu99 -c /usr/src/sys/amd64/vmm/io/vatpic.c -o vatpic.o
cc =C2=A0-O2= -pipe -fno-common =C2=A0-DVMM_KEEP_STATS -fno-strict-aliasing -Werror -D_K= ERNEL -DKLD_MODULE -nostdinc =C2=A0-I/usr/src/sys/amd64/vmm -I/usr/src/sys/= amd64/vmm/io -I/usr/src/sys/amd64/vmm/intel -I/usr/src/sys/amd64/vmm/amd -i= nclude /usr/obj/usr/src/amd64.amd64/sys/modules/vmm/opt_global.h -I. -I/usr= /src/sys -I/usr/src/sys/contrib/ck/include -fno-common =C2=A0-fno-omit-fram= e-pointer -mno-omit-leaf-frame-pointer -fdebug-prefix-map=3D./machine=3D/us= r/src/sys/amd64/include -fdebug-prefix-map=3D./x86=3D/usr/src/sys/x86/inclu= de -fdebug-prefix-map=3D./i386=3D/usr/src/sys/i386/include =C2=A0 =C2=A0 -M= D =C2=A0-MF.depend.vatpit.o -MTvatpit.o -mcmodel=3Dkernel -mno-red-zone -mn= o-mmx -mno-sse -msoft-float =C2=A0-fno-asynchronous-unwind-tables -ffreesta= nding -fwrapv -fstack-protector -Wall -Wstrict-prototypes -Wmissing-prototy= pes -Wpointer-arith -Wcast-qual -Wundef -Wno-pointer-sign -D__printf__=3D__= freebsd_kprintf__ -Wmissing-include-dirs -fdiagnostics-show-option -Wno-unk= nown-pragmas -Wno-error=3Dtautological-compare -Wno-error=3Dempty-body -Wno= -error=3Dparentheses-equality -Wno-error=3Dunused-function -Wno-error=3Dpoi= nter-sign -Wno-error=3Dshift-negative-value -Wno-address-of-packed-member -= Wno-format-zero-length =C2=A0 -mno-aes -mno-avx =C2=A0-std=3Dgnu99 -c /usr/= src/sys/amd64/vmm/io/vatpit.c -o vatpit.o
cc =C2=A0-O2 -pipe -fno-common= =C2=A0-DVMM_KEEP_STATS -fno-strict-aliasing -Werror -D_KERNEL -DKLD_MODULE= -nostdinc =C2=A0-I/usr/src/sys/amd64/vmm -I/usr/src/sys/amd64/vmm/io -I/us= r/src/sys/amd64/vmm/intel -I/usr/src/sys/amd64/vmm/amd -include /usr/obj/us= r/src/amd64.amd64/sys/modules/vmm/opt_global.h -I. -I/usr/src/sys -I/usr/sr= c/sys/contrib/ck/include -fno-common =C2=A0-fno-omit-frame-pointer -mno-omi= t-leaf-frame-pointer -fdebug-prefix-map=3D./machine=3D/usr/src/sys/amd64/in= clude -fdebug-prefix-map=3D./x86=3D/usr/src/sys/x86/include -fdebug-prefix-= map=3D./i386=3D/usr/src/sys/i386/include =C2=A0 =C2=A0 -MD =C2=A0-MF.depend= .vhpet.o -MTvhpet.o -mcmodel=3Dkernel -mno-red-zone -mno-mmx -mno-sse -msof= t-float =C2=A0-fno-asynchronous-unwind-tables -ffreestanding -fwrapv -fstac= k-protector -Wall -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith = -Wcast-qual -Wundef -Wno-pointer-sign -D__printf__=3D__freebsd_kprintf__ -W= missing-include-dirs -fdiagnostics-show-option -Wno-unknown-pragmas -Wno-er= ror=3Dtautological-compare -Wno-error=3Dempty-body -Wno-error=3Dparentheses= -equality -Wno-error=3Dunused-function -Wno-error=3Dpointer-sign -Wno-error= =3Dshift-negative-value -Wno-address-of-packed-member -Wno-format-zero-leng= th =C2=A0 -mno-aes -mno-avx =C2=A0-std=3Dgnu99 -c /usr/src/sys/amd64/vmm/io= /vhpet.c -o vhpet.o
cc =C2=A0-O2 -pipe -fno-common =C2=A0-DVMM_KEEP_STAT= S -fno-strict-aliasing -Werror -D_KERNEL -DKLD_MODULE -nostdinc =C2=A0-I/us= r/src/sys/amd64/vmm -I/usr/src/sys/amd64/vmm/io -I/usr/src/sys/amd64/vmm/in= tel -I/usr/src/sys/amd64/vmm/amd -include /usr/obj/usr/src/amd64.amd64/sys/= modules/vmm/opt_global.h -I. -I/usr/src/sys -I/usr/src/sys/contrib/ck/inclu= de -fno-common =C2=A0-fno-omit-frame-pointer -mno-omit-leaf-frame-pointer -= fdebug-prefix-map=3D./machine=3D/usr/src/sys/amd64/include -fdebug-prefix-m= ap=3D./x86=3D/usr/src/sys/x86/include -fdebug-prefix-map=3D./i386=3D/usr/sr= c/sys/i386/include =C2=A0 =C2=A0 -MD =C2=A0-MF.depend.vioapic.o -MTvioapic.= o -mcmodel=3Dkernel -mno-red-zone -mno-mmx -mno-sse -msoft-float =C2=A0-fno= -asynchronous-unwind-tables -ffreestanding -fwrapv -fstack-protector -Wall = -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith -Wcast-qual -Wunde= f -Wno-pointer-sign -D__printf__=3D__freebsd_kprintf__ -Wmissing-include-di= rs -fdiagnostics-show-option -Wno-unknown-pragmas -Wno-error=3Dtautological= -compare -Wno-error=3Dempty-body -Wno-error=3Dparentheses-equality -Wno-err= or=3Dunused-function -Wno-error=3Dpointer-sign -Wno-error=3Dshift-negative-= value -Wno-address-of-packed-member -Wno-format-zero-length =C2=A0 -mno-aes= -mno-avx =C2=A0-std=3Dgnu99 -c /usr/src/sys/amd64/vmm/io/vioapic.c -o vioa= pic.o
cc =C2=A0-O2 -pipe -fno-common =C2=A0-DVMM_KEEP_STATS -fno-strict-= aliasing -Werror -D_KERNEL -DKLD_MODULE -nostdinc =C2=A0-I/usr/src/sys/amd6= 4/vmm -I/usr/src/sys/amd64/vmm/io -I/usr/src/sys/amd64/vmm/intel -I/usr/src= /sys/amd64/vmm/amd -include /usr/obj/usr/src/amd64.amd64/sys/modules/vmm/op= t_global.h -I. -I/usr/src/sys -I/usr/src/sys/contrib/ck/include -fno-common= =C2=A0-fno-omit-frame-pointer -mno-omit-leaf-frame-pointer -fdebug-prefix-= map=3D./machine=3D/usr/src/sys/amd64/include -fdebug-prefix-map=3D./x86=3D/= usr/src/sys/x86/include -fdebug-prefix-map=3D./i386=3D/usr/src/sys/i386/inc= lude =C2=A0 =C2=A0 -MD =C2=A0-MF.depend.vlapic.o -MTvlapic.o -mcmodel=3Dker= nel -mno-red-zone -mno-mmx -mno-sse -msoft-float =C2=A0-fno-asynchronous-un= wind-tables -ffreestanding -fwrapv -fstack-protector -Wall -Wstrict-prototy= pes -Wmissing-prototypes -Wpointer-arith -Wcast-qual -Wundef -Wno-pointer-s= ign -D__printf__=3D__freebsd_kprintf__ -Wmissing-include-dirs -fdiagnostics= -show-option -Wno-unknown-pragmas -Wno-error=3Dtautological-compare -Wno-er= ror=3Dempty-body -Wno-error=3Dparentheses-equality -Wno-error=3Dunused-func= tion -Wno-error=3Dpointer-sign -Wno-error=3Dshift-negative-value -Wno-addre= ss-of-packed-member -Wno-format-zero-length =C2=A0 -mno-aes -mno-avx =C2=A0= -std=3Dgnu99 -c /usr/src/sys/amd64/vmm/io/vlapic.c -o vlapic.o
cc =C2=A0= -O2 -pipe -fno-common =C2=A0-DVMM_KEEP_STATS -fno-strict-aliasing -Werror -= D_KERNEL -DKLD_MODULE -nostdinc =C2=A0-I/usr/src/sys/amd64/vmm -I/usr/src/s= ys/amd64/vmm/io -I/usr/src/sys/amd64/vmm/intel -I/usr/src/sys/amd64/vmm/amd= -include /usr/obj/usr/src/amd64.amd64/sys/modules/vmm/opt_global.h -I. -I/= usr/src/sys -I/usr/src/sys/contrib/ck/include -fno-common =C2=A0-fno-omit-f= rame-pointer -mno-omit-leaf-frame-pointer -fdebug-prefix-map=3D./machine=3D= /usr/src/sys/amd64/include -fdebug-prefix-map=3D./x86=3D/usr/src/sys/x86/in= clude -fdebug-prefix-map=3D./i386=3D/usr/src/sys/i386/include =C2=A0 =C2=A0= -MD =C2=A0-MF.depend.vpmtmr.o -MTvpmtmr.o -mcmodel=3Dkernel -mno-red-zone = -mno-mmx -mno-sse -msoft-float =C2=A0-fno-asynchronous-unwind-tables -ffree= standing -fwrapv -fstack-protector -Wall -Wstrict-prototypes -Wmissing-prot= otypes -Wpointer-arith -Wcast-qual -Wundef -Wno-pointer-sign -D__printf__= =3D__freebsd_kprintf__ -Wmissing-include-dirs -fdiagnostics-show-option -Wn= o-unknown-pragmas -Wno-error=3Dtautological-compare -Wno-error=3Dempty-body= -Wno-error=3Dparentheses-equality -Wno-error=3Dunused-function -Wno-error= =3Dpointer-sign -Wno-error=3Dshift-negative-value -Wno-address-of-packed-me= mber -Wno-format-zero-length =C2=A0 -mno-aes -mno-avx =C2=A0-std=3Dgnu99 -c= /usr/src/sys/amd64/vmm/io/vpmtmr.c -o vpmtmr.o
cc =C2=A0-O2 -pipe -fno-= common =C2=A0-DVMM_KEEP_STATS -fno-strict-aliasing -Werror -D_KERNEL -DKLD_= MODULE -nostdinc =C2=A0-I/usr/src/sys/amd64/vmm -I/usr/src/sys/amd64/vmm/io= -I/usr/src/sys/amd64/vmm/intel -I/usr/src/sys/amd64/vmm/amd -include /usr/= obj/usr/src/amd64.amd64/sys/modules/vmm/opt_global.h -I. -I/usr/src/sys -I/= usr/src/sys/contrib/ck/include -fno-common =C2=A0-fno-omit-frame-pointer -m= no-omit-leaf-frame-pointer -fdebug-prefix-map=3D./machine=3D/usr/src/sys/am= d64/include -fdebug-prefix-map=3D./x86=3D/usr/src/sys/x86/include -fdebug-p= refix-map=3D./i386=3D/usr/src/sys/i386/include =C2=A0 =C2=A0 -MD =C2=A0-MF.= depend.vrtc.o -MTvrtc.o -mcmodel=3Dkernel -mno-red-zone -mno-mmx -mno-sse -= msoft-float =C2=A0-fno-asynchronous-unwind-tables -ffreestanding -fwrapv -f= stack-protector -Wall -Wstrict-prototypes -Wmissing-prototypes -Wpointer-ar= ith -Wcast-qual -Wundef -Wno-pointer-sign -D__printf__=3D__freebsd_kprintf_= _ -Wmissing-include-dirs -fdiagnostics-show-option -Wno-unknown-pragmas -Wn= o-error=3Dtautological-compare -Wno-error=3Dempty-body -Wno-error=3Dparenth= eses-equality -Wno-error=3Dunused-function -Wno-error=3Dpointer-sign -Wno-e= rror=3Dshift-negative-value -Wno-address-of-packed-member -Wno-format-zero-= length =C2=A0 -mno-aes -mno-avx =C2=A0-std=3Dgnu99 -c /usr/src/sys/amd64/vm= m/io/vrtc.c -o vrtc.o
cc =C2=A0-O2 -pipe -fno-common =C2=A0-DVMM_KEEP_ST= ATS -fno-strict-aliasing -Werror -D_KERNEL -DKLD_MODULE -nostdinc =C2=A0-I/= usr/src/sys/amd64/vmm -I/usr/src/sys/amd64/vmm/io -I/usr/src/sys/amd64/vmm/= intel -I/usr/src/sys/amd64/vmm/amd -include /usr/obj/usr/src/amd64.amd64/sy= s/modules/vmm/opt_global.h -I. -I/usr/src/sys -I/usr/src/sys/contrib/ck/inc= lude -fno-common =C2=A0-fno-omit-frame-pointer -mno-omit-leaf-frame-pointer= -fdebug-prefix-map=3D./machine=3D/usr/src/sys/amd64/include -fdebug-prefix= -map=3D./x86=3D/usr/src/sys/x86/include -fdebug-prefix-map=3D./i386=3D/usr/= src/sys/i386/include =C2=A0 =C2=A0 -MD =C2=A0-MF.depend.ept.o -MTept.o -mcm= odel=3Dkernel -mno-red-zone -mno-mmx -mno-sse -msoft-float =C2=A0-fno-async= hronous-unwind-tables -ffreestanding -fwrapv -fstack-protector -Wall -Wstri= ct-prototypes -Wmissing-prototypes -Wpointer-arith -Wcast-qual -Wundef -Wno= -pointer-sign -D__printf__=3D__freebsd_kprintf__ -Wmissing-include-dirs -fd= iagnostics-show-option -Wno-unknown-pragmas -Wno-error=3Dtautological-compa= re -Wno-error=3Dempty-body -Wno-error=3Dparentheses-equality -Wno-error=3Du= nused-function -Wno-error=3Dpointer-sign -Wno-error=3Dshift-negative-value = -Wno-address-of-packed-member -Wno-format-zero-length =C2=A0 -mno-aes -mno-= avx =C2=A0-std=3Dgnu99 -c /usr/src/sys/amd64/vmm/intel/ept.c -o ept.o
cc= =C2=A0-O2 -pipe -fno-common =C2=A0-DVMM_KEEP_STATS -fno-strict-aliasing -W= error -D_KERNEL -DKLD_MODULE -nostdinc =C2=A0-I/usr/src/sys/amd64/vmm -I/us= r/src/sys/amd64/vmm/io -I/usr/src/sys/amd64/vmm/intel -I/usr/src/sys/amd64/= vmm/amd -include /usr/obj/usr/src/amd64.amd64/sys/modules/vmm/opt_global.h = -I. -I/usr/src/sys -I/usr/src/sys/contrib/ck/include -fno-common =C2=A0-fno= -omit-frame-pointer -mno-omit-leaf-frame-pointer -fdebug-prefix-map=3D./mac= hine=3D/usr/src/sys/amd64/include -fdebug-prefix-map=3D./x86=3D/usr/src/sys= /x86/include -fdebug-prefix-map=3D./i386=3D/usr/src/sys/i386/include =C2=A0= =C2=A0 -MD =C2=A0-MF.depend.vmcs.o -MTvmcs.o -mcmodel=3Dkernel -mno-red-zo= ne -mno-mmx -mno-sse -msoft-float =C2=A0-fno-asynchronous-unwind-tables -ff= reestanding -fwrapv -fstack-protector -Wall -Wstrict-prototypes -Wmissing-p= rototypes -Wpointer-arith -Wcast-qual -Wundef -Wno-pointer-sign -D__printf_= _=3D__freebsd_kprintf__ -Wmissing-include-dirs -fdiagnostics-show-option -W= no-unknown-pragmas -Wno-error=3Dtautological-compare -Wno-error=3Dempty-bod= y -Wno-error=3Dparentheses-equality -Wno-error=3Dunused-function -Wno-error= =3Dpointer-sign -Wno-error=3Dshift-negative-value -Wno-address-of-packed-me= mber -Wno-format-zero-length =C2=A0 -mno-aes -mno-avx =C2=A0-std=3Dgnu99 -c= /usr/src/sys/amd64/vmm/intel/vmcs.c -o vmcs.o
cc =C2=A0-O2 -pipe -fno-c= ommon =C2=A0-DVMM_KEEP_STATS -fno-strict-aliasing -Werror -D_KERNEL -DKLD_M= ODULE -nostdinc =C2=A0-I/usr/src/sys/amd64/vmm -I/usr/src/sys/amd64/vmm/io = -I/usr/src/sys/amd64/vmm/intel -I/usr/src/sys/amd64/vmm/amd -include /usr/o= bj/usr/src/amd64.amd64/sys/modules/vmm/opt_global.h -I. -I/usr/src/sys -I/u= sr/src/sys/contrib/ck/include -fno-common =C2=A0-fno-omit-frame-pointer -mn= o-omit-leaf-frame-pointer -fdebug-prefix-map=3D./machine=3D/usr/src/sys/amd= 64/include -fdebug-prefix-map=3D./x86=3D/usr/src/sys/x86/include -fdebug-pr= efix-map=3D./i386=3D/usr/src/sys/i386/include =C2=A0 =C2=A0 -MD =C2=A0-MF.d= epend.vmx_msr.o -MTvmx_msr.o -mcmodel=3Dkernel -mno-red-zone -mno-mmx -mno-= sse -msoft-float =C2=A0-fno-asynchronous-unwind-tables -ffreestanding -fwra= pv -fstack-protector -Wall -Wstrict-prototypes -Wmissing-prototypes -Wpoint= er-arith -Wcast-qual -Wundef -Wno-pointer-sign -D__printf__=3D__freebsd_kpr= intf__ -Wmissing-include-dirs -fdiagnostics-show-option -Wno-unknown-pragma= s -Wno-error=3Dtautological-compare -Wno-error=3Dempty-body -Wno-error=3Dpa= rentheses-equality -Wno-error=3Dunused-function -Wno-error=3Dpointer-sign -= Wno-error=3Dshift-negative-value -Wno-address-of-packed-member -Wno-format-= zero-length =C2=A0 -mno-aes -mno-avx =C2=A0-std=3Dgnu99 -c /usr/src/sys/amd= 64/vmm/intel/vmx_msr.c -o vmx_msr.o
cc -c -x assembler-with-cpp -DLOCORE= -O2 -pipe -fno-common =C2=A0-DVMM_KEEP_STATS -fno-strict-aliasing -Werror = -D_KERNEL -DKLD_MODULE -nostdinc =C2=A0-I/usr/src/sys/amd64/vmm -I/usr/src/= sys/amd64/vmm/io -I/usr/src/sys/amd64/vmm/intel -I/usr/src/sys/amd64/vmm/am= d -include /usr/obj/usr/src/amd64.amd64/sys/modules/vmm/opt_global.h -I. -I= /usr/src/sys -I/usr/src/sys/contrib/ck/include -fno-common =C2=A0-fno-omit-= frame-pointer -mno-omit-leaf-frame-pointer -fdebug-prefix-map=3D./machine= =3D/usr/src/sys/amd64/include -fdebug-prefix-map=3D./x86=3D/usr/src/sys/x86= /include -fdebug-prefix-map=3D./i386=3D/usr/src/sys/i386/include =C2=A0 =C2= =A0 -MD =C2=A0-MF.depend.vmx_support.o -MTvmx_support.o -mcmodel=3Dkernel -= mno-red-zone -mno-mmx -mno-sse -msoft-float =C2=A0-fno-asynchronous-unwind-= tables -ffreestanding -fwrapv -fstack-protector -Wall -Wstrict-prototypes -= Wmissing-prototypes -Wpointer-arith -Wcast-qual -Wundef -Wno-pointer-sign -= D__printf__=3D__freebsd_kprintf__ -Wmissing-include-dirs -fdiagnostics-show= -option -Wno-unknown-pragmas -Wno-error=3Dtautological-compare -Wno-error= =3Dempty-body -Wno-error=3Dparentheses-equality -Wno-error=3Dunused-functio= n -Wno-error=3Dpointer-sign -Wno-error=3Dshift-negative-value -Wno-address-= of-packed-member -Wno-format-zero-length =C2=A0 -mno-aes -mno-avx =C2=A0-st= d=3Dgnu99 =C2=A0/usr/src/sys/amd64/vmm/intel/vmx_support.S -o vmx_support.o=
cc =C2=A0-O2 -pipe -fno-common =C2=A0-DVMM_KEEP_STATS -fno-strict-alias= ing -Werror -D_KERNEL -DKLD_MODULE -nostdinc =C2=A0-I/usr/src/sys/amd64/vmm= -I/usr/src/sys/amd64/vmm/io -I/usr/src/sys/amd64/vmm/intel -I/usr/src/sys/= amd64/vmm/amd -include /usr/obj/usr/src/amd64.amd64/sys/modules/vmm/opt_glo= bal.h -I. -I/usr/src/sys -I/usr/src/sys/contrib/ck/include -fno-common =C2= =A0-fno-omit-frame-pointer -mno-omit-leaf-frame-pointer -fdebug-prefix-map= =3D./machine=3D/usr/src/sys/amd64/include -fdebug-prefix-map=3D./x86=3D/usr= /src/sys/x86/include -fdebug-prefix-map=3D./i386=3D/usr/src/sys/i386/includ= e =C2=A0 =C2=A0 -MD =C2=A0-MF.depend.vmx.o -MTvmx.o -mcmodel=3Dkernel -mno-= red-zone -mno-mmx -mno-sse -msoft-float =C2=A0-fno-asynchronous-unwind-tabl= es -ffreestanding -fwrapv -fstack-protector -Wall -Wstrict-prototypes -Wmis= sing-prototypes -Wpointer-arith -Wcast-qual -Wundef -Wno-pointer-sign -D__p= rintf__=3D__freebsd_kprintf__ -Wmissing-include-dirs -fdiagnostics-show-opt= ion -Wno-unknown-pragmas -Wno-error=3Dtautological-compare -Wno-error=3Demp= ty-body -Wno-error=3Dparentheses-equality -Wno-error=3Dunused-function -Wno= -error=3Dpointer-sign -Wno-error=3Dshift-negative-value -Wno-address-of-pac= ked-member -Wno-format-zero-length =C2=A0 -mno-aes -mno-avx =C2=A0-std=3Dgn= u99 -c /usr/src/sys/amd64/vmm/intel/vmx.c -o vmx.o
cc =C2=A0-O2 -pipe -f= no-common =C2=A0-DVMM_KEEP_STATS -fno-strict-aliasing -Werror -D_KERNEL -DK= LD_MODULE -nostdinc =C2=A0-I/usr/src/sys/amd64/vmm -I/usr/src/sys/amd64/vmm= /io -I/usr/src/sys/amd64/vmm/intel -I/usr/src/sys/amd64/vmm/amd -include /u= sr/obj/usr/src/amd64.amd64/sys/modules/vmm/opt_global.h -I. -I/usr/src/sys = -I/usr/src/sys/contrib/ck/include -fno-common =C2=A0-fno-omit-frame-pointer= -mno-omit-leaf-frame-pointer -fdebug-prefix-map=3D./machine=3D/usr/src/sys= /amd64/include -fdebug-prefix-map=3D./x86=3D/usr/src/sys/x86/include -fdebu= g-prefix-map=3D./i386=3D/usr/src/sys/i386/include =C2=A0 =C2=A0 -MD =C2=A0-= MF.depend.vtd.o -MTvtd.o -mcmodel=3Dkernel -mno-red-zone -mno-mmx -mno-sse = -msoft-float =C2=A0-fno-asynchronous-unwind-tables -ffreestanding -fwrapv -= fstack-protector -Wall -Wstrict-prototypes -Wmissing-prototypes -Wpointer-a= rith -Wcast-qual -Wundef -Wno-pointer-sign -D__printf__=3D__freebsd_kprintf= __ -Wmissing-include-dirs -fdiagnostics-show-option -Wno-unknown-pragmas -W= no-error=3Dtautological-compare -Wno-error=3Dempty-body -Wno-error=3Dparent= heses-equality -Wno-error=3Dunused-function -Wno-error=3Dpointer-sign -Wno-= error=3Dshift-negative-value -Wno-address-of-packed-member -Wno-format-zero= -length =C2=A0 -mno-aes -mno-avx =C2=A0-std=3Dgnu99 -c /usr/src/sys/amd64/v= mm/intel/vtd.c -o vtd.o
cc =C2=A0-O2 -pipe -fno-common =C2=A0-DVMM_KEEP_= STATS -fno-strict-aliasing -Werror -D_KERNEL -DKLD_MODULE -nostdinc =C2=A0-= I/usr/src/sys/amd64/vmm -I/usr/src/sys/amd64/vmm/io -I/usr/src/sys/amd64/vm= m/intel -I/usr/src/sys/amd64/vmm/amd -include /usr/obj/usr/src/amd64.amd64/= sys/modules/vmm/opt_global.h -I. -I/usr/src/sys -I/usr/src/sys/contrib/ck/i= nclude -fno-common =C2=A0-fno-omit-frame-pointer -mno-omit-leaf-frame-point= er -fdebug-prefix-map=3D./machine=3D/usr/src/sys/amd64/include -fdebug-pref= ix-map=3D./x86=3D/usr/src/sys/x86/include -fdebug-prefix-map=3D./i386=3D/us= r/src/sys/i386/include =C2=A0 =C2=A0 -MD =C2=A0-MF.depend.vmcb.o -MTvmcb.o = -mcmodel=3Dkernel -mno-red-zone -mno-mmx -mno-sse -msoft-float =C2=A0-fno-a= synchronous-unwind-tables -ffreestanding -fwrapv -fstack-protector -Wall -W= strict-prototypes -Wmissing-prototypes -Wpointer-arith -Wcast-qual -Wundef = -Wno-pointer-sign -D__printf__=3D__freebsd_kprintf__ -Wmissing-include-dirs= -fdiagnostics-show-option -Wno-unknown-pragmas -Wno-error=3Dtautological-c= ompare -Wno-error=3Dempty-body -Wno-error=3Dparentheses-equality -Wno-error= =3Dunused-function -Wno-error=3Dpointer-sign -Wno-error=3Dshift-negative-va= lue -Wno-address-of-packed-member -Wno-format-zero-length =C2=A0 -mno-aes -= mno-avx =C2=A0-std=3Dgnu99 -c /usr/src/sys/amd64/vmm/amd/vmcb.c -o vmcb.occ =C2=A0-O2 -pipe -fno-common =C2=A0-DVMM_KEEP_STATS -fno-strict-aliasin= g -Werror -D_KERNEL -DKLD_MODULE -nostdinc =C2=A0-I/usr/src/sys/amd64/vmm -= I/usr/src/sys/amd64/vmm/io -I/usr/src/sys/amd64/vmm/intel -I/usr/src/sys/am= d64/vmm/amd -include /usr/obj/usr/src/amd64.amd64/sys/modules/vmm/opt_globa= l.h -I. -I/usr/src/sys -I/usr/src/sys/contrib/ck/include -fno-common =C2=A0= -fno-omit-frame-pointer -mno-omit-leaf-frame-pointer -fdebug-prefix-map=3D.= /machine=3D/usr/src/sys/amd64/include -fdebug-prefix-map=3D./x86=3D/usr/src= /sys/x86/include -fdebug-prefix-map=3D./i386=3D/usr/src/sys/i386/include = =C2=A0 =C2=A0 -MD =C2=A0-MF.depend.amdiommu.o -MTamdiommu.o -mcmodel=3Dkern= el -mno-red-zone -mno-mmx -mno-sse -msoft-float =C2=A0-fno-asynchronous-unw= ind-tables -ffreestanding -fwrapv -fstack-protector -Wall -Wstrict-prototyp= es -Wmissing-prototypes -Wpointer-arith -Wcast-qual -Wundef -Wno-pointer-si= gn -D__printf__=3D__freebsd_kprintf__ -Wmissing-include-dirs -fdiagnostics-= show-option -Wno-unknown-pragmas -Wno-error=3Dtautological-compare -Wno-err= or=3Dempty-body -Wno-error=3Dparentheses-equality -Wno-error=3Dunused-funct= ion -Wno-error=3Dpointer-sign -Wno-error=3Dshift-negative-value -Wno-addres= s-of-packed-member -Wno-format-zero-length =C2=A0 -mno-aes -mno-avx =C2=A0-= std=3Dgnu99 -c /usr/src/sys/amd64/vmm/amd/amdiommu.c -o amdiommu.o
cc = =C2=A0-O2 -pipe -fno-common =C2=A0-DVMM_KEEP_STATS -fno-strict-aliasing -We= rror -D_KERNEL -DKLD_MODULE -nostdinc =C2=A0-I/usr/src/sys/amd64/vmm -I/usr= /src/sys/amd64/vmm/io -I/usr/src/sys/amd64/vmm/intel -I/usr/src/sys/amd64/v= mm/amd -include /usr/obj/usr/src/amd64.amd64/sys/modules/vmm/opt_global.h -= I. -I/usr/src/sys -I/usr/src/sys/contrib/ck/include -fno-common =C2=A0-fno-= omit-frame-pointer -mno-omit-leaf-frame-pointer -fdebug-prefix-map=3D./mach= ine=3D/usr/src/sys/amd64/include -fdebug-prefix-map=3D./x86=3D/usr/src/sys/= x86/include -fdebug-prefix-map=3D./i386=3D/usr/src/sys/i386/include =C2=A0 = =C2=A0 -MD =C2=A0-MF.depend.ivhd_if.o -MTivhd_if.o -mcmodel=3Dkernel -mno-r= ed-zone -mno-mmx -mno-sse -msoft-float =C2=A0-fno-asynchronous-unwind-table= s -ffreestanding -fwrapv -fstack-protector -Wall -Wstrict-prototypes -Wmiss= ing-prototypes -Wpointer-arith -Wcast-qual -Wundef -Wno-pointer-sign -D__pr= intf__=3D__freebsd_kprintf__ -Wmissing-include-dirs -fdiagnostics-show-opti= on -Wno-unknown-pragmas -Wno-error=3Dtautological-compare -Wno-error=3Dempt= y-body -Wno-error=3Dparentheses-equality -Wno-error=3Dunused-function -Wno-= error=3Dpointer-sign -Wno-error=3Dshift-negative-value -Wno-address-of-pack= ed-member -Wno-format-zero-length =C2=A0 -mno-aes -mno-avx =C2=A0-std=3Dgnu= 99 -c ivhd_if.c -o ivhd_if.o
cc =C2=A0-O2 -pipe -fno-common =C2=A0-DVMM_= KEEP_STATS -fno-strict-aliasing -Werror -D_KERNEL -DKLD_MODULE -nostdinc = =C2=A0-I/usr/src/sys/amd64/vmm -I/usr/src/sys/amd64/vmm/io -I/usr/src/sys/a= md64/vmm/intel -I/usr/src/sys/amd64/vmm/amd -include /usr/obj/usr/src/amd64= .amd64/sys/modules/vmm/opt_global.h -I. -I/usr/src/sys -I/usr/src/sys/contr= ib/ck/include -fno-common =C2=A0-fno-omit-frame-pointer -mno-omit-leaf-fram= e-pointer -fdebug-prefix-map=3D./machine=3D/usr/src/sys/amd64/include -fdeb= ug-prefix-map=3D./x86=3D/usr/src/sys/x86/include -fdebug-prefix-map=3D./i38= 6=3D/usr/src/sys/i386/include =C2=A0 =C2=A0 -MD =C2=A0-MF.depend.svm.o -MTs= vm.o -mcmodel=3Dkernel -mno-red-zone -mno-mmx -mno-sse -msoft-float =C2=A0-= fno-asynchronous-unwind-tables -ffreestanding -fwrapv -fstack-protector -Wa= ll -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith -Wcast-qual -Wu= ndef -Wno-pointer-sign -D__printf__=3D__freebsd_kprintf__ -Wmissing-include= -dirs -fdiagnostics-show-option -Wno-unknown-pragmas -Wno-error=3Dtautologi= cal-compare -Wno-error=3Dempty-body -Wno-error=3Dparentheses-equality -Wno-= error=3Dunused-function -Wno-error=3Dpointer-sign -Wno-error=3Dshift-negati= ve-value -Wno-address-of-packed-member -Wno-format-zero-length =C2=A0 -mno-= aes -mno-avx =C2=A0-std=3Dgnu99 -c /usr/src/sys/amd64/vmm/amd/svm.c -o svm.= o
cc -c -x assembler-with-cpp -DLOCORE -O2 -pipe -fno-common =C2=A0-DVMM= _KEEP_STATS -fno-strict-aliasing -Werror -D_KERNEL -DKLD_MODULE -nostdinc = =C2=A0-I/usr/src/sys/amd64/vmm -I/usr/src/sys/amd64/vmm/io -I/usr/src/sys/a= md64/vmm/intel -I/usr/src/sys/amd64/vmm/amd -include /usr/obj/usr/src/amd64= .amd64/sys/modules/vmm/opt_global.h -I. -I/usr/src/sys -I/usr/src/sys/contr= ib/ck/include -fno-common =C2=A0-fno-omit-frame-pointer -mno-omit-leaf-fram= e-pointer -fdebug-prefix-map=3D./machine=3D/usr/src/sys/amd64/include -fdeb= ug-prefix-map=3D./x86=3D/usr/src/sys/x86/include -fdebug-prefix-map=3D./i38= 6=3D/usr/src/sys/i386/include =C2=A0 =C2=A0 -MD =C2=A0-MF.depend.svm_suppor= t.o -MTsvm_support.o -mcmodel=3Dkernel -mno-red-zone -mno-mmx -mno-sse -mso= ft-float =C2=A0-fno-asynchronous-unwind-tables -ffreestanding -fwrapv -fsta= ck-protector -Wall -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith= -Wcast-qual -Wundef -Wno-pointer-sign -D__printf__=3D__freebsd_kprintf__ -= Wmissing-include-dirs -fdiagnostics-show-option -Wno-unknown-pragmas -Wno-e= rror=3Dtautological-compare -Wno-error=3Dempty-body -Wno-error=3Dparenthese= s-equality -Wno-error=3Dunused-function -Wno-error=3Dpointer-sign -Wno-erro= r=3Dshift-negative-value -Wno-address-of-packed-member -Wno-format-zero-len= gth =C2=A0 -mno-aes -mno-avx =C2=A0-std=3Dgnu99 =C2=A0/usr/src/sys/amd64/vm= m/amd/svm_support.S -o svm_support.o
cc =C2=A0-O2 -pipe -fno-common =C2= =A0-DVMM_KEEP_STATS -fno-strict-aliasing -Werror -D_KERNEL -DKLD_MODULE -no= stdinc =C2=A0-I/usr/src/sys/amd64/vmm -I/usr/src/sys/amd64/vmm/io -I/usr/sr= c/sys/amd64/vmm/intel -I/usr/src/sys/amd64/vmm/amd -include /usr/obj/usr/sr= c/amd64.amd64/sys/modules/vmm/opt_global.h -I. -I/usr/src/sys -I/usr/src/sy= s/contrib/ck/include -fno-common =C2=A0-fno-omit-frame-pointer -mno-omit-le= af-frame-pointer -fdebug-prefix-map=3D./machine=3D/usr/src/sys/amd64/includ= e -fdebug-prefix-map=3D./x86=3D/usr/src/sys/x86/include -fdebug-prefix-map= =3D./i386=3D/usr/src/sys/i386/include =C2=A0 =C2=A0 -MD =C2=A0-MF.depend.np= t.o -MTnpt.o -mcmodel=3Dkernel -mno-red-zone -mno-mmx -mno-sse -msoft-float= =C2=A0-fno-asynchronous-unwind-tables -ffreestanding -fwrapv -fstack-prote= ctor -Wall -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith -Wcast-= qual -Wundef -Wno-pointer-sign -D__printf__=3D__freebsd_kprintf__ -Wmissing= -include-dirs -fdiagnostics-show-option -Wno-unknown-pragmas -Wno-error=3Dt= autological-compare -Wno-error=3Dempty-body -Wno-error=3Dparentheses-equali= ty -Wno-error=3Dunused-function -Wno-error=3Dpointer-sign -Wno-error=3Dshif= t-negative-value -Wno-address-of-packed-member -Wno-format-zero-length =C2= =A0 -mno-aes -mno-avx =C2=A0-std=3Dgnu99 -c /usr/src/sys/amd64/vmm/amd/npt.= c -o npt.o
cc =C2=A0-O2 -pipe -fno-common =C2=A0-DVMM_KEEP_STATS -fno-st= rict-aliasing -Werror -D_KERNEL -DKLD_MODULE -nostdinc =C2=A0-I/usr/src/sys= /amd64/vmm -I/usr/src/sys/amd64/vmm/io -I/usr/src/sys/amd64/vmm/intel -I/us= r/src/sys/amd64/vmm/amd -include /usr/obj/usr/src/amd64.amd64/sys/modules/v= mm/opt_global.h -I. -I/usr/src/sys -I/usr/src/sys/contrib/ck/include -fno-c= ommon =C2=A0-fno-omit-frame-pointer -mno-omit-leaf-frame-pointer -fdebug-pr= efix-map=3D./machine=3D/usr/src/sys/amd64/include -fdebug-prefix-map=3D./x8= 6=3D/usr/src/sys/x86/include -fdebug-prefix-map=3D./i386=3D/usr/src/sys/i38= 6/include =C2=A0 =C2=A0 -MD =C2=A0-MF.depend.ivrs_drv.o -MTivrs_drv.o -mcmo= del=3Dkernel -mno-red-zone -mno-mmx -mno-sse -msoft-float =C2=A0-fno-asynch= ronous-unwind-tables -ffreestanding -fwrapv -fstack-protector -Wall -Wstric= t-prototypes -Wmissing-prototypes -Wpointer-arith -Wcast-qual -Wundef -Wno-= pointer-sign -D__printf__=3D__freebsd_kprintf__ -Wmissing-include-dirs -fdi= agnostics-show-option -Wno-unknown-pragmas -Wno-error=3Dtautological-compar= e -Wno-error=3Dempty-body -Wno-error=3Dparentheses-equality -Wno-error=3Dun= used-function -Wno-error=3Dpointer-sign -Wno-error=3Dshift-negative-value -= Wno-address-of-packed-member -Wno-format-zero-length =C2=A0 -mno-aes -mno-a= vx =C2=A0-std=3Dgnu99 -c /usr/src/sys/amd64/vmm/amd/ivrs_drv.c -o ivrs_drv.= o
cc =C2=A0-O2 -pipe -fno-common =C2=A0-DVMM_KEEP_STATS -fno-strict-alia= sing -Werror -D_KERNEL -DKLD_MODULE -nostdinc =C2=A0-I/usr/src/sys/amd64/vm= m -I/usr/src/sys/amd64/vmm/io -I/usr/src/sys/amd64/vmm/intel -I/usr/src/sys= /amd64/vmm/amd -include /usr/obj/usr/src/amd64.amd64/sys/modules/vmm/opt_gl= obal.h -I. -I/usr/src/sys -I/usr/src/sys/contrib/ck/include -fno-common =C2= =A0-fno-omit-frame-pointer -mno-omit-leaf-frame-pointer -fdebug-prefix-map= =3D./machine=3D/usr/src/sys/amd64/include -fdebug-prefix-map=3D./x86=3D/usr= /src/sys/x86/include -fdebug-prefix-map=3D./i386=3D/usr/src/sys/i386/includ= e =C2=A0 =C2=A0 -MD =C2=A0-MF.depend.amdvi_hw.o -MTamdvi_hw.o -mcmodel=3Dke= rnel -mno-red-zone -mno-mmx -mno-sse -msoft-float =C2=A0-fno-asynchronous-u= nwind-tables -ffreestanding -fwrapv -fstack-protector -Wall -Wstrict-protot= ypes -Wmissing-prototypes -Wpointer-arith -Wcast-qual -Wundef -Wno-pointer-= sign -D__printf__=3D__freebsd_kprintf__ -Wmissing-include-dirs -fdiagnostic= s-show-option -Wno-unknown-pragmas -Wno-error=3Dtautological-compare -Wno-e= rror=3Dempty-body -Wno-error=3Dparentheses-equality -Wno-error=3Dunused-fun= ction -Wno-error=3Dpointer-sign -Wno-error=3Dshift-negative-value -Wno-addr= ess-of-packed-member -Wno-format-zero-length =C2=A0 -mno-aes -mno-avx =C2= =A0-std=3Dgnu99 -c /usr/src/sys/amd64/vmm/amd/amdvi_hw.c -o amdvi_hw.o
c= c =C2=A0-O2 -pipe -fno-common =C2=A0-DVMM_KEEP_STATS -fno-strict-aliasing -= Werror -D_KERNEL -DKLD_MODULE -nostdinc =C2=A0-I/usr/src/sys/amd64/vmm -I/u= sr/src/sys/amd64/vmm/io -I/usr/src/sys/amd64/vmm/intel -I/usr/src/sys/amd64= /vmm/amd -include /usr/obj/usr/src/amd64.amd64/sys/modules/vmm/opt_global.h= -I. -I/usr/src/sys -I/usr/src/sys/contrib/ck/include -fno-common =C2=A0-fn= o-omit-frame-pointer -mno-omit-leaf-frame-pointer -fdebug-prefix-map=3D./ma= chine=3D/usr/src/sys/amd64/include -fdebug-prefix-map=3D./x86=3D/usr/src/sy= s/x86/include -fdebug-prefix-map=3D./i386=3D/usr/src/sys/i386/include =C2= =A0 =C2=A0 -MD =C2=A0-MF.depend.svm_msr.o -MTsvm_msr.o -mcmodel=3Dkernel -m= no-red-zone -mno-mmx -mno-sse -msoft-float =C2=A0-fno-asynchronous-unwind-t= ables -ffreestanding -fwrapv -fstack-protector -Wall -Wstrict-prototypes -W= missing-prototypes -Wpointer-arith -Wcast-qual -Wundef -Wno-pointer-sign -D= __printf__=3D__freebsd_kprintf__ -Wmissing-include-dirs -fdiagnostics-show-= option -Wno-unknown-pragmas -Wno-error=3Dtautological-compare -Wno-error=3D= empty-body -Wno-error=3Dparentheses-equality -Wno-error=3Dunused-function -= Wno-error=3Dpointer-sign -Wno-error=3Dshift-negative-value -Wno-address-of-= packed-member -Wno-format-zero-length =C2=A0 -mno-aes -mno-avx =C2=A0-std= =3Dgnu99 -c /usr/src/sys/amd64/vmm/amd/svm_msr.c -o svm_msr.o
ld -m elf_= x86_64_fbsd -d -warn-common --build-id=3Dsha1 -T /usr/src/sys/conf/ldscript= .kmod.amd64 -r =C2=A0-o vmm.ko vmm.o vmm_dev.o vmm_host.o vmm_instruction_e= mul.o vmm_ioport.o vmm_lapic.o vmm_mem.o vmm_stat.o vmm_util.o x86.o iommu.= o ppt.o vatpic.o vatpit.o vhpet.o vioapic.o vlapic.o vpmtmr.o vrtc.o ept.o = vmcs.o vmx_msr.o vmx_support.o vmx.o vtd.o vmcb.o amdiommu.o ivhd_if.o svm.= o svm_support.o npt.o ivrs_drv.o amdvi_hw.o svm_msr.o
ld: warning: svm_= support.o: missing .note.GNU-stack section implies executable stack
ld: = NOTE: This behaviour is deprecated and will be removed in a future version = of the linker
:> export_syms
awk -f /usr/src/sys/conf/kmod_syms.aw= k vmm.ko =C2=A0export_syms | xargs -J% objcopy % vmm.ko
objcopy --s= trip-debug vmm.ko

now the patched vmm.ko should be= ready ?

On Mon, Dec 2, 2024 at 10:34=E2=80=AFPM Mario Marietto &l= t;marietto2008@= gmail.com> wrote:
Yes,I have also exchanged the bhyve binary= . Now I'm trying to apply your patch and then I will rebuild vmm.
<= /div>
I see that your code is :

[0xF6] =3D= {
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 /* XXX Group = 3 extended opcode - not just TEST */
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A0 .op_byte =3D 0xF6,
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A0 =C2=A0 .op_type =3D VIE_OP_TYPE_TEST,
=C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 .op_flags =3D VIE_OP_F_IMM,
= =C2=A0 =C2=A0 =C2=A0 =C2=A0 },

but it seems wrong.= Shouldn't be .op_flags =3D VIE_OP_F_IMM8 ?

On Mon, Dec 2, 2024 = at 10:16=E2=80=AFPM Mark Peek <mp@freebsd.org> wrote:
On Mon, Dec 2, = 2024 at 1:05=E2=80=AFPM Mario Marietto <marietto2008@gmail.com> wrote:
Hello Mark,

I see that your pa= tch is about to modify the code of the vmm.ko module. I've just exchang= ed the vmm.ko module that I'm using on the ZFS system with the module t= hat I use on the UFS system (where I don't see the error) but this oper= ation didn't solve the problem. I suspect that the wrong code is not in= side the vmm.ko module. Can you offer a quick technical explanation of the = reason why the exchange of the modules does not work for me ?

I'm assuming you applied the patch and r= ebuilt the vmm.ko module. Did you also recompile the bhyve binary per my co= mments in my last message? The emulated instructions are detected in vmm.ko= but are emulated in the bhyve binary. In other words, vmm_instruction_emul= .c is used in both vmm.ko and bhyve.

Mark=C2=A0


--
Ma= rio.


--
Ma= rio.
--000000000000227761062850c574-- From nobody Mon Dec 2 22:25:54 2024 X-Original-To: freebsd-virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Y2JK957KCz5gXtv for ; Mon, 02 Dec 2024 22:26:05 +0000 (UTC) (envelope-from mp@freebsd.org) Received: from smtp.freebsd.org (smtp.freebsd.org [96.47.72.83]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R10" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Y2JK94Z3Gz49Qg for ; Mon, 2 Dec 2024 22:26:05 +0000 (UTC) (envelope-from mp@freebsd.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1733178365; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=msCWl6Fx7sjddkUUcLQfxmUgPbn3KmNoI64zXfpBB1Y=; b=uPoaEUDrpiXF00SpXeY+cuXohZXpKPjSdM3oXMLMKA0FCql3DmVpMLaOYqk4LtTDuHyz4t Bvpg3MKpICbJG8tCiIO8VKpPLvxCccSaeAN9W8Mda7P9hPviO3/QbUnWBPCeWmP2I/Ghjv FS/Uc+C6KTspNVSXxrqK4K/mOgB/F7qcwTyGLEpCv1sAAtablGCezVeP0pz2me3U+cn2Qo 608g6tzhsJD+f2akbXFTsZ0hgzfObLJbYCr3GcAQNOdnxZcbyDEAkOK0apxvFJTrghlm8n XVvaAKytjQ3V8Qjcu1+N961YOfIwFRBxh4xdBV3Tfvm4FXMGQ9+khFVOKRabyA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1733178365; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=msCWl6Fx7sjddkUUcLQfxmUgPbn3KmNoI64zXfpBB1Y=; b=hvxyxZbrKDV9/aqBbPQ5PrTfUH/D/8byzV3JYtqYEXnB3f2ujLg30QLZCe7Xyo+6SuNiqd 6ZE7d/kPR5DyfV5YzPXcif7PV1534nZmoG8qwIyMSy7pIVpWvUdi8KkxFu8KWM4eOBoEle VpLuETUVGbMO+c7+L0selREVWJoXWrfgVg0re0adGMDuj0Cxjjp55K3ViQsZ2MmoDfAzQf 3Y9f0+3rPYovZbg1z7YhIw12DG2gr3GanOdSp6ZmpsSF9FhjQCyFrt14oVUILGYQxzR+eW 2ht5ZJZiKyStSBV7GEHB3Uq+x9IC1+Re/VRazKOxyXyPn2R0J3pwjCoBZ1t7Xw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1733178365; a=rsa-sha256; cv=none; b=nwFalUifrtAOl32CphKlDb8wmjAXoLCUTZb4izZBHg9yNNEsvHPoRii7UkawbgxvATjByD zr9u2CQjxhLG6xULSc+VDQYUfLZRPz+bZfRSg5FQVrUuKm6BlbTAWlOg57CCmcktWQKSLY MZD/xTNumRCr2JUQnXZnPaqzKSk8FRJffDnDQoFXnSSb9EAVvU/S6EiOkhEOC4F2BfvudO kEIywlXVpDjgY5QWgJQeC+HYc86loMbh6YU5IsiCQSliWQ+F33TudP84I5kWB+1uJe/2O0 EcHG4E7YqWbzH9rb9CHh4LsOdJ9ZVOrlaN8hsQtY7+rsiy3sfyXjFZ6WFbujhQ== Received: from mail-qv1-f43.google.com (mail-qv1-f43.google.com [209.85.219.43]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "WR4" (verified OK)) (Authenticated sender: mp) by smtp.freebsd.org (Postfix) with ESMTPSA id 4Y2JK94BdCz1FTj for ; Mon, 2 Dec 2024 22:26:05 +0000 (UTC) (envelope-from mp@freebsd.org) Received: by mail-qv1-f43.google.com with SMTP id 6a1803df08f44-6d882699271so26181776d6.1 for ; Mon, 02 Dec 2024 14:26:05 -0800 (PST) X-Forwarded-Encrypted: i=1; AJvYcCWmo2eBDZNTOx5odN/8R6kSweqXyzsIJFL4kzDvR9nyUsz5Zd1bEKEv/XJYGEkJCGjvSGFsdjXg7W4GwUJV8T6NEJSZD9pI@freebsd.org X-Gm-Message-State: AOJu0Yze+qv3Mw4ttOGfOBfzSU/SLaoZrHkyM7PnwyenEV4ltvB+qtwe E3Gren/mhABlAUslrT34cEGLO1aSNyuP8ESQTdUENVTVTHd0L18driUTSJGjkf9Xq4lxbn9Zbfr WdHloBY8lXEGPAWtIUC0nUemK4WmKzx8igvUcng== X-Google-Smtp-Source: AGHT+IGPY8qLyxa9zPlP1tZrjypT3/dETYsECUpW0sH9JZaCjE3cSA9Np7Lt2MZy7Mj1CSADEz0HJjPLJ4tAeCH0zmA= X-Received: by 2002:a05:6214:21ac:b0:6cb:ef8d:b10 with SMTP id 6a1803df08f44-6d8b7405fe2mr5947726d6.39.1733178364992; Mon, 02 Dec 2024 14:26:04 -0800 (PST) List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-virtualization@freebsd.org Sender: owner-freebsd-virtualization@FreeBSD.org MIME-Version: 1.0 References: In-Reply-To: From: Mark Peek Date: Mon, 2 Dec 2024 14:25:54 -0800 X-Gmail-Original-Message-ID: Message-ID: Subject: Re: Failed to emulate instruction sequence [ 41f646040874064c017d88eb144c89 ] at 0xbea5fcf9 To: Mario Marietto Cc: Mark Peek , =?UTF-8?Q?Corvin_K=C3=B6hne?= , FreeBSD virtualization Content-Type: multipart/alternative; boundary="000000000000c742ba0628510804" --000000000000c742ba0628510804 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable On Mon, Dec 2, 2024 at 1:35=E2=80=AFPM Mario Marietto wrote: > Yes,I have also exchanged the bhyve binary. Now I'm trying to apply your > patch and then I will rebuild vmm. > I see that your code is : > > [0xF6] =3D { > /* XXX Group 3 extended opcode - not just TEST */ > .op_byte =3D 0xF6, > .op_type =3D VIE_OP_TYPE_TEST, > .op_flags =3D VIE_OP_F_IMM, > }, > > but it seems wrong. Shouldn't be .op_flags =3D VIE_OP_F_IMM8 ? > Yes, per the discussion in the bug report, that was the change I need to make before submitting it for review. Please make that change in your copy. And per email after this one, yes, that compilation of vmm.ko looks fine. Mark --000000000000c742ba0628510804 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
On Mon, Dec 2, 2024 at 1:35=E2=80=AFPM Ma= rio Marietto <marietto2008@gma= il.com> wrote:
Ye= s,I have also exchanged the bhyve binary. Now I'm trying to apply your = patch and then I will rebuild vmm.
I see that your code is :=

[0xF6] =3D {
=C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A0 =C2=A0 /* XXX Group 3 extended opcode - not just TEST = */
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 .op_byte =3D = 0xF6,
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 .op_type = =3D VIE_OP_TYPE_TEST,
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 .op_flags =3D VIE_OP_F_IMM,
=C2=A0 =C2=A0 =C2=A0 =C2=A0 },
<= div>
but it seems wrong. Shouldn't be .op_flags =3D VIE_O= P_F_IMM8 ?

Yes, per the discuss= ion in the bug report, that was the change I need to make before submitting= it for review. Please make that change in your copy.

<= div>And per email after this one, yes, that compilation of vmm.ko looks fin= e.

Mark
--000000000000c742ba0628510804-- From nobody Mon Dec 2 22:39:17 2024 X-Original-To: freebsd-virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Y2Jd90RHLz5gYfY for ; Mon, 02 Dec 2024 22:39:57 +0000 (UTC) (envelope-from marietto2008@gmail.com) Received: from mail-pg1-x535.google.com (mail-pg1-x535.google.com [IPv6:2607:f8b0:4864:20::535]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "WR4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Y2Jd82ScGz4Cmt; Mon, 2 Dec 2024 22:39:56 +0000 (UTC) (envelope-from marietto2008@gmail.com) Authentication-Results: mx1.freebsd.org; none Received: by mail-pg1-x535.google.com with SMTP id 41be03b00d2f7-7ea8de14848so3212460a12.2; Mon, 02 Dec 2024 14:39:56 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1733179194; x=1733783994; darn=freebsd.org; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=VlaELxr689lsVdLNqRE95fnNTmaFID0dA7JNL4iHUlk=; b=a6MpVUDGSwesDw4eVCcIHdTe5GBBqFDz7b9ecLVrqQ+DGhbQ1lNgrC04Yc5i+f7126 RVDVhtIpzRREo2WHZIt+RHmZ9WFtkWLGphZA15EQ0hIVDhP3poSSdqcNXv016+BqYRFU aMnDYGqScD2HZ5ZBaQr0UtAPyPHbg8Mh7OIg/kKMh4+c9D/rFZo2Ss4nOHDxykRWZs1o r0ZoPYJ5TdPPlDPVMm2bA1WJQRJeQ7gz7moIetxK40fS1yIT8qzKUWunqL4WHAn3wze8 9ErF9NqyJsuLii+C2KX/2NVWuVM7i+le6dSC7RLts52/WaMrC/l0j1AT4HqN9UqLpFao kRqA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1733179194; x=1733783994; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=VlaELxr689lsVdLNqRE95fnNTmaFID0dA7JNL4iHUlk=; b=VYK1dtyw8xoeG/1hLJFV+l3l9rJH0NtmwqtZD83XSOz/3n7oFYVpzW53/wsXg1Oc95 Eq7tWlQYdC+bh7H2WEr7DC2rfWIzZ9yqpPPJFQNFJEHbOe6exjWEwxadmnzQR0ZgtrCY Qcc/yg9Il6AYbbK3uqRZmfKyc3i3aQY8vOrvBGEkO4xNzm+vo9OK5oYGUKucDBr5aT+q Y12VkNyPKxIbtOJq8SO9zKWKxvyr/S72X4AFewkBbDhifnBB18u2MnlZrQcg/1W89zsP rbI/s4jDVIjxQk9WjeoLNyKAC/QpDj/eoZh/t/PvXMzlWUylO/oH1Qn/1B/lw9qzhz2W AhvA== X-Forwarded-Encrypted: i=1; AJvYcCUiTUY9yilSjyTttOyHkdFV8JBe/CL++q5e7LyTOP6Ukj/iZEOS3WchyD6zRzOx/BE5FpTInOUjdn/hY31bP2R/hGSoBgk5@freebsd.org X-Gm-Message-State: AOJu0YwrFiand9EuMJlUJk5AngLQ5n0urrDqL4FZlCe3vW3tqREozh4H 4TDd3andNrFgJfUcWEJypA3LPkuSRJls6xc2/9CtBSe8UtF8KF3vLnBZRVtuTgl4QpWrazd8JK6 bx2bEHFaipr1I70An7DNN3qnWSEj1q5W3IVIVKg== X-Gm-Gg: ASbGncv+TlX0188kYHu7FETdgqjWi0SiFDS2i+4aWuI+fIDbo60FLkc1cI688ZpHkUN jxFoz0nNptCFGcgeuL8Mrcuvh3y2Yq8ky X-Google-Smtp-Source: AGHT+IF9zWTXkXIVMPeO4v/VokrsmPgDFhyjPlyqxxos+NVygBc4rXNsgB9wid3FunCV5GFytLuPZ19rPXH0MQ9y6+g= X-Received: by 2002:a05:6a21:99a7:b0:1e0:cfc0:df34 with SMTP id adf61e73a8af0-1e1653b7b73mr440483637.16.1733179194283; Mon, 02 Dec 2024 14:39:54 -0800 (PST) List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-virtualization@freebsd.org Sender: owner-freebsd-virtualization@FreeBSD.org MIME-Version: 1.0 References: In-Reply-To: From: Mario Marietto Date: Mon, 2 Dec 2024 23:39:17 +0100 Message-ID: Subject: Re: Failed to emulate instruction sequence [ 41f646040874064c017d88eb144c89 ] at 0xbea5fcf9 To: Mark Peek Cc: =?UTF-8?Q?Corvin_K=C3=B6hne?= , FreeBSD virtualization Content-Type: multipart/alternative; boundary="00000000000035200e0628513a0e" X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US] X-Rspamd-Queue-Id: 4Y2Jd82ScGz4Cmt X-Spamd-Bar: ---- --00000000000035200e0628513a0e Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable ok I've used this : .op_flags =3D VIE_OP_F_IMM8 After the compilation is finished,I copied the compiled vmm.ko module from /usr/obj/usr/src/amd64.amd64/sys/modules/vmm/vmm.ko to /boot/kernel and to /boot/modules. Regarding the bhyve executable,I'm using two custom versions of it,called bhyve-lin and bhyve-win. When I upgrade the system,they cannot change. What can change is bhyve,but I don't use it. In addition,to be sure,I copied bhyve-lin and bhyve-win from the system where I don't have the error. With this being said,the recompilation of vmm.ko didn't solve my issue. On Mon, Dec 2, 2024 at 11:26=E2=80=AFPM Mark Peek wrote: > On Mon, Dec 2, 2024 at 1:35=E2=80=AFPM Mario Marietto > wrote: > >> Yes,I have also exchanged the bhyve binary. Now I'm trying to apply your >> patch and then I will rebuild vmm. >> I see that your code is : >> >> [0xF6] =3D { >> /* XXX Group 3 extended opcode - not just TEST */ >> .op_byte =3D 0xF6, >> .op_type =3D VIE_OP_TYPE_TEST, >> .op_flags =3D VIE_OP_F_IMM, >> }, >> >> but it seems wrong. Shouldn't be .op_flags =3D VIE_OP_F_IMM8 ? >> > > Yes, per the discussion in the bug report, that was the change I need to > make before submitting it for review. Please make that change in your cop= y. > > And per email after this one, yes, that compilation of vmm.ko looks fine. > > Mark > --=20 Mario. --00000000000035200e0628513a0e Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
ok I've used this :

.op_= flags =3D VIE_OP_F_IMM8

After the compilation is f= inished,I copied the compiled vmm.ko module from /usr/obj/usr/src/amd64.amd64/sys/modules/vmm/vmm.ko to /boot/kernel = and to /boot/modules.
=
Regarding the bhyve ex= ecutable,I'm using two custom versions of it,called bhyve-lin and bhyve= -win. When I upgrade the system,they cannot change. What can change is bhyv= e,but I don't use it. In addition,to be sure,I copied bhyve-lin and bhy= ve-win from the system where I don't have the error. With this being sa= id,the recompilation of vmm.ko didn't solve my issue.
=C2=A0

On Mon, Dec 2, 2024 at 11:26=E2=80=AFPM Mark Peek <mp@freebsd.org> wrote:
On Mon, Dec= 2, 2024 at 1:35=E2=80=AFPM Mario Marietto <marietto2008@gmail.com> wrote:
=
Yes,I have also exchanged the bhyve binary. Now I&#= 39;m trying to apply your patch and then I will rebuild vmm.
I see that your code is :

[0xF6] =3D {
=C2= =A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 /* XXX Group 3 extende= d opcode - not just TEST */
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0 .op_byte =3D 0xF6,
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A0 .op_type =3D VIE_OP_TYPE_TEST,
=C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 .op_flags =3D VIE_OP_F_IMM,
=C2=A0 = =C2=A0 =C2=A0 =C2=A0 },

but it seems wrong. Should= n't be .op_flags =3D VIE_OP_F_IMM8 ?

<= /div>
Yes, per the discussion in the bug report, that was the change I = need to make before submitting it for review. Please make that change in yo= ur copy.

And per email after this one, yes, that c= ompilation of vmm.ko looks fine.

Mark
<= /div>


--
Ma= rio.
--00000000000035200e0628513a0e-- From nobody Mon Dec 2 23:09:22 2024 X-Original-To: freebsd-virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Y2KHK66frz5gbjV for ; Mon, 02 Dec 2024 23:09:33 +0000 (UTC) (envelope-from mp@freebsd.org) Received: from smtp.freebsd.org (smtp.freebsd.org [IPv6:2610:1c1:1:606c::24b:4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R10" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Y2KHK5XgKz4FY0 for ; Mon, 2 Dec 2024 23:09:33 +0000 (UTC) (envelope-from mp@freebsd.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1733180973; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=bVLQBetKhtLaY9ra8N0shYWRxXV36UL5zoC7uJUySq4=; b=jqfdyo0s/mR1KqpamvSKoszU9tSXfOTUfxQ8uGET1yMKl9z7Oky48rd3z84p5I1bwmPklN 9TLoriYJ1NY35NCDVMoKktsuKGRMIj6mhvRa4zaPAEzhniabxMn9RFKh87qJpFABKTswLL tOBkjJDulORAcEwNqBcTeXCB0VY6/WB7f/jSLMBtm+sTFEUyYL3n7Zm2H917tRZqr3IL7e yV6hmWGimY03IBcBpXPOUjSZvA70vY7ypGsxJ7KK5M0ZwNDXkKFaqpu9Q2UXx3ph7WPdTk zvAbrsc27Ydl5u91FY9rmd1q7aUB6CCwNJ4Er/eM33bzJg7lgXzxPRed0ruw0Q== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1733180973; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=bVLQBetKhtLaY9ra8N0shYWRxXV36UL5zoC7uJUySq4=; b=H2hiPMz2r6lXQVT+WeMqnrzdtiJ3W1a52HE08BqaoLb3xRcU7hu7k+lXKIXu+WNi8oKmmY eXKP3nAu1KoQp7gsPYlPvRLwuf6oz81q3t44Y6XXWLuJXC9qO29mfvYimvLs0iT0Rnrm43 T7oc2Y8seuZjK8zHoRHrsDjMXbJusw8SccFSZcKiZj1bOHVvfClMo/7GMe5xxAbcs+ro/X QgSNjfdDLdldwELbQTiifam9mQkya6pcgA72Xi2jbnwhTwr1gpwxTmBHNxCKQhBNCSXvUB QyYt3o3pbiFGlMpG/yagFEolFQP+hRPlqzU8i/enAsxwIM+evBN8gSQA6osvww== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1733180973; a=rsa-sha256; cv=none; b=TdNG0q8xQesXS0R8yj7b/dONfldLCEhw0dDtvhadrHCZR0/z5N54zs0HNG09lEnzdBxCRi xrO7kPUCr7VgI3ADHAsC73Eh4w779CdYjeV8mTQJa8GfZuf3hy+sDvESI4FXCbAFEvbsWe Uhpcff35sq4TIbNpQu4SPV6OxX2VX9dWTG/k0OodsmYDFYt9VJJQschydYrKkKbFN1kf32 Fz/JC+1pBs/3ct4j4J4QVF4fJpPsVuChKeo4J2QMzkK/MOq3CNQqn3rJ0ApuzA505XX/5n XfOD2h0MrJU7iMdduxrNgEfMcM/EwRoMCrJyoSL5u7jGIeCsGUCC09Z1vfuIiw== Received: from mail-qv1-f48.google.com (mail-qv1-f48.google.com [209.85.219.48]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "WR4" (verified OK)) (Authenticated sender: mp) by smtp.freebsd.org (Postfix) with ESMTPSA id 4Y2KHK52fhz1Fcg for ; Mon, 2 Dec 2024 23:09:33 +0000 (UTC) (envelope-from mp@freebsd.org) Received: by mail-qv1-f48.google.com with SMTP id 6a1803df08f44-6d87ff6270fso32667046d6.0 for ; Mon, 02 Dec 2024 15:09:33 -0800 (PST) X-Forwarded-Encrypted: i=1; AJvYcCXvq4bjFiXCQwBnrTDJzuawI5uizAsl0J+Ua6WsPttKBO7LBZcs1ac16N+UtWH9qC4Ly3dKHNosFf3HhyeElAFnPzzc2VKO@freebsd.org X-Gm-Message-State: AOJu0YyNxejsgZ+OCJRdQXp6HyhQjDYCmkEsZX6549qTuO6+I4+udJ2H sEJ7a7iZTO7O/ylEaUG+w7K5U0TqpFRZcZUnt6MriidyZhtT+6YAxJUarWYy9MYRv082+55g1TW slUoJhToXGSvRcDxoPsKkQ7Yj6OvXqXQINscMQw== X-Google-Smtp-Source: AGHT+IGW1zdvCq5n7NiXFBzGl7W/y2c/iauW/PJpJ5oZlOgCd0KGad9DD8JxqoS8l8p3vBQFlWB2w0Tib+UeB8MxrVg= X-Received: by 2002:a05:6214:d8f:b0:6d8:7fe2:8b31 with SMTP id 6a1803df08f44-6d8b73905f0mr6979096d6.23.1733180973279; Mon, 02 Dec 2024 15:09:33 -0800 (PST) List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-virtualization@freebsd.org Sender: owner-freebsd-virtualization@FreeBSD.org MIME-Version: 1.0 References: In-Reply-To: From: Mark Peek Date: Mon, 2 Dec 2024 15:09:22 -0800 X-Gmail-Original-Message-ID: Message-ID: Subject: Re: Failed to emulate instruction sequence [ 41f646040874064c017d88eb144c89 ] at 0xbea5fcf9 To: Mario Marietto Cc: Mark Peek , =?UTF-8?Q?Corvin_K=C3=B6hne?= , FreeBSD virtualization Content-Type: multipart/alternative; boundary="0000000000003e89e1062851a4e9" --0000000000003e89e1062851a4e9 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable On Mon, Dec 2, 2024 at 2:39=E2=80=AFPM Mario Marietto wrote: > ok I've used this : > > .op_flags =3D VIE_OP_F_IMM8 > > After the compilation is finished,I copied the compiled vmm.ko module fro= m /usr/obj/usr/src/amd64.amd64/sys/modules/vmm/vmm.ko > to /boot/kernel and to /boot/modules. > > Regarding the bhyve executable,I'm using two custom versions of it,called > bhyve-lin and bhyve-win. When I upgrade the system,they cannot change. Wh= at > can change is bhyve,but I don't use it. In addition,to be sure,I copied > bhyve-lin and bhyve-win from the system where I don't have the error. Wit= h > this being said,the recompilation of vmm.ko didn't solve my issue. > Did you reboot or reload the module? Did you use the new bhyve binary you built from the patch? Note: copying binaries around from other systems or your custom versions will not be something I can help debug. Only code built from a newly checked out /usr/src and applying the patch will provide the correct information on whether it works or not. But if it didn't solve your issue you should document how it can be reproduced and either 1) add it to the bug I mentioned or 2) open a new bug. Make sure to include information on the host system as well (intel/amd, etc.) and how the various guest bits (.img, .fd, etc) were download/created. Mark --0000000000003e89e1062851a4e9 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
On Mon, Dec 2, 2024 at 2:39=E2=80=AFPM Ma= rio Marietto <marietto2008@gma= il.com> wrote:
ok= I've used this :

.op_flags =3D VIE_OP_F_IMM8<= /div>

After the compilation is finished,I copied the com= piled vmm.ko module from /usr/obj/usr/src/= amd64.amd64/sys/modules/vmm/vmm.ko to /boot/kernel and to /boot/modules.

Regarding the bhyve executable,I'm using t= wo custom versions of it,called bhyve-lin and bhyve-win. When I upgrade the= system,they cannot change. What can change is bhyve,but I don't use it= . In addition,to be sure,I copied bhyve-lin and bhyve-win from the system w= here I don't have the error. With this being said,the recompilation of = vmm.ko didn't solve my issue.

Did you reboot or reload the module? Did you use the new bhyve bina= ry you=C2=A0built from the patch? Note: copying binaries around from other = systems or your custom versions will not be something I can help debug. Onl= y code built from a newly checked out /usr/src and applying the patch will = provide the correct information on whether it works or not.

<= /div>
But if it didn't solve your issue you should document how it = can be reproduced and either 1) add it to the bug I mentioned or 2) open a = new bug. Make sure to include information on the host system as well (intel= /amd, etc.) and how the various guest bits (.img, .fd, etc) were download/c= reated.

Mark=C2=A0
--0000000000003e89e1062851a4e9-- From nobody Mon Dec 2 23:33:22 2024 X-Original-To: freebsd-virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Y2KqY4wTsz5gdX3 for ; Mon, 02 Dec 2024 23:34:01 +0000 (UTC) (envelope-from marietto2008@gmail.com) Received: from mail-pg1-x52d.google.com (mail-pg1-x52d.google.com [IPv6:2607:f8b0:4864:20::52d]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "WR4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Y2KqY2dkPz4HDM; Mon, 2 Dec 2024 23:34:01 +0000 (UTC) (envelope-from marietto2008@gmail.com) Authentication-Results: mx1.freebsd.org; none Received: by mail-pg1-x52d.google.com with SMTP id 41be03b00d2f7-7fcc00285a9so1851113a12.2; Mon, 02 Dec 2024 15:34:01 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1733182439; x=1733787239; darn=freebsd.org; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=vvTChmNJjnq8iRP9g/dOhC/YPwTzPRJavNNZ0Y+LZoA=; b=OHwvmrytjmcFy7FP3e80VxKQUHsYyOi1bXpjdtr/yuGuuDj6QWBqj2a8eNW2djfKgO IceHQlle8E/gnsgvllom/LLrLNCLM2oa0A2DIGAEzKmNF1rfqhzoY/nd1/Fzr+IrXWyb i59GRq1rwP3ikgDLYsbl02SP1NmGlFeVqg4pUP798Jw7LrEW7Y8f7Xkm9wR66K22s1mE xdJsmVB5eELVMIeMYnLhJ0ZKUILotcx6gTc1KA2NgMuUZbws8KZHIRxMP6kfTDrmksHj 4iXlyHAey9ZVvIasSc2PN7u52IGr708iAPKpYRlQHcYneyDp75VOkcuco71xZVCDtRvG OIWA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1733182439; x=1733787239; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=vvTChmNJjnq8iRP9g/dOhC/YPwTzPRJavNNZ0Y+LZoA=; b=vcurhT9bbwl0jwmwk5w2g0//ZX42DVu/sF6zjW0HZnvHyuA2nkBRMZeURaVp/GfNoF fOiZ1jk/sjOUuUi2Swqnk9iYr7hwYz7fQNqclPYFIMkmFetvET6kGMuYJ7wo9OkKmYo+ 0gBbkqJosD9ZvIbyqrlGoQmRyt/T+t4yyyhyTD1ou335XUkGZtLtf1uKT7FJozMDn1Mc Lwy2xb98cscKPxXuTwXsaVN0nZsaaeB84sAESzmr+lqzcbCvU3TQniUi5GKVILT1xZBc yn5v0x39Y3vLVBzp/X4m7g2DanRrcfrRnFyLp0XkY+np1ACNoXlRvCSjEnengfXSGFNX D1XQ== X-Forwarded-Encrypted: i=1; AJvYcCVDQEvwFF3WjaTdmPqm9defiYHjt9GDC2HRWzlRQnPGj/UoWUEYM8UDZ1SXJadnFnmjNb+t+YfZseJ/mHWunvcwDm9cEHMy@freebsd.org X-Gm-Message-State: AOJu0YywpotwtcIguikcftDVZovBviPQdZFOf667TUvfO32rRlrNfYd3 0RsH2IK98+5Tz507KE4+v8NS0cUmDiax26SIouoaU6YWGEvO74xignegi7xXhx3UER2VrwsLjLE YaowGezc+wWCpvAQKzXF8zqBYAlh+0Ew5vnE= X-Gm-Gg: ASbGnctDY9XgNQjUrTkRwGvGLa8TQNDnuKB7i+j9j5FPwjrK/MaeeUvPkj3JgEGxJFA ixODsfmlr7TYzfBb2oIJEweerpRkAY5ZaZU3qI2mdHg7SmDUX7w== X-Google-Smtp-Source: AGHT+IHPhSgZ8jgGJfqpxAK3P+7bDAFu3RoTeAlJzS2WaqjBkT66KYl9rHugemKiMzl4Xk/DLL5Q8cuUO2N1gcsn4H8= X-Received: by 2002:a05:6a20:6a1b:b0:1db:f00e:2dfe with SMTP id adf61e73a8af0-1e165412f88mr731429637.39.1733182439122; Mon, 02 Dec 2024 15:33:59 -0800 (PST) List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-virtualization@freebsd.org Sender: owner-freebsd-virtualization@FreeBSD.org MIME-Version: 1.0 References: In-Reply-To: From: Mario Marietto Date: Tue, 3 Dec 2024 00:33:22 +0100 Message-ID: Subject: Re: Failed to emulate instruction sequence [ 41f646040874064c017d88eb144c89 ] at 0xbea5fcf9 To: Mark Peek Cc: =?UTF-8?Q?Corvin_K=C3=B6hne?= , FreeBSD virtualization Content-Type: multipart/alternative; boundary="0000000000009d70dd062851fb8e" X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US] X-Rspamd-Queue-Id: 4Y2KqY2dkPz4HDM X-Spamd-Bar: ---- --0000000000009d70dd062851fb8e Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable --> Did you reboot or reload the module ? I have rebooted the machine. --> Did you use the new bhyve binary you built from the patch ? I didn't recompile bhyve,since I don't need it. --> Note: copying binaries around from other systems or your custom versions will not be something I can help debug. The system that I have on the UFS disk is not another system. It's the same system that I have on the ZFS disk,without the last round of (latest) packages. I'm sure that the system on the ZFS system started to present the problem when I did : # pkg update # pkg upgrade I don't have the problem on the UFS disk because I didn't do that. I haven't done # freebsd-update on the ZFS and UFS systems for some months,so both are stuck to 14.1-RELEASE-p5 GENERIC. On Tue, Dec 3, 2024 at 12:09=E2=80=AFAM Mark Peek wrote: > On Mon, Dec 2, 2024 at 2:39=E2=80=AFPM Mario Marietto > wrote: > >> ok I've used this : >> >> .op_flags =3D VIE_OP_F_IMM8 >> >> After the compilation is finished,I copied the compiled vmm.ko module >> from /usr/obj/usr/src/amd64.amd64/sys/modules/vmm/vmm.ko to /boot/kernel >> and to /boot/modules. >> >> Regarding the bhyve executable,I'm using two custom versions of it,calle= d >> bhyve-lin and bhyve-win. When I upgrade the system,they cannot change. W= hat >> can change is bhyve,but I don't use it. In addition,to be sure,I copied >> bhyve-lin and bhyve-win from the system where I don't have the error. Wi= th >> this being said,the recompilation of vmm.ko didn't solve my issue. >> > > Did you reboot or reload the module? Did you use the new bhyve binary > you built from the patch? Note: copying binaries around from other system= s > or your custom versions will not be something I can help debug. Only code > built from a newly checked out /usr/src and applying the patch will provi= de > the correct information on whether it works or not. > > But if it didn't solve your issue you should document how it can be > reproduced and either 1) add it to the bug I mentioned or 2) open a new > bug. Make sure to include information on the host system as well > (intel/amd, etc.) and how the various guest bits (.img, .fd, etc) were > download/created. > > Mark > --=20 Mario. --0000000000009d70dd062851fb8e Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
--> Did you reboot or reload the module ?

I have rebooted the machine.

=
--> Did you use the new bhyve binary you=C2=A0built from the patch = ?

I didn't recompile bhyve,since I don't n= eed it.

--> Note: copying binaries around from = other systems or your custom versions will not be something I can help debu= g.

The system that I have on the UFS disk is not a= nother system. It's the same system that I have on the ZFS disk,without= the last round of (latest) packages. I'm sure that the system on the Z= FS system started to present the problem when I did :

<= div># pkg update
# pkg upgrade

I don'= ;t have the problem on the UFS disk because I didn't do that.

I haven't done # freebsd-update on the ZFS and UFS= systems for some months,so both are stuck to 14.1-RELEASE-p5 GENERIC.
<= /div>



On Tue, Dec = 3, 2024 at 12:09=E2=80=AFAM Mark Peek <mp@freebsd.org> wrote:
On Mon, Dec 2, 2024 at 2:3= 9=E2=80=AFPM Mario Marietto <marietto2008@gmail.com> wrote:
ok I've used this :

.op_flags =3D VIE= _OP_F_IMM8

After the compilation is finished,I cop= ied the compiled vmm.ko module from /usr/o= bj/usr/src/amd64.amd64/sys/modules/vmm/vmm.ko to /boot/kernel and to /boot/= modules.

Regarding the bhyve executable,I= 9;m using two custom versions of it,called bhyve-lin and bhyve-win. When I = upgrade the system,they cannot change. What can change is bhyve,but I don&#= 39;t use it. In addition,to be sure,I copied bhyve-lin and bhyve-win from t= he system where I don't have the error. With this being said,the recomp= ilation of vmm.ko didn't solve my issue.
<= div>
Did you reboot or reload the module? Did you use the new= bhyve binary you=C2=A0built from the patch? Note: copying binaries around = from other systems or your custom versions will not be something I can help= debug. Only code built from a newly checked out /usr/src and applying the = patch will provide the correct information on whether it works or not.

But if it didn't solve your issue you should docum= ent how it can be reproduced and either 1) add it to the bug I mentioned or= 2) open a new bug. Make sure to include information on the host system as = well (intel/amd, etc.) and how the various guest bits (.img, .fd, etc) were= download/created.

Mark=C2=A0


--
Ma= rio.
--0000000000009d70dd062851fb8e-- From nobody Mon Dec 2 23:49:04 2024 X-Original-To: freebsd-virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Y2L982m7Fz5gf3s for ; Mon, 02 Dec 2024 23:49:16 +0000 (UTC) (envelope-from mp@freebsd.org) Received: from smtp.freebsd.org (smtp.freebsd.org [96.47.72.83]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R10" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Y2L982Bzcz4J3m for ; Mon, 2 Dec 2024 23:49:16 +0000 (UTC) (envelope-from mp@freebsd.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1733183356; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=YVcmA34xFDyYMCAFSCDASIu6Zfw80T5JVkaa/9oFddo=; b=uueYOt+l1Cl7Cv1pfEIUaOEVISrN9gHgpwD6y6xtiZXSyRPnJbznLNfySuNb/1dFL7lnGN 0Ps9jUpSEvv8lWmYqflNETxBx41YUhB4a2YAAmN7boEs9SiQa//XpoU7ZLJEJE2ma/O3qf xijOuroIgUkJNQvstKDqEqseIfgPsPeqrSD7O7vm/+yP7h8bi7he2rxMKLZy4k1rkmwq20 GvfNoWxZi7wIomSaizVSIWEl64UB6G6EFSJFCG4aHfVMnQtE8PTVkmWWWBgvp7BtqnPc3+ 602HWJ5x3m7MGq4fR0Y9uzGcWmdVmkVrrIEwG/XTkXFHChPQB1vE8auAhkQpig== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1733183356; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=YVcmA34xFDyYMCAFSCDASIu6Zfw80T5JVkaa/9oFddo=; b=Hc2TcDcrJtAzpP6UR3/tyWn4ZTPfYE3A706G/lIXelTsnuYoUAYPtnA3QiJYEDYW3mmAMm x2TuhqogR2aYncFQbKkQXmu7Dci6N0PopvhnEwNfygSf+mrTukTlncHN7iu8uvJQUnMegg ObqTfcb1sdDwVbg4lPHxQBszc9elQwvDPhkPalirh1aa+yqagvF1XypRwRh8sarqjRQ84U 3pUBkzf2eRv/x77Z1LE/7XNw8LqODuVrvlp9zV4lJBd1M+DVQQD9aapYZlJgrGILgiUYZF 2/vj7AxjldwlDyqILtM8h9BrIJ0JzgOn2FiE9Wyie3/D81vwJNu0EbzjBLZ9rg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1733183356; a=rsa-sha256; cv=none; b=HysAB57N3COXLQbei/y/mXbxzxjzTIfg51wD7Z/IgBsf9czwq84lUwFWoitng9sCAO8Fk/ 9IHbf7/3U1aaB14NANRWEjf0l2YRWy22PYETU5ZPh6nY4yv55rcfcz8HDWQIVzVqLSZYgu BRQ7Y1EOjM1fUid64o+RfHWdVdcY6Qw+HI7KMxveCXQrEQegZYaK+CbhJ/2wQ3XmwEpURH dYMYruJqIy9Z/ryvLHuw5T8w7vQviAWoVcfDTNA54RAPq0STPxmkXpprUYfTv+xCaYS9po hbo0NIhSbw8NJDoXmdmq9F0KQKAqd37PBRSvM+JHYsuFN2Hvai5G7BcGHuRNyw== Received: from mail-oi1-f178.google.com (mail-oi1-f178.google.com [209.85.167.178]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "WR4" (verified OK)) (Authenticated sender: mp) by smtp.freebsd.org (Postfix) with ESMTPSA id 4Y2L981gcxz1FdC for ; Mon, 2 Dec 2024 23:49:16 +0000 (UTC) (envelope-from mp@freebsd.org) Received: by mail-oi1-f178.google.com with SMTP id 5614622812f47-3ea55a2a38bso2617390b6e.1 for ; Mon, 02 Dec 2024 15:49:16 -0800 (PST) X-Forwarded-Encrypted: i=1; AJvYcCW7lrIBRoAcGwP7JMaEeMfgS2NdOeXgy1DkKw6bbfOjvJ5lI0cCZZxbrlyarr9uj+Ph2UJvG67XIVN4c2pItvMNdA8mXC3R@freebsd.org X-Gm-Message-State: AOJu0YxceO0O0nWFNVKoRQwnv7nNojvMoxxPRiBeWJYgTg9sCBNTuX7a P+QeK1xo9slHvhGp00uMl4jSGOzCvsZJXUm2xVLaFc3gcBwGL1lWA/wjNnaAs9u5mPJrMDQ/maY snagcTgQWR7am9IHKVQ5IF06yzvJL+hAkNb3+uQ== X-Google-Smtp-Source: AGHT+IE4cw/p5ROFe57dme70D27Asra9aEpYYtJyn80a1kjPPiGK1PzpMTwvMreFkg4sCXTtVzzjEerxIyVsAW+351I= X-Received: by 2002:a05:6808:17a2:b0:3ea:6174:ac24 with SMTP id 5614622812f47-3eae4ecae17mr243321b6e.1.1733183355529; Mon, 02 Dec 2024 15:49:15 -0800 (PST) List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-virtualization@freebsd.org Sender: owner-freebsd-virtualization@FreeBSD.org MIME-Version: 1.0 References: In-Reply-To: From: Mark Peek Date: Mon, 2 Dec 2024 15:49:04 -0800 X-Gmail-Original-Message-ID: Message-ID: Subject: Re: Failed to emulate instruction sequence [ 41f646040874064c017d88eb144c89 ] at 0xbea5fcf9 To: Mario Marietto Cc: Mark Peek , =?UTF-8?Q?Corvin_K=C3=B6hne?= , FreeBSD virtualization Content-Type: multipart/alternative; boundary="0000000000003cd40706285232e9" --0000000000003cd40706285232e9 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable On Mon, Dec 2, 2024 at 3:34=E2=80=AFPM Mario Marietto wrote: > --> Did you use the new bhyve binary you built from the patch ? > > I didn't recompile bhyve,since I don't need it. > If you want the fix applied, you must compile and use both vmm.ko and bhyve using the patch. The patch is used in both. Please read the bug I mentioned (comments #1 and #2) where the submitter only compiled a new vmm.ko and it didn't work without the corresponding bhyve. Mark --0000000000003cd40706285232e9 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
On Mon, Dec 2, 2024 at 3:34=E2=80=AFPM Ma= rio Marietto <marietto2008@gma= il.com> wrote:
--= > Did you use the new bhyve binary you=C2=A0built from the patch ?
=

I didn't recompile bhyve,since I don't nee= d it.

If you want the fix= applied, you must compile and use both vmm.ko and bhyve using the patch. T= he patch is used in both.

Please read the bug I me= ntioned (comments #1 and #2) where the submitter only compiled a new vmm.ko= and it didn't work without the corresponding bhyve.

Mark=C2=A0
--0000000000003cd40706285232e9-- From nobody Tue Dec 3 00:01:12 2024 X-Original-To: freebsd-virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Y2LRg4Nlwz5gflG for ; Tue, 03 Dec 2024 00:01:51 +0000 (UTC) (envelope-from marietto2008@gmail.com) Received: from mail-pj1-x102b.google.com (mail-pj1-x102b.google.com [IPv6:2607:f8b0:4864:20::102b]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "WR4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Y2LRg0y5mz4LKt; Tue, 3 Dec 2024 00:01:51 +0000 (UTC) (envelope-from marietto2008@gmail.com) Authentication-Results: mx1.freebsd.org; none Received: by mail-pj1-x102b.google.com with SMTP id 98e67ed59e1d1-2eb1433958dso3237402a91.2; Mon, 02 Dec 2024 16:01:51 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1733184109; x=1733788909; darn=freebsd.org; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=LzVbMjnAJLfT5GEcKj4q0ZWktsfP/pYZZ5ODSJhDxG8=; b=gr5RdBlpAf1VKJA5YXk3RERAsyl8u4EzBDQ9GyBkG54O1GFwooZ2TC0wSKvckybOd9 E0YQ+3wTzEBOy1eqziHXWNrSHWFp2y2a+qM/BZCq6PpZz9VeC6tp3RlQWAgq9GCgi95r J/zD8jiLt3gb71BDzlxSA/nWlsY+2o2hsjwYR8spFK1zZm38V+pBC/MM7jBUzOpRmVYL bBWf2l9R2fm0fX34uz3jsS9uFrWq9bQwt/4ixNdmvJRNarh1cWrGB/5mX5QT+Gfc5fY8 EzgHaHoFJRmOUe0fyieGvHlB6wcOTS8+WVxMJF9/kOJL7GI0XCM4tF3Zi5TpwaoJIQd3 Kf2g== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1733184109; x=1733788909; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=LzVbMjnAJLfT5GEcKj4q0ZWktsfP/pYZZ5ODSJhDxG8=; b=AGGTpP/jbzWr18o0a0mnJQWWeuUdUr6BLtSZJhN3VrfOAYxm856D2OT9Js/N9i/Rhx 5DhRALUycG+SkC0DhHbtQaAUC5zYis8t9zm7szGTFQ6ukHz4TzkW/8hhKKzQB9ZkKvRI RqvV/4gBfSFlCrvKbHUufH8Y9SEiEXJmKSnKEydEz+FhXmXHYaF30WADy0tgBPp93zHR 55nd0cX2U+v7pkSu/TFHtieDDAa6hWzDo/Zbmly928rBzjKiKMoGwYe5wWMMY9D6kpJm 7JkiiV+CER1w55j0VEGLN2g3u29xON1IrxYIGtLqJ2RJtNir+WnKmPIghcxILnuN5DrT hm5w== X-Forwarded-Encrypted: i=1; AJvYcCWPTmQMo86HSBn0UC50v4VkRrU90ZcLxnTLT4twNypnkcbfQ+cb17g4GJM6w4zLE9xr27mE65CF/ZrBA3Tpi4CBM/m3NI0c@freebsd.org X-Gm-Message-State: AOJu0Yz2fqlvGggc4iA4X2CX1l0WZmut3oGpTuMTurlbpztfntGGzOQO ZQ8Cd65COeszeqx2hV6kPgZG4OVrxyAok0gGpY5nVEqaQZ6GcF56Dk6le4Rx4pENtQ1FjKJg0zI JDD+OGVkLXulS3nnP/IRhUuE2FubtOFhwO/Y= X-Gm-Gg: ASbGnctyphTjek67QZy7GdYBZrWwYDK5nSQjKWq2oMkbR0STKC1JjX59FKT8K7OO/GF URyjqfLS6C6PlbAOu4zcRD1VwLYyDnvoh+s8ovxOe2xROpuh4dA== X-Google-Smtp-Source: AGHT+IFe5q7Mdjxdlgz4r8hvqbuKmLZhuZFKoFjghtyjSbjtyNCHNxIBmToAOuU+lZkZHaQe3PrE6g3lKdAkQztDeb4= X-Received: by 2002:a17:90b:4ac8:b0:2ee:ead6:6213 with SMTP id 98e67ed59e1d1-2ef012152c7mr828811a91.19.1733184108699; Mon, 02 Dec 2024 16:01:48 -0800 (PST) List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-virtualization@freebsd.org Sender: owner-freebsd-virtualization@FreeBSD.org MIME-Version: 1.0 References: In-Reply-To: From: Mario Marietto Date: Tue, 3 Dec 2024 01:01:12 +0100 Message-ID: Subject: Re: Failed to emulate instruction sequence [ 41f646040874064c017d88eb144c89 ] at 0xbea5fcf9 To: Mark Peek Cc: =?UTF-8?Q?Corvin_K=C3=B6hne?= , FreeBSD virtualization Content-Type: multipart/alternative; boundary="000000000000212a980628525ff1" X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US] X-Rspamd-Queue-Id: 4Y2LRg0y5mz4LKt X-Spamd-Bar: ---- --000000000000212a980628525ff1 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable --> Please read the bug I mentioned (comments #1 and #2) where the submitter only compiled a new vmm.ko and it didn't work without the corresponding bhyve. This is the reason why I asked : Can you offer a quick technical explanation of the reason why the exchange of the modules does not work for me ? and you didn't give me any answer. There should be no need to recompile vmm at all,because the first thing I did was to copy vmm.ko,bhyve-win and bhyve-lin from the UFS system where the problem is not present,to the ZFS system,where the problem is present. I have recompiled vmm.ko only for the sake of my curiosity. On Tue, Dec 3, 2024 at 12:49=E2=80=AFAM Mark Peek wrote: > On Mon, Dec 2, 2024 at 3:34=E2=80=AFPM Mario Marietto > wrote: > >> --> Did you use the new bhyve binary you built from the patch ? >> >> I didn't recompile bhyve,since I don't need it. >> > > If you want the fix applied, you must compile and use both vmm.ko and > bhyve using the patch. The patch is used in both. > > Please read the bug I mentioned (comments #1 and #2) where the submitter > only compiled a new vmm.ko and it didn't work without the corresponding > bhyve. > > Mark > --=20 Mario. --000000000000212a980628525ff1 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
--> Please read the bug I mentioned (comments #1 a= nd #2) where the=20 submitter only compiled a new vmm.ko and it didn't work without the=20 corresponding bhyve.

This is the reason why I aske= d :

Can you offer a quick technical explanation o= f the reason why the exchange of the modules does not work for me ?

and you didn't give me any answer. There should be no= need to recompile vmm at all,because the first thing I did was to copy vmm= .ko,bhyve-win and bhyve-lin from the UFS system where the problem is not pr= esent,to the ZFS system,where the problem is present. I have recompiled vmm= .ko only for the sake of my curiosity.


<= div>

<= div dir=3D"ltr" class=3D"gmail_attr">On Tue, Dec 3, 2024 at 12:49=E2=80=AFA= M Mark Peek <mp@freebsd.org> wr= ote:
On Mon, Dec 2, 2024 at 3:34=E2=80=AFPM Mario Mariett= o <marietto2= 008@gmail.com> wrote:
--> Did you us= e the new bhyve binary you=C2=A0built from the patch ?

<= /div>
I didn't recompile bhyve,since I don't need it.

If you want the fix applied, you m= ust compile and use both vmm.ko and bhyve using the patch. The patch is use= d in both.

Please read the bug I mentioned (commen= ts #1 and #2) where the submitter only compiled a new vmm.ko and it didn= 9;t work without the corresponding bhyve.

Mark=C2= =A0


--
Ma= rio.
--000000000000212a980628525ff1-- From nobody Tue Dec 3 00:19:04 2024 X-Original-To: freebsd-virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Y2Lql5cbNz5ghfr for ; Tue, 03 Dec 2024 00:19:15 +0000 (UTC) (envelope-from mp@freebsd.org) Received: from smtp.freebsd.org (smtp.freebsd.org [IPv6:2610:1c1:1:606c::24b:4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R10" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Y2Lql53brz4R27 for ; Tue, 3 Dec 2024 00:19:15 +0000 (UTC) (envelope-from mp@freebsd.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1733185155; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=MmaqY1xcvLU+o/bVsNbD8r4lGxwHnjIPdukSHYyPmG4=; b=qM9AqAlr+CyglnfQfTA9Lar11SsM9HWtCQRGKY37p2SF4/QAaVmxmzbUT91hbsRVrpeTpe woyvcv2UWPs5rxK9yqBMKHTojlN45izpWrXRngQFFyXSpACcifnEUb5XR04lrB+pwq1/Go SLCoKZayyyJOjGh3mpb2jfEG4OZJv3in5rxft5j3YavS0T+dXUvEZpmmHld7oN5RcaCsBz C2j6kYealfNawcTVft8lZAKmepaMZwTm5Ac028otvlJP4KkP+uFMSvsvhUYKNKmQ3KQQb5 /3OcnYGghyFzpBqX3fhxjZqVZhPLJf2r4SpcmKXt40xpxv+P6YjUhR+CkeuDCw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1733185155; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=MmaqY1xcvLU+o/bVsNbD8r4lGxwHnjIPdukSHYyPmG4=; b=sN9QDzKNzz63jDupuQip3cWbPt2szwfKupz1S4uvESD5eir2Ti4xR1leO0KE7lMC/GlEPv INWA6UgNoHSGUhwnUBKFiaRx2MrQq1dvAIMvgC0lhehgXIujeIvxeKoxBYdQFZMFuvPVnD 5GJf3PDqR8phU5cujyNqAX5rWoJRKdmRuYLpNoxgrWm1ZADYfgVlYAg1OIEmUABpFa+Iws DPE4GFJsQCAcPmIjYiIuzTQb5ysoHlxM28ZgHrNA6XLRRjsjLyQD9uYGfuk7vsbB+w/GFJ 5qDhhRN/7nxlbs0j7qWiC4jIkxmrSzG3OkEZ0OwQQByNbdjRqxv+8gJUSvl/ng== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1733185155; a=rsa-sha256; cv=none; b=CdGxjjtGtEyFMPH/i82HQNbQSY1cvOhtCCT40xe4dJQ9OZxVcI+AISWXdYVBarsR9Hmc6C UFX6xAgrB47Gxcg6349jQg8JoRSl4kGlOwU+Pq+Wfz/DvQs7IZYeNIE1D6MFqVqWkPxJGi T1Xb+OQ8Bd+c2l8cjjIDWEFAoEOQ9gUqfm+47Rnc/2PALCHTJPZKloGPXVwNHSvGk8gFNi y9xrVr9OayrTq1oVLAz6EKNi6C6w8gETG3rdD4n6H8MSxaco9i/yIqacjZVtwmdabOEgvM b5emyWid1h9hxk/7OYOgdGlDN1WAHM/illWPyvLjOcONhyW3KQ0odPKi2R9rvQ== Received: from mail-qv1-f52.google.com (mail-qv1-f52.google.com [209.85.219.52]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "WR4" (verified OK)) (Authenticated sender: mp) by smtp.freebsd.org (Postfix) with ESMTPSA id 4Y2Lql4Xgkz1JlC for ; Tue, 3 Dec 2024 00:19:15 +0000 (UTC) (envelope-from mp@freebsd.org) Received: by mail-qv1-f52.google.com with SMTP id 6a1803df08f44-6d8adbda583so7427426d6.0 for ; Mon, 02 Dec 2024 16:19:15 -0800 (PST) X-Forwarded-Encrypted: i=1; AJvYcCW5WkVrNsRzuuQHFbp+zdOZMtDz7vxdTBzPvVoQi/GBMESwDKvye4Toz+X1Tdw9TbqQ000MjTT7XQZcB8DSdIWsXbK1XzK3@freebsd.org X-Gm-Message-State: AOJu0YyNCCfvhP5I4pt+10OWqeob9D6g3zNuqSDIPccbIVxsV5xIwWEj YhgC1wG1c3ioGfqqlmA/TkxTHOncQYNfQWhyO9jVs4QvEQyweXgQRWRfqE6shTgCPN9q49b+6io DU0xtbGywXBPrc2LNsoBBnsNNVcRSd5rLaTqyEQ== X-Google-Smtp-Source: AGHT+IHtgCZE/WFpsKvaslhzTynj5bH/LdcAwgXI470n4qI3RJI9l0Cf0BBUMhbDlYGjwEh3RVa7KIyMbeI+h6xuvkU= X-Received: by 2002:a05:6214:268f:b0:6d4:2594:631b with SMTP id 6a1803df08f44-6d8b7402468mr9820116d6.42.1733185155270; Mon, 02 Dec 2024 16:19:15 -0800 (PST) List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-virtualization@freebsd.org Sender: owner-freebsd-virtualization@FreeBSD.org MIME-Version: 1.0 References: In-Reply-To: From: Mark Peek Date: Mon, 2 Dec 2024 16:19:04 -0800 X-Gmail-Original-Message-ID: Message-ID: Subject: Re: Failed to emulate instruction sequence [ 41f646040874064c017d88eb144c89 ] at 0xbea5fcf9 To: Mario Marietto Cc: Mark Peek , =?UTF-8?Q?Corvin_K=C3=B6hne?= , FreeBSD virtualization Content-Type: multipart/alternative; boundary="00000000000082ac770628529d7f" --00000000000082ac770628529d7f Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable On Mon, Dec 2, 2024 at 4:01=E2=80=AFPM Mario Marietto wrote: > --> Please read the bug I mentioned (comments #1 and #2) where the > submitter only compiled a new vmm.ko and it didn't work without the > corresponding bhyve. > > This is the reason why I asked : > > Can you offer a quick technical explanation of the reason why the exchang= e > of the modules does not work for me ? > > and you didn't give me any answer. There should be no need to recompile > vmm at all,because the first thing I did was to copy vmm.ko,bhyve-win and > bhyve-lin from the UFS system where the problem is not present,to the ZFS > system,where the problem is present. I have recompiled vmm.ko only for th= e > sake of my curiosity. > If I had steps to recreate and reproduce the issue on my system then I might be able to get to a full root cause on why it would occur differently. Feel free to provide steps to reproduce it that does not include sending me your binaries. I'll go back to your original email that ended with "Any suggestions about how I can fix it ?". I suggested the existing bug is likely the same issue and I've said multiple times it requires both vmm.ko *and* bhyve. At this point there is not much more I can do for you on this issue beyond what I have stated. Mark --00000000000082ac770628529d7f Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable


On Mon, Dec 2, = 2024 at 4:01=E2=80=AFPM Mario Marietto <marietto2008@gmail.com> wrote:
--> Please read t= he bug I mentioned (comments #1 and #2) where the=20 submitter only compiled a new vmm.ko and it didn't work without the=20 corresponding bhyve.

This is the reason why I aske= d :

Can you offer a quick technical explanation o= f the reason why the exchange of the modules does not work for me ?

and you didn't give me any answer. There should be no= need to recompile vmm at all,because the first thing I did was to copy vmm= .ko,bhyve-win and bhyve-lin from the UFS system where the problem is not pr= esent,to the ZFS system,where the problem is present. I have recompiled vmm= .ko only for the sake of my curiosity.

If I had steps to recreate and reproduce the issue on my system the= n I might be able to get to a full root cause on why it would occur differe= ntly. Feel free to provide steps to reproduce it that does not include send= ing me your binaries.

I'll go back to your ori= ginal email that ended with "Any suggestions about how I can fix it ?&= quot;. I suggested the=C2=A0existing bug is likely the same issue and I'= ;ve said multiple times it requires both vmm.ko *and* bhyve. At this point = there is not much more I can do for you on this issue beyond what I have st= ated.

Mark
--00000000000082ac770628529d7f-- From nobody Tue Dec 3 01:04:03 2024 X-Original-To: freebsd-virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Y2Mr971X6z5fJ6S for ; Tue, 03 Dec 2024 01:04:41 +0000 (UTC) (envelope-from marietto2008@gmail.com) Received: from mail-pj1-x1034.google.com (mail-pj1-x1034.google.com [IPv6:2607:f8b0:4864:20::1034]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "WR4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Y2Mr95Hq0z4ZF4; Tue, 3 Dec 2024 01:04:41 +0000 (UTC) (envelope-from marietto2008@gmail.com) Authentication-Results: mx1.freebsd.org; none Received: by mail-pj1-x1034.google.com with SMTP id 98e67ed59e1d1-2eed82ca5b4so1106719a91.2; Mon, 02 Dec 2024 17:04:41 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1733187880; x=1733792680; darn=freebsd.org; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=sedFHVdrRjRaMuQeSEV61oA2uKGaFTvsIo4tvvRxUyc=; b=FpI2Yp86Dc3iVGZTNi2s5b/uQ+/EW5PmNuKP7JuJ7HlGj0BVBUbYkTJ3i6ymcyjjVB RpQCy/R6heTvqgsjtiiC8LxRbHHdK748BMdLMXpzgBTNGtGNsx1rQa/XTnKUXKmrM/zI dG2eodr/q+iA9YAhLf+2YLQ8qGn3HXACQ4eGvCjkIsrG0xZzy0YvATwO7m+vEmk2u2/J DWozyvW56I0ohximfhFxG1VaIFfzHFdRKpAy9QUQH8oYVLBML+DS0mAArcCWbhct6s86 9O5K/1VBTath30MB1xB/OtX0ME5LJSk42term6lYyn5sbiNHdi9E0jUSD2EAy1k4rQ2w GnsA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1733187880; x=1733792680; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=sedFHVdrRjRaMuQeSEV61oA2uKGaFTvsIo4tvvRxUyc=; b=Y2EhcEmdtzHN/lC5s/JdNdgP2wD51o5zXhUg4RXZCC/nkxRuomaesfQcBWLC466mxd ZpJPum/RyUcd1hRK0TAZ3scSFcidj/7i0N9YOFVmrdQOm6PPWznSfGFJTP3RTWiHzSWj 1kyD+ZITcsDSopzR+xe4F7hQIvLS+bFJ1gvT3+lqR7fQhdLwWs3H1hbzDDJW8hBcHmoi Aj0CvZWutkzVRTjw7+h1EFxeDSAMRCGVrQu+driDpCUoTDaJ5N2f4ol3SK8vVpA0y26z R30tVB9AJJInjKbQVb/ZFNSqqXfsQ+RYJ3f86mAc81Mh3T0cMJiuW0Bjhd9G9tVdR56v NoTQ== X-Forwarded-Encrypted: i=1; AJvYcCXYfiQdrQGDFFDeygpHSXcGJlNO/219OWnm0XJ3ZqdMoCGF2A4xXtXZQdZWpKZtypO+UXBc2PadK88ij5lT3sTanHBFX0Q8@freebsd.org X-Gm-Message-State: AOJu0Yzo8SBzBn6OG6iSpxs5Z80y/FCbzrrNNUneNyg+Red9l793uEG3 GChuHdQDwHcCr/lrk15bNOc6QzaNPT5EoBPloYLSOOkKi1hppkjfxR08WjghnRgcGP2lxi9T8ej jdKi2hjaTi+uhGw2X9YHLkPlL92TpvDRp X-Gm-Gg: ASbGncvqlGCTiHjvn+B8bCEgqIcuHXzfNhPYHFa2gtg9nAU1muLQPdb1JT/gUb63tyd RWyK9NgiLpRUihZduQFfbCfsubdyJNhc= X-Google-Smtp-Source: AGHT+IHNMS9zdS2ew1Sws8t9aXJF9/TP/ifsL8Z8v9Dm3ejd0XE5ftyW+BzDRxQ4fJe8ngHg81KEmy98jM5Z/CyPTRU= X-Received: by 2002:a17:90a:da87:b0:2ee:96e3:d834 with SMTP id 98e67ed59e1d1-2ef01274898mr809506a91.34.1733187879557; Mon, 02 Dec 2024 17:04:39 -0800 (PST) List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-virtualization@freebsd.org Sender: owner-freebsd-virtualization@FreeBSD.org MIME-Version: 1.0 References: In-Reply-To: From: Mario Marietto Date: Tue, 3 Dec 2024 02:04:03 +0100 Message-ID: Subject: Re: Failed to emulate instruction sequence [ 41f646040874064c017d88eb144c89 ] at 0xbea5fcf9 To: Mark Peek Cc: =?UTF-8?Q?Corvin_K=C3=B6hne?= , FreeBSD virtualization Content-Type: multipart/alternative; boundary="000000000000e3e50f0628533f89" X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US] X-Rspamd-Queue-Id: 4Y2Mr95Hq0z4ZF4 X-Spamd-Bar: ---- --000000000000e3e50f0628533f89 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable I will try to exchange one piece after another between the working and the not working system to reach the point where the not working system will start working. On Tue, Dec 3, 2024 at 1:19=E2=80=AFAM Mark Peek wrote: > > > On Mon, Dec 2, 2024 at 4:01=E2=80=AFPM Mario Marietto > wrote: > >> --> Please read the bug I mentioned (comments #1 and #2) where the >> submitter only compiled a new vmm.ko and it didn't work without the >> corresponding bhyve. >> >> This is the reason why I asked : >> >> Can you offer a quick technical explanation of the reason why the >> exchange of the modules does not work for me ? >> >> and you didn't give me any answer. There should be no need to recompile >> vmm at all,because the first thing I did was to copy vmm.ko,bhyve-win an= d >> bhyve-lin from the UFS system where the problem is not present,to the ZF= S >> system,where the problem is present. I have recompiled vmm.ko only for t= he >> sake of my curiosity. >> > > If I had steps to recreate and reproduce the issue on my system then I > might be able to get to a full root cause on why it would occur > differently. Feel free to provide steps to reproduce it that does not > include sending me your binaries. > > I'll go back to your original email that ended with "Any suggestions abou= t > how I can fix it ?". I suggested the existing bug is likely the same issu= e > and I've said multiple times it requires both vmm.ko *and* bhyve. At this > point there is not much more I can do for you on this issue beyond what I > have stated. > > Mark > --=20 Mario. --000000000000e3e50f0628533f89 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
I will try to exchange one piece after another between the= working and the not working system to reach the point where the not workin= g system will start working.

On Tue, Dec 3, 2024 a= t 1:19=E2=80=AFAM Mark Peek <mp@freebs= d.org> wrote:


On Mon, Dec 2, 2024 at 4:01=E2= =80=AFPM Mario Marietto <marietto2008@gmail.com> wrote:
--> Please read= the bug I mentioned (comments #1 and #2) where the=20 submitter only compiled a new vmm.ko and it didn't work without the=20 corresponding bhyve.

This is the reason why I aske= d :

Can you offer a quick technical explanation o= f the reason why the exchange of the modules does not work for me ?

and you didn't give me any answer. There should be no= need to recompile vmm at all,because the first thing I did was to copy vmm= .ko,bhyve-win and bhyve-lin from the UFS system where the problem is not pr= esent,to the ZFS system,where the problem is present. I have recompiled vmm= .ko only for the sake of my curiosity.

If I had steps to recreate and reproduce the issue on my system the= n I might be able to get to a full root cause on why it would occur differe= ntly. Feel free to provide steps to reproduce it that does not include send= ing me your binaries.

I'll go back to your ori= ginal email that ended with "Any suggestions about how I can fix it ?&= quot;. I suggested the=C2=A0existing bug is likely the same issue and I'= ;ve said multiple times it requires both vmm.ko *and* bhyve. At this point = there is not much more I can do for you on this issue beyond what I have st= ated.

Mark


--
Ma= rio.
--000000000000e3e50f0628533f89-- From nobody Wed Dec 4 04:06:00 2024 X-Original-To: virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Y33pw2jv9z5frQ9 for ; Wed, 04 Dec 2024 04:06:00 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R10" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Y33pw1YS7z4LyK for ; Wed, 4 Dec 2024 04:06:00 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1733285160; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=oifNgtK1ZLOrLggQGnWSylPPmjeOqiojG/hLO4a5cds=; b=w4xC+iWGV8M8YSnNFZJBYd5Y9WtkLYw3iKPHsAcvMr+osD2hAF4xgtfOxZT0CQg2GVVoeI aNpQ9HrhTLGawA/m5UVjiN1M1OEHjPmgTXN8261UMjPDVuJMyDHX0PM2hsNdIUDapel44d q08qlqnBmH9NVzI731QFBO81QD7QP3fKxVZ7fpWyi7CYE6BuKZ9iK67mMwxNN/ixJ/tRLh CAAx6CxMnvq/seQkLm82wQCJ+y/OnevObK4amOLNerls6r/WoC8W8Lv1CnAKROABF58Ihw xhtrpB7/QNWd54NiZUt6RRwd/x9ZtfBslfQXCLgdNsEM3I8P2tG9JDSPcRQM2w== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1733285160; a=rsa-sha256; cv=none; b=cvgB4OInONNYgq7joOOS2YQZAucfjHW6mrJsPWBE0SF9vM8JZPgtKwosmDiAIlArL9PY5u cD/mMhVCn9LwITzhMw0G2iSDqglpzUuLJrHCFDC4QOzxzuGwjhcRhBb2LYauB3MyqQjbQh 2Oextr4GU09SmafIoexlNE5uoqKawX/PiFpyRUEl3/99d6DP2loslcmSt6ikI9SIoeJUQ+ oSsunDwhyigLiX2056qD3KDeFdSVY9XeJvcA6WpJUEfo6KWMbQ2/Xmdbt3XF/di6bDvQ04 wZJnrI+YQgmG30UHQkcS5ZgI9qbvTItUz2esWVFZ/VGaep/fDlgjyPaW9j7AQg== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4Y33pw112mzrlt for ; Wed, 4 Dec 2024 04:06:00 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 4B4460ps048500 for ; Wed, 4 Dec 2024 04:06:00 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 4B44602R048496 for virtualization@FreeBSD.org; Wed, 4 Dec 2024 04:06:00 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 283103] Yet another Parallels arm64 panic Date: Wed, 04 Dec 2024 04:06:00 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: crash X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: linimon@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: keywords assigned_to Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-virtualization@freebsd.org Sender: owner-freebsd-virtualization@FreeBSD.org MIME-Version: 1.0 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D283103 Mark Linimon changed: What |Removed |Added ---------------------------------------------------------------------------- Keywords| |crash Assignee|bugs@FreeBSD.org |virtualization@FreeBSD.org --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Wed Dec 4 05:16:12 2024 X-Original-To: freebsd-virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Y35NG6Llrz5fwwh for ; Wed, 04 Dec 2024 05:16:30 +0000 (UTC) (envelope-from scf@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [96.47.72.83]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R10" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Y35NG5V8qz4VfK; Wed, 4 Dec 2024 05:16:30 +0000 (UTC) (envelope-from scf@FreeBSD.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1733289390; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=0GXIX2BHCX7i+f5nJ1r/Mf/nYI49PIcu+9nmvv0FT0g=; b=nFFPsmoVSOsayuGWEYzuPTCIsE48jAByH/hir4vxiqURigMZuL2pWQv0aCpxB7JgN5g1Ty AnEX6426itapQInydgy8Swl3Qmd2zVZAiBY7CA1+GES8dPDwrGPnhc0P52euQbBghetFkQ WHDe+CsaAXz0D3cbxzcgEAoYvFT98CKdeF2lOI1LqXEILESn1OyTj/tj8lO6bDevFrz4P3 SA0/nlE+hWpLfdE5N3lw991D69nf0D40uE5G0N2LcX/RSxYzjwI5T7uJlhZ1qM4z7u6qp5 z2J0TQd6vtrk2cRaljG43H9JVXttLnVcq+4fgO3O7G+VdTngsU2dFJO9EwGt/A== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1733289390; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=0GXIX2BHCX7i+f5nJ1r/Mf/nYI49PIcu+9nmvv0FT0g=; b=uwCkSnDotQRuJvWp1PIEujsfT3n2ZcNTY/bvYFQ2uZpROhs//N3C/BOBNR50Zsx7+FTqpB hP4gEdiwFN/2wBRk7iKNgs/sqlTBZOkEoy9jFlzU2+DTvgKsAHJiWxyNMPsyF2yw2u5ci7 jm5Wks1CTxPin+zr4q53gTbFydfgYD6s+4gWDlyvGFWz4GECJo3M+lyx01S3muIakn3IPq 8GT1Gw8Mfvxn1OSBFpCZkl0wwmi/k+shLtRCJrXuzmnumvAos6FcQShWqZ7uq5tRpirGKh li2af0VStkcbcfcIEJWn9AdlzeXiNtboM3kcrLsM9LLgsKs0y2aiOefBu53XeA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1733289390; a=rsa-sha256; cv=none; b=CGXYZVkmRZO0zhjJh2CDUleDhOjjAKgZ9hgEBn/ePdFUMiSgwiH0qjmyixRVpDw3cht7ES EMYKgQH6qjuhcBbazJRHXQJLBnMginQxKkOiYRYgXBcIy3QhtjH8OoVJ6MdrwAaF0nKBy/ nQOYwqbU73MyDBbVKls4qNBIlGanTdJ1GXiPyNO32fIZEsdGR/8iMduU2I7h18NJuVZ1QW jg08t033sLYeLO1Jq6OQcuytQVynfdOGJ8QDJEGFmp1THbuJqcXdXUngCMYTkrSb+2tR2Z RJlBElL8oTEFkFdye2etp/xCAHpwiic7BmJqyj63dIffbDzD3WNWKXSX1q29rw== Received: from thor.farley.org (1609341-v107.1360-static.crmlinaa.metronetinc.net [104.254.222.35]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) (Authenticated sender: scf/mail) by smtp.freebsd.org (Postfix) with ESMTPSA id 4Y35NG3mQLzj30; Wed, 4 Dec 2024 05:16:30 +0000 (UTC) (envelope-from scf@FreeBSD.org) Date: Wed, 4 Dec 2024 00:16:12 -0500 (EST) From: "Sean C. Farley" To: Mario Marietto cc: FreeBSD virtualization Subject: Re: Failed to emulate instruction sequence [ 41f646040874064c017d88eb144c89 ] at 0xbea5fcf9 In-Reply-To: Message-ID: <7905a2e7-3107-bf4d-10f7-2547a2af8df3@FreeBSD.org> References: List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-virtualization@freebsd.org Sender: owner-freebsd-virtualization@FreeBSD.org MIME-Version: 1.0 Content-Type: text/plain; format=flowed; charset=US-ASCII On Mon, 2 Dec 2024, Mario Marietto wrote: > Hello to everyone. > > Recently I've upgraded one of my FreeBSD systems and I see a strange > error when I try to boot Android 7.1.1. I have never seen this error > before and I also have another system where I haven't applied the > latest pkg upgrades where Android is still able to boot. > The bhyve parameters that I use in both systems are the following: > > /usr/sbin/./bhyve -S -c sockets=2,cores=2,threads=2 -m 8G -w -H -A \ > -s 0,hostbridge \ > -s > 1,ahci-hd,/mnt/zroot-133/bhyve/img/Android/DarkMatter-qemu.img,bootindex=1 \ > -s 8:0,passthru,4/0/0 \ > -s 11,hda,play=/dev/dsp,rec=/dev/dsp \ > -s 13,virtio-net,tap13 \ > -s 29,fbuf,tcp=0.0.0.0:5913,w=1440,h=900,wait \ > -s 30,xhci,tablet \ > -s 31,lpc \ > -l > bootrom,/usr/local/share/uefi-firmware/BHYVE_UEFI_CODE.fd,/usr/local/share/uefi-firmware/BHYVE_UEFI_VARS.fd > \ > vm0:13 < /dev/null & sleep 5 && vncviewer 0:13 && echo vncviewer 0:13 & Do you actually want the UEFI variables to be written to /usr/local/share/uefi-firmware/BHYVE_UEFI_VARS.fd? That file is actually installed by edk2-bhyve. You should pick a different location for the variables file to be written. Plus, reinstall edk2-bhyve to make sure nothing unexpected happens, especially if you have had multiple bhyve instances using that same file. Probably, save it just in case there are any values you need to keep first. $ pkg which /usr/local/share/uefi-firmware/BHYVE_UEFI_VARS.fd /usr/local/share/uefi-firmware/BHYVE_UEFI_VARS.fd was installed by package edk2-bhyve-g202308_5 $ ls -l /usr/local/share/uefi-firmware/BHYVE_UEFI_VARS.fd lrwxr-xr-x 1 root wheel 32 Nov 29 03:28 /usr/local/share/uefi-firmware/BHYVE_UEFI_VARS.fd@ -> ../edk2-bhyve/BHYVE_UEFI_VARS.fd $ pkg which /usr/local/share/edk2-bhyve/BHYVE_UEFI_VARS.fd /usr/local/share/edk2-bhyve/BHYVE_UEFI_VARS.fd was installed by package edk2-bhyve-g202308_5 $ pkg check -s edk2-bhyve-g202308_5 Checking edk2-bhyve-g202308_5: 100% I would run that check to make sure it is still valid. When I first ran into the error, I just replaced the UEFI vars file with an old one from a ZFS snapshot to see what was happening, which worked until the next time I rebooted the VM. Sean -- scf@FreeBSD.org From nobody Wed Dec 4 09:02:44 2024 X-Original-To: freebsd-virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Y3BQ22rm9z5gFG2 for ; Wed, 04 Dec 2024 09:03:22 +0000 (UTC) (envelope-from marietto2008@gmail.com) Received: from mail-pg1-x52f.google.com (mail-pg1-x52f.google.com [IPv6:2607:f8b0:4864:20::52f]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "WR4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Y3BQ2127gz4rR4; Wed, 4 Dec 2024 09:03:22 +0000 (UTC) (envelope-from marietto2008@gmail.com) Authentication-Results: mx1.freebsd.org; none Received: by mail-pg1-x52f.google.com with SMTP id 41be03b00d2f7-7f4325168c8so3361997a12.1; Wed, 04 Dec 2024 01:03:22 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1733303000; x=1733907800; darn=freebsd.org; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=O0plMbKaoO8AIT19rsL8hwPQADjAHuUzDcVcavddh2c=; b=OsPycTbkMKeT8APAgh42L34NECXHOrXv+Xb4/JhyN/uvu3XCjyaqWm7tl9eX+jflpV 0xt0T6oLfqn1b72gnDz9yMP3h2XGTBxGIXGn0nfKB9wo84M5eTzJVKifLGIvT3UOGGR2 iRbV7IxzAvVS8u1QELR3y+NP4Q7/hzV+DE+Tqv7Q/e6BcG2rfeWPWWlKJip+xmwvbhm6 ID87TIfXNOevl0g5++a+iY8ptFzcHY6ccUL5EbO4Yo20NpjVochEmVNhmiosCXcNdlZi oxt3l8AWGL6ImqGjt0fKKIsh1FVeTQSleEYyBre5qKd8LypsSd4gM4q6mx3LR1xA3vH2 x1gw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1733303000; x=1733907800; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=O0plMbKaoO8AIT19rsL8hwPQADjAHuUzDcVcavddh2c=; b=R0GIsQcvm2CW3Nv2SB5883GsJzLOeax+xLIdwIWXQ1SwUOdtIaWKIUnBpyppCCqflm L8/8xjsGQHsvbofOkWi7qqF9MBrctAcxuabTQmlGkYc/iqk+J9ezHAKPdt64sTfeO4tY 6EkwjeJSKfFSLMqRUBSFOgYAqhOfU2gBu6XgruJ8Kp6mUbTN953q+CVqmO1xKF5kiU2t 41ROhDbQRe2VCfUxPfYwlAiPFbLaq2rO1MaPfAH7swzWMXrmfAzfaIdL6tRsWe7JFmon Im6QvlNFxC02Dor16eEODj/GTzKaAKLH9ubmvfSs4jKGLADh5qHOvAExccXSV2HyW7fr RXTg== X-Gm-Message-State: AOJu0YyCwf8FnmjbA28qK+0h9Uuv1vWNyTgTmudElrXZHxlzNtqMavom I9z2AIg2Svge2cmYQnf2AxZ+8Iks01jAiujF2FwzGiQZ0GtLkiSFo3PVsSwxsw6jJtrAFaCEN/E g6wk0rDhfgSgj1LC65dO30Jve5LoD9sX+Vc0= X-Gm-Gg: ASbGncvAgtkJKR2p7UuoreJlP3AnJwCgvtk3KnLQhLJEXBd3H1OgpB6DzB+QX2Qw9Rv iZO2XXxpCmb54lopuomG1lzPpDJ8YEGo3HNTW/9edh8RR3Q9vIw== X-Google-Smtp-Source: AGHT+IHsdfF0RMsRftzw5KELxLwtEftlwQ5W7g+4sujCmYC4moVilQvKtzZmrjHSq1Zw/cSNp8YFb1fGKrgi5Uz9bHo= X-Received: by 2002:a17:90b:3849:b0:2ee:fa0c:ce9e with SMTP id 98e67ed59e1d1-2ef012748cemr7407853a91.32.1733303000448; Wed, 04 Dec 2024 01:03:20 -0800 (PST) List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-virtualization@freebsd.org Sender: owner-freebsd-virtualization@FreeBSD.org MIME-Version: 1.0 References: <7905a2e7-3107-bf4d-10f7-2547a2af8df3@FreeBSD.org> In-Reply-To: <7905a2e7-3107-bf4d-10f7-2547a2af8df3@FreeBSD.org> From: Mario Marietto Date: Wed, 4 Dec 2024 10:02:44 +0100 Message-ID: Subject: Re: Failed to emulate instruction sequence [ 41f646040874064c017d88eb144c89 ] at 0xbea5fcf9 To: "Sean C. Farley" Cc: FreeBSD virtualization Content-Type: multipart/alternative; boundary="000000000000a1492a06286e0d62" X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US] X-Rspamd-Queue-Id: 4Y3BQ2127gz4rR4 X-Spamd-Bar: ---- --000000000000a1492a06286e0d62 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable The first thing I did has been to exchange all the BHYVE_UEFI* files between the working system and the not working system. Unfortunately the error is not gone. On Wed, Dec 4, 2024 at 6:16=E2=80=AFAM Sean C. Farley wro= te: > On Mon, 2 Dec 2024, Mario Marietto wrote: > > > Hello to everyone. > > > > Recently I've upgraded one of my FreeBSD systems and I see a strange > > error when I try to boot Android 7.1.1. I have never seen this error > > before and I also have another system where I haven't applied the > > latest pkg upgrades where Android is still able to boot. > > The bhyve parameters that I use in both systems are the following: > > > > /usr/sbin/./bhyve -S -c sockets=3D2,cores=3D2,threads=3D2 -m 8G -w -H -= A \ > > -s 0,hostbridge \ > > -s > > > 1,ahci-hd,/mnt/zroot-133/bhyve/img/Android/DarkMatter-qemu.img,bootindex= =3D1 \ > > -s 8:0,passthru,4/0/0 \ > > -s 11,hda,play=3D/dev/dsp,rec=3D/dev/dsp \ > > -s 13,virtio-net,tap13 \ > > -s 29,fbuf,tcp=3D0.0.0.0:5913,w=3D1440,h=3D900,wait \ > > -s 30,xhci,tablet \ > > -s 31,lpc \ > > -l > > > bootrom,/usr/local/share/uefi-firmware/BHYVE_UEFI_CODE.fd,/usr/local/shar= e/uefi-firmware/BHYVE_UEFI_VARS.fd > > \ > > vm0:13 < /dev/null & sleep 5 && vncviewer 0:13 && echo vncviewer 0:13 & > > Do you actually want the UEFI variables to be written to > /usr/local/share/uefi-firmware/BHYVE_UEFI_VARS.fd? That file is > actually installed by edk2-bhyve. You should pick a different location > for the variables file to be written. Plus, reinstall edk2-bhyve to > make sure nothing unexpected happens, especially if you have had > multiple bhyve instances using that same file. Probably, save it just > in case there are any values you need to keep first. > > $ pkg which /usr/local/share/uefi-firmware/BHYVE_UEFI_VARS.fd > /usr/local/share/uefi-firmware/BHYVE_UEFI_VARS.fd was installed by packag= e > edk2-bhyve-g202308_5 > $ ls -l /usr/local/share/uefi-firmware/BHYVE_UEFI_VARS.fd > lrwxr-xr-x 1 root wheel 32 Nov 29 03:28 > /usr/local/share/uefi-firmware/BHYVE_UEFI_VARS.fd@ -> > ../edk2-bhyve/BHYVE_UEFI_VARS.fd > $ pkg which /usr/local/share/edk2-bhyve/BHYVE_UEFI_VARS.fd > /usr/local/share/edk2-bhyve/BHYVE_UEFI_VARS.fd was installed by package > edk2-bhyve-g202308_5 > $ pkg check -s edk2-bhyve-g202308_5 > Checking edk2-bhyve-g202308_5: 100% > > I would run that check to make sure it is still valid. > > When I first ran into the error, I just replaced the UEFI vars file with > an old one from a ZFS snapshot to see what was happening, which worked > until the next time I rebooted the VM. > > Sean > -- > scf@FreeBSD.org > --=20 Mario. --000000000000a1492a06286e0d62 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
The first thing I did has been to exchange all the BHYVE_U= EFI* files between the working system and the not working system. Unfortuna= tely the error is not gone.

On Wed, Dec 4, 2024 at 6:16=E2=80=AFAM Sean= C. Farley <scf@fre= ebsd.org> wrote:
On Mon, 2 Dec 2024, Mario Marietto wrote:

> Hello to everyone.
>
> Recently I've upgraded one of my FreeBSD systems and I see a stran= ge
> error when I try to boot Android 7.1.1. I have never seen this error <= br> > before and I also have another system where I haven't applied the =
> latest pkg upgrades where Android is still able to boot.
> The bhyve parameters that I use in both systems are the following:
>
> /usr/sbin/./bhyve -S -c sockets=3D2,cores=3D2,threads=3D2 -m 8G -w -H = -A \
> -s 0,hostbridge \
> -s
> 1,ahci-hd,/mnt/zroot-133/bhyve/img/Android/DarkMatter-qemu.img,bootind= ex=3D1 \
> -s 8:0,passthru,4/0/0 \
> -s 11,hda,play=3D/dev/dsp,rec=3D/dev/dsp \
> -s 13,virtio-net,tap13 \
> -s 29,fbuf,tcp=3D0.0.0.0:5913,w=3D1440,h=3D900,wait \
> -s 30,xhci,tablet \
> -s 31,lpc \
> -l
> bootrom,/usr/local/share/uefi-firmware/BHYVE_UEFI_CODE.fd,/usr/local/s= hare/uefi-firmware/BHYVE_UEFI_VARS.fd
> \
> vm0:13 < /dev/null & sleep 5 && vncviewer 0:13 &&am= p; echo vncviewer 0:13 &

Do you actually want the UEFI variables to be written to
/usr/local/share/uefi-firmware/BHYVE_UEFI_VARS.fd?=C2=A0 That file is
actually installed by edk2-bhyve.=C2=A0 You should pick a different locatio= n
for the variables file to be written.=C2=A0 Plus, reinstall edk2-bhyve to <= br> make sure nothing unexpected happens, especially if you have had
multiple bhyve instances using that same file.=C2=A0 Probably, save it just=
in case there are any values you need to keep first.

$ pkg which /usr/local/share/uefi-firmware/BHYVE_UEFI_VARS.fd
/usr/local/share/uefi-firmware/BHYVE_UEFI_VARS.fd was installed by package = edk2-bhyve-g202308_5
$ ls -l /usr/local/share/uefi-firmware/BHYVE_UEFI_VARS.fd
lrwxr-xr-x=C2=A0 1 root wheel 32 Nov 29 03:28 /usr/local/share/uefi-firmwar= e/BHYVE_UEFI_VARS.fd@ -> ../edk2-bhyve/BHYVE_UEFI_VARS.fd
$ pkg which /usr/local/share/edk2-bhyve/BHYVE_UEFI_VARS.fd
/usr/local/share/edk2-bhyve/BHYVE_UEFI_VARS.fd was installed by package edk= 2-bhyve-g202308_5
$ pkg check -s edk2-bhyve-g202308_5
Checking edk2-bhyve-g202308_5: 100%

I would run that check to make sure it is still valid.

When I first ran into the error, I just replaced the UEFI vars file with an old one from a ZFS snapshot to see what was happening, which worked
until the next time I rebooted the VM.

Sean
--
scf@FreeBSD.org


--
Ma= rio.
--000000000000a1492a06286e0d62-- From nobody Thu Dec 5 02:49:08 2024 X-Original-To: virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Y3f430GWtz5fgh0 for ; Thu, 05 Dec 2024 02:49:23 +0000 (UTC) (envelope-from bzeeb-lists@lists.zabbadoz.net) Received: from mx-01.divo.sbone.de (mx-01.divo.sbone.de [IPv6:2003:a:140a:2200:6:594:fffe:19]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature ECDSA (P-256) client-digest SHA256) (Client CN "mx-01.divo.sbone.de", Issuer "E6" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Y3f415tLzz4vJq for ; Thu, 5 Dec 2024 02:49:21 +0000 (UTC) (envelope-from bzeeb-lists@lists.zabbadoz.net) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=zabbadoz.net header.s=20240622 header.b=OcuCJhTq; spf=pass (mx1.freebsd.org: domain of bzeeb-lists@lists.zabbadoz.net designates 2003:a:140a:2200:6:594:fffe:19 as permitted sender) smtp.mailfrom=bzeeb-lists@lists.zabbadoz.net; dmarc=pass (policy=none) header.from=zabbadoz.net Received: from mail.sbone.de (mail.sbone.de [IPv6:fde9:577b:c1a9:4902:0:7404:2:1025]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature ECDSA (prime256v1) server-digest SHA256) (No client certificate requested) by mx-01.divo.sbone.de (Postfix) with ESMTPS id 0B9C3A64808 for ; Thu, 05 Dec 2024 02:49:03 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=zabbadoz.net; s=20240622; t=1733366944; bh=qtPFii4ujBw8AczN6HhoyOJPJaCHvhB78784gw9kg8Q=; h=Date:From:To:Subject; b=OcuCJhTqVXfonuwQ3DKqWJwzBivM2r+S8Mz40k7OuWMFApP2hEPgQgZULxKheNPYX OaP//Re0lmSO4xlVk8C7p310x3DE+Jo2aecRLnaiwc0K9mZcj6JxboTW5e1viXrXcy O8JHgEE175wWzUS35xmJqDrNcXv1bjb6SJb7tX1pWhK0NCF8BXqzhZjmHzFg4adx2q SAjPO4zFm8+H6Rv5oOhqqEoVF+5Grfe8Xjj/jQrHDQg6Dwrf+lvRWJUVKwonKHfXbn gQ0yNDcTmbYObs0wtqRMxcZ6XFopYyOpiMWqM1VTtfPtNqt7NvhIeK4Sq+nUtd5qX7 7vhAxWeMB7JE8fDhHIUpvlOLNSEWPQ5Y7tfSq1wXL6ox4zBBOI0/stvyq1KZDUIvUz RGrmaGdSUgRVvgYrNOle+XSevvQcw7WxyVHvb5hY1C+HspMFy6+sWWkTMeDlhHim2u kJGmkGp+MTiCvnT2T+ndSEMp51z0JWRuXDUsU2RuhYptwlQRyfJ9j8MeB7jjGGpilv jYA7shTIDdxSVKNreZB+HYrAQEDtzs1imCwCNZRHUV1Wc/QosOCypGWTsbWDC74CNJ FJ63EVGgfJ7zoHCF2dhlDDstOiMWZyk/EItE84CpVddOOGIERx8auttnPFZ/EjyOcT dYAxkKO10XZiSVOZ7jd0+rLg= Received: from content-filter.t4-02.sbone.de (content-filter.t4-02.sbone.de [IPv6:fde9:577b:c1a9:4902:0:7404:2:2742]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (No client certificate requested) by mail.sbone.de (Postfix) with ESMTPS id 29F312D029D8 for ; Thu, 5 Dec 2024 02:49:10 +0000 (UTC) X-Virus-Scanned: amavisd-new at sbone.de Received: from mail.sbone.de ([IPv6:fde9:577b:c1a9:4902:0:7404:2:1025]) by content-filter.t4-02.sbone.de (content-filter.t4-02.sbone.de [IPv6:fde9:577b:c1a9:4902:0:7404:2:2742]) (amavisd-new, port 10024) with ESMTP id LurQQLKMrspL for ; Thu, 5 Dec 2024 02:49:09 +0000 (UTC) Received: from strong-iwl0.sbone.de (strong-iwl0.sbone.de [IPv6:fde9:577b:c1a9:4902:b66b:fcff:fef3:e3d2]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (No client certificate requested) by mail.sbone.de (Postfix) with ESMTPSA id 799FB2D029DD for ; Thu, 5 Dec 2024 02:49:09 +0000 (UTC) Date: Thu, 5 Dec 2024 02:49:08 +0000 (UTC) From: "Bjoern A. Zeeb" To: virtualization@FreeBSD.org Subject: bhyve on arm64 and passthru? Message-ID: <773np621-o750-29qp-9r29-6n86n4290ns1@yvfgf.mnoonqbm.arg> X-OpenPGP-Key-Id: 0x14003F198FEFA3E77207EE8D2B58B8F83CCF1842 List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-virtualization@freebsd.org Sender: owner-freebsd-virtualization@FreeBSD.org MIME-Version: 1.0 Content-Type: text/plain; format=flowed; charset=US-ASCII X-Spamd-Result: default: False [-3.00 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; SUBJECT_ENDS_QUESTION(1.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-1.000]; DMARC_POLICY_ALLOW(-0.50)[zabbadoz.net,none]; R_DKIM_ALLOW(-0.20)[zabbadoz.net:s=20240622]; R_SPF_ALLOW(-0.20)[+ip6:2003:a:140a:2200:6:594:fffe:19]; MIME_GOOD(-0.10)[text/plain]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:3320, ipnet:2003::/19, country:DE]; RCVD_VIA_SMTP_AUTH(0.00)[]; MISSING_XM_UA(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; MLMMJ_DEST(0.00)[virtualization@FreeBSD.org]; ARC_NA(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; FROM_HAS_DN(0.00)[]; RCVD_COUNT_THREE(0.00)[4]; TO_DN_NONE(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[virtualization@freebsd.org]; TO_MATCH_ENVRCPT_ALL(0.00)[]; RCVD_TLS_LAST(0.00)[]; DKIM_TRACE(0.00)[zabbadoz.net:+] X-Rspamd-Queue-Id: 4Y3f415tLzz4vJq X-Spamd-Bar: -- Hi, I was wondering what the current status of bhyve/arm64 is and if passthru is avail or what still needs to be done to make it work? /bz -- Bjoern A. Zeeb r15:7 From nobody Thu Dec 5 04:51:09 2024 X-Original-To: virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Y3hmZ29cZz5frMj for ; Thu, 05 Dec 2024 04:51:10 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R10" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Y3hmZ0B93z469n for ; Thu, 5 Dec 2024 04:51:10 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1733374270; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=YmMdpdXcpHPJyzKF26H2fHLF/5vQNwtnZ8vxMcgWJE8=; b=mT31u+UxTrdT/qTfLiqEiZWJTxxn0TJO0SDqUGWjbAxAvOOUEU4XGM9p9eZAmMHTBB8K9T hSr4TNmiakjBQRjiwEF+Xgeyu65Pi7UsRyxnxoE3f+SGBipvnU3dLHEk8aVsQkFXdUzV3A MH8kpCNEsQaD0QIwRjGET/xmFYb4/Tzs6Eb6kP1C3fNj/VIz3C3Mje4Kvo5XsAaN+Kjyq6 Q3dJct/12WcwI3IxuUDkoC4aeDlk9b48HEHvtxQ7Jbe+KMzRYaTX2jYiYVxByctkSIXI/3 XtH9HXtJSqKAGONrsBKocCipvP0pjofI2loNnS4wAOHV3o85vV25pld2Tr8HZw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1733374270; a=rsa-sha256; cv=none; b=hzlGknXaMu8K/LywXnYJW3O6WQp+QGtZNHkpRsbyYpv0jxxP27ZPFbq1HYRFRoPIxelrtI nqvO7r360cEwmmc4FYp3NyeouQgg4oOTfi/L8NTn5L7Xa4Du/xIwiWBOja/Y7S21uVd46S rxIyis6v6TMidKsv5fuF29qgXzyk/+3vAmGnMCovGVu5v2YDZzpu6du2f8W81uWBa7uBR3 6NpI+0eLq2doGU2MKcCSJP+JRbDjel1idokvgMx8WSFFXJs6ODFCYTnsMvduM9MYcyxkqb X4GjtZZxacKsQJNhv0QJsUVO7bwy+5V+DWSa0nfZDqRdV+URuBTPDpSiG5XjhA== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4Y3hmY6twLzf5T for ; Thu, 5 Dec 2024 04:51:09 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 4B54p99D050974 for ; Thu, 5 Dec 2024 04:51:09 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 4B54p9L2050972 for virtualization@FreeBSD.org; Thu, 5 Dec 2024 04:51:09 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 268794] Simultaneous vcpu_lock_all() and vm_handle_rendezvous() can deadlock vmm Date: Thu, 05 Dec 2024 04:51:09 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bhyve X-Bugzilla-Version: 13.1-STABLE X-Bugzilla-Keywords: bhyve X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: quentin.thebault@defenso.fr X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-virtualization@freebsd.org Sender: owner-freebsd-virtualization@FreeBSD.org MIME-Version: 1.0 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D268794 --- Comment #16 from Quentin Th=C3=A9bault --- Hello, I tried the patch in https://reviews.freebsd.org/D37972 on 14.2, trying to passthrough my PCI QCNFA765 (Qualcomm Wireless) to Windows 11 Pro 24H2, and= the cpu topology below, but it does not work. The VM still locks on boot. Killi= ng the bhyve process with kill -9 (regular kill did not work) killed the entire system. cpus =3D 8 cpu_sockets =3D 2 cpu_cores =3D 4 cpu_threads =3D 1 --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Thu Dec 5 07:56:14 2024 X-Original-To: virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Y3mtr5b1Yz5g5Gw for ; Thu, 05 Dec 2024 07:56:52 +0000 (UTC) (envelope-from marietto2008@gmail.com) Received: from mail-pf1-x42e.google.com (mail-pf1-x42e.google.com [IPv6:2607:f8b0:4864:20::42e]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "WR4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Y3mtr3t6Rz4PLg for ; Thu, 5 Dec 2024 07:56:52 +0000 (UTC) (envelope-from marietto2008@gmail.com) Authentication-Results: mx1.freebsd.org; none Received: by mail-pf1-x42e.google.com with SMTP id d2e1a72fcca58-7256dc42176so680376b3a.3 for ; Wed, 04 Dec 2024 23:56:52 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1733385411; x=1733990211; darn=freebsd.org; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=dsB+1wTOMt43fgEe/l3e0TxPZOnxy4zNm70JcTBZcrc=; b=mWgc+wLg8ISHN/CHAoMzXIcbh7R4gpz2gZm0FB9M6aSCcRCMwyrsMi+qfMAyXUTwlR zJ/QIKf4fa2SeyrocWRzVvlR3hOreXRNf8FNAve5a/fi7ukqZKdkKg3KBgIQJsDiLClH TYZlS8CI9WR66MdsDCAFcL4NW2j/Kd5cfK0HOtDHpbsxFgyhKqwuKK9FWvUAbCFYt3/0 gzRlHt9OyQ+HLZg6+B92O9odc7HdWD/A4QkvAUJissARxeZbqFSUIqw3x2/Ti1rQHoOS rffgUoYM0NrVnwy68h8VoA9KzZ5TenIQwwDfFQm+2tqFcFvGWB8U0a/h+wDXAl5G5CNs dJlg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1733385411; x=1733990211; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=dsB+1wTOMt43fgEe/l3e0TxPZOnxy4zNm70JcTBZcrc=; b=vKXS/nvdsUWfvhcnRJLNoWMViVYTjLA/c5OdIbGhwCOmdLS1wCx+6tJkBfAPggbjGu g60yC7/lFRsp8NI5f4e6teyWK2sZC2iQM9hLUKIFJMqyHZxh5Xoksj7Xc0Xv7fs2zeCs i7XzE2LF8rIzvuTscWSA7Yd0vpkQS9VpBIJim2CARBhknhv6fKIMLGrkb+bRxNyHsdPX q6caO2zuVuIOGlliDdVPtG191Q/FZw2xsPApPfSPdK0X8pPW26slYIwY6aTFcn+6eF0L pM4OZijw1uFDQ0IGbFsnq+5Ig9jqj+nEo77OeVXc/cBVoRqWxpxz+KGY03q0QeDiNqjY Tb0Q== X-Gm-Message-State: AOJu0Yw0DNLM4V/cilZ59YrL6qLFLPbCaUgRhARrVSCIiZKWI9SzUdUM dEAbMGs1ep8fcnfZyvOeQHySADuIPsokOUIAajWG3Mph3T+L597r7WYKDjgfGQ1eeKuOpS/w+ch 2fal63qA6/dWrpy7h9h6mHMR17ULECMh8LIM= X-Gm-Gg: ASbGncsuE8xEbkuFM+4x3933NDUCPHpVY2FQ0B5c6NsREyZ15TMrw6bDXR8MIw8cTtG o0w23raym//xOEfzJqxnZXyinOQruQ5gG X-Google-Smtp-Source: AGHT+IEn2zWtYHLtXFw0hORWUwJ2It9nWIpkwL/PD9C1k5kjVLhcxEXJuQ/q3IPbylyIYUPxc0SMYUBB+5s4jxG2br0= X-Received: by 2002:a17:902:da84:b0:215:aa88:e153 with SMTP id d9443c01a7336-215bd1a0fd6mr114162235ad.56.1733385411126; Wed, 04 Dec 2024 23:56:51 -0800 (PST) List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-virtualization@freebsd.org Sender: owner-freebsd-virtualization@FreeBSD.org MIME-Version: 1.0 References: <773np621-o750-29qp-9r29-6n86n4290ns1@yvfgf.mnoonqbm.arg> In-Reply-To: <773np621-o750-29qp-9r29-6n86n4290ns1@yvfgf.mnoonqbm.arg> From: Mario Marietto Date: Thu, 5 Dec 2024 08:56:14 +0100 Message-ID: Subject: Re: bhyve on arm64 and passthru? To: "Bjoern A. Zeeb" Cc: virtualization@freebsd.org Content-Type: multipart/alternative; boundary="000000000000b06ae90628813d94" X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US] X-Rspamd-Queue-Id: 4Y3mtr3t6Rz4PLg X-Spamd-Bar: ---- --000000000000b06ae90628813d94 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable What do you want to pass on an arm64 platform ? Usually they have one only embedded gpu. I never saw a (cheap) arm soc with two gpus. Does it make sense to pass the only and usually not powerful gpu that they have ? Or maybe you are talking about very expensive arm socs that I never used or looked at because they are too expensive for me. On Thu, Dec 5, 2024 at 3:49=E2=80=AFAM Bjoern A. Zeeb < bzeeb-lists@lists.zabbadoz.net> wrote: > Hi, > > I was wondering what the current status of bhyve/arm64 is and if > passthru is avail or what still needs to be done to make it work? > > /bz > > -- > Bjoern A. Zeeb r15:7 > > --=20 Mario. --000000000000b06ae90628813d94 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
What do you want to pass on an arm64 platform ? Usually th= ey have one only embedded gpu. I never saw a (cheap) arm soc with two gpus.= Does it make sense to pass the only and usually not powerful gpu that they= have ? Or maybe you are talking about very expensive arm socs that I=C2=A0= never used or looked at because they are too expensive for me.
<= br>
On Thu,= Dec 5, 2024 at 3:49=E2=80=AFAM Bjoern A. Zeeb <bzeeb-lists@lists.zabbadoz.net<= /a>> wrote:
H= i,

I was wondering what the current status of bhyve/arm64 is and if
passthru is avail or what still needs to be done to make it work?

/bz

--
Bjoern A. Zeeb=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0r15:7



--
Ma= rio.
--000000000000b06ae90628813d94-- From nobody Fri Dec 6 01:46:23 2024 X-Original-To: virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Y4Dd00ml4z5g3Z4 for ; Fri, 06 Dec 2024 01:46:28 +0000 (UTC) (envelope-from bzeeb-lists@lists.zabbadoz.net) Received: from mx-01.divo.sbone.de (mx-01.divo.sbone.de [IPv6:2003:a:140a:2200:6:594:fffe:19]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature ECDSA (P-256) client-digest SHA256) (Client CN "mx-01.divo.sbone.de", Issuer "E6" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Y4Dcy693Cz3xZT for ; Fri, 6 Dec 2024 01:46:26 +0000 (UTC) (envelope-from bzeeb-lists@lists.zabbadoz.net) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=zabbadoz.net header.s=20240622 header.b=XtAuztfQ; spf=pass (mx1.freebsd.org: domain of bzeeb-lists@lists.zabbadoz.net designates 2003:a:140a:2200:6:594:fffe:19 as permitted sender) smtp.mailfrom=bzeeb-lists@lists.zabbadoz.net; dmarc=pass (policy=none) header.from=zabbadoz.net Received: from mail.sbone.de (mail.sbone.de [IPv6:fde9:577b:c1a9:4902:0:7404:2:1025]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature ECDSA (prime256v1) server-digest SHA256) (No client certificate requested) by mx-01.divo.sbone.de (Postfix) with ESMTPS id 7CAB8A64805 for ; Fri, 06 Dec 2024 01:46:18 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=zabbadoz.net; s=20240622; t=1733449578; bh=zVp6BDfoXLuTK+sejpsc0uX2bJ1cFGQnHac/j4wuqKA=; h=Date:From:To:Subject:In-Reply-To:References; b=XtAuztfQ7lWsaq+5hB+ZKX4mKS7/V59Xcdp2iUkH26Bo8saeVaT2Fyv6SkBrVw5Y8 FdQ+qPwDN4aQDVmm3m23FKwqSmaBw43eSOEwE9GLm1rsPunROqbril5PYJY1E13oYC sfcdqk1BA2l/P5TY5lqzityAMrNck1QSa9dI5aAwa+40GJP+PejJKjTjcYXa8so/Q9 7yMpVZP1vxfRG6XmGvfk+BO4BHqp2NriOQSo/ZDoHCeK32FepLYVb17cFBFRV+uzrV sQukNUtsqCpO3T7Qc9vkuyQqSUrw4XWZDl0bSb5kZ7uyTH1PXUyfJqb+qVBZHqof/T mckLMm56d+8Mu6L1ZJngNrsG0aUe7PV+9BWWZXrJ/DAXsQTMnveybkaYJUkxC0N0Qg jXtflJdtBUaCLubHtzWtTspJsSCRt5zI6WLOFzqP50UTl1XSUn6zZ2Cmq1AjFx4Mgv SdA8qmNbLyoA+jwsekur1/kR+FJSsWrGE3Y3nhpWpYuU4o0y+UT//xPi5ZqQq3+3/R l+CVmIs8WULwtR9HMIImNSnHzDlCRsALvTqPgkrf2bRm9aWf7BNghnHILIAXDGCE9F 94H/s06oeZbkeXJR9JLf8jlGYeQP1f/y13Zof6lR0VLX4afIMnZg2j4/Zn0Q02AbGn yFwy/NI4xATABvOEPZyUphzE= Received: from content-filter.t4-02.sbone.de (content-filter.t4-02.sbone.de [IPv6:fde9:577b:c1a9:4902:0:7404:2:2742]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (No client certificate requested) by mail.sbone.de (Postfix) with ESMTPS id 8550D2D029DC for ; Fri, 6 Dec 2024 01:46:24 +0000 (UTC) X-Virus-Scanned: amavisd-new at sbone.de Received: from mail.sbone.de ([IPv6:fde9:577b:c1a9:4902:0:7404:2:1025]) by content-filter.t4-02.sbone.de (content-filter.t4-02.sbone.de [IPv6:fde9:577b:c1a9:4902:0:7404:2:2742]) (amavisd-new, port 10024) with ESMTP id K5v7szUHtvWp for ; Fri, 6 Dec 2024 01:46:23 +0000 (UTC) Received: from strong-iwl0.sbone.de (strong-iwl0.sbone.de [IPv6:fde9:577b:c1a9:4902:b66b:fcff:fef3:e3d2]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (No client certificate requested) by mail.sbone.de (Postfix) with ESMTPSA id AC30D2D029D8 for ; Fri, 6 Dec 2024 01:46:23 +0000 (UTC) Date: Fri, 6 Dec 2024 01:46:23 +0000 (UTC) From: "Bjoern A. Zeeb" To: virtualization@freebsd.org Subject: Re: bhyve on arm64 and passthru? In-Reply-To: Message-ID: References: <773np621-o750-29qp-9r29-6n86n4290ns1@yvfgf.mnoonqbm.arg> X-OpenPGP-Key-Id: 0x14003F198FEFA3E77207EE8D2B58B8F83CCF1842 List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-virtualization@freebsd.org Sender: owner-freebsd-virtualization@FreeBSD.org MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII; format=flowed X-Spamd-Result: default: False [-3.00 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; SUBJECT_ENDS_QUESTION(1.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-1.000]; DMARC_POLICY_ALLOW(-0.50)[zabbadoz.net,none]; R_DKIM_ALLOW(-0.20)[zabbadoz.net:s=20240622]; R_SPF_ALLOW(-0.20)[+ip6:2003:a:140a:2200:6:594:fffe:19]; MIME_GOOD(-0.10)[text/plain]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:3320, ipnet:2003::/19, country:DE]; RCVD_VIA_SMTP_AUTH(0.00)[]; MISSING_XM_UA(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; MLMMJ_DEST(0.00)[virtualization@freebsd.org]; ARC_NA(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; FROM_HAS_DN(0.00)[]; RCVD_COUNT_THREE(0.00)[4]; TO_DN_NONE(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[virtualization@freebsd.org]; TO_MATCH_ENVRCPT_ALL(0.00)[]; RCVD_TLS_LAST(0.00)[]; DKIM_TRACE(0.00)[zabbadoz.net:+] X-Rspamd-Queue-Id: 4Y4Dcy693Cz3xZT X-Spamd-Bar: -- On Thu, 5 Dec 2024, Mario Marietto wrote: > What do you want to pass on an arm64 platform ? Usually they have one only > embedded gpu. I never saw a (cheap) arm soc with two gpus. Does it make > sense to pass the only and usually not powerful gpu that they have ? Or > maybe you are talking about very expensive arm socs that I never used or > looked at because they are too expensive for me. Not that it matters but I have a (semi-cheap) arm64 box with roughly 25 PCIe cards attached currently and no GPU anywhere in the system. So again, could someone how knows comment on the state of art please? /bz -- Bjoern A. Zeeb r15:7 From nobody Fri Dec 6 04:08:12 2024 X-Original-To: virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Y4HmZ3vB0z5gFLB for ; Fri, 06 Dec 2024 04:08:14 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R10" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Y4HmZ1sYBz4GS7 for ; Fri, 6 Dec 2024 04:08:14 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1733458094; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=y4O5DxxyGPcAhxTWz/3CU+vh82PAlPCqWstURv8LDaU=; b=KawBhB53FlTUP71DHLT00s6IxQ+tjOColcMCMTgDI1gbK2vMdmmzRw+rrZdc13hG9IremM lZ5IYpY8DIKMhwys/TrkHk/kyTFBPzpEYxP1fdMfwu/CqewVoJ8dj3GSWXhXWkMwcXJVS5 EPD91R3Ph6qLv4gF0AT+ot8Dmn6SUiAh/37s6JliojS4KWG0JVirBavwqLSUUTm+OmjrqD S6DxHAZsI4dQhPfGOylu8VpZxYqwpDi38bCP68IYpIwAvjGqRMiWfkEYkc+V7vUGzihPpm K33HtXp2T05Ku7vDipvTv5SMNUT5RJi63L4sXA1xz22xT4U/0+ers+4CMPAzUA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1733458094; a=rsa-sha256; cv=none; b=bVdGe/oP/nTUf2ceBYb1/ldfNN65QsKgGdMR8kHNRH0TM5TbAbA1IkE3Ts46oU8Wk8hryU 3wR1TAz55IejX6kgd3ohxv14ezdTLJbMrMA3JbJFNe4PuST6p9n6HHF+ElcFZ79miaOIXM EZeDYFdfrpOnsUyl5wUki0Cn9dla/fCxOSenHF4a+UZLV5ShOSt1t13BI2ZxCQe+Ku2gKz pHv92SFxCS5hCx67tQu1tZ6pmxER4OFClPchm6c/O+mYJQHleDS1oMwwyO15J9oQSK14D6 6QP+4Vwwp+b0/uUVoA9QEcw8xWf3MoD0IOqgN3+eBTYU09g2lAsfVoX2infrGw== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4Y4HmZ1TGDzMT2 for ; Fri, 6 Dec 2024 04:08:14 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 4B648EA5030901 for ; Fri, 6 Dec 2024 04:08:14 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 4B648EG0030900 for virtualization@FreeBSD.org; Fri, 6 Dec 2024 04:08:14 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 279901] glibc-2.39-2 and above on the host segfault Date: Fri, 06 Dec 2024 04:08:12 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bhyve X-Bugzilla-Version: 14.1-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: fweimer@redhat.com X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-virtualization@freebsd.org Sender: owner-freebsd-virtualization@FreeBSD.org MIME-Version: 1.0 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D279901 Florian Weimer changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |fweimer@redhat.com --- Comment #18 from Florian Weimer --- If you copy over /usr/bin/ld.so from glibc 2.40 into an older distribution (without replacing the installed /usr/bin/ld.so on the older distribution), does =E2=80=9Cld.so --list-diagnostics=E2=80=9D work? If so, please attach = its output. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Fri Dec 6 13:34:43 2024 X-Original-To: virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Y4XLG2dMwz5gH1K for ; Fri, 06 Dec 2024 13:34:46 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R10" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Y4XLG1P4Zz44cC for ; Fri, 6 Dec 2024 13:34:46 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1733492086; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=x4DtF+er5Pq60drp7x0l3ZRraLf19j0CUisFeR9Fsug=; b=SrpR0tRfXG/7FYsMH6sxLIyJeE12SaOj9OKakp2jfj+Xv38cTpH6PlbfO3efoTn693dliT G5KxabeCkMmKFgeDPDCWC2kRSpkABAY0d1i+p5eXDl0HCRPm88vyrYJpFlogEfuyqSIwOE Vmnk/mUvH1tUVoKu1YRqZA1auy/OADNKdYKTLy6p7pGpX6BekDufpGpxSel3vk+nONxozC xFu40rWpTD45ADNozMArd5klSgjXsAoKtRdWmkTt90LfBc4khv6GqjB7yPlRGtcl4CHw0Q nxuYYG5nLHdv/GXk4AUknm3H2NswQtgPpBDDEAdVX7Zi6PRbZem7kU2cvTCOWg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1733492086; a=rsa-sha256; cv=none; b=G12lJFWQQbiQ6UCbTtsv4JNJHNXQBOFtQBvU+LmhokEG5a0+uT3SAeK3vS98eSPzqOnnfI 1b6q3vVV54oXfxG81Ec3cy4fnMqW3cGPKDaNqT/bDbFr1ZQ6+6izSiGxm5Bvw9+aC/LiVO i60Rv7dHYmU9WW/xtj7ycq6J5YK84sb7hfkV1E0Zb4pgNNqx8gURAFabnyCfhgn466t/Y5 inkRfGeKjZbkU9GB2GRoy9HlXxTRhjTJNKcW7/VS2dvHAMhFaYL9/qgIiBaQy7rQNlqX9R ZfVAjPbVCLrwTpZBAiLja5hSaHKehrCaFxn4SIB7YQpq4udZCwzVUjbMx+KfVw== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4Y4XLG0tgQzg9w for ; Fri, 6 Dec 2024 13:34:46 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 4B6DYjxn059184 for ; Fri, 6 Dec 2024 13:34:45 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 4B6DYjvG059183 for virtualization@FreeBSD.org; Fri, 6 Dec 2024 13:34:45 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 279901] glibc-2.39-2 and above on the host segfault Date: Fri, 06 Dec 2024 13:34:43 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bhyve X-Bugzilla-Version: 14.1-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: zatrazz@gmail.com X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-virtualization@freebsd.org Sender: owner-freebsd-virtualization@FreeBSD.org MIME-Version: 1.0 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D279901 Adhemerval Zanella changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |zatrazz@gmail.com --- Comment #19 from Adhemerval Zanella --- I am trying to reproduce it with a different hypervisor/emulation (in this = case qemu/kvm) with a Ryzen 9 5900x Zen3 core but both AlmaLinux 10 Kitten (glibc 2.39) and debian sid (glibc 2.40) boots and works without any issue. And I also verified on debian sid the selected memcpy/memmove is indeed the= one that optimized with glibc change (__memcpy_avx_unaligned_erms). I even trie= d to run glibc memcpy/memmove tests in this VM, where they stress a lot of diffe= rent sizes and alignments for different memcpy/memmove implementations. Also, my daily workstation (Ryzen 9 5900x) the uses a recent glibc that also contains this issue and I haven't see any memcpy/memmove related issue. So I am not sure if this is a glibc issue. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Fri Dec 6 17:45:48 2024 X-Original-To: virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Y4dvw6bMVz5gcM3 for ; Fri, 06 Dec 2024 17:45:48 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R10" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Y4dvw5HHnz4lbQ for ; Fri, 6 Dec 2024 17:45:48 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1733507148; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=lv1MlPW3z1Uto4RwEyqQeYVIkDFXp60QiC1jexicK50=; b=YVpPtyRfTWZXqQnQ31cqNer6fmZMJDYS7NlK9X7+GkHSmbz1H1qOgx0nAToOkOYH3FKweu 824G+6Kr2ihyoekSWjjXCU3cRx6N6UpTM7FNpUd+BNt4Udf2bFZZMTucoL8ChRe81CHwDX 3f9OrvRqkPEypq2cPE9I/E++Y1y0pWLrsACqJ1SARs6a8fp69x+B/lprR6Kz9oePIRoxyE cbcfBBVI+hZV3nCuVuLsAncTN8rWs7txcSg6T7BE1OVWkuAVb3gAdlt6lUSDoCC5uRMg61 NGNzsRWdcOXoiAgjAmIe//tOe4w52ZD28JMYBYw10AJZT5kUImnVucwXoRhabg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1733507148; a=rsa-sha256; cv=none; b=U0WHMDuHSl5t6TGtl4ykIvhXllri6+npJ8mSOthV8/9iBQTGOvIk8UiwuBh0X731B9aB3A ZMGDJnFLlfkGBJYPuKxkQSMeQ+tBpRsbaUgVd88dSa539Y689RNuEiWYOMZWYus9gYZ8Ha NxRwcnSbGYNvwMD6xALBBuZ/3hVGOmWIpJanJBVj/8LZy5sU9T94fxn6iwpaSt2fN5Q3yO ac4a//rigUAOURMswngNTC9LgO+RTXZWkgkNGsWmYnSMLBoX+7t93PnC//4cBKwtUF7GuY 8jcr/j5HXsyHIJaT+MaxhwS3/crujgVqQ6jTkv8KXGLVoVUy1q15f9jes5KWZg== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4Y4dvw4mNCznRG for ; Fri, 6 Dec 2024 17:45:48 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 4B6Hjm6P069269 for ; Fri, 6 Dec 2024 17:45:48 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 4B6Hjmjh069268 for virtualization@FreeBSD.org; Fri, 6 Dec 2024 17:45:48 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 283103] Yet another Parallels arm64 panic Date: Fri, 06 Dec 2024 17:45:48 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: crash X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: markj@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc bug_status Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-virtualization@freebsd.org Sender: owner-freebsd-virtualization@FreeBSD.org MIME-Version: 1.0 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D283103 Mark Johnston changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |markj@FreeBSD.org Status|New |Open --- Comment #1 from Mark Johnston --- Do you know which driver is causing this? That is, can you dump info about= the current thread from ddb, so we know which ithread it is? --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Fri Dec 6 19:15:30 2024 X-Original-To: virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Y4gvQ2sJRz5gjVn for ; Fri, 06 Dec 2024 19:15:30 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R10" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Y4gvQ1gKbz528n for ; Fri, 6 Dec 2024 19:15:30 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1733512530; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=uAulw0W5jSKN+eGM3C2g8y4IAZb86T3MyJLML7+OEJU=; b=DwYbBqMltSQdu4sqrT9j4CTbtMVAQKXeqnsVVtfwoZMO8T/AU154hI4vTXsyOUY0Dhp6zM gixterPOfd+liTITrNzK+IzhOruh3r/ivg6QBHPQ+vaDa5dV8LSmOFstj+oHeTm5DJGSs0 3uQvXvJn9ti4/AYBtWANkadgt3Bd+tLYLcRVywG0fUS06p09TIocbUVFK+wHQaf2FBcvlX ++EaoFSiU66UrtYArjBrciPNIx1Xs8vJlBJ4bptHDFpvO0yUvAF8zqDjF2RgZ5O/z9BH9f 3/PtknQUx4Mm2mUYgPSa6xC2sLsx4E0pyb9tRnTKZQm677S78yoM+gSgS+kBmg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1733512530; a=rsa-sha256; cv=none; b=t4NFuoDJlBDFqG3eXZBRUTdlGfDQWYNZlt6Z7/j0rmUw+li5AcNmYy1NeSO5YSVwqKNl4d FGdkCuYz7XniGFEB1PLs5/nlFjCPY8LjXATC55B64j/m8yVcrhtPX1f/ABxQnbYZnc6x/j XMspf22sr5b2h9KhRN83/aZyL7OS2Qd2V0Repus6S0MMlrAo3t1JG0ebiBIEqdTMwAWo6C fS2UEcOcUetr1oSkDOIBY7qS6JkNBgdAk13Kvkv/nH5O9WaCH+B4Xubxebg9I8ANPNlZmS tojySODdtzlZCZsucSekDvIR+FnzinCevNtBEihNpSO/QFp4K17AQS7Sp40FQQ== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4Y4gvQ1DzfzqlG for ; Fri, 6 Dec 2024 19:15:30 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 4B6JFUgb024989 for ; Fri, 6 Dec 2024 19:15:30 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 4B6JFUWM024988 for virtualization@FreeBSD.org; Fri, 6 Dec 2024 19:15:30 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 283103] Yet another Parallels arm64 panic Date: Fri, 06 Dec 2024 19:15:30 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: crash X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: trasz@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-virtualization@freebsd.org Sender: owner-freebsd-virtualization@FreeBSD.org MIME-Version: 1.0 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D283103 --- Comment #2 from Edward Tomasz Napierala --- Yup, it's: * 79 Thread 100070 (PID=3D12: intr/gic0,s16: acpi_ged0) 0xffff0000004b5= aa8 in doadump (textdump=3D0) at /usr/home/trasz/git/freebsd/sys/kern/kern_shutdown.c:404 I should have more luck with the backtrace next time this happens. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sat Dec 7 21:37:31 2024 X-Original-To: freebsd-virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Y5M0x40Gmz5gFN0 for ; Sat, 07 Dec 2024 21:37:37 +0000 (UTC) (envelope-from lausts@acm.org) Received: from 008.lax.mailroute.net (008.lax.mailroute.net [199.89.1.11]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "mailroute.net", Issuer "R10" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Y5M0w4c6Pz4KRR for ; Sat, 7 Dec 2024 21:37:36 +0000 (UTC) (envelope-from lausts@acm.org) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=acm.org header.s=mr01 header.b="O QE6nsN"; spf=pass (mx1.freebsd.org: domain of lausts@acm.org designates 199.89.1.11 as permitted sender) smtp.mailfrom=lausts@acm.org; dmarc=pass (policy=reject) header.from=acm.org Received: from localhost (localhost [127.0.0.1]) by 008.lax.mailroute.net (Postfix) with ESMTP id 4Y5M0t5T2sz6ClY98 for ; Sat, 7 Dec 2024 21:37:34 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=acm.org; h= content-transfer-encoding:content-type:content-type:subject :subject:from:from:content-language:user-agent:mime-version:date :date:message-id:received:received; s=mr01; t=1733607453; x= 1736199454; bh=w9WI3AspC+4C2aHyG6CLOZ79QanqYAzwe9qJ1KkrCzQ=; b=O QE6nsNgx58T4yqbtfQ+/VA2thUwi/dNKuA9ZK0pGPXiqBww31oCozSBoUUwCjeTl N06TOTlDFptIiDVVBfLAgvRC+0jLfHAPiiMoYifnLrfGoXCMXOn9POe/f0zNvbdN Lr/JV2Qb36b/LS1G5r4MHWU9UxApX8tlFPoKSbmqr6Lh3d1DZAbPMODSopJtAtMK qP3uZwyRKw/V5gUTnBGZtM+7HE4krLVRerPdy05/TZ2LAgbgov6qnfVx2lQurWDs XteV6iVsSIYaq2GQfwEEczYOvV9c5/KsD9T4TQzmjExjtJUPQHaCmcwNJj9Ng78E e59rjxupUGuW1ZfJzFTug== X-Virus-Scanned: by MailRoute Received: from 008.lax.mailroute.net ([127.0.0.1]) by localhost (008.lax [127.0.0.1]) (mroute_mailscanner, port 10029) with LMTP id BI331JsBta0H for ; Sat, 7 Dec 2024 21:37:33 +0000 (UTC) Received: from [192.168.1.100] (syn-174-101-219-087.res.spectrum.com [174.101.219.87]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) (Authenticated sender: lausts@acm.org) by 008.lax.mailroute.net (Postfix) with ESMTPSA id 4Y5M0s4F9mz6CmM6f for ; Sat, 7 Dec 2024 21:37:32 +0000 (UTC) Message-ID: <0fc1d487-b254-4c64-9db1-a982169924e4@acm.org> Date: Sat, 7 Dec 2024 16:37:31 -0500 List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-virtualization@freebsd.org Sender: owner-freebsd-virtualization@FreeBSD.org MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Content-Language: en-US To: freebsd-virtualization@freebsd.org From: Thomas Laus Subject: Tap device problem on FreeBSD 14.2-RELEASE Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit X-Spamd-Result: default: False [-5.09 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; DWL_DNSWL_LOW(-1.00)[acm.org:dkim]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.998]; DMARC_POLICY_ALLOW(-0.50)[acm.org,reject]; R_SPF_ALLOW(-0.20)[+ip4:199.89.0.0/21]; R_DKIM_ALLOW(-0.20)[acm.org:s=mr01]; MIME_GOOD(-0.10)[text/plain]; RCVD_IN_DNSWL_LOW(-0.10)[199.89.1.11:from]; XM_UA_NO_VERSION(0.01)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:8100, ipnet:199.89.1.0/24, country:US]; RCVD_TLS_LAST(0.00)[]; ARC_NA(0.00)[]; TO_DN_NONE(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; FROM_HAS_DN(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; PREVIOUSLY_DELIVERED(0.00)[freebsd-virtualization@freebsd.org]; MLMMJ_DEST(0.00)[freebsd-virtualization@freebsd.org]; DKIM_TRACE(0.00)[acm.org:+] X-Rspamd-Queue-Id: 4Y5M0w4c6Pz4KRR X-Spamd-Bar: ----- I used FreeBSD-update to go from 14.1-RELEASE to 14.2-RELEASE and there is an issue with creating and using the tap device. The device doesn't get created during the boot process and can't be created or used after the system is up. The UPDATING file has just one entry concerning the tap device and that is change the 'tap' name in all configuration files with 'tuntap'. I did that and get an invalid device reply. I installed the latest package for vm-bhyve which did not make any difference. I also deleted /usr/obj/* and checked out a fresh /usr/src and rebuilt FreeBSD-14.2-RELEASE from source without anything working differently. If anyone has a working tap device using FreeBSD 14.2-RELEASE, I would appreciate you sharing your bhyve portions of /etc/rc.conf, /etc/sysctl.conf and /boot/loader.conf files. Thanks Tom -- Public Keys: PGP KeyID = 0x5F22FDC1 GnuPG KeyID = 0x620836CF From nobody Sat Dec 7 21:38:02 2024 X-Original-To: virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Y5M1R3H99z5gFtn for ; Sat, 07 Dec 2024 21:38:03 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R10" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Y5M1Q6QJvz4Kc2 for ; Sat, 7 Dec 2024 21:38:02 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1733607482; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=VzFpYRWCNetgoa1UlU4MvzGsAZtRTmwCxD3/IlX5Z68=; b=OXmZTyMIlb3EovC3dQGALJQ0XcMa7UzUi9Bc1eE2iBZtgXU4jGN8soGm4mky47inBXCUCu X1BM6hVa2M8rvc2pNdbibmxyeHM+JMxa6hw7jk+WAKW2w5rPnQMge0ELRbH65/R3C9n4vy 5C7CXrU1d1kX0/7KQK74aXFeCBUl++mgkVvug1fyHiFn4ADCZpQVf4eRj8vy9X5nUia806 CnQ+cEPxjF+5VDnArSek2NUbMQaQDVGGH9nr2yQCQM41yaqQyucrppauhNf03mB2XqmW54 9rvOX3/wZTVIr2Zwff2VlZJpKovf/Q1VnlqALhMegao0Qs8Oo2lYytKMPHncDw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1733607482; a=rsa-sha256; cv=none; b=L+obQ/Rxhtp7mZSuAS2MdYcW6lkGXezsRuHYuudqhplodnVfnhSroUSG2Oj0G8nkLf58kj eOyD5iJ6GajTrkeVYuKM6BtJ64liWjia9yQj+vl9mszPM+m9Lg+hI+iVLUFZ1aA/RXr7f/ TrQF7BjtKZx1q2z0D6cFeXzirvjfT6LMmhZzX7HMA1w6Lg6uAmQA8mKjw493lp9qwoCdxg V65/3Ncbar7lDrlJ7G5KD7wbTk6we/0N++8EK0wKVy4Y092VCfzd91DO8oVmJ2nPqs4MfB U7yG32RiPzt2CKEGnXaOxt9yNUhJcmqwqH2koth0RHRHtnLzZguwHkoURJ2nQA== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4Y5M1Q5lBMzPhR for ; Sat, 7 Dec 2024 21:38:02 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 4B7Lc2QV024418 for ; Sat, 7 Dec 2024 21:38:02 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 4B7Lc2ED024417 for virtualization@FreeBSD.org; Sat, 7 Dec 2024 21:38:02 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 279901] glibc-2.39-2 and above on the host segfault Date: Sat, 07 Dec 2024 21:38:02 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bhyve X-Bugzilla-Version: 14.1-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: getz@dflund.se X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: attachments.created Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-virtualization@freebsd.org Sender: owner-freebsd-virtualization@FreeBSD.org MIME-Version: 1.0 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D279901 --- Comment #20 from Getz Mikalsen --- Created attachment 255691 --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=3D255691&action= =3Dedit ld.so --list-diagnostics from glibc240 --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sat Dec 7 22:38:57 2024 X-Original-To: freebsd-virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Y5NN34g8Gz5gKCy for ; Sat, 07 Dec 2024 22:39:15 +0000 (UTC) (envelope-from mike@sentex.net) Received: from smarthost1.sentex.ca (smarthost1.sentex.ca [IPv6:2607:f3e0:0:1::12]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smarthost1.sentex.ca", Issuer "R10" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Y5NN24cGgz4P4M for ; Sat, 7 Dec 2024 22:39:14 +0000 (UTC) (envelope-from mike@sentex.net) Authentication-Results: mx1.freebsd.org; none Received: from pyroxene2a.sentex.ca (pyroxene19.sentex.ca [199.212.134.19]) by smarthost1.sentex.ca (8.18.1/8.18.1) with ESMTPS id 4B7McwEb005245 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=FAIL); Sat, 7 Dec 2024 17:38:58 -0500 (EST) (envelope-from mike@sentex.net) Received: from [IPV6:2607:f3e0:0:4:1dd9:4f60:be7e:ab1] ([IPv6:2607:f3e0:0:4:1dd9:4f60:be7e:ab1]) by pyroxene2a.sentex.ca (8.18.1/8.15.2) with ESMTPS id 4B7McuQU064306 (version=TLSv1.3 cipher=TLS_AES_128_GCM_SHA256 bits=128 verify=NO); Sat, 7 Dec 2024 17:38:57 -0500 (EST) (envelope-from mike@sentex.net) Message-ID: Date: Sat, 7 Dec 2024 17:38:57 -0500 List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-virtualization@freebsd.org Sender: owner-freebsd-virtualization@FreeBSD.org MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Subject: Re: Tap device problem on FreeBSD 14.2-RELEASE To: Thomas Laus , freebsd-virtualization@freebsd.org References: <0fc1d487-b254-4c64-9db1-a982169924e4@acm.org> Content-Language: en-US From: mike tancsa Autocrypt: addr=mike@sentex.net; keydata= xsBNBFywzOMBCACoNFpwi5MeyEREiCeHtbm6pZJI/HnO+wXdCAWtZkS49weOoVyUj5BEXRZP xflV2ib2hflX4nXqhenaNiia4iaZ9ft3I1ebd7GEbGnsWCvAnob5MvDZyStDAuRxPJK1ya/s +6rOvr+eQiXYNVvfBhrCfrtR/esSkitBGxhUkBjOti8QwzD71JVF5YaOjBAs7jZUKyLGj0kW yDg4jUndudWU7G2yc9GwpHJ9aRSUN8e/mWdIogK0v+QBHfv/dsI6zVB7YuxCC9Fx8WPwfhDH VZC4kdYCQWKXrm7yb4TiVdBh5kgvlO9q3js1yYdfR1x8mjK2bH2RSv4bV3zkNmsDCIxjABEB AAHNHW1pa2UgdGFuY3NhIDxtaWtlQHNlbnRleC5uZXQ+wsCOBBMBCAA4FiEEmuvCXT0aY6hs 4SbWeVOEFl5WrMgFAl+pQfkCGwMFCwkIBwIGFQoJCAsCBBYCAwECHgECF4AACgkQeVOEFl5W rMiN6ggAk3H5vk8QnbvGbb4sinxZt/wDetgk0AOR9NRmtTnPaW+sIJEfGBOz47Xih+f7uWJS j+uvc9Ewn2Z7n8z3ZHJlLAByLVLtcNXGoRIGJ27tevfOaNqgJHBPbFOcXCBBFTx4MYMM4iAZ cDT5vsBTSaM36JZFtHZBKkuFEItbA/N8ZQSHKdTYMIA7A3OCLGbJBqloQ8SlW4MkTzKX4u7R yefAYQ0h20x9IqC5Ju8IsYRFacVZconT16KS81IBceO42vXTN0VexbVF2rZIx3v/NT75r6Vw 0FlXVB1lXOHKydRA2NeleS4NEG2vWqy/9Boj0itMfNDlOhkrA/0DcCurMpnpbM7ATQRcsMzk AQgA1Dpo/xWS66MaOJLwA28sKNMwkEk1Yjs+okOXDOu1F+0qvgE8sVmrOOPvvWr4axtKRSG1 t2QUiZ/ZkW/x/+t0nrM39EANV1VncuQZ1ceIiwTJFqGZQ8kb0+BNkwuNVFHRgXm1qzAJweEt RdsCMohB+H7BL5LGCVG5JaU0lqFU9pFP40HxEbyzxjsZgSE8LwkI6wcu0BLv6K6cLm0EiHPO l5G8kgRi38PS7/6s3R8QDsEtbGsYy6O82k3zSLIjuDBwA9GRaeigGppTxzAHVjf5o9KKu4O7 gC2KKVHPegbXS+GK7DU0fjzX57H5bZ6komE5eY4p3oWT/CwVPSGfPs8jOwARAQABwsB2BBgB CAAgFiEEmuvCXT0aY6hs4SbWeVOEFl5WrMgFAl+pQfkCGwwACgkQeVOEFl5WrMiVqwf9GwU8 c6cylknZX8QwlsVudTC8xr/L17JA84wf03k3d4wxP7bqy5AYy7jboZMbgWXngAE/HPQU95NM aukysSnknzoIpC96XZJ0okLBXVS6Y0ylZQ+HrbIhMpuQPoDweoF5F9wKrsHRoDaUK1VR706X rwm4HUzh7Jk+auuMYfuCh0FVlFBEuiJWMLhg/5WCmcRfiuB6F59ZcUQrwLEZeNhF2XJV4KwB Tlg7HCWO/sy1foE5noaMyACjAtAQE9p5kGYaj+DuRhPdWUTsHNuqrhikzIZd2rrcMid+ktb0 NvtvswzMO059z1YGMtGSqQ4srCArju+XHIdTFdiIYbd7+jeehg== In-Reply-To: <0fc1d487-b254-4c64-9db1-a982169924e4@acm.org> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit X-Scanned-By: MIMEDefang 2.86 X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:11647, ipnet:2607:f3e0::/32, country:CA] X-Rspamd-Queue-Id: 4Y5NN24cGgz4P4M X-Spamd-Bar: ---- On 12/7/2024 4:37 PM, Thomas Laus wrote: > I used FreeBSD-update to go from 14.1-RELEASE to 14.2-RELEASE and > there is an issue with creating and using the tap device.  The device > doesn't get created during the boot process and can't be created or > used after the system is up.  The UPDATING file has just one entry > concerning the tap device and that is change the 'tap' name in all > configuration files with 'tuntap'. I did that and get an invalid > device reply.  I installed the latest package for vm-bhyve which did > not make any difference.  I also deleted /usr/obj/* and checked out a > fresh /usr/src and rebuilt FreeBSD-14.2-RELEASE from source without > anything working differently. > > If anyone has a working tap device using FreeBSD 14.2-RELEASE, I would > appreciate you sharing your bhyve portions of /etc/rc.conf, > /etc/sysctl.conf and /boot/loader.conf files. > I dont have anything unusual in my config. I am running just a few days ahead of 14.2, but I dont think that makes a difference  kldstat Id Refs Address                Size Name  1   47 0xffffffff80200000  1f3d9c0 kernel  2    1 0xffffffff8213f000   5da658 zfs.ko  3    1 0xffffffff8271a000     36c8 coretemp.ko  4    2 0xffffffff8271e000    8dae8 pf.ko  5    1 0xffffffff827ac000     77d8 cryptodev.ko  6    1 0xffffffff827b4000     3c58 pflog.ko  7    1 0xffffffff83c20000     3390 acpi_wmi.ko  8    1 0xffffffff83c24000     4250 ichsmb.ko  9    1 0xffffffff83c29000     2178 smbus.ko 10    1 0xffffffff83c2c000     7798 if_bridge.ko 11    1 0xffffffff83c34000     60e0 bridgestp.ko 12    1 0xffffffff83c3b000     33c0 uchcom.ko 13    1 0xffffffff83c3f000     4e10 ucom.ko 14    1 0xffffffff83e00000   33e438 vmm.ko 15    1 0xffffffff83c44000     4850 nullfs.ko Starting up a vm works as before for me  vmrun.sh -t tap0 -d /baseimage/14-1VM-p6.raw -E  vm0 Launching virtual machine "vm0" ... fbuf frame buffer base: 0x2be256a00000 [sz 16777216] 3h 3h 3h BdsDxe: loading Boot0001 "UEFI Misc Device" from PciRoot(0x0)/Pci(0x3,0x0) BdsDxe: starting Boot0001 "UEFI Misc Device" from PciRoot(0x0)/Pci(0x3,0x0) Consoles: EFI console     Reading loader env vars from /efi/freebsd/loader.env Setting currdev to disk0p2: FreeBSD/amd64 EFI loader, Revision 1.1    Command line arguments: loader.efi    Image base: 0x1e27a000    EFI version: 2.70    EFI Firmware: BHYVE (rev 1.00)    Console: efi (0x20001000)    Load Path: \EFI\BOOT\BOOTX64.EFI    Load Device: PciRoot(0x0)/Pci(0x3,0x0)/HD(2,GPT,E140336F-1F4D-11EF-AE18-002590EC5BF2,0x17B,0x10418)    BootCurrent: 0001    BootOrder: 0000 0001[*] 0002 0003 0004    BootInfo Path: PciRoot(0x0)/Pci(0x3,0x0) Ignoring Boot0001: Only one DP found Trying ESP: PciRoot(0x0)/Pci(0x3,0x0)/HD(2,GPT,E140336F-1F4D-11EF-AE18-002590EC5BF2,0x17B,0x10418) Setting currdev to disk0p2: Trying: PciRoot(0x0)/Pci(0x3,0x0)/HD(1,GPT,E1403365-1F4D-11EF-AE18-002590EC5BF2,0x22,0x159) Setting currdev to disk0p1: Trying: PciRoot(0x0)/Pci(0x3,0x0)/HD(3,GPT,E1403374-1F4D-11EF-AE18-002590EC5BF2,0x10593,0x200000) Setting currdev to disk0p3: Trying: PciRoot(0x0)/Pci(0x3,0x0)/HD(4,GPT,E1403378-1F4D-11EF-AE18-002590EC5BF2,0x210593,0x11FFF6D) Setting currdev to zfs:zroot/ROOT/default: - Loading /boot/defaults/loader.conf Loading /boot/defaults/loader.conf Loading /boot/device.hints Loading /boot/loader.conf Loading /boot/loader.conf.local ?c\ |  ______               ____   _____ _____   |  ____|             |  _ \ / ____|  __ \   | |___ _ __ ___  ___ | |_) | (___ | |  | |   |  ___| '__/ _ \/ _ \|  _ < \___ \| |  | |   | |   | | |  __/  __/| |_) |____) | |__| |   | |   | | |    |    ||     |      |      | . . . root@freebsd:~ # ping 8.8.8.8 PING 8.8.8.8 (8.8.8.8): 56 data bytes 64 bytes from 8.8.8.8: icmp_seq=0 ttl=114 time=28.173 ms ^C --- 8.8.8.8 ping statistics --- 1 packets transmitted, 1 packets received, 0.0% packet loss round-trip min/avg/max/stddev = 28.173/28.173/28.173/0.000 ms root@freebsd:~ # shutdown -p now Shutdown NOW! ... The bridge to tap0 works as expected. It gets auto created for me I can create new ones too # ifconfig tap1 create # ifconfig tap1 tap1: flags=8802 metric 0 mtu 1500         options=4080000         ether 58:9c:fc:10:63:02         groups: tap         media: Ethernet 1000baseT         status: no carrier         nd6 options=29 On an actually 14.2R box, if I add to rc.conf cloned_interfaces="bridge0 tap0" it gets created at boot % ifconfig tap0 tap0: flags=8802 metric 0 mtu 1500         options=80000         ether 58:9c:fc:10:ff:ed         groups: tap         media: Ethernet 1000baseT         status: no carrier         nd6 options=29 From nobody Sat Dec 7 22:45:07 2024 X-Original-To: virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Y5NW01rrCz5gKhF for ; Sat, 07 Dec 2024 22:45:16 +0000 (UTC) (envelope-from herbert@gojira.at) Received: from mail.bsd4all.net (mail.bsd4all.net [94.130.200.20]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature ECDSA (P-384) client-digest SHA384) (Client CN "mail.bsd4all.net", Issuer "E6" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Y5NVy5fS6z4Qlv for ; Sat, 7 Dec 2024 22:45:14 +0000 (UTC) (envelope-from herbert@gojira.at) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gojira.at header.s=mail202005 header.b=ypa9aQwL; spf=pass (mx1.freebsd.org: domain of herbert@gojira.at designates 94.130.200.20 as permitted sender) smtp.mailfrom=herbert@gojira.at; dmarc=none Date: Sat, 7 Dec 2024 23:45:07 +0100 DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=gojira.at; s=mail202005; t=1733611507; bh=YsnK8uFpxKT+FCcO/Gg7OU83SESqYJX5CpaETVPUM/M=; h=Date:From:To:Subject:Message-ID:MIME-Version:Content-Type; b=ypa9aQwLfX46Hge53RQPjHSmWMaQKs4jWRyElS+L+LYeUin9CMKEq7PDjFD4KWOf5 ydaTnGMTUyQANHv73mqI5IIv3LP82cZY3NAjEdhh8XeYMZOOT6RAoeDQabTvsKSQkZ YqgiHESlVLHfCvJ8OhF5R32/W0zT/Hxsrl6f2LHFOM/mhwbZtgn00HL6cJOcPI90ux bHXoZunp1EcAzqyflp48ezwO31K7CR4N/jiSLROL+vcCD07E+XMKIV8jZk9Qma1CJG g3BVZjB35IuAN6niZUmLIZvIe38wAFTfgH76nTAkszToMr16KSImOwpxlu5qKPhj3v BGYa3QekqeWzA== From: "Herbert J. Skuhra" To: virtualization@freebsd.org Subject: Re: Tap device problem on FreeBSD 14.2-RELEASE Message-ID: References: <0fc1d487-b254-4c64-9db1-a982169924e4@acm.org> List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-virtualization@freebsd.org Sender: owner-freebsd-virtualization@FreeBSD.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <0fc1d487-b254-4c64-9db1-a982169924e4@acm.org> X-Spamd-Result: default: False [-3.50 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-1.000]; R_SPF_ALLOW(-0.20)[+ip4:94.130.200.20]; R_DKIM_ALLOW(-0.20)[gojira.at:s=mail202005]; MIME_GOOD(-0.10)[text/plain]; MIME_TRACE(0.00)[0:+]; RCPT_COUNT_ONE(0.00)[1]; ASN(0.00)[asn:24940, ipnet:94.130.0.0/16, country:DE]; MISSING_XM_UA(0.00)[]; FROM_HAS_DN(0.00)[]; RCVD_COUNT_ZERO(0.00)[0]; DMARC_NA(0.00)[gojira.at]; FROM_EQ_ENVFROM(0.00)[]; ARC_NA(0.00)[]; TO_DN_NONE(0.00)[]; MLMMJ_DEST(0.00)[virtualization@freebsd.org]; TO_MATCH_ENVRCPT_ALL(0.00)[]; DKIM_TRACE(0.00)[gojira.at:+] X-Rspamd-Queue-Id: 4Y5NVy5fS6z4Qlv X-Spamd-Bar: --- On Sat, Dec 07, 2024 at 04:37:31PM -0500, Thomas Laus wrote: > I used FreeBSD-update to go from 14.1-RELEASE to 14.2-RELEASE and there is > an issue with creating and using the tap device. The device doesn't get > created during the boot process and can't be created or used after the > system is up. The UPDATING file has just one entry concerning the tap > device and that is change the 'tap' name in all configuration files with > 'tuntap'. I did that and get an invalid device reply. I installed the > latest package for vm-bhyve which did not make any difference. I also > deleted /usr/obj/* and checked out a fresh /usr/src and rebuilt > FreeBSD-14.2-RELEASE from source without anything working differently. I guess you are misreading UPDATING (20190507?). "device tuntap" is included in GENERIC since 251a32b5b2bab (2019!). So this entry is not relevant for the 14.1-RELEASE to 14.2-RELEASE update. What files have you modified? > If anyone has a working tap device using FreeBSD 14.2-RELEASE, I would > appreciate you sharing your bhyve portions of /etc/rc.conf, /etc/sysctl.conf > and /boot/loader.conf files. You should be able to create tun/tap interfaces with "ifconfig tun0 create" or "ifconfig tap0 create". What error do you get? From nobody Sat Dec 7 22:45:10 2024 X-Original-To: freebsd-virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Y5NW81Fzhz5gKq3 for ; Sat, 07 Dec 2024 22:45:24 +0000 (UTC) (envelope-from bakul@iitbombay.org) Received: from mail-pj1-x1036.google.com (mail-pj1-x1036.google.com [IPv6:2607:f8b0:4864:20::1036]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "WR4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Y5NW76dGzz4Qt2 for ; Sat, 7 Dec 2024 22:45:23 +0000 (UTC) (envelope-from bakul@iitbombay.org) Authentication-Results: mx1.freebsd.org; none Received: by mail-pj1-x1036.google.com with SMTP id 98e67ed59e1d1-2ee8ecb721dso525355a91.3 for ; Sat, 07 Dec 2024 14:45:23 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=iitbombay.org; s=google; t=1733611522; x=1734216322; darn=freebsd.org; h=to:references:message-id:content-transfer-encoding:cc:date :in-reply-to:from:subject:mime-version:from:to:cc:subject:date :message-id:reply-to; bh=GR98mdbI38N+3JqT9XW7yqcmfE9FmejkMU8DQyeF28A=; b=OXqCJbprpW2lx2RXQYtJo2/wg/CIVFL8HkH8OHXWUzF7eOPoLlEOeo5mTgWnFhBxl5 Q9Jbm65JuezdD+irzRc7y9+KRcKDDMtvyl8cDy/4Qm/JuJLU0gqt9ipAN9H7rGYUP2LW mHj4Aaur2Xw3Dc80jP7wnqhVU0MxAIBBBLgQs= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1733611522; x=1734216322; h=to:references:message-id:content-transfer-encoding:cc:date :in-reply-to:from:subject:mime-version:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=GR98mdbI38N+3JqT9XW7yqcmfE9FmejkMU8DQyeF28A=; b=aR8ijptGVsyuCqlbsEHmVVbhiqwg89767xyEz4QvvC893NN6Xn8CxilDyTF/PdqAbr QIzMU5UHN9+HzUQmYhMLL/gUrNZq1sFF4n6bLs34HKuhiLan4cwj0mgYWheiw9DmBmK+ xcl4R00DtsOS8VIc7/nNuAc//1zN0Akm078EUGG7vRf0H6Vw9OjKyS+jGSy9OTGmADSO VcxMTs1CrQYIkFeY6nghZ7uhWfWbpyi6GealwSvG8TI898nIdJeVYXd9QR99WJAQAg17 XsqESpHyHxKRx3l/1FoNFadZu28iXhTa+EjWmQ4RHuICrMTu86jEmmlNCmyyn1EXERHN tC0A== X-Gm-Message-State: AOJu0Yztj/WZsF/G1aItPBXiRy37WRn6b7EZz3Gev11wMLV9hHCTiUX2 DhsK6BM07R7wDezCuSX/E6nyQXo8WtH4wQi2Bu/y3wEWWJgzvnCvuuw6UYUzcAQ6HmzPSrC8JOY = X-Gm-Gg: ASbGncsu/G56pXl+pCOK3by6+B48TyfcFwfkXcwtpCo4THLmFWA1Ozcdo5YDKbCvNA4 kINDycVtfihzNaZ6X5Lgqo08LiN3dmvlrIkrsGw/kqSPM8Ka2AJm6IvLAycsLhWxnenSGYNB060 t+WYBx8kqrHZ0RioQNpPk+vIKq9Z0I5Bgeifv19uOISk7QynWbGlSN9WRGVhtjbci7xw0YPzgiH kjpZSHs7NVcGLZZxuStxLgwBXuYEW/4Vf+wLVvonArsIrEcJVDXP9ENwO9h4bQztLOFDo2o882f Id9hIM8WEMKecN45Ws77HQ6hBLvdWf07LJf5uQIq/lHYsVk= X-Google-Smtp-Source: AGHT+IFglO76m/u9rahcaUqNFCwx9uh5GdkR7UEKaXjuHGsbjYzdR56NPsQ/55RTJFCLTn+Y2VJV5A== X-Received: by 2002:a17:90b:3803:b0:2ee:d4ed:13a7 with SMTP id 98e67ed59e1d1-2ef6ab12974mr4618729a91.7.1733611522434; Sat, 07 Dec 2024 14:45:22 -0800 (PST) Received: from smtpclient.apple (107-215-223-229.lightspeed.sntcca.sbcglobal.net. [107.215.223.229]) by smtp.gmail.com with ESMTPSA id 98e67ed59e1d1-2ef6ef14312sm3418320a91.46.2024.12.07.14.45.21 (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Sat, 07 Dec 2024 14:45:21 -0800 (PST) Content-Type: text/plain; charset=utf-8 List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-virtualization@freebsd.org Sender: owner-freebsd-virtualization@FreeBSD.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3826.200.121\)) Subject: Re: Tap device problem on FreeBSD 14.2-RELEASE From: Bakul Shah In-Reply-To: <0fc1d487-b254-4c64-9db1-a982169924e4@acm.org> Date: Sat, 7 Dec 2024 14:45:10 -0800 Cc: freebsd-virtualization@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: References: <0fc1d487-b254-4c64-9db1-a982169924e4@acm.org> To: Thomas Laus X-Mailer: Apple Mail (2.3826.200.121) X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US] X-Rspamd-Queue-Id: 4Y5NW76dGzz4Qt2 X-Spamd-Bar: ---- $ uname -v FreeBSD 14.2-RELEASE releng/14.2-n269506-c8918d6c7412 GENERIC $ kldstat |grep 'if_.*tap' $ kldstat -v |grep 'if_.*tap' 388 if_tap 386 if_tuntap $ ifconfig tap5 ifconfig: interface tap5 does not exist $ ls -l /dev/tap5 ls: /dev/tap5: No such file or directory $ sudo ls -l /dev/tap5 crw------- 1 uucp dialer 0x89 Dec 7 14:40 /dev/tap5 $ ifconfig tap5 tap5: flags=3D8802 metric 0 mtu 1500 options=3D80000 ether 58:9c:fc:10:ff:80 groups: tap media: Ethernet 1000baseT status: no carrier nd6 options=3D29 /dev/tap is created on access (if you have the permission to do so) and then ifconfig works. You may be able to trigger this by adding tap related lines to /etc/devfs.conf such as own tap0 $user:$group # replace with user and group you want ... > On Dec 7, 2024, at 1:37=E2=80=AFPM, Thomas Laus = wrote: >=20 > I used FreeBSD-update to go from 14.1-RELEASE to 14.2-RELEASE and = there is an issue with creating and using the tap device. The device = doesn't get created during the boot process and can't be created or used = after the system is up. The UPDATING file has just one entry concerning = the tap device and that is change the 'tap' name in all configuration = files with 'tuntap'. I did that and get an invalid device reply. I = installed the latest package for vm-bhyve which did not make any = difference. I also deleted /usr/obj/* and checked out a fresh /usr/src = and rebuilt FreeBSD-14.2-RELEASE from source without anything working = differently. >=20 > If anyone has a working tap device using FreeBSD 14.2-RELEASE, I would = appreciate you sharing your bhyve portions of /etc/rc.conf, = /etc/sysctl.conf and /boot/loader.conf files. >=20 > Thanks >=20 > Tom >=20 >=20 > --=20 > Public Keys: > PGP KeyID =3D 0x5F22FDC1 > GnuPG KeyID =3D 0x620836CF >=20 >=20 From nobody Sat Dec 7 23:27:23 2024 X-Original-To: freebsd-virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Y5PRt0zPlz5gMdB for ; Sat, 07 Dec 2024 23:27:38 +0000 (UTC) (envelope-from zbeeble@gmail.com) Received: from mail-pj1-x1029.google.com (mail-pj1-x1029.google.com [IPv6:2607:f8b0:4864:20::1029]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "WR4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Y5PRr4sySz4T5V for ; Sat, 7 Dec 2024 23:27:36 +0000 (UTC) (envelope-from zbeeble@gmail.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20230601 header.b=av4LlslG; spf=pass (mx1.freebsd.org: domain of zbeeble@gmail.com designates 2607:f8b0:4864:20::1029 as permitted sender) smtp.mailfrom=zbeeble@gmail.com; dmarc=pass (policy=none) header.from=gmail.com Received: by mail-pj1-x1029.google.com with SMTP id 98e67ed59e1d1-2ee46851b5eso2329823a91.1 for ; Sat, 07 Dec 2024 15:27:36 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1733614055; x=1734218855; darn=freebsd.org; h=to:subject:message-id:date:from:mime-version:from:to:cc:subject :date:message-id:reply-to; bh=K2OZ7c6mxHzJtfMmZOdlkgqppbjnpbX/nrvVLnNiHNw=; b=av4LlslGiJpwNaL4uDZb0pQ15a5qb7+Z/vT3betZcDI1pWqTDY/91OowsHfnShqY8Q w4fhV5UCBotA37Xkiq4HiRHOoQl+dLVlH4M1AXjM25X5IQCohvuTQke89595d3WatPjI bUs4ouQqcEafpOch0Z4cjIvBi6/dv7wm7KK3S8BelgnyUjYGgUMN1eQepWx4xc78Noub wy3v/5LWFNtNBEr4lCM8FV63UQTwsInJWCFVAEd1A/hQgxKxG30kr28SO97uRZI3NFs9 dUSTLtDKXc4y0iFs7siWvuID4wdL+1HfcCajJBbFRVjVn9Bk942ZfB5nH5wRM5UB3B+d lhmA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1733614055; x=1734218855; h=to:subject:message-id:date:from:mime-version:x-gm-message-state :from:to:cc:subject:date:message-id:reply-to; bh=K2OZ7c6mxHzJtfMmZOdlkgqppbjnpbX/nrvVLnNiHNw=; b=pi9ukSXaS4o005FTgIQRj6iAAKo5YHtcoSBl/Qdcm+DNznJNlh7xknNWUsFaTEodiI DyaZWQKCDFbWSA5cX1Sakcok02Z2hE0QEByv1994jHGZ6CEsiOKHIcL0xbf/HCI4l/n+ LHAxidL82SfKjR42IEtShTDMqbZayw7bvzctqtCdhKyRnVC4l7JxwnLSEr/xkiwLddwe VlZu7GeGisGbdsyMyjD7w9KjYaC8tcuMkXruf6q3lNkolkBkn/uugNylYivNHoddCBPR Vnxxgpy2Twny4kjxxwE/5ZUjkbTdN0HVLOn5HGWOSqK7hyqfbcAjsNbNf7yM7WZrlTIb 3V2A== X-Gm-Message-State: AOJu0YzV74n6yEK5bq657jBPNfGMaFjwkO7m2fcq9pj19c8jxM+YpC/g uIxyeMqqiddXwb/91GNgal5PCz8SgYqDU3NnOqRXPfsNZKhSFa+w2XPprk60FqPJG6d5sTrIeNj 90LZvwi7Fh9pwnmFJMcv89bbk6VTRqj0= X-Gm-Gg: ASbGncsTEE80SAiOBFvTQViOgAsm/bRq+kJx5GrK5WPy0RxotsqOQywOi0rDqphr5Wo 4tWAwENTKa/E7c3HF/kesLqia/cBvHtQyo+4F161MBxcxTfqHKDF7NwDb X-Google-Smtp-Source: AGHT+IEoxM+5mg8wXDW4stQHJ38tGWBb9V3N+/tU3vfcQuG2fBPXF2JfS5LX1Cps9FLFTVJexhaL6xLtT/I1z6zk2og= X-Received: by 2002:a17:90b:3944:b0:2ee:b4d4:78 with SMTP id 98e67ed59e1d1-2ef6ab1052amr12589036a91.24.1733614055138; Sat, 07 Dec 2024 15:27:35 -0800 (PST) List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-virtualization@freebsd.org Sender: owner-freebsd-virtualization@FreeBSD.org MIME-Version: 1.0 From: Zaphod Beeblebrox Date: Sat, 7 Dec 2024 18:27:23 -0500 Message-ID: Subject: Struggle with bhyve and Kali. To: freebsd-virtualization@freebsd.org Content-Type: multipart/related; boundary="000000000000efbdf40628b679fb" X-Spamd-Result: default: False [-4.00 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.997]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20230601]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; MIME_GOOD(-0.10)[multipart/related,multipart/alternative,text/plain]; RCVD_TLS_LAST(0.00)[]; ARC_NA(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; FREEMAIL_ENVFROM(0.00)[gmail.com]; TO_MATCH_ENVRCPT_ALL(0.00)[]; FREEMAIL_FROM(0.00)[gmail.com]; MIME_TRACE(0.00)[0:+,1:+,2:+,3:~,4:~]; FROM_HAS_DN(0.00)[]; RCVD_COUNT_ONE(0.00)[1]; MISSING_XM_UA(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-virtualization@freebsd.org]; TO_DN_NONE(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; MID_RHS_MATCH_FROMTLD(0.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; MLMMJ_DEST(0.00)[freebsd-virtualization@freebsd.org]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::1029:from] X-Rspamd-Queue-Id: 4Y5PRr4sySz4T5V X-Spamd-Bar: --- --000000000000efbdf40628b679fb Content-Type: multipart/alternative; boundary="000000000000efbdf30628b679fa" --000000000000efbdf30628b679fa Content-Type: text/plain; charset="UTF-8" So... I've installed kali a few times on bhyve. Lately on 14.1 that is now 14.2 (no change there). The graphical install proceeds fine (using the vm install command), and the first reboot (cd still attached) works fine. Subsequent reboots fail with this message: [image: image.png] ... which since Kali linux does install on hardware, seems to be Bhyve's problem. Help? --000000000000efbdf30628b679fa Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
So... I've installed kali a few times on bhyve.= =C2=A0 Lately on 14.1 that is now 14.2 (no change there).=C2=A0 The graphic= al install proceeds fine (using the vm install command), and the first rebo= ot (cd still attached) works fine.

Subsequent rebo= ots fail with this message:

3D"image.png"

<= /div>
... which since Kali linux does install on hardware, seems to be = Bhyve's problem.

Help?
--000000000000efbdf30628b679fa-- --000000000000efbdf40628b679fb Content-Type: image/png; name="image.png" Content-Disposition: inline; filename="image.png" Content-Transfer-Encoding: base64 Content-ID: X-Attachment-Id: ii_m4et0i930 iVBORw0KGgoAAAANSUhEUgAAArkAAACMCAYAAAB4drGDAAASyklEQVR4Xu3dYXLcuBEG0N3b+ki+ bZKp3amwaADdDYLSiHipyh+TBNGvQfDTeFb++6+//vrP//7vfwQIECBAgAABAgQeI/C3kPuYXiqE AAECBAgQIEDgXwEh11IgQIAAAQIECBB4nICQ+7iWKogAAQIECBAgQEDItQYIECBAgAABAgQeJyDk Pq6lCiJAgAABAgQIEBByrQECBAgQIECAAIHHCQi5j2upgggQIECAAAECBIRca4AAAQIECBAgQOBx AkLu41qqIAIECBAgQIAAASHXGiBAgAABAgQIEHicgJD7uJYqiAABAgQIECBAQMi1BggQIECAAAEC BB4nIOQ+rqUKIkCAAAECBAgQEHKtAQIECBAgQIAAgccJCLmPa6mCCBAgQIAAAQIEhFxrgAABAgQI ECBA4HECQu7jWqogAgQIECBAgAABIdcaIECAAAECBAgQeJyAkPu4liqIAAECBAgQIEBAyLUGCBAg QIAAAQIEHicg5D6upQoiQIAAAQIECBAQcq0BAgQIECBAgACBxwkIuY9rqYIIECBAgAABAgSEXGuA AAECBAgQIEDgcQJC7uNaqiACBAgQIECAAAEh1xogQIAAAQIECBB4nICQ+7iWKogAAQIECBAgQEDI tQYIECBAgAABAgQeJyDkPq6lCiJAgAABAgQIEFgWcn///t3U/PXr1x9/fjy3dbw1UGv87LVf3ebz XFfOc8buXP/VMV7Xr6zpOL+rc8v0euYelfWdmcPonJFvNPerx1/zeo9R7fHxuvMYrTFb57dcXvPo +b/OHx3P1hDN72pPr17/k/a/Xq2j9VHxuXN/rcyjt28d/zy7/qL7fsr+06r5WGO0/1TqbI1b8czs L5Xxorn33rMrfY7783vvq8zrrv5U5vDV5y4Lua2X4+hlOfMiXbVJ3omceblH949souPR+KuCTOY+ M+esqC+678w9VvT2yryi9X/1+KoN9Bg63xt8JkRGvtHxFeu6FZrPL8KZtRP1PXM86m9mjMw5d9W3 Yv6ZNZCp8Y5zVs2t579q/FHt2d5Hz3N2nF5ojsbP9C/ympljdo+J5j977yt79NXn7+r1mZ7dcc6P DbnZxXYH2opN4soYVx6Q931nx5i9rtKHT71HtGlWauydm33Bndf/zKbaq+c9t+qnHKNNMJpf73l+ XRcF5auf+LReHO/5vkNv72W8oufZMb5i/d25r654SX7F3pDtx/m8Vf3J7gF3WGTHzNSaHWv07B+f v+8cr/r8r/Y5v7ere3Rm/61mkko/Zp+pFdcJuSsUD2N8ReNX3GN2jNnrKsyfeo/MxlWps3Vu9gV3 R8i9+gPQe07vT3Kj8Fn1zKyLzDkj99axati/ugayPwDN1nrX/DLjvn9oOf7wkrluxdqs3Gfm3Op6 rt7j7vGzP+BkA1Nlfa4eMzNeZX6VXmXunbXu/SAl5OY78uUh970AWk06H3udM3pRHhdTZmFF46/Y SEcPzqj2873PtR9bGgWh47m9v2qdfUjOS6v3faPq+Cvqq/qOjEdBqPfJYrS+Rsdbx47zi9b31eMZ //y28ueZ0fzOm34rBLVe8qu+StDz7+1BrbVzpf8Z2yjkZNbX6FPxYw++o74Zg9aefXTI7k/na2YC 0JX+ZPb/q+Nn1sdofx+9H6Pn++rxyrs5ej/O7t/R83GnT2t/rLy/rvpH12ee3e8655aQ2wtZo1Ca Qcw+5LPfCaw8SKMQlAl4mTDc+wQpY3V+KK4+JJFNdk6ZhZ4dq2o4Wn+VebXWdzTn6HjF9x0Ae/XM HP+kkNt7fqIQ2Vrzmb62no3WHnL3Syya62j/i9ZXtHdG/a+Of6UXPYdz/6MfcKLnvXX8HRzOoTfq zcx+mw1j53X3HftPZX209p/o/XPuRe/5G+35lT00ms9o/UZzyDwrUUbJjPFeq9W1eWd/MnP56nNu Cbmtn5SiTTZaONEm0toIqn9dugI/U0f0AojGiB6A1sMe+Wdrr2zMUR3Ry+xK/6J6Z+a2MmT01kDG dybEZl8i0drMrpPzeZk125rj6OX6dohewJk5Z+Y3eolG6yk6PjPHmRAXfZJbXZdXTDI1Z9ZRFG4y NR1D7fme2a+rtMbIeGdrPI9f2R+z6zuzTqOxeiHq2IdzQMvuT9H8Rsfv7k/2WbjqM7NHV31n+zPz TN99zceE3PMD8C48+3WFbMhtgWY3sUwzZh+yyot6tMn06otCX6a20cMVbXzZ8TMvpN5mUtnEos2y Nd9PCbmt+iP/6Hhl/VV6md34Mxt3pmeZczK9ra71aP+andeoL62Qu+L5r6yV1r57nsNX76+t+0U1 ZUPAaO1n9v6MRW+c0Q81lfoqz+SVZyV6T1VC+mjO2b3r7v5UXWd8ZvNLtD6y+Snq2cy74e5rPirk nouNglkldKx4yWSakdmgohd6NNfsgs2+IDN1RZvMzJx6982OVdn0o7WUMaist3OPZ2qKNu9R/bP3 j9Zmxmn2xTiz7qM9IzvfbH8qPlF/snPrPXuV8Svrv2IR7QvVGqPzZ4NKVJOQ+4989Az2zol8o/0o c300v2jus2unusfM1nLlea68K2b2k2xN0fP7HceF3IZ69LCMGiXk/v8f/5h1zD5QQu4//wBL5vtr WdPoRTK7SWXu3zun8le+d6+5ik/lpZVxrf6QNXrxVV/4kWt0PFNf5pzqvEchvNef15+PvpPdm+fs 3LIhqtr/aP1lnslsrZmxKvt16zmL1tiV49G1UYiMenjVJxo/mt/V+2euzzy/33HOx4TcDOKVhyQz /mhDzDbnk0Ju1StT4+jF8A5cVx2zvarUN3pBZOqONt1oztHxltmdL7VVL+RZu8gzc7x178rLaubF 0Au5UX+j4xnHynof+b3vtfI/bF1RX9Vg5Yv/bPsVITf7rujtp5UQm+1PNObMDw3ZZya699U9q3p9 tT+V/STzPqrON3rvrto/Zp6NzLN91znLQu4b8DzR6Fe4HINRa4zzpzjH8aPvh/QWUm+Mq8jn+ff+ 6993zaONp/ciGt1j5HfcaEY9yhgc7xP1N/MdtNbm0Kq/Ut/ov16dqX92fc/49HzPPRx99/D4XPV8 R+vzjmek+nwf10Dl2ZqZezUEXF2fUdDsBbhRbdHz0Qsbdzx/1fqq+855fUfro7f/9f4j6eqL/Or9 zwHl7NfaE6rvt8z6yOwx57n29rjq+3l071Hgu7que/atPTTT5zt9Wus4cs7s/zP7X/XdnnnG7zhn Wci9Y3LGJECAAAECBAgQIDAjIOTOqLmGAAECBAgQIEDgowWE3I9uj8kRIECAAAECBAjMCAi5M2qu IUCAAAECBAgQ+GgBIfej22NyBAgQIECAAAECMwJC7oyaawgQIECAAAECBD5aQMj96PaYHAECBAgQ IECAwIzAspAb/R67mckdr8n+HrfMfV5jVX/HW+/3pL7uVx0rM8fROaPfo3p1bNcTIECAAAECBJ4g sCzkvjDuDLqZX4adaciVOfZ++fZXh9y7rTOOziFAgAABAgQIfLLAjwy5709PZwLrzDXvBvY+TRZy P3mJmxsBAgQIECCwo8DSkHvnJ4ytf05vJrDOXDMKud+1aK7U8V1zdl8CBAgQIECAwFcJfEvInQlo mZA7+re5e9+prXwK2/q6Qu/f7X43sPVvo7d+GDiOPfrObeXfzv6qReQ+BAgQIECAAIFPE/hxIfcV GjOBt/ep8kzAPn+Se2xiL8Se75/5Pm90TisIV0L6py0+8yFAgAABAgQI3CXwLSF3ppheAHyNdQy+ rU9Woz/Lzmf0SW702x+iAJv9dHcUqrN1OI8AAQIECBAg8HQBIbfQ4dGnwEJuAdKpBAgQIECAAIGb BX5syD1/8hmFzLfjiq8rtL4iEN3fJ7k3r2TDEyBAgAABAgQOAktDbjZAZs87dqoaIs8hWMi17gkQ IECAAAEC+whsHXKrYdvXFfZ5MFRKgAABAgQI/GyBZSG3GhirbNEnucdPbo9jj75a8Dov+9sJMr+6 a/QrzM7za/3HctFXGlb8GrSqu/MJECBAgAABAj9RYFnI/YnFmzMBAgQIECBAgMAzBYTcZ/ZVVQQI ECBAgACBrQWE3K3br3gCBAgQIECAwDMFhNxn9lVVBAgQIECAAIGtBYTcrduveAIECBAgQIDAMwWE 3Gf2VVUECBAgQIAAga0FhNyt2694AgQIECBAgMAzBYTcZ/ZVVQQIECBAgACBrQWE3K3br3gCBAgQ IECAwDMFhNxn9lVVBAgQIECAAIGtBYTcrduveAIECBAgQIDAMwWE3Gf2VVUECBAgQIAAga0FhNyt 2694AgQIECBAgMAzBYTcZ/ZVVQQIECBAgACBrQWE3K3br3gCBAgQIECAwDMFhNxn9lVVBAgQIECA AIGtBYTcrduveAIECBAgQIDAMwWE3Gf2VVUECBAgQIAAga0FhNyt2694AgQIECBAgMAzBYTcZ/ZV VQQIECBAgACBrQWE3K3br3gCBAgQIECAwDMFhNxn9lVVBAgQIECAAIGtBYTcrduveAIECBAgQIDA MwWE3Gf2VVUECBAgQIAAga0FhNyt2694AgQIECBAgMAzBYTcZ/ZVVQQIECBAgACBrQU+KuT+/v37 j2b8+vXrjz97ndf681WdnBm/NffXfN7zfB8/zvv4Z73rj2Osqu87xsn6nOc20+fjvWau/w4f9yRA gAABAgTWCiwLua0Qd5zqzPEoGK6l+Ge0aJ6je56vbYXYXsht3fvKXO6wWTHmqKaRX+XeQm5Fy7kE CBAgQOCZAstCbiYgVgJOb7y7g9+V8VeH3LfBkz6NrKyBmV6cPzF+kt0ztyBVESBAgACBewSWhtwr QTf7qe1M8KnQXRk/+iSy+sluZd4/5Vwh96d0yjwJECBAgMDPFlgeclcH3Tdv9J3O433f12S+/3r+ zuy5nZVPAleG3FXfC+59J3j0Q8XRoHX9la8DzIbcyPa87q78sPKzH2mzJ0CAAAECBF4Ct4TcFUH3 NUbvPzrrHTu2NPPJcOacyjKpBLFWDVf+qj2qJZpbdH2rpzNBUsitrCjnEiBAgAABArMCt4XcK0F3 dG02WGVCWwstO/7o2uOx6NPk0fErnyKfDe8IuTOLLhNyW37V+V/p40xdriFAgAABAgQ+S+C2kBuF jOh4L+jOhqRM6M6e02thVNOd38mNQn02JLZqG/0atOpyzvQv8wl+r57R/KtzdT4BAgQIECDwcwVu CbmVsDeii4Lb8dooxGUDbDT36nzf52dqWX3vUajOeJ1rvTK/kcPMsWgu0fGf+8iaOQECBAgQIJAR WB5yo3DRO54JgaOgmglt0dyyQXjmk9xMfb1zMl9biMaPfO62mQmy1R9iRudnj2UeGucQIECAAAEC ny+wNORGQan6V9WV4BaFuGyAjb5S8JWf5EaeUXCL/kp/9A9TtLwq81n1g0CrxvefjcJ/da19/qNq hgQIECBAgEBFYFnIjQJQdPwYqo4FjL6f+TqvFdTef94KrJWAdB4/E3B742cDe+semU9ys36Z8Nfy f1+X8WvVcL7+PE52/Jl1lPWrPDjOJUCAAAECBD5bYFnI/ewyzY4AAQIECBAgQGAnASF3p26rlQAB AgQIECCwiYCQu0mjlUmAAAECBAgQ2ElAyN2p22olQIAAAQIECGwiIORu0mhlEiBAgAABAgR2EhBy d+q2WgkQIECAAAECmwgIuZs0WpkECBAgQIAAgZ0EhNyduq1WAgQIECBAgMAmAkLuJo1WJgECBAgQ IEBgJwEhd6duq5UAAQIECBAgsImAkLtJo5VJgAABAgQIENhJQMjdqdtqJUCAAAECBAhsIiDkbtJo ZRIgQIAAAQIEdhIQcnfqtloJECBAgAABApsICLmbNFqZBAgQIECAAIGdBITcnbqtVgIECBAgQIDA JgJC7iaNViYBAgQIECBAYCcBIXenbquVAAECBAgQILCJgJC7SaOVSYAAAQIECBDYSUDI3anbaiVA gAABAgQIbCIg5G7SaGUSIECAAAECBHYSEHJ36rZaCRAgQIAAAQKbCAi5mzRamQQIECBAgACBnQSE 3J26rVYCBAgQIECAwCYCQu4mjVYmAQIECBAgQGAnASF3p26rlQABAgQIECCwiYCQu0mjlUmAAAEC BAgQ2ElAyN2p22olQIAAAQIECGwiIORu0mhlEiBAgAABAgR2EhByd+q2WgkQIECAAAECmwgIuZs0 WpkECBAgQIAAgZ0EhNyduq1WAgQIECBAgMAmAkLuJo1WJgECBAgQIEBgJwEhd6duq5UAAQIECBAg sImAkLtJo5VJgAABAgQIENhJQMjdqdtqJUCAAAECBAhsIiDkbtJoZRIgQIAAAQIEdhIQcnfqtloJ ECBAgAABApsICLmbNFqZBAgQIECAAIGdBITcnbqtVgIECBAgQIDAJgJC7iaNViYBAgQIECBAYCeB /wIkY3kABrJz8AAAAABJRU5ErkJggg== --000000000000efbdf40628b679fb-- From nobody Sat Dec 7 23:30:34 2024 X-Original-To: freebsd-virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Y5PWj2nNHz5gNBq for ; Sat, 07 Dec 2024 23:30:57 +0000 (UTC) (envelope-from chuck@tuffli.net) Received: from fout-b5-smtp.messagingengine.com (fout-b5-smtp.messagingengine.com [202.12.124.148]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Y5PWj0fdrz4TR9 for ; Sat, 7 Dec 2024 23:30:56 +0000 (UTC) (envelope-from chuck@tuffli.net) Authentication-Results: mx1.freebsd.org; none Received: from phl-compute-12.internal (phl-compute-12.phl.internal [10.202.2.52]) by mailfout.stl.internal (Postfix) with ESMTP id 78BEB1140162; Sat, 7 Dec 2024 18:30:55 -0500 (EST) Received: from phl-imap-11 ([10.202.2.101]) by phl-compute-12.internal (MEProxy); Sat, 07 Dec 2024 18:30:55 -0500 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=tuffli.net; h=cc :content-type:content-type:date:date:from:from:in-reply-to :in-reply-to:message-id:mime-version:references:reply-to:subject :subject:to:to; s=fm3; t=1733614255; x=1733700655; bh=oy9dUaNKMi Fh8ULlrAPXOHA6900e4qBqXfOh0kz/X7E=; b=JygmWeI0IAL0bheVODgvPBJESJ 3Z2nPt0wMnHNk+bzDc3v4e6Do8VFRFNPznruHXx3zFtDh+68H7a+mZ4VTWojwy2r R2E1rXRFYj3VLthcx2vzcSAcA3069XWKqiCMzkcRXVW/A0pnHWFLYhx0IDGma3Z3 hqgdPY1kbrkvyGczhMH0Z7XzQTk17rcASpW5J+1PwFQKDSuWxiiz2F3IwmIrh0cF Sjrr7Bea3I7RrldluwBtCCUTv/vyF+8/e7Ay5igtryU4PiD++y/7vVNPD4ONPyuc PkDd2t5MhMOb2N5R7njibbza+hqAd0N1KLyPrEinf5sc6cvM01q9rwNwJl2Q== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:content-type:content-type:date:date :feedback-id:feedback-id:from:from:in-reply-to:in-reply-to :message-id:mime-version:references:reply-to:subject:subject:to :to:x-me-proxy:x-me-sender:x-me-sender:x-sasl-enc; s=fm1; t= 1733614255; x=1733700655; bh=oy9dUaNKMiFh8ULlrAPXOHA6900e4qBqXfO h0kz/X7E=; b=DNLT/2xe/v394iNn0hOvupVnaCONbPfT6+vxVl3hRC5RdtMQKpT 1j68aBr03zT1g/2oAm8WOXUgDn7WivGDfN+JxcVnKH7dVb+CPUAsbFE9kw7Fvjnq tbtrelhEpcFo+qzLdERRsYkSst4Gik4wI2OEaibz7iPklIw2ZclX81HzVyDTz7X5 sNZq8ALXpnR8QzUhB/oLesxIm00WrJPMYk6+76aMHcL+E66VtKtvAbkzCbbz+vBP s1fX6l2BwF5I395gKie/buwGfOFjjW8z49RbBLaKnnbVO/uzH7iZD0vreBGcNvQz bweeqMCj7MCnBrkIUJpix3aKaqcejOcWRZg== X-ME-Sender: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgeefuddrjedvgddtlecutefuodetggdotefrodftvf curfhrohhfihhlvgemucfhrghsthforghilhdpggftfghnshhusghstghrihgsvgdpuffr tefokffrpgfnqfghnecuuegrihhlohhuthemuceftddtnecusecvtfgvtghiphhivghnth hsucdlqddutddtmdenucfjughrpefoggffhffvkfgjfhfutgesrgdtreerredttdenucfh rhhomhepfdevhhhutghkucfvuhhffhhlihdfuceotghhuhgtkhesthhufhhflhhirdhnvg htqeenucggtffrrghtthgvrhhnpeejvefgveffleffheevveeivefghfeujeeikeehfffh gfffteeugfeghfettdetvdenucevlhhushhtvghrufhiiigvpedtnecurfgrrhgrmhepmh grihhlfhhrohhmpegthhhutghksehtuhhffhhlihdrnhgvthdpnhgspghrtghpthhtohep vddpmhhouggvpehsmhhtphhouhhtpdhrtghpthhtohepfhhrvggvsghsugdqvhhirhhtuh grlhhiiigrthhiohhnsehfrhgvvggsshgurdhorhhgpdhrtghpthhtohepiigsvggvsghl vgesghhmrghilhdrtghomh X-ME-Proxy: Feedback-ID: ib6f94606:Fastmail Received: by mailuser.phl.internal (Postfix, from userid 501) id B291D2220073; Sat, 7 Dec 2024 18:30:54 -0500 (EST) X-Mailer: MessagingEngine.com Webmail Interface List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-virtualization@freebsd.org Sender: owner-freebsd-virtualization@FreeBSD.org MIME-Version: 1.0 Date: Sat, 07 Dec 2024 15:30:34 -0800 From: "Chuck Tuffli" To: "Zaphod Beeblebrox" , "FreeBSD virtualization" Message-Id: <839c02e0-4ac3-4926-afb8-644c12ee9cee@app.fastmail.com> In-Reply-To: References: Subject: Re: Struggle with bhyve and Kali. Content-Type: multipart/alternative; boundary=2b5d9e269870479085d7e967b6d824da X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[] X-Rspamd-Queue-Id: 4Y5PWj0fdrz4TR9 X-Spamd-Bar: ---- --2b5d9e269870479085d7e967b6d824da Content-Type: text/plain Content-Transfer-Encoding: 7bit On Sat, Dec 7, 2024, at 3:27 PM, Zaphod Beeblebrox wrote: > So... I've installed kali a few times on bhyve. Lately on 14.1 that is now 14.2 (no change there). The graphical install proceeds fine (using the vm install command), and the first reboot (cd still attached) works fine. > > Subsequent reboots fail with this message: > > image.png > > ... which since Kali linux does install on hardware, seems to be Bhyve's problem. > > Help? How are you invoking bhyve? --2b5d9e269870479085d7e967b6d824da Content-Type: multipart/related; boundary=649d3341e07e4bad81f5954218c8477d; type="text/html" --649d3341e07e4bad81f5954218c8477d Content-Type: text/html Content-Transfer-Encoding: 7bit
On Sat, Dec 7, 2024, at 3:27 PM, Zaphod Beeblebrox wrote:
So... I've installed kali a few times on bhyve.  Lately on 14.1 that is now 14.2 (no change there).  The graphical install proceeds fine (using the vm install command), and the first reboot (cd still attached) works fine.

Subsequent reboots fail with this message:

image.png

... which since Kali linux does install on hardware, seems to be Bhyve's problem.

Help?

How are you invoking bhyve?
--649d3341e07e4bad81f5954218c8477d Content-ID: Content-Disposition: inline; filename="image.png" Content-Type: image/png; name="image.png" Content-Transfer-Encoding: base64 iVBORw0KGgoAAAANSUhEUgAAArkAAACMCAYAAAB4drGDAAASyklEQVR4Xu3dYXLcuBEG0N3b +ki+bZKp3amwaADdDYLSiHipyh+TBNGvQfDTeFb++6+//vrP//7vfwQIECBAgAABAgQeI/C3 kPuYXiqEAAECBAgQIEDgXwEh11IgQIAAAQIECBB4nICQ+7iWKogAAQIECBAgQEDItQYIECBA gAABAgQeJyDkPq6lCiJAgAABAgQIEBByrQECBAgQIECAAIHHCQi5j2upgggQIECAAAECBIRc a4AAAQIECBAgQOBxAkLu41qqIAIECBAgQIAAASHXGiBAgAABAgQIEHicgJD7uJYqiAABAgQI ECBAQMi1BggQIECAAAECBB4nIOQ+rqUKIkCAAAECBAgQEHKtAQIECBAgQIAAgccJCLmPa6mC CBAgQIAAAQIEhFxrgAABAgQIECBA4HECQu7jWqogAgQIECBAgAABIdcaIECAAAECBAgQeJyA kPu4liqIAAECBAgQIEBAyLUGCBAgQIAAAQIEHicg5D6upQoiQIAAAQIECBAQcq0BAgQIECBA gACBxwkIuY9rqYIIECBAgAABAgSEXGuAAAECBAgQIEDgcQJC7uNaqiACBAgQIECAAAEh1xog QIAAAQIECBB4nICQ+7iWKogAAQIECBAgQEDItQYIECBAgAABAgQeJyDkPq6lCiJAgAABAgQI EFgWcn///t3U/PXr1x9/fjy3dbw1UGv87LVf3ebzXFfOc8buXP/VMV7Xr6zpOL+rc8v0euYe lfWdmcPonJFvNPerx1/zeo9R7fHxuvMYrTFb57dcXvPo+b/OHx3P1hDN72pPr17/k/a/Xq2j 9VHxuXN/rcyjt28d/zy7/qL7fsr+06r5WGO0/1TqbI1b8czsL5Xxorn33rMrfY7783vvq8zr rv5U5vDV5y4Lua2X4+hlOfMiXbVJ3omceblH949souPR+KuCTOY+M+esqC+678w9VvT2yryi 9X/1+KoN9Bg63xt8JkRGvtHxFeu6FZrPL8KZtRP1PXM86m9mjMw5d9W3Yv6ZNZCp8Y5zVs2t 579q/FHt2d5Hz3N2nF5ojsbP9C/ympljdo+J5j977yt79NXn7+r1mZ7dcc6PDbnZxXYH2opN 4soYVx6Q931nx5i9rtKHT71HtGlWauydm33Bndf/zKbaq+c9t+qnHKNNMJpf73l+XRcF5auf +LReHO/5vkNv72W8oufZMb5i/d25r654SX7F3pDtx/m8Vf3J7gF3WGTHzNSaHWv07B+fv+8c r/r8r/Y5v7ere3Rm/61mkko/Zp+pFdcJuSsUD2N8ReNX3GN2jNnrKsyfeo/MxlWps3Vu9gV3 R8i9+gPQe07vT3Kj8Fn1zKyLzDkj99axati/ugayPwDN1nrX/DLjvn9oOf7wkrluxdqs3Gfm 3Op6rt7j7vGzP+BkA1Nlfa4eMzNeZX6VXmXunbXu/SAl5OY78uUh970AWk06H3udM3pRHhdT ZmFF46/YSEcPzqj2873PtR9bGgWh47m9v2qdfUjOS6v3faPq+Cvqq/qOjEdBqPfJYrS+Rsdb x47zi9b31eMZ//y28ueZ0fzOm34rBLVe8qu+StDz7+1BrbVzpf8Z2yjkZNbX6FPxYw++o74Z g9aefXTI7k/na2YC0JX+ZPb/q+Nn1sdofx+9H6Pn++rxyrs5ej/O7t/R83GnT2t/rLy/rvpH 12ee3e8655aQ2wtZo1CaQcw+5LPfCaw8SKMQlAl4mTDc+wQpY3V+KK4+JJFNdk6ZhZ4dq2o4 Wn+VebXWdzTn6HjF9x0Ae/XMHP+kkNt7fqIQ2Vrzmb62no3WHnL3Syya62j/i9ZXtHdG/a+O f6UXPYdz/6MfcKLnvXX8HRzOoTfqzcx+mw1j53X3HftPZX209p/o/XPuRe/5G+35lT00ms9o /UZzyDwrUUbJjPFeq9W1eWd/MnP56nNuCbmtn5SiTTZaONEm0toIqn9dugI/U0f0AojGiB6A 1sMe+Wdrr2zMUR3Ry+xK/6J6Z+a2MmT01kDGdybEZl8i0drMrpPzeZk125rj6OX6dohewJk5 Z+Y3eolG6yk6PjPHmRAXfZJbXZdXTDI1Z9ZRFG4yNR1D7fme2a+rtMbIeGdrPI9f2R+z6zuz TqOxeiHq2IdzQMvuT9H8Rsfv7k/2WbjqM7NHV31n+zPzTN99zceE3PMD8C48+3WFbMhtgWY3 sUwzZh+yyot6tMn06otCX6a20cMVbXzZ8TMvpN5mUtnEos2yNd9PCbmt+iP/6Hhl/VV6md34 Mxt3pmeZczK9ra71aP+andeoL62Qu+L5r6yV1r57nsNX76+t+0U1ZUPAaO1n9v6MRW+c0Q81 lfoqz+SVZyV6T1VC+mjO2b3r7v5UXWd8ZvNLtD6y+Snq2cy74e5rPirknouNglkldKx4yWSa kdmgohd6NNfsgs2+IDN1RZvMzJx6982OVdn0o7WUMaist3OPZ2qKNu9R/bP3j9Zmxmn2xTiz 7qM9IzvfbH8qPlF/snPrPXuV8Svrv2IR7QvVGqPzZ4NKVJOQ+4989Az2zol8o/0oc300v2ju s2unusfM1nLlea68K2b2k2xN0fP7HceF3IZ69LCMGiXk/v8f/5h1zD5QQu4//wBL5vtrWdPo RTK7SWXu3zun8le+d6+5ik/lpZVxrf6QNXrxVV/4kWt0PFNf5pzqvEchvNef15+PvpPdm+fs 3LIhqtr/aP1lnslsrZmxKvt16zmL1tiV49G1UYiMenjVJxo/mt/V+2euzzy/33HOx4TcDOKV hyQz/mhDzDbnk0Ju1StT4+jF8A5cVx2zvarUN3pBZOqONt1oztHxltmdL7VVL+RZu8gzc7x1 78rLaubF0Au5UX+j4xnHynof+b3vtfI/bF1RX9Vg5Yv/bPsVITf7rujtp5UQm+1PNObMDw3Z Zya699U9q3p9tT+V/STzPqrON3rvrto/Zp6NzLN91znLQu4b8DzR6Fe4HINRa4zzpzjH8aPv h/QWUm+Mq8jn+ff+6993zaONp/ciGt1j5HfcaEY9yhgc7xP1N/MdtNbm0Kq/Ut/ov16dqX92 fc/49HzPPRx99/D4XPV8R+vzjmek+nwf10Dl2ZqZezUEXF2fUdDsBbhRbdHz0Qsbdzx/1fqq +855fUfro7f/9f4j6eqL/Or9zwHl7NfaE6rvt8z6yOwx57n29rjq+3l071Hgu7que/atPTTT 5zt9Wus4cs7s/zP7X/XdnnnG7zhnWci9Y3LGJECAAAECBAgQIDAjIOTOqLmGAAECBAgQIEDg owWE3I9uj8kRIECAAAECBAjMCAi5M2quIUCAAAECBAgQ+GgBIfej22NyBAgQIECAAAECMwJC 7oyaawgQIECAAAECBD5aQMj96PaYHAECBAgQIECAwIzAspAb/R67mckdr8n+HrfMfV5jVX/H W+/3pL7uVx0rM8fROaPfo3p1bNcTIECAAAECBJ4gsCzkvjDuDLqZX4adaciVOfZ++fZXh9y7 rTOOziFAgAABAgQIfLLAjwy5709PZwLrzDXvBvY+TRZyP3mJmxsBAgQIECCwo8DSkHvnJ4yt f05vJrDOXDMKud+1aK7U8V1zdl8CBAgQIECAwFcJfEvInQlomZA7+re5e9+prXwK2/q6Qu/f 7X43sPVvo7d+GDiOPfrObeXfzv6qReQ+BAgQIECAAIFPE/hxIfcVGjOBt/ep8kzAPn+Se2xi L8Se75/5Pm90TisIV0L6py0+8yFAgAABAgQI3CXwLSF3ppheAHyNdQy+rU9Woz/Lzmf0SW70 2x+iAJv9dHcUqrN1OI8AAQIECBAg8HQBIbfQ4dGnwEJuAdKpBAgQIECAAIGbBX5syD1/8hmF zLfjiq8rtL4iEN3fJ7k3r2TDEyBAgAABAgQOAktDbjZAZs87dqoaIs8hWMi17gkQIECAAAEC +whsHXKrYdvXFfZ5MFRKgAABAgQI/GyBZSG3GhirbNEnucdPbo9jj75a8Dov+9sJMr+6a/Qr zM7za/3HctFXGlb8GrSqu/MJECBAgAABAj9RYFnI/YnFmzMBAgQIECBAgMAzBYTcZ/ZVVQQI ECBAgACBrQWE3K3br3gCBAgQIECAwDMFhNxn9lVVBAgQIECAAIGtBYTcrduveAIECBAgQIDA MwWE3Gf2VVUECBAgQIAAga0FhNyt2694AgQIECBAgMAzBYTcZ/ZVVQQIECBAgACBrQWE3K3b r3gCBAgQIECAwDMFhNxn9lVVBAgQIECAAIGtBYTcrduveAIECBAgQIDAMwWE3Gf2VVUECBAg QIAAga0FhNyt2694AgQIECBAgMAzBYTcZ/ZVVQQIECBAgACBrQWE3K3br3gCBAgQIECAwDMF hNxn9lVVBAgQIECAAIGtBYTcrduveAIECBAgQIDAMwWE3Gf2VVUECBAgQIAAga0FhNyt2694 AgQIECBAgMAzBYTcZ/ZVVQQIECBAgACBrQWE3K3br3gCBAgQIECAwDMFhNxn9lVVBAgQIECA AIGtBYTcrduveAIECBAgQIDAMwWE3Gf2VVUECBAgQIAAga0FhNyt2694AgQIECBAgMAzBYTc Z/ZVVQQIECBAgACBrQU+KuT+/v37j2b8+vXrjz97ndf681WdnBm/NffXfN7zfB8/zvv4Z73r j2Osqu87xsn6nOc20+fjvWau/w4f9yRAgAABAgTWCiwLua0Qd5zqzPEoGK6l+Ge0aJ6je56v bYXYXsht3fvKXO6wWTHmqKaRX+XeQm5Fy7kECBAgQOCZAstCbiYgVgJOb7y7g9+V8VeH3LfB kz6NrKyBmV6cPzF+kt0ztyBVESBAgACBewSWhtwrQTf7qe1M8KnQXRk/+iSy+sluZd4/5Vwh 96d0yjwJECBAgMDPFlgeclcH3Tdv9J3O433f12S+/3r+zuy5nZVPAleG3FXfC+59J3j0Q8XR oHX9la8DzIbcyPa87q78sPKzH2mzJ0CAAAECBF4Ct4TcFUH3NUbvPzrrHTu2NPPJcOacyjKp BLFWDVf+qj2qJZpbdH2rpzNBUsitrCjnEiBAgAABArMCt4XcK0F3dG02WGVCWwstO/7o2uOx 6NPk0fErnyKfDe8IuTOLLhNyW37V+V/p40xdriFAgAABAgQ+S+C2kBuFjOh4L+jOhqRM6M6e 02thVNOd38mNQn02JLZqG/0atOpyzvQv8wl+r57R/KtzdT4BAgQIECDwcwVuCbmVsDeii4Lb 8dooxGUDbDT36nzf52dqWX3vUajOeJ1rvTK/kcPMsWgu0fGf+8iaOQECBAgQIJARWB5yo3DR O54JgaOgmglt0dyyQXjmk9xMfb1zMl9biMaPfO62mQmy1R9iRudnj2UeGucQIECAAAECny+w NORGQan6V9WV4BaFuGyAjb5S8JWf5EaeUXCL/kp/9A9TtLwq81n1g0CrxvefjcJ/da19/qNq hgQIECBAgEBFYFnIjQJQdPwYqo4FjL6f+TqvFdTef94KrJWAdB4/E3B742cDe+semU9ys36Z 8Nfyf1+X8WvVcL7+PE52/Jl1lPWrPDjOJUCAAAECBD5bYFnI/ewyzY4AAQIECBAgQGAnASF3 p26rlQABAgQIECCwiYCQu0mjlUmAAAECBAgQ2ElAyN2p22olQIAAAQIECGwiIORu0mhlEiBA gAABAgR2EhByd+q2WgkQIECAAAECmwgIuZs0WpkECBAgQIAAgZ0EhNyduq1WAgQIECBAgMAm AkLuJo1WJgECBAgQIEBgJwEhd6duq5UAAQIECBAgsImAkLtJo5VJgAABAgQIENhJQMjdqdtq JUCAAAECBAhsIiDkbtJoZRIgQIAAAQIEdhIQcnfqtloJECBAgAABApsICLmbNFqZBAgQIECA AIGdBITcnbqtVgIECBAgQIDAJgJC7iaNViYBAgQIECBAYCcBIXenbquVAAECBAgQILCJgJC7 SaOVSYAAAQIECBDYSUDI3anbaiVAgAABAgQIbCIg5G7SaGUSIECAAAECBHYSEHJ36rZaCRAg QIAAAQKbCAi5mzRamQQIECBAgACBnQSE3J26rVYCBAgQIECAwCYCQu4mjVYmAQIECBAgQGAn ASF3p26rlQABAgQIECCwiYCQu0mjlUmAAAECBAgQ2ElAyN2p22olQIAAAQIECGwiIORu0mhl EiBAgAABAgR2EhByd+q2WgkQIECAAAECmwgIuZs0WpkECBAgQIAAgZ0EhNyduq1WAgQIECBA gMAmAkLuJo1WJgECBAgQIEBgJwEhd6duq5UAAQIECBAgsImAkLtJo5VJgAABAgQIENhJQMjd qdtqJUCAAAECBAhsIiDkbtJoZRIgQIAAAQIEdhIQcnfqtloJECBAgAABApsICLmbNFqZBAgQ IECAAIGdBITcnbqtVgIECBAgQIDAJgJC7iaNViYBAgQIECBAYCeB/wIkY3kABrJz8AAAAABJ RU5ErkJggg== --649d3341e07e4bad81f5954218c8477d-- --2b5d9e269870479085d7e967b6d824da-- From nobody Sun Dec 8 00:23:46 2024 X-Original-To: freebsd-virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Y5Qhw1M66z5gRLq for ; Sun, 08 Dec 2024 00:24:00 +0000 (UTC) (envelope-from bakul@iitbombay.org) Received: from mail-pj1-x1033.google.com (mail-pj1-x1033.google.com [IPv6:2607:f8b0:4864:20::1033]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "WR4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Y5Qhv5s5Xz4XZV for ; Sun, 8 Dec 2024 00:23:59 +0000 (UTC) (envelope-from bakul@iitbombay.org) Authentication-Results: mx1.freebsd.org; none Received: by mail-pj1-x1033.google.com with SMTP id 98e67ed59e1d1-2ef7733a1dcso277908a91.3 for ; Sat, 07 Dec 2024 16:23:59 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=iitbombay.org; s=google; t=1733617438; x=1734222238; darn=freebsd.org; h=to:references:message-id:content-transfer-encoding:cc:date :in-reply-to:from:subject:mime-version:from:to:cc:subject:date :message-id:reply-to; bh=cBDNwA3paIp9GBX/XIyYaF3mpR92ZgLmwJ1sId3BaLs=; b=VCBSRExRvXhdgSH0ww05Xp4md2UFsjdcagQ+LKL9buXSD3o4u/ugHMKjlWeyJ+pSee FFealZ41WCQGhR4+OJLlJwLZkWB7OBeu7W9aNOlNXOmXPLikHjgT6KpdC33hxWKTkQay sWgSR0ZE3XQt8cmuOkXTjOpsy4Inx73erPuto= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1733617438; x=1734222238; h=to:references:message-id:content-transfer-encoding:cc:date :in-reply-to:from:subject:mime-version:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=cBDNwA3paIp9GBX/XIyYaF3mpR92ZgLmwJ1sId3BaLs=; b=BfZFU+hRgrAwnPULzJY+Ps+shM9VWbNc1bzmgNdMYai+UDzJZ/nhIp0G6NpAhmsr97 O7VKPn+4jWCUjw4LgfVomPvmwzUwPQnClAXTeYwpqffbTAYXBQ9JGT7wnPzOQZe7Zp05 fPvsp6D7UuyfLgLbtRc23q1aRc7wV2n14Qp3lkl3ntr1cFbd5LCwpmCmXKpl/FKKEjyC f5VLxKfh+wjt9teNR2ZPSAtLdx3Qv5AOxb4lIWkH88YLyXEOax9iSCMAjp296PxFPIKC /FemAvL6qtXRa/OWPYx41dLSubnMskTJgLFctP94J3Kb3ARLJa04LQZKb9gNaLhy2l4y j7KQ== X-Gm-Message-State: AOJu0YxRH5IlgaODER4OsNEeUPC2FTRoWv0+FfDlgrQT5r0ww14mrwEs HVxV+5HS7wU05VqineaiNVysBCWoKlqB83IaiIDKUtjwHdQzYVZRH1J03C/GpyEl9V9qV5+8/OU = X-Gm-Gg: ASbGncth4TKgAYJy9ifDU444u2cp4vZrvptaFEBtO4PC9d5858UZc6nxwM0HJjfr4Gh V0hFvYbrjo04Rw151x+tZzbLCJX+PR6Q2S17infYMs4vb13ltorSoswGooLRVNSxx6zTZTUKEf9 W2wpEtUiF88AixS3gJK9Gmb3QwwfWs0eUpcfIkHFJ78670M3jZOQ9+6sJBgs78hOuEXuVvZar/j 7YdUPf4ByhXkkHwE2oi485N472otc/+6jgceeybpGjf4+UhL5aeY1xy9T3bRKjfWd6q9y3YPyRp d/RFzCSC32E4CBgNyG3n/uscGByTOjQYxVnRNJjxCsT9XLI= X-Google-Smtp-Source: AGHT+IHZUyJ0mDdtAH/xDEX7PjyEWeJgLfthNjMQZA0MQ+q3aUz3U7PSSKA5kFOcDpQpxpAm42vatg== X-Received: by 2002:a17:902:e88f:b0:215:9a73:6c4f with SMTP id d9443c01a7336-21614d5365fmr43091985ad.6.1733617438395; Sat, 07 Dec 2024 16:23:58 -0800 (PST) Received: from smtpclient.apple (107-215-223-229.lightspeed.sntcca.sbcglobal.net. [107.215.223.229]) by smtp.gmail.com with ESMTPSA id d9443c01a7336-215f8ef9485sm48609205ad.157.2024.12.07.16.23.57 (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Sat, 07 Dec 2024 16:23:57 -0800 (PST) Content-Type: text/plain; charset=utf-8 List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-virtualization@freebsd.org Sender: owner-freebsd-virtualization@FreeBSD.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3826.200.121\)) Subject: Re: Struggle with bhyve and Kali. From: Bakul Shah In-Reply-To: Date: Sat, 7 Dec 2024 16:23:46 -0800 Cc: freebsd-virtualization@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: <6B19A54E-78B2-4BDA-94FA-F7558F26DA87@iitbombay.org> References: To: Zaphod Beeblebrox X-Mailer: Apple Mail (2.3826.200.121) X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US] X-Rspamd-Queue-Id: 4Y5Qhv5s5Xz4XZV X-Spamd-Bar: ---- This may help:=20 = https://record99.blogspot.com/2021/12/bdsdex-failed-to-load-boot0001-uefi-= bhyve-sata-disk.html > On Dec 7, 2024, at 3:27=E2=80=AFPM, Zaphod Beeblebrox = wrote: >=20 > So... I've installed kali a few times on bhyve. Lately on 14.1 that = is now 14.2 (no change there). The graphical install proceeds fine = (using the vm install command), and the first reboot (cd still attached) = works fine. >=20 > Subsequent reboots fail with this message: >=20 > >=20 > ... which since Kali linux does install on hardware, seems to be = Bhyve's problem. >=20 > Help? From nobody Sun Dec 8 01:26:50 2024 X-Original-To: freebsd-virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Y5S5g59XXz5fnR1 for ; Sun, 08 Dec 2024 01:27:03 +0000 (UTC) (envelope-from kyle.a.taylor@gmail.com) Received: from mail-io1-xd2a.google.com (mail-io1-xd2a.google.com [IPv6:2607:f8b0:4864:20::d2a]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "WR4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Y5S5g1WSfz4fLB for ; Sun, 8 Dec 2024 01:27:03 +0000 (UTC) (envelope-from kyle.a.taylor@gmail.com) Authentication-Results: mx1.freebsd.org; none Received: by mail-io1-xd2a.google.com with SMTP id ca18e2360f4ac-84192e4788dso107074639f.2 for ; Sat, 07 Dec 2024 17:27:03 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1733621222; x=1734226022; darn=freebsd.org; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=HPCFDfLT0Z+Vn0oqx7KdINWiW9elR+MgwW0rsFeK2mM=; b=GBEI4nCT2/eh84PDFV1bOY6LeUlcewhKY5QYJoyCpIwmia2CVar90sxbxZ9egjz+FH aNjxIfY9wcQmc+IFUxXTaw3eQ50LGNM1XlBnbwklqhTfALtuw6frZ250aIQymA9s7xlH kkYl32QdmIAeoNP1irlRXTAMWvxAu7vDMoNEAB7B9cO2Eb7saPQh6CsTJnDw+wKcZu3J RbC8VtvOmUY1UeXxd8/mrnBeqTV4gteaVhT1XREdVCxc37IYa3aZ4pN+fxsEiFPpVo5z SoCK4buyzAGnI/RVAJmo3nrasJ1n0bfeX2fgKN52U2c462BDo6KtrJyn3soGXF22nJSN WxAQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1733621222; x=1734226022; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=HPCFDfLT0Z+Vn0oqx7KdINWiW9elR+MgwW0rsFeK2mM=; b=C3QxtjHdDOTUz3gjCxB7O6tZ09ev3EigtQegbfhkxOc3VqkawTAvnljg663/g0e7ZL 72HMX0TkJsJiKNSbJnmUqKGY5ZGjJzK69yLucjy/PV6bNIxpV52LOlPm6CwBT++kT7Gx cicjoNC4pOeN/i48brNpMTfNkHrCWcmpt05nujugLlAkVJgdOeI1T5bBuTr8wcQyvtQ+ ICP3c7/9wpiZfA4GDd81f+TUElupmJoyz4SUV5hXBzRcWjBGNAXezshSfcAE7h2RwDor qBLqmQHkYKVkgLxsGzIF+fPJujGDB5rtqVKcxcuwK4qg6PqQp/v8xzDCjNi/NQzLxEOu EXcw== X-Gm-Message-State: AOJu0Yzjrp93QUTbPsc3OhwV+DhU2XiGNlaSqVoTuxlx4Jd8E0+zQWU3 VrhsiQjszfOEyk2NZSaZtq/3u7HD73Smtw4c0gROijf+vdqYQd/vTVxA3MSoTmiofPgegXBd635 LuZGaowxsVHOxiQmHGBVl1ttuNYs= X-Gm-Gg: ASbGncvWsHVRLnpqBfU/rCrD46Ax/U8MHXXG137ibUivMbpz2JpG6q+WziIWhoTB8PH 7ysOOoWU3FkCYKwQKTvDnTedAog8aIj5qKxWHrnFyksws4e6n6a/jKHkv2+kmZRth X-Google-Smtp-Source: AGHT+IGYujv/6cx9dSTrUleqK5l1FJ13zBNP+wchDef2ursUcfsfisOfjHV87Yax/XTtfXXuzFGKAxkczHUKvPiKhRw= X-Received: by 2002:a05:6e02:2181:b0:3a7:dec1:de55 with SMTP id e9e14a558f8ab-3a811e90ea0mr74672125ab.22.1733621221857; Sat, 07 Dec 2024 17:27:01 -0800 (PST) List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-virtualization@freebsd.org Sender: owner-freebsd-virtualization@FreeBSD.org MIME-Version: 1.0 References: In-Reply-To: From: Kyle Taylor Date: Sat, 7 Dec 2024 18:26:50 -0700 Message-ID: Subject: Re: Struggle with bhyve and Kali. To: Zaphod Beeblebrox Cc: freebsd-virtualization@freebsd.org Content-Type: multipart/related; boundary="0000000000001abb990628b825bc" X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; TAGGED_FROM(0.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US] X-Rspamd-Queue-Id: 4Y5S5g1WSfz4fLB X-Spamd-Bar: ---- --0000000000001abb990628b825bc Content-Type: multipart/alternative; boundary="0000000000001abb980628b825bb" --0000000000001abb980628b825bb Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable This happens to me when working with Debian on Bhyve (which Kali is based on). Here's a description from the maintainer of the vm-bhyve port explaining what's going on : https://github.com/churchers/vm-bhyve/issues/336#issuecomment-573731049 . The fix is to rename the /boot entries so the Linux bootloader knows where to look for them back to their standard naming convention for UEFI. Here's an example : https://blog.tkrn.io/freenas-11-boot-failed-efi-misc-device-fix-debian/ . You can do this on the first boot. On Sat, Dec 7, 2024, 4:27=E2=80=AFPM Zaphod Beeblebrox = wrote: > So... I've installed kali a few times on bhyve. Lately on 14.1 that is > now 14.2 (no change there). The graphical install proceeds fine (using t= he > vm install command), and the first reboot (cd still attached) works fine. > > Subsequent reboots fail with this message: > > [image: image.png] > > ... which since Kali linux does install on hardware, seems to be Bhyve's > problem. > > Help? > --0000000000001abb980628b825bb Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable


On Sat, Dec 7, 2024, 4:27=E2=80= =AFPM Zaphod Beeblebrox <zbeeble@gm= ail.com> wrote:
So... I've installed kali a few times on bhyve.=C2=A0 Lately = on 14.1 that is now 14.2 (no change there).=C2=A0 The graphical install pro= ceeds fine (using the vm install command), and the first reboot (cd still a= ttached) works fine.

Subsequent reboots fail with = this message:

3D=

... = which since Kali linux does install on hardware, seems to be Bhyve's pr= oblem.

Help?
--0000000000001abb980628b825bb-- --0000000000001abb990628b825bc Content-Type: image/png; name="image.png" Content-Disposition: inline; filename="image.png" Content-Transfer-Encoding: base64 Content-ID: X-Attachment-Id: ii_m4et0i930 iVBORw0KGgoAAAANSUhEUgAAArkAAACMCAYAAAB4drGDAAASyklEQVR4Xu3dYXLcuBEG0N3b+ki+ bZKp3amwaADdDYLSiHipyh+TBNGvQfDTeFb++6+//vrP//7vfwQIECBAgAABAgQeI/C3kPuYXiqE AAECBAgQIEDgXwEh11IgQIAAAQIECBB4nICQ+7iWKogAAQIECBAgQEDItQYIECBAgAABAgQeJyDk Pq6lCiJAgAABAgQIEBByrQECBAgQIECAAIHHCQi5j2upgggQIECAAAECBIRca4AAAQIECBAgQOBx AkLu41qqIAIECBAgQIAAASHXGiBAgAABAgQIEHicgJD7uJYqiAABAgQIECBAQMi1BggQIECAAAEC BB4nIOQ+rqUKIkCAAAECBAgQEHKtAQIECBAgQIAAgccJCLmPa6mCCBAgQIAAAQIEhFxrgAABAgQI ECBA4HECQu7jWqogAgQIECBAgAABIdcaIECAAAECBAgQeJyAkPu4liqIAAECBAgQIEBAyLUGCBAg QIAAAQIEHicg5D6upQoiQIAAAQIECBAQcq0BAgQIECBAgACBxwkIuY9rqYIIECBAgAABAgSEXGuA AAECBAgQIEDgcQJC7uNaqiACBAgQIECAAAEh1xogQIAAAQIECBB4nICQ+7iWKogAAQIECBAgQEDI tQYIECBAgAABAgQeJyDkPq6lCiJAgAABAgQIEFgWcn///t3U/PXr1x9/fjy3dbw1UGv87LVf3ebz XFfOc8buXP/VMV7Xr6zpOL+rc8v0euYelfWdmcPonJFvNPerx1/zeo9R7fHxuvMYrTFb57dcXvPo +b/OHx3P1hDN72pPr17/k/a/Xq2j9VHxuXN/rcyjt28d/zy7/qL7fsr+06r5WGO0/1TqbI1b8czs L5Xxorn33rMrfY7783vvq8zrrv5U5vDV5y4Lua2X4+hlOfMiXbVJ3omceblH949souPR+KuCTOY+ M+esqC+678w9VvT2yryi9X/1+KoN9Bg63xt8JkRGvtHxFeu6FZrPL8KZtRP1PXM86m9mjMw5d9W3 Yv6ZNZCp8Y5zVs2t579q/FHt2d5Hz3N2nF5ojsbP9C/ympljdo+J5j977yt79NXn7+r1mZ7dcc6P DbnZxXYH2opN4soYVx6Q931nx5i9rtKHT71HtGlWauydm33Bndf/zKbaq+c9t+qnHKNNMJpf73l+ XRcF5auf+LReHO/5vkNv72W8oufZMb5i/d25r654SX7F3pDtx/m8Vf3J7gF3WGTHzNSaHWv07B+f v+8cr/r8r/Y5v7ere3Rm/61mkko/Zp+pFdcJuSsUD2N8ReNX3GN2jNnrKsyfeo/MxlWps3Vu9gV3 R8i9+gPQe07vT3Kj8Fn1zKyLzDkj99axati/ugayPwDN1nrX/DLjvn9oOf7wkrluxdqs3Gfm3Op6 rt7j7vGzP+BkA1Nlfa4eMzNeZX6VXmXunbXu/SAl5OY78uUh970AWk06H3udM3pRHhdTZmFF46/Y SEcPzqj2873PtR9bGgWh47m9v2qdfUjOS6v3faPq+Cvqq/qOjEdBqPfJYrS+Rsdbx47zi9b31eMZ //y28ueZ0fzOm34rBLVe8qu+StDz7+1BrbVzpf8Z2yjkZNbX6FPxYw++o74Zg9aefXTI7k/na2YC 0JX+ZPb/q+Nn1sdofx+9H6Pn++rxyrs5ej/O7t/R83GnT2t/rLy/rvpH12ee3e8655aQ2wtZo1Ca Qcw+5LPfCaw8SKMQlAl4mTDc+wQpY3V+KK4+JJFNdk6ZhZ4dq2o4Wn+VebXWdzTn6HjF9x0Ae/XM HP+kkNt7fqIQ2Vrzmb62no3WHnL3Syya62j/i9ZXtHdG/a+Of6UXPYdz/6MfcKLnvXX8HRzOoTfq zcx+mw1j53X3HftPZX209p/o/XPuRe/5G+35lT00ms9o/UZzyDwrUUbJjPFeq9W1eWd/MnP56nNu Cbmtn5SiTTZaONEm0toIqn9dugI/U0f0AojGiB6A1sMe+Wdrr2zMUR3Ry+xK/6J6Z+a2MmT01kDG dybEZl8i0drMrpPzeZk125rj6OX6dohewJk5Z+Y3eolG6yk6PjPHmRAXfZJbXZdXTDI1Z9ZRFG4y NR1D7fme2a+rtMbIeGdrPI9f2R+z6zuzTqOxeiHq2IdzQMvuT9H8Rsfv7k/2WbjqM7NHV31n+zPz TN99zceE3PMD8C48+3WFbMhtgWY3sUwzZh+yyot6tMn06otCX6a20cMVbXzZ8TMvpN5mUtnEos2y Nd9PCbmt+iP/6Hhl/VV6md34Mxt3pmeZczK9ra71aP+andeoL62Qu+L5r6yV1r57nsNX76+t+0U1 ZUPAaO1n9v6MRW+c0Q81lfoqz+SVZyV6T1VC+mjO2b3r7v5UXWd8ZvNLtD6y+Snq2cy74e5rPirk nouNglkldKx4yWSakdmgohd6NNfsgs2+IDN1RZvMzJx6982OVdn0o7WUMaist3OPZ2qKNu9R/bP3 j9Zmxmn2xTiz7qM9IzvfbH8qPlF/snPrPXuV8Svrv2IR7QvVGqPzZ4NKVJOQ+4989Az2zol8o/0o c300v2jus2unusfM1nLlea68K2b2k2xN0fP7HceF3IZ69LCMGiXk/v8f/5h1zD5QQu4//wBL5vtr WdPoRTK7SWXu3zun8le+d6+5ik/lpZVxrf6QNXrxVV/4kWt0PFNf5pzqvEchvNef15+PvpPdm+fs 3LIhqtr/aP1lnslsrZmxKvt16zmL1tiV49G1UYiMenjVJxo/mt/V+2euzzy/33HOx4TcDOKVhyQz /mhDzDbnk0Ju1StT4+jF8A5cVx2zvarUN3pBZOqONt1oztHxltmdL7VVL+RZu8gzc7x178rLaubF 0Au5UX+j4xnHynof+b3vtfI/bF1RX9Vg5Yv/bPsVITf7rujtp5UQm+1PNObMDw3ZZya699U9q3p9 tT+V/STzPqrON3rvrto/Zp6NzLN91znLQu4b8DzR6Fe4HINRa4zzpzjH8aPvh/QWUm+Mq8jn+ff+ 6993zaONp/ciGt1j5HfcaEY9yhgc7xP1N/MdtNbm0Kq/Ut/ov16dqX92fc/49HzPPRx99/D4XPV8 R+vzjmek+nwf10Dl2ZqZezUEXF2fUdDsBbhRbdHz0Qsbdzx/1fqq+855fUfro7f/9f4j6eqL/Or9 zwHl7NfaE6rvt8z6yOwx57n29rjq+3l071Hgu7que/atPTTT5zt9Wus4cs7s/zP7X/XdnnnG7zhn Wci9Y3LGJECAAAECBAgQIDAjIOTOqLmGAAECBAgQIEDgowWE3I9uj8kRIECAAAECBAjMCAi5M2qu IUCAAAECBAgQ+GgBIfej22NyBAgQIECAAAECMwJC7oyaawgQIECAAAECBD5aQMj96PaYHAECBAgQ IECAwIzAspAb/R67mckdr8n+HrfMfV5jVX/HW+/3pL7uVx0rM8fROaPfo3p1bNcTIECAAAECBJ4g sCzkvjDuDLqZX4adaciVOfZ++fZXh9y7rTOOziFAgAABAgQIfLLAjwy5709PZwLrzDXvBvY+TRZy P3mJmxsBAgQIECCwo8DSkHvnJ4ytf05vJrDOXDMKud+1aK7U8V1zdl8CBAgQIECAwFcJfEvInQlo mZA7+re5e9+prXwK2/q6Qu/f7X43sPVvo7d+GDiOPfrObeXfzv6qReQ+BAgQIECAAIFPE/hxIfcV GjOBt/ep8kzAPn+Se2xiL8Se75/5Pm90TisIV0L6py0+8yFAgAABAgQI3CXwLSF3ppheAHyNdQy+ rU9Woz/Lzmf0SW702x+iAJv9dHcUqrN1OI8AAQIECBAg8HQBIbfQ4dGnwEJuAdKpBAgQIECAAIGb BX5syD1/8hmFzLfjiq8rtL4iEN3fJ7k3r2TDEyBAgAABAgQOAktDbjZAZs87dqoaIs8hWMi17gkQ IECAAAEC+whsHXKrYdvXFfZ5MFRKgAABAgQI/GyBZSG3GhirbNEnucdPbo9jj75a8Dov+9sJMr+6 a/QrzM7za/3HctFXGlb8GrSqu/MJECBAgAABAj9RYFnI/YnFmzMBAgQIECBAgMAzBYTcZ/ZVVQQI ECBAgACBrQWE3K3br3gCBAgQIECAwDMFhNxn9lVVBAgQIECAAIGtBYTcrduveAIECBAgQIDAMwWE 3Gf2VVUECBAgQIAAga0FhNyt2694AgQIECBAgMAzBYTcZ/ZVVQQIECBAgACBrQWE3K3br3gCBAgQ IECAwDMFhNxn9lVVBAgQIECAAIGtBYTcrduveAIECBAgQIDAMwWE3Gf2VVUECBAgQIAAga0FhNyt 2694AgQIECBAgMAzBYTcZ/ZVVQQIECBAgACBrQWE3K3br3gCBAgQIECAwDMFhNxn9lVVBAgQIECA AIGtBYTcrduveAIECBAgQIDAMwWE3Gf2VVUECBAgQIAAga0FhNyt2694AgQIECBAgMAzBYTcZ/ZV VQQIECBAgACBrQWE3K3br3gCBAgQIECAwDMFhNxn9lVVBAgQIECAAIGtBYTcrduveAIECBAgQIDA MwWE3Gf2VVUECBAgQIAAga0FhNyt2694AgQIECBAgMAzBYTcZ/ZVVQQIECBAgACBrQU+KuT+/v37 j2b8+vXrjz97ndf681WdnBm/NffXfN7zfB8/zvv4Z73rj2Osqu87xsn6nOc20+fjvWau/w4f9yRA gAABAgTWCiwLua0Qd5zqzPEoGK6l+Ge0aJ6je56vbYXYXsht3fvKXO6wWTHmqKaRX+XeQm5Fy7kE CBAgQOCZAstCbiYgVgJOb7y7g9+V8VeH3LfBkz6NrKyBmV6cPzF+kt0ztyBVESBAgACBewSWhtwr QTf7qe1M8KnQXRk/+iSy+sluZd4/5Vwh96d0yjwJECBAgMDPFlgeclcH3Tdv9J3O433f12S+/3r+ zuy5nZVPAleG3FXfC+59J3j0Q8XRoHX9la8DzIbcyPa87q78sPKzH2mzJ0CAAAECBF4Ct4TcFUH3 NUbvPzrrHTu2NPPJcOacyjKpBLFWDVf+qj2qJZpbdH2rpzNBUsitrCjnEiBAgAABArMCt4XcK0F3 dG02WGVCWwstO/7o2uOx6NPk0fErnyKfDe8IuTOLLhNyW37V+V/p40xdriFAgAABAgQ+S+C2kBuF jOh4L+jOhqRM6M6e02thVNOd38mNQn02JLZqG/0atOpyzvQv8wl+r57R/KtzdT4BAgQIECDwcwVu CbmVsDeii4Lb8dooxGUDbDT36nzf52dqWX3vUajOeJ1rvTK/kcPMsWgu0fGf+8iaOQECBAgQIJAR WB5yo3DRO54JgaOgmglt0dyyQXjmk9xMfb1zMl9biMaPfO62mQmy1R9iRudnj2UeGucQIECAAAEC ny+wNORGQan6V9WV4BaFuGyAjb5S8JWf5EaeUXCL/kp/9A9TtLwq81n1g0CrxvefjcJ/da19/qNq hgQIECBAgEBFYFnIjQJQdPwYqo4FjL6f+TqvFdTef94KrJWAdB4/E3B742cDe+semU9ys36Z8Nfy f1+X8WvVcL7+PE52/Jl1lPWrPDjOJUCAAAECBD5bYFnI/ewyzY4AAQIECBAgQGAnASF3p26rlQAB AgQIECCwiYCQu0mjlUmAAAECBAgQ2ElAyN2p22olQIAAAQIECGwiIORu0mhlEiBAgAABAgR2EhBy d+q2WgkQIECAAAECmwgIuZs0WpkECBAgQIAAgZ0EhNyduq1WAgQIECBAgMAmAkLuJo1WJgECBAgQ IEBgJwEhd6duq5UAAQIECBAgsImAkLtJo5VJgAABAgQIENhJQMjdqdtqJUCAAAECBAhsIiDkbtJo ZRIgQIAAAQIEdhIQcnfqtloJECBAgAABApsICLmbNFqZBAgQIECAAIGdBITcnbqtVgIECBAgQIDA JgJC7iaNViYBAgQIECBAYCcBIXenbquVAAECBAgQILCJgJC7SaOVSYAAAQIECBDYSUDI3anbaiVA gAABAgQIbCIg5G7SaGUSIECAAAECBHYSEHJ36rZaCRAgQIAAAQKbCAi5mzRamQQIECBAgACBnQSE 3J26rVYCBAgQIECAwCYCQu4mjVYmAQIECBAgQGAnASF3p26rlQABAgQIECCwiYCQu0mjlUmAAAEC BAgQ2ElAyN2p22olQIAAAQIECGwiIORu0mhlEiBAgAABAgR2EhByd+q2WgkQIECAAAECmwgIuZs0 WpkECBAgQIAAgZ0EhNyduq1WAgQIECBAgMAmAkLuJo1WJgECBAgQIEBgJwEhd6duq5UAAQIECBAg sImAkLtJo5VJgAABAgQIENhJQMjdqdtqJUCAAAECBAhsIiDkbtJoZRIgQIAAAQIEdhIQcnfqtloJ ECBAgAABApsICLmbNFqZBAgQIECAAIGdBITcnbqtVgIECBAgQIDAJgJC7iaNViYBAgQIECBAYCeB /wIkY3kABrJz8AAAAABJRU5ErkJggg== --0000000000001abb990628b825bc-- From nobody Sun Dec 8 04:27:53 2024 X-Original-To: freebsd-virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Y5X6c4xG9z5g2pg for ; Sun, 08 Dec 2024 04:28:08 +0000 (UTC) (envelope-from zbeeble@gmail.com) Received: from mail-pj1-x1031.google.com (mail-pj1-x1031.google.com [IPv6:2607:f8b0:4864:20::1031]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "WR4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Y5X6b2vtLz3yB2 for ; Sun, 8 Dec 2024 04:28:07 +0000 (UTC) (envelope-from zbeeble@gmail.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20230601 header.b=gDZGpYzH; spf=pass (mx1.freebsd.org: domain of zbeeble@gmail.com designates 2607:f8b0:4864:20::1031 as permitted sender) smtp.mailfrom=zbeeble@gmail.com; dmarc=pass (policy=none) header.from=gmail.com Received: by mail-pj1-x1031.google.com with SMTP id 98e67ed59e1d1-2ee8647dbb9so2736391a91.2 for ; Sat, 07 Dec 2024 20:28:07 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1733632086; x=1734236886; darn=freebsd.org; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=Bto2d/Yy9QDsU2TpKq8KzlJncX7zfIWldGiuQK2L8cQ=; b=gDZGpYzHI3+webOkF94ylEDUEDAV5g5BxhMdXyB2P3gAleIG5eZmGmXhFGbhM/CkrH oGDm3f1mqR0nh4HDXdt9r1O2LsAu3H90EqQ/8QRfrkzPoXTMdtqQx/J1fOuc4EYtg1HY twwSwaCCkpkzYp+hfN8hyp2KKWjbzsfagUG/JIS+NZfuxyEcRBqDXO4AoCuNtb5trf6x I9AyrH2J/7MwwjQnMs6+4XpyCE0ubhHUcCmMk3p4gqeaRYWQrvRCfCsSBjZaNOKvPdQD 11BSI126/ONja2QSOYzmLDvhNLUzY36+NcIZIsufru/PqMV+5Y0kWRsvvk0PzjMWsv6y /vpw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1733632086; x=1734236886; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=Bto2d/Yy9QDsU2TpKq8KzlJncX7zfIWldGiuQK2L8cQ=; b=ZwLCfq55tSi2p5Y07DJ/XqOGjc10UlR2OGHJ58s0k4YUIPDJCpQKyvKwTbrAvEwuRf 79Ik/Dd1Izw6zkKWKuZL90Fbw0DkYAo3CdCdnpl9qxogQPOstFpYQDXoOIQCuEA4O1Xu NIbryeEN/f+gJp4R/Ezef4JMQAzgsuqNF+LuJvXf8DuKOuCDp5CAgOM7GlJ4mrirmcpx 3219tZ1v/xNguSG3Z63bMmvR5zpsHWPXL3dUXkRMOk7MJ0xZlS7o6B2RQ4YzJuWDhWV4 sWE8MBQiTecwYd2H3cUHWOb2b5Qp3wwn+6NmxSanoqPl5S81lBHtM7kfK5IrHVz82IwU b0Rg== X-Gm-Message-State: AOJu0YwnMS3Mf9zY3TVQWce8fPGXK830CWWTbysXeiKfCq3QtONqzo5m XgjQOmsGY4+a2XBpatS7VDd+5+uckQIRS9XJnDAQaLkGQiHbFAWpbelbayo1+oPgCopqIBcOMQq +OPu7cpNMwW/GEbBajOTj8msuTAlY X-Gm-Gg: ASbGnctwpilJkSYE1szzgf2FHst2lQBXpn9JNtnxKR+/STPw678hkRx2IO+aYerCOC1 NF4hyfQnowSkwo3VG4mI1zxswCeS3HrI+GaWYjyV6GFhP0FzvmS2jczIz X-Google-Smtp-Source: AGHT+IGd2C7pzoAnkXXVZ4PxAr8gZV4uyb0ZllhcLnTikVUnTH+u/IhuLIWCPnn8qUavvLVgvpXHByFMkP2QLpmHfWA= X-Received: by 2002:a17:90a:c88f:b0:2ee:dd9b:e402 with SMTP id 98e67ed59e1d1-2ef69f0b077mr14089080a91.12.1733632085863; Sat, 07 Dec 2024 20:28:05 -0800 (PST) List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-virtualization@freebsd.org Sender: owner-freebsd-virtualization@FreeBSD.org MIME-Version: 1.0 References: In-Reply-To: From: Zaphod Beeblebrox Date: Sat, 7 Dec 2024 23:27:53 -0500 Message-ID: Subject: Re: Struggle with bhyve and Kali. To: Kyle Taylor Cc: freebsd-virtualization@freebsd.org Content-Type: multipart/related; boundary="000000000000a6546b0628baaceb" X-Spamd-Result: default: False [-4.00 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.999]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20230601]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; MIME_GOOD(-0.10)[multipart/related,multipart/alternative,text/plain]; RCPT_COUNT_TWO(0.00)[2]; RCVD_TLS_LAST(0.00)[]; FREEMAIL_TO(0.00)[gmail.com]; ARC_NA(0.00)[]; TO_DN_SOME(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:+,3:~,4:~]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; FREEMAIL_FROM(0.00)[gmail.com]; DKIM_TRACE(0.00)[gmail.com:+]; FROM_HAS_DN(0.00)[]; FREEMAIL_ENVFROM(0.00)[gmail.com]; PREVIOUSLY_DELIVERED(0.00)[freebsd-virtualization@freebsd.org]; TO_MATCH_ENVRCPT_SOME(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; MISSING_XM_UA(0.00)[]; MID_RHS_MATCH_FROMTLD(0.00)[]; TAGGED_RCPT(0.00)[]; MLMMJ_DEST(0.00)[freebsd-virtualization@freebsd.org]; RCVD_COUNT_ONE(0.00)[1]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::1031:from] X-Rspamd-Queue-Id: 4Y5X6b2vtLz3yB2 X-Spamd-Bar: --- --000000000000a6546b0628baaceb Content-Type: multipart/alternative; boundary="000000000000a6546a0628baacea" --000000000000a6546a0628baacea Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Is a bug filed to mark this yet? On Sat, Dec 7, 2024 at 8:27=E2=80=AFPM Kyle Taylor wrote: > This happens to me when working with Debian on Bhyve (which Kali is based > on). Here's a description from the maintainer of the vm-bhyve port > explaining what's going on : > https://github.com/churchers/vm-bhyve/issues/336#issuecomment-573731049 . > > The fix is to rename the /boot entries so the Linux bootloader knows wher= e > to look for them back to their standard naming convention for UEFI. Here'= s > an example : > https://blog.tkrn.io/freenas-11-boot-failed-efi-misc-device-fix-debian/ . > You can do this on the first boot. > > > On Sat, Dec 7, 2024, 4:27=E2=80=AFPM Zaphod Beeblebrox wrote: > >> So... I've installed kali a few times on bhyve. Lately on 14.1 that is >> now 14.2 (no change there). The graphical install proceeds fine (using = the >> vm install command), and the first reboot (cd still attached) works fine= . >> >> Subsequent reboots fail with this message: >> >> [image: image.png] >> >> ... which since Kali linux does install on hardware, seems to be Bhyve's >> problem. >> >> Help? >> > --000000000000a6546a0628baacea Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
Is a bug filed to mark this yet?

On Sat, Dec 7, 2024 at 8:27=E2=80=AFPM Kyle Taylor <kyle.a.taylor@gmail.com> wrote:
This= happens to me when working with Debian on Bhyve (which Kali is based on). = Here's a description from the maintainer of the vm-bhyve port explainin= g what's going on : https://github.com/churc= hers/vm-bhyve/issues/336#issuecomment-573731049 .

The fix is to = rename the /boot entries so the Linux bootloader knows where to look for th= em back to their standard naming convention for UEFI. Here's an example= : https://blog.tkrn.io/freenas-11-boot-failed-e= fi-misc-device-fix-debian/ . You can do this on the first boot.


On Sat, Dec 7, 2024, 4:2= 7=E2=80=AFPM Zaphod Beeblebrox <zbeeble@gmail.com> wrote:
So... I've insta= lled kali a few times on bhyve.=C2=A0 Lately on 14.1 that is now 14.2 (no c= hange there).=C2=A0 The graphical install proceeds fine (using the vm insta= ll command), and the first reboot (cd still attached) works fine.

Subsequent reboots fail with this message:

3D"image.png"

... which since Kali linux does in= stall on hardware, seems to be Bhyve's problem.

Help?
--000000000000a6546a0628baacea-- --000000000000a6546b0628baaceb Content-Type: image/png; name="image.png" Content-Disposition: inline; filename="image.png" Content-Transfer-Encoding: base64 Content-ID: X-Attachment-Id: ii_m4et0i930 iVBORw0KGgoAAAANSUhEUgAAArkAAACMCAYAAAB4drGDAAASyklEQVR4Xu3dYXLcuBEG0N3b+ki+ bZKp3amwaADdDYLSiHipyh+TBNGvQfDTeFb++6+//vrP//7vfwQIECBAgAABAgQeI/C3kPuYXiqE AAECBAgQIEDgXwEh11IgQIAAAQIECBB4nICQ+7iWKogAAQIECBAgQEDItQYIECBAgAABAgQeJyDk Pq6lCiJAgAABAgQIEBByrQECBAgQIECAAIHHCQi5j2upgggQIECAAAECBIRca4AAAQIECBAgQOBx AkLu41qqIAIECBAgQIAAASHXGiBAgAABAgQIEHicgJD7uJYqiAABAgQIECBAQMi1BggQIECAAAEC BB4nIOQ+rqUKIkCAAAECBAgQEHKtAQIECBAgQIAAgccJCLmPa6mCCBAgQIAAAQIEhFxrgAABAgQI ECBA4HECQu7jWqogAgQIECBAgAABIdcaIECAAAECBAgQeJyAkPu4liqIAAECBAgQIEBAyLUGCBAg QIAAAQIEHicg5D6upQoiQIAAAQIECBAQcq0BAgQIECBAgACBxwkIuY9rqYIIECBAgAABAgSEXGuA AAECBAgQIEDgcQJC7uNaqiACBAgQIECAAAEh1xogQIAAAQIECBB4nICQ+7iWKogAAQIECBAgQEDI tQYIECBAgAABAgQeJyDkPq6lCiJAgAABAgQIEFgWcn///t3U/PXr1x9/fjy3dbw1UGv87LVf3ebz XFfOc8buXP/VMV7Xr6zpOL+rc8v0euYelfWdmcPonJFvNPerx1/zeo9R7fHxuvMYrTFb57dcXvPo +b/OHx3P1hDN72pPr17/k/a/Xq2j9VHxuXN/rcyjt28d/zy7/qL7fsr+06r5WGO0/1TqbI1b8czs L5Xxorn33rMrfY7783vvq8zrrv5U5vDV5y4Lua2X4+hlOfMiXbVJ3omceblH949souPR+KuCTOY+ M+esqC+678w9VvT2yryi9X/1+KoN9Bg63xt8JkRGvtHxFeu6FZrPL8KZtRP1PXM86m9mjMw5d9W3 Yv6ZNZCp8Y5zVs2t579q/FHt2d5Hz3N2nF5ojsbP9C/ympljdo+J5j977yt79NXn7+r1mZ7dcc6P DbnZxXYH2opN4soYVx6Q931nx5i9rtKHT71HtGlWauydm33Bndf/zKbaq+c9t+qnHKNNMJpf73l+ XRcF5auf+LReHO/5vkNv72W8oufZMb5i/d25r654SX7F3pDtx/m8Vf3J7gF3WGTHzNSaHWv07B+f v+8cr/r8r/Y5v7ere3Rm/61mkko/Zp+pFdcJuSsUD2N8ReNX3GN2jNnrKsyfeo/MxlWps3Vu9gV3 R8i9+gPQe07vT3Kj8Fn1zKyLzDkj99axati/ugayPwDN1nrX/DLjvn9oOf7wkrluxdqs3Gfm3Op6 rt7j7vGzP+BkA1Nlfa4eMzNeZX6VXmXunbXu/SAl5OY78uUh970AWk06H3udM3pRHhdTZmFF46/Y SEcPzqj2873PtR9bGgWh47m9v2qdfUjOS6v3faPq+Cvqq/qOjEdBqPfJYrS+Rsdbx47zi9b31eMZ //y28ueZ0fzOm34rBLVe8qu+StDz7+1BrbVzpf8Z2yjkZNbX6FPxYw++o74Zg9aefXTI7k/na2YC 0JX+ZPb/q+Nn1sdofx+9H6Pn++rxyrs5ej/O7t/R83GnT2t/rLy/rvpH12ee3e8655aQ2wtZo1Ca Qcw+5LPfCaw8SKMQlAl4mTDc+wQpY3V+KK4+JJFNdk6ZhZ4dq2o4Wn+VebXWdzTn6HjF9x0Ae/XM HP+kkNt7fqIQ2Vrzmb62no3WHnL3Syya62j/i9ZXtHdG/a+Of6UXPYdz/6MfcKLnvXX8HRzOoTfq zcx+mw1j53X3HftPZX209p/o/XPuRe/5G+35lT00ms9o/UZzyDwrUUbJjPFeq9W1eWd/MnP56nNu Cbmtn5SiTTZaONEm0toIqn9dugI/U0f0AojGiB6A1sMe+Wdrr2zMUR3Ry+xK/6J6Z+a2MmT01kDG dybEZl8i0drMrpPzeZk125rj6OX6dohewJk5Z+Y3eolG6yk6PjPHmRAXfZJbXZdXTDI1Z9ZRFG4y NR1D7fme2a+rtMbIeGdrPI9f2R+z6zuzTqOxeiHq2IdzQMvuT9H8Rsfv7k/2WbjqM7NHV31n+zPz TN99zceE3PMD8C48+3WFbMhtgWY3sUwzZh+yyot6tMn06otCX6a20cMVbXzZ8TMvpN5mUtnEos2y Nd9PCbmt+iP/6Hhl/VV6md34Mxt3pmeZczK9ra71aP+andeoL62Qu+L5r6yV1r57nsNX76+t+0U1 ZUPAaO1n9v6MRW+c0Q81lfoqz+SVZyV6T1VC+mjO2b3r7v5UXWd8ZvNLtD6y+Snq2cy74e5rPirk nouNglkldKx4yWSakdmgohd6NNfsgs2+IDN1RZvMzJx6982OVdn0o7WUMaist3OPZ2qKNu9R/bP3 j9Zmxmn2xTiz7qM9IzvfbH8qPlF/snPrPXuV8Svrv2IR7QvVGqPzZ4NKVJOQ+4989Az2zol8o/0o c300v2jus2unusfM1nLlea68K2b2k2xN0fP7HceF3IZ69LCMGiXk/v8f/5h1zD5QQu4//wBL5vtr WdPoRTK7SWXu3zun8le+d6+5ik/lpZVxrf6QNXrxVV/4kWt0PFNf5pzqvEchvNef15+PvpPdm+fs 3LIhqtr/aP1lnslsrZmxKvt16zmL1tiV49G1UYiMenjVJxo/mt/V+2euzzy/33HOx4TcDOKVhyQz /mhDzDbnk0Ju1StT4+jF8A5cVx2zvarUN3pBZOqONt1oztHxltmdL7VVL+RZu8gzc7x178rLaubF 0Au5UX+j4xnHynof+b3vtfI/bF1RX9Vg5Yv/bPsVITf7rujtp5UQm+1PNObMDw3ZZya699U9q3p9 tT+V/STzPqrON3rvrto/Zp6NzLN91znLQu4b8DzR6Fe4HINRa4zzpzjH8aPvh/QWUm+Mq8jn+ff+ 6993zaONp/ciGt1j5HfcaEY9yhgc7xP1N/MdtNbm0Kq/Ut/ov16dqX92fc/49HzPPRx99/D4XPV8 R+vzjmek+nwf10Dl2ZqZezUEXF2fUdDsBbhRbdHz0Qsbdzx/1fqq+855fUfro7f/9f4j6eqL/Or9 zwHl7NfaE6rvt8z6yOwx57n29rjq+3l071Hgu7que/atPTTT5zt9Wus4cs7s/zP7X/XdnnnG7zhn Wci9Y3LGJECAAAECBAgQIDAjIOTOqLmGAAECBAgQIEDgowWE3I9uj8kRIECAAAECBAjMCAi5M2qu IUCAAAECBAgQ+GgBIfej22NyBAgQIECAAAECMwJC7oyaawgQIECAAAECBD5aQMj96PaYHAECBAgQ IECAwIzAspAb/R67mckdr8n+HrfMfV5jVX/HW+/3pL7uVx0rM8fROaPfo3p1bNcTIECAAAECBJ4g sCzkvjDuDLqZX4adaciVOfZ++fZXh9y7rTOOziFAgAABAgQIfLLAjwy5709PZwLrzDXvBvY+TRZy P3mJmxsBAgQIECCwo8DSkHvnJ4ytf05vJrDOXDMKud+1aK7U8V1zdl8CBAgQIECAwFcJfEvInQlo mZA7+re5e9+prXwK2/q6Qu/f7X43sPVvo7d+GDiOPfrObeXfzv6qReQ+BAgQIECAAIFPE/hxIfcV GjOBt/ep8kzAPn+Se2xiL8Se75/5Pm90TisIV0L6py0+8yFAgAABAgQI3CXwLSF3ppheAHyNdQy+ rU9Woz/Lzmf0SW702x+iAJv9dHcUqrN1OI8AAQIECBAg8HQBIbfQ4dGnwEJuAdKpBAgQIECAAIGb BX5syD1/8hmFzLfjiq8rtL4iEN3fJ7k3r2TDEyBAgAABAgQOAktDbjZAZs87dqoaIs8hWMi17gkQ IECAAAEC+whsHXKrYdvXFfZ5MFRKgAABAgQI/GyBZSG3GhirbNEnucdPbo9jj75a8Dov+9sJMr+6 a/QrzM7za/3HctFXGlb8GrSqu/MJECBAgAABAj9RYFnI/YnFmzMBAgQIECBAgMAzBYTcZ/ZVVQQI ECBAgACBrQWE3K3br3gCBAgQIECAwDMFhNxn9lVVBAgQIECAAIGtBYTcrduveAIECBAgQIDAMwWE 3Gf2VVUECBAgQIAAga0FhNyt2694AgQIECBAgMAzBYTcZ/ZVVQQIECBAgACBrQWE3K3br3gCBAgQ IECAwDMFhNxn9lVVBAgQIECAAIGtBYTcrduveAIECBAgQIDAMwWE3Gf2VVUECBAgQIAAga0FhNyt 2694AgQIECBAgMAzBYTcZ/ZVVQQIECBAgACBrQWE3K3br3gCBAgQIECAwDMFhNxn9lVVBAgQIECA AIGtBYTcrduveAIECBAgQIDAMwWE3Gf2VVUECBAgQIAAga0FhNyt2694AgQIECBAgMAzBYTcZ/ZV VQQIECBAgACBrQWE3K3br3gCBAgQIECAwDMFhNxn9lVVBAgQIECAAIGtBYTcrduveAIECBAgQIDA MwWE3Gf2VVUECBAgQIAAga0FhNyt2694AgQIECBAgMAzBYTcZ/ZVVQQIECBAgACBrQU+KuT+/v37 j2b8+vXrjz97ndf681WdnBm/NffXfN7zfB8/zvv4Z73rj2Osqu87xsn6nOc20+fjvWau/w4f9yRA gAABAgTWCiwLua0Qd5zqzPEoGK6l+Ge0aJ6je56vbYXYXsht3fvKXO6wWTHmqKaRX+XeQm5Fy7kE CBAgQOCZAstCbiYgVgJOb7y7g9+V8VeH3LfBkz6NrKyBmV6cPzF+kt0ztyBVESBAgACBewSWhtwr QTf7qe1M8KnQXRk/+iSy+sluZd4/5Vwh96d0yjwJECBAgMDPFlgeclcH3Tdv9J3O433f12S+/3r+ zuy5nZVPAleG3FXfC+59J3j0Q8XRoHX9la8DzIbcyPa87q78sPKzH2mzJ0CAAAECBF4Ct4TcFUH3 NUbvPzrrHTu2NPPJcOacyjKpBLFWDVf+qj2qJZpbdH2rpzNBUsitrCjnEiBAgAABArMCt4XcK0F3 dG02WGVCWwstO/7o2uOx6NPk0fErnyKfDe8IuTOLLhNyW37V+V/p40xdriFAgAABAgQ+S+C2kBuF jOh4L+jOhqRM6M6e02thVNOd38mNQn02JLZqG/0atOpyzvQv8wl+r57R/KtzdT4BAgQIECDwcwVu CbmVsDeii4Lb8dooxGUDbDT36nzf52dqWX3vUajOeJ1rvTK/kcPMsWgu0fGf+8iaOQECBAgQIJAR WB5yo3DRO54JgaOgmglt0dyyQXjmk9xMfb1zMl9biMaPfO62mQmy1R9iRudnj2UeGucQIECAAAEC ny+wNORGQan6V9WV4BaFuGyAjb5S8JWf5EaeUXCL/kp/9A9TtLwq81n1g0CrxvefjcJ/da19/qNq hgQIECBAgEBFYFnIjQJQdPwYqo4FjL6f+TqvFdTef94KrJWAdB4/E3B742cDe+semU9ys36Z8Nfy f1+X8WvVcL7+PE52/Jl1lPWrPDjOJUCAAAECBD5bYFnI/ewyzY4AAQIECBAgQGAnASF3p26rlQAB AgQIECCwiYCQu0mjlUmAAAECBAgQ2ElAyN2p22olQIAAAQIECGwiIORu0mhlEiBAgAABAgR2EhBy d+q2WgkQIECAAAECmwgIuZs0WpkECBAgQIAAgZ0EhNyduq1WAgQIECBAgMAmAkLuJo1WJgECBAgQ IEBgJwEhd6duq5UAAQIECBAgsImAkLtJo5VJgAABAgQIENhJQMjdqdtqJUCAAAECBAhsIiDkbtJo ZRIgQIAAAQIEdhIQcnfqtloJECBAgAABApsICLmbNFqZBAgQIECAAIGdBITcnbqtVgIECBAgQIDA JgJC7iaNViYBAgQIECBAYCcBIXenbquVAAECBAgQILCJgJC7SaOVSYAAAQIECBDYSUDI3anbaiVA gAABAgQIbCIg5G7SaGUSIECAAAECBHYSEHJ36rZaCRAgQIAAAQKbCAi5mzRamQQIECBAgACBnQSE 3J26rVYCBAgQIECAwCYCQu4mjVYmAQIECBAgQGAnASF3p26rlQABAgQIECCwiYCQu0mjlUmAAAEC BAgQ2ElAyN2p22olQIAAAQIECGwiIORu0mhlEiBAgAABAgR2EhByd+q2WgkQIECAAAECmwgIuZs0 WpkECBAgQIAAgZ0EhNyduq1WAgQIECBAgMAmAkLuJo1WJgECBAgQIEBgJwEhd6duq5UAAQIECBAg sImAkLtJo5VJgAABAgQIENhJQMjdqdtqJUCAAAECBAhsIiDkbtJoZRIgQIAAAQIEdhIQcnfqtloJ ECBAgAABApsICLmbNFqZBAgQIECAAIGdBITcnbqtVgIECBAgQIDAJgJC7iaNViYBAgQIECBAYCeB /wIkY3kABrJz8AAAAABJRU5ErkJggg== --000000000000a6546b0628baaceb-- From nobody Sun Dec 8 04:37:19 2024 X-Original-To: freebsd-virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Y5XKV1bZ6z5g3Jn for ; Sun, 08 Dec 2024 04:37:34 +0000 (UTC) (envelope-from zbeeble@gmail.com) Received: from mail-pl1-x630.google.com (mail-pl1-x630.google.com [IPv6:2607:f8b0:4864:20::630]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "WR4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Y5XKT6Nm9z40yX for ; Sun, 8 Dec 2024 04:37:33 +0000 (UTC) (envelope-from zbeeble@gmail.com) Authentication-Results: mx1.freebsd.org; none Received: by mail-pl1-x630.google.com with SMTP id d9443c01a7336-215a7e487bfso27960005ad.2 for ; Sat, 07 Dec 2024 20:37:33 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1733632652; x=1734237452; darn=freebsd.org; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=VVf+/kmpa/vxk/FjlL5RoCwP9q4o1IJyVl3AkJIW6yc=; b=ZJ7WjQzdXjgxMtQ9nEJeEV8p3pegJhzeylwiGUA2p5BUVZDQc2tE8N1RE/WTaPN37K m5H07RPd4WYRE3PY7/adMBO/wiEJGrlEsSe6yY5PRAAP2BcXT+Bg/meViiZ3qF9Iaf/g Wpcc5uHqDNhoYVQ9mQ6NlLpRE7yQvnUVHee+IO7FWDrd65OUjGHOHpj6vqBNCzUdnTXJ 2JYSWcNaHtaM16Z9Q2ZN1CfZL1sKN9zoRi9fam9n+61GHk/M+kjBwMEiDf5uefhht/2x 7b8/kHoBFnFFf6bvUe8T1Sn+1g4g0laKsNj/p4+4G2kWqAx4hMMbrAf0Uj9K5Y16SnVN q+ZA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1733632652; x=1734237452; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=VVf+/kmpa/vxk/FjlL5RoCwP9q4o1IJyVl3AkJIW6yc=; b=MqJFpuHUxACCOGEeg+qNWm/5sKvvZxE7z4+DWUDuEtGsqErWYO8Qg1Ine11jJpeNfT tuLXXA8/AxSdRD69kg4ATbttILoUyuIPCIJinvDy7icVWdNY1eAH/n8Qo4arcxfKnVQc Or8s7exVxbSB/SHSrleHZ5pupqqBpTFtqvP0mx5uYXvN/HJGQ1L+6iON2BgDClV+LXA8 KO31al0nLvucJOP5s8tQVt7d92+wzoPyH//4AxYtq79osUGqXGWbD0h2YEYwsAJbzmoD fw6PkUl0iWiKfVJKrumYfYjZSpHeeb4lMliMGsw9hOp1LiRhkfzKfNPPU50II2CC+PBp Sedw== X-Gm-Message-State: AOJu0YxDsXaC68WOM+NJ166/2JQ3S6ZZ51aXVXG2t4KxMMTVeUyqxaT/ JWRocdIWoEnmh4WzjD0NCCgZLSZlkXMBm7DaV6dBQKMdYoApn+vXMJNiF9Qq/lQIRQXnRIoQf7n QvpGTmodrhqh6EEma7EDRX3EBhQVx X-Gm-Gg: ASbGncvO4xPCjox9qUcUWaiOpwMg7aqDejaOmoVVkVlhg71g8jwtW4TVllF3IaP9sXS wBcHaHR7cdP2hceusUJmJjsOE2+TkTucEWh0+R9mmq2jEADKisFtXTFwv X-Google-Smtp-Source: AGHT+IExw5Kkk1ESIxL0AZjb165qOvfda/DrewvHW6rOoBvgPqsKSL4/Awo/2cENotlFltNw2JwMhMzKYooS0ptsYQo= X-Received: by 2002:a17:903:2349:b0:202:cbf:2d6f with SMTP id d9443c01a7336-21614e05ea8mr107401065ad.57.1733632651742; Sat, 07 Dec 2024 20:37:31 -0800 (PST) List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-virtualization@freebsd.org Sender: owner-freebsd-virtualization@FreeBSD.org MIME-Version: 1.0 References: <6B19A54E-78B2-4BDA-94FA-F7558F26DA87@iitbombay.org> In-Reply-To: <6B19A54E-78B2-4BDA-94FA-F7558F26DA87@iitbombay.org> From: Zaphod Beeblebrox Date: Sat, 7 Dec 2024 23:37:19 -0500 Message-ID: Subject: Re: Struggle with bhyve and Kali. To: Bakul Shah Cc: freebsd-virtualization@freebsd.org Content-Type: multipart/alternative; boundary="00000000000060d89e0628baced6" X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US] X-Rspamd-Queue-Id: 4Y5XKT6Nm9z40yX X-Spamd-Bar: ---- --00000000000060d89e0628baced6 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable That doesn't seem to help for kali. I found the binary, and I think it boots... but it goes from the 1080p that I select for it down to some 4x3 resolution that is tiny. Then I think X is up, but I don't get a login or any other response to input other than a mouse cursor. Really, this should be documented (the uefi boot variables thing). I suppose I'll keep messing with it --- maybe booting with the full resolution and the correct file will work --- which will likely require me to mount the efi partition on the host and mess around. On Sat, Dec 7, 2024 at 7:23=E2=80=AFPM Bakul Shah wro= te: > This may help: > > https://record99.blogspot.com/2021/12/bdsdex-failed-to-load-boot0001-uefi= -bhyve-sata-disk.html > > > > On Dec 7, 2024, at 3:27=E2=80=AFPM, Zaphod Beeblebrox wrote: > > > > So... I've installed kali a few times on bhyve. Lately on 14.1 that is > now 14.2 (no change there). The graphical install proceeds fine (using t= he > vm install command), and the first reboot (cd still attached) works fine. > > > > Subsequent reboots fail with this message: > > > > > > > > ... which since Kali linux does install on hardware, seems to be Bhyve'= s > problem. > > > > Help? > > --00000000000060d89e0628baced6 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
That doesn't seem to help for kali.=C2=A0 I found= the binary, and I think it boots... but it goes from the 1080p that I sele= ct for it down to some 4x3 resolution that is tiny.=C2=A0 Then I think X is= up, but I don't get a login or any other response to input other than = a mouse cursor.

Really, this should be documented = (the uefi boot variables thing).=C2=A0 I suppose I'll keep messing with= it --- maybe booting with the full resolution and the correct file will wo= rk --- which will likely require me to mount the efi partition on the host = and mess around.

On Sat, Dec 7, 2024 at 7:23= =E2=80=AFPM Bakul Shah <bakul@iit= bombay.org> wrote:
This may help:
https:= //record99.blogspot.com/2021/12/bdsdex-failed-to-load-boot0001-uefi-bhyve-s= ata-disk.html


> On Dec 7, 2024, at 3:27=E2=80=AFPM, Zaphod Beeblebrox <zbeeble@gmail.com> wrote:=
>
> So... I've installed kali a few times on bhyve.=C2=A0 Lately on 14= .1 that is now 14.2 (no change there).=C2=A0 The graphical install proceeds= fine (using the vm install command), and the first reboot (cd still attach= ed) works fine.
>
> Subsequent reboots fail with this message:
>
> <image.png>
>
> ... which since Kali linux does install on hardware, seems to be Bhyve= 's problem.
>
> Help?

--00000000000060d89e0628baced6-- From nobody Sun Dec 8 06:38:26 2024 X-Original-To: freebsd-virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Y5b1C5bVNz5gCB6 for ; Sun, 08 Dec 2024 06:38:39 +0000 (UTC) (envelope-from bakul@iitbombay.org) Received: from mail-pj1-x102c.google.com (mail-pj1-x102c.google.com [IPv6:2607:f8b0:4864:20::102c]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "WR4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Y5b1C3x19z4CB8 for ; Sun, 8 Dec 2024 06:38:39 +0000 (UTC) (envelope-from bakul@iitbombay.org) Authentication-Results: mx1.freebsd.org; none Received: by mail-pj1-x102c.google.com with SMTP id 98e67ed59e1d1-2ee94a2d8d0so526072a91.2 for ; Sat, 07 Dec 2024 22:38:39 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=iitbombay.org; s=google; t=1733639918; x=1734244718; darn=freebsd.org; h=to:references:message-id:content-transfer-encoding:cc:date :in-reply-to:from:subject:mime-version:from:to:cc:subject:date :message-id:reply-to; bh=ZsTlQuVww41/PwkNKPeEVajiv+esj+esb2imEqepB8Q=; b=YinenycErHxuZ1dz46NKcoOTdJIOcIyQHp4rxnq0DI6Iih4tiNF20xOBhhMS9449sd h37mjJlBNq5vbRK4vcy8CLGUKrRJa6BZpyaS0GMRtqGipX5JLTk91YcJkC+Nxz+zYJi2 g0sExSnDqLF3FzJJ85K9vg7zrUsSqV4W/yEdI= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1733639918; x=1734244718; h=to:references:message-id:content-transfer-encoding:cc:date :in-reply-to:from:subject:mime-version:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=ZsTlQuVww41/PwkNKPeEVajiv+esj+esb2imEqepB8Q=; b=GBgQFiKiqvx9zPbrUiwsEGUfzCSouki8vgAmjFKzFINZKGjY774BYGXZdvb7p4v/wY ro187tyuG2gQ+RyEgIxh+zKCK2Ksmi1oFlhr9nz3nlJ1RRFPn2OvQm7CQbwqgSaqj0Mb yzHN8tF+vMGwZhv1NMZz0DlcpWc6gfKCNe80RZZHylHpMLioNu6L+3G8NHUihLWzc1dq 4ajC7esA4IjRViEEFqPGmNzSQI2P4QfOZESoP2Q6i9wsRclCKHyrfT/a/pr3eeGmYm0Q JIH0orOeMZ7JVqVddfoK2PU2bhTRc1fU169nm0fpNl3muszVebcGHz39RlS8WqPpyTOB fGMA== X-Gm-Message-State: AOJu0YxdoAAmfFFqrqKe8sMGEa3FnTxkjMiYTs473/vwPKNE2nlaCpKt oR3tp2FMLC1rqiG22Pi80yVGqo4Y90XB7J50k2NX1LxLRkWG/K+ZNr24I+IbGZXFqMjBhicFAZU = X-Gm-Gg: ASbGncv3UHwsrS1cJIiKJimOoWPnBjZ2hmv4JSv6WCGPS+y28xiNk2O6jwCRoIT4aMq mY2FjRdhbmAH0zexMazjHTg7q/nyxCzXN68bfja6Y5fwk3d3DSk423cP8N4LUPysn8+tkaOsp+D x/s2OBQPgHaD1HKR1Srcdauo6hDT195kSsbgExK2BMIHw2G1BfINlU2gRJaPvGjq5BCjVoH1Tu0 Ol8lQP5JnOTa7WBg1L1Q1XWhDDvGqGpWVMsaUHhCe86Zhm/mcmiYUiZF0WGmiCmJIzcRSo3blnb rpwqesavgbv8bqREUqFyzDdQtFpNWoQbdj1sTfEMw3ur8VY= X-Google-Smtp-Source: AGHT+IHfwLYZ9wO5cuY3N9D+6n6t8yjXgFpz6cgRK14ncQ/mXIbaysJoQa1uv8Sl3cg6CZ7G0HbreQ== X-Received: by 2002:a17:902:e943:b0:215:a57e:88d6 with SMTP id d9443c01a7336-21613951bebmr45060665ad.0.1733639917830; Sat, 07 Dec 2024 22:38:37 -0800 (PST) Received: from smtpclient.apple (107-215-223-229.lightspeed.sntcca.sbcglobal.net. [107.215.223.229]) by smtp.gmail.com with ESMTPSA id d9443c01a7336-215f8efc906sm52247205ad.166.2024.12.07.22.38.36 (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Sat, 07 Dec 2024 22:38:37 -0800 (PST) Content-Type: text/plain; charset=utf-8 List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-virtualization@freebsd.org Sender: owner-freebsd-virtualization@FreeBSD.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3826.200.121\)) Subject: Re: Struggle with bhyve and Kali. From: Bakul Shah In-Reply-To: Date: Sat, 7 Dec 2024 22:38:26 -0800 Cc: freebsd-virtualization@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: References: <6B19A54E-78B2-4BDA-94FA-F7558F26DA87@iitbombay.org> To: Zaphod Beeblebrox X-Mailer: Apple Mail (2.3826.200.121) X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US] X-Rspamd-Queue-Id: 4Y5b1C3x19z4CB8 X-Spamd-Bar: ---- To check I did a graphical install of kali. After install, when bhyve = exited, as root I did this (to let efiboot work in bhyve): mdconfig -a -t vnode -f kali.img # the filename I used for kali's disk mount -t msdosfs /dev/md0p1 /mnt cd /mnt/EFI mkdir BOOT cp kali/grubx64.efi BOOT/bootx64.efi cd umount /mnt I just use bhyve, not vm, so I manually started the VM after removing the .iso line. Choosing the default blanks the screen and shows just vnc's tiny cursor. So I killed it with bhyvectl --vm=3Dkali --destroy and started it again. This time I chose the second option, that allows booting in "recovery mode" -- no X, just the console. Now I could login as the user I created & get a shell prompt. I don't use kali (or much linux) so I stopped. You're on your own at this point! May be you can ask on some kali related site.... > On Dec 7, 2024, at 8:37=E2=80=AFPM, Zaphod Beeblebrox = wrote: >=20 > That doesn't seem to help for kali. I found the binary, and I think = it boots... but it goes from the 1080p that I select for it down to some = 4x3 resolution that is tiny. Then I think X is up, but I don't get a = login or any other response to input other than a mouse cursor. >=20 > Really, this should be documented (the uefi boot variables thing). I = suppose I'll keep messing with it --- maybe booting with the full = resolution and the correct file will work --- which will likely require = me to mount the efi partition on the host and mess around. >=20 > On Sat, Dec 7, 2024 at 7:23=E2=80=AFPM Bakul Shah = wrote: > This may help:=20 > = https://record99.blogspot.com/2021/12/bdsdex-failed-to-load-boot0001-uefi-= bhyve-sata-disk.html >=20 >=20 > > On Dec 7, 2024, at 3:27=E2=80=AFPM, Zaphod Beeblebrox = wrote: > >=20 > > So... I've installed kali a few times on bhyve. Lately on 14.1 that = is now 14.2 (no change there). The graphical install proceeds fine = (using the vm install command), and the first reboot (cd still attached) = works fine. > >=20 > > Subsequent reboots fail with this message: > >=20 > > > >=20 > > ... which since Kali linux does install on hardware, seems to be = Bhyve's problem. > >=20 > > Help? >=20 From nobody Sun Dec 8 09:50:32 2024 X-Original-To: freebsd-virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Y5gHF1DBPz5gRG8 for ; Sun, 08 Dec 2024 09:51:05 +0000 (UTC) (envelope-from freebsd@ny-central.org) Received: from mail2.ny-central.com (mail2.ny-central.com [173.212.246.2]) by mx1.freebsd.org (Postfix) with ESMTP id 4Y5gHD1yJjz4SvG for ; Sun, 8 Dec 2024 09:51:04 +0000 (UTC) (envelope-from freebsd@ny-central.org) Authentication-Results: mx1.freebsd.org; none X-Virus-Scanned: amavisd-new at ny-central.com DKIM-Filter: OpenDKIM Filter v2.10.3 mail2.ny-central.com 78D881B3002 DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=ny-central.org; s=202405; t=1733651462; bh=m9Z9T6zYpB+SV9tIY9Q1VYjXz8Qy6eh7TIPijUJvyCk=; h=Date:From:To:cc:Subject:In-Reply-To:References; z=Date:=20Sun,=208=20Dec=202024=2010:50:32=20+0100=20(CET)|From:=20 Chris=20Moerz=20|To:=20Zaphod=20Beeblebrox =20|cc:=20Bakul=20Shah=20, =20freebsd-virtualization@freebsd.org|Subject:=20Re:=20Struggle=20 with=20bhyve=20and=20Kali.|In-Reply-To:=20|References:=20=20<6 B19A54E-78B2-4BDA-94FA-F7558F26DA87@iitbombay.org>=20; b=q2HQ49Prfi6ayINKlclc/+GWLeSayjoLFyVjXmxPzDM251jppYIjw1d7IUJ89Ifsz xgPgAS/q0Pl6EbYmI93BmqhSNTzxmNmc1zt9Nazsv64A03SWMLisukSGs8OJOGxC9w BoPByUTEbePIprhzYXnLQHuUlmqfg0ZosHz0Kyq2OPmqfyn4YZ/6YKscaWZkp9ocpe C99ylIetmMiS9CUe40KUe2b/ufGwCRV14IcFrhzZ7+CPM2YmGUNkeXl048YwmoNt/y Sfb4vmOoqHrD2OFiqb5H4zop+fLIbxNcgCbkRlNE/3leFjPBBTTOR+4Kf1qMU4ccFr 5/K7GEfeOkGrH3zTaqp8/42mWsyTMlMFLUp15aOwDSMEqJl46kGCkQ02+94xZR8nDp jJHuPJlX+2xLgJrmJtLt/h6mLw0c6vjUoUEbyg8fzBRs36CasehQUt3lDPBIpo623f mTg/pR7ETFr2Ssn7DIH+OBa4KnTItzI/iR5cu9t9Ky1B6smHw++zrRdnM6bJtIiAUl NVa6bBHufL9BHAtZCc+jyuYMrpdv0g2zGlxAVsfUzfbI78oJJZFoqSm/+mljaxte45 WOoqiFCrYhwY2IFikRSQxrSHVVX244FnggA25HEm1C41wEMqeao2FmqK7ykDaE4cSE YktaGi/lFo9RdDrWKACH9peI= Received: from tenforward.ny-central.local (unknown [192.168.11.104]) by mail2.ny-central.com (Postfix) with ESMTPSA id 78D881B3002; Sun, 08 Dec 2024 10:50:50 +0100 (CET) Date: Sun, 8 Dec 2024 10:50:32 +0100 (CET) From: Chris Moerz To: Zaphod Beeblebrox cc: Bakul Shah , freebsd-virtualization@freebsd.org Subject: Re: Struggle with bhyve and Kali. In-Reply-To: Message-ID: References: <6B19A54E-78B2-4BDA-94FA-F7558F26DA87@iitbombay.org> List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-virtualization@freebsd.org Sender: owner-freebsd-virtualization@FreeBSD.org MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="3328038562-1051281657-1733651433=:60587" X-Spam-Status: No, score=-2.9 required=5.0 tests=ALL_TRUSTED,BAYES_00 autolearn=ham autolearn_force=no version=4.0.1 X-Spam-Checker-Version: SpamAssassin 4.0.1 (2024-03-26) on mail2.ny-central.com X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:51167, ipnet:173.212.240.0/21, country:DE] X-Rspamd-Queue-Id: 4Y5gHD1yJjz4SvG X-Spamd-Bar: ---- This message is in MIME format. The first part should be readable text, while the remaining parts are likely unreadable without MIME-aware tools. --3328038562-1051281657-1733651433=:60587 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8BIT On Sat, 7 Dec 2024, Zaphod Beeblebrox wrote: > That doesn't seem to help for kali.  I found the binary, and I think it boots... but it goes from the 1080p > that I select for it down to some 4x3 resolution that is tiny.  Then I think X is up, but I don't get a > login or any other response to input other than a mouse cursor. > > Really, this should be documented (the uefi boot variables thing).  I suppose I'll keep messing with it --- > maybe booting with the full resolution and the correct file will work --- which will likely require me to > mount the efi partition on the host and mess around. I believe this actually is documented - at least in the Handbook: https://docs.freebsd.org/en/books/handbook/virtualization/#virtualization-bhyve-uefi I remember we added that note in the blue box particularly because of the behavior you're describing. If you have any recommandation or suggestion how to make it clearer, I'm certainly open to hear it! chris > > On Sat, Dec 7, 2024 at 7:23 PM Bakul Shah wrote: > This may help: > https://record99.blogspot.com/2021/12/bdsdex-failed-to-load-boot0001-uefi-bhyve-sata-disk.html > > > > On Dec 7, 2024, at 3:27 PM, Zaphod Beeblebrox wrote: > > > > So... I've installed kali a few times on bhyve.  Lately on 14.1 that is now 14.2 (no change > there).  The graphical install proceeds fine (using the vm install command), and the first > reboot (cd still attached) works fine. > > > > Subsequent reboots fail with this message: > > > > > > > > ... which since Kali linux does install on hardware, seems to be Bhyve's problem. > > > > Help? > > > --3328038562-1051281657-1733651433=:60587-- From nobody Sun Dec 8 10:08:31 2024 X-Original-To: virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Y5ggM55Kvz5gSyQ for ; Sun, 08 Dec 2024 10:08:31 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R10" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Y5ggM3WN7z4VhM for ; Sun, 8 Dec 2024 10:08:31 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1733652511; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=UcrqauLmRzSgx7NRHmuTgGkBFcfttyaFgGf6FHHg2oQ=; b=qMTfkUXNjA8g6DmM+cM3B4Vyme3dxIbeJ4t3EjQ07WvkvPO2nUaqRBLfI/5okczSXooL++ vamlRpD9IZ0ZPGelqTFQhMB2bY6IfFxXGsZz+UQmPzE5NnYxV6rDbd+eCXwZwhoRddcDr4 iaD6UUog2mlpReUoIkCGTSdKzqDowH+Is/WlryZAphowgfHYVyLpAaFPwekrq7luschveF ZI3FYE1UwVhhZHMC1cGzzmvWS+L5TbMT9OkLqdlyKlKcq74UBtadWyjDAcVG0ZfqSb8Ac0 tWaZfLpKnlujD50cMujKjR8zA16rAFiwXP/dd7Sq5palUjFwk6wUV/hktvESoA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1733652511; a=rsa-sha256; cv=none; b=tKDZOGX9wj1CYH5ZI5zeN/ozPVG9GBvvSTVPJ0PmmruylertONRhTdefFkNcW+Zgxrv+zq 9fwytwirIxXaEQdzJqnyO22Q02j1S1hLXqGkcrpgjNZ1Wf0oh35hwiU3CNXcl87qPzWfKK bePbK0nx6abhMVv91LhWwpY/HJuGPsT61dpZKFvuBt+oGf2m3pwma6D4CSbEX7tnAkx1yQ 251rdQeLTRfg2tAxfYqrZKacaXdx/t+rhGL2BI3xLblsAnVt061TdScqh4aNMjNjEGBUPT JPV227mT1KhI2tSlfM9Ks86H2EJnaF/UTOm8NCMK1huRTMBaMCqeuMSaK52sOw== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4Y5ggM2RNfzp73 for ; Sun, 8 Dec 2024 10:08:31 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 4B8A8VPR072041 for ; Sun, 8 Dec 2024 10:08:31 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 4B8A8VAo072039 for virtualization@FreeBSD.org; Sun, 8 Dec 2024 10:08:31 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 279901] glibc-2.39-2 and above on the host segfault Date: Sun, 08 Dec 2024 10:08:31 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bhyve X-Bugzilla-Version: 14.1-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: fweimer@redhat.com X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-virtualization@freebsd.org Sender: owner-freebsd-virtualization@FreeBSD.org MIME-Version: 1.0 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D279901 --- Comment #21 from Florian Weimer --- (In reply to Getz Mikalsen from comment #20) > ld.so --list-diagnostics from glibc240 Sorry, this says =E2=80=9Cversion.version=3D"2.36"=E2=80=9D in the dump, an= d it lacks the CPUID diagnostics. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sun Dec 8 10:26:22 2024 X-Original-To: virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Y5h401rWYz5gTb3 for ; Sun, 08 Dec 2024 10:26:24 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R10" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Y5h400WRsz4XTM for ; Sun, 8 Dec 2024 10:26:24 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1733653584; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=x8hW0ktnRP3WTB5o7/EBnF0Nsym8NWoBeGg7ovUEmHw=; b=QK6FRGYhMTy1293S1qZ5siMsGutSicPb9UxqouTUnnMAs7G3IDrRsDkL89oDQ2BkFcdqLg r4Y6YXyN1NslZ/vTMWPUJRWc70Rw6CLQiprqVPpLeaO4VskxtD4v2S2BuJNeKpd1pVKFU6 2pSAHA2gBaXiz5MC6XVAMdOG9oCfIXVTGGNnpTLVMuJXvU3xtyaB9CHOB/WXWfh9XM/jIh 5s8rIRsfE1GVyXuuOcl94EMaIpdSPm0+eAWLrGWoSuPYEiYMKA60eKsML55j01HeGRRwiI PCebnRT4CG+FDCn4Os6QZ8djLYNN8fAWspw22uijNlc7KUDtbgzmR6SmozJO7g== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1733653584; a=rsa-sha256; cv=none; b=qaL5hsa5RRgFKzBCEK/yFJKxJ69/hJCirDfYoUEvSRZ108uKMN20ni72Lfrsovld4dnLDY EtVd/YlEO91n4uLkXs1MHxWW1K61tJQG3f39zhdXTkVOehIzp+0EuwGcwMWTkfqDniKhC+ 37bjpJkFViQNZ1oW4c5qvSCOAn5SmCzeEGfdv9TN/KN7xP1/JT6uvHfX83W1i3HQBzkHXF bwGp8Ud/xOJ6cZQ9tamPzyBbje334P7UWImUI0EmG/c1FVLl0vraeN8B/GE4x+rjjx5Snv t20P+HUaMXUqGC/JYCvHcPBL5w+F6X0OtmTH/Ofb0lCDNnYCu9/zsNgYBU0Akw== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4Y5h3z1xP5zpYl for ; Sun, 8 Dec 2024 10:26:23 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 4B8AQNwh008622 for ; Sun, 8 Dec 2024 10:26:23 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 4B8AQNVs008621 for virtualization@FreeBSD.org; Sun, 8 Dec 2024 10:26:23 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 279901] glibc-2.39-2 and above on the host segfault Date: Sun, 08 Dec 2024 10:26:22 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bhyve X-Bugzilla-Version: 14.1-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: getz@dflund.se X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-virtualization@freebsd.org Sender: owner-freebsd-virtualization@FreeBSD.org MIME-Version: 1.0 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D279901 --- Comment #22 from Getz Mikalsen --- (In reply to Florian Weimer from comment #21) It's /usr/bin/ld.so from glibc 2.40 copied over into an older distribution running 2.36 just like you asked. I was able to install the latest archlinux iso by not exposing ERMS in CPUI= D. Then I reverted the patch and it booted, although would easily segfault. I can attach the output from --list-diagnostics from that vm if that'd be of more use. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sun Dec 8 10:31:58 2024 X-Original-To: virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Y5hBS3B6pz5gVRk for ; Sun, 08 Dec 2024 10:32:00 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R10" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Y5hBS27pVz4YPL for ; Sun, 8 Dec 2024 10:32:00 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1733653920; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=+cdAtXyb7Yac8rtf1d6cwstPBzYHHTT2wVr7gj+bv+k=; b=lotw7kX/EQXMHCqoWvqrZZo44eRm7nH+WsRxf5h6bpt7XJa+sZW3K0f42qS3qpVFqQhLdm UDQQDOuzah0X3mctlaqg4CfhHEm6Lq6j9LZGAPxfYhCTk8GoHVkpxrZQBrRNW4vZw+f422 F0hcou8CLqXYRLhvK6iG//84WB2jrTRs3z7sTYW4c/mrXmQc4JZervE+K8XBbTAy/7ubkf lAKvdQ/4lwjPhk7e5GUJXURt7RxQxchVZPdxVSpUTVYba1sLET7MSfDGiqFoyCVTBds4qs BF3p0ejX6yqhpKDoDLmbcLwVr22aSSCIspixnWJu7gM7Fz9vLm5J9+AD2+V10Q== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1733653920; a=rsa-sha256; cv=none; b=byNyVGDbiTdiJzOA3PdXM07qLu9WaNTUy5fOVdAng1r28BOzcb+QOTaLeumKAUZdP1J1wM ZieFaKfWyAa6VMRBBdjx9Hit39r/QztcV8Z2mG/N9oWbBVxgw5RHge9zqMGu00NffHyPpx 6P/C7I7ceUo1jHP7XOR44D2oLAOKQt8TzF8CQhvdNrL7KyjQXgDK4pBWQZ59R0I0WOqLFw 1+pa+HLfyKt6a+hW3MBkubUVuaPkI6x1RvFdZBLO9hlJuSQMKuGE/PCVz6Lhl9mN5Cd1Je WMf0NnLmweUOWX2OfKXbLJrvdbMNGQVNROxUZ9yv2pMJB0xENhaZr+MZKH3wIQ== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4Y5hBS1GGgzp8c for ; Sun, 8 Dec 2024 10:32:00 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 4B8AW0vS018506 for ; Sun, 8 Dec 2024 10:32:00 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 4B8AW0Wo018505 for virtualization@FreeBSD.org; Sun, 8 Dec 2024 10:32:00 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 279901] glibc-2.39-2 and above on the host segfault Date: Sun, 08 Dec 2024 10:31:58 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bhyve X-Bugzilla-Version: 14.1-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: fweimer@redhat.com X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-virtualization@freebsd.org Sender: owner-freebsd-virtualization@FreeBSD.org MIME-Version: 1.0 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D279901 --- Comment #23 from Florian Weimer --- (In reply to Getz Mikalsen from comment #22) > It's /usr/bin/ld.so from glibc 2.40 copied over into an older distributio= n running 2.36 just like you asked. Sorry, It looks like you have copied over the symbolic link instead of the symbolic link target. Sorry, I should have mentioned that. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sun Dec 8 11:07:28 2024 X-Original-To: virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Y5hzQ5cpHz5gXHd for ; Sun, 08 Dec 2024 11:07:30 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R10" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Y5hzP4DShz4bqc for ; Sun, 8 Dec 2024 11:07:29 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1733656049; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=JfWwaFLdzZ0zm7GSM/ButUICxdQLW8L8ocPZ1iyb8Oc=; b=o+GSqljlt/4rvNVAGObQ8BZbVtEM35n4LOi9UTWOjGTbiUOJpJuiTy+5pm9laxIDkVe5PW +vGuI5mBPdldvY4hXzG21zKnqIJoj4MZqkFM86w4a/5GqLetf0K/H4QRWtABiRzo+C8SAj 7fHdaLbzfT/mdxY6yIPSl7NuUDpmD+9dQQMcdcdMenDt94egvB01oI+6qu55dOar+f0ihx ClC+Qb9duD28Uzx5GVbf4p6RcYRFuMC9G7B3WZ21IUYjL1rX5CJSZrRpPNxni/r2MyW/DC uLlFKW+UCch6WYqO95DzeYCCsIS/DiMxrbJgWoin2q0CXt05cnHQlyGWLlcR3Q== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1733656049; a=rsa-sha256; cv=none; b=qiqcZ9qVwpns26Mbt5lg9jt798hFCFN690LMYRhhm7cE615wq5cDg4oWc/zWDNQmasXapP QVFelah4WDJNumIEsnlCTE9OJ0I3/SGRHt8Ye9TdxOX1CcvBZGc7oOJgRwfTArOBq6RfX9 ym93p3a4BLKtE5rutd1CrfM22JD/SLww4hwVG4xSN2wutcm239gH1DstoPfOaNaCIjJpgC 61sE31K5NgkNHSuQugABMqDDd+BiDcpoSRfV1IWIiXFGahC5/rhqf2/Aln3vkzeUDBCXhA 9tfqw1CL6wXbFfDB2gU47mcHEb7jOoz/VDxhJJH8LGanR04sC7iysS+TnOLT2w== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4Y5hzP3rmczqDM for ; Sun, 8 Dec 2024 11:07:29 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 4B8B7TNd073804 for ; Sun, 8 Dec 2024 11:07:29 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 4B8B7TWP073803 for virtualization@FreeBSD.org; Sun, 8 Dec 2024 11:07:29 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 279901] glibc-2.39-2 and above on the host segfault Date: Sun, 08 Dec 2024 11:07:28 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bhyve X-Bugzilla-Version: 14.1-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: getz@dflund.se X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: attachments.isobsolete attachments.created Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-virtualization@freebsd.org Sender: owner-freebsd-virtualization@FreeBSD.org MIME-Version: 1.0 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D279901 Getz Mikalsen changed: What |Removed |Added ---------------------------------------------------------------------------- Attachment #255691|0 |1 is obsolete| | --- Comment #24 from Getz Mikalsen --- Created attachment 255708 --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=3D255708&action= =3Dedit ld-linux-x86-64.so.2 --list-diagnostics from glibc2.40 (In reply to Florian Weimer from comment #23) Sorry my bad, here is the actual ld-linux-x86-64.so.2 output, no symlink th= is time. :-) --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sun Dec 8 13:50:59 2024 X-Original-To: freebsd-virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Y5mc93Dhyz5ghtK for ; Sun, 08 Dec 2024 13:51:05 +0000 (UTC) (envelope-from lausts@acm.org) Received: from 009.lax.mailroute.net (009.lax.mailroute.net [199.89.1.12]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "mailroute.net", Issuer "R10" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Y5mc91Gzjz4t8L for ; Sun, 8 Dec 2024 13:51:04 +0000 (UTC) (envelope-from lausts@acm.org) Authentication-Results: mx1.freebsd.org; none Received: from localhost (localhost [127.0.0.1]) by 009.lax.mailroute.net (Postfix) with ESMTP id 4Y5mc760Cpzlgd6x; Sun, 8 Dec 2024 13:51:03 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=acm.org; h= content-transfer-encoding:content-type:content-type:in-reply-to :from:from:content-language:references:subject:subject :user-agent:mime-version:date:date:message-id:received:received; s=mr01; t=1733665862; x=1736257863; bh=58ZqQDP51B45WdJSTT0xKBOR SNFqfZntCFi9Umukvzw=; b=yqVrEkR0NGvFP32IquN4wd0sLyEggwEhl+R0XPfM bD972bleueCmMNJljn5NqxzT5opZvDOu17ga+b9gfvo3z73GlWdeTcK9ABiCLaIi uBxio01N5ddD5xeFoTpRqGpjFVhP3HKZ/J1KNov2hMTBhwTa3FywUfLYY8B6bjUi IrIfWH5zNyDWnMIj5p3TggHrwzD+epCs/4GgvwFdVQZjVF0ViUrfPtveHJwSdrsj 6l+IkuZhE9lpg4F+k8icx370YdEG+bCjxizu90RMlBYfQlGTDfiGoiEJJuemcAvz DX9qqPik6dT7fn7XoC+nHIPKb/0v0CIjrsiYYZBQSiix2A== X-Virus-Scanned: by MailRoute Received: from 009.lax.mailroute.net ([127.0.0.1]) by localhost (009.lax [127.0.0.1]) (mroute_mailscanner, port 10029) with LMTP id eigzwDyg57w3; Sun, 8 Dec 2024 13:51:02 +0000 (UTC) Received: from [192.168.1.100] (syn-174-101-219-087.res.spectrum.com [174.101.219.87]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) (Authenticated sender: lausts@acm.org) by 009.lax.mailroute.net (Postfix) with ESMTPSA id 4Y5mc55nPQzlgd6Q; Sun, 8 Dec 2024 13:51:01 +0000 (UTC) Message-ID: <801e6324-0825-4758-ad51-ea777c2834a1@acm.org> Date: Sun, 8 Dec 2024 08:50:59 -0500 List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-virtualization@freebsd.org Sender: owner-freebsd-virtualization@FreeBSD.org MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Subject: Re: Tap device problem on FreeBSD 14.2-RELEASE To: mike tancsa , freebsd-virtualization@freebsd.org References: <0fc1d487-b254-4c64-9db1-a982169924e4@acm.org> Content-Language: en-US From: Thomas Laus In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: quoted-printable X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:8100, ipnet:199.89.1.0/24, country:US] X-Rspamd-Queue-Id: 4Y5mc91Gzjz4t8L X-Spamd-Bar: ---- On 12/7/24 17:38, mike tancsa wrote: > On 12/7/2024 4:37 PM, Thomas Laus wrote: > I dont have anything unusual in my config. I am running just a few days= =20 > ahead of 14.2, but I dont think that makes a difference >=20 >=20 > =C2=A0kldstat > Id Refs Address=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 Size Name > =C2=A01=C2=A0=C2=A0 47 0xffffffff80200000=C2=A0 1f3d9c0 kernel > =C2=A02=C2=A0=C2=A0=C2=A0 1 0xffffffff8213f000=C2=A0=C2=A0 5da658 zfs.= ko > =C2=A03=C2=A0=C2=A0=C2=A0 1 0xffffffff8271a000=C2=A0=C2=A0=C2=A0=C2=A0= 36c8 coretemp.ko > =C2=A04=C2=A0=C2=A0=C2=A0 2 0xffffffff8271e000=C2=A0=C2=A0=C2=A0 8dae8= pf.ko > =C2=A05=C2=A0=C2=A0=C2=A0 1 0xffffffff827ac000=C2=A0=C2=A0=C2=A0=C2=A0= 77d8 cryptodev.ko > =C2=A06=C2=A0=C2=A0=C2=A0 1 0xffffffff827b4000=C2=A0=C2=A0=C2=A0=C2=A0= 3c58 pflog.ko > =C2=A07=C2=A0=C2=A0=C2=A0 1 0xffffffff83c20000=C2=A0=C2=A0=C2=A0=C2=A0= 3390 acpi_wmi.ko > =C2=A08=C2=A0=C2=A0=C2=A0 1 0xffffffff83c24000=C2=A0=C2=A0=C2=A0=C2=A0= 4250 ichsmb.ko > =C2=A09=C2=A0=C2=A0=C2=A0 1 0xffffffff83c29000=C2=A0=C2=A0=C2=A0=C2=A0= 2178 smbus.ko > 10=C2=A0=C2=A0=C2=A0 1 0xffffffff83c2c000=C2=A0=C2=A0=C2=A0=C2=A0 7798 = if_bridge.ko > 11=C2=A0=C2=A0=C2=A0 1 0xffffffff83c34000=C2=A0=C2=A0=C2=A0=C2=A0 60e0 = bridgestp.ko > 12=C2=A0=C2=A0=C2=A0 1 0xffffffff83c3b000=C2=A0=C2=A0=C2=A0=C2=A0 33c0 = uchcom.ko > 13=C2=A0=C2=A0=C2=A0 1 0xffffffff83c3f000=C2=A0=C2=A0=C2=A0=C2=A0 4e10 = ucom.ko > 14=C2=A0=C2=A0=C2=A0 1 0xffffffff83e00000=C2=A0=C2=A0 33e438 vmm.ko > 15=C2=A0=C2=A0=C2=A0 1 0xffffffff83c44000=C2=A0=C2=A0=C2=A0=C2=A0 4850 = nullfs.ko >=20 >=20 > Starting up a vm works as before for me >=20 > =C2=A0vmrun.sh -t tap0 -d /baseimage/14-1VM-p6.raw -E=C2=A0 vm0 > Launching virtual machine "vm0" ... > fbuf frame buffer base: 0x2be256a00000 [sz 16777216] > 3h > 3h > 3h > BdsDxe: loading Boot0001 "UEFI Misc Device" from PciRoot(0x0)/Pci(0x3,0= x0) > BdsDxe: starting Boot0001 "UEFI Misc Device" from PciRoot(0x0)/Pci(0x3,= 0x0) > Consoles: EFI console > =C2=A0=C2=A0=C2=A0 Reading loader env vars from /efi/freebsd/loader.en= v > Setting currdev to disk0p2: > FreeBSD/amd64 EFI loader, Revision 1.1 >=20 > =C2=A0=C2=A0 Command line arguments: loader.efi > =C2=A0=C2=A0 Image base: 0x1e27a000 > =C2=A0=C2=A0 EFI version: 2.70 > =C2=A0=C2=A0 EFI Firmware: BHYVE (rev 1.00) > =C2=A0=C2=A0 Console: efi (0x20001000) > =C2=A0=C2=A0 Load Path: \EFI\BOOT\BOOTX64.EFI > =C2=A0=C2=A0 Load Device: PciRoot(0x0)/Pci(0x3,0x0)/HD(2,GPT,E140336F-= 1F4D-11EF-=20 > AE18-002590EC5BF2,0x17B,0x10418) > =C2=A0=C2=A0 BootCurrent: 0001 > =C2=A0=C2=A0 BootOrder: 0000 0001[*] 0002 0003 0004 > =C2=A0=C2=A0 BootInfo Path: PciRoot(0x0)/Pci(0x3,0x0) > Ignoring Boot0001: Only one DP found > Trying ESP: PciRoot(0x0)/Pci(0x3,0x0)/HD(2,GPT,E140336F-1F4D-11EF-=20 > AE18-002590EC5BF2,0x17B,0x10418) > Setting currdev to disk0p2: > Trying: PciRoot(0x0)/Pci(0x3,0x0)/HD(1,GPT,E1403365-1F4D-11EF-=20 > AE18-002590EC5BF2,0x22,0x159) > Setting currdev to disk0p1: > Trying: PciRoot(0x0)/Pci(0x3,0x0)/HD(3,GPT,E1403374-1F4D-11EF-=20 > AE18-002590EC5BF2,0x10593,0x200000) > Setting currdev to disk0p3: > Trying: PciRoot(0x0)/Pci(0x3,0x0)/HD(4,GPT,E1403378-1F4D-11EF-=20 > AE18-002590EC5BF2,0x210593,0x11FFF6D) > Setting currdev to zfs:zroot/ROOT/default:--=20 I may have missed defining my issue. I thought that it was related to=20 the creation of the tap device. It looks like a problem is with=20 virtio-net not getting loaded during the VM boot process on=20 FreeDSD-14.2-RELEASE. vm-bhyve log from startup on FreeBSD-14.1-RELEASE Dec 06 17:18:55: [bhyve devices: -s 0,hostbridge -s 31,lpc -s=20 4:0,virtio-blk,/virtual/openbsd/disk0.img -s=20 5:0,virtio-net,tap0,mac=3D58:9c:fc:09:93:65 -s 6:0,passthru,3/0/0] Dec 06 17:18:55: [bhyve console: -l com1,/dev/nmdm-openbsd.1A] Dec 06 17:18:55: starting bhyve (run 1) vm-bhyve log from startup on FreeBSD-14.2-RELEASE Dec 07 13:57:55: [bhyve devices: -s 0,hostbridge -s 31,lpc -s=20 4:0,virtio-blk,/virtual/openbsd/disk0.img -s 6:0,passthru,3/0/0] Dec 07 13:57:55: [bhyve console: -l com1,/dev/nmdm-openbsd.1A] Dec 07 13:57:55: starting bhyve (run 1) Tom --- Public Keys: PGP KeyID =3D 0x5F22FDC1 GnuPG KeyID =3D 0x620836CF From nobody Sun Dec 8 14:17:37 2024 X-Original-To: virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Y5nBz4Tn2z5gjbs for ; Sun, 08 Dec 2024 14:17:47 +0000 (UTC) (envelope-from herbert@gojira.at) Received: from mail.bsd4all.net (mail.bsd4all.net [IPv6:2a01:4f8:13b:240c::25]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature ECDSA (P-384) client-digest SHA384) (Client CN "mail.bsd4all.net", Issuer "E6" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Y5nBy29X9z4vrh for ; Sun, 8 Dec 2024 14:17:45 +0000 (UTC) (envelope-from herbert@gojira.at) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gojira.at header.s=mail202005 header.b=uIF4zgAA; spf=pass (mx1.freebsd.org: domain of herbert@gojira.at designates 2a01:4f8:13b:240c::25 as permitted sender) smtp.mailfrom=herbert@gojira.at; dmarc=none Date: Sun, 8 Dec 2024 15:17:37 +0100 DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=gojira.at; s=mail202005; t=1733667457; bh=oxk91zDBxVxi3OLH+Unm1kyhP5KKZs999IBOQxw7C30=; h=Date:From:To:Subject:Message-ID:MIME-Version:Content-Type; b=uIF4zgAA3DTbTL14kp8yopH9VVRuns1WPkCmxrWwHAVKo19MxrHTUgynRQohkEbaP MMhYEtP7TBQe1xSCmwcJLdWe3kpqJpoH32i2PKEZSgsdqswFrbsrydFKFKdQHj4BpZ 3z1mTMj4KhFch8J2EVEM3xDTAE/6zBWsOzK4tugt9Bl0ycgSDUXh8w4fZ6rfneeUo3 ub0MSSjkkPnSJE1RKGigywojenQBG+h/1cKwLklafsDiaLq+bhneog/8QN/G3Y0Q7t HhI4L+jdiFv9sZ6kpCq4uoEdkWEBtoPYclqSZRq/7gO/8Qn0kr3MO6E/1nv8NhsYvE xjYCYmCBvwR6A== From: "Herbert J. Skuhra" To: virtualization@freebsd.org Subject: Re: Tap device problem on FreeBSD 14.2-RELEASE Message-ID: References: <0fc1d487-b254-4c64-9db1-a982169924e4@acm.org> <801e6324-0825-4758-ad51-ea777c2834a1@acm.org> List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-virtualization@freebsd.org Sender: owner-freebsd-virtualization@FreeBSD.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <801e6324-0825-4758-ad51-ea777c2834a1@acm.org> X-Spamd-Result: default: False [-3.50 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.996]; R_SPF_ALLOW(-0.20)[+ip6:2a01:4f8:13b:240c::25]; R_DKIM_ALLOW(-0.20)[gojira.at:s=mail202005]; MIME_GOOD(-0.10)[text/plain]; MIME_TRACE(0.00)[0:+]; RCPT_COUNT_ONE(0.00)[1]; ASN(0.00)[asn:24940, ipnet:2a01:4f8::/32, country:DE]; MISSING_XM_UA(0.00)[]; FROM_HAS_DN(0.00)[]; RCVD_COUNT_ZERO(0.00)[0]; DMARC_NA(0.00)[gojira.at]; FROM_EQ_ENVFROM(0.00)[]; ARC_NA(0.00)[]; TO_DN_NONE(0.00)[]; MLMMJ_DEST(0.00)[virtualization@freebsd.org]; TO_MATCH_ENVRCPT_ALL(0.00)[]; DKIM_TRACE(0.00)[gojira.at:+] X-Rspamd-Queue-Id: 4Y5nBy29X9z4vrh X-Spamd-Bar: --- On Sun, Dec 08, 2024 at 08:50:59AM -0500, Thomas Laus wrote: > > I may have missed defining my issue. I thought that it was related to the > creation of the tap device. It looks like a problem is with virtio-net not > getting loaded during the VM boot process on FreeDSD-14.2-RELEASE. > > vm-bhyve log from startup on FreeBSD-14.1-RELEASE > > Dec 06 17:18:55: [bhyve devices: -s 0,hostbridge -s 31,lpc -s > 4:0,virtio-blk,/virtual/openbsd/disk0.img -s > 5:0,virtio-net,tap0,mac=58:9c:fc:09:93:65 -s 6:0,passthru,3/0/0] > Dec 06 17:18:55: [bhyve console: -l com1,/dev/nmdm-openbsd.1A] > Dec 06 17:18:55: starting bhyve (run 1) > > vm-bhyve log from startup on FreeBSD-14.2-RELEASE > > Dec 07 13:57:55: [bhyve devices: -s 0,hostbridge -s 31,lpc -s > 4:0,virtio-blk,/virtual/openbsd/disk0.img -s 6:0,passthru,3/0/0] > Dec 07 13:57:55: [bhyve console: -l com1,/dev/nmdm-openbsd.1A] > Dec 07 13:57:55: starting bhyve (run 1) Did you run the same version of vm-bhyve on FreeBSD-14.1-RELEASE? https://github.com/churchers/vm-bhyve/issues/570 From nobody Sun Dec 8 18:24:35 2024 X-Original-To: virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Y5tgs4wCBz5f143 for ; Sun, 08 Dec 2024 18:24:41 +0000 (UTC) (envelope-from lausts@acm.org) Received: from 009.lax.mailroute.net (009.lax.mailroute.net [199.89.1.12]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "mailroute.net", Issuer "R10" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Y5tgr2lyFz47DZ for ; Sun, 8 Dec 2024 18:24:40 +0000 (UTC) (envelope-from lausts@acm.org) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=acm.org header.s=mr01 header.b=P9te2uza; spf=pass (mx1.freebsd.org: domain of lausts@acm.org designates 199.89.1.12 as permitted sender) smtp.mailfrom=lausts@acm.org; dmarc=pass (policy=reject) header.from=acm.org Received: from localhost (localhost [127.0.0.1]) by 009.lax.mailroute.net (Postfix) with ESMTP id 4Y5tgp67lyzlffl6 for ; Sun, 8 Dec 2024 18:24:38 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=acm.org; h= content-transfer-encoding:content-type:content-type:in-reply-to :from:from:content-language:references:subject:subject :user-agent:mime-version:date:date:message-id:received:received; s=mr01; t=1733682277; x=1736274278; bh=TvrbCp6NYDwPbtdyhGEoomxp +X4NPmtdnUmyK3pBv8E=; b=P9te2uza18qeg8AplemsE2kkwMdLvErQ6yhHYR9s 9Nq6WQEGSECo5ga7li3cVDbHFkKzl7uArQDw0eyw5bCvgl7/f+i1Ul5B0yFi2RL8 V7SQWjRiqORipia8UG/JlDjFznk+bguMfMr7OSNHOUIq5Tj/J8Labzynb489tm/p uyBm4j4rD8zmecmTgwqIsXQcPcLt62dufCzmFzS2qLJ/9smtsAUMVzU0wQGpIVof vi8n0f865O7teBEARL4E99xtlZxPyw4jO+hykAn5oQy5+BsYRiR9PRbeSXeyQpju izCm71DwoiVh+p/i6UCTADtGvUmXmjjDp8IecA4M9gQ4KQ== X-Virus-Scanned: by MailRoute Received: from 009.lax.mailroute.net ([127.0.0.1]) by localhost (009.lax [127.0.0.1]) (mroute_mailscanner, port 10029) with LMTP id kW0nMqd9DHEi for ; Sun, 8 Dec 2024 18:24:37 +0000 (UTC) Received: from [192.168.1.100] (syn-174-101-219-087.res.spectrum.com [174.101.219.87]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) (Authenticated sender: lausts@acm.org) by 009.lax.mailroute.net (Postfix) with ESMTPSA id 4Y5tgn58Kczlgd6Q for ; Sun, 8 Dec 2024 18:24:36 +0000 (UTC) Message-ID: <0ab950f7-edca-4d91-badd-48c94d698fe8@acm.org> Date: Sun, 8 Dec 2024 13:24:35 -0500 List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-virtualization@freebsd.org Sender: owner-freebsd-virtualization@FreeBSD.org MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Subject: Re: Tap device problem on FreeBSD 14.2-RELEASE To: virtualization@freebsd.org References: <0fc1d487-b254-4c64-9db1-a982169924e4@acm.org> <801e6324-0825-4758-ad51-ea777c2834a1@acm.org> Content-Language: en-US From: Thomas Laus In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit X-Spamd-Result: default: False [-5.09 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; DWL_DNSWL_LOW(-1.00)[acm.org:dkim]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-1.000]; DMARC_POLICY_ALLOW(-0.50)[acm.org,reject]; R_SPF_ALLOW(-0.20)[+ip4:199.89.0.0/21]; R_DKIM_ALLOW(-0.20)[acm.org:s=mr01]; MIME_GOOD(-0.10)[text/plain]; RCVD_IN_DNSWL_LOW(-0.10)[199.89.1.12:from]; XM_UA_NO_VERSION(0.01)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:8100, ipnet:199.89.1.0/24, country:US]; RCVD_TLS_LAST(0.00)[]; ARC_NA(0.00)[]; TO_DN_NONE(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; FROM_HAS_DN(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; PREVIOUSLY_DELIVERED(0.00)[virtualization@freebsd.org]; MLMMJ_DEST(0.00)[virtualization@freebsd.org]; DKIM_TRACE(0.00)[acm.org:+] X-Rspamd-Queue-Id: 4Y5tgr2lyFz47DZ X-Spamd-Bar: ----- On 12/8/24 09:17, Herbert J. Skuhra wrote: > > Did you run the same version of vm-bhyve on FreeBSD-14.1-RELEASE? > > https://github.com/churchers/vm-bhyve/issues/570 > That package was updated before I installed FreeBSD 14.2. Thanks for the link. It looks like it may fix this issue. I'll have to wait until next weekend when my wife's office is closed. This is a production computer. Tom -- Public Keys: PGP KeyID = 0x5F22FDC1 GnuPG KeyID = 0x620836CF From nobody Sun Dec 8 18:41:05 2024 X-Original-To: freebsd-virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Y5v3317ycz5f1L0 for ; Sun, 08 Dec 2024 18:41:19 +0000 (UTC) (envelope-from mp@freebsd.org) Received: from smtp.freebsd.org (smtp.freebsd.org [IPv6:2610:1c1:1:606c::24b:4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R10" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Y5v314NYsz4Cl4 for ; Sun, 8 Dec 2024 18:41:17 +0000 (UTC) (envelope-from mp@freebsd.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1733683277; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=3JH36ILS7CbRSogBAIG8/cZS2CYQd1k9vwZNu0rY8Zk=; b=U8BVSi8hY3RmisGqooq4Vcgjzot1XPxBSkxpmLhl9Vs2M/Jfh3eWUpvQGC9OCXk1dy+big Fb/zMH5xwP4hJpkTNDRqLmVH4LfXLHG+iLptIpNzmsPjA65mh6n3ZGmwCsbzj9GuJ2VME+ +f/ARWKQhhwT0RKbqi4L7QK6rI4yM1GpPuHozvRCNu6El3hwjwM+IM7avpZ4mi+yxdvn+x 5SsTE4d0AlsbTUMQPmEDUqe/SB0JzYuWSxbIkhu6ggFajzJmosTQBNM2llgnJc7CIblB4O ewSjIcZ2LWgBGHST5XGw/P1mBdY9RrZBHhcq6vBKirJ/leLevRS36M8ScEORdA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1733683277; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=3JH36ILS7CbRSogBAIG8/cZS2CYQd1k9vwZNu0rY8Zk=; b=l7Zbsthf6CUOmLqj6X8YtFe0sUXKHpdpL9TygXp/6SSuvWcWlC/l1y14inySbvj1yzzuDl AWFTf359K3PFNnz1SUySp/AXSVNviPTXWrBp3rurraMuMxvtPSf0NRRJ9uyi7xHu+TNQJV TmDwbhe5FL/LRFwt72jNLM4DlujOvmFDD09VmuVbSL7xDnBg6uogKwqFjDh2hpNLwowhGX xSEEKA7vlSegatYOBH2BArJHcOzg5vhmRkFIpYlGWu49SCzqYmGLLSnYS5Jpd5i2U+P74U FTuRt8CQlXCEv66jjrGzp1Nep+Kh3AzIJozzVImWPNhXpKDnWc1CKrC71jyipw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1733683277; a=rsa-sha256; cv=none; b=IWwSgFhRR37v4+jsor6mbpaUTgR2laQDpqtSnrkUVFdTSr/4tB5o+6jawvU1Warl8opGCB QTrtjUUFuhVFcmO90xKluXXCdQO09C6qMmm906eaRO8tqDhcqF0/hQu/4cvdiGO9D7cyAB FEHzfMLbzVV1LhZh2TmK0HjAYWmNJFyvG/DCA+C5AusRNUdFVGQ+CNcMosmrHlh8Hf5+DH JFL4DCa3K57/O/OokI2ZE1h9MeXRfrHjl/qo3lGmvoQsRMn/sfB3wUchwZcVXBKl6MR2wO BXHJliJH8THAddOPQ1c8juarbe3bSHZYKQeq55ywI978SjWULWnzrA0KbF/5cA== Received: from mail-qt1-f179.google.com (mail-qt1-f179.google.com [209.85.160.179]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "WR4" (verified OK)) (Authenticated sender: mp) by smtp.freebsd.org (Postfix) with ESMTPSA id 4Y5v313mKKz1K5F for ; Sun, 8 Dec 2024 18:41:17 +0000 (UTC) (envelope-from mp@freebsd.org) Received: by mail-qt1-f179.google.com with SMTP id d75a77b69052e-4674ce290aaso18788701cf.3 for ; Sun, 08 Dec 2024 10:41:17 -0800 (PST) X-Forwarded-Encrypted: i=1; AJvYcCWqkQjftCFDCa5QIWEwYHVDVeqXKoyxAazqger1xI/3kqpXDRFrQPemBTBw7SixWWAJF2IKB1qnf88/BpfzRSiGNU+6vwOC@freebsd.org X-Gm-Message-State: AOJu0Yzqwvd3PvMWy6Bu++KvuAIYAIH09CCsKo/dv8gXjORS+WsCFlvE d7CRWXWgAEWhtDpUn8QK9k0OQZCXUmkev/mhAuKhhCxiP/ebpNzpmpc86SxVUpadYDoujxhuMAe bjC2KI7QhuLOlCAWjyiUCYkYSBTI7FSV2xEMvHw== X-Google-Smtp-Source: AGHT+IHbZ2QcPB1w45jkHAOApSSFOu2lH3AsZ5ADnj/rLn+KAhsz+NrozNk6Slib05my8jVcs/FzyUmM7ZIU9MeHTqA= X-Received: by 2002:a05:622a:7414:b0:467:48f3:3452 with SMTP id d75a77b69052e-46748f339a0mr108799611cf.56.1733683277164; Sun, 08 Dec 2024 10:41:17 -0800 (PST) List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-virtualization@freebsd.org Sender: owner-freebsd-virtualization@FreeBSD.org MIME-Version: 1.0 References: <6B19A54E-78B2-4BDA-94FA-F7558F26DA87@iitbombay.org> In-Reply-To: From: Mark Peek Date: Sun, 8 Dec 2024 10:41:05 -0800 X-Gmail-Original-Message-ID: Message-ID: Subject: Re: Struggle with bhyve and Kali. To: Zaphod Beeblebrox Cc: Bakul Shah , freebsd-virtualization@freebsd.org, Chris Moerz Content-Type: multipart/alternative; boundary="000000000000e391910628c6978b" --000000000000e391910628c6978b Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable On Sun, Dec 8, 2024 at 1:51=E2=80=AFAM Chris Moerz = wrote: > > > On Sat, 7 Dec 2024, Zaphod Beeblebrox wrote: > > > That doesn't seem to help for kali. I found the binary, and I think it > boots... but it goes from the 1080p > > that I select for it down to some 4x3 resolution that is tiny. Then I > think X is up, but I don't get a > > login or any other response to input other than a mouse cursor. > > > > Really, this should be documented (the uefi boot variables thing). I > suppose I'll keep messing with it --- > > maybe booting with the full resolution and the correct file will work > --- which will likely require me to > > mount the efi partition on the host and mess around. > > I believe this actually is documented - at least in the Handbook: > > https://docs.freebsd.org/en/books/handbook/virtualization/#virtualization= -bhyve-uefi > > I remember we added that note in the blue box particularly because of the > behavior you're describing. > > If you have any recommandation or suggestion how to make it clearer, I'm > certainly open to hear it! > > If using vm-bhyve and uefi, make sure these are set in the vm-bhyve config file prior to installing: loader=3D"uefi" uefi_vars=3D"yes" In other words: # vm create kali Now edit kali/kali.conf to add the above and other tweaks to the settings # vm install kali kali-linux-2024.3-installer-amd64.iso Install kali and it reboots. Login and shut it down # vm start kali kali should boot fine now You should now see a kali/uefi-vars.fd file in the virtual machine directory. Mark --000000000000e391910628c6978b Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
On Sun, Dec 8, 2024 at 1:51=E2=80=AFAM Ch= ris Moerz <freebsd@ny-central.= org> wrote:


On Sat, 7 Dec 2024, Zaphod Beeblebrox wrote:

> That doesn't seem to help for kali.=C2=A0 I found the binary, and = I think it boots... but it goes from the 1080p
> that I select for it down to some 4x3 resolution that is tiny.=C2=A0 T= hen I think X is up, but I don't get a
> login or any other response to input other than a mouse cursor.
>
> Really, this should be documented (the uefi boot variables thing).=C2= =A0 I suppose I'll keep messing with it ---
> maybe booting with the full resolution and the correct file will work = --- which will likely require me to
> mount the efi partition on the host and mess around.

I believe this actually is documented - at least in the Handbook:
https://docs.fre= ebsd.org/en/books/handbook/virtualization/#virtualization-bhyve-uefi
I remember we added that note in the blue box particularly because of the behavior you're describing.

If you have any recommandation or suggestion how to make it clearer, I'= m
certainly open to hear it!


If using= vm-bhyve and uefi, make sure these are set in the vm-bhyve config file pri= or to installing:
loader=3D"uefi&qu= ot;
uefi_vars=3D"yes"

In other= words:
# vm create kali
Now edit kali/kali.conf to add= the above and other tweaks to the settings
# vm install kali=C2= =A0kali-linux-2024.3-installer-amd64.iso
Install kali and it rebo= ots. Login and shut it down
# vm start kali
kali should= boot fine now

You should now see a kali/uefi-vars= .fd file in the virtual machine directory.

Mark

--000000000000e391910628c6978b--