From nobody Tue Jul 16 14:38:51 2024 X-Original-To: freebsd-virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4WNhXH1y1Zz5RQ74 for ; Tue, 16 Jul 2024 14:38:55 +0000 (UTC) (envelope-from polarian@polarian.dev) Received: from mail.polarian.dev (mail.polarian.dev [IPv6:2001:8b0:57a:2385::8]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4WNhXG06ldz4P2Y for ; Tue, 16 Jul 2024 14:38:54 +0000 (UTC) (envelope-from polarian@polarian.dev) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=polarian.dev header.s=polarian header.b=pR26ezEV; dmarc=pass (policy=quarantine) header.from=polarian.dev; spf=pass (mx1.freebsd.org: domain of polarian@polarian.dev designates 2001:8b0:57a:2385::8 as permitted sender) smtp.mailfrom=polarian@polarian.dev Received: from PolarianBSD (_gateway [192.168.2.1]) by mail.polarian.dev (Postfix) with ESMTPSA id 6232010A071E for ; Tue, 16 Jul 2024 14:38:52 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=simple/relaxed; d=polarian.dev; s=polarian; t=1721140732; bh=cgLGDug0diXGZzAZwN/gSShEGJshDu6SdYcaT6umB9M=; h=Date:From:To:Subject; b=pR26ezEVWO3eIFdF8dpU0K7VPnXQ+RR6IberST6jrsqXXYJETavhPzKV9zvf6KcCp 1Zxd1YDBW0AUiZIpGkSdqchFzV7UTTA7kCUHPjlX7WTCT7a68h7Pwin+qKmDhEttM/ gBxxQcdR/qwGWXAvWmbsYZl2RgZtRXR0l9sZ/GAQ= Date: Tue, 16 Jul 2024 15:38:51 +0100 From: Polarian To: freebsd-virtualization@FreeBSD.org Subject: nmdm issues with bhyve Message-ID: <20240716153851.60c1ea61@PolarianBSD> X-Mailer: Claws Mail 3.20.0 (GTK+ 2.24.33; amd64-portbld-freebsd14.0) List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-virtualization@freebsd.org Sender: owner-freebsd-virtualization@FreeBSD.org MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.50 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.999]; DMARC_POLICY_ALLOW(-0.50)[polarian.dev,quarantine]; MID_RHS_NOT_FQDN(0.50)[]; R_SPF_ALLOW(-0.20)[+ip6:2001:8b0:57a:2385::8]; R_DKIM_ALLOW(-0.20)[polarian.dev:s=polarian]; MIME_GOOD(-0.10)[text/plain]; RCVD_TLS_ALL(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; DKIM_TRACE(0.00)[polarian.dev:+]; FROM_HAS_DN(0.00)[]; ASN(0.00)[asn:20712, ipnet:2001:8b0::/32, country:GB]; ARC_NA(0.00)[]; TO_DN_NONE(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; RCVD_COUNT_ONE(0.00)[1]; PREVIOUSLY_DELIVERED(0.00)[freebsd-virtualization@freebsd.org]; RCVD_VIA_SMTP_AUTH(0.00)[]; MLMMJ_DEST(0.00)[freebsd-virtualization@FreeBSD.org]; MIME_TRACE(0.00)[0:+] X-Rspamd-Queue-Id: 4WNhXG06ldz4P2Y Hello, Over the last few days I have been trying to get nmdm working with bhyve. I have discussed it within #bhyve over on libera.chat however none of the suggestions so far have fixed the problem, therefore I am bringing it to the mailing list for further support. A rundown what I have done so far, I have a shell script with the following contents: #!/bin/sh bhyve -c 1 -m 1G -u -H \ -s 0,amd_hostbridge \ -s 3,ahci-hd,/path/to/install.img \ -s 4,virtio-blk,/dev/zvol/zpool-storage/dns \ -s 5,virtio-net,tap0 \ -s 31,lpc -l com1,/dev/nmdm3A \ -l bootrom,/usr/local/share/uefi-firmware/BHYVE_UEFI.fd \ dns To verify the virtual machine was in fact booting, I did test stdio, and the install medium for OpenBSD does successfully boot. The problem, well there is many. Following the FAQ entry [1], the following flag is suggested: -s 31,lpc -l com1,nmdm0A (where 0 can be substituted to prevent collisions) Enter problem #1, when I try this by executing the script (with doas, doas sh dns.sh) I get the following: Unable to initialize backend 'nmdm3A' for LPC device com1 Device emulation initialization error: No such file or directory Now, both vmm and nmdm have been loaded, checked with the following commands: kldstat | grep vmm kldstat | grep nmdm And these have been entered into /boot/loader.conf see below: vmm_load="YES" nmdm_load="YES" So they have been loaded into the kernel. When looking into the problem I found an article on the FreeBSD forums which has the same error [2], which would suggest the example in the FAQ is either wrong, or deprecated and no longer works. The solution from this article is to ensure to specify the /dev path, as seen in the full script at the beginning of the email, /dev/nmdm0A, this DOES work and the vm does startup. Problem #2, the device doesn't show up, even though the vm is, in fact, running. ls /dev | grep nmdm The above returns nothing, there is no nmdm device. I have tested it to ensure nmdm is in fact working, using cu to open both A and B and verifying that the data is being passes between them. So nmdm is working! AllanJude on IRC suggested that I change from 0 to some other number in case of conflicts, and so I did (as seen in the script at the beginning of the email) changing 0 --> 3, same issue remains. I can find no further information on this issue, and I am out of ideas, so if anyone has nmdm successfully working, could you give me a hand in getting it to work on my server? The FAQ [1] also suggested pty can be used, or a terminal multiplexer such as tmux, however I am yet to find any examples on how this could be done to substitute nmdm. If anyone has some useful links to some examples for these, that would be great! Thank you, -- Polarian GPG signature: 0770E5312238C760 Jabber/XMPP: polarian@icebound.dev [1] https://wiki.freebsd.org/bhyve#Q:_Does_bhyve_have_an_.22out-of-band.22.2F.22lights-out_management.22_serial_console.3F [2] https://forums.freebsd.org/threads/unable-to-initialize-backend-nmdm0a-for-lpc-device-com1.82177/ From nobody Tue Jul 16 15:06:43 2024 X-Original-To: freebsd-virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4WNj961YVnz5RSDb for ; Tue, 16 Jul 2024 15:07:22 +0000 (UTC) (envelope-from marietto2008@gmail.com) Received: from mail-pg1-x532.google.com (mail-pg1-x532.google.com [IPv6:2607:f8b0:4864:20::532]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "WR4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4WNj956h3Kz4QM2 for ; Tue, 16 Jul 2024 15:07:21 +0000 (UTC) (envelope-from marietto2008@gmail.com) Authentication-Results: mx1.freebsd.org; none Received: by mail-pg1-x532.google.com with SMTP id 41be03b00d2f7-75c5bdab7faso2977679a12.1 for ; Tue, 16 Jul 2024 08:07:21 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1721142440; x=1721747240; darn=freebsd.org; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=2Gmr4r6jDBuGf3OjWKoZxSydQlSbg69N8fdjq3WZ3D8=; b=duqDKmfRLD/KulNLH0yHnMTLqbTYHEkqvL218zRP/E85S3ErQ3tOkRPXgf/0ALSo0d tG+9ncBDZ86aUuIvaMEcWVXJcUUHqiTLpg79ZF/tuGGeq3JsD7UbT6DA30KTO6Rgv0V2 DneVzRVmlh1jq5eb5Aj4Mh0d/7jkl3wDqB+gpeifZp0GghYbkuI9f5G8SCvUrsFUJ2pY vO/FtuTKRJyEKCkElXAQt4GgoMthqk8zV4M88NMuJEdZ76j5gJPrurnpyfucyFuuINK5 Q/TJDhxgVvqIlyHXx4x7YKMLxgmZKDo8K2G2B8T4BZfcODLpIypynnDz7BjmQCVTZzS+ VFbQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1721142440; x=1721747240; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=2Gmr4r6jDBuGf3OjWKoZxSydQlSbg69N8fdjq3WZ3D8=; b=vCZWD7r3nTi9/mKiFJ8wHtsw0/bEPdma6Nc8xJZD8HFFIOpGjgqxkg/PUoZOFOf28R 58JHeYULGMuiwYfYKVP8XTlWu1Rqglb6dultu99KQwkJ5Zkk328irifwsLRGhZADOs7W JiPHdMlDazLO0j12ndXAD5/+sjx2NPj0A3dLCuB/Ygj8E6O2llBqUTJqYRXP5B6X1pOv p8tcrS4mBtE242FgeJbpWJLKPIxw8Cdp/99GDz/046S3R29R+/kMa3pnN0VYrCgJNs4y I6k28UvZOCf3c+ml/YQJ6pgSsdyx6YukZgpWvV2QqWc3bcGNauqk8ucShbnnbCx9NVyS QoxQ== X-Gm-Message-State: AOJu0YwcLKdSWQaQb2XPqr9Tp4jMf8eaCXVwwxH+Mka+kUe70r2Flo5Q f1oD7jRw8C69k/IAt7hlqec7KSAdBD/FHdlIHBwI7xuZTGHFR4bO6VaUKTpaML+7AvVSeiXXO1d ciRzKielieBZj4UhVUsW2WsmHsCigyhtm X-Google-Smtp-Source: AGHT+IFlDZQNtWhWj32wdobTzGAOZklj48V3H3JCPqztqAVmtMXLvfLhLrlPhJWNV1QOcz5R50EVMat19wo+apUTXco= X-Received: by 2002:a05:6a20:4310:b0:1c2:8c8f:aa0c with SMTP id adf61e73a8af0-1c3f11f450emr3172593637.12.1721142439607; Tue, 16 Jul 2024 08:07:19 -0700 (PDT) List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-virtualization@freebsd.org Sender: owner-freebsd-virtualization@FreeBSD.org MIME-Version: 1.0 References: <20240716153851.60c1ea61@PolarianBSD> In-Reply-To: <20240716153851.60c1ea61@PolarianBSD> From: Mario Marietto Date: Tue, 16 Jul 2024 17:06:43 +0200 Message-ID: Subject: Re: nmdm issues with bhyve To: Polarian Cc: freebsd-virtualization@freebsd.org Content-Type: multipart/alternative; boundary="000000000000b885c8061d5eb315" X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US] X-Rspamd-Queue-Id: 4WNj956h3Kz4QM2 --000000000000b885c8061d5eb315 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Hello. In short words,what's nmdm used for ? thanks. On Tue, Jul 16, 2024 at 4:39=E2=80=AFPM Polarian wr= ote: > Hello, > > Over the last few days I have been trying to get nmdm working with > bhyve. I have discussed it within #bhyve over on libera.chat however > none of the suggestions so far have fixed the problem, therefore I am > bringing it to the mailing list for further support. > > A rundown what I have done so far, I have a shell script with the > following contents: > > #!/bin/sh > > bhyve -c 1 -m 1G -u -H \ > -s 0,amd_hostbridge \ > -s 3,ahci-hd,/path/to/install.img \ > -s 4,virtio-blk,/dev/zvol/zpool-storage/dns \ > -s 5,virtio-net,tap0 \ > -s 31,lpc -l com1,/dev/nmdm3A \ > -l bootrom,/usr/local/share/uefi-firmware/BHYVE_UEFI.fd \ > dns > > To verify the virtual machine was in fact booting, I did test stdio, > and the install medium for OpenBSD does successfully boot. > > The problem, well there is many. Following the FAQ entry [1], the > following flag is suggested: > > -s 31,lpc -l com1,nmdm0A > > (where 0 can be substituted to prevent collisions) > > Enter problem #1, when I try this by executing the script (with doas, > doas sh dns.sh) I get the following: > > Unable to initialize backend 'nmdm3A' for LPC device com1 > Device emulation initialization error: No such file or directory > > Now, both vmm and nmdm have been loaded, checked with the following > commands: > > kldstat | grep vmm > kldstat | grep nmdm > > And these have been entered into /boot/loader.conf see below: > > vmm_load=3D"YES" > nmdm_load=3D"YES" > > So they have been loaded into the kernel. > > When looking into the problem I found an article on the FreeBSD forums > which has the same error [2], which would suggest the example in the > FAQ is either wrong, or deprecated and no longer works. > > The solution from this article is to ensure to specify the /dev path, as > seen in the full script at the beginning of the email, /dev/nmdm0A, > this DOES work and the vm does startup. > > Problem #2, the device doesn't show up, even though the vm is, in fact, > running. > > ls /dev | grep nmdm > > The above returns nothing, there is no nmdm device. I have tested it to > ensure nmdm is in fact working, using cu to open both A and B and > verifying that the data is being passes between them. So nmdm is > working! > > AllanJude on IRC suggested that I change from 0 to some other number in > case of conflicts, and so I did (as seen in the script at the beginning > of the email) changing 0 --> 3, same issue remains. > > I can find no further information on this issue, and I am out of ideas, > so if anyone has nmdm successfully working, could you give me a hand in > getting it to work on my server? > > The FAQ [1] also suggested pty can be used, or a terminal multiplexer > such as tmux, however I am yet to find any examples on how this could > be done to substitute nmdm. If anyone has some useful links to some > examples for these, that would be great! > > Thank you, > -- > Polarian > GPG signature: 0770E5312238C760 > Jabber/XMPP: polarian@icebound.dev > > [1] > > https://wiki.freebsd.org/bhyve#Q:_Does_bhyve_have_an_.22out-of-band.22.2F= .22lights-out_management.22_serial_console.3F > [2] > > https://forums.freebsd.org/threads/unable-to-initialize-backend-nmdm0a-fo= r-lpc-device-com1.82177/ > > --=20 Mario. --000000000000b885c8061d5eb315 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
Hello.

In short words,what&#= 39;s nmdm used for ? thanks.

=
On Tue, Jul 16, 2024 at 4:39=E2=80=AF= PM Polarian <polarian@polarian.= dev> wrote:
Hello,

Over the last few days I have been trying to get nmdm working with
bhyve. I have discussed it within #bhyve over on libera.chat however
none of the suggestions so far have fixed the problem, therefore I am
bringing it to the mailing list for further support.

A rundown what I have done so far, I have a shell script with the
following contents:

#!/bin/sh

bhyve -c 1 -m 1G -u -H \
=C2=A0 =C2=A0 =C2=A0 =C2=A0 -s 0,amd_hostbridge \
=C2=A0 =C2=A0 =C2=A0 =C2=A0 -s 3,ahci-hd,/path/to/install.img \
=C2=A0 =C2=A0 =C2=A0 =C2=A0 -s 4,virtio-blk,/dev/zvol/zpool-storage/dns \ =C2=A0 =C2=A0 =C2=A0 =C2=A0 -s 5,virtio-net,tap0 \
=C2=A0 =C2=A0 =C2=A0 =C2=A0 -s 31,lpc -l com1,/dev/nmdm3A \
=C2=A0 =C2=A0 =C2=A0 =C2=A0 -l bootrom,/usr/local/share/uefi-firmware/BHYVE= _UEFI.fd \
=C2=A0 =C2=A0 =C2=A0 =C2=A0 dns

To verify the virtual machine was in fact booting, I did test stdio,
and the install medium for OpenBSD does successfully boot.

The problem, well there is many. Following the FAQ entry [1], the
following flag is suggested:

-s 31,lpc -l com1,nmdm0A

(where 0 can be substituted to prevent collisions)

Enter problem #1, when I try this by executing the script (with doas,
doas sh dns.sh) I get the following:

Unable to initialize backend 'nmdm3A' for LPC device com1
Device emulation initialization error: No such file or directory

Now, both vmm and nmdm have been loaded, checked with the following
commands:

kldstat | grep vmm
kldstat | grep nmdm

And these have been entered into /boot/loader.conf see below:

vmm_load=3D"YES"
nmdm_load=3D"YES"

So they have been loaded into the kernel.

When looking into the problem I found an article on the FreeBSD forums
which has the same error [2], which would suggest the example in the
FAQ is either wrong, or deprecated and no longer works.

The solution from this article is to ensure to specify the /dev path, as seen in the full script at the beginning of the email, /dev/nmdm0A,
this DOES work and the vm does startup.

Problem #2, the device doesn't show up, even though the vm is, in fact,=
running.

ls /dev | grep nmdm

The above returns nothing, there is no nmdm device. I have tested it to
ensure nmdm is in fact working, using cu to open both A and B and
verifying that the data is being passes between them. So nmdm is
working!

AllanJude on IRC suggested that I change from 0 to some other number in
case of conflicts, and so I did (as seen in the script at the beginning
of the email) changing 0 --> 3, same issue remains.

I can find no further information on this issue, and I am out of ideas,
so if anyone has nmdm successfully working, could you give me a hand in
getting it to work on my server?

The FAQ [1] also suggested pty can be used, or a terminal multiplexer
such as tmux, however I am yet to find any examples on how this could
be done to substitute nmdm. If anyone has some useful links to some
examples for these, that would be great!

Thank you,
--
Polarian
GPG signature: 0770E5312238C760
Jabber/XMPP: pol= arian@icebound.dev

[1]
https://wiki.freebsd.org/bhyve#Q:_Does_bhyve_have_an_.22o= ut-of-band.22.2F.22lights-out_management.22_serial_console.3F
[2]
htt= ps://forums.freebsd.org/threads/unable-to-initialize-backend-nmdm0a-for-lpc= -device-com1.82177/



--
Mario.
--000000000000b885c8061d5eb315-- From nobody Tue Jul 16 15:16:47 2024 X-Original-To: freebsd-virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4WNjNF4B1nz5RSVm for ; Tue, 16 Jul 2024 15:17:01 +0000 (UTC) (envelope-from bakul@iitbombay.org) Received: from mail-pl1-x631.google.com (mail-pl1-x631.google.com [IPv6:2607:f8b0:4864:20::631]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "WR4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4WNjNF2VlCz4RHl for ; Tue, 16 Jul 2024 15:17:01 +0000 (UTC) (envelope-from bakul@iitbombay.org) Authentication-Results: mx1.freebsd.org; none Received: by mail-pl1-x631.google.com with SMTP id d9443c01a7336-1fb457b53c8so46326905ad.0 for ; Tue, 16 Jul 2024 08:17:01 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=iitbombay-org.20230601.gappssmtp.com; s=20230601; t=1721143019; x=1721747819; darn=freebsd.org; h=to:references:message-id:content-transfer-encoding:cc:date :in-reply-to:from:subject:mime-version:from:to:cc:subject:date :message-id:reply-to; bh=P1CUfkmVXqyiqKp4EP0VxP+T1iHsGJymf+jwZxOEfsk=; b=tyaEwC89yFFBXWfxHCi6VfG8LW9tQByq2IQ2eSkdf/GFe6KxfNI91km/LWxzrDhaqp 5RrL/pn+x6mrXRCJQC1mA6f8kpiAGVql/hy+wLprMhqx4RwPuozWq3ZQFHgrgdo/WQfH EPXDsXqVk7kt//ZAf0cjSk66nKOAJXPWAoD2/mrMXrJ9bJNduC8+7fi2oFcorXVOtuyF 6U0WlfJCiUw5tUwVL/gWv/Ji7qKhpppaFR0CL7rtGzIqAPVWqV9FK1INXkEyUEuSIm+Y g1FZqUr0ap4O4QLiain1IBYN4Aslc81Pt37LzahmfVH2+k7KjllAUBhcB3js2gvht53e QxFA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1721143019; x=1721747819; h=to:references:message-id:content-transfer-encoding:cc:date :in-reply-to:from:subject:mime-version:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=P1CUfkmVXqyiqKp4EP0VxP+T1iHsGJymf+jwZxOEfsk=; b=DFVSAmLQjsLGlbbwTm5gIKSr1Hs5CosEEuX6wRdVRDftd1YDw2EdUshIBay23HCxd7 hlDOzTHYj7DvRG5pYtnG/aKOqcr1YygLS5d9saDiUOxrTLVuqraE/v1sif8yfCbmu/u+ 4/YxIlUeXZrD/9x4gMb2wbnlvvOsNwnKVfXf5F/42ady7GzTR679+bES80z6ckXu8OWt SueE808b6zpFFhoDeYjFIchokb8vqywUSASWbwJQ9GcvqwCPmB/ygMGjFyY3lHIyLVM/ K/s5Ne12ivYZK0azFHjsPHJPRyqse8TtofLQ+I82VA/rG8K3NtAjqUGUz/TlHj2LZnmi 8lAA== X-Gm-Message-State: AOJu0YydG9QGPbQlL1+5RtE6WeLZUWf+W20rD/LHgcfU3WcTZgovGtGQ adxlteYmo73qJLLcT5LDyeaOXKKFEM4eLWs9sjtZXoESPaCkQBPHi3xz+3/v7RUgdLXWWV6Q24s = X-Google-Smtp-Source: AGHT+IEbTHrZWykw+7RZ9l4KNGtjlnN+UKiBXp4L8lpetLZY9pVj2OKkZQOb3Ci3bWiYH+JiG26ajA== X-Received: by 2002:a17:902:d484:b0:1fb:5b83:48d9 with SMTP id d9443c01a7336-1fc3d95861dmr16227505ad.37.1721143019259; Tue, 16 Jul 2024 08:16:59 -0700 (PDT) Received: from smtpclient.apple (107-215-223-229.lightspeed.sntcca.sbcglobal.net. [107.215.223.229]) by smtp.gmail.com with ESMTPSA id d9443c01a7336-1fc0eea3cfbsm58001665ad.115.2024.07.16.08.16.58 (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Tue, 16 Jul 2024 08:16:58 -0700 (PDT) Content-Type: text/plain; charset=utf-8 List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-virtualization@freebsd.org Sender: owner-freebsd-virtualization@FreeBSD.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3774.600.62\)) Subject: Re: nmdm issues with bhyve From: Bakul Shah In-Reply-To: <20240716153851.60c1ea61@PolarianBSD> Date: Tue, 16 Jul 2024 08:16:47 -0700 Cc: "freebsd-virtualization@freebsd.org" Content-Transfer-Encoding: quoted-printable Message-Id: <2137018B-1F61-423F-B17A-6EF8CC60314F@iitbombay.org> References: <20240716153851.60c1ea61@PolarianBSD> To: Polarian X-Mailer: Apple Mail (2.3774.600.62) X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US] X-Rspamd-Queue-Id: 4WNjNF2VlCz4RHl On Jul 16, 2024, at 7:38=E2=80=AFAM, Polarian = wrote: >=20 > -s 31,lpc -l com1,/dev/nmdm3A \ I use the B device here, as in /dev/nmdm3B > ls /dev | grep nmdm >=20 > The above returns nothing, there is no nmdm device. I have tested it = to > ensure nmdm is in fact working, using cu to open both A and B and > verifying that the data is being passes between them. So nmdm is > working! They seem to get generated on demand. e.g if you do cu -l /dev/nmdm3A Both A and B devices will get generated. From nobody Tue Jul 16 15:56:10 2024 X-Original-To: virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4WNkFV4pgCz5RWVv for ; Tue, 16 Jul 2024 15:56:14 +0000 (UTC) (envelope-from polarian@polarian.dev) Received: from mail.polarian.dev (mail.polarian.dev [IPv6:2001:8b0:57a:2385::8]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4WNkFT6SyXz4ZBp for ; Tue, 16 Jul 2024 15:56:13 +0000 (UTC) (envelope-from polarian@polarian.dev) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=polarian.dev header.s=polarian header.b=kR3w++m1; dmarc=pass (policy=quarantine) header.from=polarian.dev; spf=pass (mx1.freebsd.org: domain of polarian@polarian.dev designates 2001:8b0:57a:2385::8 as permitted sender) smtp.mailfrom=polarian@polarian.dev Received: from PolarianBSD (_gateway [192.168.2.1]) by mail.polarian.dev (Postfix) with ESMTPSA id 20C7D10A1554 for ; Tue, 16 Jul 2024 15:56:11 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=simple/relaxed; d=polarian.dev; s=polarian; t=1721145371; bh=0yuIB25D2zmeKltMZRuCTgYQD65Lk86Mju6HiW5k2ts=; h=Date:From:To:Subject:In-Reply-To:References; b=kR3w++m1Uuud9R/BZeayX0cdPYbPjZ7CgXC4OJ1K+8s2KFKsRd+F4MBgLMqUkxkO8 FZ0O/53MBsIV0oD+Va7WHwY6N1ncNiwRddjN4HPRMCt7m/j0WchAViNWBUG/jkPCPp YkzwkejRvTjXpV9cNq1JJ01MODavuSEJvqQBaXMA= Date: Tue, 16 Jul 2024 16:56:10 +0100 From: Polarian To: virtualization@freebsd.org Subject: Re: nmdm issues with bhyve Message-ID: <20240716165610.5c0066fb@PolarianBSD> In-Reply-To: <2137018B-1F61-423F-B17A-6EF8CC60314F@iitbombay.org> References: <20240716153851.60c1ea61@PolarianBSD> <2137018B-1F61-423F-B17A-6EF8CC60314F@iitbombay.org> X-Mailer: Claws Mail 3.20.0 (GTK+ 2.24.33; amd64-portbld-freebsd14.0) List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-virtualization@freebsd.org Sender: owner-freebsd-virtualization@FreeBSD.org MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.50 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-1.000]; DMARC_POLICY_ALLOW(-0.50)[polarian.dev,quarantine]; MID_RHS_NOT_FQDN(0.50)[]; R_SPF_ALLOW(-0.20)[+ip6:2001:8b0:57a:2385::8]; R_DKIM_ALLOW(-0.20)[polarian.dev:s=polarian]; MIME_GOOD(-0.10)[text/plain]; RCVD_TLS_ALL(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; DKIM_TRACE(0.00)[polarian.dev:+]; FROM_HAS_DN(0.00)[]; ASN(0.00)[asn:20712, ipnet:2001:8b0::/32, country:GB]; ARC_NA(0.00)[]; TO_DN_NONE(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; RCVD_COUNT_ONE(0.00)[1]; PREVIOUSLY_DELIVERED(0.00)[virtualization@freebsd.org]; RCVD_VIA_SMTP_AUTH(0.00)[]; MLMMJ_DEST(0.00)[virtualization@freebsd.org]; MIME_TRACE(0.00)[0:+] X-Rspamd-Queue-Id: 4WNkFT6SyXz4ZBp Hello, I will reply to both emails here. Mario: > In short words,what's nmdm used for ? thanks. nmdm(4) (null modem) allows to connect two devices through serial communication. The nmdm device simply allows two devices, A and B to pass data to one another. What I am trying to do is get bhyve to redirect the output from com1 to a nmdm device, which would allow me to cu to read the output from com1 on the host (instead of using stdio or vnc). Therefore allowing configuration of the virtual machine over ssh instead of having to use vnc which has security implications when used remotely. For more information on null modem see the man page, or [1]. Bakul: > I use the B device here, as in /dev/nmdm3B I do not believe this would make a difference but I will give it a go anyways, thanks :) > They seem to get generated on demand. e.g if you do >=20 > cu -l /dev/nmdm3A >=20 > Both A and B devices will get generated. Yes, nmdm(4) already states this: "The nmdm driver implements =E2=80=9Con-demand device creation=E2=80=9D so = simply accessing a given instance in /dev will create it." However that is not the issue, the issue is that bhyve SHOULD have created it, if there is data from com1 going to a nmdm device as specified in the bhyve command, then the devices should be appearing, but they are not, that is what I can't figure out. Thank you, --=20 Polarian GPG signature: 0770E5312238C760 Jabber/XMPP: polarian@icebound.dev [1] https://en.wikipedia.org/wiki/Null_modem From nobody Tue Jul 16 16:11:55 2024 X-Original-To: virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4WNkbf2jb9z5RXsL for ; Tue, 16 Jul 2024 16:11:58 +0000 (UTC) (envelope-from polarian@polarian.dev) Received: from mail.polarian.dev (mail.polarian.dev [IPv6:2001:8b0:57a:2385::8]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4WNkbd6FXgz4bf2 for ; Tue, 16 Jul 2024 16:11:57 +0000 (UTC) (envelope-from polarian@polarian.dev) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=polarian.dev header.s=polarian header.b="H/qd0R08"; dmarc=pass (policy=quarantine) header.from=polarian.dev; spf=pass (mx1.freebsd.org: domain of polarian@polarian.dev designates 2001:8b0:57a:2385::8 as permitted sender) smtp.mailfrom=polarian@polarian.dev Received: from PolarianBSD (_gateway [192.168.2.1]) by mail.polarian.dev (Postfix) with ESMTPSA id 5BF2310A1554 for ; Tue, 16 Jul 2024 16:11:56 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=simple/relaxed; d=polarian.dev; s=polarian; t=1721146316; bh=KkvNOI+Ftl70kwNF7HipgYnSThMFCecQRJ94l08HjSg=; h=Date:From:To:Subject:In-Reply-To:References; b=H/qd0R08uUzX+d3aZjn+RMt6dB1CE01KMZvfDTNi4gO2+Q7oAE2VQJYe8PMPVi1N5 ywFqXJDnha2ckAL69iE8M/KN7/AURpymLmb3fRb7Xw5BVHhzzGMqKmo3RxnKnVnFqe nZj7/WTjtBNM9e+EGh8tlMU5zl3+SqUcZnOB4HxM= Date: Tue, 16 Jul 2024 17:11:55 +0100 From: Polarian To: virtualization@freebsd.org Subject: Re: nmdm issues with bhyve Message-ID: <20240716171155.55b32e8a@PolarianBSD> In-Reply-To: <20240716165610.5c0066fb@PolarianBSD> References: <20240716153851.60c1ea61@PolarianBSD> <2137018B-1F61-423F-B17A-6EF8CC60314F@iitbombay.org> <20240716165610.5c0066fb@PolarianBSD> X-Mailer: Claws Mail 3.20.0 (GTK+ 2.24.33; amd64-portbld-freebsd14.0) List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-virtualization@freebsd.org Sender: owner-freebsd-virtualization@FreeBSD.org MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.50 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-1.000]; MID_RHS_NOT_FQDN(0.50)[]; DMARC_POLICY_ALLOW(-0.50)[polarian.dev,quarantine]; R_DKIM_ALLOW(-0.20)[polarian.dev:s=polarian]; R_SPF_ALLOW(-0.20)[+ip6:2001:8b0:57a:2385::8:c]; MIME_GOOD(-0.10)[text/plain]; RCVD_COUNT_ONE(0.00)[1]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:20712, ipnet:2001:8b0::/32, country:GB]; RCVD_TLS_ALL(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; FROM_EQ_ENVFROM(0.00)[]; FROM_HAS_DN(0.00)[]; MLMMJ_DEST(0.00)[virtualization@freebsd.org]; TO_DN_NONE(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[virtualization@freebsd.org]; TO_MATCH_ENVRCPT_ALL(0.00)[]; DKIM_TRACE(0.00)[polarian.dev:+] X-Rspamd-Queue-Id: 4WNkbd6FXgz4bf2 Quick follow up email, Substituting B for A has not made any difference, no device shows up. Thank you, -- Polarian GPG signature: 0770E5312238C760 Jabber/XMPP: polarian@icebound.dev From nobody Tue Jul 16 20:15:57 2024 X-Original-To: virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4WNr1B4Sjgz5Q9DF for ; Tue, 16 Jul 2024 20:15:58 +0000 (UTC) (envelope-from kevans@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [IPv6:2610:1c1:1:606c::24b:4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R10" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4WNr1B3y8sz48Wk for ; Tue, 16 Jul 2024 20:15:58 +0000 (UTC) (envelope-from kevans@FreeBSD.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1721160958; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=Q1TFDZCQqZF4DuM82765fnwLPVsgDkezsAEV0/sgy1g=; b=nX5WTlc6V3v0JnIUt/NhFb5rmEXamE1o/94f8VnShHyzcV8WWVSxynSOpncNddVdGF5Iaw QdEBFyRR6T+OiRNIkgRbO0QixouU0qnmp7CBWnJYqdHywomT7F9aTz5NNyoJo3KeGTdIGw V3ME6ATbGKNBtSN9pvbqCNmPUBymrJq63LJkVMGEtKvrZqxABqyLfazsYSGlESjOLvIuO/ Pbn9YEGi8poiP58wdZ5I43YErgAGBGKT9MBqLi04DQXtce1vMMXAoMsafmNfjQ5+e/3s9D U5xPdKieNPk9xiOTlLV/D9BprhQIvDMxmtGJJ09m3CBk3w9Wg6yVEGyptexKcw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1721160958; a=rsa-sha256; cv=none; b=RAAO0o4e3rOYBW5bmgyhmhk9N1kmEfVWB1FX5gjth7uDDf7olWmD6p7u+okNMUwifgAQee AObxNtEdU3OWfvSfnjII77sT+8aEGB5m5CL/EzDEw7KNL5JiroUZb1qZIuAQP0+VZI44PA AoKMJqivxl0KNcpq5O2a2cTyPtB87o69n6lqn27xAw0CSmQZ982yNx1PN7XIcpvAqh+hj0 gnEbrErdqqdsqwu+Qgo796KpJj4+/Nn8dwbQklfYQfdl/ty3NGV3TEawGZNOUXwugKxExb n+F1lonKrZ1T6XT4wdWfkHV7n+WdLOZ4ZUtQpJvr8GOaevAvRzdMvs1TdZcB6w== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1721160958; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=Q1TFDZCQqZF4DuM82765fnwLPVsgDkezsAEV0/sgy1g=; b=aVzoLMypUl0qNjLv72wsAjULhJji8X4FRtbpRELTq/ETBSAP2Sv56o+iaze5169c3+Qxag VBM9drPdwidgHcrZ8B+e5qu/25PTztoEjaIsMGRfAacBX4YjqElMPrd3Wtwwh8KV/5A079 eCCAgF2wNetERCpE/9bpTgcF9sX66j1uRV0fyJ8qw3VJ+HGGAIMvl1mNX1w7pXb9NTEp3r v7YMSe2Zn2dVWe5RmfdIwMlPkZb6ItihTiAH8u2ONDzu/iD20XYqbertWdqSrO5PoImt4r Ta35QYq6r/dU6//fVTMUualPnE5t75dEAoUu3gejS/4z/D1uEfQTkrGqriDuMg== Received: from [10.9.4.95] (unknown [209.182.120.176]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits)) (Client did not present a certificate) (Authenticated sender: kevans/mail) by smtp.freebsd.org (Postfix) with ESMTPSA id 4WNr1B2JGczhrl for ; Tue, 16 Jul 2024 20:15:58 +0000 (UTC) (envelope-from kevans@FreeBSD.org) Message-ID: <16dfe6b3-2ef1-4859-a5b0-a36efe452804@FreeBSD.org> Date: Tue, 16 Jul 2024 15:15:57 -0500 List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-virtualization@freebsd.org Sender: owner-freebsd-virtualization@FreeBSD.org MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Subject: Re: nmdm issues with bhyve To: virtualization@freebsd.org References: <20240716153851.60c1ea61@PolarianBSD> Content-Language: en-US From: Kyle Evans In-Reply-To: <20240716153851.60c1ea61@PolarianBSD> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit On 7/16/24 09:38, Polarian wrote: > Hello, > > Over the last few days I have been trying to get nmdm working with > bhyve. I have discussed it within #bhyve over on libera.chat however > none of the suggestions so far have fixed the problem, therefore I am > bringing it to the mailing list for further support. > > A rundown what I have done so far, I have a shell script with the > following contents: > > #!/bin/sh > > bhyve -c 1 -m 1G -u -H \ > -s 0,amd_hostbridge \ > -s 3,ahci-hd,/path/to/install.img \ > -s 4,virtio-blk,/dev/zvol/zpool-storage/dns \ > -s 5,virtio-net,tap0 \ > -s 31,lpc -l com1,/dev/nmdm3A \ > -l bootrom,/usr/local/share/uefi-firmware/BHYVE_UEFI.fd \ > dns > > To verify the virtual machine was in fact booting, I did test stdio, > and the install medium for OpenBSD does successfully boot. > > The problem, well there is many. Following the FAQ entry [1], the > following flag is suggested: > > -s 31,lpc -l com1,nmdm0A > > (where 0 can be substituted to prevent collisions) > > Enter problem #1, when I try this by executing the script (with doas, > doas sh dns.sh) I get the following: > > Unable to initialize backend 'nmdm3A' for LPC device com1 > Device emulation initialization error: No such file or directory > > Now, both vmm and nmdm have been loaded, checked with the following > commands: > > kldstat | grep vmm > kldstat | grep nmdm > > And these have been entered into /boot/loader.conf see below: > > vmm_load="YES" > nmdm_load="YES" > > So they have been loaded into the kernel. > > When looking into the problem I found an article on the FreeBSD forums > which has the same error [2], which would suggest the example in the > FAQ is either wrong, or deprecated and no longer works. > > The solution from this article is to ensure to specify the /dev path, as > seen in the full script at the beginning of the email, /dev/nmdm0A, > this DOES work and the vm does startup. > > Problem #2, the device doesn't show up, even though the vm is, in fact, > running. > > ls /dev | grep nmdm > > The above returns nothing, there is no nmdm device. I have tested it to > ensure nmdm is in fact working, using cu to open both A and B and > verifying that the data is being passes between them. So nmdm is > working! > We did some light debugging in #freebsd on this; bhyve(8) is opening the nmdm pair as it should and that works fine, but I guess at some point (perhaps right after handoff to the OpenBSD kernel) it's getting closed so the device isn't around anymore by the time they try to observe it above. They attempted a run with stdio in otherwise the same configuration, and it cut off right after: booting hd0a:/7.5/amd64/bsd.rd: 4076463+1688576+3891240+0+708608 [109+464016+317541]=0xaa40e8 entry point at 0x1001000 wrmsr to register 0xc0011029(0x3) on vcpu 0 Thanks, Kyle Evans From nobody Tue Jul 16 20:39:47 2024 X-Original-To: virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4WNrXx5xc4z5QC8X for ; Tue, 16 Jul 2024 20:40:01 +0000 (UTC) (envelope-from bakul@iitbombay.org) Received: from mail-pj1-x1032.google.com (mail-pj1-x1032.google.com [IPv6:2607:f8b0:4864:20::1032]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "WR4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4WNrXx2Mh7z4Fbn for ; Tue, 16 Jul 2024 20:40:01 +0000 (UTC) (envelope-from bakul@iitbombay.org) Authentication-Results: mx1.freebsd.org; none Received: by mail-pj1-x1032.google.com with SMTP id 98e67ed59e1d1-2c96187b3d1so3876638a91.3 for ; Tue, 16 Jul 2024 13:40:01 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=iitbombay-org.20230601.gappssmtp.com; s=20230601; t=1721162399; x=1721767199; darn=freebsd.org; h=to:references:message-id:content-transfer-encoding:cc:date :in-reply-to:from:subject:mime-version:from:to:cc:subject:date :message-id:reply-to; bh=BhYkpcI1gCVbBUCeG/aPIKuQ5zZUJ8jagxD4SOY3TKU=; b=C4puxin66oYFnVWU3KdDAF5SvB9GwIaH6wyn6YKRM4wHB+PEaPL2QusaUHLpyzOzpj q7nBIduE0PM7KG8qbLyo2OhIrccyhdvts3OgXrdYLEhuYFe1CCX4k1px0aWQl5spj1Fp Yg8Vf3j1Lzf5oTjNrKu6YaqdbvTJG+kxi92XHShSsgHttvPBgsoU8rc4jZI1UXtEWTr0 WxCX2pl4lKH6ixAczB36HSxYicjQoHsGg3eHCKkR3wtIi+mWyX3r+UvYo0r/4eUU78Mt PgNsD5X96CmOnbieL6MQzmvFWCxILR8RiaJ5jvnPi0nXcjATfqqD88t3/jpUFILJ8PT5 gDxA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1721162399; x=1721767199; h=to:references:message-id:content-transfer-encoding:cc:date :in-reply-to:from:subject:mime-version:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=BhYkpcI1gCVbBUCeG/aPIKuQ5zZUJ8jagxD4SOY3TKU=; b=kOa7nRjxxYNwfBHGS6qv00I2lIikZzhMe7ZY+tzZiJDIh+Tm0XvUZedjoAAlKWbY1B VmIikJrV75Jy6P+XqaCNXyKy6rTdVvj9lg76b02D5IM6OexVFzQxYhN6K/yrcgK9VzQZ Xy0mxjfmqinLE+7kKNQArcD9pEJAEREAOYRwLucUE3yvwnwNcGNSWrTGZqXzKF657wB6 p8h4Rk+93S6omk2mtmp/zvv43Abkoa8z96puP5IekwlPtRFvn3Omx+jKiA3kpBifyyoz LYkQpILWVGs1O4mPdma9KDsz9IUsRnm7Dlfk0elk1vJkqveFpHQt94O4Mo7bJKPpU9ZU Jyow== X-Gm-Message-State: AOJu0YwWphIcQDUmeAflmhz7K4iefCGAhyVNa7+5V/rC5R3/SeXsjFof p1yee/z3ZNSVmGwHXZP41VWd3gMseZaUSTQTW0ICVkYPMr0U3hsbYmI6EjhhfQ== X-Google-Smtp-Source: AGHT+IFnV3n7NUs1v/ARBr/qjJLO9Szn6IPoAxPIf7lobY17q25/105SjWIqQvT+AeQbcSoBPDY9rg== X-Received: by 2002:a17:90a:62c6:b0:2c9:358c:babf with SMTP id 98e67ed59e1d1-2cb37455deamr2609417a91.36.1721162398831; Tue, 16 Jul 2024 13:39:58 -0700 (PDT) Received: from smtpclient.apple (107-215-223-229.lightspeed.sntcca.sbcglobal.net. [107.215.223.229]) by smtp.gmail.com with ESMTPSA id 98e67ed59e1d1-2cacd3e5a87sm8826794a91.14.2024.07.16.13.39.57 (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Tue, 16 Jul 2024 13:39:58 -0700 (PDT) Content-Type: text/plain; charset=utf-8 List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-virtualization@freebsd.org Sender: owner-freebsd-virtualization@FreeBSD.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3774.600.62\)) Subject: Re: nmdm issues with bhyve From: Bakul Shah In-Reply-To: <16dfe6b3-2ef1-4859-a5b0-a36efe452804@FreeBSD.org> Date: Tue, 16 Jul 2024 13:39:47 -0700 Cc: virtualization@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: References: <20240716153851.60c1ea61@PolarianBSD> <16dfe6b3-2ef1-4859-a5b0-a36efe452804@FreeBSD.org> To: Kyle Evans X-Mailer: Apple Mail (2.3774.600.62) X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US] X-Rspamd-Queue-Id: 4WNrXx2Mh7z4Fbn > On Jul 16, 2024, at 1:15=E2=80=AFPM, Kyle Evans = wrote: >=20 > On 7/16/24 09:38, Polarian wrote: >> Hello, >> Over the last few days I have been trying to get nmdm working with >> bhyve. I have discussed it within #bhyve over on libera.chat however >> none of the suggestions so far have fixed the problem, therefore I am >> bringing it to the mailing list for further support. >> A rundown what I have done so far, I have a shell script with the >> following contents: >> #!/bin/sh >> bhyve -c 1 -m 1G -u -H \ >> -s 0,amd_hostbridge \ >> -s 3,ahci-hd,/path/to/install.img \ >> -s 4,virtio-blk,/dev/zvol/zpool-storage/dns \ >> -s 5,virtio-net,tap0 \ >> -s 31,lpc -l com1,/dev/nmdm3A \ >> -l bootrom,/usr/local/share/uefi-firmware/BHYVE_UEFI.fd \ >> dns >> To verify the virtual machine was in fact booting, I did test stdio, >> and the install medium for OpenBSD does successfully boot. >> The problem, well there is many. Following the FAQ entry [1], the >> following flag is suggested: >> -s 31,lpc -l com1,nmdm0A >> (where 0 can be substituted to prevent collisions) >> Enter problem #1, when I try this by executing the script (with doas, >> doas sh dns.sh) I get the following: >> Unable to initialize backend 'nmdm3A' for LPC device com1 >> Device emulation initialization error: No such file or directory >> Now, both vmm and nmdm have been loaded, checked with the following >> commands: >> kldstat | grep vmm >> kldstat | grep nmdm >> And these have been entered into /boot/loader.conf see below: >> vmm_load=3D"YES" >> nmdm_load=3D"YES" >> So they have been loaded into the kernel. >> When looking into the problem I found an article on the FreeBSD = forums >> which has the same error [2], which would suggest the example in the >> FAQ is either wrong, or deprecated and no longer works. >> The solution from this article is to ensure to specify the /dev path, = as >> seen in the full script at the beginning of the email, /dev/nmdm0A, >> this DOES work and the vm does startup. >> Problem #2, the device doesn't show up, even though the vm is, in = fact, >> running. >> ls /dev | grep nmdm >> The above returns nothing, there is no nmdm device. I have tested it = to >> ensure nmdm is in fact working, using cu to open both A and B and >> verifying that the data is being passes between them. So nmdm is >> working! >=20 > We did some light debugging in #freebsd on this; bhyve(8) is opening = the nmdm pair as it should and that works fine, but I guess at some = point (perhaps right after handoff to the OpenBSD kernel) it's getting = closed so the device isn't around anymore by the time they try to = observe it above. They attempted a run with stdio in otherwise the same = configuration, and it cut off right after: >=20 > booting hd0a:/7.5/amd64/bsd.rd: 4076463+1688576+3891240+0+708608 = [109+464016+317541]=3D0xaa40e8 > entry point at 0x1001000 > wrmsr to register 0xc0011029(0x3) on vcpu 0 This is what I used for openbsd (later upgraded to 7.5): bhyve -c 1 \ -s 0,hostbridge \ -s 4,ahci-hd,install74.img \ -s 5,nvme,obsd.img \ -s 10,e1000,tap6 \ -s 11,fbuf,tcp=3D0.0.0.0:5907 \ -s 20,xhci,tablet \ -s 31,lpc \ -l bootrom,/usr/local/share/uefi-firmware/BHYVE_UEFI.fd \ -m 2G -H -w \ -l com1,/dev/nmdm4B \ obsd exit 0 Once installed, move the "-s 4,..." line below "exit 0". Move the "-s 11,..." line below exit if you don't want to connect via VNC. Never tried installing 7.5 from scratch. From nobody Tue Jul 16 23:12:22 2024 X-Original-To: virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4WNvws3GHXz5QSLt for ; Tue, 16 Jul 2024 23:12:29 +0000 (UTC) (envelope-from SRS0=+cz1=OQ=freebsd.org=grehan@iredmail.onthenet.com.au) Received: from alto.onthenet.com.au (alto.OntheNet.com.au [203.13.68.12]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4WNvws0BMYz4T8x for ; Tue, 16 Jul 2024 23:12:27 +0000 (UTC) (envelope-from SRS0=+cz1=OQ=freebsd.org=grehan@iredmail.onthenet.com.au) Authentication-Results: mx1.freebsd.org; none Received: from iredmail.onthenet.com.au (iredmail.onthenet.com.au [203.13.68.150]) by alto.onthenet.com.au (Postfix) with ESMTPS id A3AC320B49B3 for ; Wed, 17 Jul 2024 09:12:22 +1000 (AEST) Received: from iredmail.onthenet.com.au (iredmail.onthenet.com.au [127.0.0.1]) by iredmail.onthenet.com.au (Postfix) with ESMTP id 9CC432127CB9 for ; Wed, 17 Jul 2024 09:12:22 +1000 (AEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=nt.com.au; h= content-transfer-encoding:content-type:content-type:in-reply-to :from:from:references:to:content-language:subject:subject :user-agent:mime-version:date:date:message-id; s=dkim; t= 1721171542; x=1723763543; bh=CEyNM33zM3ttUSDRu6VYw1tvu3ngmc36yxG G2AkDJQw=; b=V/bBZfHICenzhm8uvHnygiCd/cX8m8oA9VheOlOrApVxfEyeDNW NOc6i6gUJZ2+v/fiwHyi9iExDW7X+N2bZSUpWkRqfBcRorEl78NuF8UQ2jxOMBnj uQT8o8x/OacrmgtChJRLugWeymRtyFJwDXnz4aT5qTz1FaKUdH9SVlU4= Received: from iredmail.onthenet.com.au ([127.0.0.1]) by iredmail.onthenet.com.au (iredmail.onthenet.com.au [127.0.0.1]) (amavisd-new, port 10026) with ESMTP id rI9olZyoKqF5 for ; Wed, 17 Jul 2024 09:12:22 +1000 (AEST) Received: from [192.168.1.118] (otn-120-29-26-72.broadband.onthenet.net [120.29.26.72]) by iredmail.onthenet.com.au (Postfix) with ESMTPSA id 7B5432127CB7; Wed, 17 Jul 2024 09:12:22 +1000 (AEST) Message-ID: <4b081401-4f57-42b7-9795-c7c3885e3b68@freebsd.org> Date: Wed, 17 Jul 2024 09:12:22 +1000 List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-virtualization@freebsd.org Sender: owner-freebsd-virtualization@FreeBSD.org MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Subject: Re: nmdm issues with bhyve Content-Language: en-US To: Kyle Evans , virtualization@freebsd.org References: <20240716153851.60c1ea61@PolarianBSD> <16dfe6b3-2ef1-4859-a5b0-a36efe452804@FreeBSD.org> From: Peter Grehan In-Reply-To: <16dfe6b3-2ef1-4859-a5b0-a36efe452804@FreeBSD.org> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit X-CMAE-Score: 0 X-CMAE-Analysis: v=2.4 cv=Fu4D/Xrq c=1 sm=1 tr=0 ts=6696fe56 a=A6CF0fG5TOl4vs6YHvqXgw==:117 a=a4bhmx2LhB2xo2qa/CUXUA==:17 a=IkcTkHD0fZMA:10 a=4kmOji7k6h8A:10 a=zuic0gOjEFedAopvo_8A:9 a=QEXdDO2ut3YA:10 X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; TAGGED_FROM(0.00)[cz1=OQ=freebsd.org=grehan]; ASN(0.00)[asn:9313, ipnet:203.13.68.0/24, country:AU] X-Rspamd-Queue-Id: 4WNvws0BMYz4T8x > wrmsr to register 0xc0011029(0x3) on vcpu 0 The -w option is needed so that bhyve won't exit on accessing an unimplemented MSR (that particular one is harmless). later, Peter. From nobody Wed Jul 17 01:04:31 2024 X-Original-To: virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4WNyQF3Dxlz5QdHW for ; Wed, 17 Jul 2024 01:04:37 +0000 (UTC) (envelope-from polarian@polarian.dev) Received: from mail.polarian.dev (mail.polarian.dev [IPv6:2001:8b0:57a:2385::8]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4WNyQD3lCtz4d3q for ; Wed, 17 Jul 2024 01:04:36 +0000 (UTC) (envelope-from polarian@polarian.dev) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=polarian.dev header.s=polarian header.b=Crcx+7Id; dmarc=pass (policy=quarantine) header.from=polarian.dev; spf=pass (mx1.freebsd.org: domain of polarian@polarian.dev designates 2001:8b0:57a:2385::8 as permitted sender) smtp.mailfrom=polarian@polarian.dev Received: from PolarianBSD (_gateway [192.168.2.1]) by mail.polarian.dev (Postfix) with ESMTPSA id 64F2F10A1E76 for ; Wed, 17 Jul 2024 01:04:32 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=simple/relaxed; d=polarian.dev; s=polarian; t=1721178272; bh=i4rmQ8CuElzfpXEWHKvdcJRMlog8vzXb+St17nJvHWI=; h=Date:From:To:Subject:In-Reply-To:References; b=Crcx+7Idvhx0A3MQbcTTfV7Y7m2Ev1S/63FZSvJCT9Rk1lssIxe/VTxARF8LtkQKG ZP2GLUa/kJL97tuXfueHj/CgoJAapeuf6+4qLZEHfMJkT04jUdpx8JsOzc7tICRJYK GdY46i1QuByksvI565J7XTvROwb5HEme+/+4UwIw= Date: Wed, 17 Jul 2024 02:04:31 +0100 From: Polarian To: virtualization@freebsd.org Subject: Re: nmdm issues with bhyve Message-ID: <20240717020431.2c53edfa@PolarianBSD> In-Reply-To: <4b081401-4f57-42b7-9795-c7c3885e3b68@freebsd.org> References: <20240716153851.60c1ea61@PolarianBSD> <16dfe6b3-2ef1-4859-a5b0-a36efe452804@FreeBSD.org> <4b081401-4f57-42b7-9795-c7c3885e3b68@freebsd.org> X-Mailer: Claws Mail 3.20.0 (GTK+ 2.24.33; amd64-portbld-freebsd14.0) List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-virtualization@freebsd.org Sender: owner-freebsd-virtualization@FreeBSD.org MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.50 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.996]; MID_RHS_NOT_FQDN(0.50)[]; DMARC_POLICY_ALLOW(-0.50)[polarian.dev,quarantine]; R_DKIM_ALLOW(-0.20)[polarian.dev:s=polarian]; R_SPF_ALLOW(-0.20)[+ip6:2001:8b0:57a:2385::8]; MIME_GOOD(-0.10)[text/plain]; RCVD_COUNT_ONE(0.00)[1]; RCPT_COUNT_ONE(0.00)[1]; RCVD_VIA_SMTP_AUTH(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:20712, ipnet:2001:8b0::/32, country:GB]; RCVD_TLS_ALL(0.00)[]; ARC_NA(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; FROM_HAS_DN(0.00)[]; MLMMJ_DEST(0.00)[virtualization@freebsd.org]; TO_DN_NONE(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[virtualization@freebsd.org]; TO_MATCH_ENVRCPT_ALL(0.00)[]; DKIM_TRACE(0.00)[polarian.dev:+] X-Rspamd-Queue-Id: 4WNyQD3lCtz4d3q Hello, > The -w option is needed so that bhyve won't exit on accessing an > unimplemented MSR (that particular one is harmless). Apologies, this is within the wiki [1], however I must have missed it when I was typing out the command. However, I have tested it right now, even with the -w option the nmdm device does not show up still. When testing with stdio: wrmsr to register 0xc0011029(0x3) on vcpu 0 Followed by: sh: turning off NDELAY mode Which I assume is bhyve forking into the background? Anyways updated configuration is below: bhyve -c 1 -m 1G -u -H -w \ -s 0,amd_hostbridge \ -s 3,ahci-hd,/home/bitflame/install75.img \ -s 4,virtio-blk,/dev/zvol/zpool-storage/dns \ -s 5,virtio-net,tap0 \ -s 31,lpc -l com1,stdio \ -l bootrom,/usr/local/share/uefi-firmware/BHYVE_UEFI.fd \ dns Bakul I have read your configuration, I haven't had time to test it, I will test it shortly to see if something there resolves the problem. Thank you for the help, -- Polarian GPG signature: 0770E5312238C760 Jabber/XMPP: polarian@icebound.dev From nobody Wed Jul 17 06:39:19 2024 X-Original-To: virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4WP5rS1sXGz5Qfcf for ; Wed, 17 Jul 2024 06:39:20 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R11" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4WP5rS0lrBz46gt for ; Wed, 17 Jul 2024 06:39:20 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1721198360; a=rsa-sha256; cv=none; b=OWWZZJ825mOuse23Go/JKNQqBdiyjQ1amaOGrN21QICjvtyc9cQAGWs8hp6V86avhUgPHp XF/PxV2+x9ZtS0+24RumBVnnT5XTtoll1ZphT1c5DQKisM8Q35qzkbbBaNP4CdbHF8T81/ ObmE1vUwm1yGs8t3rV78T9l49hDU3BYHZ6SPoaLuAjRkxGAfAZlH2pYHexyQs/cbkWQ25g FGvi1TDxM2+D0kbQroTp3GXkVcYZNuS6yUycKNQo+L8fASDE2SYCA4hXRg8IQNIL1pn2dw Qk7/m1/7f8RqRHyHFi+cFnKC/PWkGLNTw6649cAUkGCoQ7ZeRrt8Io2Sq4pJDQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1721198360; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=Zt8hlBQMq2xCjxlzsmNJgSuEH8q3j+PyFrkBqLTecAY=; b=SwPUuaiqVAh6F8UF/7s8ZWiDnA2+5A4brLO7FkfP+Ax5UXfg7/jf7vXP/Oi4gtovrmcrNh gPsRvIgZNPBdzkTbnU9rqLuroHKxH2wHRlPqhoF8IhOVoNxRPB8F/zsI6EtIYb5B3mTrVn FnuYuXDHbPnb0VF+TQLBYVWl8TEnftkWYKBuqKql87XDHnx2tkGnFJEaXmhOrjR8YN/9ZW qOYvuvYt6lleWt/KHpHXkHqAqvT+rtMVamfKD5BwRgMkszz8Czkp/HGhNj1vW6T/H7Xu83 miR37bw3PK7ayONM4ysMiUaP1ezJCuqmfGh6tq1fLF30mZc1//N5zkKQB21lLQ== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4WP5rS028jz17C1 for ; Wed, 17 Jul 2024 06:39:20 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 46H6dJQK070506 for ; Wed, 17 Jul 2024 06:39:19 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 46H6dJ0O070505 for virtualization@FreeBSD.org; Wed, 17 Jul 2024 06:39:19 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 279901] glibc-2.39-2 and above on the host segfault Date: Wed, 17 Jul 2024 06:39:19 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bhyve X-Bugzilla-Version: 14.1-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: raul.munoz@custos.es X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-virtualization@freebsd.org Sender: owner-freebsd-virtualization@FreeBSD.org MIME-Version: 1.0 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D279901 Ra=C3=BAl changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |raul.munoz@custos.es --- Comment #4 from Ra=C3=BAl --- Upgrading a debian sid today [....] Unpacking libc6:amd64 (2.39-4) over (2.38-14) ... Setting up libc6:amd64 (2.39-4) ... free(): invalid pointer dpkg: error processing package libc6:amd64 (--configure): installed libc6:amd64 package post-installation script subprocess was kill= ed by signal (Aborted), core dumped Errors were encountered while processing: libc6:amd64 Error: Sub-process /usr/bin/dpkg returned an error code (1) [....] --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Wed Jul 17 06:43:08 2024 X-Original-To: virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4WP5wr40yGz5QgMq for ; Wed, 17 Jul 2024 06:43:08 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R11" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4WP5wr2vt2z47LW for ; Wed, 17 Jul 2024 06:43:08 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1721198588; a=rsa-sha256; cv=none; b=uzzggyQfulVC91iV5+3uxEejSKIzfZoqKNsnk0i15deGHhor1uURmVQn6F6yWBrz/wN0It YsR4clrb9YQgrf1tAs33DnETnr0HAenT+AL2sm6GAhuUFaoPYhbRsUmuh+UBMrfzH3bbsr bVJLrBbdMhFZ++/feosBw5IxNeD4ATrThAkzDHx9jKwdL6KPiTM/hv85buesv59YV4RrQN ZWVMIBavWP14PV8UAYlRUcf5A/juM3YWXM4sQo22NX7+pg75Bbc96XtM6k6XvZnY0u6N5P oVT1m0A6qk1pno0vP2geMAnRXLqbn8U2QTcjbMNizJOZWWBzhxYUXFeef0EWAg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1721198588; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=/nEvAUMN/6jb23gDEe2ap5rJb/hfUoDFu34C/q9Rbc4=; b=OBosbI8GgabjsCjiNFGU5Cf4qG6ajUMVIFtnJA513+fKfYPeYyVWGeeXYqawZxgp7MvKiQ NYO3ll1UHsemDCF3CLy1kizJCxmJCNs3SuDBIasJtJC/HlnzJfVdWnTz/LeRW1Ywt3a8uh RmDx5WkX+4bLuZFSZn9d7TApm3dNbLfZb20LKhiLK034XxvdXMITfGspkYWMxN7z5wJt9x iK7yMSufg2e9G4xZQsnByYTk8qJ5kn6boKd3ibmXluYDYmKF9KbF7uDvHDUFDccJ5HWAab LundodrlPJODOzpC9MmZigPA8QhnkS7g3Rlf68tpq8SA/OWcohzLiHVUzHrlpQ== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4WP5wr2Vpsz18P4 for ; Wed, 17 Jul 2024 06:43:08 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 46H6h8TF091378 for ; Wed, 17 Jul 2024 06:43:08 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 46H6h8Ia091373 for virtualization@FreeBSD.org; Wed, 17 Jul 2024 06:43:08 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 279901] glibc-2.39-2 and above on the host segfault Date: Wed, 17 Jul 2024 06:43:08 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bhyve X-Bugzilla-Version: 14.1-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: raul.munoz@custos.es X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-virtualization@freebsd.org Sender: owner-freebsd-virtualization@FreeBSD.org MIME-Version: 1.0 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D279901 --- Comment #5 from Ra=C3=BAl --- CPU: AMD Ryzen 9 5950X 16-Core Processor (3393.72-MHz K8-class = CPU) --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Wed Jul 17 06:49:45 2024 X-Original-To: virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4WP64V0nBvz5Qgck for ; Wed, 17 Jul 2024 06:49:46 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R11" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4WP64T6mxmz4CTf for ; Wed, 17 Jul 2024 06:49:45 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1721198986; a=rsa-sha256; cv=none; b=aRN3C7W+RU1fNWn7Py5cK7YYF8UmxhuWV5pGheuKjBtP9kzJM+N2sMRkm/rVPIUMoQA2xc zUztfvyKypHKV3+fEMLOCmOgnEVUQ0UrZXw0cyRaVJGR7JX6rdKa45w+/qaxSi+1f57uFF 9PzSXq98AlqoCZgwlLJyRnvB4JzWntCyC5zX3qtlyRpzeBFHSJBLRCHEpXOzw7kULJt2/B fri+EarYosK1cFcUCmXi1svWJOHiGn3DHSIX+7BRtfr7JF69CAYEvLr/sP2PXRgvfHncQI fosAnu3uL+fRmvvc+9XJgAKmiJOEw0XLcuvhJP25FWIKizGmIIhCzUdVRbn0fg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1721198986; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=paREZOTqpJmp+S+o0Tych6x4KKqtIR1JWKlAVsHvTbs=; b=FDeB0guvDyLZMz9RE8CYzv2nq5kG+/yCKVjSkvtrccgt9smC+xWtOGOwvHehc3rjUcWKXt LeOZoCwJb1Jc8Okjej+2q1mkPxntL3q++QR/cZO6moTes4Lj/1Ew6KU/srHbU/P9Nl4pe3 x9iQgQoR75Eo4M18koojX7fNT0Kct4QrKOGOFwHFGVDdyr0ok4WNDUxVQih/CTIqWcY9qN EujsN5nAGWUYSHplDVe7gH4pJ7EV5UC7q+1YrXOXGUj7/ZUFkBtyHu+0vue0Aky9UIAkm0 PPZqCa9IA9AnTLvt6BJ4Y4vHQuPKK9Ig5jCSmv0pEGzFCYjMnkO5ksESH8Pbfw== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4WP64T6Ks8z18RT for ; Wed, 17 Jul 2024 06:49:45 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 46H6njt0010553 for ; Wed, 17 Jul 2024 06:49:45 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 46H6njGi010552 for virtualization@FreeBSD.org; Wed, 17 Jul 2024 06:49:45 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 279901] glibc-2.39-2 and above on the host segfault Date: Wed, 17 Jul 2024 06:49:45 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bhyve X-Bugzilla-Version: 14.1-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: raul.munoz@custos.es X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-virtualization@freebsd.org Sender: owner-freebsd-virtualization@FreeBSD.org MIME-Version: 1.0 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D279901 --- Comment #6 from Ra=C3=BAl --- I see on that sid dmesg: [173364.415802] apt[5234]: segfault at 7f29a9d1aff8 ip 00007f29aa36ff25 sp 00007ffcc0b4ad18 error 4 in libc.so.6[7f29aa23f000+158000] likely on CPU 3 (core 0, socket 3) [173364.415815] Code: fe 6f 76 40 48 8d 8c 17 7f ff ff ff c5 fe 6f 7e 60 c5= 7e 6f 44 16 e0 48 29 fe 48 83 e1 e0 48 01 ce 0f 1f 40 00 c5 fe 6f 4e 60 f= e 6f 56 40 c5 fe 6f 5e 20 c5 fe 6f 26 48 83 c6 80 c5 fd 7f 49 [173385.774003] traps: appstreamcli[5351] general protection fault ip:7f793c03993a sp:7ffcfcdaae90 error:0 in libc.so.6[7f793bfc5000+158000] don't know too much linux, let me know if I can help --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Wed Jul 17 07:44:17 2024 X-Original-To: virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4WP7HQ4WCRz5QmB5 for ; Wed, 17 Jul 2024 07:44:18 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R11" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4WP7HQ3T1Bz4JH1 for ; Wed, 17 Jul 2024 07:44:18 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1721202258; a=rsa-sha256; cv=none; b=UwqhpxeLAkKGULQnI7T+Ny6z24geF+/yj9x32aY7b9pfSaU8UQvVfzScDImmCve+mFB539 YjCIaA09oIvtuDpTmNdeBPmSGjaXzSfjgs2lKeSUrY3PJxb2Jdq65GZJ2IuV//LomV8J0p xFqF4YSvd1yzB+lxv+57H1/76bU1Rt5r9wjUpJjXiK2zLyqn9vPT1UcJuWoaVR4FozqSlO ZDLXg/2+cFvUruSMjiRuy1nD24XUMww+fjPqlleoRDX1zF6qUhygpiEX0VlcS8CETdPc8G oWiBG9fZPuK22nVfHPVvfHt8WszLE88RuxUIxB6zEe6eo1Dncpo5k0wJ2/I6ew== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1721202258; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=gpxRhc48j5jlpCbawtZQeuK5VksYFEX0UQ0M+NLWFJQ=; b=XoOAtKIa2L6z0Vz0uTYYtZs+W3UQtGJQlrtfjFZ58lh95DHHVdOoY541kWXOdnsfblSZYS g1utajp7f7113vsMq84XoVRo4wPe6nFm1ZIciKB7R3k5KGa8ruNU/aTtYhF09CXQkUoeqa t6/3dnv2KamQHPtANAdYgjqznaRnlisJdHdG3kwAYLbIC/IrLo/tGctVjBnzMrwSOk+Xxt i0gx75KcLWUfmwgIigGIHoIpGnkVLU60CsvAGyqlEvmsf6QWtHEmmJZfK2atYF0VWKralP fHnMMCXj8Ipm8dxU5SQfKPUzapYpimfkq4Rk/lcL7FUSjEZnXNn+ZbidAmpiZw== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4WP7HQ320kz1B8r for ; Wed, 17 Jul 2024 07:44:18 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 46H7iIAn040799 for ; Wed, 17 Jul 2024 07:44:18 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 46H7iIor040798 for virtualization@FreeBSD.org; Wed, 17 Jul 2024 07:44:18 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 279901] glibc-2.39-2 and above on the host segfault Date: Wed, 17 Jul 2024 07:44:17 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bhyve X-Bugzilla-Version: 14.1-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: kevans@freebsd.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-virtualization@freebsd.org Sender: owner-freebsd-virtualization@FreeBSD.org MIME-Version: 1.0 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D279901 --- Comment #7 from Kyle Evans --- (In reply to jordy from comment #3) > It's kind of difficult to debug as gdb will also crash when the latest gl= ibc is installed. The other user of the arch forum made some backtraces of = some applications crashing: https://bbs.archlinux.org/viewtopic.php?pid=3D2= 172581#p2172581 The easy solution is presumably to crash it & get a core, then downgrade gl= ibc and use gdb. If you load the core, `disas` should presumably get us what we need to make any kind of progress. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Wed Jul 17 07:50:32 2024 X-Original-To: virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4WP7Qd58Hjz5QmtY for ; Wed, 17 Jul 2024 07:50:33 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R11" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4WP7Qd1m0xz4Jcb for ; Wed, 17 Jul 2024 07:50:33 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1721202633; a=rsa-sha256; cv=none; b=WInT37Tzp4pETPertaI6VuzyghCZ6yx8o6erCsHEf/o1fewucS4BW3x7Zn67aGMmtoCXg2 RFZaTBJ8hclMjr7IvXcXZkp4vWsrujQBfrGKTkkuqkOZ9KlEs6hAcoJBdriRgeQKDoMeaU ajKfjYXFyQTKOBTMacZlSueQBeIxK36EWbUsijMb1jF68eRiR443X3OHfAn3uhSnsiHvjP tjM0pNyh+zq3ancUi3d7hnZfZ+lKpgX8n8B1Qh146ceBvpz91tJ8yI3G1jTPGSVWNLrpA8 xs6D6wMsC4gM50GMip1QX2l+QUMJZD0sTUXwANI7sknnsd0DpFf9DMRjkxu5sA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1721202633; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=rkM5lGIjKoi9DRFDg6Vz1PFfnQSfXvOQfK7PgYxMw5s=; b=hp07kCtB2TdOUf+lQ6UEp94m6k56Sw4LvwUKsWeWbJ60j58qEbk5v6nfPVfI9i4ih4Y4s4 Nt545qFpTYzU6N86qVWrfq9XbR/+bCwxPky6aXHx4tOnHartLX7uziO2tVO07Ud59NyEJX ZWN/U+CUd3Yc/II1Svm9S/gAc0qkaMWxfC4ODylCrU/rV326MPZCubT1eXoniownFca7o1 VT9C0M26iO88CdNMKvNTK8lPYTF6VTFQPaIs5ZYBnW3UxsQLclV31O60WEouNir3ZsbNBj 86340XyFfziJCCeAv3YsdHDSO34ACIsSNlOq3mbScHsbIxAg3l9X28AwK2C3DQ== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4WP7Qd1LnYz19vy for ; Wed, 17 Jul 2024 07:50:33 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 46H7oXNx059516 for ; Wed, 17 Jul 2024 07:50:33 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 46H7oX28059515 for virtualization@FreeBSD.org; Wed, 17 Jul 2024 07:50:33 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 279901] glibc-2.39-2 and above on the host segfault Date: Wed, 17 Jul 2024 07:50:32 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bhyve X-Bugzilla-Version: 14.1-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: kib@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-virtualization@freebsd.org Sender: owner-freebsd-virtualization@FreeBSD.org MIME-Version: 1.0 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D279901 --- Comment #8 from Konstantin Belousov --- (In reply to Kyle Evans from comment #7) Most likely noit, unfortunately. The downgrade of libc would cause wrong c= ode to be disassembled, because text is not dumped normally. Is there a way to affect the glibc selection of the CPU-optimized functions, like our "ARCHLEVEL" env var? --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Wed Jul 17 08:02:02 2024 X-Original-To: virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4WP7gv44xlz5Qnq7 for ; Wed, 17 Jul 2024 08:02:03 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R11" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4WP7gv34zhz4KjV for ; Wed, 17 Jul 2024 08:02:03 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1721203323; a=rsa-sha256; cv=none; b=RMKzg2w5Q+5VO7bXoDxPOCw4y+V3hlcIjs+VvS+lkaWDipWuvo3C3JxJHUMMslYFIwMgPs V4kQ4pyQQjtBVrfqGF2Sfpw9Imd0Kg+rvyoJLxMmG1JlVn8XA6Gv5Xltp6u8MS63ssypZY E23JKdmZ17evzI0f1uydbbG2ekfHgi37mWAZnXPCqQVc+KuH8+mXb1N1DaNy9Qb46BHB4Y VuA0CMxPc/aci+8ND2+xxklheJ+ZNTJzXPW9WHprEbFB5sAZscHYKoGIrmqOMtVIyqGbs+ 0AzRL8ZBANaZrlfVN3gcdWUgT5Y/a2PZeutx/DaEJ85shfJPrswN84uY5uuEgg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1721203323; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=uXu5RV30Mes7HGbbPlSudbBeA/xDURANzy4yCMFjq5o=; b=uOxG90Pq7Su2SNLD9NsEe1uaemXtYmknTX2NRe+Hn+hQQ6wqbt5agM/C/AV/u6ILSrz2ia mTcAJHH0tM4imefqiPYRZVK93ABVm6xwRVMY6JFBTx60lt6QogdB5X9fl1YkKYhhbgZKj/ duzFtmyLEpIfj7Xj2o+jujO993t/TMJp3sh82DgNCqI1I4Nbiyo9cW5Kf21gy+wiI69G/U 8HJUu4HcaPHaUIzP6JuNBrkG0S7KMbU6QVWQJ6MoGzszvl8StvncwfdYeO9TlJvCI4Gje5 GRrdW5pEtp70YIvuzLhdOe9loNjRzZpzr+B1Deynxd0gi/utEoCYMSd7dr67Bw== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4WP7gv2hvgz19YG for ; Wed, 17 Jul 2024 08:02:03 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 46H823F3014794 for ; Wed, 17 Jul 2024 08:02:03 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 46H82360014793 for virtualization@FreeBSD.org; Wed, 17 Jul 2024 08:02:03 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 279901] glibc-2.39-2 and above on the host segfault Date: Wed, 17 Jul 2024 08:02:02 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bhyve X-Bugzilla-Version: 14.1-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: kevans@freebsd.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-virtualization@freebsd.org Sender: owner-freebsd-virtualization@FreeBSD.org MIME-Version: 1.0 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D279901 --- Comment #9 from Kyle Evans --- (In reply to Konstantin Belousov from comment #8) One could `add-symbol-file` in a saved off copy of the broken shlib at the expected offset and get expected disassembly, perhaps? Not as easy as writt= en before, but an option if there's no env for this. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Wed Jul 17 08:06:03 2024 X-Original-To: virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4WP7mW6Dcxz5QpMg for ; Wed, 17 Jul 2024 08:06:03 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R11" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4WP7mW58jVz4Lgq for ; Wed, 17 Jul 2024 08:06:03 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1721203563; a=rsa-sha256; cv=none; b=Z8+0iDZqn452keU4ofEyAS9yzZ0SHn40o53KjUABl2QOkT1+c6SyS0WSqO8X7UJJTHG57M JU9g3RzWytYmhc1T7GAEiGRTXoRfJcnVXSApnSBntlV2IIxWcpMSfcdL4O09+OE84Ey5mm BdWTvYIDpUG3AdfZlY3+1btwulaiqLT9nnadHPzXUrWHEDG8+Ti0ls9Zi9RdayomuQvLuT hn63z3y4wO0S9CY/ukUsJyu+jocEpmv/kU52KajAmFIMoKnQNdWiFOoqKaI67rz+gTCAKf YTb8/BV8etW7mra6SDMxXoTqzpu7nTC6ImJyABAUU7/emg/788sP33K1FaCo6A== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1721203563; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=vfHWIsqr9JwU9rZrII9WuAandP5NvL3FuD2HrsFrip0=; b=uGSmj75cvsJY07c2ccUlOuFDgGFWi6ojiu3ERrFjPBhuH5py/PearBJX5CC0PiVCISzF1i ADL6EA/o90n4KrfeJvqz8MxiNNUPAtbNQ3q0fZJ8TLJHZkikesN9qdD5xmE0m0ycTNdZrw VsLich0dYOufSESoGrOT//tiHdBxsHj70LpsrdPAdDlF10l/CTGKdkalNOjZ9rHUY7h9zK OFixPrdHKPViw1+v644VLgWB4ZwJwHkJzR6Ds9lBT2d0TNm7JOgFRaHuXbf5WEaaehnSAz zzwhBcy+ehyKrCU/iM3eF4/ABdPONSyN0a5UgtQzreFAnj8Yyn0V/HcxzliGWw== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4WP7mW4jtqz1BhK for ; Wed, 17 Jul 2024 08:06:03 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 46H863dM028942 for ; Wed, 17 Jul 2024 08:06:03 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 46H863kq028941 for virtualization@FreeBSD.org; Wed, 17 Jul 2024 08:06:03 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 279901] glibc-2.39-2 and above on the host segfault Date: Wed, 17 Jul 2024 08:06:03 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bhyve X-Bugzilla-Version: 14.1-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: kib@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-virtualization@freebsd.org Sender: owner-freebsd-virtualization@FreeBSD.org MIME-Version: 1.0 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D279901 --- Comment #10 from Konstantin Belousov --- Perhaps LD_LIBRARY_PATH to force the crashing binary to use crashing libc is the easiest. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Wed Jul 17 22:42:01 2024 X-Original-To: virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4WPWCS2thwz5QY24 for ; Wed, 17 Jul 2024 22:42:12 +0000 (UTC) (envelope-from polarian@polarian.dev) Received: from mail.polarian.dev (mail.polarian.dev [IPv6:2001:8b0:57a:2385::8]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4WPWCR4gmnz4tl3 for ; Wed, 17 Jul 2024 22:42:11 +0000 (UTC) (envelope-from polarian@polarian.dev) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=polarian.dev header.s=polarian header.b=QmWtj0+O; dmarc=pass (policy=quarantine) header.from=polarian.dev; spf=pass (mx1.freebsd.org: domain of polarian@polarian.dev designates 2001:8b0:57a:2385::8 as permitted sender) smtp.mailfrom=polarian@polarian.dev Received: from PolarianBSD (_gateway [192.168.2.1]) by mail.polarian.dev (Postfix) with ESMTPSA id 744F410A1564 for ; Wed, 17 Jul 2024 22:42:02 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=simple/relaxed; d=polarian.dev; s=polarian; t=1721256122; bh=49TUjn5aClwo8YUvXONAnhrvhjlSlvzYAdGVkyo3qa4=; h=Date:From:To:Subject:In-Reply-To:References; b=QmWtj0+OcLkqSANk9dVLeXKN1vwZBLcprhs/Vxdaa6O5DLuWG4TlTV0o71Aml9Nt5 zEvHFRu1ze+XrnldCsGz4oerfuV4epiwKROjf0GwSiy02UbqdRnjSR9BlLYOA1vly5 kVAEHWO6bgAFHMmCZgvbX81eb4vTxIiB6Pb5zoqo= Date: Wed, 17 Jul 2024 23:42:01 +0100 From: Polarian To: virtualization@freebsd.org Subject: Re: nmdm issues with bhyve Message-ID: <20240717234201.2ccbb91c@PolarianBSD> In-Reply-To: References: <20240716153851.60c1ea61@PolarianBSD> <16dfe6b3-2ef1-4859-a5b0-a36efe452804@FreeBSD.org> X-Mailer: Claws Mail 3.20.0 (GTK+ 2.24.33; amd64-portbld-freebsd14.0) List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-virtualization@freebsd.org Sender: owner-freebsd-virtualization@FreeBSD.org MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.50 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.996]; MID_RHS_NOT_FQDN(0.50)[]; DMARC_POLICY_ALLOW(-0.50)[polarian.dev,quarantine]; R_DKIM_ALLOW(-0.20)[polarian.dev:s=polarian]; R_SPF_ALLOW(-0.20)[+ip6:2001:8b0:57a:2385::8]; MIME_GOOD(-0.10)[text/plain]; RCVD_COUNT_ONE(0.00)[1]; RCPT_COUNT_ONE(0.00)[1]; RCVD_VIA_SMTP_AUTH(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:20712, ipnet:2001:8b0::/32, country:GB]; RCVD_TLS_ALL(0.00)[]; ARC_NA(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; FROM_HAS_DN(0.00)[]; MLMMJ_DEST(0.00)[virtualization@freebsd.org]; TO_DN_NONE(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[virtualization@freebsd.org]; TO_MATCH_ENVRCPT_ALL(0.00)[]; DKIM_TRACE(0.00)[polarian.dev:+] X-Rspamd-Queue-Id: 4WPWCR4gmnz4tl3 Hello, I have tested your configuration substituting in my values and it still doesn't work, no nmdm device shows up. I am not even sure this configuration is successfully booting OpenBSD 7.5 and I am clueless of what to try now. Anyone have any ideas? (Possibly examples with pty or a terminal multiplexer to see if it is a nmdm issue or an issue with bhyve?) Thanks, -- Polarian GPG signature: 0770E5312238C760 Jabber/XMPP: polarian@icebound.dev From nobody Thu Jul 18 16:07:35 2024 X-Original-To: freebsd-virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4WPyQQ3p4bz5RfXt for ; Thu, 18 Jul 2024 16:08:14 +0000 (UTC) (envelope-from odhiambo@gmail.com) Received: from mail-oa1-x2b.google.com (mail-oa1-x2b.google.com [IPv6:2001:4860:4864:20::2b]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "WR4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4WPyQP49mZz4Kf6 for ; Thu, 18 Jul 2024 16:08:13 +0000 (UTC) (envelope-from odhiambo@gmail.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20230601 header.b=nhDWMhh3; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of odhiambo@gmail.com designates 2001:4860:4864:20::2b as permitted sender) smtp.mailfrom=odhiambo@gmail.com Received: by mail-oa1-x2b.google.com with SMTP id 586e51a60fabf-260e6dfc701so530107fac.3 for ; Thu, 18 Jul 2024 09:08:13 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1721318892; x=1721923692; darn=freebsd.org; h=to:subject:message-id:date:from:in-reply-to:references:mime-version :from:to:cc:subject:date:message-id:reply-to; bh=eOFP5/rWKUz76UsEWkEUZQvNd+TZlITNcnMX+cq67Pw=; b=nhDWMhh3szzwB6Rv5jxdbHgCbofF5nnE0mWt9sbKhJOR/UWbHzMJWGNSmYiJXZ0SYW ipPFERMO9lSvsil7hlDmt2W2XrQ0m8TaA5wXGNwHcjR/NSFqKSJQW1h+Dn+6MlaRmjd4 OQXK6uN3QnzKGfvu2uLE2emW2rDjguYH/+nOmVNav9n+XqPNZ6hk8XMJpVi05xZ1Mgew JO4kA8Gz0dk+lZ65NLwY58jQOyaJo7111/9iPpF9qbwOoPpdEnXWY8t3o6LxvpCFCkEA 05Nqs+NGJA9uTb3eJffKujtMEcLiLUZu+ZywyL8oVyJqARxuV5VhH/4SsjMauE1J7rB4 25wQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1721318892; x=1721923692; h=to:subject:message-id:date:from:in-reply-to:references:mime-version :x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=eOFP5/rWKUz76UsEWkEUZQvNd+TZlITNcnMX+cq67Pw=; b=CHYfwcmHfpLxOex1yyZOch7JRQiLidxI/JnkSX96xwPwTg6aATPrydqF3hPN+19qmr pUSgNFf5mxx0BP7APRk08af9/u3JDZ0fAeR3kxfGFBMn+xmmhBoVlAY1b2sCYHG073QP 5WFipUWLhxdQHhrLOAXtG8M5XjsHv+d3KmWiAhQHJ8Jw7Suu0jjoA2tsIhttIeMt/dTr yJbqt21s8/xt1KsTkBVu/x6MbS2Tx6mL8GdwNdh0QVe1MCggujJIByCNvwKCZSaLmhAs PqwiaoA05xG4+KXipHBJceublc1r1UnPRlgXlHgPelmGYZFPrL4SaU7jxvp9kBFjqBy4 VOJQ== X-Gm-Message-State: AOJu0YxIWsoVPax/zbyJCfFS49WcI65O4Fr6K4OedFEz/FwrD2ndZTBA EbCWDGr3204ynKM5mf4eEklDwkFieAN+TGWdV8Li4n20TiZSjSmX5ZbrqRDSR4Q7nl5rkbMj/Y+ gZ8MKYS0bwUHE6OcpJXAAtKf8Z7oj6QHk4O0= X-Google-Smtp-Source: AGHT+IGnnK6dOsii89bi5+AQmzslOR8jKcMV+9K/e+S9/nqUE6mFvtYJdRRRk9MjW2O1bTStC/45e0kAIFgWZeYKRfA= X-Received: by 2002:a05:6870:f610:b0:261:87:fe1f with SMTP id 586e51a60fabf-26100880120mr874843fac.44.1721318891447; Thu, 18 Jul 2024 09:08:11 -0700 (PDT) List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-virtualization@freebsd.org Sender: owner-freebsd-virtualization@FreeBSD.org MIME-Version: 1.0 References: <202407111449.46BEnLoP051380@gndrsh.dnsmgr.net> In-Reply-To: From: Odhiambo Washington Date: Thu, 18 Jul 2024 19:07:35 +0300 Message-ID: Subject: Re: Suddenly unable to access VMs To: FreeBSD virtualization Content-Type: multipart/alternative; boundary="00000000000011efcf061d87c97a" X-Spamd-Bar: - X-Spamd-Result: default: False [-1.28 / 15.00]; URI_COUNT_ODD(1.00)[15]; HTTP_TO_IP(1.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-0.97)[-0.966]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; NEURAL_HAM_SHORT(-0.32)[-0.318]; R_SPF_ALLOW(-0.20)[+ip6:2001:4860:4000::/36:c]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20230601]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; RCVD_TLS_LAST(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; FROM_HAS_DN(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; ARC_NA(0.00)[]; FREEMAIL_ENVFROM(0.00)[gmail.com]; FREEMAIL_FROM(0.00)[gmail.com]; TO_DN_ALL(0.00)[]; MISSING_XM_UA(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; MID_RHS_MATCH_FROMTLD(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-virtualization@freebsd.org]; FROM_EQ_ENVFROM(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MLMMJ_DEST(0.00)[freebsd-virtualization@freebsd.org]; RCVD_COUNT_ONE(0.00)[1]; ASN(0.00)[asn:15169, ipnet:2001:4860:4864::/48, country:US]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; RCVD_IN_DNSWL_NONE(0.00)[2001:4860:4864:20::2b:from] X-Rspamd-Queue-Id: 4WPyQP49mZz4Kf6 --00000000000011efcf061d87c97a Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable On Thu, Jul 11, 2024 at 6:23=E2=80=AFPM Odhiambo Washington wrote: > > > On Thu, Jul 11, 2024 at 5:49=E2=80=AFPM Rodney W. Grimes < > freebsd-rwg@gndrsh.dnsmgr.net> wrote: > >> > My bhyve VMs have been all fine until now. >> > I can't ping them and can't SSH into them. However, I can connect to >> them >> > with VNCViewer from a remote host (my PC from my house) :-( >> > >> > I haven't done any changes on the host at all. >> > dnsmasq is running, but seems like the VMs aren't getting the IPs for >> some >> > reason. >> > >> > ``` >> > cloned_interfaces=3D"bridge0 tap0 tap1 tap2 tap3 tap4 tap5" >> > ifconfig_bridge0_name=3D"vmbridge" >> > ifconfig_vmbridge=3D"addm em1 addm tap0 addm tap1 addm tap2 addm tap3 = addm >> > tap4 addm tap5 up" >> > ifconfig_vmbridge_alias0=3D"inet 172.16.0.1 netmask 255.255.255.0" >> > ``` >> > What might have happened? >> > >> > >> > root@gw:/home/wash # ifconfig vmbridge >> > vmbridge: flags=3D1008843 >> > metric 0 mtu 1500 >> > options=3D0 >> > ether 58:9c:fc:10:df:1d >> > inet 172.16.0.1 netmask 0xffffff00 broadcast 172.16.0.255 >> > id 00:00:00:00:00:00 priority 32768 hellotime 2 fwddelay 15 >> > maxage 20 holdcnt 6 proto rstp maxaddr 2000 timeout 1200 >> > root id 00:00:00:00:00:00 priority 32768 ifcost 0 port 0 >> > member: tap5 flags=3D143 >> > ifmaxaddr 0 port 10 priority 128 path cost 2000000 >> > member: tap4 flags=3D143 >> > ifmaxaddr 0 port 9 priority 128 path cost 2000000 >> > member: tap3 flags=3D143 >> > ifmaxaddr 0 port 8 priority 128 path cost 2000000 >> > member: tap2 flags=3D143 >> > ifmaxaddr 0 port 7 priority 128 path cost 2000000 >> > member: tap1 flags=3D143 >> > ifmaxaddr 0 port 6 priority 128 path cost 2000000 >> > member: tap0 flags=3D143 >> > ifmaxaddr 0 port 5 priority 128 path cost 2000000 >> > member: em1 flags=3D143 >> > ifmaxaddr 0 port 2 priority 128 path cost 55 >> > groups: bridge >> > nd6 options=3D9 >> > root@gw:/home/wash # ssh 172.16.0.99 >> > ssh: connect to host 172.16.0.99 port 22: Permission denied >> > root@gw:/home/wash # ssh 172.16.0.100 >> > ssh: connect to host 172.16.0.100 port 22: Permission denied >> > root@gw:/home/wash # ping 172.16.0.100 >> > PING 172.16.0.100 (172.16.0.100): 56 data bytes >> > ping: sendto: Permission denied >> > ping: sendto: Permission denied >> > ping: sendto: Permission denied >> > ping: sendto: Permission denied >> > ^C >> > --- 172.16.0.100 ping statistics --- >> > 4 packets transmitted, 0 packets received, 100.0% packet loss >> > root@gw:/home/wash # ping 172.16.0.99 >> > PING 172.16.0.99 (172.16.0.99): 56 data bytes >> > ping: sendto: Permission denied >> > ping: sendto: Permission denied >> > ping: sendto: Permission denied >> > ^C >> > --- 172.16.0.99 ping statistics --- >> > 3 packets transmitted, 0 packets received, 100.0% packet loss >> > root@gw:/home/wash # service dnsmasq status >> > dnsmasq is running as pid 4190. >> > root@gw:/home/wash # >> >> Permission denied is almost certainly coming from firewall, >> either ipfw or pf. >> > > I haven't changed anything in my pf.conf either. > What also baffles me is that the VMs are not obtaining IP addresses from > dnsmasq. > Is anyone able to spot something obvious from the following pf.conf that could be causing the problem I am having? Thanking you in advance. ``` #--------------------------------------------------------------------------= ----- # PF: List and Macros #--------------------------------------------------------------------------= ----- # Interfaces ext_if =3D "em0" # macro for external interface - use tun0 for PPPoE int_if =3D "em1" # macro for internal interface jail_if =3D "lo1" # the interface we chose for communication between jails # # bhyve bhyve_net=3D"172.16.0.0/24" int_addr =3D "192.168.55.254" # Internal IPv4 address (i.e., gateway for private network) int_network =3D "192.168.54.0/23" # Internal IPv4 network # External services - port 25214 is used instead of 514 for syslog ext_tcp_services =3D "{ 21 22 25 26 53 80 110 123 143 443 465 587 2222 2525 2587 25214 993 995 3000 5000><5100 6276 6277 8000 8069 8080 8081 8082 8083 8999 10000 5900><6000 30000><50000 1024><6277 8765 }" ext_udp_services =3D "{ ntp, 1194 }" # Internal services int_tcp_services =3D "{ domain, bootps, dhcpv6-server, ntp, http, https, http-alt, \ smtp, smtps, pop3, pop3s, imap, imaps, ftp-data, ftp, ssh, svn, 2222, 2232, 4444, \ 3128, 3129, 13128, 13129, 23129, 9050, 8123, 8056, 2199, 8191, 82, 2087, 8333, 1157, \ 2083, 8030, 10443, 3389, 8080, 8081, 9091, 81, 8086, 8000, 8001, 8002, 8005, 8006, 8090, 8100, 8800, 443, 465, 587, 8444, 8443, 9443, \ 18082, 18087, 18092, 18093, 9447, 7005, 115, 8030, 18090, 18083, 18084, 15001, 15002, 15003, 2082 }" int_udp_services =3D "{ domain, bootps, dhcpv6-server, ntp, 1194, svn, sip, 8056, 500, 1000, 10000 }" # The martians table denotes the RFC 1918 addresses and a few other ranges which # are mandated by various RFCs not to be in circulation on the open Internet. martians =3D "{ 127.0.0.0/8, 192.168.0.0/16, 172.16.0.0/12, \ 10.0.0.0/8, 169.254.0.0/16, 192.0.2.0/24, \ 0.0.0.0/8, 240.0.0.0/4 }" #--------------------------------------------------------------------------= ----- # PF: Tables #--------------------------------------------------------------------------= ----- table persist file "/etc/firewall/whatsapp-cidr.txt" table file "/etc/firewall/bruteforce_attackers" persist table persist file "/etc/firewall/f2b" table persist table persist #--------------------------------------------------------------------------= ----- # PF: Options #--------------------------------------------------------------------------= ----- # No restrictions on jail network set skip on $jail_if set skip on lo #--------------------------------------------------------------------------= ----- # PF: Scrub (Packet Normalization) #--------------------------------------------------------------------------= ----- set limit { states 40000, frags 20000, src-nodes 20000 } set timeout { adaptive.start 18000, adaptive.end 39000 } #--------------------------------------------------------------------------= ----- # PF: Packet Queueing and Priorization #--------------------------------------------------------------------------= ----- #--------------------------------------------------------------------------= ----- # PF: Netkwork Address Translation (NAT) and Packet Redirection #--------------------------------------------------------------------------= ----- # Network address translation # Internet nat on $ext_if inet from any to any -> $ext_if # Bhyve nat on $ext_if from $bhyve_net to any -> ($ext_if) # Traccar rdr pass on $ext_if inet proto { tcp, udp } from any to port 5055 -> 127.0.0.1 port 5055 # Nominatim Test rdr pass on $ext_if inet proto { tcp, udp } from any to port 8089 -> 127.0.0.1 port 8089 #--------------------------------------------------------------------------= ----- # PF: Packet Filtering #--------------------------------------------------------------------------= ----- # Restrictive default rules block all # Block packets and reply with a TCP RST or ICMP Unreachable response block return # FTP-Proxy # We need to have an anchor for ftp-proxy anchor "ftp-proxy/*" # Anchor for fail2ban anchor "f2b/*" # Anchor for blacklistd # This makes sure that the rules within blacklistd are only used for incoming data on ext_if anchor "blacklistd/*" in on $ext_if # Blocking Spoofed Packets #--------------------------------------------------------------------------= ----- # Filter rules for $ext_if inbound # Temporarily let go everything, do not leave active! #pass in on $ext_if inet #pass in on $ext_if inet6 # Allow ping pass in on $ext_if inet proto icmp all pass in on $ext_if inet6 proto icmp6 all # External services pass in on $ext_if inet proto tcp to port $ext_tcp_services pass in on $ext_if inet proto udp to port $ext_udp_services block drop in quick on $ext_if inet from to any block drop in quick on $ext_if inet from to any block in quick from # Custom blocks block drop in quick on $ext_if inet from 31.130.184.0/24 to any block in proto tcp from to any # Now block the ssh bruteforce block drop in quick on $ext_if inet from block drop in quick on $ext_if inet6 from # PF "Self-Protecting" an FTP Server (passive) pass in on $ext_if inet proto tcp from any to any port { ftp, > 49151 } pass in on $ext_if inet6 proto tcp from any to any port { ftp, > 49151 } # Traccar pass in on $ext_if inet proto tcp from any to any port { 5000><5100 } pass in on $ext_if inet6 proto tcp from any to any port { 5000><5100 } # Nominatim Test pass in on $ext_if inet proto tcp from any to any port 8089 #--------------------------------------------------------------------------= ----- # Filter rules for $ext_if outbound pass out on $ext_if inet pass out on $ext_if inet6 #--------------------------------------------------------------------------= ----- # Filter rules for $int_if inbound # block drop in quick on $int_if inet from 192.168.55.x to any port { 443 993 } #block drop in quick on $int_if from 192.168.54.190 to any #block drop in quick on $int_if from any to 13.107.4.50 # Temporarily let go everything, do not leave active! #pass in on $int_if inet #pass in on $int_if inet6 # Internal services pass in on $int_if inet proto tcp to port $int_tcp_services pass in on $int_if inet proto udp to port $int_udp_services # Filter rules for $int_if outbound pass out on $int_if inet pass out on $int_if inet6 #--------------------------------------------------------------------------= ----- # DEBUG: RULES FOR VMM pass in quick on bridge0 all keep state pass in quick on tap0 all keep state pass in quick on tap1 all keep state pass in quick on tap2 all keep state pass in quick on tap3 all keep state pass out quick on bridge0 all keep state pass out quick on tap0 all keep state pass out quick on tap1 all keep state pass out quick on tap2 all keep state pass out quick on tap3 all keep state # Bhyve hosts pass in on tap0 pass in on tap1 pass in on tap2 pass in on tap3 ``` --=20 Best regards, Odhiambo WASHINGTON, Nairobi,KE +254 7 3200 0004/+254 7 2274 3223 In an Internet failure case, the #1 suspect is a constant: DNS. "Oh, the cruft.", egrep -v '^$|^.*#' =C2=AF\_(=E3=83=84)_/=C2=AF :-) [How to ask smart questions: http://www.catb.org/~esr/faqs/smart-questions.html] --00000000000011efcf061d87c97a Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable


=
On Thu, Jul 11, 2024 at 6:23=E2=80=AF= PM Odhiambo Washington <odhiambo@g= mail.com> wrote:


On Thu, Jul 11, 2024 at 5:49= =E2=80=AFPM Rodney W. Grimes <freebsd-rwg@gndrsh.dnsmgr.net> wrote:
> My bhyve VMs hav= e been all fine until now.
> I can't ping them and can't SSH into them. However, I can conn= ect to them
> with VNCViewer from a remote host (my PC from my house) :-(
>
> I haven't done any changes on the host at all.
> dnsmasq is running, but seems like the VMs aren't getting the IPs = for some
> reason.
>
> ```
> cloned_interfaces=3D"bridge0 tap0 tap1 tap2 tap3 tap4 tap5"<= br> > ifconfig_bridge0_name=3D"vmbridge"
> ifconfig_vmbridge=3D"addm em1 addm tap0 addm tap1 addm tap2 addm = tap3 addm
> tap4 addm tap5 up"
> ifconfig_vmbridge_alias0=3D"inet 172.16.0.1 netmask 255.255.255.0= "
> ```
> What might have happened?
>
>
> root@gw:/home/wash # ifconfig vmbridge
> vmbridge: flags=3D1008843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST,LO= WER_UP>
> metric 0 mtu 1500
>=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0options=3D0
>=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0ether 58:9c:fc:10:df:1d
>=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0inet 172.16.0.1 netmask 0xffffff00 br= oadcast 172.16.0.255
>=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0id 00:00:00:00:00:00 priority 32768 h= ellotime 2 fwddelay 15
>=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0maxage 20 holdcnt 6 proto rstp maxadd= r 2000 timeout 1200
>=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0root id 00:00:00:00:00:00 priority 32= 768 ifcost 0 port 0
>=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0member: tap5 flags=3D143<LEARNING,= DISCOVER,AUTOEDGE,AUTOPTP>
>=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0ifmaxaddr= 0 port 10 priority 128 path cost 2000000
>=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0member: tap4 flags=3D143<LEARNING,= DISCOVER,AUTOEDGE,AUTOPTP>
>=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0ifmaxaddr= 0 port 9 priority 128 path cost 2000000
>=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0member: tap3 flags=3D143<LEARNING,= DISCOVER,AUTOEDGE,AUTOPTP>
>=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0ifmaxaddr= 0 port 8 priority 128 path cost 2000000
>=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0member: tap2 flags=3D143<LEARNING,= DISCOVER,AUTOEDGE,AUTOPTP>
>=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0ifmaxaddr= 0 port 7 priority 128 path cost 2000000
>=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0member: tap1 flags=3D143<LEARNING,= DISCOVER,AUTOEDGE,AUTOPTP>
>=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0ifmaxaddr= 0 port 6 priority 128 path cost 2000000
>=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0member: tap0 flags=3D143<LEARNING,= DISCOVER,AUTOEDGE,AUTOPTP>
>=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0ifmaxaddr= 0 port 5 priority 128 path cost 2000000
>=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0member: em1 flags=3D143<LEARNING,D= ISCOVER,AUTOEDGE,AUTOPTP>
>=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0ifmaxaddr= 0 port 2 priority 128 path cost 55
>=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0groups: bridge
>=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0nd6 options=3D9<PERFORMNUD,IFDISAB= LED>
> root@gw:/home/wash # ssh 172.16.0.99
> ssh: connect to host 172.16.0.99 port 22: Permission denied
> root@gw:/home/wash # ssh 172.16.0.100
> ssh: connect to host 172.16.0.100 port 22: Permission denied
> root@gw:/home/wash # ping 172.16.0.100
> PING 172.16.0.100 (172.16.0.100): 56 data bytes
> ping: sendto: Permission denied
> ping: sendto: Permission denied
> ping: sendto: Permission denied
> ping: sendto: Permission denied
> ^C
> --- 172.16.0.100 ping statistics ---
> 4 packets transmitted, 0 packets received, 100.0% packet loss
> root@gw:/home/wash # ping 172.16.0.99
> PING 172.16.0.99 (172.16.0.99): 56 data bytes
> ping: sendto: Permission denied
> ping: sendto: Permission denied
> ping: sendto: Permission denied
> ^C
> --- 172.16.0.99 ping statistics ---
> 3 packets transmitted, 0 packets received, 100.0% packet loss
> root@gw:/home/wash # service dnsmasq status
> dnsmasq is running as pid 4190.
> root@gw:/home/wash #

Permission denied is almost certainly coming from firewall,
either ipfw or pf.

I haven't change= d anything in my pf.conf either.
What also baffles me is that the= VMs are not obtaining IP addresses from dnsmasq.=C2=A0

Is anyone able to spot something obvious fro= m the following pf.conf that could be causing the problem I am having?
Thanking you in advance.

```

#= ---------------------------------------------------------------------------= ----
# PF: List and Macros
#-----------------------------------------= --------------------------------------

# Interfaces
ext_if =3D &q= uot;em0" # macro for external interface - use tun0 for PPPoE
int= _if =3D "em1" # macro for internal interface

jail_if = =3D "lo1" # the interface we chose for communication between j= ails
#
# bhyve
bhyve_net=3D"= 172.16.0.0/24"

int_addr =3D "192.168.55.254" =C2= =A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 # Internal IPv4 address (i.e., gatew= ay for private network)
int_network =3D "192.168.54.0/23" =C2=A0 =C2=A0 =C2=A0 =C2=A0 # Internal I= Pv4 network

# External services - port 25214 is used instead of 514 = for syslog
ext_tcp_services =3D "{ 21 22 25 26 53 80 110 123 143 44= 3 465 587 2222 2525 2587 25214 993 995 3000 5000><5100 6276 6277 8000= 8069 8080 8081 8082 8083 8999 10000 5900><6000 30000><50000 10= 24><6277 8765 }"
ext_udp_services =3D "{ ntp, 1194 }&quo= t;

# Internal services
int_tcp_services =3D "{ domain, bootp= s, dhcpv6-server, ntp, http, https, http-alt, \
=C2=A0 =C2=A0 =C2=A0 =C2= =A0 smtp, smtps, pop3, pop3s, imap, imaps, ftp-data, ftp, ssh, svn, 2222, 2= 232, 4444, \
=C2=A0 =C2=A0 =C2=A0 =C2=A0 3128, 3129, 13128, 13129, 23129= , 9050, 8123, 8056, 2199, 8191, 82, 2087, 8333, 1157, \
=C2=A0 =C2=A0 = =C2=A0 =C2=A0 2083, 8030, 10443, 3389, 8080, 8081, 9091, 81, 8086, 8000, 80= 01, 8002, 8005, 8006, 8090, 8100, 8800, 443, 465, 587, 8444, 8443, 9443, \<= br>=C2=A0 =C2=A0 =C2=A0 =C2=A0 18082, 18087, 18092, 18093, 9447, 7005, 115,= 8030, 18090, 18083, 18084, 15001, 15002, 15003, 2082 }"
int_udp_se= rvices =3D "{ domain, bootps, dhcpv6-server, ntp, 1194, svn, sip, 8056= , 500, 1000, 10000 }"

# The martians table denotes the RFC 1918= addresses and a few other ranges which
# are mandated by various RFCs n= ot to be in circulation on the open Internet.
martians =3D "{ 127.0.0.0/8, 192.168.0.0/16, 172.16.0.0/12, \=
=C2=A0 =C2=A0 =C2=A0 =C2=A0 10.0.0.0/8, 169.254.0.0/16, 192.0.2.0/24, \
=C2=A0 =C2=A0 =C2=A0 =C2=A0 0.0.0.0/8, 240.0.0.0/= 4 }"

#-----------------------------------------------------= --------------------------
# PF: Tables
#----------------------------= ---------------------------------------------------

table <whatsa= pp-cidr> persist file "/etc/firewall/whatsapp-cidr.txt"
tab= le <bruteforce> file "/etc/firewall/bruteforce_attackers" p= ersist
table <f2b> persist file "/etc/firewall/f2b"
t= able <fail2ban> persist
table <sshguard> persist

#---= ---------------------------------------------------------------------------= -
# PF: Options
#----------------------------------------------------= ---------------------------

# No restrictions on jail network
set= skip on $jail_if
set skip on lo

#-------------------------------= ------------------------------------------------
# PF: Scrub (Packet Nor= malization)
#-----------------------------------------------------------= --------------------

set limit { states 40000, frags 20000, src-node= s 20000 }
set timeout { adaptive.start 18000, adaptive.end 39000 }
#------------------------------------------------------------------------= -------
# PF: Packet Queueing and Priorization
#---------------------= ----------------------------------------------------------

#--------= -----------------------------------------------------------------------
= # PF: Netkwork Address Translation (NAT) and Packet Redirection
#-------= ------------------------------------------------------------------------
# Network address translation
# Internet
nat on $ext_if inet fro= m any to any -> $ext_if

# Bhyve
nat on $ext_if from $bhyve_net= to any -> ($ext_if)

# Traccar
rdr pass on $ext_if inet proto = { tcp, udp } from any to port 5055 -> 127.0.0.1 port 5055
# Nominatim= Test
rdr pass on $ext_if inet proto { tcp, udp } from any to port 8089 = -> 127.0.0.1 port 8089


#-------------------------------------= ------------------------------------------
# PF: Packet Filtering
#--= ---------------------------------------------------------------------------= --

# Restrictive default rules
block all

# Block packets a= nd reply with a TCP RST or ICMP Unreachable response
block return
# FTP-Proxy
# We need to have an anchor for ftp-proxy
anchor "f= tp-proxy/*"

# Anchor for fail2ban
anchor "f2b/*"
# Anchor for blacklistd
# This makes sure that the rules within bl= acklistd are only used for incoming data on ext_if
anchor "blacklis= td/*" in on $ext_if

# Blocking Spoofed Packets

#--------= -----------------------------------------------------------------------
= # Filter rules for $ext_if inbound

# Temporarily let go everything, = do not leave active!
#pass in on $ext_if inet
#pass in on $ext_if ine= t6

# Allow ping
pass in on $ext_if inet =C2=A0proto icmp =C2=A0al= l
pass in on $ext_if inet6 proto icmp6 all

# External servicespass in on $ext_if inet =C2=A0proto tcp to port $ext_tcp_services
pass = in on $ext_if inet =C2=A0proto udp to port $ext_udp_services

block d= rop in quick on $ext_if inet from <bruteforce> to any
block drop i= n quick on $ext_if inet from <f2b> to any
block in quick from <= fail2ban>

# Custom blocks
block drop in quick on $ext_if inet = from 31.130.184.0/24 to any

<= br>block in proto tcp from <sshguard> to any

# Now block the s= sh bruteforce=C2=A0
block drop in quick on $ext_if inet =C2=A0from <s= sh-bruteforce>
block drop in quick on $ext_if inet6 from <ssh-brut= eforce>

# PF "Self-Protecting" an FTP Server (passive)<= br>pass in on $ext_if inet =C2=A0proto tcp from any to any port { ftp, >= 49151 }
pass in on $ext_if inet6 proto tcp from any to any port { ftp, = > 49151 }

# Traccar
pass in on $ext_if inet proto tcp from any= to any port { 5000><5100 }
pass in on $ext_if inet6 proto tcp fro= m any to any port { 5000><5100 }
# Nominatim Test
pass in on $e= xt_if inet proto tcp from any to any port 8089

#--------------------= -----------------------------------------------------------
# Filter rul= es for $ext_if outbound

pass out on $ext_if inet
pass out on $ext= _if inet6

#---------------------------------------------------------= ----------------------
# Filter rules for $int_if inbound

# block= drop in quick on $int_if inet from 192.168.55.x to any port { 443 993 }#block drop in quick on $int_if from 192.168.54.190 to any
#block drop = in quick on $int_if from any to 13.107.4.50


# Temporarily let go= everything, do not leave active!
#pass in on $int_if inet
#pass in o= n $int_if inet6


# Internal services
pass in on $int_if inet = =C2=A0proto tcp to port $int_tcp_services
pass in on $int_if inet =C2=A0= proto udp to port $int_udp_services


# Filter rules for $int_if o= utbound

pass out on $int_if inet
pass out on $int_if inet6
#-------------------------------------------------------------------------= ------

# DEBUG: RULES FOR VMM

pass in quick on bridge0 all ke= ep state
pass in quick on tap0 all keep state
pass in quick on tap1 a= ll keep state
pass in quick on tap2 all keep state
pass in quick on t= ap3 all keep state
pass out quick on bridge0 all keep state
pass out = quick on tap0 all keep state
pass out quick on tap1 all keep state
pa= ss out quick on tap2 all keep state
pass out quick on tap3 all keep stat= e

# Bhyve hosts
pass in on tap0
pass in on tap1
pass in on = tap2
pass in on tap3
```

--
Best regards,
Odhia= mbo WASHINGTON,
Nairobi,KE
+254 7 3200 0004/+254 7 2274 3223
=C2=A0In=C2=A0an Internet failure case, the #1 suspect is a constant:= DNS.
"Oh, the cruft.",=C2=A0egrep -v '^$|^.*#'=C2=A0=C2= =AF\_(=E3=83=84)_/=C2=AF=C2=A0:-)
[How to ask smart question= s:=C2=A0http://www.catb.org/~= esr/faqs/smart-questions.html]
--00000000000011efcf061d87c97a-- From nobody Sun Jul 21 16:22:56 2024 X-Original-To: virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4WRpc11k0Fz5RmQ9 for ; Sun, 21 Jul 2024 16:22:57 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R11" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4WRpc10bZwz4pGm for ; Sun, 21 Jul 2024 16:22:57 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1721578977; a=rsa-sha256; cv=none; b=mE/3q3xJU2sH9C+zRHVSRdGirnrerllc2VUqJmx4CpEZoHk9+X4Rrj2JORKBh1Zs1A18JB 0EMBzfH0RNYBKH5w58TYWoy6h+6yFQP7gZsHZlxWrN2fT9tcSyRcUJ7wrYwxwLWXq2pemv Cq2JejIGM061Sd8aBgwOwrQueCWYnlr1VeFYoqjrX7ZkAlR8DYi7WY6I969nMz+p2+9K79 QL5/+IvWBPd9L90+Vz4qjPNR66U7Uxf1Pe3oynn5pRP4jf5qkCI1zHOz9bmltWpS6hdm8O lttRoq7owBv2FM7voVy3ETWTlyXvNQG4LkB2qurk38mNV5RXh4uLwz+PBpWQfg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1721578977; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=8/t0P9QRVr95906GkBwTRsQd9qnwmDU5QxfWagrxU5w=; b=VYy2hOvox2y8/XhkBDdYZgNpsaPntCg8VW8EBP4HhBS1hpFcb8N6UkqoXH3FMFKhyiElkh KJGIqVwaolE/6IyZv7FyuOPTeIMmci6vy4YUtLpjdG+K6iJPSb2Mn9O0909C2F8H/Bgo19 CHnS1BHz+vplkTMPpGDu8qjqIOLS0YEvADxhvbQ4nZvGpsQq19hXzcEmguknPFEDZkR6rT k2ZL0RcQr+2kcrI1M5S74Bgk5wpkoCm5lTJdItCNZlCrpHD2V4rZh3eMHpuGP4+C/XogjV 4bi7dJ/Fh4QC2szhK94KRVHeIZ5l8XZt1VWS5lrWh29dozyMYT9Lll+KQqKMhg== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4WRpc10Cc9z17Cq for ; Sun, 21 Jul 2024 16:22:57 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 46LGMux9079286 for ; Sun, 21 Jul 2024 16:22:56 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 46LGMugF079277 for virtualization@FreeBSD.org; Sun, 21 Jul 2024 16:22:56 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 279901] glibc-2.39-2 and above on the host segfault Date: Sun, 21 Jul 2024 16:22:56 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bhyve X-Bugzilla-Version: 14.1-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: bugzilla@tunedal.net X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-virtualization@freebsd.org Sender: owner-freebsd-virtualization@FreeBSD.org MIME-Version: 1.0 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D279901 bugzilla@tunedal.net changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |bugzilla@tunedal.net --- Comment #11 from bugzilla@tunedal.net --- Is this the kind of thing you need? "disas" didn't work, so I tried dumping= the instructions near the program counter instead. (I have no idea what I'm doi= ng when it comes to gdb.) root@localhost:~# gdb --core=3Dpython3.core GNU gdb (Debian 13.2-1+b2) 13.2 ... Core was generated by `python3'. Program terminated with signal SIGSEGV, Segmentation fault. #0 0x0000000000553914 in ?? () (gdb) bt #0 0x0000000000553914 in ?? () #1 0x0000000000000000 in ?? () (gdb) disas No function contains program counter for selected frame. (gdb) x/50i ($pc - 100) 0x5538b0: test %eax,%eax 0x5538b2: je 0x554064 0x5538b8: test %eax,%eax 0x5538ba: jns 0x55406d 0x5538c0: mov %r14,%r12 0x5538c3: cmp %r14,%r15 0x5538c6: jae 0x553f1d 0x5538cc: mov %ebp,%r14d 0x5538cf: shr $0x6,%bpl 0x5538d3: lea 0x28(%r13),%rax 0x5538d7: mov %r13,0x28(%rsp) 0x5538dc: and $0x1,%ebp 0x5538df: shr $0x5,%r14b 0x5538e3: mov %rax,0x10(%rsp) 0x5538e8: mov %r12,%r13 0x5538eb: mov %bpl,0x8(%rsp) 0x5538f0: and $0x1,%r14d 0x5538f4: mov %rbx,0x30(%rsp) 0x5538f9: mov %r14d,%ebx 0x5538fc: mov %r8,%r14 0x5538ff: mov %r13,%rax 0x553902: mov %r14,%rdx 0x553905: sub %r15,%rax 0x553908: sar $0x4,%rax 0x55390c: lea (%r15,%rax,8),%rbp 0x553910: mov 0x0(%rbp),%rsi =3D> 0x553914: mov 0x10(%rsi),%r12 0x553918: movzbl 0x20(%rsi),%eax 0x55391c: cmp %r14,%r12 0x55391f: cmovle %r12,%rdx 0x553923: test $0x20,%al 0x553925: je 0x451a14 0x55392b: test $0x40,%al 0x55392d: je 0x554dfc 0x553933: add $0x28,%rsi 0x553937: test %bl,%bl 0x553939: je 0x555085 0x55393f: cmpb $0x0,0x8(%rsp) 0x553944: je 0x554018 0x55394a: mov 0x10(%rsp),%rdi 0x55394f: call 0x4217f0 0x553954: test %eax,%eax 0x553956: je 0x554030 0x55395c: test %eax,%eax 0x55395e: jns 0x554040 0x553964: cmp %rbp,%r15 0x553967: jae 0x55404d 0x55396d: mov %rbp,%r13 0x553970: jmp 0x5538ff 0x553972: nopw 0x0(%rax,%rax,1) And for vim: root@localhost:~# gdb --core=3Dvim.core GNU gdb (Debian 13.2-1+b2) 13.2 ... Core was generated by `vim'. Program terminated with signal SIGABRT, Aborted. #0 0x00007fee03ec47a7 in ?? () (gdb) bt #0 0x00007fee03ec47a7 in ?? () #1 0x0000559fc8dc4831 in ?? () #2 0x00007fffc3822820 in ?? () #3 0x00000000000001a6 in ?? () #4 0x00007fee03de9440 in ?? () #5 #6 0x00007fee03f1339c in ?? () #7 0x00007fffc3822860 in ?? () #8 0x2c0d8adf099bf900 in ?? () #9 0x0000000000000006 in ?? () #10 0x00007fee03de9440 in ?? () #11 0x00007fffc3822820 in ?? () #12 0x00007fffc3822820 in ?? () #13 0x00007fffc3822820 in ?? () #14 0x00007fee03ec44f2 in ?? () #15 0x00007fee04060b50 in ?? () #16 0x00007fee03ead4ed in ?? () #17 0x0000000000000020 in ?? () #18 0x0000000000000000 in ?? () (gdb) x/50i ($pc - 100) 0x7fee03ec4743: jne 0x7fee03ec4652 0x7fee03ec4749: xor %edx,%edx 0x7fee03ec474b: xor %esi,%esi 0x7fee03ec474d: jmp 0x7fee03ec4652 0x7fee03ec4752: nopw 0x0(%rax,%rax,1) 0x7fee03ec4758: mov 0x19a699(%rip),%rdx # 0x7fee0405edf8 0x7fee03ec475f: neg %eax 0x7fee03ec4761: mov %eax,%fs:(%rdx) 0x7fee03ec4764: mov $0xffffffff,%edx 0x7fee03ec4769: jmp 0x7fee03ec4717 0x7fee03ec476b: call 0x7fee03f98b20 0x7fee03ec4770: sub $0x8,%rsp 0x7fee03ec4774: call 0x7fee03f18220 0x7fee03ec4779: test %eax,%eax 0x7fee03ec477b: jne 0x7fee03ec4788 0x7fee03ec477d: add $0x8,%rsp 0x7fee03ec4781: ret 0x7fee03ec4782: nopw 0x0(%rax,%rax,1) 0x7fee03ec4788: mov 0x19a669(%rip),%rdx # 0x7fee0405edf8 0x7fee03ec478f: mov %eax,%fs:(%rdx) 0x7fee03ec4792: mov $0xffffffff,%eax 0x7fee03ec4797: jmp 0x7fee03ec477d 0x7fee03ec4799: nopl 0x0(%rax) 0x7fee03ec47a0: mov $0x3e,%eax 0x7fee03ec47a5: syscall =3D> 0x7fee03ec47a7: cmp $0xfffffffffffff001,%rax 0x7fee03ec47ad: jae 0x7fee03ec47b0 0x7fee03ec47af: ret 0x7fee03ec47b0: mov 0x19a641(%rip),%rcx # 0x7fee0405edf8 0x7fee03ec47b7: neg %eax 0x7fee03ec47b9: mov %eax,%fs:(%rcx) 0x7fee03ec47bc: or $0xffffffffffffffff,%rax 0x7fee03ec47c0: ret 0x7fee03ec47c1: cs nopw 0x0(%rax,%rax,1) 0x7fee03ec47cb: nopl 0x0(%rax,%rax,1) 0x7fee03ec47d0: mov $0x8,%esi 0x7fee03ec47d5: mov $0x7f,%eax 0x7fee03ec47da: syscall 0x7fee03ec47dc: cmp $0xfffffffffffff000,%rax 0x7fee03ec47e2: ja 0x7fee03ec47e8 0x7fee03ec47e4: ret 0x7fee03ec47e5: nopl (%rax) 0x7fee03ec47e8: mov 0x19a609(%rip),%rdx # 0x7fee0405edf8 0x7fee03ec47ef: neg %eax 0x7fee03ec47f1: mov %eax,%fs:(%rdx) 0x7fee03ec47f4: mov $0xffffffff,%eax 0x7fee03ec47f9: ret 0x7fee03ec47fa: nopw 0x0(%rax,%rax,1) 0x7fee03ec4800: cmpb $0x0,0x1a2839(%rip) # 0x7fee04067040 0x7fee03ec4807: je 0x7fee03ec4820 To get the above output, I used the latest Debian Sid nocloud image: https://cloud.debian.org/cdimage/cloud/sid/daily/20240721-1815/debian-sid-n= ocloud-amd64-daily-20240721-1815.tar.xz I ran it on Bhyve on AMD to get the core dump and on KVM on Intel to debug = it. The debug version of Python (python3-dbg) doesn't crash, so I don't know ho= w to get debug symbols. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sun Jul 21 19:44:41 2024 X-Original-To: freebsd-virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4WRv504zSbz5QMkL for ; Sun, 21 Jul 2024 19:44:52 +0000 (UTC) (envelope-from hartzell@alerce.com) Received: from corvid.alerce.com (corvid.alerce.com [206.125.171.163]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4WRv4z62YFz47YM for ; Sun, 21 Jul 2024 19:44:51 +0000 (UTC) (envelope-from hartzell@alerce.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=alerce.com header.s=dkim header.b=urYkYxJJ; dmarc=pass (policy=none) header.from=alerce.com; spf=pass (mx1.freebsd.org: domain of hartzell@alerce.com designates 206.125.171.163 as permitted sender) smtp.mailfrom=hartzell@alerce.com Received: from postfix.alerce.com (unknown [65.130.18.255]) (using TLSv1.2 with cipher ECDHE-ECDSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by corvid.alerce.com (Postfix) with ESMTPSA id 712A9F0BE0 for ; Sun, 21 Jul 2024 12:55:21 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=alerce.com; s=dkim; t=1721591721; h=from:from:reply-to:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=T9pJiB5g4lvCmDZFqCdMMA+Kdd4xndc//nnwrnX75YM=; b=urYkYxJJce1e+Jk6T5INOWwLT59i1jkwSGxPPOfJcYz1Q8BIkbGVZu5vQe7P+0cGA8l94A UT6fxUnitdHuRoXz5YUwEl0daDzF5WDlc1YEoDVC2LxBfG+SzEjdkKitdKst7Tr7s8qLAh Rvv/tkpTfFQGVMxkadaGQdmhuUESHa4NMQz+M0HAifzJqnfEr1quy4uUybCh2jQAKsDRQ1 oyWgbr3rfql9UQOy8FKsUQvRJqyl2/p3Z1EucxxTRQBEB2aoyLPyTwOcPEsYAdPnSA+k4U Y1H6ek0W2wzlPTV/tLqi75jVksadb5WqQZ4GE3jL+vPshZWyB/RvYoxx/gDEfA== Received: by postfix.alerce.com (Postfix, from userid 502) id E26A933DB0B2; Sun, 21 Jul 2024 13:44:41 -0600 (MDT) From: George Hartzell List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-virtualization@freebsd.org Sender: owner-freebsd-virtualization@FreeBSD.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit Message-ID: <26269.25897.876377.311179@gargle.gargle.HOWL> Date: Sun, 21 Jul 2024 13:44:41 -0600 To: freebsd-virtualization@freebsd.org Subject: Re: Problem with TinyCore Linux in Bhyve in TrueNas In-Reply-To: <26232.44448.864451.216491@gargle.gargle.HOWL> References: <26232.44448.864451.216491@gargle.gargle.HOWL> X-Mailer: VM undefined under 29.1 (aarch64-apple-darwin23.1.0) Reply-To: hartzell@alerce.com X-Spamd-Bar: --- X-Spamd-Result: default: False [-4.00 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-1.000]; DMARC_POLICY_ALLOW(-0.50)[alerce.com,none]; R_SPF_ALLOW(-0.20)[+mx]; R_DKIM_ALLOW(-0.20)[alerce.com:s=dkim]; MIME_GOOD(-0.10)[text/plain]; ARC_NA(0.00)[]; ASN(0.00)[asn:25795, ipnet:206.125.168.0/21, country:US]; RCVD_VIA_SMTP_AUTH(0.00)[]; MIME_TRACE(0.00)[0:+]; RCPT_COUNT_ONE(0.00)[1]; MLMMJ_DEST(0.00)[freebsd-virtualization@freebsd.org]; RCVD_TLS_LAST(0.00)[]; REPLYTO_ADDR_EQ_FROM(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; FROM_HAS_DN(0.00)[]; HAS_REPLYTO(0.00)[hartzell@alerce.com]; RCVD_COUNT_TWO(0.00)[2]; TO_MATCH_ENVRCPT_ALL(0.00)[]; TO_DN_NONE(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-virtualization@freebsd.org]; DKIM_TRACE(0.00)[alerce.com:+] X-Rspamd-Queue-Id: 4WRv4z62YFz47YM George Hartzell writes: > > I have a TrueNAS Core system running TrueNAS-13.0-U6.1. > > I'm trying to install TinyCore Linux in a VM. [...] Just wanted to follow up with a few notes after working all this out. It's mostly straight-forward, do what you think you should, and _etc_. The key bits are: - Use the [TinyCorePure64] iso, it has the UEFI bits needed to boot up. - Connect via VNC - In grub, choose `core`, the window-system version (tc) would boot but I could never get the mouse/keyboard to respond in the VNC window. - Use the virtio network device, not the Intel device. The Intel device works for a bit, but when I would try to reconnect a VNC session the entire VM would get a sig 6 or 11. For my future self's sake (and completeness), my notes boil down to: ## Set up a VM - Grab a copy of the x86 Pure 64 port iso. E.g. the [Core Pure 64 Latest Build] and then [TinyCorePure64]. You need the `TinyCorePure64` ISO, not the `CorePure64...` ISO, the former includes necessary UEFI boot bits. - Set up a VM using the TrueNAS GUI. Most of the choices are "obvious", but definitely should have... - Guest Operating System: Linux - Boot Method: UEFI - [x] Enable VNC - NEXT - CPU bits, whatever, I took the defaults - NEXT - Create a new disk image, provide a ZVOL storage location and a size. - NEXT - Networking bits - Choose the virtio adapter, not the Intel. The intel seems to cause the vm to crash when (at least) VNC reconnects. - NEXT - boot from the e.g. TinyCorePure64-15.0.iso image. You might need to upload it from your laptop or otherwise get it into the TrueNAS filesystem. - NEXT - SUBMIT ## Start the VM - Start it - Choose the VNC console - In grub, choose `core` (the `tc` choice sets up an X desktop, I couldn't figure out how to get it to listen to input...). - You should now be at a shell prompt ## Load some useful tools (might not be minimal...) - `tce-load -wi e2fsprogs dosfstools grub2-multi efibootmgr` - `sudo fdisk /dev/sda` ... - `sudo fdisk /dev/sda` -- goal is to create two partitions, first is a type `ef` (EFI) of ~0.5G, then a type `83` (linux) that uses the rest of the disk. - Create some filesystems: - `sudo mkfs.vfat /dev/sda1` - `sudo mkfs.ext4 /dev/sda2` - Mount them - `sudo rebuildfstab` - `sudo mount /dev/sda1` - `sudo mount /dev/sda2` - Install the boot loader - `sudo grub-install --target=x86_64-efi --boot-directory=/mnt/sda1/EFI/BOOT --efi-directory=/mnt/sda1 --removable` - Set up the tinycore bits - `mkdir /mnt/sda1/boot` - `mount /dev/sr0` - `cp /mnt/sr0/boot/* /mnt/sda1/boot` # ignore warning about omitting a directory - `cp /mnt/sr0/EFI/BOOT/grub/grub.cfg /mnt/sda1/EFI/BOOT/grub/grub.cfg` - (optional) edit the `grub.cfg`, I removed useless entries... and added a `default=core` and `timeout=5` - `mkdir /mnt/sda1/tce` - `touch /mnt/sda1/tce/mydata.tgz` - `sudo halt` - Stop the VM, remove the CD device from the VM, then start it and reconnect to VNC. - Et, viola! [TinyCorePure64]: http://tinycorelinux.net/15.x/x86_64/release/TinyCorePure64-15.0.iso From nobody Sun Jul 21 21:00:43 2024 X-Original-To: virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4WRwmX3TRfz5QTjk for ; Sun, 21 Jul 2024 21:00:44 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R11" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4WRwmX0Q6dz4K6k for ; Sun, 21 Jul 2024 21:00:44 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1721595644; a=rsa-sha256; cv=none; b=wtVdGCaeF9nmH1iSrPJpqLRBDA7Q466pUPEnnFqVDx9Zb3LELw6mgctXWHvCBj5s/VzK4q D5x4SnuUMJshg4pQ1XgiDhiDqZQM6Q4Wgny0ngr3WGM2pexWqCsGqaOemes4R9JR9WEKba UBHFNgyNNl7coJAEPYikk7WYU9WzKJwxXgGfCEFQ7jdp7e6X4sS5oiVxkR8wvEEsv6h9Zl ZQ88A0ODPli5W81Iy2wL6V1dfxNOqYND2Lqyb4MvqwmzkuxH4MazuXuF4Oqo0QipdWNbLI mgVG7F6gYlWhjnei+lWneiHJSZMHWFYmlLixpW+dyHitddqc5KJp5JIKyPEPFA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1721595644; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=wULj57KVSfimwVOLLjBKkminCWRGpUYUVQNxTS9SPH4=; b=J0ognGcFK+QTAkEF+P78CpHRFnsh4pb6nZqxKp5hAWn3k8yInYOWNsiUzkEpqxmx/F97xV Y9IQFOs/N6KzhkyWB29iV4FBdHXXYmVMIa5CWFhOkmkZa1S5xXSpNxnRuhU+fdePXHXSif lH0fNTCm87y4Ec+jaz4UVG3qxs5u2di1YkQwL7dQ60lLQJ6NFKw2mxRYmF9nonGtyMAHUe gqVJGAhECPupHPpNQvTX+E90/7i1WGbglg2mOmhib/Ef511zA2zESXoF+LBOxaw1h+YjdF ZgkyMzO44Nk0nIHyzkSgHFAeYwr9Er9xff76v3XAkxOYntCVdfHsIp3VHSGwag== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4WRwmX02gszG8d for ; Sun, 21 Jul 2024 21:00:44 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 46LL0hps019502 for ; Sun, 21 Jul 2024 21:00:43 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 46LL0hdE019501 for virtualization@FreeBSD.org; Sun, 21 Jul 2024 21:00:43 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Message-Id: <202407212100.46LL0hdE019501@kenobi.freebsd.org> X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@FreeBSD.org using -f From: bugzilla-noreply@FreeBSD.org To: virtualization@FreeBSD.org Subject: Problem reports for virtualization@FreeBSD.org that need special attention Date: Sun, 21 Jul 2024 21:00:43 +0000 List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-virtualization@freebsd.org Sender: owner-freebsd-virtualization@FreeBSD.org MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="17215956431.08e1.12228" Content-Transfer-Encoding: 7bit --17215956431.08e1.12228 Date: Sun, 21 Jul 2024 21:00:43 +0000 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" To view an individual PR, use: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=(Bug Id). The following is a listing of current problems submitted by FreeBSD users, which need special attention. These represent problem reports covering all versions including experimental development code and obsolete releases. Status | Bug Id | Description ------------+-----------+--------------------------------------------------- Open | 264267 | UEFI Booting on Azure Generation 2 VMs crashes 1 problems total for which you should take action. --17215956431.08e1.12228 Date: Sun, 21 Jul 2024 21:00:43 +0000 MIME-Version: 1.0 Content-Type: text/html; charset="UTF-8" 
The following is a listing of current problems submitted by FreeBSD users,
which need special attention. These represent problem reports covering
all versions including experimental development code and obsolete releases.

Status      |    Bug Id | Description
------------+-----------+---------------------------------------------------
Open        |    264267 | UEFI Booting on Azure Generation 2 VMs crashes

1 problems total for which you should take action.
--17215956431.08e1.12228--