From nobody Tue Apr 28 23:43:45 2026 X-Original-To: arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4g4xqK3Tl7z6cGRd for ; Tue, 28 Apr 2026 23:44:29 +0000 (UTC) (envelope-from marietto2008@gmail.com) Received: from mail-pj1-x102b.google.com (mail-pj1-x102b.google.com [IPv6:2607:f8b0:4864:20::102b]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "WR4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4g4xqJ3mcmz3fP9 for ; Tue, 28 Apr 2026 23:44:28 +0000 (UTC) (envelope-from marietto2008@gmail.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20251104 header.b=XxaQdKB0; dmarc=pass (policy=none) header.from=gmail.com; arc=pass ("google.com:s=arc-20240605:i=1"); spf=pass (mx1.freebsd.org: domain of marietto2008@gmail.com designates 2607:f8b0:4864:20::102b as permitted sender) smtp.mailfrom=marietto2008@gmail.com Received: by mail-pj1-x102b.google.com with SMTP id 98e67ed59e1d1-35da9c0c007so10265781a91.2 for ; Tue, 28 Apr 2026 16:44:28 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1777419862; cv=none; d=google.com; s=arc-20240605; b=AepzzgV5IDTb9LC9OVBT7PZqIPiVr4v5e9iSde6gsNpz9nqowPOSKwcFGQImG+/lq3 iRl6YDx2t5G8LKqj4mOjuT82xjCf+UmFCTPu5dSq7hOVLhSflt5lHST7V8u815Y5aq3i n1cDVsrTOgn1ZBQcSjZxjfloccGsTtDnrtQRnUxJpv50dwQ9H7MPLrc2GJVIffEP0HNu cSxhv1ah36TUKNsHBNWcEI/0nSLJx8gZtDLWfQSo/gfieMR1yFpuUBVpqYrIw6grFS71 owwNG8qWgzQjfkYRmLYotfJAfn56TQzRJawOeEpIpvB6RB7NUeYwcha6loRkYJeB5vzS BRkw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20240605; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:dkim-signature; bh=Hw3Fych1WIOgYwEgvAs4NeESUgpL+UIO2mkfIgVXPlo=; fh=4epOILOUr7DZRzm62DmHflTZCYLy3va+FrrdOKyRuCs=; b=V7dgjwDXB/GUHviXN1T4PkJodWGgVQhFAmxDYEmSYvjCGkIKVAf/sjm2zrzXrbk1YY 5p3Yztyxi9zLWx0ocvpysqju7LdQujDvm8uYLvAYCxMQZFXuKwO61rtAK0uTA2lb30KM Xen5sKyESSWCKVKaWXycRnkF35LFfDcmNmrSHZLBXjUEaZ56J+J8jzEpLtau48V1vSmD wy4U6TwhL+OClI3NmvEP2vJqYFy+cWqmxsZPKLHkwQQ1A5Ono0g0Jnlgc0MjDR/NPtBL eNebCQZarFMgT/FFLmsS17R/ZFOTZhaNiRWYWawoLI4bKmVHzK4XuCzE7bEpzgMniiYs +XTQ==; darn=freebsd.org ARC-Authentication-Results: i=1; mx.google.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20251104; t=1777419862; x=1778024662; darn=freebsd.org; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=Hw3Fych1WIOgYwEgvAs4NeESUgpL+UIO2mkfIgVXPlo=; b=XxaQdKB0HbIuI3+MxMNLtzwfdiyHFARTPtbr0+FeGZLTqee+9nkw2xx4LobsSDBd6l IXwf1E1UB7Cy4dIl2qvjK+Q5n4pT5qWCny7lBx3G3spFO/Ml0+Kmi9i+r/lOZ0i0wIpu HmXjRxc6I6FaXGb9JxN9VFiHl++IALYE1VVodL81PIu2X3biIo/dij0z0sTp6TnUmmmh gJ6YOMbpHJX9EbYhEqL9/ZPkne+suIPlEyiDqTsBLCjgZtyN2fjvEF7CSrlhpx+x8Zry NFD3j+FliJSeTk/iYSKWhx+Bbc1ZAkiUIcj1XDwLZerlOSKwKc2pld1sBBKDF71kUD/g dyJA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20251104; t=1777419862; x=1778024662; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-gg:x-gm-message-state:from:to:cc:subject:date :message-id:reply-to; bh=Hw3Fych1WIOgYwEgvAs4NeESUgpL+UIO2mkfIgVXPlo=; b=HUCG5QolYdkZ8w+ulQhbSwDPO0U6H1W8ReM5JOIeRB4ZiWeMGS/ukveEO/ZXs9tlJO F9cDNdeXUAupQ/v4JPen8T3UpS9EFs7nka2jZvgbWxZgpoyOElF4+aiY7T9qNqYPM81j 0rNAuZAzLRImmJxCjeAtTq8Wi1t9GBegaJ7EvpJ0AulfuM82ooJ/ZBQ3tgO6macvBLlF coQ69aqTdjyT5lqoN3T/hKZUaGFMyKVt0NeOK4mlxbymn5ZQ5sCozOGCUBnjec6KOp/d GCr84Ae+CW54EXSGQTiiCwr4RJiyAjv5diPlnCvSqLWeatQhKRsgHDQqAd/Vwgk/I/4l /ZZw== X-Forwarded-Encrypted: i=1; AFNElJ8snz1DhgBt04xob5NT2zRZtkREQA0nnGHoH7bkYsHVF0YU8q4zS6Ofoy84iu9ly7U1lb4=@freebsd.org X-Gm-Message-State: AOJu0Yy3rb9i7/8OaEGCyqehO+eOtiFVXNjchxNW+7OmZCSPoAGdxSDp vy7sX2GXmvGiWpx27BFaieAT4wfA0iPgjTezW8jRZNMVuW4B/Nuc5eJJTM+yd+awH8fWDrSIefE LVLmrpgjLpD+9N7B6clfTp9n0YkpNFDJ83c9HMzI= X-Gm-Gg: AeBDieuuTkzvXwhB8mLh/HsCfgeXQlbBQW+Hvc0a8UAHRg0O8qAaJiHAVZ6RUgH7Orr LI74EXfHujh+o2exCob6L6ZQBtanGWPchVWprEG0i4PTUBecr/rEArj5HYyx7OSlik6l7jxOZUz E1AytqbJpu8f/8/fFeeaDH3KBIgOGbMiTjmjhFmLdspqOJYmTHTd+PVQW0KKPMb5hlsXK13VrhO 8++xgH8s+77CHsgayVXaJBnNhHM8KbmeqkGWihkFjG0blZvl6EOvGtB9JEmUdGc2O2nkgzIiu64 DFzSA7gQxPTMOU5m4oTdekfFJECWc2KBQQYbkgkyRLVXdk2P9CDKmGRvql7ePuqOCkT/Zg0tRHG DSckUUfu9kEczfGt4lAwX4hN0wWfF4B3PpktJ2g0iTnjn6moKatID9odZRLii8KDbMzz3VwKqMx YVXm1r6UsrKggN0dV70YExt2/c1/naM4SaPMTd64A1uCq68llMyHJhJE2qNufDaQk00db/eDAiK c1AYEATAyWCyleMslqmvrmVlMdCuheDFaMD3lfytxUPbTMn63cyMIgW3S1t972CrjRcTcbcJgxM RjkFUgg8bRvo8ci0L9due2HZKoa0Aj9fTExpUdOT4Yzx X-Received: by 2002:a17:90b:3850:b0:35a:329:73d8 with SMTP id 98e67ed59e1d1-36491ff66cdmr5243381a91.4.1777419862123; Tue, 28 Apr 2026 16:44:22 -0700 (PDT) List-Id: Porting FreeBSD to ARM processors List-Archive: https://lists.freebsd.org/archives/freebsd-arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@FreeBSD.org MIME-Version: 1.0 References: <18B789E4-5891-4F3E-BAB6-05FD45949438@yahoo.com> <1923834610.13708.1716392599662@localhost> <6117F301-D584-40F7-9022-F90103FF5468@yahoo.com> <71FB8C8C-DA84-469B-8742-1C3DD5F3E773@mit.edu> In-Reply-To: From: Mario Marietto Date: Wed, 29 Apr 2026 01:43:45 +0200 X-Gm-Features: AVHnY4Ktl5PX_CTqwg4fKMYL7yBYsGfs7ttWbv6oPGe44ZozJ33kDf05tjxdInU Message-ID: Subject: Re: vmm (bhyve) on GICv2 To: John F Carr Cc: Mark Millard , Ronald Klop , "arm@freebsd.org" , Lexi Winter Content-Type: multipart/alternative; boundary="0000000000007faa3706508dcfd5" X-Spamd-Result: default: False [-4.93 / 15.00]; ARC_ALLOW(-1.00)[google.com:s=arc-20240605:i=1]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.93)[-0.932]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20251104]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4864::/56]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; TO_DN_EQ_ADDR_SOME(0.00)[]; RCVD_TLS_LAST(0.00)[]; FREEMAIL_FROM(0.00)[gmail.com]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::102b:from]; FREEMAIL_CC(0.00)[yahoo.com,klop.ws,freebsd.org,le-fay.org]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; TO_DN_SOME(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; FROM_HAS_DN(0.00)[]; MISSING_XM_UA(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[arm@freebsd.org]; TO_MATCH_ENVRCPT_SOME(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; MID_RHS_MATCH_FROMTLD(0.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; MLMMJ_DEST(0.00)[arm@freebsd.org]; RCPT_COUNT_FIVE(0.00)[5]; RCVD_COUNT_ONE(0.00)[1]; FREEMAIL_ENVFROM(0.00)[gmail.com] X-Rspamd-Queue-Id: 4g4xqJ3mcmz3fP9 X-Spamd-Bar: ---- --0000000000007faa3706508dcfd5 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Hello to everyone. I would like to try bhyve for arm64 bit on my radxa zero 3W. Does anyone know if this board supports GICv3 ? On Wed, May 22, 2024 at 10:29=E2=80=AFPM Mario Marietto wrote: > Is there another cheap alternative to the RockPro64 / Quartz64 that works > well on FreeBSD if one wants to test bhyve ? > > On Wed, May 22, 2024 at 9:39=E2=80=AFPM Mario Marietto > wrote: > >> This ? >> >> https://pine64.com/product/quartz64-model-a-8gb-single-board-computer/ >> >> On Wed, May 22, 2024 at 9:20=E2=80=AFPM John F Carr wrote: >> >>> > On May 22, 2024, at 13:20, Mario Marietto >>> wrote: >>> > >>> > Can someone confirm that bhyve works ok on the RockPro64 (RK3399) ? >>> Has bhyve been patched in relation to this bug : >>> > >>> > https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D277559 >>> > >>> > ? >>> > >>> > I read that there is a huge amount of work to do on the RPI5 before i= t >>> works with FreeBSD. And anyway,it does not support bhyve. So if I will = buy >>> a soc,it will be the RockPro64.... >>> >>> The RockPro64 should be usable for development, not production use >>> of virtual machines. The kernel sometimes locks up the first time the >>> vmm module is loaded. Once the module loads it can be unloaded >>> and reloaded without risk. >>> >>> I was able to boot FreeBSD-13.3-RELEASE-arm64-aarch64.raw in bhyve >>> on my RockPro64 with this script: >>> >>> NCPU=3D1 >>> MEM=3D384m >>> DISK0=3D/dev/nda0s4 >>> VMNAME=3Dthirteen >>> bhyve -c "${NCPU:?}" -m "${MEM:?}" \ >>> -s 0:0,hostbridge \ >>> -s 1:0,virtio-blk,"${DISK0:?}" \ >>> -o bootrom=3D/usr/local/share/u-boot/u-boot-bhyve-arm64/u-boot.bin \ >>> -o rtc.use_localtime=3Dfalse \ >>> -o console=3Dstdio \ >>> -o config.dump=3Dfalse \ >>> -o acpi_tables=3Dtrue \ >>> "${VMNAME:?}" >>> >>> I had copied the image to /dev/nda0s4. It should work just as well wit= h >>> the >>> regular file after "virtio-blk". >>> >>> Some observations: >>> >>> 1. There is no clock visible to the guest OS: >>> >>> Warning: no time-of-day clock registered, system time will not be set >>> accurately >>> >>> 2. The RockPro system has two types of cores. One has a physically >>> indexed I-cache, >>> the other virtually indexed. The virtual CPU reports a virtually >>> indexed cache. >>> >>> CPU 0: ARM Foundation-Model r0p0 affinity: 0 >>> Cache Type =3D <64 byte D-cacheline,64 byte >>> I-cacheline,VIPT ICache,64 byte ERG,64 byte CWG> >>> >>> I think this will cause correct behavior despite being technically wron= g. >>> >>> I have a Quartz64, a newer Pine64 SBC, but I have not yet tried to >>> install BSD on it. >>> >>> John Carr >>> >>> >> >> -- >> Mario. >> > > > -- > Mario. > --=20 Mario. --0000000000007faa3706508dcfd5 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
Hello to everyone.

I would l= ike to try bhyve for arm64 bit on my radxa zero 3W. Does anyone know if thi= s board supports=C2=A0GICv3 ?

On Wed, May 22, 2024 at 10:29=E2=80=AFPM= Mario Marietto <marietto2008@gmail.com> wrote:
Is there another cheap alternat= ive to the RockPro64 / Quartz64 that works well on FreeBSD if one wants to = test bhyve ?

On Wed, May 22, 2024 at 9:39=E2=80=AFPM Mario Marietto <= ;marietto2008@g= mail.com> wrote:

On Wed, May 22, 2024 at 9:20=E2=80=AFPM John F Carr= <jfc@mit.edu> w= rote:
> On Ma= y 22, 2024, at 13:20, Mario Marietto <marietto2008@gmail.com> wrote:
>
> Can someone confirm that bhyve works ok on the RockPro64 (RK3399) ? Ha= s bhyve been patched in relation to this bug :
>
> https://bugs.freebsd.org/bugzilla/sho= w_bug.cgi?id=3D277559
>
> ?
>
> I read that there is a huge amount of work to do on the RPI5 before it= works with FreeBSD. And anyway,it does not support bhyve. So if I will buy= a soc,it will be the RockPro64....

The RockPro64 should be usable for development, not production use
of virtual machines.=C2=A0 The kernel sometimes locks up the first time the=
vmm module is loaded.=C2=A0 Once the module loads it can be unloaded
and reloaded without risk.

I was able to boot FreeBSD-13.3-RELEASE-arm64-aarch64.raw in bhyve
on my RockPro64 with this script:

NCPU=3D1
MEM=3D384m
DISK0=3D/dev/nda0s4
VMNAME=3Dthirteen
bhyve -c "${NCPU:?}" -m "${MEM:?}" \
-s 0:0,hostbridge \
-s 1:0,virtio-blk,"${DISK0:?}" \
-o bootrom=3D/usr/local/share/u-boot/u-boot-bhyve-arm64/u-boot.bin \
-o rtc.use_localtime=3Dfalse \
-o console=3Dstdio \
-o config.dump=3Dfalse \
-o acpi_tables=3Dtrue \
"${VMNAME:?}"

I had copied the image to /dev/nda0s4.=C2=A0 It should work just as well wi= th the
regular file after "virtio-blk".

Some observations:

1. There is no clock visible to the guest OS:

Warning: no time-of-day clock registered, system time will not be set accur= ately

2. The RockPro system has two types of cores.=C2=A0 One has a physically in= dexed I-cache,
the other virtually indexed.=C2=A0 The virtual CPU reports a virtually inde= xed cache.

CPU=C2=A0 0: ARM Foundation-Model r0p0 affinity:=C2=A0 0
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0Cache = Type =3D <64 byte D-cacheline,64 byte I-cacheline,VIPT ICache,64 byte ER= G,64 byte CWG>

I think this will cause correct behavior despite being technically wrong.
I have a Quartz64, a newer Pine64 SBC, but I have not yet tried to install = BSD on it.

John Carr



--
Mario.


--
Mario.


--
Ma= rio.
--0000000000007faa3706508dcfd5--