Date: Fri, 16 Feb 2024 12:00:13 -0600 From: Matthew Grooms <mgrooms@shrew.net> To: Chuck Tuffli <chuck@tuffli.net>, FreeBSD virtualization <freebsd-virtualization@freebsd.org> Subject: Re: bhyve disk performance issue Message-ID: <0ff6f30a-b53a-4d0f-ac21-eaf701d35d00@shrew.net> In-Reply-To: <28ea168c-1211-4104-b8b4-daed0e60950d@app.fastmail.com> References: <6a128904-a4c1-41ec-a83d-56da56871ceb@shrew.net> <28ea168c-1211-4104-b8b4-daed0e60950d@app.fastmail.com>
next in thread | previous in thread | raw e-mail | index | archive | help
This is a multi-part message in MIME format.
--------------OUO03Djdqszf3XOd8PWHDNYK
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 8bit
On 2/16/24 11:42, Chuck Tuffli wrote:
> On Fri, Feb 16, 2024, at 9:19 AM, Matthew Grooms wrote:
>>
>> Hi All,
>>
>>
>> I'm in the middle of a project that involves building out a handful
>> of servers to host virtual Linux instances. Part of that includes
>> testing bhyve to see how it performs. The intent is to compare host
>> storage options such as raw vs zvol block devices and ufs vs zfs disk
>> images using hardware raid vs zfs managed disks. It would also involve
>>
>>
> …
>>
>> Here is a list of a few other things I'd like to try:
>>
>>
>> 1) Wiring guest memory ( unlikely as it's 32G of 256G )
>> 2) Downgrading the host to 13.2-RELEASE
>
> FWIW we recently did a similar exercise and saw significant
> performance differences on ZFS backed disk images when comparing 14.0
> and 13.2. We didn’t have time to root cause the difference, so it
> could simply be some tuning difference needed for 14.
Hi Chuck,
That's very helpful feedback. I'll start by downgrading the host to 13.2
and report back here.
Thanks again,
-Matthew
--------------OUO03Djdqszf3XOd8PWHDNYK
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: 8bit
<!DOCTYPE html>
<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
</head>
<body>
On 2/16/24 11:42, Chuck Tuffli wrote:<br>
<blockquote type="cite"
cite="mid:28ea168c-1211-4104-b8b4-daed0e60950d@app.fastmail.com">
<meta http-equiv="content-type" content="text/html; charset=UTF-8">
<title></title>
<style type="text/css">p.MsoNormal,p.MsoNoSpacing{margin:0}</style>
<div>On Fri, Feb 16, 2024, at 9:19 AM, Matthew Grooms wrote:<br>
</div>
<blockquote type="cite" id="qt" style="">
<p>Hi All,<br>
</p>
<p><br>
</p>
<div>I'm in the middle of a project that involves building out a
handful of servers to host virtual Linux instances. Part of
that includes testing bhyve to see how it performs. The intent
is to compare host storage options such as raw vs zvol block
devices and ufs vs zfs disk images using hardware raid vs zfs
managed disks. It would also involve<br>
</div>
<p><br>
</p>
</blockquote>
<div>…<br>
</div>
<blockquote type="cite" id="qt" style="">
<p><span style="color:rgb(27, 30, 32);">Here is a list of a few
other things I'd like to try:</span><br>
</p>
<div> <br>
</div>
<div> 1) Wiring guest memory ( unlikely as it's 32G of 256G )<br>
</div>
<div> 2) Downgrading the host to 13.2-RELEASE<br>
</div>
</blockquote>
<div><br>
</div>
<div>FWIW we recently did a similar exercise and saw significant
performance differences on ZFS backed disk images when comparing
14.0 and 13.2. We didn’t have time to root cause the difference,
so it could simply be some tuning difference needed for 14. <br>
</div>
</blockquote>
<br>
<p>Hi Chuck,</p>
<p>That's very helpful feedback. I'll start by downgrading the host
to 13.2 and report back here.<br>
</p>
<p>Thanks again,</p>
<p>-Matthew<br>
</p>
</body>
</html>
--------------OUO03Djdqszf3XOd8PWHDNYK--
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?0ff6f30a-b53a-4d0f-ac21-eaf701d35d00>