Date: Mon, 16 Oct 2023 06:17:22 -0700 From: Chuck Tuffli <chuck@freebsd.org> To: Warner Losh <imp@bsdimp.com> Cc: Pete Wright <pete@nomadlogic.org>, FreeBSD Current <freebsd-current@freebsd.org> Subject: Re: nvme timeout issues with hardware and bhyve vm's Message-ID: <CAKAYmM%2BbFd-jiX4MS4nfekMipnriMPGNVY8ktepgiZ8Gk0M1MA@mail.gmail.com> In-Reply-To: <CANCZdfpgw_sm4couYx9%2Bcgp-q_2jmPC2Q7TSeD9Yb3VYoiDQhQ@mail.gmail.com> References: <90d3e532-8ea7-4eea-8e31-8c363285a156@nomadlogic.org> <CANCZdfrQTd3F-j81HsamUCJG4DyUk_-yPOtbZY4Q926_ihatsQ@mail.gmail.com> <0ad493d5-1c1e-4370-977a-118f46ebd677@nomadlogic.org> <CANCZdfrwzmZ=iHj_vm2nsi72ceRQ81KY5DjiuML3udEaWTBanA@mail.gmail.com> <0c4f8149-89dd-4635-a5ed-4766fffd2553@nomadlogic.org> <CANCZdfpgw_sm4couYx9%2Bcgp-q_2jmPC2Q7TSeD9Yb3VYoiDQhQ@mail.gmail.com>
next in thread | previous in thread | raw e-mail | index | archive | help
On Fri, Oct 13, 2023 at 7:34=E2=80=AFPM Warner Losh <imp@bsdimp.com> wrote: ... > Let me now if you see similar messages in stable/14. I think I've fixed a= ll the > issues with timeouts, though you shouldn't ever seem them in a vm setup > unless something else weird is going on. I'd be interested in a repo case too as I haven't seen the NVMe emulation in bhyve do this before. Were there any error messages from bhyve? The guest log messages seem to suggest that the backing storage for the emulated device is timing out. If your comment > I had similar issues on my workstation as well. Scrubbing the NVMe > device on my real-hardware workstation hasn't turned up any issues, but > the system has locked up a handful of times. means the host is seeing NVMe errors on the drives backing the zpool/zvol used by the emulated device, this might explain it. Although, it is curious the emulated controller had trouble resetting (i.e., the error message "controller ready did not become 1 within 30500 ms"). --chuck
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?CAKAYmM%2BbFd-jiX4MS4nfekMipnriMPGNVY8ktepgiZ8Gk0M1MA>