From nobody Fri Jan 12 22:07:26 2024 X-Original-To: freebsd-virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4TBbHx3LrZz56VZw for ; Fri, 12 Jan 2024 22:07:41 +0000 (UTC) (envelope-from tomek@cedro.info) Received: from mail-yb1-xb34.google.com (mail-yb1-xb34.google.com [IPv6:2607:f8b0:4864:20::b34]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4TBbHx0BvFz4jmq for ; Fri, 12 Jan 2024 22:07:41 +0000 (UTC) (envelope-from tomek@cedro.info) Authentication-Results: mx1.freebsd.org; none Received: by mail-yb1-xb34.google.com with SMTP id 3f1490d57ef6-dbed5d2ad18so6213961276.0 for ; Fri, 12 Jan 2024 14:07:41 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=cedro.info; s=google; t=1705097259; x=1705702059; darn=freebsd.org; h=content-transfer-encoding:cc:to:subject:message-id:date:from :in-reply-to:references:mime-version:from:to:cc:subject:date :message-id:reply-to; bh=KS9cSG6NHYCgJdXqBQO/Wrbb6snlx4gWVd+t8cI8fSU=; b=HxIF0IDEkkxLOsKttcXV82qBFxexLz/Rl4VDWfdpb8VgGqu26SGAoMnBCk5+Q5srBd +E2z73E9oaQRd4DnCX8Qwx9h9XIqcgyX1tbOHYewh0S/uXvlT6+prsQmhN3g+HzXZfR9 1992G/fBTtG4ZUpB5ViVtRfxLAYaHXsbGPCILn3PqfIA28MXt0dD9lTAuOtgMvyvXphO P6K8ZPKQCO7mIzOdslDBQUSJLKaCVVNgbxGxCyveU/qX4D+W4rY7YKPaP8Wr4My+u2JD om1LBvk9lRI6CJ1dP5nDNg9+JG9+CVFxau/OwBsANS0NSjkikC7Wu5Axj65GPI2B/b/b Uv1w== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1705097259; x=1705702059; h=content-transfer-encoding:cc:to:subject:message-id:date:from :in-reply-to:references:mime-version:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=KS9cSG6NHYCgJdXqBQO/Wrbb6snlx4gWVd+t8cI8fSU=; b=GPyDrXRVzj+u9QHjhvj3whQojkG3fawAMRPDVDl4R0o91lxSsrxBE7Tex2RAQ7Vpuf s7xIB5fUhly38JEmtps8I9vaxnX/ifDVeD6AsRspxGkHif+SPxc5lZfpzEq9DpP+/ciy hL2ClR2lO8JJZyESbdkRdulZX3+Nj4eKHwWL5NBFqjLZ7810RWfhRlSrLx86PDGCWOvF UjtBz6YVcG2GsBeCUUfyKaPLrhHiil8ifwvXNhU8vx2YkQtr86xjf2oN9rAD19Wn0rHP hau6tCrnZQP4X/WzT3j5KTFpMUc1BPtEO1FPspWz4Unq5To6DLdhi2u77jj5ntdpAzSF O7Ew== X-Gm-Message-State: AOJu0YzMJ/47xfAAhekV9WIlFcg19buFgL2rJYzzlXGlFhpUAWYStyl7 BqC/kQOuSqcbALLSheoidq/p0yabgU7yax3tjbVljGTlTA== X-Google-Smtp-Source: AGHT+IGEB5Fd6Zh5j4DM94arxLPCoJwPuA3og94seW5vNCOlC3WvbMPQ3lUNbxmMZ7mo0FHuBIVPFw== X-Received: by 2002:a25:df87:0:b0:dbf:4864:77c6 with SMTP id w129-20020a25df87000000b00dbf486477c6mr1266787ybg.104.1705097259582; Fri, 12 Jan 2024 14:07:39 -0800 (PST) Received: from mail-yw1-f171.google.com (mail-yw1-f171.google.com. [209.85.128.171]) by smtp.gmail.com with ESMTPSA id 20-20020a250b14000000b00dbf335494e2sm1554144ybl.34.2024.01.12.14.07.39 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Fri, 12 Jan 2024 14:07:39 -0800 (PST) Received: by mail-yw1-f171.google.com with SMTP id 00721157ae682-5fc2e997804so9153847b3.3; Fri, 12 Jan 2024 14:07:39 -0800 (PST) X-Received: by 2002:a81:8442:0:b0:5f8:6f47:b081 with SMTP id u63-20020a818442000000b005f86f47b081mr2037442ywf.9.1705097258659; Fri, 12 Jan 2024 14:07:38 -0800 (PST) List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-virtualization@freebsd.org X-BeenThere: freebsd-virtualization@freebsd.org MIME-Version: 1.0 References: In-Reply-To: From: Tomek CEDRO Date: Fri, 12 Jan 2024 23:07:26 +0100 X-Gmail-Original-Message-ID: Message-ID: Subject: Re: (vm-)bhyve stopped working recently on 13.2 To: Michael Gmelin Cc: FreeBSD Questions Mailing List , Virtualisation on FreeBSD Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Rspamd-Queue-Id: 4TBbHx0BvFz4jmq X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US] On Fri, Jan 12, 2024 at 10:54=E2=80=AFPM Michael Gmelin wrote: > What are you running inside bhyve (OS and version)? Could you maybe share= vm-bhyve=E2=80=98s config file? I was running Debian 11 and since it stopped working I tried Debian 12. debug=3D"yes" #loader=3D"bhyveload" loader=3D"uefi" uefi_vars=3D"yes" graphics=3D"yes" graphics_res=3D"1920x1080" graphics_listen=3D"127.0.0.1" graphics_wait=3D"no" graphics_vga=3D"no" cpu=3D"4" memory=3D"20G" network0_type=3D"virtio-net" network0_switch=3D"public" #disk0_type=3D"virtio-blk" disk0_type=3D"nvme" disk0_name=3D"disk0.img" sound=3D"yes" sound_play=3D"/dev/dsp" passthru0=3D"6/0/0" xhci_mouse=3D"yes" uuid=3D"XXX" network0_mac=3D"XXX" Debian 12 log: Jan 12 22:33:49: initialising Jan 12 22:33:49: [loader: uefi] Jan 12 22:33:49: [cpu: 4] Jan 12 22:33:49: [memory: 20G] Jan 12 22:33:49: [hostbridge: standard] Jan 12 22:33:49: [com ports: com1] Jan 12 22:33:49: [uuid: XXX] Jan 12 22:33:49: [debug mode: yes] Jan 12 22:33:49: [primary disk: disk0.img] Jan 12 22:33:49: [primary disk dev: file] Jan 12 22:33:49: initialising network device tap0 Jan 12 22:33:49: adding tap0 -> vm-public (public addm) Jan 12 22:33:49: bring up tap0 -> vm-public (public addm) Jan 12 22:33:49: dynamically allocated port 5900 for vnc connections Jan 12 22:33:49: booting Jan 12 22:33:49: [bhyve options: -c 4 -m 20G -Hwl bootrom,/usr/local/share/uefi-firmware/BHYVE_UEFI.fd,/ztuff/vm/bhyve/debian= 12/uefi-vars.fd -U 273d0407-b18d-11ee-ba62-60a44c60c172 -u -S] Jan 12 22:33:49: [bhyve devices: -s 0,hostbridge -s 31,lpc -s 4:0,nvme,/ztuff/vm/bhyve/debian12/disk0.img -s 5:0,virtio-net,tap0,mac=3D58:9c:fc:06:d3:8f -s 6:0,passthru,6/0/0 -s 7:0,fbuf,tcp=3D127.0.0.1:5900,w=3D1920,h=3D1080,vga=3Dno -s 8:0,xhci,tablet= -s 9:0,hda,play=3D/dev/dsp] Jan 12 22:33:49: [bhyve console: -l com1,/dev/nmdm-debian12.1A] Jan 12 22:33:49: [bhyve iso device: -s 3:0,ahci-cd,/ztuff/vm/bhyve/.iso/debian-12.4.0-amd64-netinst.iso,ro] Jan 12 22:33:49: starting bhyve (run 1) Jan 12 22:33:56: bhyve exited with status 4 Jan 12 22:33:56: destroying network device tap0 Jan 12 22:33:56: stopped Debian11 log: Jan 12 21:46:01: booting Jan 12 21:46:01: [bhyve options: -c 4 -m 20G -Hwl bootrom,/usr/local/share/uefi-firmware/BHYVE_UEFI.fd,/ztuff/vm/bhyve/debian= 11/uefi-vars.fd -U XXX -u -S] Jan 12 21:46:01: [bhyve devices: -s 0,hostbridge -s 31,lpc -s 4:0,nvme,/ztuff/vm/bhyve/debian11/disk0.img -s 5:0,virtio-net,tap0,mac=3DXXX -s 6:0,passthru,6/0/0 -s 7:0,fbuf,tcp=3D127.0.0.1:5900,w=3D1920,h=3D1080] Jan 12 21:46:01: [bhyve console: -l com1,/dev/nmdm-debian11.1A] Jan 12 21:46:01: starting bhyve (run 1) Jan 12 21:46:10: bhyve exited with status 134 Jan 12 21:46:10: destroying network device tap0 Jan 12 21:46:10: stopped What I found regarding exit status 134 was forum post that hardware is too old lol.. but it was working week ago and I am older :-) `man bhyve` states that error code 4 means "exited due to an error" and that tells a lot :-) Enabling debug does not help here the log is the same. My last reply went to the questions list only, so as this one goes also to the virtualisation I would like to humbly express an idea of moving vh-bhyve under FreeeBSD wings and make it a default frontend for bhyve as it is amazingly simple and does the job :-) Thanks Michael :-) Tomek -- CeDeROM, SQ7MHZ, http://www.tomek.cedro.info