From nobody Fri Apr 19 05:59:09 2024 X-Original-To: xen@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4VLP9N5TtHz5Hv0y for ; Fri, 19 Apr 2024 05:59:20 +0000 (UTC) (envelope-from buhrow@nfbcal.org) Received: from nfbcal.org (ns3.NFBCAL.ORG [157.22.230.125]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "nfbcal.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4VLP9M19XGz4N0L for ; Fri, 19 Apr 2024 05:59:18 +0000 (UTC) (envelope-from buhrow@nfbcal.org) Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of buhrow@nfbcal.org designates 157.22.230.125 as permitted sender) smtp.mailfrom=buhrow@nfbcal.org Received: from nfbcal.org (localhost [127.0.0.1]) by nfbcal.org (8.15.2/8.14.1-NFBNETBSD) with ESMTPS id 43J5xAew012604 (version=TLSv1.2 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=NO); Thu, 18 Apr 2024 22:59:10 -0700 (PDT) X-Virus-Status: Clean X-Virus-Scanned: clamav-milter 0.102.2 at lothlorien.nfbcal.org Received: (from buhrow@localhost) by nfbcal.org (8.15.2/8.12.11) id 43J5x9eZ015862; Thu, 18 Apr 2024 22:59:09 -0700 (PDT) Message-Id: <202404190559.43J5x9eZ015862@nfbcal.org> From: Brian Buhrow Date: Thu, 18 Apr 2024 22:59:09 -0700 X-Mailer: Mail User's Shell (7.2.6 beta(4.pl1)+dynamic 20000103) To: xen@freebsd.org Subject: Freebsd-13.1 as domu cannot use multiple virtual disks Cc: buhrow@nfbcal.org X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.4.3 (nfbcal.org [127.0.0.1]); Thu, 18 Apr 2024 22:59:10 -0700 (PDT) X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.24 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.94)[-0.942]; R_SPF_ALLOW(-0.20)[+a:ns3.nfbcal.org]; MIME_GOOD(-0.10)[text/plain]; MID_RHS_MATCH_FROM(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; FROM_HAS_DN(0.00)[]; ASN(0.00)[asn:7091, ipnet:157.22.0.0/16, country:US]; ARC_NA(0.00)[]; R_DKIM_NA(0.00)[]; MLMMJ_DEST(0.00)[xen@freebsd.org]; RCVD_TLS_LAST(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; DMARC_NA(0.00)[nfbcal.org]; RCVD_COUNT_TWO(0.00)[2]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_NONE(0.00)[]; MIME_TRACE(0.00)[0:+] X-Rspamd-Queue-Id: 4VLP9M19XGz4N0L List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-xen List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-xen@freebsd.org Sender: owner-freebsd-xen@FreeBSD.org Hello. I'm running FreeBSD-13.1 as a domu on xen-4.16.0 and I find I cannot use multiple virtual disks on the same virtual guest. The problem appears to be related to the way the geom layer sorts the disks. Somehow it thinks the first and second disks are related. Here is the configuration of the disks for the virtual machine: disk = [ 'file:/var/xen/nfbcal/fbsd_dev/disk0,0x1,rw', 'file:/var/xen/nfbcal/fbsd_dev/disk1,0x2,rw' ] Here's what the virtual guest reports when it boots: xbd0: 51200MB at device/vbd/1 on xenbusb_front0 xbd0: features: flush, write_barrier xbd0: synchronize cache commands enabled. xbd1: 100000MB at device/vbd/2 on xenbusb_front0 xbd1: features: flush, write_barrier xbd1: synchronize cache commands enabled. Trying to mount root from ufs:/dev/gpt/root []... sysctl_warn_reuse: can't re-use a leaf (kern.geom.disk.xbd0.led)! sysctl_warn_reuse: can't re-use a leaf (kern.geom.disk.xbd0.flags)! g_dev_taste: make_dev_p() failed (gp->name=xbd0, error=17) Any ideas what I'm doing wrong? this must work, right? -thanks -Brian