From nobody Fri Apr 19 05:59:09 2024 X-Original-To: xen@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4VLP9N5TtHz5Hv0y for ; Fri, 19 Apr 2024 05:59:20 +0000 (UTC) (envelope-from buhrow@nfbcal.org) Received: from nfbcal.org (ns3.NFBCAL.ORG [157.22.230.125]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "nfbcal.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4VLP9M19XGz4N0L for ; Fri, 19 Apr 2024 05:59:18 +0000 (UTC) (envelope-from buhrow@nfbcal.org) Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of buhrow@nfbcal.org designates 157.22.230.125 as permitted sender) smtp.mailfrom=buhrow@nfbcal.org Received: from nfbcal.org (localhost [127.0.0.1]) by nfbcal.org (8.15.2/8.14.1-NFBNETBSD) with ESMTPS id 43J5xAew012604 (version=TLSv1.2 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=NO); Thu, 18 Apr 2024 22:59:10 -0700 (PDT) X-Virus-Status: Clean X-Virus-Scanned: clamav-milter 0.102.2 at lothlorien.nfbcal.org Received: (from buhrow@localhost) by nfbcal.org (8.15.2/8.12.11) id 43J5x9eZ015862; Thu, 18 Apr 2024 22:59:09 -0700 (PDT) Message-Id: <202404190559.43J5x9eZ015862@nfbcal.org> From: Brian Buhrow Date: Thu, 18 Apr 2024 22:59:09 -0700 X-Mailer: Mail User's Shell (7.2.6 beta(4.pl1)+dynamic 20000103) To: xen@freebsd.org Subject: Freebsd-13.1 as domu cannot use multiple virtual disks Cc: buhrow@nfbcal.org X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.4.3 (nfbcal.org [127.0.0.1]); Thu, 18 Apr 2024 22:59:10 -0700 (PDT) X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.24 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.94)[-0.942]; R_SPF_ALLOW(-0.20)[+a:ns3.nfbcal.org]; MIME_GOOD(-0.10)[text/plain]; MID_RHS_MATCH_FROM(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; FROM_HAS_DN(0.00)[]; ASN(0.00)[asn:7091, ipnet:157.22.0.0/16, country:US]; ARC_NA(0.00)[]; R_DKIM_NA(0.00)[]; MLMMJ_DEST(0.00)[xen@freebsd.org]; RCVD_TLS_LAST(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; DMARC_NA(0.00)[nfbcal.org]; RCVD_COUNT_TWO(0.00)[2]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_NONE(0.00)[]; MIME_TRACE(0.00)[0:+] X-Rspamd-Queue-Id: 4VLP9M19XGz4N0L List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-xen List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-xen@freebsd.org Sender: owner-freebsd-xen@FreeBSD.org Hello. I'm running FreeBSD-13.1 as a domu on xen-4.16.0 and I find I cannot use multiple virtual disks on the same virtual guest. The problem appears to be related to the way the geom layer sorts the disks. Somehow it thinks the first and second disks are related. Here is the configuration of the disks for the virtual machine: disk = [ 'file:/var/xen/nfbcal/fbsd_dev/disk0,0x1,rw', 'file:/var/xen/nfbcal/fbsd_dev/disk1,0x2,rw' ] Here's what the virtual guest reports when it boots: xbd0: 51200MB at device/vbd/1 on xenbusb_front0 xbd0: features: flush, write_barrier xbd0: synchronize cache commands enabled. xbd1: 100000MB at device/vbd/2 on xenbusb_front0 xbd1: features: flush, write_barrier xbd1: synchronize cache commands enabled. Trying to mount root from ufs:/dev/gpt/root []... sysctl_warn_reuse: can't re-use a leaf (kern.geom.disk.xbd0.led)! sysctl_warn_reuse: can't re-use a leaf (kern.geom.disk.xbd0.flags)! g_dev_taste: make_dev_p() failed (gp->name=xbd0, error=17) Any ideas what I'm doing wrong? this must work, right? -thanks -Brian From nobody Fri Apr 19 12:44:06 2024 X-Original-To: xen@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4VLZ8X1Vchz5H0WH for ; Fri, 19 Apr 2024 12:44:12 +0000 (UTC) (envelope-from roger.pau@cloud.com) Received: from mail-wm1-x336.google.com (mail-wm1-x336.google.com [IPv6:2a00:1450:4864:20::336]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4VLZ8W6fGRz447y for ; Fri, 19 Apr 2024 12:44:11 +0000 (UTC) (envelope-from roger.pau@cloud.com) Authentication-Results: mx1.freebsd.org; none Received: by mail-wm1-x336.google.com with SMTP id 5b1f17b1804b1-418c979ddd2so14124295e9.3 for ; Fri, 19 Apr 2024 05:44:11 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=citrix.com; s=google; t=1713530649; x=1714135449; darn=freebsd.org; h=in-reply-to:content-disposition:mime-version:references:message-id :subject:cc:to:from:date:from:to:cc:subject:date:message-id:reply-to; bh=Kt649tNTjw19InQd4+U98VX2Lv95WSulJkzWCM7Fe8s=; b=qCIOlDdV6EHo5+wNCCIIerpSAyM1l8wdWrrY7eYZhDHNWEvy8ojYF1uomB3T8yw3Kr X0o4L7IgYr1NB3U9SAfed1VZ7FMPXIDcLSS1xmdaplEtI+q72PnTgRjPvbYaRBDjdzCu lr1j+ygzRuglJPVwcBToB3EzulX9V7PrijzZY= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1713530649; x=1714135449; h=in-reply-to:content-disposition:mime-version:references:message-id :subject:cc:to:from:date:x-gm-message-state:from:to:cc:subject:date :message-id:reply-to; bh=Kt649tNTjw19InQd4+U98VX2Lv95WSulJkzWCM7Fe8s=; b=H029uj9uZy97G0awZq98AnsKLE2DmxlnzERYRAs24tL7kSDsn20ek6sBKhEdfaezeq rUqdXZ1XIGIbiFt18oUFpU3CLTvohXicZ5V/vtUNbBRulR1mW4VA2IFNypPVgiXcKuJ9 Ut2BCQ5FxRauniODpHWiWz9u/I0gxitWw0JuEasZAAX541nonjfK2VR7pEYsT8BZlpFW Mn0741Bo4HgmQB95nGqYCPANUfBNeATiVE5lJ/EC+U8YluEcGGImdNJw3IFeMSKfEblZ GBpdeaBg4Z9UvcdjUhQO3/dcltUgv9Hus/8jT1TXuz9TxTn6uB41NlzFCtI8hz56ALRk A6NA== X-Gm-Message-State: AOJu0YwkgxFNXTnhq/zF+BVpdhbGZTJrM34U+kcta2mkelZvjqF3qnHM 6Z0oykn4hp86ik2rNnkf0yoC2wT6bSD9AZYNi0ttD88dPMsY+rzMSjV7oX1Et9wzjNa4EY4duy1 h X-Google-Smtp-Source: AGHT+IHEChhHeQdziYBj3/jsTGIemBuOesZ+dRpx0on1MAtJ95MZ+tkxty0owATN60MWO/DfGfpNrg== X-Received: by 2002:a05:600c:5254:b0:418:f827:160e with SMTP id fc20-20020a05600c525400b00418f827160emr1755010wmb.9.1713530648933; Fri, 19 Apr 2024 05:44:08 -0700 (PDT) Received: from localhost ([85.31.135.62]) by smtp.gmail.com with ESMTPSA id s9-20020a05600c45c900b004180c6a26bdsm5873142wmo.1.2024.04.19.05.44.07 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Fri, 19 Apr 2024 05:44:08 -0700 (PDT) Date: Fri, 19 Apr 2024 14:44:06 +0200 From: Roger Pau =?utf-8?B?TW9ubsOp?= To: Brian Buhrow Cc: xen@freebsd.org Subject: Re: Freebsd-13.1 as domu cannot use multiple virtual disks Message-ID: References: <202404190559.43J5x9eZ015862@nfbcal.org> List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-xen List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-xen@freebsd.org Sender: owner-freebsd-xen@FreeBSD.org MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Disposition: inline In-Reply-To: <202404190559.43J5x9eZ015862@nfbcal.org> X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US] X-Rspamd-Queue-Id: 4VLZ8W6fGRz447y On Thu, Apr 18, 2024 at 10:59:09PM -0700, Brian Buhrow wrote: > Hello. I'm running FreeBSD-13.1 as a domu on xen-4.16.0 and I find I cannot use multiple > virtual disks on the same virtual guest. > > > The problem appears to be related to the way the geom layer sorts the disks. Somehow it thinks > the first and second disks are related. > > Here is the configuration of the disks for the virtual machine: > > > disk = [ > 'file:/var/xen/nfbcal/fbsd_dev/disk0,0x1,rw', > 'file:/var/xen/nfbcal/fbsd_dev/disk1,0x2,rw' > ] The vdev syntax that you are using is not a valid one, see: https://xenbits.xen.org/docs/unstable/man/xen-vbd-interface.7.html That wants to be: disk = [ 'file:/var/xen/nfbcal/fbsd_dev/disk0,xvda,rw', 'file:/var/xen/nfbcal/fbsd_dev/disk1,xvdb,rw' ] Or hd{a,b}. I've tried using 0x1 and 0x2 as your example, and it results in some errors in geom. > Here's what the virtual guest reports when it boots: > > > xbd0: 51200MB at device/vbd/1 on xenbusb_front0 > xbd0: features: flush, write_barrier > xbd0: synchronize cache commands enabled. > xbd1: 100000MB at device/vbd/2 on xenbusb_front0 > xbd1: features: flush, write_barrier > xbd1: synchronize cache commands enabled. > Trying to mount root from ufs:/dev/gpt/root []... > sysctl_warn_reuse: can't re-use a leaf (kern.geom.disk.xbd0.led)! > sysctl_warn_reuse: can't re-use a leaf (kern.geom.disk.xbd0.flags)! > g_dev_taste: make_dev_p() failed (gp->name=xbd0, error=17) > > > Any ideas what I'm doing wrong? this must work, right? It does work for me when using xvd{a,b}: [...] xbd0: 6176MB at device/vbd/51712 on xenbusb_front0 xbd0: features: flush, write_barrier xbd0: synchronize cache commands enabled. xbd1: 6176MB at device/vbd/51728 on xenbusb_front0 xbd1: features: flush, write_barrier xbd1: synchronize cache commands enabled. Trying to mount root from ufs:/dev/xbd0p4 []... WARNING: WITNESS option enabled, expect reduced performance. random: unblocking device. Setting hostuuid: 116f6f55-b478-11ee-a8a1-48210b35a577. Setting hostid: 0xa6037d1b. Starting file system checks: /dev/xbd0p4: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/xbd0p4: clean, 331160 free (2664 frags, 41062 blocks, 0.2% fragmentation) /dev/gpt/efiesp: FILESYSTEM CLEAN; SKIPPING CHECKS Mounting local filesystems:. [...] Regards, Roger. From nobody Fri Apr 19 13:34:12 2024 X-Original-To: xen@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4VLbGN2rCNz5H4GK for ; Fri, 19 Apr 2024 13:34:20 +0000 (UTC) (envelope-from buhrow@nfbcal.org) Received: from nfbcal.org (ns3.NFBCAL.ORG [157.22.230.125]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "nfbcal.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4VLbGM4w95z48vT for ; Fri, 19 Apr 2024 13:34:19 +0000 (UTC) (envelope-from buhrow@nfbcal.org) Authentication-Results: mx1.freebsd.org; none Received: from nfbcal.org (localhost [127.0.0.1]) by nfbcal.org (8.15.2/8.14.1-NFBNETBSD) with ESMTPS id 43JDYCJD008234 (version=TLSv1.2 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=NO); Fri, 19 Apr 2024 06:34:13 -0700 (PDT) X-Virus-Status: Clean X-Virus-Scanned: clamav-milter 0.102.2 at lothlorien.nfbcal.org Received: (from buhrow@localhost) by nfbcal.org (8.15.2/8.12.11) id 43JDYCRV008172; Fri, 19 Apr 2024 06:34:12 -0700 (PDT) Message-Id: <202404191334.43JDYCRV008172@nfbcal.org> From: Brian Buhrow Date: Fri, 19 Apr 2024 06:34:12 -0700 In-Reply-To: X-Mailer: Mail User's Shell (7.2.6 beta(4.pl1)+dynamic 20000103) To: Roger Pau =?utf-8?B?TW9ubsOp?= Subject: Re: Freebsd-13.1 as domu cannot use multiple virtual disks Cc: xen@freebsd.org, buhrow@nfbcal.org X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.4.3 (nfbcal.org [127.0.0.1]); Fri, 19 Apr 2024 06:34:13 -0700 (PDT) X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:7091, ipnet:157.22.0.0/16, country:US] X-Rspamd-Queue-Id: 4VLbGM4w95z48vT List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-xen List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-xen@freebsd.org Sender: owner-freebsd-xen@FreeBSD.org hello Roger. Thanks for the quick reply. Okay. I'll try the alternate lines. Interestingly enough, I tried hda and hdb and they didn't work either. Also, for NetBSD domu's the 0x1,0x2 syntax works beautifuly, so I was surprised it didn't work with the FreeBSD domu's. -thanks -Brian From nobody Fri Apr 19 13:47:51 2024 X-Original-To: xen@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4VLbZ513Dfz5H5S5 for ; Fri, 19 Apr 2024 13:47:57 +0000 (UTC) (envelope-from roger.pau@cloud.com) Received: from mail-wr1-x432.google.com (mail-wr1-x432.google.com [IPv6:2a00:1450:4864:20::432]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4VLbZ44RRPz4DCD for ; Fri, 19 Apr 2024 13:47:56 +0000 (UTC) (envelope-from roger.pau@cloud.com) Authentication-Results: mx1.freebsd.org; none Received: by mail-wr1-x432.google.com with SMTP id ffacd0b85a97d-344047ac7e4so1949399f8f.0 for ; Fri, 19 Apr 2024 06:47:56 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=citrix.com; s=google; t=1713534473; x=1714139273; darn=freebsd.org; h=in-reply-to:content-disposition:mime-version:references:message-id :subject:cc:to:from:date:from:to:cc:subject:date:message-id:reply-to; bh=IPAFG1dkw+ZSVQ2SwcEE7cv0rwxQoYqvkxtwo0Wq3Rs=; b=LUOwMxFIRDyZZW7BHrPJv8vscMgVI039pl95INwiJeVzeQ/H5yKU3ZT9usPr03Kbn3 ATn6T53jkaFrW6DQPYts8xYLJltrzkawpEbj6NiZcW6x98Hjav6fkZqYGXf6dvVnDdnC 3X+GdAreUsc8iplcGH84Ti+qAYWRCNVMzaESY= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1713534473; x=1714139273; h=in-reply-to:content-disposition:mime-version:references:message-id :subject:cc:to:from:date:x-gm-message-state:from:to:cc:subject:date :message-id:reply-to; bh=IPAFG1dkw+ZSVQ2SwcEE7cv0rwxQoYqvkxtwo0Wq3Rs=; b=R+yKTKE62xObVSOcHbNjxXE5fsydKGlA7go2xCLNisRXxx1JcJNVNQDUqu/FGKDUhB Kg8HzwwAWOiHUSLhklLH/S2B+0hTs6mVKblXqq5uV5YKVZAl39Q+WRjt/KEq+dYwyvP5 EGXacHgV1PGjsK4H8LdhUMYmotL8MlUdYBJ03fK3AXy7MV214BhAOiWQ+tteVOna80L0 cYzadaXeQ2YBZRoJyXev3AtpHruqYmb7EPhRiWNxSs0Z/0GJ/AN1i7N89jktJ8emauv7 Ukj6aTjLjPOvGnSbGFjpn6SPK+GeVNS4IElQFEmB3/jLG3JZLKDe9ojPfsawSzMQstiR 9LqQ== X-Gm-Message-State: AOJu0YyaNSD9+iY3pwJS0EHcmvPWxQ+EoRnyv02j0+HaFo18LAKnNjTw 1sUqz1kCvmTefZWS13dDAGQXxyvza1+UobTh7ZS692kyrydKSo9ixyC98f/3ZDK75SeoEKOT3bU U X-Google-Smtp-Source: AGHT+IHCO7cJvjVQZ1qzLXuq5QSFiETz9iZ1tqbRjUViMJjj0LKzc+18Hf8LffdQ/PDrEuq4DL9lag== X-Received: by 2002:a05:6000:1868:b0:349:af80:9b67 with SMTP id d8-20020a056000186800b00349af809b67mr4736982wri.30.1713534472906; Fri, 19 Apr 2024 06:47:52 -0700 (PDT) Received: from localhost ([85.31.135.62]) by smtp.gmail.com with ESMTPSA id je12-20020a05600c1f8c00b004183edc31adsm10254356wmb.44.2024.04.19.06.47.52 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Fri, 19 Apr 2024 06:47:52 -0700 (PDT) Date: Fri, 19 Apr 2024 15:47:51 +0200 From: Roger Pau =?utf-8?B?TW9ubsOp?= To: Brian Buhrow Cc: xen@freebsd.org Subject: Re: Freebsd-13.1 as domu cannot use multiple virtual disks Message-ID: References: <202404191334.43JDYCRV008172@nfbcal.org> List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-xen List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-xen@freebsd.org Sender: owner-freebsd-xen@FreeBSD.org MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Disposition: inline In-Reply-To: <202404191334.43JDYCRV008172@nfbcal.org> X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US] X-Rspamd-Queue-Id: 4VLbZ44RRPz4DCD On Fri, Apr 19, 2024 at 06:34:12AM -0700, Brian Buhrow wrote: > hello Roger. Thanks for the quick reply. Okay. I'll try the alternate lines. > Interestingly enough, I tried hda and hdb and they didn't work either. Weird, both the hd and the xvd notation seems to work for me. For the record my configuration is: disk = [ '/root/FreeBSD-15.0-CURRENT-amd64.raw,raw,xvda,rw', '/root/FreeBSD-14.0-RELEASE-amd64.raw,raw,xvdb,rw' ] > Also, for NetBSD domu's > the 0x1,0x2 syntax works beautifuly, so I was surprised it didn't work with the FreeBSD domu's. No idea, maybe NetBSD carries some patches in ports to support that syntax. AFAICT from the vbd format document that I linked on my previous reply it's not a valid notation. Regards, Roger. From nobody Fri Apr 19 14:13:26 2024 X-Original-To: xen@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4VLc7b6gcJz5H7jD for ; Fri, 19 Apr 2024 14:13:31 +0000 (UTC) (envelope-from buhrow@nfbcal.org) Received: from nfbcal.org (ns3.NFBCAL.ORG [157.22.230.125]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "nfbcal.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4VLc7b2G7Cz4J93 for ; Fri, 19 Apr 2024 14:13:31 +0000 (UTC) (envelope-from buhrow@nfbcal.org) Authentication-Results: mx1.freebsd.org; none Received: from nfbcal.org (localhost [127.0.0.1]) by nfbcal.org (8.15.2/8.14.1-NFBNETBSD) with ESMTPS id 43JEDROf001613 (version=TLSv1.2 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=NO); Fri, 19 Apr 2024 07:13:27 -0700 (PDT) X-Virus-Status: Clean X-Virus-Scanned: clamav-milter 0.102.2 at lothlorien.nfbcal.org Received: (from buhrow@localhost) by nfbcal.org (8.15.2/8.12.11) id 43JEDRvb001481; Fri, 19 Apr 2024 07:13:27 -0700 (PDT) Message-Id: <202404191413.43JEDRvb001481@nfbcal.org> From: Brian Buhrow Date: Fri, 19 Apr 2024 07:13:26 -0700 In-Reply-To: X-Mailer: Mail User's Shell (7.2.6 beta(4.pl1)+dynamic 20000103) To: Roger Pau =?utf-8?B?TW9ubsOp?= Subject: Re: Freebsd-13.1 as domu cannot use multiple virtual disks Cc: xen@freebsd.org, buhrow@nfbcal.org X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.4.3 (nfbcal.org [127.0.0.1]); Fri, 19 Apr 2024 07:13:27 -0700 (PDT) X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:7091, ipnet:157.22.0.0/16, country:US] X-Rspamd-Queue-Id: 4VLc7b2G7Cz4J93 List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-xen List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-xen@freebsd.org Sender: owner-freebsd-xen@FreeBSD.org hello Roger. Again, thank you for the hints. In addition to the xvda syntax working, one can also use the hex values for the device numbers, separated by 16, allowing one to use absolute numbers, rather than remembering letter to number mappings. The following syntax, for example, also works. Note this results in the same probe messages as xvda and xvdb. disk = [ 'file:/var/xen/nfbcal/fbsd_dev/disk0,0xca00,rw', 'file:/var/xen/nfbcal/fbsd_dev/disk1,0xca10,rw' ] Probes with: xbd0: 51200MB at device/vbd/51712 on xenbusb_front0 xbd0: features: flush, write_barrier xbd0: synchronize cache commands enabled. xbd1: 105890MB at device/vbd/51728 on xenbusb_front0 xbd1: features: flush, write_barrier xbd1: synchronize cache commands enabled. From nobody Fri Apr 19 18:16:45 2024 X-Original-To: xen@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4VLjXL0fsNz5HVGJ for ; Fri, 19 Apr 2024 18:16:50 +0000 (UTC) (envelope-from roger.pau@cloud.com) Received: from mail-wr1-x430.google.com (mail-wr1-x430.google.com [IPv6:2a00:1450:4864:20::430]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4VLjXK5yYbz4kt7 for ; Fri, 19 Apr 2024 18:16:49 +0000 (UTC) (envelope-from roger.pau@cloud.com) Authentication-Results: mx1.freebsd.org; none Received: by mail-wr1-x430.google.com with SMTP id ffacd0b85a97d-343e46ec237so1754825f8f.2 for ; Fri, 19 Apr 2024 11:16:49 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=citrix.com; s=google; t=1713550607; x=1714155407; darn=freebsd.org; h=in-reply-to:content-disposition:mime-version:references:message-id :subject:cc:to:from:date:from:to:cc:subject:date:message-id:reply-to; bh=Bdk5IBu9b/+nDgjb2yYKWNa6M8xHZ07D14yoUB8hnAg=; b=QNMD5IuUF9OnV8RY6g5V3xmNrryKhgXziL6QUh9T3Leh41feDClJl+ZSPgMn/BE0Ug cDNh9seirHCGaKTPeBtAWzqfTUW/ZydRP+c+krP+W2dQAMtVTigDtL1a43K03i8SZ0qn gqowV1ZcaI5KDzm1urJRQSSjQHloMofasYXP0= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1713550607; x=1714155407; h=in-reply-to:content-disposition:mime-version:references:message-id :subject:cc:to:from:date:x-gm-message-state:from:to:cc:subject:date :message-id:reply-to; bh=Bdk5IBu9b/+nDgjb2yYKWNa6M8xHZ07D14yoUB8hnAg=; b=kmmKeMIFfvjfqicR/hQhNBR3hTgeMACoX0lvKc0l8pgLp7MAuF8gWwHtm2PCbS/cPc 5pA3G52CVmhL5o9wgu/KBLEO3UzKBu8QgiFWlZRD46d8ecoObWdysaXSeFrGhV1N7Vrb UPFOX2BNl9m+cxNTDvY+QhD5aLNE93+y6vzsjDLDLOvP5HOL4biPQcENaW/Jby3DFcj/ HZNq2qUlsNfu7pCyGbz2P7Hvof2j3DRmJ0KJx+vvZW6OGecguFdsR44xh3b1hFltBg7c NQ3EV+QFJvgNC5kHDVKQ4g7bdT/K0Ceb02AduvZzkOk5HrycMRGK1ZmCnddtC4b2MzIZ Q6Gw== X-Gm-Message-State: AOJu0Yw725AZWQdnIQCrJkAOCiq9kGocLvL4wlDM9Lr67CtJlAP95NUQ iKwDJ4vUMeIkJePNPhGBAJFSXFbDIotzyyTpN4HLLT8DaReH00/oAOsrwFNP//xgwN8VFskjjre G X-Google-Smtp-Source: AGHT+IFQldfED4Jq4pLw9GaQi1HXh0E6VPFJinOy9IEAdOa9y1EB0UgIWSfcpAlHxkRA6VpNnsAYzw== X-Received: by 2002:a5d:64c3:0:b0:34a:751e:24b4 with SMTP id f3-20020a5d64c3000000b0034a751e24b4mr1750055wri.42.1713550607422; Fri, 19 Apr 2024 11:16:47 -0700 (PDT) Received: from localhost ([85.31.135.62]) by smtp.gmail.com with ESMTPSA id bi8-20020a05600c3d8800b00419c8e27f75sm1459147wmb.16.2024.04.19.11.16.46 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Fri, 19 Apr 2024 11:16:46 -0700 (PDT) Date: Fri, 19 Apr 2024 20:16:45 +0200 From: Roger Pau =?utf-8?B?TW9ubsOp?= To: Brian Buhrow Cc: xen@freebsd.org Subject: Re: Freebsd-13.1 as domu cannot use multiple virtual disks Message-ID: References: <202404191413.43JEDRvb001481@nfbcal.org> List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-xen List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-xen@freebsd.org Sender: owner-freebsd-xen@FreeBSD.org MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Disposition: inline In-Reply-To: <202404191413.43JEDRvb001481@nfbcal.org> X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US] X-Rspamd-Queue-Id: 4VLjXK5yYbz4kt7 On Fri, Apr 19, 2024 at 07:13:26AM -0700, Brian Buhrow wrote: > hello Roger. Again, thank you for the hints. > In addition to the xvda syntax working, one can also use the hex values for the device numbers, > separated by 16, allowing one to use absolute numbers, rather than remembering letter to number > mappings. The following syntax, for example, also works. > Note this results in the same probe messages as xvda and xvdb. Oh, I see, there's a reference to this in the documentation, albeit it's very obscure. I haven't looked at the code, but I assume FreeBSD blkfront requires the device type of the disk number to be something sensible (in other words xvd or hd) or else the device is not identified properly. Anyway, glad you got it working. Regards, Roger.