Date: Fri, 25 Mar 2022 16:02:12 +0000 From: Michael Jung <mikej@paymentallianceintl.com> To: John Doherty <bsdlists@jld3.net>, Rich <rincebrain@gmail.com> Cc: freebsd-fs <freebsd-fs@freebsd.org> Subject: RE: create zpool from zvols? Message-ID: <07cf88d380d94a2f8f97af23bb7d8965@MAIL-HUB.pai.local> In-Reply-To: <F066040F-8A12-4071-9A06-05462DE66B39@jld3.net> References: <72AA1AC8-E623-4B73-A3F3-3FDB0ABDFCEA@jld3.net> <CAOeNLurwC5-PygGjLSaCiShvjhvb1bvGiygSKJi2q6UxsGLDRQ@mail.gmail.com> <F066040F-8A12-4071-9A06-05462DE66B39@jld3.net>
next in thread | previous in thread | raw e-mail | index | archive | help
--_000_07cf88d380d94a2f8f97af23bb7d8965MAILHUBpailocal_
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable
Hi!
I have never tried to use ZFS type 'volume' as a zpool but you can share a
zpool between zfs type 'filesystem' and type 'volume'. Here I share two
type 'volume' stores as iscsi targets and one type 'filesystem' as a
zpool. If you interested in my iscsi config /etc/ctl.conf email me off list
to mikej@mikej.com.
ZFS raid-5400-1 is a simple 14 x raidz2 pool in my home lab.
root@draid:/raid-5400-1 # zfs list -t volume
NAME
USED AVAIL REFER MOUNTPOINT
<SNIP>
raid-5400-1/esxi-store1 2.16T 3.51T 443G -
raid-5400-1/unitrends1 1.08T 2.70T 171G -
<SNIP>
root@draid:/raid-5400-1 # zfs list -t filesystem
NAME USED AVAIL REFER MOUNTPOINT
<SNIP>
raid-5400-1 3.24T 1.79T 236K /raid-5400-1
<SNIP>
Since your experimenting - I am too. (for the curios while slightly
off topic) I have been testing ZFS Draid - here is how that pool looks.
root@draid:/raid-5400-1 # zpool list -v tank
NAME SIZE ALLOC FREE CKPOINT EXPANDSZ FRAG CAP D=
EDUP HEALTH ALTROOT
tank 18.5T 8.02T 10.4T - - 0% 43% 1=
.00x ONLINE -
draid2:2d:10c:0s-0 9.03T 4.06T 4.97T - - 0% 44.9% =
- ONLINE
gpt/da0p1 - - - - - - - =
- ONLINE
gpt/d10p1 - - - - - - - =
- ONLINE
da39p1 - - - - - - - =
- ONLINE
da40p1 - - - - - - - =
- ONLINE
da41p1 - - - - - - - =
- ONLINE
da43p1 - - - - - - - =
- ONLINE
da44p1 - - - - - - - =
- ONLINE
da42p1 - - - - - - - =
- ONLINE
da45p1 - - - - - - - =
- ONLINE
gpt/d19p1 - - - - - - - =
- ONLINE
draid2:2d:10c:0s-1 9.03T 3.96T 5.07T - - 0% 43.8% =
- ONLINE
da46p1 - - - - - - - =
- ONLINE
gpt/d11p1 - - - - - - - =
- ONLINE
gpt/d12p1 - - - - - - - =
- ONLINE
gpt/d13p1 - - - - - - - =
- ONLINE
gpt/d14p1 - - - - - - - =
- ONLINE
gpt/d15p1 - - - - - - - =
- ONLINE
gpt/d16p1 - - - - - - - =
- ONLINE
gpt/d17p1 - - - - - - - =
- ONLINE
gpt/d18p1 - - - - - - - =
- ONLINE
da18p1 - - - - - - - =
- ONLINE
special - - - - - - - =
- -
mirror-3 398G 2.86G 395G - - 0% 0.71% =
- ONLINE
gpt/special0 - - - - - - - =
- ONLINE
gpt/special1 - - - - - - - =
- ONLINE
logs - - - - - - - =
- -
mirror-2 15.5G 256K 15.5G - - 0% 0.00% =
- ONLINE
gpt/slog0 - - - - - - - =
- ONLINE
gpt/slog1 - - - - - - - =
- ONLINE
CONFIDENTIALITY NOTE: This message is intended only for the use
of the individual or entity to whom it is addressed and may
contain information that is privileged, confidential, and
exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby
notified that any dissemination, distribution or copying
of this communication is strictly prohibited. If you have
received this transmission in error, please notify us by
telephone at (502) 212-4000 or notify us at: PAI, Dept. 99,
2101 High Wickham Place, Suite 101, Louisville, KY 40245
From: owner-freebsd-fs@freebsd.org [mailto:owner-freebsd-fs@freebsd.org] On=
Behalf Of John Doherty
Sent: Friday, March 25, 2022 9:50 AM
To: Rich <rincebrain@gmail.com>
Cc: freebsd-fs <freebsd-fs@freebsd.org>
Subject: Re: create zpool from zvols?
Thanks for the super-quick response. I guess I'll just use plain files
then. I don't really want to use the zpools for anything, I just want an
easy way to experiment with and demonstrate zpool create commands.
FWIW, the tunable does allow the "zpool create" command to work:
[root@ibex] # sysctl vfs.zfs.vol.recursive
vfs.zfs.vol.recursive: 1
[root@ibex] # zpool create ztest mirror /dev/zvol/zroot/zv{0,1}
[root@ibex] # zpool status ztest
pool: ztest
state: ONLINE
config:
NAME STATE READ WRITE CKSUM
ztest ONLINE 0 0 0
mirror-0 ONLINE 0 0 0
zvol/zroot/zv0 ONLINE 0 0 0
zvol/zroot/zv1 ONLINE 0 0 0
errors: No known data errors
On Fri 2022-03-25 07:41 AM MDT -0600, <rincebrain@gmail.com<mailto:rincebra=
in@gmail.com>> wrote:
> https://reviews.freebsd.org/D4998<https://reviews.freebsd.org/D4998>; adde=
d a knob to allow you to do this
> even
> though it sometimes deadlocks, which is why it's off by default.
>
> It's a FreeBSD-only tunable.
>
> That tunable is still there in the post-OpenZFS FreeBSD, too, though
> it's
> labeled "Allow zpools to use zvols as vdevs (DANGEROUS)", so it seems
> likely that it still can cause undesirable outcomes.
>
> - Rich
>
>
>
> On Fri, Mar 25, 2022 at 9:34 AM John Doherty <bsdlists@jld3.net<mailto:bs=
dlists@jld3.net>>
> wrote:
>
>> Hello, I am using ZFS on FreeBSD 13.0-RELEASE-p8. For experimentation
>> and demonstration, I would like to create zpools using zvols as the
>> underlying block devices.
>>
>> For example, I have these:
>>
>> [root@ibex] # zfs list -r -t volume zroot | grep zv
>> zroot/zv0 8.25G 832G 56K -
>> zroot/zv1 8.25G 832G 56K -
>>
>> This seems as if it would do what I want:
>>
>> [root@ibex] # zpool create -n ztest mirror /dev/zvol/zroot/zv{0,1}
>> would create 'ztest' with the following layout:
>>
>> ztest
>> mirror
>> zvol/zroot/zv0
>> zvol/zroot/zv1
>>
>> But when I try to actually do it, it doesn't work:
>>
>> [root@ibex] # zpool create ztest mirror /dev/zvol/zroot/zv{0,1}
>> cannot create 'ztest': no such pool or dataset
>>
>> FWIW, doing something similar on OmniOS works fine:
>>
>> [root@orca] # uname -srvp
>> SunOS 5.11 omnios-r151040-852962cae3 i386
>> [root@orca] # zfs create -V 2G rpool/zv0
>> [root@orca] # zfs create -V 2G rpool/zv1
>> [root@orca] # zpool create ztest mirror /dev/zvol/dsk/rpool/zv{0,1}
>> [root@orca] # zpool status ztest
>> pool: ztest
>> state: ONLINE
>> scan: none requested
>> config:
>>
>> NAME STATE READ WRITE CKSUM
>> ztest ONLINE 0 0 0
>> mirror-0 ONLINE 0 0 0
>> /dev/zvol/dsk/rpool/zv0 ONLINE 0 0 0
>> /dev/zvol/dsk/rpool/zv1 ONLINE 0 0 0
>>
>> errors: No known data errors
>>
>> I thought I had done this in the past. Am I doing something wrong? Am
>> I
>> misremembering and this never worked?
>>
>> Using files created with truncate(1) rather zvols seems to work fine
>> so
>> maybe that's what I did before. Not sure, it's been a long time since
>> I
>> wanted to do something like this.
>>
>> Thanks for any enlightenment.
Disclaimer
The information contained in this communication from the sender is confiden=
tial. It is intended solely for use by the recipient and others authorized =
to receive it. If you are not the recipient, you are hereby notified that a=
ny disclosure, copying, distribution or taking action in relation of the co=
ntents of this information is strictly prohibited and may be unlawful.
This email has been scanned for viruses and malware, and may have been auto=
matically archived by Mimecast, a leader in email security and cyber resili=
ence. Mimecast integrates email defenses with brand protection, security aw=
areness training, web security, compliance and other essential capabilities=
. Mimecast helps protect large and small organizations from malicious activ=
ity, human error and technology failure; and to lead the movement toward bu=
ilding a more resilient world. To find out more, visit our website.
--_000_07cf88d380d94a2f8f97af23bb7d8965MAILHUBpailocal_
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: quoted-printable
<html><head>
<meta http-equiv=3D"Content-Type" content=3D"text/html; charset=3Dus-ascii"=
>
<meta name=3D"Generator" content=3D"Microsoft Word 15 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
=09{font-family:"Cambria Math";
=09panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
=09{font-family:Calibri;
=09panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
=09{margin:0in;
=09margin-bottom:.0001pt;
=09font-size:12.0pt;
=09font-family:"Times New Roman",serif;}
a:link, span.MsoHyperlink
=09{mso-style-priority:99;
=09color:blue;
=09text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
=09{mso-style-priority:99;
=09color:purple;
=09text-decoration:underline;}
span.EmailStyle17
=09{mso-style-type:personal;
=09font-family:"Calibri",sans-serif;
=09color:#1F497D;}
span.EmailStyle18
=09{mso-style-type:personal-compose;
=09font-family:"Calibri",sans-serif;
=09color:windowtext;}
.MsoChpDefault
=09{mso-style-type:export-only;
=09font-size:10.0pt;}
@page WordSection1
=09{size:8.5in 11.0in;
=09margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
=09{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext=3D"edit" spidmax=3D"1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext=3D"edit">
<o:idmap v:ext=3D"edit" data=3D"1" />
</o:shapelayout></xml><![endif]-->
<style type=3D"text/css">.style1 {font-family: "Times New Roman";}</style><=
/head><body lang=3D"EN-US" link=3D"blue" vlink=3D"purple">
<div class=3D"WordSection1">
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New";color:#1F497D">Hi!<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New";color:#1F497D"><o:p> </o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New";color:#1F497D">I have never tried to use ZFS type ‘vol=
ume’ as a zpool but you can share a
<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New";color:#1F497D">zpool between zfs type ‘filesystem̵=
7; and type ‘volume’. Here I share two
<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New";color:#1F497D">type ‘volume’ stores as iscsi tar=
gets and one type ‘filesystem’ as a
<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New";color:#1F497D">zpool. If you interested in my iscsi config /=
etc/ctl.conf email me off list<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New";color:#1F497D">to mikej@mikej.com.<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New";color:#1F497D"><o:p> </o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New";color:#1F497D">ZFS raid-5400-1 is a simple 14 x raidz2 pool =
in my home lab.<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New";color:#1F497D"><o:p> </o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New";color:#1F497D">root@draid:/raid-5400-1 # zfs list -t volume<=
o:p></o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New";color:#1F497D">NAME
<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New";color:#1F497D"> &nb=
sp; =
USED AVAIL REFER MOUNTPOINT<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New";color:#1F497D"><SNIP><o:p></o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New";color:#1F497D">raid-5400-1/esxi-store1 2.16T 3.5=
1T 443G -<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New";color:#1F497D">raid-5400-1/unitrends1 1.08T =
; 2.70T 171G -<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New";color:#1F497D"><SNIP><o:p></o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New";color:#1F497D"><o:p> </o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New";color:#1F497D">root@draid:/raid-5400-1 # zfs list -t filesys=
tem<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New";color:#1F497D">NAME  =
; &n=
bsp; USED AVAIL=
REFER MOUNTPOINT<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New";color:#1F497D"><SNIP><o:p></o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New";color:#1F497D">raid-5400-1 &nbs=
p; &=
nbsp; 3.24T 1.79T 236K /raid-5400-1<o:p=
></o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New";color:#1F497D"><SNIP><o:p></o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New";color:#1F497D"><o:p> </o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New";color:#1F497D">Since your experimenting – I am too. (f=
or the curios while slightly<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New";color:#1F497D">off topic) I have been testing ZFS Draid R=
11; here is how that pool looks.<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New";color:#1F497D"><o:p> </o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New";color:#1F497D">root@draid:/raid-5400-1 # zpool list -v tank<=
o:p></o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New";color:#1F497D">NAME  =
; SIZE ALLOC&nb=
sp; FREE CKPOINT EXPANDSZ FRAG &nb=
sp; CAP DEDUP HEALTH ALTROOT<o:p></o:p></span=
></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New";color:#1F497D">tank  =
; 18.5T 8.02T 1=
0.4T - &nb=
sp; - 0% 43%&nb=
sp; 1.00x ONLINE -<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New";color:#1F497D"> draid2:2d:10c:0s-0 9.03T 4=
.06T 4.97T - &nb=
sp; - 0% 44.9%&=
nbsp; - ONLINE<o:p></o:p></span><=
/p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New";color:#1F497D"> gpt/da0p1  =
; - =
- -  =
; - - &nbs=
p; - - -&=
nbsp; ONLINE<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New";color:#1F497D"> gpt/d10p1  =
; - =
- -  =
; - - &nbs=
p; - - -&=
nbsp; ONLINE<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New";color:#1F497D"> da39p1 &n=
bsp; - &nb=
sp; - - &n=
bsp; - - &=
nbsp; - - =
- ONLINE<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New";color:#1F497D"> da40p1 &n=
bsp; - &nb=
sp; - - &n=
bsp; - - &=
nbsp; - - =
- ONLINE<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New";color:#1F497D"> da41p1 &n=
bsp; - &nb=
sp; - - &n=
bsp; - - =
- - =
- ONLINE<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New";color:#1F497D"> da43p1 &n=
bsp; - &nb=
sp; - - &n=
bsp; - - &=
nbsp; - - =
- ONLINE<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New";color:#1F497D"> da44p1 &n=
bsp; - &nb=
sp; - - &n=
bsp; - - &=
nbsp; - - =
- ONLINE<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New";color:#1F497D"> da42p1 &n=
bsp; - &nb=
sp; - - &n=
bsp; - - &=
nbsp; - - =
- ONLINE<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New";color:#1F497D"> da45p1 &n=
bsp; - &nb=
sp; - - &n=
bsp; - - &=
nbsp; - - =
- ONLINE<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New";color:#1F497D"> gpt/d19p1  =
; - =
- -  =
; - - &nbs=
p; - - -&=
nbsp; ONLINE<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New";color:#1F497D"> draid2:2d:10c:0s-1 9.03T 3=
.96T 5.07T - &nb=
sp; - 0% 43.8%&=
nbsp; - ONLINE<o:p></o:p></span><=
/p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New";color:#1F497D"> da46p1 &n=
bsp; - &nb=
sp; - - &n=
bsp; - - &=
nbsp; - - =
- ONLINE<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New";color:#1F497D"> gpt/d11p1  =
; - =
- -  =
; - - &nbs=
p; - - -&=
nbsp; ONLINE<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New";color:#1F497D"> gpt/d12p1 &nbs=
p; - =
- -  =
; - - &nbs=
p; - - -&=
nbsp; ONLINE<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New";color:#1F497D"> gpt/d13p1  =
; - =
- -  =
; - - &nbs=
p; - - -&=
nbsp; ONLINE<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New";color:#1F497D"> gpt/d14p1  =
; - =
- -  =
; - - &nbs=
p; - - -&=
nbsp; ONLINE<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New";color:#1F497D"> gpt/d15p1  =
; - =
- -  =
; - - &nbs=
p; - - -&=
nbsp; ONLINE<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New";color:#1F497D"> gpt/d16p1  =
; - =
- -  =
; - - &nbs=
p; - - -&=
nbsp; ONLINE<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New";color:#1F497D"> gpt/d17p1  =
; - =
- -  =
; - - &nbs=
p; - - -&=
nbsp; ONLINE<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New";color:#1F497D"> gpt/d18p1  =
; - =
- -  =
; - - &nbs=
p; - - -&=
nbsp; ONLINE<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New";color:#1F497D"> da18p1 &n=
bsp; - &nb=
sp; - - &n=
bsp; - - &=
nbsp; - - =
- ONLINE<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New";color:#1F497D">special &n=
bsp; - &nb=
sp; - - &n=
bsp; - - &=
nbsp; - - =
- -<o:p></o:p>=
</span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New";color:#1F497D"> mirror-3 =
398G 2.86G 395G  =
; - =
- 0% 0.71% &nbs=
p; - ONLINE<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New";color:#1F497D"> gpt/special0 &n=
bsp; - - &=
nbsp; - - =
- - =
; - - &nbs=
p; ONLINE<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New";color:#1F497D"> gpt/special1 &n=
bsp; - - &=
nbsp; - -  =
; - - =
; - - &nbs=
p; ONLINE<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New";color:#1F497D">logs  =
; -=
- -  =
; - =
- - -&nb=
sp; - &nbs=
p; -<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New";color:#1F497D"> mirror-2 =
15.5G 256K 15.5G &nbs=
p; -  =
; - 0% 0.00% -&=
nbsp; ONLINE<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New";color:#1F497D"> gpt/slog0  =
; - =
- -  =
; - - &nbs=
p; - - -&=
nbsp; ONLINE<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New";color:#1F497D"> gpt/slog1  =
; - =
- -  =
; - - &nbs=
p; - - -&=
nbsp; ONLINE<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:11.0pt;font-family:"Ca=
libri",sans-serif;color:#1F497D"><o:p> </o:p></span></p>
<div>
<p style=3D"FONT-SIZE: 10pt; FONT-FAMILY: Arial"> </p>
<div style=3D"FONT-SIZE: 10px; BORDER-TOP: #666666 1px solid; FONT-FAMILY: =
Verdana; WIDTH: 410px; BORDER-BOTTOM: #666666 1px solid; PADDING-BOTTOM: 5p=
x; PADDING-TOP: 5px; PADDING-LEFT: 5px; PADDING-RIGHT: 5px">
CONFIDENTIALITY NOTE: This message is intended only for the use<br>
of the individual or entity to whom it is addressed and may <br>
contain information that is privileged, confidential, and <br>
exempt from disclosure under applicable law. If the reader <br>
of this message is not the intended recipient, you are hereby <br>
notified that any dissemination, distribution or copying <br>
of this communication is strictly prohibited. If you have <br>
received this transmission in error, please notify us by <br>
telephone at (502) 212-4000 or notify us at: PAI, Dept. 99, <br>
2101 High Wickham Place, Suite 101, Louisville, KY 40245<br>
<br>
<br>
<br>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
</div>
</div>
<div>
<div style=3D"border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0in =
0in 0in">
<p class=3D"MsoNormal"><b><span style=3D"font-size:11.0pt;font-family:"=
;Calibri",sans-serif">From:</span></b><span style=3D"font-size:11.0pt;=
font-family:"Calibri",sans-serif"> owner-freebsd-fs@freebsd.org [=
mailto:owner-freebsd-fs@freebsd.org]
<b>On Behalf Of </b>John Doherty<br>
<b>Sent:</b> Friday, March 25, 2022 9:50 AM<br>
<b>To:</b> Rich <rincebrain@gmail.com><br>
<b>Cc:</b> freebsd-fs <freebsd-fs@freebsd.org><br>
<b>Subject:</b> Re: create zpool from zvols?<o:p></o:p></span></p>
</div>
</div>
<p class=3D"MsoNormal"><o:p> </o:p></p>
<p class=3D"MsoNormal">Thanks for the super-quick response. I guess I'll ju=
st use plain files
<br>
then. I don't really want to use the zpools for anything, I just want an <b=
r>
easy way to experiment with and demonstrate zpool create commands.<br>
<br>
FWIW, the tunable does allow the "zpool create" command to work:<=
br>
<br>
[root@ibex] # sysctl vfs.zfs.vol.recursive<br>
vfs.zfs.vol.recursive: 1<br>
[root@ibex] # zpool create ztest mirror /dev/zvol/zroot/zv{0,1}<br>
[root@ibex] # zpool status ztest<br>
pool: ztest<br>
state: ONLINE<br>
config:<br>
<br>
NAME STATE READ WRITE CKSUM<br>
ztest ONLINE 0 0 0<br>
mirror-0 ONLINE 0 0 0<br>
zvol/zroot/zv0 ONLINE 0 0 0<br>
zvol/zroot/zv1 ONLINE 0 0 0<br>
<br>
errors: No known data errors<br>
<br>
On Fri 2022-03-25 07:41 AM MDT -0600, <<a href=3D"mailto:rincebrain@gmai=
l.com">rincebrain@gmail.com</a>> wrote:<br>
<br>
> <a href=3D"https://reviews.freebsd.org/D4998">;
https://reviews.freebsd.org/D4998</a>; added a knob to allow you to do this =
<br>
> even<br>
> though it sometimes deadlocks, which is why it's off by default.<br>
><br>
> It's a FreeBSD-only tunable.<br>
><br>
> That tunable is still there in the post-OpenZFS FreeBSD, too, though <=
br>
> it's<br>
> labeled "Allow zpools to use zvols as vdevs (DANGEROUS)", so=
it seems<br>
> likely that it still can cause undesirable outcomes.<br>
><br>
> - Rich<br>
><br>
><br>
><br>
> On Fri, Mar 25, 2022 at 9:34 AM John Doherty <<a href=3D"mailto:bsd=
lists@jld3.net">bsdlists@jld3.net</a>>
<br>
> wrote:<br>
><br>
>> Hello, I am using ZFS on FreeBSD 13.0-RELEASE-p8. For experimentat=
ion<br>
>> and demonstration, I would like to create zpools using zvols as th=
e<br>
>> underlying block devices.<br>
>><br>
>> For example, I have these:<br>
>><br>
>> [root@ibex] # zfs list -r -t volume zroot | grep zv<br>
>> zroot/zv0 8.25G 832G 56K -<br>
>> zroot/zv1 8.25G 832G 56K -<br>
>><br>
>> This seems as if it would do what I want:<br>
>><br>
>> [root@ibex] # zpool create -n ztest mirror /dev/zvol/zroot/zv{0,1}=
<br>
>> would create 'ztest' with the following layout:<br>
>><br>
>> ztest<br>
>> mirror<br>
>> zvol/zroot/zv0<br>
>> zvol/zroot/zv1<br>
>><br>
>> But when I try to actually do it, it doesn't work:<br>
>><br>
>> [root@ibex] # zpool create ztest mirror /dev/zvol/zroot/zv{0,1}<br=
>
>> cannot create 'ztest': no such pool or dataset<br>
>><br>
>> FWIW, doing something similar on OmniOS works fine:<br>
>><br>
>> [root@orca] # uname -srvp<br>
>> SunOS 5.11 omnios-r151040-852962cae3 i386<br>
>> [root@orca] # zfs create -V 2G rpool/zv0<br>
>> [root@orca] # zfs create -V 2G rpool/zv1<br>
>> [root@orca] # zpool create ztest mirror /dev/zvol/dsk/rpool/zv{0,1=
}<br>
>> [root@orca] # zpool status ztest<br>
>> pool: ztest<br>
>> state: ONLINE<br>
>> scan: none requested<br>
>> config:<br>
>><br>
>> NAME STATE READ WRITE CKSUM<br>
>> ztest ONLINE 0 0 0<br>
>> mirror-0 ONLINE 0 0 0<br>
>> /dev/zvol/dsk/rpool/zv0 ONLINE 0 0 0<br>
>> /dev/zvol/dsk/rpool/zv1 ONLINE 0 0 0<br>
>><br>
>> errors: No known data errors<br>
>><br>
>> I thought I had done this in the past. Am I doing something wrong?=
Am <br>
>> I<br>
>> misremembering and this never worked?<br>
>><br>
>> Using files created with truncate(1) rather zvols seems to work fi=
ne <br>
>> so<br>
>> maybe that's what I did before. Not sure, it's been a long time si=
nce <br>
>> I<br>
>> wanted to do something like this.<br>
>><br>
>> Thanks for any enlightenment.<o:p></o:p></p>
</div>
<br><br><p style=3D"font-family: Verdana; font-size:10pt; color:#666666;"><=
b>Disclaimer</b></p><p style=3D"font-family: Verdana; font-size:8pt; color:=
#666666;">The information contained in this communication from the sender i=
s confidential. It is intended solely for use by the recipient and others a=
uthorized to receive it. If you are not the recipient, you are hereby notif=
ied that any disclosure, copying, distribution or taking action in relation=
of the contents of this information is strictly prohibited and may be unla=
wful.<br><br>This email has been scanned for viruses and malware, and may h=
ave been automatically archived by Mimecast, a leader in email security and=
cyber resilience. Mimecast integrates email defenses with brand protection=
, security awareness training, web security, compliance and other essential=
capabilities. Mimecast helps protect large and small organizations from ma=
licious activity, human error and technology failure; and to lead the movem=
ent toward building a more resilient world. To find out more, visit our web=
site.</p></body></html>
--_000_07cf88d380d94a2f8f97af23bb7d8965MAILHUBpailocal_--
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?07cf88d380d94a2f8f97af23bb7d8965>