Date: Thu, 21 Apr 2022 20:27:45 +0000 From: Michael Jung <mikej@paymentallianceintl.com> To: freebsd-fs <freebsd-fs@freebsd.org> Subject: ZFS reservations for type=volume Message-ID: <94c10113c3964b1bbd3f4ddf934c23cd@MAIL-HUB.pai.local>
next in thread | raw e-mail | index | archive | help
--_000_94c10113c3964b1bbd3f4ddf934c23cdMAILHUBpailocal_ Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable I have a zfs block dataset raid-5400-1/esxi-store1 that I share as an iscsi= target and that works great. I have set a reservation on that block device equal to its size so that is not sparse and thus while= I could over provision guests on the provided LUN, the storage presented as the LUN capacity will always be available. At lea= st this is what I want to achieve. What I find strange is that the reservation does not seem to be applied to = the ZFS pool 'raid-5400-1'. Do you really need to set your maximum reservation at the pool level, and then apply reservati= ons to all datasets on that volume? And if so I would assume you could never set reservations for datasets totaling more = than what was reserved for the pool 'raid-5400-1'. I could build out a test environment and figure out constraints but I'd rea= lly like to know the "how it is supposed to work" not the "how I find it to work". Thanks in advance. FreeBSD 14.0-CURRENT #4 main-n253875-8e72f458c6d: (this is a raidz2 pool - not my draid pool) root@draid:/usr/src/contrib/bearssl # zfs list -o name,type,used,avail,rati= o,compression,reservation,refreservation,volsize raid-5400-1 NAME TYPE USED AVAIL RATIO COMPRESS RESERV REFRESERV = VOLSIZE raid-5400-1 filesystem 18.0T 2.08T 1.36x on none = none - <- no reservation @pool root@draid:/usr/src/contrib/bearssl # root@draid:/usr/src/contrib/bearssl # zfs list -o name,type,used,avail,rati= o,compression,reservation,refreservation,volsize raid-5400-1/esxi-store1 NAME TYPE USED AVAIL RATIO COMPRESS RESERV = REFRESERV VOLSIZE raid-5400-1/esxi-store1 volume 16.9T 18.5T 1.78x zstd 15.6= T 16.9T 15.6T <- reservation @dataset root@draid:/usr/src/contrib/bearssl # zpool list NAME SIZE ALLOC FREE CKPOINT EXPANDSZ FRAG CAP DEDUP = HEALTH ALTROOT ccache 9.50G 9.10G 406M - - 88% 95% 1.00x = ONLINE - raid-5400-1 24.6T 1.52T 23.1T - - 2% 6% 1.00x = ONLINE - <- Free does not reflect reservation @pool tank 18.5T 605G 17.9T - - 0% 3% 1.00x = ONLINE - zfsroot 103G 33.3G 69.7G - - 31% 32% 1.00x = ONLINE - root@draid:/usr/src/contrib/bearssl # CONFIDENTIALITY NOTE: This message is intended only for the use of the individual or entity to whom it is addressed and may contain information that is privileged, confidential, and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any dissemination, distribution or copying of this communication is strictly prohibited. If you have received this transmission in error, please notify us by telephone at (502) 212-4000 or notify us at: PAI, Dept. 99, 2101 High Wickham Place, Suite 101, Louisville, KY 40245 Disclaimer The information contained in this communication from the sender is confiden= tial. It is intended solely for use by the recipient and others authorized = to receive it. If you are not the recipient, you are hereby notified that a= ny disclosure, copying, distribution or taking action in relation of the co= ntents of this information is strictly prohibited and may be unlawful. This email has been scanned for viruses and malware, and may have been auto= matically archived by Mimecast, a leader in email security and cyber resili= ence. Mimecast integrates email defenses with brand protection, security aw= areness training, web security, compliance and other essential capabilities= . Mimecast helps protect large and small organizations from malicious activ= ity, human error and technology failure; and to lead the movement toward bu= ilding a more resilient world. To find out more, visit our website. --_000_94c10113c3964b1bbd3f4ddf934c23cdMAILHUBpailocal_ Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable <html><head> <meta http-equiv=3D"Content-Type" content=3D"text/html; charset=3Dus-ascii"= > <meta name=3D"Generator" content=3D"Microsoft Word 15 (filtered medium)"> <style><!-- /* Font Definitions */ @font-face =09{font-family:"Cambria Math"; =09panose-1:2 4 5 3 5 4 6 3 2 4;} @font-face =09{font-family:Calibri; =09panose-1:2 15 5 2 2 2 4 3 2 4;} /* Style Definitions */ p.MsoNormal, li.MsoNormal, div.MsoNormal =09{margin:0in; =09margin-bottom:.0001pt; =09font-size:11.0pt; =09font-family:"Calibri",sans-serif;} a:link, span.MsoHyperlink =09{mso-style-priority:99; =09color:#0563C1; =09text-decoration:underline;} a:visited, span.MsoHyperlinkFollowed =09{mso-style-priority:99; =09color:#954F72; =09text-decoration:underline;} span.EmailStyle17 =09{mso-style-type:personal-compose; =09font-family:"Calibri",sans-serif; =09color:windowtext;} .MsoChpDefault =09{mso-style-type:export-only; =09font-family:"Calibri",sans-serif;} @page WordSection1 =09{size:8.5in 11.0in; =09margin:1.0in 1.0in 1.0in 1.0in;} div.WordSection1 =09{page:WordSection1;} --></style><!--[if gte mso 9]><xml> <o:shapedefaults v:ext=3D"edit" spidmax=3D"1026" /> </xml><![endif]--><!--[if gte mso 9]><xml> <o:shapelayout v:ext=3D"edit"> <o:idmap v:ext=3D"edit" data=3D"1" /> </o:shapelayout></xml><![endif]--> <style type=3D"text/css">.style1 {font-family: "Times New Roman";}</style><= /head><body lang=3D"EN-US" link=3D"#0563C1" vlink=3D"#954F72"> <div class=3D"WordSection1"> <p class=3D"MsoNormal">I have a zfs block dataset raid-5400-1/esxi-store1 t= hat I share as an iscsi target and that works great. I have set a res= ervation<o:p></o:p></p> <p class=3D"MsoNormal">on that block device equal to its size so that is no= t sparse and thus while I could over provision guests on the provided LUN,<= o:p></o:p></p> <p class=3D"MsoNormal">the storage presented as the LUN capacity will alway= s be available. At least this is what I want to achieve.<o:p></o:p></= p> <p class=3D"MsoNormal"><o:p> </o:p></p> <p class=3D"MsoNormal">What I find strange is that the reservation does not= seem to be applied to the ZFS pool ‘raid-5400-1’. Do you= really need<o:p></o:p></p> <p class=3D"MsoNormal">to set your maximum reservation at the pool level, a= nd then apply reservations to all datasets on that volume? And if so<= o:p></o:p></p> <p class=3D"MsoNormal">I would assume you could never set reservations for = datasets totaling more than what was reserved for the pool ‘raid-5400= -1’.<o:p></o:p></p> <p class=3D"MsoNormal"><o:p> </o:p></p> <p class=3D"MsoNormal">I could build out a test environment and figure out = constraints but I’d really like to know the “how it is supposed= to work”<o:p></o:p></p> <p class=3D"MsoNormal">not the “how I find it to work”.<o:p></o= :p></p> <p class=3D"MsoNormal"><o:p> </o:p></p> <p class=3D"MsoNormal">Thanks in advance.<o:p></o:p></p> <p class=3D"MsoNormal"><o:p> </o:p></p> <p class=3D"MsoNormal">FreeBSD 14.0-CURRENT #4 main-n253875-8e72f458c6d:<o:= p></o:p></p> <p class=3D"MsoNormal"><o:p> </o:p></p> <p class=3D"MsoNormal">(this is a raidz2 pool – not my draid pool)<o:= p></o:p></p> <p class=3D"MsoNormal"><o:p> </o:p></p> <p class=3D"MsoNormal"><o:p> </o:p></p> <p class=3D"MsoNormal">root@draid:/usr/src/contrib/bearssl # zfs list -o na= me,type,used,avail,ratio,compression,reservation,refreservation,volsize rai= d-5400-1<o:p></o:p></p> <p class=3D"MsoNormal">NAME = TYPE USED AVAIL RATIO COMPRESS &n= bsp; RESERV REFRESERV VOLSIZE<o:p></o:p= ></p> <p class=3D"MsoNormal">raid-5400-1 filesystem 18.0T 2.08T= 1.36x on  = ; none &nbs= p; none - = <- no reser= vation @pool<o:p></o:p></p> <p class=3D"MsoNormal">root@draid:/usr/src/contrib/bearssl #<o:p></o:p></p> <p class=3D"MsoNormal"><o:p> </o:p></p> <p class=3D"MsoNormal">root@draid:/usr/src/contrib/bearssl # zfs list -o na= me,type,used,avail,ratio,compression,reservation,refreservation,volsize rai= d-5400-1/esxi-store1<o:p></o:p></p> <p class=3D"MsoNormal">NAME = TY= PE USED AVAIL RATIO COMPRESS  = ; RESERV REFRESERV VOLSIZE<o:p></o:p></= p> <p class=3D"MsoNormal">raid-5400-1/esxi-store1 volume 16.9T&nbs= p; 18.5T 1.78x zstd &n= bsp; 15.6T 16.9T = ; 15.6T <- reserva= tion @dataset<o:p></o:p></p> <p class=3D"MsoNormal"><o:p> </o:p></p> <p class=3D"MsoNormal">root@draid:/usr/src/contrib/bearssl # zpool list<o:p= ></o:p></p> <p class=3D"MsoNormal">NAME = SIZE ALLOC FREE CKPOINT EXPANDSZ = FRAG CAP DEDUP HEALTH = ; ALTROOT<o:p></o:p></p> <p class=3D"MsoNormal">ccache 9.50G&nbs= p; 9.10G 406M - = - 88% &nb= sp; 95% 1.00x ONLINE -<o:p></o:p></p> <p class=3D"MsoNormal">raid-5400-1 24.6T 1.52T 23.1T = ; - = - 2% 6% = 1.00x ONLINE - &= nbsp; &nbs= p; <- Free does not reflect reservation @pool<o:p></o:p></p> <p class=3D"MsoNormal">tank = 18.5T 605G 17.9T &nbs= p; - - &nb= sp; 0% 3% 1.00x ONLINE = ; -<o:p></o:p></p> <p class=3D"MsoNormal">zfsroot 103G&nbs= p; 33.3G 69.7G -  = ; - 31% &= nbsp;32% 1.00x ONLINE -<o:p></o:p></p> <p class=3D"MsoNormal">root@draid:/usr/src/contrib/bearssl #<o:p></o:p></p> <p class=3D"MsoNormal"><o:p> </o:p></p> </div> <div> <p style=3D"FONT-SIZE: 10pt; FONT-FAMILY: Arial"> </p> <div style=3D"FONT-SIZE: 10px; BORDER-TOP: #666666 1px solid; FONT-FAMILY: = Verdana; WIDTH: 410px; BORDER-BOTTOM: #666666 1px solid; PADDING-BOTTOM: 5p= x; PADDING-TOP: 5px; PADDING-LEFT: 5px; PADDING-RIGHT: 5px"> CONFIDENTIALITY NOTE: This message is intended only for the use<br> of the individual or entity to whom it is addressed and may <br> contain information that is privileged, confidential, and <br> exempt from disclosure under applicable law. If the reader <br> of this message is not the intended recipient, you are hereby <br> notified that any dissemination, distribution or copying <br> of this communication is strictly prohibited. If you have <br> received this transmission in error, please notify us by <br> telephone at (502) 212-4000 or notify us at: PAI, Dept. 99, <br> 2101 High Wickham Place, Suite 101, Louisville, KY 40245<br> <br> <br> <br> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> <p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p> </div> </div> <br><br><p style=3D"font-family: Verdana; font-size:10pt; color:#666666;"><= b>Disclaimer</b></p><p style=3D"font-family: Verdana; font-size:8pt; color:= #666666;">The information contained in this communication from the sender i= s confidential. It is intended solely for use by the recipient and others a= uthorized to receive it. If you are not the recipient, you are hereby notif= ied that any disclosure, copying, distribution or taking action in relation= of the contents of this information is strictly prohibited and may be unla= wful.<br><br>This email has been scanned for viruses and malware, and may h= ave been automatically archived by Mimecast, a leader in email security and= cyber resilience. Mimecast integrates email defenses with brand protection= , security awareness training, web security, compliance and other essential= capabilities. Mimecast helps protect large and small organizations from ma= licious activity, human error and technology failure; and to lead the movem= ent toward building a more resilient world. To find out more, visit our web= site.</p></body></html> --_000_94c10113c3964b1bbd3f4ddf934c23cdMAILHUBpailocal_--
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?94c10113c3964b1bbd3f4ddf934c23cd>