Date: Sun, 13 Nov 2022 11:13:56 -0500 From: Mark Saad <nonesuch@longcount.org> To: freebsd-fs@freebsd.org Subject: Re: Odd behaviour of two identical ZFS servers mirroring via rsync Message-ID: <CAMXt9Nbr=7K6PELVGAPZ=-RiAfx=zp9iOoKyWdH=0H2=AiE52Q@mail.gmail.com> In-Reply-To: <alpine.GSO.2.20.2211121949060.7126@scrappy.simplesystems.org> References: <alpine.BSF.2.22.395.2211111709230.29479@mail0.time-domain.net> <CAOgwaMuoLQ9Er67Y%2B=q%2Bf9724v2WT3L5v5TZaRVXq%2B=1vEyJ%2BA@mail.gmail.com> <alpine.BSF.2.22.395.2211112008220.30520@mail0.time-domain.net> <alpine.GSO.2.20.2211121949060.7126@scrappy.simplesystems.org>
next in thread | previous in thread | raw e-mail | index | archive | help
--00000000000092b96f05ed5c6903 Content-Type: text/plain; charset="UTF-8" On Sat, Nov 12, 2022 at 8:54 PM Bob Friesenhahn < bfriesen@simple.dallas.tx.us> wrote: > On Fri, 11 Nov 2022, andy thomas wrote: > > > Yes, I can confirm the rsync --delete option is being used and in fact, > 'du' > > reports some of the mirrored folders as having identical sizes on both > > servers, mainly those containing only small amounts of data. > > I forgot to mention that a proven solution when using rsync is to use > the '--inplace --no-whole-file' options. These options help rsync to > avoid doing wasteful things when updating existing files on a ZFS > filesystem. > > Bob are you saying when the target is zfs --inplace --no-whole-file helps or just in general when you have large files ? Also have you tried using --delete-during / --delete-after ? > Bob > -- > Bob Friesenhahn > bfriesen@simple.dallas.tx.us, http://www.simplesystems.org/users/bfriesen/ > GraphicsMagick Maintainer, http://www.GraphicsMagick.org/ > Public Key, http://www.simplesystems.org/users/bfriesen/public-key.txt > > -- mark saad | nonesuch@longcount.org --00000000000092b96f05ed5c6903 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable <div dir=3D"ltr"><div dir=3D"ltr"><br></div><br><div class=3D"gmail_quote">= <div dir=3D"ltr" class=3D"gmail_attr">On Sat, Nov 12, 2022 at 8:54 PM Bob F= riesenhahn <<a href=3D"mailto:bfriesen@simple.dallas.tx.us">bfriesen@sim= ple.dallas.tx.us</a>> wrote:<br></div><blockquote class=3D"gmail_quote" = style=3D"margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);pa= dding-left:1ex">On Fri, 11 Nov 2022, andy thomas wrote:<br> <br> > Yes, I can confirm the rsync --delete option is being used and in fact= , 'du' <br> > reports some of the mirrored folders as having identical sizes on both= <br> > servers, mainly those containing only small amounts of data.<br> <br> I forgot to mention that a proven solution when using rsync is to use <br> the '--inplace --no-whole-file' options.=C2=A0 These options help r= sync to <br> avoid doing wasteful things when updating existing files on a ZFS <br> filesystem.<br> <br></blockquote><div><br></div><div>Bob are you saying when the target is = zfs --inplace --no-whole-file helps or just in general when you have <br></= div><div>large files ?=C2=A0 Also have you tried using --delete-during / --= delete-after=C2=A0 ?<br></div><div>=C2=A0</div><blockquote class=3D"gmail_q= uote" style=3D"margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,2= 04);padding-left:1ex"> Bob<br> -- <br> Bob Friesenhahn<br> <a href=3D"mailto:bfriesen@simple.dallas.tx.us" target=3D"_blank">bfriesen@= simple.dallas.tx.us</a>, <a href=3D"http://www.simplesystems.org/users/bfri= esen/" rel=3D"noreferrer" target=3D"_blank">http://www.simplesystems.org/us= ers/bfriesen/</a><br> GraphicsMagick Maintainer,=C2=A0 =C2=A0 <a href=3D"http://www.GraphicsMagic= k.org/" rel=3D"noreferrer" target=3D"_blank">http://www.GraphicsMagick.org/= </a><br> Public Key,=C2=A0 =C2=A0 =C2=A0<a href=3D"http://www.simplesystems.org/user= s/bfriesen/public-key.txt" rel=3D"noreferrer" target=3D"_blank">http://www.= simplesystems.org/users/bfriesen/public-key.txt</a><br> <br> </blockquote></div><br clear=3D"all"><br>-- <br><div dir=3D"ltr" class=3D"g= mail_signature">mark saad | <a href=3D"mailto:nonesuch@longcount.org" targe= t=3D"_blank">nonesuch@longcount.org</a><br></div></div> --00000000000092b96f05ed5c6903--
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?CAMXt9Nbr=7K6PELVGAPZ=-RiAfx=zp9iOoKyWdH=0H2=AiE52Q>