Date: Thu, 4 May 2023 12:29:22 -0400 From: Paul Procacci <pprocacci@gmail.com> To: Kaya Saman <kayasaman@optiplex-networks.com> Cc: freebsd-questions@freebsd.org Subject: Re: Tool to compare directories and delete duplicate files from one directory Message-ID: <CAFbbPugfhXGPfscKpx6B0ue=DcF_qssL6P-0GgB1CWKtm3U=tQ@mail.gmail.com> In-Reply-To: <9887a438-95e7-87cc-a162-4ad7a70d744f@optiplex-networks.com> References: <9887a438-95e7-87cc-a162-4ad7a70d744f@optiplex-networks.com>
next in thread | previous in thread | raw e-mail | index | archive | help
--0000000000007bbd5905fae0adda
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable
On Thu, May 4, 2023 at 11:53=E2=80=AFAM Kaya Saman <kayasaman@optiplex-netw=
orks.com>
wrote:
> Hi,
>
>
> I'm wondering if anyone knows of a tool like diff or so that can also
> delete files based on name and size from either left/right or
> source/destination directory?
>
>
> Basically what I have done is performed an rsync without using the
> --remove-source-files option onto a newly bought and created disk pool
> (yes zpool) that i am trying to consolidate my data - as it's currently
> spread out over multiple pools with the same folder name.
>
>
> The issue I am facing mainly is that I perform another rsync and use the
> --remove-source-files option, rsync will delete files based on name
> while there are some files that have the same name but not same size and
> I would like to retain these files.
>
>
> Right now I have looked at many different options in both rsync and
> other tools but found nothing suitable. I even tested using a few test
> dirs and files that I put into /tmp and whatever I tried, the files of
> different size either got transferred or deleted.
>
>
> How would be a good way to approach this problem?
>
>
> Even if I create some kind of shell script and use diff, I think it will
> only compare names and not file sizes.
>
>
> I'm really lost here....
>
>
> Regards,
>
>
> Kaya
>
>
>
>
It sounds like you want fdupes. It's in the ports tree.
~Paul
--=20
__________________
:(){ :|:& };:
--0000000000007bbd5905fae0adda
Content-Type: text/html; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable
<div dir=3D"ltr"><div><div dir=3D"ltr"><br></div><br><div class=3D"gmail_qu=
ote"><div dir=3D"ltr" class=3D"gmail_attr">On Thu, May 4, 2023 at 11:53=E2=
=80=AFAM Kaya Saman <<a href=3D"mailto:kayasaman@optiplex-networks.com">=
kayasaman@optiplex-networks.com</a>> wrote:<br></div><blockquote class=
=3D"gmail_quote" style=3D"margin:0px 0px 0px 0.8ex;border-left:1px solid rg=
b(204,204,204);padding-left:1ex">Hi,<br>
<br>
<br>
I'm wondering if anyone knows of a tool like diff or so that can also <=
br>
delete files based on name and size from either left/right or <br>
source/destination directory?<br>
<br>
<br>
Basically what I have done is performed an rsync without using the <br>
--remove-source-files option onto a newly bought and created disk pool <br>
(yes zpool) that i am trying to consolidate my data - as it's currently=
<br>
spread out over multiple pools with the same folder name.<br>
<br>
<br>
The issue I am facing mainly is that I perform another rsync and use the <b=
r>
--remove-source-files option, rsync will delete files based on name <br>
while there are some files that have the same name but not same size and <b=
r>
I would like to retain these files.<br>
<br>
<br>
Right now I have looked at many different options in both rsync and <br>
other tools but found nothing suitable. I even tested using a few test <br>
dirs and files that I put into /tmp and whatever I tried, the files of <br>
different size either got transferred or deleted.<br>
<br>
<br>
How would be a good way to approach this problem?<br>
<br>
<br>
Even if I create some kind of shell script and use diff, I think it will <b=
r>
only compare names and not file sizes.<br>
<br>
<br>
I'm really lost here....<br>
<br>
<br>
Regards,<br>
<br>
<br>
Kaya<br>
<br>
<br>
<br>
</blockquote></div><br></div><div>It sounds like you want fdupes.=C2=A0 It&=
#39;s in the ports tree.</div><div><br></div><div>~Paul<br></div><div><br><=
span class=3D"gmail_signature_prefix">-- </span><br><div dir=3D"ltr" class=
=3D"gmail_signature">__________________<br><br>:(){ :|:& };:</div></div=
></div>
--0000000000007bbd5905fae0adda--
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?CAFbbPugfhXGPfscKpx6B0ue=DcF_qssL6P-0GgB1CWKtm3U=tQ>