Date: Wed, 17 May 2023 08:55:05 +0100 From: Kaya Saman <kayasaman@optiplex-networks.com> To: questions@freebsd.org Subject: Re: Tool to compare directories and delete duplicate files from one directory Message-ID: <1e30ac66-a339-ce08-75ac-8e566f4d2278@optiplex-networks.com> In-Reply-To: <941908372.622746.1684189567246@ichabod.co-bxl> References: <9887a438-95e7-87cc-a162-4ad7a70d744f@optiplex-networks.com> <7747f587-f33e-f39c-ac97-fe4fe19e0b76@optiplex-networks.com> <CAFbbPuhoMOM=wp26yZ42e9xnRP%2BtJ6B30y8%2BBa3eCBh2v66Grw@mail.gmail.com> <fd9aa7d3-f6a7-2274-f970-d4421d187855@optiplex-networks.com> <CAFbbPujpPPrm-axMC9S5OnOiYn2oPuQbkRjnQY4tp=5L7TiVSg@mail.gmail.com> <eda13374-48c1-1749-3a73-530370934eff@optiplex-networks.com> <CAFbbPujbyPHm2GO%2BFnR0G8rnsmpA3AxY2NzYOAAXetApiF8HVg@mail.gmail.com> <b4ac4aea-a051-fbfe-f860-cd7836e5a1bb@optiplex-networks.com> <7c2429c5-55d0-1649-a442-ce543f2d46c2@holgerdanske.com> <6a0aba81-485a-8985-d20d-6da58e9b5580@optiplex-networks.com> <347612746.1721811.1683912265841@fidget.co-bxl> <08804029-03de-e856-568b-74494dfc81cf@holgerdansk e.com> <126434505.494354.1684104532813@ichabod.co-bxl> <c1699605-fa7f-71da-db06-dfcfb43618d6@holgerdanske.com> <818813a2-8ab0-df5 4-3c59-0e1ba9ce743d@holgerdanske.com> <941908372.622746.1684189567246@ichabod.co-bxl>
next in thread | previous in thread | raw e-mail | index | archive | help
On 5/15/23 23:26, Sysadmin Lists wrote: >> ---------------------------------------- >> From: David Christensen <dpchrist@holgerdanske.com> >> Date: May 15, 2023, 1:43:38 AM >> To: <questions@freebsd.org> >> Subject: Re: Tool to compare directories and delete duplicate files from one directory >> >> >> I looks like your script only finds duplicates when the subpath is >> identical (?): >> > Yeah. Wasn't that the original problem description? I went off the example > given by Paul earlier in this thread, and it looked like only files with > matching subpaths were being considered (because the OP accidentally rsync'd > files from a source to a bunch of destination dirs). > Glad to see this thread has turned into an interesting discussion.... Just as the OP :-) I will clarify.... There was no accidental rsync in place. Due to lack of storage my files where basically all over the place on different zpools. The problem is that most of those were on iscsi drives (all running Freebsd), so I needed to get them in a single place. Of course as the files where all over things became a mess. I bought a few new drives and created a new zpool just for this case. So virtually I had to sync the multiple directories to a single destination. *but* of course I didn't use the --remove-source-files option as I didn't want things to be destructive. But then I needed the extra space too and that's where this post came from. Regards, Kaya
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?1e30ac66-a339-ce08-75ac-8e566f4d2278>