Skip site navigation (1)Skip section navigation (2)
Date:      Tue, 28 Feb 2012 08:44:55 +0000
From:      Matthew Seaman <m.seaman@infracaninophile.co.uk>
To:        freebsd-questions@freebsd.org
Subject:   Re: "find" not traversing all directories on a single zfs file system
Message-ID:  <4F4C9407.6090507@infracaninophile.co.uk>
In-Reply-To: <4F4C3A3A.9080903@weogeo.com>
References:  <4F4BFB09.9090002@weogeo.com> <4F4C094C.1010900@infracaninophile.co.uk> <4F4C3A3A.9080903@weogeo.com>

index | next in thread | previous in thread | raw e-mail

[-- Attachment #1 --]
On 28/02/2012 02:21, Robert Banfield wrote:
> I have some additional information that I didnt see before actually
> digging into the log file.  It is quite interesting.  There are 82,206
> subdirectories in one of the folders.  Like this:
> 
> /zfs_mount/directoryA/token[1-82206]/various_tileset_files
> 
> When looking at the output of find, here is what I see:
> 
> Lines 1-9996943: The output of find, good as good can be
> Lines 9996944-10062479:  Subdirectory entries only, it traversed none of
> them.
> 
> Notice 10062479-9996944+1 = 65536 = 2^16
> 
> So, of the 82206 subdirectories, the first 82206-2^16 were traversed,
> and the final 2^16 were not.  The plot thickens...

Now this is very interesting indeed.  80,000 subdirectories is quite a
lot..  As is a grand total of more than 10,000,000 files.

Hmmm... and you see the find problem just when searching within the
structure under directoryA?  I think you have found a bug, although
whether it is in find(1), the filesystem or elsewhere is not clear.
Given that 'ls -R' shows the same problem, the bug could be in fts(3).

Still, that's a testable hypothesis.  Let me see if I can reproduce the
problem.

	Cheers,

	Matthew

-- 
Dr Matthew J Seaman MA, D.Phil.                   7 Priory Courtyard
                                                  Flat 3
PGP: http://www.infracaninophile.co.uk/pgpkey     Ramsgate
JID: matthew@infracaninophile.co.uk               Kent, CT11 9PW


[-- Attachment #2 --]
-----BEGIN PGP SIGNATURE-----
Version: GnuPG/MacGPG2 v2.0.16 (Darwin)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/

iEYEARECAAYFAk9MlA4ACgkQ8Mjk52CukIyTxQCglbQ/KZOOoBa9/XQghEFL0r6b
5ccAnjzQpBeylXIrtmSrk31Dt6p6I8gM
=wyQF
-----END PGP SIGNATURE-----
help

Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?4F4C9407.6090507>