From owner-freebsd-questions@FreeBSD.ORG Tue Feb 28 08:45:09 2012 Return-Path: Delivered-To: freebsd-questions@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id DC878106564A for ; Tue, 28 Feb 2012 08:45:08 +0000 (UTC) (envelope-from m.seaman@infracaninophile.co.uk) Received: from smtp.infracaninophile.co.uk (smtp6.infracaninophile.co.uk [IPv6:2001:8b0:151:1:3cd3:cd67:fafa:3d78]) by mx1.freebsd.org (Postfix) with ESMTP id 62CDC8FC14 for ; Tue, 28 Feb 2012 08:45:08 +0000 (UTC) Received: from seedling.black-earth.co.uk (seedling.black-earth.co.uk [IPv6:2001:8b0:151:1:fa1e:dfff:feda:c0bb]) (authenticated bits=0) by smtp.infracaninophile.co.uk (8.14.5/8.14.5) with ESMTP id q1S8j3sq089772 (version=TLSv1/SSLv3 cipher=DHE-RSA-CAMELLIA256-SHA bits=256 verify=NO) for ; Tue, 28 Feb 2012 08:45:04 GMT (envelope-from m.seaman@infracaninophile.co.uk) X-DKIM: OpenDKIM Filter v2.4.3 smtp.infracaninophile.co.uk q1S8j3sq089772 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=infracaninophile.co.uk; s=201001-infracaninophile; t=1330418704; bh=WLi6uRt28dzMoaekviz9H8Z4zYsC3hflsK+xd9D0b+w=; h=Message-ID:Date:From:MIME-Version:To:Subject:References: In-Reply-To:Content-Type:Cc; b=HWASQNvBHgSF9khzo39sQ1ggkVZ5CQfPkImKa2WMNUK66bosRFzrNOEFuksxe+xao JJvXIqQdPTUJeTkrhIr6qIRXtF2IUvJO0o2irr8IErYP/u8D57p8mzrsFsY0ewde2M CzirNqOhu0Lgnv/gDlmAT75H08xRP50wr9O4LhBc= Message-ID: <4F4C9407.6090507@infracaninophile.co.uk> Date: Tue, 28 Feb 2012 08:44:55 +0000 From: Matthew Seaman User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.6; rv:10.0.2) Gecko/20120216 Thunderbird/10.0.2 MIME-Version: 1.0 To: freebsd-questions@freebsd.org References: <4F4BFB09.9090002@weogeo.com> <4F4C094C.1010900@infracaninophile.co.uk> <4F4C3A3A.9080903@weogeo.com> In-Reply-To: <4F4C3A3A.9080903@weogeo.com> X-Enigmail-Version: 1.3.5 OpenPGP: id=60AE908C Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="------------enig7D9A41A9B34CB51B4F6BAE31" X-Virus-Scanned: clamav-milter 0.97.3 at lucid-nonsense.infracaninophile.co.uk X-Virus-Status: Clean X-Spam-Status: No, score=-2.8 required=5.0 tests=ALL_TRUSTED,AWL,BAYES_00, DKIM_SIGNED,DKIM_VALID,DKIM_VALID_AU autolearn=ham version=3.3.2 X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on lucid-nonsense.infracaninophile.co.uk Subject: Re: "find" not traversing all directories on a single zfs file system X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 28 Feb 2012 08:45:09 -0000 This is an OpenPGP/MIME signed message (RFC 2440 and 3156) --------------enig7D9A41A9B34CB51B4F6BAE31 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable On 28/02/2012 02:21, Robert Banfield wrote: > I have some additional information that I didnt see before actually > digging into the log file. It is quite interesting. There are 82,206 > subdirectories in one of the folders. Like this: >=20 > /zfs_mount/directoryA/token[1-82206]/various_tileset_files >=20 > When looking at the output of find, here is what I see: >=20 > Lines 1-9996943: The output of find, good as good can be > Lines 9996944-10062479: Subdirectory entries only, it traversed none o= f > them. >=20 > Notice 10062479-9996944+1 =3D 65536 =3D 2^16 >=20 > So, of the 82206 subdirectories, the first 82206-2^16 were traversed, > and the final 2^16 were not. The plot thickens... Now this is very interesting indeed. 80,000 subdirectories is quite a lot.. As is a grand total of more than 10,000,000 files. Hmmm... and you see the find problem just when searching within the structure under directoryA? I think you have found a bug, although whether it is in find(1), the filesystem or elsewhere is not clear. Given that 'ls -R' shows the same problem, the bug could be in fts(3). Still, that's a testable hypothesis. Let me see if I can reproduce the problem. Cheers, Matthew --=20 Dr Matthew J Seaman MA, D.Phil. 7 Priory Courtyard Flat 3 PGP: http://www.infracaninophile.co.uk/pgpkey Ramsgate JID: matthew@infracaninophile.co.uk Kent, CT11 9PW --------------enig7D9A41A9B34CB51B4F6BAE31 Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG/MacGPG2 v2.0.16 (Darwin) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/ iEYEARECAAYFAk9MlA4ACgkQ8Mjk52CukIyTxQCglbQ/KZOOoBa9/XQghEFL0r6b 5ccAnjzQpBeylXIrtmSrk31Dt6p6I8gM =wyQF -----END PGP SIGNATURE----- --------------enig7D9A41A9B34CB51B4F6BAE31--