Skip site navigation (1)Skip section navigation (2)
Date:      Tue, 2 Aug 2011 19:12:24 +0930
From:      "Daniel O'Connor" <doconnor@gsoft.com.au>
To:        Jeremy Chadwick <freebsd@jdc.parodius.com>
Cc:        freebsd-stable@freebsd.org, "seanrees@gmail.com" <seanrees@gmail.com>
Subject:   Re: ZFS directory with a large number of files
Message-ID:  <960112E7-2331-449A-8736-C8790B05FE20@gsoft.com.au>
In-Reply-To: <20110802090830.GA92646@icarus.home.lan>
References:  <CAJGy1F0d7jeyaFuNdXe%2BucTL2r7R4suCyu8xG7WRHenMFZH-6g@mail.gmail.com> <20110802090830.GA92646@icarus.home.lan>

next in thread | previous in thread | raw e-mail | index | archive | help

On 02/08/2011, at 18:38, Jeremy Chadwick wrote:
> On Tue, Aug 02, 2011 at 08:39:03AM +0100, seanrees@gmail.com wrote:
>> On my FreeBSD 8.2-S machine (built circa 12th June), I created a
>> directory and populated it over the course of 3 weeks with about 2
>> million individual files.
>=20
> I'll keep this real simple:
>=20
> Why did you do this?
>=20
> I hope this was a stress test of some kind.  If not:
>=20
> This is the 2nd or 3rd mail in recent months from people saying "I
> decided to do something utterly stupid with my filesystem[1] and now =
I'm
> asking why performance sucks".
>=20
> Why can people not create proper directory tree layouts to avoid this
> problem regardless of what filesystem is used?  I just don't get it.
>=20
> [1]: Applies to any filesystem, not just ZFS.  There was a UFS one a
> month or two ago too=85

The problem is that he is being punished with shitty FS performance even =
though the directory structure is now non-silly.

It sounds like the FS hasn't GC'd some (now unneeded) metadata..

--
Daniel O'Connor software and network engineer
for Genesis Software - http://www.gsoft.com.au
"The nice thing about standards is that there
are so many of them to choose from."
  -- Andrew Tanenbaum
GPG Fingerprint - 5596 B766 97C0 0E94 4347 295E E593 DC20 7B3F CE8C









Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?960112E7-2331-449A-8736-C8790B05FE20>