Date: Thu, 1 Sep 2011 08:56:58 -0400 From: Trent Nelson <trent@snakebite.org> To: Daniel Mayfield <dan@3geeks.org> Cc: "freebsd-fs@freebsd.org" <freebsd-fs@freebsd.org> Subject: Re: gptzfsboot and 4k sector raidz Message-ID: <4E5F811A.2040307@snakebite.org> In-Reply-To: <F335600A-0364-455F-A276-43E23B0E597E@3geeks.org> References: <F335600A-0364-455F-A276-43E23B0E597E@3geeks.org>
next in thread | previous in thread | raw e-mail | index | archive | help
On 01-Sep-11 2:11 AM, Daniel Mayfield wrote: > I just set this up on an Athlon64 machine I have w/ 4 WD EARS 2TB > disks. I followed the instructions here: > http://www.leidinger.net/blog/2011/05/03/another-root-on-zfs-howto-optimized-for-4k-sector-drives/, > but just building a single pool so three partitions per disk (boot, > swap and zfs). I'm using the mfsBSD image to do the boot code. When > I reboot to actually come up from ZFS, the loader spins for half a > second and then the machine reboots. I've seen a number of bug > reports on gptzfsboot and 4k sector pools, but I never saw one fail > so early. What data would the ZFS people need to help fix this? FWIW, I experienced the exact same issue about a week ago with four new WD EARS 2TB disks. I contemplated looking into fixing it, until I noticed the crazy disk usage with 4K sectors. On my old box, my /usr/src dataset was ~450MB (mirrored 512-byte drives), on the new box with the 2TB 4k sector drives, /usr/src was 1.5-something GB. Exact same settings. This appeared to be the case for *everything*; every file system/zfs dataset seemed to be consuming 2-3 times more space on the 4K-sector box. So, combine that with the fact that I couldn't boot into it anyway, and I ditched the 4k-sector effort and just re-built with raidz as per normal (i.e. with 512-byte sectors). One week later? Disk usage is sensible, as expected, but performance (especially writing) is pretty horrid. As much as I'd like to blame raidz overhead, I'm not sure it's the problem; I've got a gstripe of 4x16GB partitions at the start of each 2TB as /scratch; dd'ing /dev/zero to that doesn't yield write speeds faster than ~20-30MB/s if I'm lucky. Writing to the raidz partition nets about 15-20MB/s in very bursty peaks. NFS and Samba performance are even worse; 2-3MB/s sustained if I'm lucky, with the odd burst of 20MB/s every so often. (The box is a lowly dual-core Athlon 1800 w/ 8GB RAM, 8-stable from yesterday.) So, uh, no solution from my end, but perhaps some more problems for you to run into if you get it to boot ;-) Trent.
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?4E5F811A.2040307>