Date: Sat, 18 Feb 2012 22:10:32 -0800 From: =?iso-8859-1?Q?Ask_Bj=F8rn_Hansen?= <ask@develooper.com> To: freebsd-stable@freebsd.org, freebsd-zfs@freebsd.org Subject: Can't read a full block, only got 8193 bytes. Message-ID: <770EEEFF-B41D-4851-AD74-C3F96FFB1683@develooper.com>
index | next in thread | raw e-mail
Hi everyone, We're recycling an old database server with room for 16 disks as a backup server (our old database servers had 12-20 15k disks; the new ones one or two SSDs and they're faster). We have a box running FreeBSD 8.2 with 7 disks in a ZFS raidz2 (and a spare). It's using an older 3ware card with all the disks (2TB WD green "ears" ones) setup as a "single" unit on the 3ware controller and though slow is basically working great. We have a small program to smartly purge old snapshots that I wrote after a year and tens of thousands of snapshots: https://github.com/abh/zfs-snapshot-cleaner The new box is running 9.0 with a 3ware 9690SA-4I4E card with the latest firmware (4.10.00.024). We're using Seagate 3TB barracuda disks (big and cheap; good for backups). Now for the problem: When running bonnie++ we get a few ZFS checksum errors and (weirder) we get this error from bonnie: "Can't read a full block, only got 8193 bytes." This seems to only be when testing a single ZFS disk or a UFS partition. Testing a raidz1 we just get checksum errors noted in zpool status, but no errors reading (though read speeds are ~10MB/second across four disks -- writing sequentially was ~230MB/second). Any ideas where to start look? Our best guess is that the 3ware controller can't play nicely with the disks; we're planning to try some older/smaller disks on Monday and then trying the same system and disks with Linux to see if the 3ware driver there works differently. Askhelp
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?770EEEFF-B41D-4851-AD74-C3F96FFB1683>