From owner-freebsd-current@FreeBSD.ORG Tue Jan 22 09:46:07 2008 Return-Path: Delivered-To: freebsd-current@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id DC5B816A418 for ; Tue, 22 Jan 2008 09:46:07 +0000 (UTC) (envelope-from pjd@garage.freebsd.pl) Received: from mail.garage.freebsd.pl (arm132.internetdsl.tpnet.pl [83.17.198.132]) by mx1.freebsd.org (Postfix) with ESMTP id 5E4DC13C44B for ; Tue, 22 Jan 2008 09:46:07 +0000 (UTC) (envelope-from pjd@garage.freebsd.pl) Received: by mail.garage.freebsd.pl (Postfix, from userid 65534) id 0B3EB45E8F; Tue, 22 Jan 2008 10:46:06 +0100 (CET) Received: from localhost (pjd.wheel.pl [10.0.1.1]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mail.garage.freebsd.pl (Postfix) with ESMTP id 383A345683; Tue, 22 Jan 2008 10:45:58 +0100 (CET) Date: Tue, 22 Jan 2008 10:45:47 +0100 From: Pawel Jakub Dawidek To: Peter Losher Message-ID: <20080122094546.GB56119@garage.freebsd.pl> References: <47606C09.2070209@isc.org> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="dTy3Mrz/UPE2dbVg" Content-Disposition: inline In-Reply-To: <47606C09.2070209@isc.org> User-Agent: Mutt/1.4.2.3i X-PGP-Key-URL: http://people.freebsd.org/~pjd/pjd.asc X-OS: FreeBSD 7.0-CURRENT i386 X-Spam-Checker-Version: SpamAssassin 3.0.4 (2005-06-05) on mail.garage.freebsd.pl X-Spam-Level: X-Spam-Status: No, score=-5.9 required=3.0 tests=ALL_TRUSTED,BAYES_00 autolearn=ham version=3.0.4 Cc: FreeBSD Current Subject: Re: ZFS melting under postgres... X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 22 Jan 2008 09:46:07 -0000 --dTy3Mrz/UPE2dbVg Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Wed, Dec 12, 2007 at 03:17:29PM -0800, Peter Losher wrote: > Hi, >=20 > As part of our testing 7.0/ZFS we tried putting it thru it's paces > having ZFS act as our storage medium for some test pgsql db's (like for > sqlgrey, etc) and in both BETA2 and BETA4 (amd64) we get the same > results with a RAIDZ2 container: >=20 > -=3D- > Dec 12 14:24:12 nsa sqlgrey: fatal: setconfig error at > /usr/local/sbin/sqlgrey line 186. > Dec 12 16:49:53 nsa root: ZFS: checksum mismatch, zpool=3Dvault > path=3D/dev/ad4 offset=3D3665128448 size=3D22016 [...] > It basically corrupts the container from the inside until it fails > completely (usually withing 24-48 hours depending on how busy the db is) >=20 > I had thought it was a bad SATA replicator/controller, but we had that > replaced w/ one from Supermicro. So it's either the disks, or something > in ZFS. Anyone used ZFS to backend any db's (mysql or pgsql?) >=20 > If you need more info, let me know... It is hard for me to believe that this is FreeBSD-specific bug, because checksumming is below FreeBSD-specific code. Of course everything is possible, but I just think it's just unlikely. I'd start from configuring UFS on top of GELI with authentication. GELI will also detect silent data corruptions: # geli init -a hmac/md5 -e null -s 4096 -P -K /dev/null /dev/ad4 # geli attach -p -k /dev/null /dev/ad4 # dd if=3D/dev/zero of=3D/dev/ad4.eli bs=3D1m (this will take a while) # newfs -U /dev/ad4.eli # mount -o noatime /dev/ad4.eli /mnt/tmp Try your DB test on this file system. --=20 Pawel Jakub Dawidek http://www.wheel.pl pjd@FreeBSD.org http://www.FreeBSD.org FreeBSD committer Am I Evil? Yes, I Am! --dTy3Mrz/UPE2dbVg Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.4 (FreeBSD) iD8DBQFHlbtKForvXbEpPzQRApvOAJ9c9UGv8gWbubyuYk2GGthRsDERfQCgpslk MU38yYY2u6y00k9a/+yF210= =MnIM -----END PGP SIGNATURE----- --dTy3Mrz/UPE2dbVg--