From owner-freebsd-fs@FreeBSD.ORG Mon Dec 5 22:34:50 2011 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id BA1C3106564A for ; Mon, 5 Dec 2011 22:34:50 +0000 (UTC) (envelope-from kungfujesus06@gmail.com) Received: from mail-qw0-f54.google.com (mail-qw0-f54.google.com [209.85.216.54]) by mx1.freebsd.org (Postfix) with ESMTP id 7109D8FC0A for ; Mon, 5 Dec 2011 22:34:50 +0000 (UTC) Received: by qabg14 with SMTP id g14so767700qab.13 for ; Mon, 05 Dec 2011 14:34:49 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=date:from:to:subject:message-id:mime-version:content-type :content-disposition:user-agent; bh=ph/2HDIUImVHaGw2IQ1Y4swhYBvc6nlcEMeb0d2vmsE=; b=JxDSXzL170oYyA+7Q2GW8B5ddmrg3wnzB9DPXojAnohyd8fFEUHxkKU8sLpNekWuel 9MCeBU6BQ7nhiMJuQUJ41C818sNHXYfa8rbo1i+fcEFhjwofY80dC5vDSnxNbuqKDOHt bxIQB73Hgsk1oG1LFNgcahrh6xuGwrapOZBjs= Received: by 10.224.96.84 with SMTP id g20mr5599831qan.17.1323122838268; Mon, 05 Dec 2011 14:07:18 -0800 (PST) Received: from freebsdbox.adamsnet ([72.49.234.31]) by mx.google.com with ESMTPS id bw9sm27978975qab.18.2011.12.05.14.07.17 (version=TLSv1/SSLv3 cipher=OTHER); Mon, 05 Dec 2011 14:07:17 -0800 (PST) Date: Mon, 5 Dec 2011 17:07:15 -0500 From: Adam Stylinski To: freebsd-fs@freebsd.org Message-ID: <20111205220715.GA36072@freebsdbox.adamsnet> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="M9NhX3UHpAaciwkO" Content-Disposition: inline User-Agent: Mutt/1.5.21 (2010-09-15) Subject: weird bug with ZFS and SLOG X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 05 Dec 2011 22:34:50 -0000 --M9NhX3UHpAaciwkO Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable The worst case scenario happened to me where my dedicated SLOG decided to d= rop off the controller and thus prevent me from importing my pool. I quick= ly upgrade to FreeBSD 9.0-RC2 after testing this scenario in a VM. It has = worked successfully in a VM, but it is not working on my hardware for whate= ver reason. I rollback the pool with zpool import -F share, seems ok, file= s are there, finishes scrub, very little corruption. I upgrade the pool to= V28, and the fs's to v5. I then do a: zpool remove share 15752248745115926170 It returns no errors and pretends like the operation worked, it even appen= ds it to my zpool history. However, when I do a zpool status, this is what= I get: [adam@nasbox ~]$ zpool status pool: share state: DEGRADED status: One or more devices has experienced an error resulting in data corruption. Applications may be affected. action: Restore the file in question if possible. Otherwise restore the entire pool from backup. see: http://www.sun.com/msg/ZFS-8000-8A scan: scrub repaired 0 in 8h57m with 0 errors on Mon Dec 5 12:48:28 2011 config: NAME STATE READ WRITE CKSUM share DEGRADED 0 0 0 raidz1-0 ONLINE 0 0 0 ada4 ONLINE 0 0 0 ada1 ONLINE 0 0 0 ada2 ONLINE 0 0 0 ada3 ONLINE 0 0 0 raidz1-1 ONLINE 0 0 0 da3 ONLINE 0 0 0 da0 ONLINE 0 0 0 da2 ONLINE 0 0 0 da1 ONLINE 0 0 0 raidz1-2 ONLINE 0 0 0 aacd0 ONLINE 0 0 0 aacd1 ONLINE 0 0 0 aacd2 ONLINE 0 0 0 aacd3 ONLINE 0 0 0 raidz1-4 ONLINE 0 0 0 aacd4 ONLINE 0 0 0 aacd5 ONLINE 0 0 0 aacd6 ONLINE 0 0 0 aacd7 ONLINE 0 0 0 logs 15752248745115926170 UNAVAIL 0 0 0 was /dev/ada2 errors: 3 data errors, use '-v' for a list Here is the ending output of zpool history: 2011-12-05.03:38:50 zpool upgrade -V 28 -a 2011-12-05.03:39:09 zpool export share 2011-12-05.03:39:33 zpool import -m share 2011-12-05.03:40:05 zpool remove share 15752248745115926170 2011-12-05.03:41:04 zpool remove share 15752248745115926170 2011-12-05.03:41:18 zpool export share 2011-12-05.03:41:56 zpool import -m share 2011-12-05.03:43:47 zpool remove share 15752248745115926170 2011-12-05.03:47:54 zpool remove share 15752248745115926170 2011-12-05.03:51:20 zpool scrub share 2011-12-05.16:33:01 zfs create share/vardb2 2011-12-05.16:33:32 zfs set compression=3Dgzip-9 share/vardb2 2011-12-05.16:33:38 zfs set atime=3Doff share/vardb2 2011-12-05.16:39:37 zfs destroy share/vardb 2011-12-05.16:39:47 zfs rename share/vardb2 share/vardb 2011-12-05.16:39:53 zfs set mountpoint=3D/var/db share/vardb 2011-12-05.16:47:24 zpool clear share 2011-12-05.16:48:41 zpool remove share 15752248745115926170 2011-12-05.16:53:15 zpool export -f share 2011-12-05.16:55:21 zpool import -m share 2011-12-05.16:55:52 zpool remove share 15752248745115926170 2011-12-05.16:56:56 zpool remove share -f 15752248745115926170 2011-12-05.17:04:07 zpool remove share 15752248745115926170 What is going on here and how do I fix it? =20 --=20 Adam Stylinski PGP Key: http://pohl.ececs.uc.edu/~adam/publickey.pub Blog: http://technicallyliving.blogspot.com --M9NhX3UHpAaciwkO Content-Type: application/pgp-signature -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.18 (FreeBSD) iQIcBAEBAgAGBQJO3UCRAAoJED6sRHE6Tvmn8rMQAK2UnDYK3K9EIEr4j1l065dl RWBj4mNPfq53L0wUcKyJwlWAdENnwX2XPxds79vfaskIqbfm8d54ooSD6Xq8MxTk vY+O5DWHGYu2aSedIK1UPrhQy7yoH42/h4GREqTC/XpdKjWXdTlBaX7m3d9e4Eu5 GZg32LtbVrNymm4fZ2tId3g+o312NTRt4zpaqZR9a3C/sYGrBhw2G5gTUGUl9JIQ EQwZhEXDUvILh2aeO7kM1vUtDHkeq2HzUu0am0QxkWmUlkL9a3NkVt+97kwUQTvg ymAF8+Um6OtBP1029N5YMEyLhmZIAEtSg/88dFMMlzD2ZwBkyVTMJ/9s3V7FLcPQ KkfVdmrbIoniO+NJ9nIiXRHlH2Ta/qkFFf7M/1TMKO0SD2uy4GyiH3IENCTxlJ0K 6rbJrSNZGTv0F97nnhpaouY6cLG8R386ijYOCc1B3LvaFIV1H8L79hFhVyiioTA1 jMWvYsnYGNeC/UruI3k7QcxMBAq1xvyR64MCYx6l+j/Bxf/r4utwdG7SOLYoZtEW N6eI6mpnkYbwiHRbS0rqXvHc4rbuoxxc75qnChM7s2f4z1velZXIBuvKZhYBoVR7 li3mckdnVf9XGMtsD6KMX6tblaGPmKjNwiaOAMwwHbL9mJcFyE109nKYK180u7b/ ORm5/yTbnbRvjR3frLSw =ymyG -----END PGP SIGNATURE----- --M9NhX3UHpAaciwkO--