From owner-freebsd-fs@FreeBSD.ORG Wed Sep 1 20:30:40 2010 Return-Path: <owner-freebsd-fs@FreeBSD.ORG> Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 4F3E710656D3; Wed, 1 Sep 2010 20:30:40 +0000 (UTC) (envelope-from jhellenthal@gmail.com) Received: from mail-qy0-f175.google.com (mail-qy0-f175.google.com [209.85.216.175]) by mx1.freebsd.org (Postfix) with ESMTP id 667E18FC1D; Wed, 1 Sep 2010 20:30:39 +0000 (UTC) Received: by qyk31 with SMTP id 31so1152589qyk.13 for <multiple recipients>; Wed, 01 Sep 2010 13:30:38 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:sender:message-id:date:from :user-agent:mime-version:to:cc:subject:references:in-reply-to :x-enigmail-version:content-type:content-transfer-encoding; bh=uzcSJllXdxoIPDxmhQ3qAz4zhB30v+bumkY0A1GZ6MQ=; b=iFDYkC1zH/XcKhJYQCnkTzsp64S783bZsURts4jslPoVw47ICVHZaBK7bsVUfLqI0Y hcz+uRvMdYl8/K19puWANHeuMMlBQHsgP3zDVq1b4iZU8G1HvK00OqlAcD1PoVxDgtmV TuNAa5mSlayyiXG+A1fQgTSQuqCqwxcuYxTc0= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=sender:message-id:date:from:user-agent:mime-version:to:cc:subject :references:in-reply-to:x-enigmail-version:content-type :content-transfer-encoding; b=XhWr8Kt96LPfzXK32X5Nqs+XoeTUjAmXRY5Y7gXBmMgxUPaBpUslQEF7IBpplIY6sK tefOEy1fRZOHycg0n3nR5E9L0NkdTD5t5nLvs9hnZnp89o1zpJXZ9MgMnSmNwrFfP6kv kjZkqcRTF8LfXbOwrTzS8l1wcKBoDW3Pz5sbA= Received: by 10.229.231.4 with SMTP id jo4mr6025969qcb.22.1283373038606; Wed, 01 Sep 2010 13:30:38 -0700 (PDT) Received: from centel.dataix.local ([99.181.137.20]) by mx.google.com with ESMTPS id q8sm11534397qcs.12.2010.09.01.13.30.36 (version=SSLv3 cipher=RC4-MD5); Wed, 01 Sep 2010 13:30:37 -0700 (PDT) Sender: "J. Hellenthal" <jhellenthal@gmail.com> Message-ID: <4C7EB7EB.8070206@DataIX.net> Date: Wed, 01 Sep 2010 16:30:35 -0400 From: jhell <jhell@DataIX.net> User-Agent: Mozilla/5.0 (X11; U; FreeBSD i386; en-US; rv:1.9.2.8) Gecko/20100806 Lightning/1.0b1 Thunderbird MIME-Version: 1.0 To: Pawel Jakub Dawidek <pjd@freebsd.org> References: <20100831215915.GE1932@garage.freebsd.pl> In-Reply-To: <20100831215915.GE1932@garage.freebsd.pl> X-Enigmail-Version: 1.1.2 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Cc: freebsd-fs@freebsd.org, freebsd-current@freebsd.org Subject: Re: ZFS v28 is ready for wider testing. X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems <freebsd-fs.freebsd.org> List-Unsubscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-fs>, <mailto:freebsd-fs-request@freebsd.org?subject=unsubscribe> List-Archive: <http://lists.freebsd.org/pipermail/freebsd-fs> List-Post: <mailto:freebsd-fs@freebsd.org> List-Help: <mailto:freebsd-fs-request@freebsd.org?subject=help> List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-fs>, <mailto:freebsd-fs-request@freebsd.org?subject=subscribe> X-List-Received-Date: Wed, 01 Sep 2010 20:30:40 -0000 -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On 08/31/2010 17:59, Pawel Jakub Dawidek wrote: > Hello. > > I'd like to give you ZFS v28 for testing. If you are neither brave nor > mad, you can stop here. > > The patchset is very experimental. It can eat your cookie and hurt your > teddy bear, so be warned. Don't try it for anything except testing. > > This patchset is also a message we, as the FreeBSD project, would like > to send to our users: Eventhough OpenSolaris is dead, the ZFS file > system is going to stay in FreeBSD. At this point we have quite a few > developers involved in ZFS on FreeBSD as well as serveral companies. > We are also looking forward to work with IllumOS. > > So, what this new ZFS brings? > > - Data deduplication. Read more here: > > http://blogs.sun.com/bonwick/entry/zfs_dedup > > - Triple parity RAIDZ (RAIDZ3). Read more here: > > http://dtrace.org/blogs/ahl/2009/07/21/triple-parity-raid-z/ > > - zfs diff. Read more here: > > http://arc.opensolaris.org/caselog/PSARC/2010/105/20100328_tim.haley > > - zpool split. Read more here: > > http://arc.opensolaris.org/caselog/PSARC/2009/511/20090924_mark.musante > > - Snapshot holds. Read more here: > > http://arc.opensolaris.org/caselog/PSARC/2009/297/20090511_chris.kirby > > - zpool import -F. Allows to rewind corrupted pool to earlier > transaction group. > > - Possibility to import pool in read-only mode. > > And much, much more, including plenty of preformance improvements and bug > fixes. > > So test whatever you can and report back. Look for regressions, strange > behaviour, missing features, deadlocks, livelocks, preformance > degradation, etc. > > The boot code is not updated at all, so booting off of ZFS doesn't > currently work. > > The patch is against today's FreeBSD HEAD. > > The patch enables (in sys/modules/zfs/Makefile) ZFS internal debugging, > please don't turn it off. Also, compile your kernel with the following > options: > > options KDB > options DDB > options INVARIANTS > options INVARIANT_SUPPORT > options WITNESS > options WITNESS_SKIPSPIN > options DEBUG_LOCKS > options DEBUG_VFS_LOCKS > > Ignore all the LOR (Lock Order Reversal) reports from WITNESS. There will > be plenty of those, and you'll desperately want to report them, but please > don't. > > The best way to report a problem is to answer to this e-mail with as short > as possible procedure of how to reproduce it and debugging info. I'd > prefer textdump if possible. Below you can find quick procedure how to > setup textdumps: > > Choose spare/swap disk/partition in your system, let's say it is > /dev/ad0s1b. > > Add the following line to /etc/fstab: > > /dev/ad0s1b none swap sw 0 0 > > Add the following line to /etc/rc.conf: > > ddb_enable="YES" > > Run the following commands: > > # /etc/rc.d/swap1 start > # /etc/rc.d/dumpon start > # /etc/rc.d/ddb start > > This will setup swap, mark it as dump device and setup some DDB > scripts. Or you can just reboot. > > Now when your system panic or deadlock, enter DDB and call the > following command: > > ddb> run kdb.enter.panic > > It will execute all the commands I need, dump them in text format to > your swap device and reboot machine. > > After the reboot, you should find textdump.tar.0 file in /var/crash/ > directory. This is the debug info I need. > > End of textdumps procedure. > > Ok, now that I know you read everything carefully, here is the patch: > > http://people.freebsd.org/~pjd/patches/zfs_20100831.patch.bz2 > > Good luck! >:> > 293 files changed, 54587 insertions(+), 19525 deletions(-) Yikes! I certainly commend you for this work. As for how to explain it I do not think the words exist in the English dictionary. Though it is unlikely that I will be attempting to use this ATM I logged some things for giggles. http://bit.ly/d20tML At that URL you will find a patch.log reject-files.log and a directory 'reject-files' with non-other than the reject files from the patch tar & bzip2'd for convenience. Just for being curious & found out that only 14 of the 293 files that were changed had rejects against a stable/8 that was patched to ZFSv15 + metaslab_v2 + abe_stat_rrwlock. My Hats off to the developers and everyone involved with keeping this all together, it says A LOT!. This is impressive. Not to mention this easily read and understandable email to top it off. Regards! - -- Again here is the link: http://bit.ly/d20tML jhell,v -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.16 (FreeBSD) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/ iQEcBAEBAgAGBQJMfrfqAAoJEJBXh4mJ2FR+gscH/3tXKOTa2/eVt5Ev9ovpEbS3 n3EiMe6b8G8jxWaynoccNFWi6IywTzDhuKQxM/o4I1RnUJe50fSF00IQqwVo3QDm rcju0RKFw6jFgLar+1qq2prssAWQZ4DLC9VQY5CxZ/NY6MgEoWWqaV91RkOqLu5a /4VrvnvkkNhF7Q8Wni3tljAKTw4OFo3thuft5AxsBhecnF+ghCsr9Ne7xFPA6sl0 x6tx9p1p4sTBhSy1/oIBDt16mD/6O9FPVdme7lCvhUtPY7mtlANIYM1GLPMDlu6p iKyzxJOx7veBH0cb3VPkWvd8quItwMIZj/EbS9vTORUEEq0OtTZeZMNVc/nJsX4= =PIN+ -----END PGP SIGNATURE-----