From owner-freebsd-fs@FreeBSD.ORG  Mon Feb  6 17:35:01 2012
Return-Path: <owner-freebsd-fs@FreeBSD.ORG>
Delivered-To: freebsd-fs@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34])
	by hub.freebsd.org (Postfix) with ESMTP id 163151065672
	for <freebsd-fs@freebsd.org>; Mon,  6 Feb 2012 17:35:01 +0000 (UTC)
	(envelope-from daniel@digsys.bg)
Received: from smtp-sofia.digsys.bg (smtp-sofia.digsys.bg [193.68.3.230])
	by mx1.freebsd.org (Postfix) with ESMTP id 91CFA8FC17
	for <freebsd-fs@freebsd.org>; Mon,  6 Feb 2012 17:35:00 +0000 (UTC)
Received: from digsys226-136.pip.digsys.bg (digsys226-136.pip.digsys.bg
	[193.68.136.226]) (authenticated bits=0)
	by smtp-sofia.digsys.bg (8.14.5/8.14.5) with ESMTP id q16HYn5J038404
	(version=TLSv1/SSLv3 cipher=AES128-SHA bits=128 verify=NO);
	Mon, 6 Feb 2012 19:34:55 +0200 (EET) (envelope-from daniel@digsys.bg)
Mime-Version: 1.0 (Apple Message framework v1257)
Content-Type: text/plain; charset=us-ascii
From: Daniel Kalchev <daniel@digsys.bg>
In-Reply-To: <4F300CEA.5000901@fuckner.net>
Date: Mon, 6 Feb 2012 19:34:49 +0200
Content-Transfer-Encoding: quoted-printable
Message-Id: <413B1A6F-B076-4F50-90EA-7E17CF4B6E36@digsys.bg>
References: <4F2FF72B.6000509@pean.org> <20120206162206.GA541@icarus.home.lan>
	<CAOjFWZ44nP5MVPgvux=Y-x+T+By-WWGVyuAegJYrv6mLmmaN-w@mail.gmail.com>
	<4F300CEA.5000901@fuckner.net>
To: Michael Fuckner <michael@fuckner.net>
X-Mailer: Apple Mail (2.1257)
Cc: freebsd-fs@freebsd.org
Subject: Re: HPC and zfs.
X-BeenThere: freebsd-fs@freebsd.org
X-Mailman-Version: 2.1.5
Precedence: list
List-Id: Filesystems <freebsd-fs.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-fs>,
	<mailto:freebsd-fs-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-fs>
List-Post: <mailto:freebsd-fs@freebsd.org>
List-Help: <mailto:freebsd-fs-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-fs>,
	<mailto:freebsd-fs-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Mon, 06 Feb 2012 17:35:01 -0000


On Feb 6, 2012, at 7:24 PM, Michael Fuckner wrote:

> Another thing to think about is CPU: you probably need weeks for a =
rebuild of a single disk in a Petabyte Filesystem- I haven't tried this =
with ZFS yet, but I'm really interested if anyone already did this.

This is where ZFS will shine. Depending on how you stripe disks, you can =
either get super fast resilver (if you go for stripe of mirrors), to =
fast (if you go for small number of disks raidz) to reasonable (if you =
of for large number of disks raidz). If you need high TPS you will want =
to go with mirrors anyway.

The thing is doable with commodity hardware, but I wonder how one ever =
backups such setup?

Daniel=