Date: Wed, 08 Feb 2012 20:05:53 +0100 From: "Ronald Klop" <ronald-freebsd8@klop.yi.org> To: freebsd-fs@freebsd.org, =?utf-8?Q?Peter_Ankerst=C3=A5l?= <peter@pean.org> Subject: Re: HPC and zfs. Message-ID: <op.v9djb3iw8527sy@212-182-167-131.ip.telfort.nl> In-Reply-To: <4F2FF72B.6000509@pean.org> References: <4F2FF72B.6000509@pean.org>
next in thread | previous in thread | raw e-mail | index | archive | help
On Mon, 06 Feb 2012 16:52:11 +0100, Peter Ankerst=C3=A5l <peter@pean.org>= wrote: > Hi, > > I want to investigate if it is possible to create your own usable HPC =20 > storage using zfs and some > network filesystem like nfs. > > Just a thought experiment.. > A machine with 2 6 core XEON, 3.46Ghz 12MB and 192GB of ram (or more) > I addition the machine will use 3-6 SSD drives for ZIL and 3-6 SSD =20 > deives for cache. > Preferrably in mirror where applicable. > > Connected to this machine we will have about 410 3TB drives to give =20 > approx > 1PB of usable storage in a 8+2 raidz configuration. > > Connected to this will be a ~800 nodes big HPC cluster that will access= =20 > the storage in parallell > is this even possible or do we need to distribute the meta data load =20 > over many servers? If that is the case, > does it exist any software for FreeBSD that could accomplish this =20 > distribution (pNFS dosent seem to be > anywhere close to usable in FreeBSD) or do I need to call NetApp or =20 > Panasas right away? It would be > really nice if I could build my own storage solution. > > Other possible solutions to this problem is extremley welcome. > > Best Regards > Peter Ankerst=C3=A5l You might make a call to Backblaze. http://blog.backblaze.com/2009/09/01/petabytes-on-a-budget-how-to-build-c= heap-cloud-storage/ Ronald.
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?op.v9djb3iw8527sy>