From owner-freebsd-current@FreeBSD.ORG Tue Jan 27 03:41:06 2009 Return-Path: Delivered-To: freebsd-current@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 524721065673 for ; Tue, 27 Jan 2009 03:41:06 +0000 (UTC) (envelope-from terry@tmk.com) Received: from server.tmk.com (server.tmk.com [204.141.35.63]) by mx1.freebsd.org (Postfix) with ESMTP id 2A5898FC19 for ; Tue, 27 Jan 2009 03:41:06 +0000 (UTC) (envelope-from terry@tmk.com) Received: from tmk.com by tmk.com (PMDF V6.3-x13 #37010) id <01N4RMHR8MWG00FK2Q@tmk.com> for freebsd-current@freebsd.org; Mon, 26 Jan 2009 22:41:04 -0500 (EST) Date: Mon, 26 Jan 2009 22:27:15 -0500 (EST) From: Terry Kennedy In-reply-to: "Your message dated Sun, 25 Jan 2009 14:57:49 +1100" <6FE15EE8-19C2-4AEE-8F3D-D7A453A5D201@ish.com.au> Sender: Terry Kennedy To: freebsd-current@freebsd.org Message-id: <01N4RNVS3TDW00FK2Q@tmk.com> MIME-version: 1.0 Content-type: TEXT/PLAIN; CHARSET=us-ascii; format=flowed; delsp=yes References: <01N4NEOEB7LY00EQWX@tmk.com> Cc: Aristedes Maniatis Subject: Re: Help me select hardware and software options for very large server X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 27 Jan 2009 03:41:06 -0000 > > I think this system may have the most storage ever configured on a > > FreeBSD system, and it is probably up near the top in terms of CPU and > > memory. > > I doubt it. 8 core systems are very common these days. I've seen > benchmarking with anything up to 64 cores (which I believe is the > current FreeBSD limit). As for memory, there was a recent thread with > someone installing 64Gb also claiming theirs was the biggest, but > others insisting that it certainly wasn't. As for storage, I know Sun > sell systems into the petabyte range which I assume these days are > powered by ZFS. > > The above is not to belittle your project; more to reassure you that > you aren't anywhere near the limits and you should have no troubles if > you tune things properly. Regarding storage, while there are other ZFS deployments (particularly on Sun equipment) which are a lot larger, I haven't seen any discussion of pools of this size on FreeBSD. And I have been keeping an eye on the FreeBSD ZFS discussions. That isn't to say that nobody has one, but if they do, they're keeping pretty quiet about it... Part of the reason for rolling my own is the fun I get from it - other- wise I could just buy a pre-configured Sun / NetApp / whatever box. It is good to know that my CPU / memory choices aren't pushing any limits in FreeBSD. I still think they're probably in the 95th percentile, size-wise. I've always been a bit careful about sizing at the top end - back when I was using BSD/OS, I'd run into problems with configurations with more than a certain amount of memory failing in subtle (and not-so-subtle) ways. I'm sure that people have experimented enough to find the upper limits, at least for quick testing. This is particularly common among hardware vendors and integrators, since they have all those parts sitting around waiting - years ago, I did such a test on a DEC system that shipped with 16MB memory standard and 64MB max. I loaded it up with 768MB to see what would happen (it worked). I'm also the guy that once set up a demo Cisco 2511 with full BGP tables (now *that* was a hack 8-). Terry Kennedy http://www.tmk.com terry@tmk.com New York, NY USA