From owner-freebsd-questions@FreeBSD.ORG Thu Sep 19 14:55:06 2013 Return-Path: Delivered-To: freebsd-questions@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTP id 59EA3E50 for ; Thu, 19 Sep 2013 14:55:06 +0000 (UTC) (envelope-from freebsd-questions@m.gmane.org) Received: from plane.gmane.org (plane.gmane.org [80.91.229.3]) (using TLSv1 with cipher AES256-SHA (256/256 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 18E722331 for ; Thu, 19 Sep 2013 14:55:05 +0000 (UTC) Received: from list by plane.gmane.org with local (Exim 4.69) (envelope-from ) id 1VMfdH-0007Ai-Je for freebsd-questions@freebsd.org; Thu, 19 Sep 2013 16:55:03 +0200 Received: from 095-097-094-131.static.chello.nl ([95.97.94.131]) by main.gmane.org with esmtp (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Thu, 19 Sep 2013 16:55:03 +0200 Received: from schut by 095-097-094-131.static.chello.nl with local (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Thu, 19 Sep 2013 16:55:03 +0200 X-Injected-Via-Gmane: http://gmane.org/ To: freebsd-questions@freebsd.org From: Vincent Schut Subject: Re: this 48-core box... Date: Thu, 19 Sep 2013 15:53:27 +0200 Organization: SarVision Lines: 44 Message-ID: <20130919155327.115e7344@sarvision.nl> References: <52388C9B.6030205@foxbatcapital.com> Mime-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit X-Complaints-To: usenet@ger.gmane.org X-Gmane-NNTP-Posting-Host: 095-097-094-131.static.chello.nl X-Newsreader: Claws Mail 3.9.2 (GTK+ 2.24.20; x86_64-unknown-linux-gnu) X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 19 Sep 2013 14:55:06 -0000 On Tue, 17 Sep 2013 12:08:43 -0500 Michael Chen wrote: > I'm considering bidding on this 48-core box: > > http://www.ebay.com/itm/Supermicro-A-Server-1042G-TF-1U-H8QG6-4-CPUS-48-cores-2-2Ghz-128GB-RAM-/151119828428?pt=COMP_EN_Servers&hash=item232f7195cc > > Does anyone have experience with it and can I use all the cores? > > Thanks! > _______________________________________________ > freebsd-questions@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-questions > To unsubscribe, send any mail to > "freebsd-questions-unsubscribe@freebsd.org" > I recently bought one like that (48 cores but 'only' 96 Gb ram). It was meant to play a double role as both zfs file server and data processing server (we do lots of satellite image processing), running FreeBSD 9.1. It connects with a SAN and we'll use it to process about 36TB of satellite data in the next months. (In a couple of weeks we will probably have budget to split those roles, and buy a dedicated file server.) After several weeks of tweaking and testing, I can say that: - the zfs/file server part runs without problems - the satellite data processing had problems scaling to all 48 cores, I got max performance when running about 18 processes in parallel, scaling up more would lower the overall performance. However, this (sorry guys) appeared to be a FreeBSD problem, and not a hardware problem. As a test I switched to linux with ZoL (ZFS on Linux), and, though zfs performance is less compared to freebsd, data processing is much much better, like a factor 12 or so. Conclusion: the hardware is alright, however when needed to do lots of heavy calculations on terabytes of data, the combination with FreeBSD appears not ideal. Of course it is you get what you pay for. Decent, OK working hardware, but none of the special handy-dandy features expensive brands will give you. If you don't need them, in my experience it is decent hardware for a good price. regards, Vincent.