From owner-freebsd-fs@FreeBSD.ORG Sat Jun 22 17:49:10 2013 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by hub.freebsd.org (Postfix) with ESMTP id 3C96219F for ; Sat, 22 Jun 2013 17:49:10 +0000 (UTC) (envelope-from prvs=1885c13778=killing@multiplay.co.uk) Received: from mail1.multiplay.co.uk (mail1.multiplay.co.uk [85.236.96.23]) by mx1.freebsd.org (Postfix) with ESMTP id C08801751 for ; Sat, 22 Jun 2013 17:49:09 +0000 (UTC) Received: from r2d2 ([82.69.141.170]) by mail1.multiplay.co.uk (mail1.multiplay.co.uk [85.236.96.23]) (MDaemon PRO v10.0.4) with ESMTP id md50004466503.msg for ; Sat, 22 Jun 2013 18:48:31 +0100 X-Spam-Processed: mail1.multiplay.co.uk, Sat, 22 Jun 2013 18:48:31 +0100 (not processed: message from valid local sender) X-MDDKIM-Result: neutral (mail1.multiplay.co.uk) X-MDRemoteIP: 82.69.141.170 X-Return-Path: prvs=1885c13778=killing@multiplay.co.uk X-Envelope-From: killing@multiplay.co.uk X-MDaemon-Deliver-To: freebsd-fs@freebsd.org Message-ID: <81EDE2A7D67241DAB985C38662DA57DD@multiplay.co.uk> From: "Steven Hartland" To: "John" , References: <51C5B4EE.3010601@growveg.net> Subject: Re: Dell R710 with PERC H310. GPT issues and hardware raid or ZFS? Date: Sat, 22 Jun 2013 18:48:43 +0100 MIME-Version: 1.0 Content-Type: text/plain; format=flowed; charset="iso-8859-1"; reply-type=original Content-Transfer-Encoding: 7bit X-Priority: 3 X-MSMail-Priority: Normal X-Mailer: Microsoft Outlook Express 6.00.2900.5931 X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2900.6157 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 22 Jun 2013 17:49:10 -0000 ----- Original Message ----- From: "John" To: Sent: Saturday, June 22, 2013 3:30 PM Subject: Dell R710 with PERC H310. GPT issues and hardware raid or ZFS? > Hello list, > > I have a Dell R710 with PERC H310 using hardware raid5 with 4x3TB disks. > I tried installing FreeBSD-10 and it defaulted to a GPT partitioning > scheme. FreeBSD installed OK but, on reboot, it couldn't find the > kernel. I grabbed freebsd-9.1 and it offered me the choice of > partitioning schemes. > > I had to change the partitioning scheme to "BSD partition" I think it's > called, in order to get a bootable install. The problem with this is > that this particular schema can only see about 1TB of space yet there's > about 10TB there. > > Currently, writes are cached on the hardware raid. (Need to tune it up > because I left all settings at their default in the configuration > utility. If it does a lot of writes, it will stall as the buffer fills.) > > I'm happy to let freebsd have this 1TB to itself if I can somehow get it > to seethe other 9TB. The purpose of the server is to run virtual boxes. > > Hard drive array is seen like this: > > mfi0: port 0xfc00-0xfcff mem > 0xddffc000-0xddffffff,0xddf80000-0xddfbffff irq 42 at device 0.0 on pci2 > mfi0: Using MSI > mfi0: Megaraid SAS driver Ver 4.23 > > My questions are: > > 0. which is better? ZFS or hardware raid+UFS2? IMO ZFS. It gives you end to end checksuming, which has saved us more than once, self healing (no need to do a full array level scrub. > 1. should I use ZFS on top of the raid5? Guessing not. You can but I wouldn't advise it, much better to let ZFS have the raw disks. > 2. should I blat the system and change the raid so it's a JBOD, then > make it do zfs? IMO yes. > 3. what other methods can I use to make the existing install see > the rest of the space? Sorry not aware of any. > 4. how come it could not read the kernel when the partitioning scheme > was GPT?Is it because it was raid5 in hardware? Shouldn't be, I've never had an issue booting from GPT installs even with much older Dell machines. I see you have an dell + mfi controller, there was an important FW update released a week or so back do ensure you have that installed or you'll suffer from nasty IO stalls. Regards Steve ================================================ This e.mail is private and confidential between Multiplay (UK) Ltd. and the person or entity to whom it is addressed. In the event of misdirection, the recipient is prohibited from using, copying, printing or otherwise disseminating it or any information contained in it. In the event of misdirection, illegible or incomplete transmission please telephone +44 845 868 1337 or return the E.mail to postmaster@multiplay.co.uk.