From owner-freebsd-questions@FreeBSD.ORG Fri Aug 15 11:56:54 2008 Return-Path: Delivered-To: freebsd-questions@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 031AF1065673 for ; Fri, 15 Aug 2008 11:56:54 +0000 (UTC) (envelope-from wmoran@potentialtech.com) Received: from mail.potentialtech.com (internet.potentialtech.com [66.167.251.6]) by mx1.freebsd.org (Postfix) with ESMTP id 9690C8FC18 for ; Fri, 15 Aug 2008 11:56:53 +0000 (UTC) (envelope-from wmoran@potentialtech.com) Received: from vanquish.ws.pitbpa0.priv.collaborativefusion.com (pr40.pitbpa0.pub.collaborativefusion.com [206.210.89.202]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mail.potentialtech.com (Postfix) with ESMTPSA id 4B6EAEBC0C; Fri, 15 Aug 2008 07:56:52 -0400 (EDT) Date: Fri, 15 Aug 2008 07:57:03 -0400 From: Bill Moran To: Joze Volf Message-Id: <20080815075703.951bacb9.wmoran@potentialtech.com> In-Reply-To: <48A560E1.7080701@ilab.si> References: <48A560E1.7080701@ilab.si> X-Mailer: Sylpheed 2.5.0 (GTK+ 2.12.11; i386-portbld-freebsd7.0) Mime-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit Cc: freebsd-questions@freebsd.org Subject: Re: Large RAID arrays, partitioning X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 15 Aug 2008 11:56:54 -0000 In response to Joze Volf : > > I have a HP DL320s 2U server with 12 500 GB SATA drives and Smart Array P400 RAID controller. The machine will be a video streaming server for a public library. The system I am installing is 7.0-RELEASE, amd64. > > I made 2 RAID6 volumes, one 120GB for the system and one 4.3TB for the streaming media content. The first problem I have encountered is that during installation, the large RAID volume wasn't visible. No problem, because I could install the system to the small 120G volume. > > After the base system installation I decided to delete the large volume using the HP ACU and create a few smaller 1TB volumes, which will hopefully be recognized by the kernel. They were, buth when I ran the fdisk from sysinstall it always reported: > WARNING: A geometry of xxxxxxx/255/32 for da1 is incorrect. Using a more likely geometry. If this geometry is incorrect... That always happens. I don't remember the last time I saw a disk where it _didn't_ complain about that. Don't know the details of what's going on there, but I've never seen it cause a problem. > I was trying to do a few 1TB vinum partitions and tying them together into single concatenated volume (I already did something similar in linux using LVM and it worked great). I had no success. Well, can't help you much if you don't describe what you tried to do here. > Then I searched the web and found this patch http://yogurt.org/FreeBSD/ciss_large.diff and hoped it will resolve the geometry problem. It did not, but one other thing it should do is allow kernel to get da device for an array > 2TB. It did! What version of FreeBSD is this? It looks like this driver has seen significant redesign in 7-STABLE. > I deleted the smaller 1TB volumes and recreated one large 4.3TB RAID volume. The kernel recognized it perfectly as /dev/da1. Great! Then I tried to create a slice using sysintall fdisk and a filesystem using sysinstall label. Nothing but trouble! Again, without any details, not much anyone can do to help. > I searched the web again and found a possible solution to my problem. I used the "newfs -U -O2 /dev/da1" command to create the filesystem directly on the RAID volume. It worked without a problem. Then I mounted /dev/da1 to /var/media and here is the output of "df -h" command: > > Filesystem Size Used Avail Capacity Mounted on > /dev/da0s1a 4.3G 377M 3.6G 9% / > devfs 1.0K 1.0K 0B 100% /dev > /dev/da0s1e 7.7G 12K 7.1G 0% /tmp > /dev/da0s1f 36G 1.6G 31G 5% /usr > /dev/da0s1d 58G 25M 53G 0% /var > /dev/da1 4.3T 4.0K 4.0T 0% /var/media > > Is it somehow bad to make a filesystem directly on a storage device such as disk drive or hardware raid volume? Yes and no. If you use certain type of disk utilities, such as bootable CDs that check disk health and what not, they may get confused by the fact that there is no DOS-style fdisk partition on the disk. Otherwise, it works fine. I frequently do this to make my life simpler (why install partitions when you don't need them?) It also wastes less disk space (although, who cares about a few hundred bytes on a 4T disk). Now that you've got it up and running, I'd be more concerned about making sure your next FreeBSD upgrade will continue to support that sized disk. -- Bill Moran http://www.potentialtech.com