From owner-freebsd-hardware@FreeBSD.ORG Tue Dec 11 23:19:04 2007 Return-Path: Delivered-To: freebsd-hardware@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id D564916A419 for ; Tue, 11 Dec 2007 23:19:04 +0000 (UTC) (envelope-from carlsonmark@gmail.com) Received: from wr-out-0506.google.com (wr-out-0506.google.com [64.233.184.233]) by mx1.freebsd.org (Postfix) with ESMTP id 9EA0213C447 for ; Tue, 11 Dec 2007 23:19:04 +0000 (UTC) (envelope-from carlsonmark@gmail.com) Received: by wr-out-0506.google.com with SMTP id 68so1815wra.13 for ; Tue, 11 Dec 2007 15:19:04 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; bh=IDwiOK5aKxH+uywKcc1HFHnxFr5CR7fUZ/54edED8KU=; b=juIUzSAJYUVFwjkpdC3X32oPV3L2s50dJriIjyq5y5bprjpYqwxkizkaap6ajqwHEAZIO+eYxz7BxgGZBq00GwZc9hVHtfal+ptyILtmtIyDy8cegK1Gxo18xbEjPBEAkS3cNvzdn4txWXCshbaoCQwjzv2GY5XeO0J6ITjINNA= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; b=Lcx9qxyRCK1P8pwrjGD/slHIInRSPUiuuy7Ir9YhDTxMtwPkt5KSryip3aiz4N9tFzNFfMz6N+PGgR1KR7hIvVf3D1FTLHAr8EvndXiMKtxKf5y/3h/gPa4NuUa3Kr5MAZH2K6vITPHd6ZGJFyTQEofFN2kyGg/ru1JPbITwlCk= Received: by 10.142.216.9 with SMTP id o9mr1546291wfg.1197413578724; Tue, 11 Dec 2007 14:52:58 -0800 (PST) Received: by 10.142.112.12 with HTTP; Tue, 11 Dec 2007 14:52:58 -0800 (PST) Message-ID: Date: Tue, 11 Dec 2007 15:52:58 -0700 From: "Mark Carlson" To: "Ivan Voras" In-Reply-To: MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline References: <475D7866.1070803@hangwithme.com> <475D7D60.4040701@fuckner.net> Cc: freebsd-fs@freebsd.org, freebsd-hardware@freebsd.org Subject: Re: large disk > 8 TB X-BeenThere: freebsd-hardware@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: General discussion of FreeBSD hardware List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 11 Dec 2007 23:19:04 -0000 On 12/11/07, Ivan Voras wrote: > Michael Fuckner wrote: > > Lan Tran wrote: > >> I have a Dell PERC 6/E controller connected to an external Dell MD1000 > >> storage, which I set up RAID 6 for. The RAID BIOS reports 8.5 TB. I > >> installed 7BETA4 amd64 and Sysinstall/dmesg.boot detects this correctly: > >> mfid1: on mfi1 > >> mfid1: 8578560MB (17568890880 sectors) RAID volume 'raid6' is optimal" > >> > >> However, after I created a zfs zpool on this device it only shows 185 > >> GB. # zpool create tank /dev/mfid1s1d > >> # zpool list > >> NAME SIZE USED AVAIL CAP HEALTH ALTROOT > >> tank 185G 111K 185G 0% ONLINE - > >> > >> also with 'dh': > >> # df -h tank > >> Filesystem Size Used Avail Capacity Mounted on > >> tank 182G 0B 182G 0% /tank > >> > > > > The main purpose of ZFS is doing Software raid (which is even faster > > than HW Raid nowadays). > > > > You should export all disks seperately to the OS- and then you don't > > have the 4GB limit wrapping the size to 185GB. > > This is the wrong way around. Why would something wrap drive sizes at a > 32-bit limit? The driver and the GEOM systems are 64-bit clean, if this > is a problem in ZFS, it's a serious one. > > I don't have the drive capacity to create a large array, but I assume > someone has tested ZFS on large arrays (Pawel?) If there is a bug here, I'm not sure people will see it for a while in practice. I mean, who is using hardware raid to create a 8.5GB "disk" then create a zpool with that one "disk"? In this case, it appears there was some misconfiguration that has been remedied: hardware raid seems to have been disabled now, and all the disks are exported seperately to create a zpool with, resulting in success. > Can you run "diskinfo -v " on the large array (the 8.5 TB one) and > verify the system sees it all?