From owner-freebsd-fs@freebsd.org Sat Sep 26 05:43:27 2015 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 0131CA08F00 for ; Sat, 26 Sep 2015 05:43:27 +0000 (UTC) (envelope-from pekka.jarvinen@gmail.com) Received: from mail-io0-x235.google.com (mail-io0-x235.google.com [IPv6:2607:f8b0:4001:c06::235]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id D0B16190B for ; Sat, 26 Sep 2015 05:43:26 +0000 (UTC) (envelope-from pekka.jarvinen@gmail.com) Received: by iofh134 with SMTP id h134so130685266iof.0 for ; Fri, 25 Sep 2015 22:43:26 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :content-type; bh=CbcxEKmvlPp8yGQanG+/TCqBFIBD282Br1GPnkyvUUY=; b=vcdM8Wf+Z1U9mRIKHesWSZMCUwDxTy7Jf9Fk50QcKjCMqDbBPdm7Dnxre4ZrOymJtT xUzBHg2luvxDnW/imaKar+510Y9d8R0Fu61oHAwgHVnNwr1CMIBiTD2cEO3ZeqpXirN+ uVoTkdprDMgIJ72MRsRcao4/JsFzLxN1zuB/zav9mfPe+dugmdwz46rxIed/G8Ktb/Ng MplvjxyjFXRFx7s6jS7Q6lhqQqQrIdWJDIkGny1CLRU7ttqxZ7+BrbrgnQTW4mTagm86 1k33QCDLyYc9oMQuTwPV501MQHLzNytDVtGCGSg9u20lsSSonqglQtfFW6IVUQw+ndEt 6IDQ== X-Received: by 10.107.30.12 with SMTP id e12mr9644298ioe.57.1443246206093; Fri, 25 Sep 2015 22:43:26 -0700 (PDT) MIME-Version: 1.0 Received: by 10.79.92.6 with HTTP; Fri, 25 Sep 2015 22:42:56 -0700 (PDT) In-Reply-To: <20150926035218.GF3478@server.rulingia.com> References: <20150926035218.GF3478@server.rulingia.com> From: =?UTF-8?Q?Pekka_J=C3=A4rvinen?= Date: Sat, 26 Sep 2015 08:42:56 +0300 Message-ID: Subject: Re: Missing free space from new raidz2 zpool To: freebsd-fs@freebsd.org Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.20 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 26 Sep 2015 05:43:27 -0000 I installed FreeBSD-10.2-STABLE-amd64-20150917-r287929-memstick.img and it gives 28.1T free. So possibly a bug in FreeBSD 10.2-RELEASE-p2 #0 r287260M. I created bug report https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D203330 I also tried with OpenIndiana's ZFS implementation with same machine and it gives 28.5T free and lists drives as 8001.49GB. 2015-09-26 6:52 GMT+03:00 Peter Jeremy : > On 2015-Sep-24 19:36:50 +0300, Pekka J=C3=A4rvinen > wrote: > >I bought 6 new 8 TB drives and created new raidz2 pool with these drives= . > > > >My question is why zfs list and df is only showing 14.5T free? Shouldn't > it > >be more close to 30T? Or is that old zfs metadata somehow lurking around > >and zfs is reading that? Bug? > > Your pool seems to be sized correctly but the filesystem can't see all > the space. If you're concerned about old metadata, destroy your new > pool and then dd zeroes over the first and last few MB of each drive - > which is where ZFS stores its metadata: > > for i in /dev/ada{0,1,2,3,4,5};do > dd if=3D/dev/zero of=3D$i bs=3D64k count=3D32 > dd if=3D/dev/zero of=3D$i bs=3D64k oseek=3D122094000 > done > > ># zpool iostat storage2 > > capacity operations bandwidth > >pool alloc free read write read write > >---------- ----- ----- ----- ----- ----- ----- > >storage2 900K 43.5T 0 1 0 7.84K > > The 43.5T looks correct. "zpool list" would be a better command. > > ># zdb storage2 > > > >Cached configuration: > ... > > asize: 48009350479872 > ... > >MOS Configuration: > ... > > asize: 48009350479872 > > That's also correct. > > As an experiment, I simulated your configuration: > # cd /tmp > # mkdir zfs > # cd zfs > # for i in 0 1 2 3 4 5;do truncate -s 7814026584k d$i;done > # zpool create storage2 raidz2 /tmp/zfs/d? > # zpool list storage2 > NAME SIZE ALLOC FREE EXPANDSZ FRAG CAP DEDUP HEALTH > ALTROOT > storage2 43.5T 165K 43.5T - 0% 0% 1.00x ONLINE - > # zfs list storage2 > NAME USED AVAIL REFER MOUNTPOINT > storage2 88.9K 28.1T 32.0K /storage2 > # zfs get all storage2 > NAME PROPERTY VALUE SOURCE > storage2 type filesystem - > storage2 creation Sat Sep 26 13:31 2015 - > storage2 used 88.9K - > storage2 available 28.1T - > storage2 referenced 32.0K - > storage2 compressratio 1.00x - > storage2 mounted yes - > ... > > -- > Peter Jeremy > --=20 Pekka J=C3=A4rvinen