From owner-freebsd-fs@freebsd.org Fri Oct 18 09:35:58 2019 Return-Path: Delivered-To: freebsd-fs@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 9085F14B71E for ; Fri, 18 Oct 2019 09:35:58 +0000 (UTC) (envelope-from gerrit.kuehn@aei.mpg.de) Received: from mailgate2.uni-hannover.de (mailgate2.uni-hannover.de [130.75.2.114]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 46vgrY5Xjbz4M60 for ; Fri, 18 Oct 2019 09:35:57 +0000 (UTC) (envelope-from gerrit.kuehn@aei.mpg.de) Received: from intranet.aei.uni-hannover.de (ahin1.aei.uni-hannover.de [130.75.117.40]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mailgate2.uni-hannover.de (Postfix) with ESMTPS id 63B4B10C0 for ; Fri, 18 Oct 2019 11:35:55 +0200 (CEST) Received: from arc.aei.uni-hannover.de ([130.75.117.1]) by intranet.aei.uni-hannover.de (IBM Domino Release 9.0.1FP8) with ESMTP id 2019101811355442-2136 ; Fri, 18 Oct 2019 11:35:54 +0200 Date: Fri, 18 Oct 2019 11:35:54 +0200 From: Gerrit =?UTF-8?B?S8O8aG4=?= To: freebsd-fs Subject: zfs capacity Message-ID: <20191018113554.4f5822e3@arc.aei.uni-hannover.de> Organization: Albert-Einstein-Institut X-Mailer: Claws Mail 3.17.3 (GTK+ 2.24.32; amd64-portbld-freebsd11.2) MIME-Version: 1.0 X-MIMETrack: Itemize by SMTP Server on intranet/aei-hannover(Release 9.0.1FP8|February 23, 2017) at 18/10/2019 11:35:54, Serialize by Router on intranet/aei-hannover(Release 9.0.1FP8|February 23, 2017) at 18/10/2019 11:35:54, Serialize complete at 18/10/2019 11:35:54 X-TNEFEvaluated: 1 Content-Transfer-Encoding: 7bit Content-Type: text/plain; charset=US-ASCII X-Rspamd-Queue-Id: 46vgrY5Xjbz4M60 X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=none (mx1.freebsd.org: domain of gerrit.kuehn@aei.mpg.de has no SPF policy when checking 130.75.2.114) smtp.mailfrom=gerrit.kuehn@aei.mpg.de X-Spamd-Result: default: False [-0.65 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.40)[-0.403,0]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-0.96)[-0.964,0]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; DMARC_NA(0.00)[mpg.de]; AUTH_NA(1.00)[]; RCPT_COUNT_ONE(0.00)[1]; HAS_ORG_HEADER(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; IP_SCORE(0.02)[asn: 680(0.11), country: DE(-0.01)]; TO_DN_ALL(0.00)[]; RCVD_IN_DNSWL_MED(-0.20)[114.2.75.130.list.dnswl.org : 127.0.11.2]; R_SPF_NA(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:680, ipnet:130.75.0.0/16, country:DE]; RCVD_TLS_LAST(0.00)[] X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 18 Oct 2019 09:35:58 -0000 Hi, I just tried these two raidz2 setups with 36 disks: 3x 10+2, 4x 7+2. The result is a bit puzzling for me, because I get the same capacity, although one setup is using 6 drives for redundancy, the other is using 8: --- root@pt-storage2:~ # zpool create data raidz2 gpt/disk-00 gpt/disk-01 gpt/disk-02 gpt/disk-03 gpt/disk-04 gpt/disk-05 gpt/disk-06 gpt/disk-07 gpt/disk-08 gpt/disk-09 gpt/disk-10 gpt/disk-11 raidz2 gpt/disk-12 gpt/disk-13 gpt/disk-14 gpt/disk-15 gpt/disk-16 gpt/disk-17 gpt/disk-18 gpt/disk-19 gpt/disk-20 gpt/disk-21 gpt/disk-22 gpt/disk-23 raidz2 gpt/disk-24 gpt/disk-25 gpt/disk-26 gpt/disk-27 gpt/disk-28 gpt/disk-29 gpt/disk-30 gpt/disk-31 gpt/disk-32 gpt/disk-33 gpt/disk-34 gpt/disk-35 root@pt-storage2:~ # zfs list NAME USED AVAIL REFER MOUNTPOINT data 695K 241T 201K /data root@pt-storage2:~ # zpool create data raidz2 gpt/disk-00 gpt/disk-01 gpt/disk-02 gpt/disk-03 gpt/disk-04 gpt/disk-05 gpt/disk-06 gpt/disk-07 gpt/disk-08 raidz2 gpt/disk-09 gpt/disk-10 gpt/disk-11 gpt/disk-12 gpt/disk-13 gpt/disk-14 gpt/disk-15 gpt/disk-16 gpt/disk-17 raidz2 gpt/disk-18 gpt/disk-19 gpt/disk-20 gpt/disk-21 gpt/disk-22 gpt/disk-23 gpt/disk-24 gpt/disk-25 gpt/disk-26 raidz2 gpt/disk-27 gpt/disk-28 gpt/disk-29 gpt/disk-30 gpt/disk-31 gpt/disk-32 gpt/disk-33 gpt/disk-34 gpt/disk-35 root@pt-storage2:~ # zfs list NAME USED AVAIL REFER MOUNTPOINT data 695K 241T 201K /data --- These are 10TB drives, so the numbers for the 3 vdev setup appear to be way too low. Any ideas what is going on there? cu Gerrit