From owner-freebsd-current@FreeBSD.ORG Sun Jan 5 15:41:20 2014 Return-Path: Delivered-To: freebsd-current@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 37C9C2CD for ; Sun, 5 Jan 2014 15:41:20 +0000 (UTC) Received: from outpost1.zedat.fu-berlin.de (outpost1.zedat.fu-berlin.de [130.133.4.66]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id B879A1A63 for ; Sun, 5 Jan 2014 15:41:19 +0000 (UTC) Received: from inpost2.zedat.fu-berlin.de ([130.133.4.69]) by outpost.zedat.fu-berlin.de (Exim 4.82) with esmtp (envelope-from ) id <1VzppD-0023LY-TI>; Sun, 05 Jan 2014 16:41:15 +0100 Received: from e179174027.adsl.alicedsl.de ([85.179.174.27] helo=thor.walstatt.dyndns.org) by inpost2.zedat.fu-berlin.de (Exim 4.82) with esmtpsa (envelope-from ) id <1VzppD-000V4x-Oy>; Sun, 05 Jan 2014 16:41:15 +0100 Date: Sun, 5 Jan 2014 16:41:10 +0100 From: "O. Hartmann" To: Adam Vande More Subject: Re: ZFS command can block the whole ZFS subsystem! Message-ID: <20140105164110.44318739@thor.walstatt.dyndns.org> In-Reply-To: References: <20140103130021.30569db4@thor.walstatt.dyndns.org> <20140103171457.0fbf0cd4@telesto> <20140103181622.GA61275@dan.emsphone.com> <20140103202535.6e72eebd@thor.walstatt.dyndns.org> <20140104221004.GA72376@server.rulingia.com> <20140104232642.141402dd@thor.walstatt.dyndns.org> <20140104231426.GC72376@server.rulingia.com> <20140105091138.725ff0c2@thor.walstatt.dyndns.org> Organization: FU Berlin X-Mailer: Claws Mail 3.9.3 (GTK+ 2.24.22; amd64-portbld-freebsd11.0) MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; boundary="Sig_/7IBzDnU/powH9tkn5ef7iuS"; protocol="application/pgp-signature" X-Originating-IP: 85.179.174.27 X-ZEDAT-Hint: A Cc: FreeBSD CURRENT , Peter Jeremy X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 05 Jan 2014 15:41:20 -0000 --Sig_/7IBzDnU/powH9tkn5ef7iuS Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: quoted-printable On Sun, 5 Jan 2014 06:43:18 -0600 Adam Vande More wrote: > On Sun, Jan 5, 2014 at 2:11 AM, O. Hartmann > wrote: >=20 > > On Sun, 5 Jan 2014 10:14:26 +1100 > > Peter Jeremy wrote: > > > > > On 2014-Jan-04 23:26:42 +0100, "O. Hartmann" > > > wrote: > > > >zfs list -r BACKUP00 > > > >NAME USED AVAIL REFER MOUNTPOINT > > > >BACKUP00 1.48T 1.19T 144K /BACKUP00 > > > >BACKUP00/backup 1.47T 1.19T 1.47T /backup > > > > > > Well, that at least shows it's making progress - it's gone from > > > 2.5T to 1.47T used (though I gather that has taken several > > > days). Can you pleas post the result of > > > zfs get all BACKUP00/backup > > > > > > > Here we go: > > > > > > NAME PROPERTY VALUE SOURCE > > BACKUP00/backup type filesystem - > > BACKUP00/backup creation Fr Dez 20 23:17 2013 - > > BACKUP00/backup used 1.47T - > > BACKUP00/backup available 1.19T - > > BACKUP00/backup referenced 1.47T - > > BACKUP00/backup compressratio 1.00x - > > BACKUP00/backup mounted no - > > BACKUP00/backup quota none default > > BACKUP00/backup reservation none default > > BACKUP00/backup recordsize 128K default > > BACKUP00/backup mountpoint /backup local > > BACKUP00/backup sharenfs off default > > BACKUP00/backup checksum sha256 local > > BACKUP00/backup compression lz4 local > > BACKUP00/backup atime on default > > BACKUP00/backup devices on default > > BACKUP00/backup exec on default > > BACKUP00/backup setuid on default > > BACKUP00/backup readonly off default > > BACKUP00/backup jailed off default > > BACKUP00/backup snapdir hidden default > > BACKUP00/backup aclmode discard default > > BACKUP00/backup aclinherit restricted default > > BACKUP00/backup canmount on default > > BACKUP00/backup xattr on default > > BACKUP00/backup copies 1 default > > BACKUP00/backup version 5 - > > BACKUP00/backup utf8only off - > > BACKUP00/backup normalization none - > > BACKUP00/backup casesensitivity sensitive - > > BACKUP00/backup vscan off default > > BACKUP00/backup nbmand off default > > BACKUP00/backup sharesmb on local > > BACKUP00/backup refquota none default > > BACKUP00/backup refreservation none default > > BACKUP00/backup primarycache all default > > BACKUP00/backup secondarycache all default > > BACKUP00/backup usedbysnapshots 0 - > > BACKUP00/backup usedbydataset 1.47T - > > BACKUP00/backup usedbychildren 0 - > > BACKUP00/backup usedbyrefreservation 0 - > > BACKUP00/backup logbias latency default > > BACKUP00/backup dedup on local > > >=20 > As already described by Dan and perhaps not followed up on: dedup > requires at very large amount of memory. Assuming 32GB is sufficient > is most likely wrong. >=20 > What does zdb -S BACKUP00 say? That command is stuck for 2 hours by now ... >=20 > Also I will note you were asked if the ZFS FS in question had dedup > enabled. You replied with a response from an incorrect FS. >=20 >=20 >=20 --Sig_/7IBzDnU/powH9tkn5ef7iuS Content-Type: application/pgp-signature; name=signature.asc Content-Disposition: attachment; filename=signature.asc -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.22 (FreeBSD) iQEcBAEBAgAGBQJSyX0aAAoJEOgBcD7A/5N8oSMIAM6AF3MLA4eaV8aAN266foHH gF9VynN6q5qcW9YtFP5wH0zSsXk8SU635c5u98OJMjdJPryo02ySEDquFTaPnAAM Q+R/m9J76di+bGt2yxeRcwvpBSBgE8TZdETXT23doeMq08MY1ohyyKyKuCGd4Yew O9acx0dSnfH85crIfn1C7YA782Ar8eWMizFqvAMejhyivjpyYVT+aqGSi+KlCmy7 dosEFM+VClKlzoXjS61g4SvaKlPsVEpE1MHd35IBD3CbVFwiBnGLvCl2aeXmw2Rh FBskvXVguknhAxxXwvgze6cp7GRw5WpGHMDhpFTRey4OiktPDts6RbbZdWTu3no= =GdAn -----END PGP SIGNATURE----- --Sig_/7IBzDnU/powH9tkn5ef7iuS--