From owner-freebsd-current@FreeBSD.ORG Sun Jan 5 08:46:10 2014 Return-Path: Delivered-To: freebsd-current@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id CADD73DA for ; Sun, 5 Jan 2014 08:46:10 +0000 (UTC) Received: from outpost1.zedat.fu-berlin.de (outpost1.zedat.fu-berlin.de [130.133.4.66]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 7F0651D62 for ; Sun, 5 Jan 2014 08:46:10 +0000 (UTC) Received: from inpost2.zedat.fu-berlin.de ([130.133.4.69]) by outpost.zedat.fu-berlin.de (Exim 4.82) with esmtp (envelope-from ) id <1VzjLT-000yuh-OO>; Sun, 05 Jan 2014 09:46:07 +0100 Received: from g225156084.adsl.alicedsl.de ([92.225.156.84] helo=thor.walstatt.dyndns.org) by inpost2.zedat.fu-berlin.de (Exim 4.82) with esmtpsa (envelope-from ) id <1VzjLT-0005Ja-JZ>; Sun, 05 Jan 2014 09:46:07 +0100 Date: Sun, 5 Jan 2014 09:46:07 +0100 From: "O. Hartmann" To: Peter Jeremy Subject: Re: ZFS command can block the whole ZFS subsystem! Message-ID: <20140105094607.43ecf058@thor.walstatt.dyndns.org> In-Reply-To: <20140105083039.GA75558@server.rulingia.com> References: <20140103130021.30569db4@thor.walstatt.dyndns.org> <20140103171457.0fbf0cd4@telesto> <20140103181622.GA61275@dan.emsphone.com> <20140103202535.6e72eebd@thor.walstatt.dyndns.org> <20140104221004.GA72376@server.rulingia.com> <20140104232642.141402dd@thor.walstatt.dyndns.org> <20140104231426.GC72376@server.rulingia.com> <20140105091138.725ff0c2@thor.walstatt.dyndns.org> <20140105083039.GA75558@server.rulingia.com> Organization: FU Berlin X-Mailer: Claws Mail 3.9.3 (GTK+ 2.24.22; amd64-portbld-freebsd11.0) MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; boundary="Sig_/eBh7BWdHB_CjUMUlqXGQOh7"; protocol="application/pgp-signature" X-Originating-IP: 92.225.156.84 X-ZEDAT-Hint: A Cc: FreeBSD CURRENT X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 05 Jan 2014 08:46:10 -0000 --Sig_/eBh7BWdHB_CjUMUlqXGQOh7 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: quoted-printable On Sun, 5 Jan 2014 19:30:39 +1100 Peter Jeremy wrote: > On 2014-Jan-05 09:11:38 +0100, "O. Hartmann" > wrote: > >On Sun, 5 Jan 2014 10:14:26 +1100 > >Peter Jeremy wrote: > > > >> On 2014-Jan-04 23:26:42 +0100, "O. Hartmann" > >> wrote: > >> >zfs list -r BACKUP00 > >> >NAME USED AVAIL REFER MOUNTPOINT > >> >BACKUP00 1.48T 1.19T 144K /BACKUP00 > >> >BACKUP00/backup 1.47T 1.19T 1.47T /backup > >>=20 > >> Well, that at least shows it's making progress - it's gone from > >> 2.5T to 1.47T used (though I gather that has taken several days). > >> Can you pleas post the result of > >> zfs get all BACKUP00/backup >=20 > >BACKUP00/backup dedup on local >=20 > This is your problem. Before it can free any block, it has to check > for other references to the block via the DDT and I suspect you don't > have enough RAM to cache the DDT. >=20 > Your options are: > 1) Wait until the delete finishes. > 2) Destroy the pool with extreme prejudice: Forcably export the pool > (probably by booting to single user and not starting ZFS) and write > zeroes to the first and last MB of ada3p1. >=20 > BTW, this problem will occur on any filesystem where you've ever > enabled dedup - once there are any dedup'd blocks in a filesystem, > all deletes need to go via the DDT. >=20 As I stated earlier in the this thread, the box in question has 32 GB RAM and this should be sufficient. --Sig_/eBh7BWdHB_CjUMUlqXGQOh7 Content-Type: application/pgp-signature; name=signature.asc Content-Disposition: attachment; filename=signature.asc -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.22 (FreeBSD) iQEcBAEBAgAGBQJSyRvPAAoJEOgBcD7A/5N8tQsH/02xl1lrDHjc1VbPy1ZkKljV nxAQ5Ca8xACLyORKIMk5mWh3r0Y33pnVRqbyGwM5S3k4oSea2CJJVx1HtDob2Abs Cox2SWWo0AB697WEWwDFI7rxAwOfL+xP4hNvkOtkZoU9Z9zzj/yUv1HyO9yElTC5 TLuCVPDGTzcW5InhLjgvHs/nBanp7XJ1sYr3Qj+233eHAgKYVdAp6v5UE6LC9C1+ m3npu7KI0wFoNkQUcZjKUE4Nj83tKDD8UbwvROqGSr/NEmSo8bH7KK2/qzHXon4u pEtskV7veki8SQCLdF1z2/0O+/Dv7gRPVLmYaqS8aPx8Ph9nRrUbFPBGugAPYSk= =HtEN -----END PGP SIGNATURE----- --Sig_/eBh7BWdHB_CjUMUlqXGQOh7--