From owner-freebsd-current@FreeBSD.ORG Sun Jan 5 08:30:54 2014 Return-Path: Delivered-To: freebsd-current@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id E47C5152 for ; Sun, 5 Jan 2014 08:30:53 +0000 (UTC) Received: from vps.rulingia.com (vps.rulingia.com [103.243.244.15]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 79B661B58 for ; Sun, 5 Jan 2014 08:30:52 +0000 (UTC) Received: from server.rulingia.com (c220-239-250-249.belrs5.nsw.optusnet.com.au [220.239.250.249]) by vps.rulingia.com (8.14.7/8.14.7) with ESMTP id s058Uj8q060966 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=OK); Sun, 5 Jan 2014 19:30:45 +1100 (EST) (envelope-from peter@rulingia.com) X-Bogosity: Ham, spamicity=0.000000 Received: from server.rulingia.com (localhost.rulingia.com [127.0.0.1]) by server.rulingia.com (8.14.7/8.14.7) with ESMTP id s058UdAO057183 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=NO); Sun, 5 Jan 2014 19:30:39 +1100 (EST) (envelope-from peter@server.rulingia.com) Received: (from peter@localhost) by server.rulingia.com (8.14.7/8.14.7/Submit) id s058Ud5L057182; Sun, 5 Jan 2014 19:30:39 +1100 (EST) (envelope-from peter) Date: Sun, 5 Jan 2014 19:30:39 +1100 From: Peter Jeremy To: "O. Hartmann" Subject: Re: ZFS command can block the whole ZFS subsystem! Message-ID: <20140105083039.GA75558@server.rulingia.com> References: <20140103130021.30569db4@thor.walstatt.dyndns.org> <20140103171457.0fbf0cd4@telesto> <20140103181622.GA61275@dan.emsphone.com> <20140103202535.6e72eebd@thor.walstatt.dyndns.org> <20140104221004.GA72376@server.rulingia.com> <20140104232642.141402dd@thor.walstatt.dyndns.org> <20140104231426.GC72376@server.rulingia.com> <20140105091138.725ff0c2@thor.walstatt.dyndns.org> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="KsGdsel6WgEHnImy" Content-Disposition: inline In-Reply-To: <20140105091138.725ff0c2@thor.walstatt.dyndns.org> X-PGP-Key: http://www.rulingia.com/keys/peter.pgp User-Agent: Mutt/1.5.22 (2013-10-16) Cc: FreeBSD CURRENT X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 05 Jan 2014 08:30:54 -0000 --KsGdsel6WgEHnImy Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On 2014-Jan-05 09:11:38 +0100, "O. Hartmann" = wrote: >On Sun, 5 Jan 2014 10:14:26 +1100 >Peter Jeremy wrote: > >> On 2014-Jan-04 23:26:42 +0100, "O. Hartmann" >> wrote: >> >zfs list -r BACKUP00 >> >NAME USED AVAIL REFER MOUNTPOINT >> >BACKUP00 1.48T 1.19T 144K /BACKUP00 >> >BACKUP00/backup 1.47T 1.19T 1.47T /backup >>=20 >> Well, that at least shows it's making progress - it's gone from 2.5T >> to 1.47T used (though I gather that has taken several days). Can you >> pleas post the result of >> zfs get all BACKUP00/backup >BACKUP00/backup dedup on local This is your problem. Before it can free any block, it has to check for other references to the block via the DDT and I suspect you don't have enough RAM to cache the DDT. Your options are: 1) Wait until the delete finishes. 2) Destroy the pool with extreme prejudice: Forcably export the pool (probably by booting to single user and not starting ZFS) and write zeroes to the first and last MB of ada3p1. BTW, this problem will occur on any filesystem where you've ever enabled dedup - once there are any dedup'd blocks in a filesystem, all deletes need to go via the DDT. --=20 Peter Jeremy --KsGdsel6WgEHnImy Content-Type: application/pgp-signature -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.22 (FreeBSD) iKYEARECAGYFAlLJGC9fFIAAAAAALgAoaXNzdWVyLWZwckBub3RhdGlvbnMub3Bl bnBncC5maWZ0aGhvcnNlbWFuLm5ldDBCRjc3QTcyNTg5NEVCRTY0RjREN0VFRUZF OEE0N0JGRjAwRkI4ODcACgkQ/opHv/APuIdjfACeO+YLlrRBp/r8QrQI1zTheuMH DpEAoK9QqXeeDIxYqSuyzUv1PYIbARZr =cjn/ -----END PGP SIGNATURE----- --KsGdsel6WgEHnImy--