From owner-freebsd-fs@freebsd.org Mon May 14 15:35:24 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 7129DDF5BAC for ; Mon, 14 May 2018 15:35:24 +0000 (UTC) (envelope-from paul.esson@redstor.com) Received: from EUR02-AM5-obe.outbound.protection.outlook.com (mail-am5eur02on0603.outbound.protection.outlook.com [IPv6:2a01:111:f400:fe07::603]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-SHA384 (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "Microsoft IT TLS CA 4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id BF8FD79013 for ; Mon, 14 May 2018 15:35:23 +0000 (UTC) (envelope-from paul.esson@redstor.com) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=redstorltd.onmicrosoft.com; s=selector1-redstor-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version; bh=rRkWcbQnR9Dj+eaygA4UgIxa9DfmnKbrg59f5k18f/Q=; b=bBRGb5noqEjMA5GNTsljTjmboA+6Ie77HjYHpA7sJlBeZRsZtgUpykslZbW2EkbkmmYU1C88+HGR+9r6ow6ThRxMpGO/3bltLpgYHWdRq6P60L7qTLYhJLWgGsPyPmaImgBGYaUfSSmlatCq5v1aHlGVbYtliXyYml8UedUexFI= Received: from AM5PR0102MB2578.eurprd01.prod.exchangelabs.com (10.167.168.139) by AM5PR0102MB2625.eurprd01.prod.exchangelabs.com (10.167.168.150) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384) id 15.20.755.16; Mon, 14 May 2018 15:35:21 +0000 Received: from AM5PR0102MB2578.eurprd01.prod.exchangelabs.com ([fe80::ac97:828b:b059:2244]) by AM5PR0102MB2578.eurprd01.prod.exchangelabs.com ([fe80::ac97:828b:b059:2244%13]) with mapi id 15.20.0755.018; Mon, 14 May 2018 15:35:21 +0000 From: Paul Esson To: "freebsd-fs@freebsd.org" Subject: Releasing deleted blocks from a sparse ZVOL Thread-Topic: Releasing deleted blocks from a sparse ZVOL Thread-Index: AdPrmSj1/1GnWlHITtWaBCXmXJBXmQ== Date: Mon, 14 May 2018 15:35:21 +0000 Message-ID: Accept-Language: en-GB, en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: authentication-results: spf=none (sender IP is ) smtp.mailfrom=paul.esson@redstor.com; x-originating-ip: [81.136.184.115] x-ms-publictraffictype: Email x-microsoft-exchange-diagnostics: 1; AM5PR0102MB2625; 7:qfuJeolji1QR91xJ7UgKzTgcIyECmbM5xQgHltZNvj/NURjbcQS/zvaxZ7d3W566+8Re+//L1mfS/Sx+DHStHsyhtKDiimB04116TQuXTQX37R8QqmzRaP3RuLEL6B174vZdaRLfDddUX+IZZ+/pFw+Z73NFRStN4bXah/i50/xHRXjByau0Mi+l3xXIgGaVyC36CHKt4JP/Ibmw+o8d6bxMbmQ/Sl3H37eHut+kNpb4+9CfDW6AjjuVS0pQ45cJ x-ms-exchange-antispam-srfa-diagnostics: SOS; x-microsoft-antispam: UriScan:; BCL:0; PCL:0; RULEID:(7020095)(4652020)(5600026)(4534165)(4627221)(201703031133081)(201702281549075)(2017052603328)(7153060)(7193020); SRVR:AM5PR0102MB2625; x-ms-traffictypediagnostic: AM5PR0102MB2625: x-microsoft-antispam-prvs: x-exchange-antispam-report-test: UriScan:(28532068793085)(21748063052155); x-ms-exchange-senderadcheck: 1 x-exchange-antispam-report-cfa-test: BCL:0; PCL:0; RULEID:(6040522)(2401047)(5005006)(8121501046)(93006095)(93001095)(3002001)(3231254)(944501410)(52105095)(10201501046)(149027)(150027)(6041310)(201703131423095)(201702281528075)(20161123555045)(201703061421075)(201703061406153)(20161123564045)(20161123562045)(20161123558120)(20161123560045)(6072148)(201708071742011); SRVR:AM5PR0102MB2625; BCL:0; PCL:0; RULEID:; SRVR:AM5PR0102MB2625; x-forefront-prvs: 067270ECAF x-forefront-antispam-report: SFV:NSPM; SFS:(10009020)(39850400004)(376002)(39380400002)(396003)(366004)(346002)(199004)(189003)(42174003)(74316002)(99286004)(316002)(9686003)(236005)(5250100002)(25786009)(7696005)(106356001)(2501003)(102836004)(186003)(26005)(4743002)(97736004)(59450400001)(5630700001)(86362001)(2351001)(9326002)(55016002)(6916009)(68736007)(105586002)(66066001)(486006)(54896002)(44832011)(6306002)(81156014)(3660700001)(790700001)(3846002)(6116002)(5640700003)(53946003)(5660300001)(2900100001)(53936002)(3280700002)(2906002)(7736002)(6436002)(6506007)(33656002)(478600001)(476003)(14454004)(81166006)(8676002)(8936002)(579004); DIR:OUT; SFP:1101; SCL:1; SRVR:AM5PR0102MB2625; H:AM5PR0102MB2578.eurprd01.prod.exchangelabs.com; FPR:; SPF:None; LANG:en; PTR:InfoNoRecords; A:1; MX:1; received-spf: None (protection.outlook.com: redstor.com does not designate permitted sender hosts) x-microsoft-antispam-message-info: TjySQtJEVbV/Az/yqm/kkY3MD00TsJYFnK6e53U0o2hRUiuOc30by6kZ1K4H7MAwkefLYBSS9mfBNNzPYgXtXOKvG1arkbM13toeIAzwdb+3UwVPxLVdQhpuwHjA3Dgek+vN4bpL/EdSn9n4mlYjwSf8/1vfFYaDtOmsIzsTLQy1aOtHbhApshpMVhRilyPa spamdiagnosticoutput: 1:99 spamdiagnosticmetadata: NSPM MIME-Version: 1.0 X-MS-Office365-Filtering-Correlation-Id: a6478e25-850c-41a7-6fa5-08d5b9b04db9 X-OriginatorOrg: redstor.com X-MS-Exchange-CrossTenant-Network-Message-Id: a6478e25-850c-41a7-6fa5-08d5b9b04db9 X-MS-Exchange-CrossTenant-originalarrivaltime: 14 May 2018 15:35:21.0924 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 24ac53ae-15a7-4211-afef-61d8f34e2571 X-MS-Exchange-Transport-CrossTenantHeadersStamped: AM5PR0102MB2625 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.26 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.26 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 14 May 2018 15:35:25 -0000 Hi Folks, I'm attempting to use a sparse ZVOL from a FreeBSD 11.1-RELEASE host as a d= ata disk for a bhyve FreeBSD 11.1-RELEASE guest that in turn uses this devi= ce as the source for a ZFS filesystem. When I delete data from the filesys= tem on the guest this is reflected in its used space, but not in the ZVOL o= n the host. I've read suggestions that the use of a block driver that supp= orts TRIM or SCSi unmap is crucial such as virtio-scsi, but from what I can= tell my vm-bhyve implementation is using virtio - certainly the disk1_type= parameter in the configuration file has a value of "virtio-blk". Can anyone confirm this is indeed the issue and whether it is possible to s= witch to the relevant driver? Or am I barking up the wrong tree altogether= ? Host ZFS Filesystem NAME PROPERTY VALUE SOURCE dc1-hn-01 type filesystem - dc1-hn-01 creation Mon Apr 23 14:35 2018 - dc1-hn-01 used 36.7G - dc1-hn-01 available 78.2T - dc1-hn-01 referenced 201K - dc1-hn-01 compressratio 1.00x - dc1-hn-01 mounted yes - dc1-hn-01 quota none default dc1-hn-01 reservation none default dc1-hn-01 recordsize 128K default dc1-hn-01 mountpoint /export/data/dc1-hn-01 local dc1-hn-01 sharenfs off default dc1-hn-01 checksum on default dc1-hn-01 compression off default dc1-hn-01 atime on default dc1-hn-01 devices on default dc1-hn-01 exec on default dc1-hn-01 setuid on default dc1-hn-01 readonly off default dc1-hn-01 jailed off default dc1-hn-01 snapdir hidden default dc1-hn-01 aclmode discard default dc1-hn-01 aclinherit restricted default dc1-hn-01 canmount on default dc1-hn-01 xattr off temporary dc1-hn-01 copies 1 default dc1-hn-01 version 5 - dc1-hn-01 utf8only off - dc1-hn-01 normalization none - dc1-hn-01 casesensitivity sensitive - dc1-hn-01 vscan off default dc1-hn-01 nbmand off default dc1-hn-01 sharesmb off default dc1-hn-01 refquota none default dc1-hn-01 refreservation none default dc1-hn-01 primarycache all default dc1-hn-01 secondarycache all default dc1-hn-01 usedbysnapshots 0 - dc1-hn-01 usedbydataset 201K - dc1-hn-01 usedbychildren 36.7G - dc1-hn-01 usedbyrefreservation 0 - dc1-hn-01 logbias latency default dc1-hn-01 dedup off default dc1-hn-01 mlslabel - dc1-hn-01 sync standard default dc1-hn-01 refcompressratio 1.00x - dc1-hn-01 written 201K - dc1-hn-01 logicalused 4.12G - dc1-hn-01 logicalreferenced 36.5K - dc1-hn-01 volmode default default dc1-hn-01 filesystem_limit none default dc1-hn-01 snapshot_limit none default dc1-hn-01 filesystem_count none default dc1-hn-01 snapshot_count none default dc1-hn-01 redundant_metadata all default Host ZFS volume - used by vm-bhyve guest NAME PROPERTY VALUE = SOURCE dc1-hn-01/vm/dc1-olbp-sn-11/disk1 type volume = - dc1-hn-01/vm/dc1-olbp-sn-11/disk1 creation Wed May 2 14:06 2= 018 - dc1-hn-01/vm/dc1-olbp-sn-11/disk1 used 4.70G = - dc1-hn-01/vm/dc1-olbp-sn-11/disk1 available 78.2T = - dc1-hn-01/vm/dc1-olbp-sn-11/disk1 referenced 4.70G = - dc1-hn-01/vm/dc1-olbp-sn-11/disk1 compressratio 1.00x = - dc1-hn-01/vm/dc1-olbp-sn-11/disk1 reservation none = default dc1-hn-01/vm/dc1-olbp-sn-11/disk1 volsize 28T = local dc1-hn-01/vm/dc1-olbp-sn-11/disk1 volblocksize 8K = - dc1-hn-01/vm/dc1-olbp-sn-11/disk1 checksum on = default dc1-hn-01/vm/dc1-olbp-sn-11/disk1 compression off = default dc1-hn-01/vm/dc1-olbp-sn-11/disk1 readonly off = default dc1-hn-01/vm/dc1-olbp-sn-11/disk1 copies 1 = default dc1-hn-01/vm/dc1-olbp-sn-11/disk1 refreservation none = default dc1-hn-01/vm/dc1-olbp-sn-11/disk1 primarycache all = default dc1-hn-01/vm/dc1-olbp-sn-11/disk1 secondarycache all = default dc1-hn-01/vm/dc1-olbp-sn-11/disk1 usedbysnapshots 0 = - dc1-hn-01/vm/dc1-olbp-sn-11/disk1 usedbydataset 4.70G = - dc1-hn-01/vm/dc1-olbp-sn-11/disk1 usedbychildren 0 = - dc1-hn-01/vm/dc1-olbp-sn-11/disk1 usedbyrefreservation 0 = - dc1-hn-01/vm/dc1-olbp-sn-11/disk1 logbias latency = default dc1-hn-01/vm/dc1-olbp-sn-11/disk1 dedup off = default dc1-hn-01/vm/dc1-olbp-sn-11/disk1 mlslabel = - dc1-hn-01/vm/dc1-olbp-sn-11/disk1 sync standard = default dc1-hn-01/vm/dc1-olbp-sn-11/disk1 refcompressratio 1.00x = - dc1-hn-01/vm/dc1-olbp-sn-11/disk1 written 4.70G = - dc1-hn-01/vm/dc1-olbp-sn-11/disk1 logicalused 2.06G = - dc1-hn-01/vm/dc1-olbp-sn-11/disk1 logicalreferenced 2.06G = - dc1-hn-01/vm/dc1-olbp-sn-11/disk1 volmode dev = local dc1-hn-01/vm/dc1-olbp-sn-11/disk1 snapshot_limit none = default dc1-hn-01/vm/dc1-olbp-sn-11/disk1 snapshot_count none = default dc1-hn-01/vm/dc1-olbp-sn-11/disk1 redundant_metadata all = default Guest ZFS Filesystem NAME PROPERTY VALUE SOURCE dc1-sn-11 type filesystem - dc1-sn-11 creation Wed May 2 15:49 2018 - dc1-sn-11 used 752K - dc1-sn-11 available 26.9T - dc1-sn-11 referenced 176K - dc1-sn-11 compressratio 1.00x - dc1-sn-11 mounted yes - dc1-sn-11 quota none default dc1-sn-11 reservation none default dc1-sn-11 recordsize 128K default dc1-sn-11 mountpoint /export/data/dc1-sn-11 local dc1-sn-11 sharenfs off default dc1-sn-11 checksum on default dc1-sn-11 compression off default dc1-sn-11 atime on default dc1-sn-11 devices on default dc1-sn-11 exec on default dc1-sn-11 setuid on default dc1-sn-11 readonly off default dc1-sn-11 jailed off default dc1-sn-11 snapdir hidden default dc1-sn-11 aclmode discard default dc1-sn-11 aclinherit restricted default dc1-sn-11 canmount on default dc1-sn-11 xattr off temporary dc1-sn-11 copies 1 default dc1-sn-11 version 5 - dc1-sn-11 utf8only off - dc1-sn-11 normalization none - dc1-sn-11 casesensitivity sensitive - dc1-sn-11 vscan off default dc1-sn-11 nbmand off default dc1-sn-11 sharesmb off default dc1-sn-11 refquota none default dc1-sn-11 refreservation none default dc1-sn-11 primarycache all default dc1-sn-11 secondarycache all default dc1-sn-11 usedbysnapshots 0 - dc1-sn-11 usedbydataset 176K - dc1-sn-11 usedbychildren 576K - dc1-sn-11 usedbyrefreservation 0 - dc1-sn-11 logbias latency default dc1-sn-11 dedup off default dc1-sn-11 mlslabel - dc1-sn-11 sync standard default dc1-sn-11 refcompressratio 1.00x - dc1-sn-11 written 176K - dc1-sn-11 logicalused 153K - dc1-sn-11 logicalreferenced 55K - dc1-sn-11 volmode default default dc1-sn-11 filesystem_limit none default dc1-sn-11 snapshot_limit none default dc1-sn-11 filesystem_count none default dc1-sn-11 snapshot_count none default dc1-sn-11 redundant_metadata all default Regards, Paul Esson | Redstor Limited e paul.esson@redstor.com