From owner-freebsd-fs@FreeBSD.ORG Wed Jul 10 14:43:05 2013 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by hub.freebsd.org (Postfix) with ESMTP id A7635EEA; Wed, 10 Jul 2013 14:43:05 +0000 (UTC) (envelope-from c.kworr@gmail.com) Received: from mail-lb0-x233.google.com (mail-lb0-x233.google.com [IPv6:2a00:1450:4010:c04::233]) by mx1.freebsd.org (Postfix) with ESMTP id F23681231; Wed, 10 Jul 2013 14:43:04 +0000 (UTC) Received: by mail-lb0-f179.google.com with SMTP id w20so5725303lbh.38 for ; Wed, 10 Jul 2013 07:43:04 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=message-id:date:from:user-agent:mime-version:to:cc:subject :references:in-reply-to:content-type:content-transfer-encoding; bh=T+wtj9dsT9X29vQvfbzYbVtb8wdrLpRsAQo9BWrUNMU=; b=UnGxWrH84PQ6ILWEwYk9GR7lRObtxViLuqpDZbCkX+/WX+lQ53diZia0RsGXedQ95f FBo0qPehBD3kuDsDdmjWSmIqUKVkA4ueraNpQkqlJMlnldc0N8w/xWZP+pvdKju8c2w3 zMYV5YcCf5Tx8khoapj8es2miim+h0XV00EH386zwJw5MA/slLBuINagbQ28KCpu2nH+ 7ipTZzzxqXghdDCHWAQ5BKcsRPTk7Wv7pdHpENmyuztyNX2P/WOM4iUT24iFIyh9YLDC xax/qu3J/e5RXihLjbyyHAcuxAXIh/tCu8onNQUZnVFJotKtfnDEDFTSBlJYlpudoHAH 5B5Q== X-Received: by 10.152.27.9 with SMTP id p9mr15317348lag.4.1373467383949; Wed, 10 Jul 2013 07:43:03 -0700 (PDT) Received: from [192.168.1.139] (mau.donbass.com. [92.242.127.250]) by mx.google.com with ESMTPSA id n17sm10864712lbv.2.2013.07.10.07.43.02 for (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Wed, 10 Jul 2013 07:43:03 -0700 (PDT) Message-ID: <51DD72F5.8090008@gmail.com> Date: Wed, 10 Jul 2013 17:43:01 +0300 From: Volodymyr Kostyrko User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:17.0) Gecko/20130627 Thunderbird/17.0.7 MIME-Version: 1.0 To: d@delphij.net Subject: Re: ZFS default compression algo for contemporary FreeBSD versions References: <51D576E1.6030803@gmail.com> <51D59B6C.5030600@gmail.com> <51D59C88.9060403@FreeBSD.org> <51D5DAB9.4070507@gmail.com> <51D5DCDF.2030503@delphij.net> <51D5DEC4.2000101@gmail.com> <51D5E42C.5010506@delphij.net> In-Reply-To: <51D5E42C.5010506@delphij.net> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit Cc: freebsd-fs@FreeBSD.org, Dmitry Morozovsky , Andriy Gapon X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 10 Jul 2013 14:43:05 -0000 05.07.2013 00:07, Xin Li wrote: > -----BEGIN PGP SIGNED MESSAGE----- > Hash: SHA256 > > On 7/4/13 1:44 PM, Volodymyr Kostyrko wrote: >> 04.07.2013 23:36, Xin Li wrote: >>> -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA256 >>> >>> On 7/4/13 1:27 PM, Volodymyr Kostyrko wrote: >>>> 04.07.2013 19:02, Andriy Gapon wrote: >>>>> on 04/07/2013 18:57 Volodymyr Kostyrko said the following: >>>>>> Yes. Much better in terms of speed. >>>>> >>>>> And compression too. >>>> >>>> Can't really say. >>>> >>>> When the code first appeared in stable I moved two of my >>>> machines (desktops) to LZ4 recreating each dataset. To my >>>> surprise gain at transition from lzjb was fairly minimal and >>>> sometimes LZ4 even loses to lzjb in compression size. However >>>> better compression/decompression speed and moreover earlier >>>> takeoff when data is incompressible clearly makes lz4 a >>>> winner. >>> >>> I'm interested in this -- what's the nature of data on that >>> dataset (e.g. plain text? binaries? images?) >> >> Triple no. Biggest difference in lzjb favor was at zvol with Mac OS >> X Snow Leo. >> >> Maybe it's just because recordsize is too small on zvols? Anyway >> the difference was like a 1% or 2%. Can't remember but can retest. > > Hmm that's weird. I haven't tried Mac iSCSI volumes but do have tried > Windows iSCSI volumes, and lz4 was a win. > > It may be helpful if you can post your 'zfs get all ' > output so we can try to reproduce the problem at lab? Sorry, my virtual machines are all phased out so can't reproduce. At most I can see this now with this two pools: arcade@ar1l0u\/home/arcade# zfs get all ar1l0u/vbox_mac_0_cp NAME PROPERTY VALUE SOURCE ar1l0u/vbox_mac_0_cp type volume - ar1l0u/vbox_mac_0_cp creation ср лип 10 11:55 2013 - ar1l0u/vbox_mac_0_cp used 18,2G - ar1l0u/vbox_mac_0_cp available 13,0G - ar1l0u/vbox_mac_0_cp referenced 18,2G - ar1l0u/vbox_mac_0_cp compressratio 1.11x - ar1l0u/vbox_mac_0_cp reservation none default ar1l0u/vbox_mac_0_cp volsize 30G local ar1l0u/vbox_mac_0_cp volblocksize 8K - ar1l0u/vbox_mac_0_cp checksum sha256 inherited from ar1l0u ar1l0u/vbox_mac_0_cp compression lzjb local ar1l0u/vbox_mac_0_cp readonly off default ar1l0u/vbox_mac_0_cp copies 1 default ar1l0u/vbox_mac_0_cp refreservation none default ar1l0u/vbox_mac_0_cp primarycache metadata local ar1l0u/vbox_mac_0_cp secondarycache all default ar1l0u/vbox_mac_0_cp usedbysnapshots 0 - ar1l0u/vbox_mac_0_cp usedbydataset 18,2G - ar1l0u/vbox_mac_0_cp usedbychildren 0 - ar1l0u/vbox_mac_0_cp usedbyrefreservation 0 - ar1l0u/vbox_mac_0_cp logbias throughput local ar1l0u/vbox_mac_0_cp dedup off default ar1l0u/vbox_mac_0_cp mlslabel - ar1l0u/vbox_mac_0_cp sync standard default ar1l0u/vbox_mac_0_cp refcompressratio 1.11x - ar1l0u/vbox_mac_0_cp written 18,2G - ar1l0u/vbox_mac_0_cp logicalused 20,2G - ar1l0u/vbox_mac_0_cp logicalreferenced 20,2G - arcade@ar1l0u\/home/arcade# zfs get all ar1l0u/vbox_mac_1 NAME PROPERTY VALUE SOURCE ar1l0u/vbox_mac_1 type volume - ar1l0u/vbox_mac_1 creation ср чер 26 18:02 2013 - ar1l0u/vbox_mac_1 used 5,48G - ar1l0u/vbox_mac_1 available 13,0G - ar1l0u/vbox_mac_1 referenced 18,0G - ar1l0u/vbox_mac_1 compressratio 1.09x - ar1l0u/vbox_mac_1 origin ar1l0u/vbox_mac_0@xcode - ar1l0u/vbox_mac_1 reservation none default ar1l0u/vbox_mac_1 volsize 30G local ar1l0u/vbox_mac_1 volblocksize 8K - ar1l0u/vbox_mac_1 checksum sha256 inherited from ar1l0u ar1l0u/vbox_mac_1 compression lz4 inherited from ar1l0u ar1l0u/vbox_mac_1 readonly off default ar1l0u/vbox_mac_1 copies 1 default ar1l0u/vbox_mac_1 refreservation none default ar1l0u/vbox_mac_1 primarycache metadata local ar1l0u/vbox_mac_1 secondarycache all default ar1l0u/vbox_mac_1 usedbysnapshots 0 - ar1l0u/vbox_mac_1 usedbydataset 5,48G - ar1l0u/vbox_mac_1 usedbychildren 0 - ar1l0u/vbox_mac_1 usedbyrefreservation 0 - ar1l0u/vbox_mac_1 logbias throughput local ar1l0u/vbox_mac_1 dedup off default ar1l0u/vbox_mac_1 mlslabel - ar1l0u/vbox_mac_1 sync standard default ar1l0u/vbox_mac_1 refcompressratio 1.13x - ar1l0u/vbox_mac_1 written 5,48G - ar1l0u/vbox_mac_1 logicalused 5,98G - ar1l0u/vbox_mac_1 logicalreferenced 20,2G - The latter is actually a clone of some other pool so I'm not sure whether this a result of working with snapshots or a real compression difference. -- Sphinx of black quartz, judge my vow.