Skip site navigation (1)Skip section navigation (2)
Date:      Tue, 18 Jan 2022 14:56:46 +0100
From:      Florent Rivoire <florent@rivoire.fr>
To:        freebsd-fs@freebsd.org
Subject:   [zfs] recordsize: unexpected increase of disk usage when increasing it
Message-ID:  <CADzRhsEsZMGE-SoeWLMG9NTtkwhhy6OGQQ046m9AxGFbp5h_kQ@mail.gmail.com>

next in thread | raw e-mail | index | archive | help
--00000000000072d31d05d5dba4a4
Content-Type: text/plain; charset="UTF-8"

TLDR: I rsync-ed the same data twice: once with 128K recordsize and
once with 1M, and the allocated size on disk is ~3% bigger with 1M.
Why not smaller ?


Hello,

I would like some help to understand how the disk usage evolves when I
change the recordsize.

I've read several articles/presentations/forums about recordsize in
ZFS, and if I try to summarize, I mainly understood that:
- recordsize is the "maximum" size of "objects" (so "logical blocks")
that zfs will create for both  -data & metadata, then each object is
compressed and allocated to one vdev, splitted into smaller (ashift
size) "physical" blocks and written on disks
- increasing recordsize is usually good when storing large files that
are not modified, because it limits the nb of metadata objects
(block-pointers), which has a positive effect on performance
- decreasing recordsize is useful for "databases-like" workloads (ie:
small random writes inside existing objects), because it avoids write
amplification (read-modify-write a large object for a small update)

Today, I'm trying to observe the effect of increasing recordsize for
*my* data (because I'm also considering defining special_small_blocks
& using SSDs as "special", but not tested nor discussed here, just
recordsize).
So, I'm doing some benchmarks on my "documents" dataset (details in
"notes" below), but the results are really strange to me.

When I rsync the same data to a freshly-recreated zpool:
A) with recordsize=128K : 226G allocated on disk
B) with recordsize=1M : 232G allocated on disk => bigger than 128K ?!?

I would clearly expect the other way around, because bigger recordsize
generates less metadata so smaller disk usage, and there shouldn't be
any overhead because 1M is just a maximum and not a forced size to
allocate for every object.
I don't mind the increased usage (I can live with a few GB more), but
I would like to understand why it happens.

I tried to give all the details of my tests below.
Did I do something wrong ? Can you explain the increase ?

Thanks !



===============================================
A) 128K
==========

# zpool destroy bench
# zpool create -o ashift=12 bench
/dev/gptid/3c0f5cbc-b0ce-11ea-ab91-c8cbb8cc3ad4

# rsync -av --exclude '.zfs' /mnt/tank/docs-florent/ /bench
[...]
sent 241,042,476,154 bytes  received 353,838 bytes  81,806,492.45 bytes/sec
total size is 240,982,439,038  speedup is 1.00

# zfs get recordsize bench
NAME   PROPERTY    VALUE    SOURCE
bench  recordsize  128K     default

# zpool list -v bench
NAME                                           SIZE  ALLOC   FREE
CKPOINT  EXPANDSZ   FRAG    CAP  DEDUP    HEALTH  ALTROOT
bench                                         2.72T   226G  2.50T
  -         -     0%     8%  1.00x    ONLINE  -
  gptid/3c0f5cbc-b0ce-11ea-ab91-c8cbb8cc3ad4  2.72T   226G  2.50T
  -         -     0%  8.10%      -    ONLINE

# zfs list bench
NAME    USED  AVAIL     REFER  MOUNTPOINT
bench   226G  2.41T      226G  /bench

# zfs get all bench |egrep "(used|referenced|written)"
bench  used                  226G                   -
bench  referenced            226G                   -
bench  usedbysnapshots       0B                     -
bench  usedbydataset         226G                   -
bench  usedbychildren        1.80M                  -
bench  usedbyrefreservation  0B                     -
bench  written               226G                   -
bench  logicalused           226G                   -
bench  logicalreferenced     226G                   -

# zdb -Lbbbs bench > zpool-bench-rcd128K.zdb



===============================================
B) 1M
==========

# zpool destroy bench
# zpool create -o ashift=12 bench
/dev/gptid/3c0f5cbc-b0ce-11ea-ab91-c8cbb8cc3ad4
# zfs set recordsize=1M bench

# rsync -av --exclude '.zfs' /mnt/tank/docs-florent/ /bench
[...]
sent 241,042,476,154 bytes  received 353,830 bytes  80,173,899.88 bytes/sec
total size is 240,982,439,038  speedup is 1.00

# zfs get recordsize bench
NAME   PROPERTY    VALUE    SOURCE
bench  recordsize  1M       local

# zpool list -v bench
NAME                                           SIZE  ALLOC   FREE
CKPOINT  EXPANDSZ   FRAG    CAP  DEDUP    HEALTH  ALTROOT
bench                                         2.72T   232G  2.49T
  -         -     0%     8%  1.00x    ONLINE  -
  gptid/3c0f5cbc-b0ce-11ea-ab91-c8cbb8cc3ad4  2.72T   232G  2.49T
  -         -     0%  8.32%      -    ONLINE

# zfs list bench
NAME    USED  AVAIL     REFER  MOUNTPOINT
bench   232G  2.41T      232G  /bench

# zfs get all bench |egrep "(used|referenced|written)"
bench  used                  232G                   -
bench  referenced            232G                   -
bench  usedbysnapshots       0B                     -
bench  usedbydataset         232G                   -
bench  usedbychildren        1.96M                  -
bench  usedbyrefreservation  0B                     -
bench  written               232G                   -
bench  logicalused           232G                   -
bench  logicalreferenced     232G                   -

# zdb -Lbbbs bench > zpool-bench-rcd1M.zdb



===============================================
Notes:
==========

- the source dataset contains ~50% of pictures (raw files and jpg),
and also some music, various archived documents, zip, videos
- no change on the source dataset while testing (cf size logged by resync)
- I repeated the tests twice (128K, then 1M, then 128K, then 1M), and
same results
- probably not important here, but:
/dev/gptid/3c0f5cbc-b0ce-11ea-ab91-c8cbb8cc3ad4 is a Red 3TB CMR
(WD30EFRX), and /mnt/tank/docs-florent/ is a 128K-recordsize dataset
on another zpool that I never tweaked except ashit=12 (because using
the same model of Red 3TB)

# zfs --version
zfs-2.0.6-1
zfs-kmod-v2021120100-zfs_a8c7652

# uname -a
FreeBSD xxxxxxxxx 12.2-RELEASE-p11 FreeBSD 12.2-RELEASE-p11
75566f060d4(HEAD) TRUENAS  amd64

--00000000000072d31d05d5dba4a4
Content-Type: application/octet-stream; name="zpool-bench-rcd1M.zdb"
Content-Disposition: attachment; filename="zpool-bench-rcd1M.zdb"
Content-Transfer-Encoding: base64
Content-ID: <f_kyk6h5v80>
X-Attachment-Id: f_kyk6h5v80

ClRyYXZlcnNpbmcgYWxsIGJsb2NrcyAuLi4KCgoJYnAgY291bnQ6ICAgICAgICAgICAgICAgIDI1
NjAwOAoJZ2FuZ2VkIGNvdW50OiAgICAgICAgICAgICAgICAgMAoJYnAgbG9naWNhbDogICAgICAg
IDI0OTMxNDg0MTYwMCAgICAgIGF2ZzogOTczODU1CglicCBwaHlzaWNhbDogICAgICAgMjQ4ODY1
Njc0MjQwICAgICAgYXZnOiA5NzIxMDEgICAgIGNvbXByZXNzaW9uOiAgIDEuMDAKCWJwIGFsbG9j
YXRlZDogICAgICAyNDg5NDM5NTU5NjggICAgICBhdmc6IDk3MjQwNiAgICAgY29tcHJlc3Npb246
ICAgMS4wMAoJYnAgZGVkdXBlZDogICAgICAgICAgICAgICAgICAgMCAgICByZWY+MTogICAgICAw
ICAgZGVkdXBsaWNhdGlvbjogICAxLjAwCglOb3JtYWwgY2xhc3M6ICAgICAgMjQ1NTEzMTM4MTc2
ICAgICB1c2VkOiAgOC4yMSUKCglhZGRpdGlvbmFsLCBub24tcG9pbnRlciBicHMgb2YgdHlwZSAw
OiAgICAgICAgMTY5CgkgbnVtYmVyIG9mIChjb21wcmVzc2VkKSBieXRlczogIG51bWJlciBvZiBi
cHMKCQkJIDI4OiAgICAgIDggKioqKioqKioKCQkJIDI5OiAgICAgIDMgKioqCgkJCSAzMDogICAg
ICAwIAoJCQkgMzE6ICAgICAgMCAKCQkJIDMyOiAgICAgIDEgKgoJCQkgMzM6ICAgICAgMCAKCQkJ
IDM0OiAgICAgIDAgCgkJCSAzNTogICAgICAwIAoJCQkgMzY6ICAgICAgMCAKCQkJIDM3OiAgICAg
IDAgCgkJCSAzODogICAgICAwIAoJCQkgMzk6ICAgICAgMCAKCQkJIDQwOiAgICAgIDIgKioKCQkJ
IDQxOiAgICAgIDIgKioKCQkJIDQyOiAgICAgIDAgCgkJCSA0MzogICAgICAwIAoJCQkgNDQ6ICAg
ICAgMCAKCQkJIDQ1OiAgICAgIDEgKgoJCQkgNDY6ICAgICAgMCAKCQkJIDQ3OiAgICAgIDAgCgkJ
CSA0ODogICAgICAxICoKCQkJIDQ5OiAgICAgIDEgKgoJCQkgNTA6ICAgICAgMSAqCgkJCSA1MTog
ICAgICAwIAoJCQkgNTI6ICAgICAgMCAKCQkJIDUzOiAgICAgIDEgKgoJCQkgNTQ6ICAgICAgOCAq
KioqKioqKgoJCQkgNTU6ICAgICAxMiAqKioqKioqKioqKioKCQkJIDU2OiAgICAgIDAgCgkJCSA1
NzogICAgICAyICoqCgkJCSA1ODogICAgICAwIAoJCQkgNTk6ICAgICAgMCAKCQkJIDYwOiAgICAg
IDAgCgkJCSA2MTogICAgICAwIAoJCQkgNjI6ICAgICAgNCAqKioqCgkJCSA2MzogICAgICAwIAoJ
CQkgNjQ6ICAgICAgNCAqKioqCgkJCSA2NTogICAgICAwIAoJCQkgNjY6ICAgICAgMyAqKioKCQkJ
IDY3OiAgICAgIDIgKioKCQkJIDY4OiAgICAgIDAgCgkJCSA2OTogICAgICAxICoKCQkJIDcwOiAg
ICAgIDAgCgkJCSA3MTogICAgICAwIAoJCQkgNzI6ICAgICAgMyAqKioKCQkJIDczOiAgICAgMzMg
KioqKioqKioqKioqKioqKioqKioqKioqKioqKioqKioqCgkJCSA3NDogICAgICA3ICoqKioqKioK
CQkJIDc1OiAgICAgIDIgKioKCQkJIDc2OiAgICAgIDUgKioqKioKCQkJIDc3OiAgICAgIDMgKioq
CgkJCSA3ODogICAgICAxICoKCQkJIDc5OiAgICAgIDEgKgoJCQkgODA6ICAgICAgMiAqKgoJCQkg
ODE6ICAgICAgMSAqCgkJCSA4MjogICAgICAzICoqKgoJCQkgODM6ICAgICAgMSAqCgkJCSA4NDog
ICAgICAxICoKCQkJIDg1OiAgICAgIDAgCgkJCSA4NjogICAgICAzICoqKgoJCQkgODc6ICAgICAg
MiAqKgoJCQkgODg6ICAgICAgMSAqCgkJCSA4OTogICAgICAzICoqKgoJCQkgOTA6ICAgICAgMiAq
KgoJCQkgOTE6ICAgICAgMSAqCgkJCSA5MjogICAgICAyICoqCgkJCSA5MzogICAgICAwIAoJCQkg
OTQ6ICAgICAgMSAqCgkJCSA5NTogICAgICAyICoqCgkJCSA5NjogICAgICAxICoKCQkJIDk3OiAg
ICAgIDAgCgkJCSA5ODogICAgICA3ICoqKioqKioKCQkJIDk5OiAgICAgIDMgKioqCgkJCTEwMDog
ICAgICAxICoKCQkJMTAxOiAgICAgIDEgKgoJCQkxMDI6ICAgICAgMiAqKgoJCQkxMDM6ICAgICAg
MSAqCgkJCTEwNDogICAgICAyICoqCgkJCTEwNTogICAgICAxICoKCQkJMTA2OiAgICAgIDQgKioq
KgoJCQkxMDc6ICAgICAgMiAqKgoJCQkxMDg6ICAgICAgMiAqKgoJCQkxMDk6ICAgICAgMCAKCQkJ
MTEwOiAgICAgIDIgKioKCQkJMTExOiAgICAgIDIgKioKCQkJMTEyOiAgICAgIDEgKgoJRGl0dG9l
ZCBibG9ja3Mgb24gc2FtZSB2ZGV2OiAxNjMzMAoKQmxvY2tzCUxTSVpFCVBTSVpFCUFTSVpFCSAg
YXZnCSBjb21wCSVUb3RhbAlUeXBlCiAgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAg
LQkgICAgIC0JdW5hbGxvY2F0ZWQKICAgICAyCSAgMzJLCSAgIDhLCSAgMjRLCSAgMTJLCSA0LjAw
CSAgMC4wMAlvYmplY3QgZGlyZWN0b3J5CiAgICAgMQkgIDUxMgkgIDUxMgkgIDEySwkgIDEySwkg
MS4wMAkgIDAuMDAJb2JqZWN0IGFycmF5CiAgICAgMQkgIDE2SwkgICA0SwkgIDEySwkgIDEySwkg
NC4wMAkgIDAuMDAJcGFja2VkIG52bGlzdAogICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgIC0J
ICAgIC0JICAgICAtCXBhY2tlZCBudmxpc3Qgc2l6ZQogICAgIC0JICAgIC0JICAgIC0JICAgIC0J
ICAgIC0JICAgIC0JICAgICAtCWJwb2JqCiAgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgLQkg
ICAgLQkgICAgIC0JYnBvYmogaGVhZGVyCiAgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgLQkg
ICAgLQkgICAgIC0JU1BBIHNwYWNlIG1hcCBoZWFkZXIKICAgMTA4CTEzLjVNCSA0NzZLCTEuMzlN
CTEzLjJLCTI5LjA0CSAgMC4wMAlTUEEgc3BhY2UgbWFwCiAgICAgLQkgICAgLQkgICAgLQkgICAg
LQkgICAgLQkgICAgLQkgICAgIC0JWklMIGludGVudCBsb2cKICAgICAxCSAxMjhLCSAgIDRLCSAg
IDhLCSAgIDhLCTMyLjAwCSAgMC4wMAkgICAgTDUgRE1VIGRub2RlCiAgICAgMQkgMTI4SwkgICA0
SwkgICA4SwkgICA4SwkzMi4wMAkgIDAuMDAJICAgIEw0IERNVSBkbm9kZQogICAgIDEJIDEyOEsJ
ICAgNEsJICAgOEsJICAgOEsJMzIuMDAJICAwLjAwCSAgICBMMyBETVUgZG5vZGUKICAgICAxCSAx
MjhLCSAgIDRLCSAgIDhLCSAgIDhLCTMyLjAwCSAgMC4wMAkgICAgTDIgRE1VIGRub2RlCiAgICAg
MgkgMjU2SwkgIDM2SwkgIDc2SwkgIDM4SwkgNy4xMQkgIDAuMDAJICAgIEwxIERNVSBkbm9kZQog
ICA2MjgJOS44MU0JMi40N00JNS4wN00JOC4yN0sJIDMuOTcJICAwLjAwCSAgICBMMCBETVUgZG5v
ZGUKICAgNjM0CTEwLjZNCTIuNTJNCTUuMThNCTguMzZLCSA0LjE5CSAgMC4wMAlETVUgZG5vZGUK
ICAgICAyCSAgIDhLCSAgIDhLCSAgMjBLCSAgMTBLCSAxLjAwCSAgMC4wMAlETVUgb2Jqc2V0CiAg
ICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgIC0JRFNMIGRpcmVjdG9yeQog
ICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgICAtCURTTCBkaXJlY3Rvcnkg
Y2hpbGQgbWFwCiAgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgIC0JRFNM
IGRhdGFzZXQgc25hcCBtYXAKICAgICAtCSAgICAtCSAgICAtCSAgICAtCSAgICAtCSAgICAtCSAg
ICAgLQlEU0wgcHJvcHMKICAgICAtCSAgICAtCSAgICAtCSAgICAtCSAgICAtCSAgICAtCSAgICAg
LQlEU0wgZGF0YXNldAogICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgICAt
CVpGUyB6bm9kZQogICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgICAtCVpG
UyBWMCBBQ0wKICAgIDYzCTEuOTdNCSAyNTJLCSA1MDRLCSAgIDhLCSA4LjAwCSAgMC4wMAkgICAg
TDIgWkZTIHBsYWluIGZpbGUKIDE0LjNLCSA0NThNCTU5LjZNCSAxMTlNCTguMzJLCSA3LjY5CSAg
MC4wNQkgICAgTDEgWkZTIHBsYWluIGZpbGUKICAyMzRLCSAyMzJHCSAyMzJHCSAyMzJHCTEwMTRL
CSAxLjAwCSA5OS45NAkgICAgTDAgWkZTIHBsYWluIGZpbGUKICAyNDhLCSAyMzJHCSAyMzJHCSAy
MzJHCSA5NTZLCSAxLjAwCSA5OS45OQlaRlMgcGxhaW4gZmlsZQogICAxMjcJMy45N00JIDUwOEsJ
MTAxNksJICAgOEsJIDguMDAJICAwLjAwCSAgICBMMSBaRlMgZGlyZWN0b3J5CiAgIDg2NAk1LjIx
TQkyLjAzTQk1LjkyTQk3LjAySwkgMi41NwkgIDAuMDAJICAgIEwwIFpGUyBkaXJlY3RvcnkKICAg
OTkxCTkuMThNCTIuNTJNCTYuOTFNCTcuMTRLCSAzLjY0CSAgMC4wMAlaRlMgZGlyZWN0b3J5CiAg
ICAgMQkgICAxSwkgICAxSwkgICA4SwkgICA4SwkgMS4wMAkgIDAuMDAJWkZTIG1hc3RlciBub2Rl
CiAgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgIC0JWkZTIGRlbGV0ZSBx
dWV1ZQogICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgICAtCXp2b2wgb2Jq
ZWN0CiAgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgIC0JenZvbCBwcm9w
CiAgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgIC0Jb3RoZXIgdWludDhb
XQogICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgICAtCW90aGVyIHVpbnQ2
NFtdCiAgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgIC0Jb3RoZXIgWkFQ
CiAgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgIC0JcGVyc2lzdGVudCBl
cnJvciBsb2cKICAgICAxCSAxMjhLCSAgIDRLCSAgMTJLCSAgMTJLCTMyLjAwCSAgMC4wMAlTUEEg
aGlzdG9yeQogICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgICAtCVNQQSBo
aXN0b3J5IG9mZnNldHMKICAgICAtCSAgICAtCSAgICAtCSAgICAtCSAgICAtCSAgICAtCSAgICAg
LQlQb29sIHByb3BlcnRpZXMKICAgICAtCSAgICAtCSAgICAtCSAgICAtCSAgICAtCSAgICAtCSAg
ICAgLQlEU0wgcGVybWlzc2lvbnMKICAgICAtCSAgICAtCSAgICAtCSAgICAtCSAgICAtCSAgICAt
CSAgICAgLQlaRlMgQUNMCiAgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAg
IC0JWkZTIFNZU0FDTAogICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgICAt
CUZVSUQgdGFibGUKICAgICAtCSAgICAtCSAgICAtCSAgICAtCSAgICAtCSAgICAtCSAgICAgLQlG
VUlEIHRhYmxlIHNpemUKICAgICAtCSAgICAtCSAgICAtCSAgICAtCSAgICAtCSAgICAtCSAgICAg
LQlEU0wgZGF0YXNldCBuZXh0IGNsb25lcwogICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgIC0J
ICAgIC0JICAgICAtCXNjYW4gd29yayBxdWV1ZQogICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAg
IC0JICAgIC0JICAgICAtCVpGUyB1c2VyL2dyb3VwL3Byb2plY3QgdXNlZAogICAgIC0JICAgIC0J
ICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgICAtCVpGUyB1c2VyL2dyb3VwL3Byb2plY3QgcXVv
dGEKICAgICAtCSAgICAtCSAgICAtCSAgICAtCSAgICAtCSAgICAtCSAgICAgLQlzbmFwc2hvdCBy
ZWZjb3VudCB0YWdzCiAgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgIC0J
RERUIFpBUCBhbGdvcml0aG0KICAgICAtCSAgICAtCSAgICAtCSAgICAtCSAgICAtCSAgICAtCSAg
ICAgLQlERFQgc3RhdGlzdGljcwogICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgIC0J
ICAgICAtCVN5c3RlbSBhdHRyaWJ1dGVzCiAgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgLQkg
ICAgLQkgICAgIC0JU0EgbWFzdGVyIG5vZGUKICAgICAxCTEuNTBLCTEuNTBLCSAgIDhLCSAgIDhL
CSAxLjAwCSAgMC4wMAlTQSBhdHRyIHJlZ2lzdHJhdGlvbgogICAgIDIJICAzMksJICAgOEsJICAx
NksJICAgOEsJIDQuMDAJICAwLjAwCVNBIGF0dHIgbGF5b3V0cwogICAgIC0JICAgIC0JICAgIC0J
ICAgIC0JICAgIC0JICAgIC0JICAgICAtCXNjYW4gdHJhbnNsYXRpb25zCiAgICAgLQkgICAgLQkg
ICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgIC0JZGVkdXBsaWNhdGVkIGJsb2NrCiAgICAgLQkg
ICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgIC0JRFNMIGRlYWRsaXN0IG1hcAogICAg
IC0JICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgICAtCURTTCBkZWFkbGlzdCBtYXAg
aGRyCiAgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgIC0JRFNMIGRpciBj
bG9uZXMKICAgICAtCSAgICAtCSAgICAtCSAgICAtCSAgICAtCSAgICAtCSAgICAgLQlicG9iaiBz
dWJvYmoKICAgICAtCSAgICAtCSAgICAtCSAgICAtCSAgICAtCSAgICAtCSAgICAgLQlkZWZlcnJl
ZCBmcmVlCiAgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgIC0JZGVkdXAg
ZGl0dG8KICAgIDExCSAxNzBLCSAgMjVLCSAxMDhLCTkuODJLCSA2LjgyCSAgMC4wMAlvdGhlcgog
ICAgIDEJIDEyOEsJICAgNEsJICAgOEsJICAgOEsJMzIuMDAJICAwLjAwCSAgICBMNSBUb3RhbAog
ICAgIDEJIDEyOEsJICAgNEsJICAgOEsJICAgOEsJMzIuMDAJICAwLjAwCSAgICBMNCBUb3RhbAog
ICAgIDEJIDEyOEsJICAgNEsJICAgOEsJICAgOEsJMzIuMDAJICAwLjAwCSAgICBMMyBUb3RhbAog
ICAgNjQJMi4wOU0JIDI1NksJIDUxMksJICAgOEsJIDguMzgJICAwLjAwCSAgICBMMiBUb3RhbAog
MTQuNEsJIDQ2Mk0JNjAuMU0JIDEyME0JOC4zMksJIDcuNjkJICAwLjA1CSAgICBMMSBUb3RhbAog
IDIzNksJIDIzMkcJIDIzMkcJIDIzMkcJMTAwOEsJIDEuMDAJIDk5Ljk1CSAgICBMMCBUb3RhbAog
IDI1MEsJIDIzMkcJIDIzMkcJIDIzMkcJIDk1MEsJIDEuMDAJMTAwLjAwCVRvdGFsCgpCbG9jayBT
aXplIEhpc3RvZ3JhbQoKICBibG9jayAgIHBzaXplICAgICAgICAgICAgICAgIGxzaXplICAgICAg
ICAgICAgICAgIGFzaXplCiAgIHNpemUgICBDb3VudCAgIFNpemUgICBDdW0uICBDb3VudCAgIFNp
emUgICBDdW0uICBDb3VudCAgIFNpemUgICBDdW0uCiAgICA1MTI6ICAgIDEzOSAgNjkuNUsgIDY5
LjVLICAgIDEzOSAgNjkuNUsgIDY5LjVLICAgICAgMCAgICAgIDAgICAgICAwCiAgICAgMUs6ICAg
IDI1MSAgIDMwMUsgICAzNzBLICAgIDI1MSAgIDMwMUsgICAzNzBLICAgICAgMCAgICAgIDAgICAg
ICAwCiAgICAgMks6ICAgIDE2NCAgIDQzMksgICA4MDJLICAgIDE2NCAgIDQzMksgICA4MDJLICAg
ICAgMCAgICAgIDAgICAgICAwCiAgICAgNEs6ICAxNS4zSyAgNjEuM00gIDYyLjFNICAgIDE1MiAg
IDg2MksgIDEuNjJNICAgIDE4MyAgIDczMksgICA3MzJLCiAgICAgOEs6ICAgIDQ1OCAgNC44Mk0g
IDY2LjlNICAgIDEwOSAgMS4xNE0gIDIuNzdNICAxNS43SyAgIDEyNk0gICAxMjdNCiAgICAxNks6
ICAgICA2NCAgMS40MU0gIDY4LjRNICAgIDk1NSAgMTUuM00gIDE4LjFNICAgIDQ0OSAgOS4zOE0g
ICAxMzdNCiAgICAzMks6ICAgICA5MSAgNC4xN00gIDcyLjVNICAxNC42SyAgIDQ2OE0gICA0ODZN
ICAgIDEwMCAgNC40OE0gICAxNDFNCiAgICA2NEs6ICAgIDI0OCAgMjUuMU0gIDk3LjZNICAgIDI0
OCAgMjUuMU0gICA1MTFNICAgIDIzNSAgMjMuNU0gICAxNjVNCiAgIDEyOEs6ICAgIDU4MCAgIDEw
N00gICAyMDVNICAgIDY5NiAgIDEyMk0gICA2MzNNICAgIDU4MyAgIDEwN00gICAyNzFNCiAgIDI1
Nks6ICAxLjA0SyAgIDM4Mk0gICA1ODdNICAxLjA0SyAgIDM4Mk0gIDEwMTVNICAxLjA0SyAgIDM4
MU0gICA2NTNNCiAgIDUxMks6ICAxLjQySyAgMS4wNUcgIDEuNjJHICAxLjQySyAgMS4wNUcgIDIu
MDRHICAxLjQzSyAgMS4wNkcgIDEuNjlHCiAgICAgMU06ICAgMjMwSyAgIDIzMEcgICAyMzJHICAg
MjMwSyAgIDIzMEcgICAyMzJHICAgMjMwSyAgIDIzMEcgICAyMzJHCiAgICAgMk06ICAgICAgMCAg
ICAgIDAgICAyMzJHICAgICAgMCAgICAgIDAgICAyMzJHICAgICAgMCAgICAgIDAgICAyMzJHCiAg
ICAgNE06ICAgICAgMCAgICAgIDAgICAyMzJHICAgICAgMCAgICAgIDAgICAyMzJHICAgICAgMCAg
ICAgIDAgICAyMzJHCiAgICAgOE06ICAgICAgMCAgICAgIDAgICAyMzJHICAgICAgMCAgICAgIDAg
ICAyMzJHICAgICAgMCAgICAgIDAgICAyMzJHCiAgICAxNk06ICAgICAgMCAgICAgIDAgICAyMzJH
ICAgICAgMCAgICAgIDAgICAyMzJHICAgICAgMCAgICAgIDAgICAyMzJHCgogICAgICAgICAgICAg
ICAgICAgICAgICAgICAgY2FwYWNpdHkgICBvcGVyYXRpb25zICAgYmFuZHdpZHRoICAtLS0tIGVy
cm9ycyAtLS0tCmRlc2NyaXB0aW9uICAgICAgICAgICAgICAgIHVzZWQgYXZhaWwgIHJlYWQgd3Jp
dGUgIHJlYWQgd3JpdGUgIHJlYWQgd3JpdGUgY2tzdW0KYmVuY2ggICAgICAgICAgICAgICAgICAg
ICAgMjI5RyAyLjUwVCAgIDI1MSAgICAgMCAxMS43TSAgICAgMCAgICAgMCAgICAgMCAgICAgMAog
IC9kZXYvZ3B0aWQvM2MwZjVjYmMtYjBjZS0xMWVhLWFiOTEtYzhjYmI4Y2MzYWQ0ICAgICAgICAg
ICAgICAgICAgICAgICAgICAyMjlHIDIuNTBUICAgMjUxICAgICAwIDExLjdNICAgICAwICAgICAw
ICAgICAwICAgICAwCg==
--00000000000072d31d05d5dba4a4
Content-Type: application/octet-stream; name="zpool-bench-rcd128K.zdb"
Content-Disposition: attachment; filename="zpool-bench-rcd128K.zdb"
Content-Transfer-Encoding: base64
Content-ID: <f_kyk6h5vu1>
X-Attachment-Id: f_kyk6h5vu1

ClRyYXZlcnNpbmcgYWxsIGJsb2NrcyAuLi4KCgoJYnAgY291bnQ6ICAgICAgICAgICAgICAgMTg2
OTk2NQoJZ2FuZ2VkIGNvdW50OiAgICAgICAgICAgICAgICAgMAoJYnAgbG9naWNhbDogICAgICAg
IDI0Mjg0NDI3MjY0MCAgICAgIGF2ZzogMTI5ODY1CglicCBwaHlzaWNhbDogICAgICAgMjQyMjgw
MzU1MzI4ICAgICAgYXZnOiAxMjk1NjQgICAgIGNvbXByZXNzaW9uOiAgIDEuMDAKCWJwIGFsbG9j
YXRlZDogICAgICAyNDI0MjAwMjMyOTYgICAgICBhdmc6IDEyOTYzOCAgICAgY29tcHJlc3Npb246
ICAgMS4wMAoJYnAgZGVkdXBlZDogICAgICAgICAgICAgICAgICAgMCAgICByZWY+MTogICAgICAw
ICAgZGVkdXBsaWNhdGlvbjogICAxLjAwCglOb3JtYWwgY2xhc3M6ICAgICAgMjM1NDYzMTcyMDk2
ICAgICB1c2VkOiAgNy44OCUKCglhZGRpdGlvbmFsLCBub24tcG9pbnRlciBicHMgb2YgdHlwZSAw
OiAgICAgICAgMTcwCgkgbnVtYmVyIG9mIChjb21wcmVzc2VkKSBieXRlczogIG51bWJlciBvZiBi
cHMKCQkJIDI4OiAgICAgMTAgKioqKioqKioqKgoJCQkgMjk6ICAgICAgMiAqKgoJCQkgMzA6ICAg
ICAgMCAKCQkJIDMxOiAgICAgIDAgCgkJCSAzMjogICAgICAxICoKCQkJIDMzOiAgICAgIDAgCgkJ
CSAzNDogICAgICAwIAoJCQkgMzU6ICAgICAgMCAKCQkJIDM2OiAgICAgIDAgCgkJCSAzNzogICAg
ICAwIAoJCQkgMzg6ICAgICAgMCAKCQkJIDM5OiAgICAgIDAgCgkJCSA0MDogICAgICAzICoqKgoJ
CQkgNDE6ICAgICAgMSAqCgkJCSA0MjogICAgICAwIAoJCQkgNDM6ICAgICAgMCAKCQkJIDQ0OiAg
ICAgIDAgCgkJCSA0NTogICAgICAxICoKCQkJIDQ2OiAgICAgIDAgCgkJCSA0NzogICAgICAwIAoJ
CQkgNDg6ICAgICAgMSAqCgkJCSA0OTogICAgICAwIAoJCQkgNTA6ICAgICAgMSAqCgkJCSA1MTog
ICAgICAwIAoJCQkgNTI6ICAgICAgMCAKCQkJIDUzOiAgICAgIDAgCgkJCSA1NDogICAgIDE4ICoq
KioqKioqKioqKioqKioqKgoJCQkgNTU6ICAgICAgMyAqKioKCQkJIDU2OiAgICAgIDAgCgkJCSA1
NzogICAgICAyICoqCgkJCSA1ODogICAgICAwIAoJCQkgNTk6ICAgICAgMCAKCQkJIDYwOiAgICAg
IDAgCgkJCSA2MTogICAgICAxICoKCQkJIDYyOiAgICAgIDMgKioqCgkJCSA2MzogICAgICAwIAoJ
CQkgNjQ6ICAgICAgMyAqKioKCQkJIDY1OiAgICAgIDIgKioKCQkJIDY2OiAgICAgIDEgKgoJCQkg
Njc6ICAgICAgMyAqKioKCQkJIDY4OiAgICAgIDAgCgkJCSA2OTogICAgICAxICoKCQkJIDcwOiAg
ICAgIDAgCgkJCSA3MTogICAgICAwIAoJCQkgNzI6ICAgICAgMSAqCgkJCSA3MzogICAgIDM1ICoq
KioqKioqKioqKioqKioqKioqKioqKioqKioqKioqKioqCgkJCSA3NDogICAgICA4ICoqKioqKioq
CgkJCSA3NTogICAgICA0ICoqKioKCQkJIDc2OiAgICAgIDIgKioKCQkJIDc3OiAgICAgIDIgKioK
CQkJIDc4OiAgICAgIDMgKioqCgkJCSA3OTogICAgICAxICoKCQkJIDgwOiAgICAgIDMgKioqCgkJ
CSA4MTogICAgICAwIAoJCQkgODI6ICAgICAgMiAqKgoJCQkgODM6ICAgICAgMSAqCgkJCSA4NDog
ICAgICAwIAoJCQkgODU6ICAgICAgMiAqKgoJCQkgODY6ICAgICAgMiAqKgoJCQkgODc6ICAgICAg
NCAqKioqCgkJCSA4ODogICAgICAxICoKCQkJIDg5OiAgICAgIDAgCgkJCSA5MDogICAgICAxICoK
CQkJIDkxOiAgICAgIDIgKioKCQkJIDkyOiAgICAgIDIgKioKCQkJIDkzOiAgICAgIDEgKgoJCQkg
OTQ6ICAgICAgMSAqCgkJCSA5NTogICAgICAzICoqKgoJCQkgOTY6ICAgICAgMSAqCgkJCSA5Nzog
ICAgICAxICoKCQkJIDk4OiAgICAgIDggKioqKioqKioKCQkJIDk5OiAgICAgIDEgKgoJCQkxMDA6
ICAgICAgMiAqKgoJCQkxMDE6ICAgICAgMSAqCgkJCTEwMjogICAgICAxICoKCQkJMTAzOiAgICAg
IDIgKioKCQkJMTA0OiAgICAgIDAgCgkJCTEwNTogICAgICAyICoqCgkJCTEwNjogICAgICAyICoq
CgkJCTEwNzogICAgICA1ICoqKioqCgkJCTEwODogICAgICAzICoqKgoJCQkxMDk6ICAgICAgMCAK
CQkJMTEwOiAgICAgIDEgKgoJCQkxMTE6ICAgICAgMSAqCgkJCTExMjogICAgICAxICoKCURpdHRv
ZWQgYmxvY2tzIG9uIHNhbWUgdmRldjogMjE4OTEKCkJsb2NrcwlMU0laRQlQU0laRQlBU0laRQkg
IGF2ZwkgY29tcAklVG90YWwJVHlwZQogICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAg
IC0JICAgICAtCXVuYWxsb2NhdGVkCiAgICAgMgkgIDMySwkgICA4SwkgIDI0SwkgIDEySwkgNC4w
MAkgIDAuMDAJb2JqZWN0IGRpcmVjdG9yeQogICAgIDEJICA1MTIJICA1MTIJICAxMksJICAxMksJ
IDEuMDAJICAwLjAwCW9iamVjdCBhcnJheQogICAgIDEJICAxNksJICAgNEsJICAxMksJICAxMksJ
IDQuMDAJICAwLjAwCXBhY2tlZCBudmxpc3QKICAgICAtCSAgICAtCSAgICAtCSAgICAtCSAgICAt
CSAgICAtCSAgICAgLQlwYWNrZWQgbnZsaXN0IHNpemUKICAgICAtCSAgICAtCSAgICAtCSAgICAt
CSAgICAtCSAgICAtCSAgICAgLQlicG9iagogICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgIC0J
ICAgIC0JICAgICAtCWJwb2JqIGhlYWRlcgogICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgIC0J
ICAgIC0JICAgICAtCVNQQSBzcGFjZSBtYXAgaGVhZGVyCiAgIDEwMgkxMi44TQkgNDUySwkxLjMy
TQkxMy4zSwkyOC44OAkgIDAuMDAJU1BBIHNwYWNlIG1hcAogICAgIC0JICAgIC0JICAgIC0JICAg
IC0JICAgIC0JICAgIC0JICAgICAtCVpJTCBpbnRlbnQgbG9nCiAgICAgMQkgMTI4SwkgICA0Swkg
ICA4SwkgICA4SwkzMi4wMAkgIDAuMDAJICAgIEw1IERNVSBkbm9kZQogICAgIDEJIDEyOEsJICAg
NEsJICAgOEsJICAgOEsJMzIuMDAJICAwLjAwCSAgICBMNCBETVUgZG5vZGUKICAgICAxCSAxMjhL
CSAgIDRLCSAgIDhLCSAgIDhLCTMyLjAwCSAgMC4wMAkgICAgTDMgRE1VIGRub2RlCiAgICAgMQkg
MTI4SwkgICA0SwkgICA4SwkgICA4SwkzMi4wMAkgIDAuMDAJICAgIEwyIERNVSBkbm9kZQogICAg
IDIJIDI1NksJICAzNksJICA3NksJICAzOEsJIDcuMTEJICAwLjAwCSAgICBMMSBETVUgZG5vZGUK
ICAgNjIxCTkuNzBNCTIuNDVNCTQuOTlNCTguMjNLCSAzLjk3CSAgMC4wMAkgICAgTDAgRE1VIGRu
b2RlCiAgIDYyNwkxMC41TQkyLjUwTQk1LjEwTQk4LjMzSwkgNC4xOQkgIDAuMDAJRE1VIGRub2Rl
CiAgICAgMgkgICA4SwkgICA4SwkgIDIwSwkgIDEwSwkgMS4wMAkgIDAuMDAJRE1VIG9ianNldAog
ICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgICAtCURTTCBkaXJlY3RvcnkK
ICAgICAtCSAgICAtCSAgICAtCSAgICAtCSAgICAtCSAgICAtCSAgICAgLQlEU0wgZGlyZWN0b3J5
IGNoaWxkIG1hcAogICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgICAtCURT
TCBkYXRhc2V0IHNuYXAgbWFwCiAgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgLQkg
ICAgIC0JRFNMIHByb3BzCiAgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAg
IC0JRFNMIGRhdGFzZXQKICAgICAtCSAgICAtCSAgICAtCSAgICAtCSAgICAtCSAgICAtCSAgICAg
LQlaRlMgem5vZGUKICAgICAtCSAgICAtCSAgICAtCSAgICAtCSAgICAtCSAgICAtCSAgICAgLQla
RlMgVjAgQUNMCiAgIDI2Ngk4LjMxTQkxLjA2TQkyLjEyTQk4LjE4SwkgNy44MgkgIDAuMDAJICAg
IEwyIFpGUyBwbGFpbiBmaWxlCiAxOS42SwkgNjI2TQkgMTIzTQkgMjQ1TQkxMi41SwkgNS4xMAkg
IDAuMTEJICAgIEwxIFpGUyBwbGFpbiBmaWxlCiAxLjc2TQkgMjI2RwkgMjI2RwkgMjI2RwkgMTI4
SwkgMS4wMAkgOTkuODkJICAgIEwwIFpGUyBwbGFpbiBmaWxlCiAxLjc4TQkgMjI2RwkgMjI2Rwkg
MjI2RwkgMTI3SwkgMS4wMAkgOTkuOTkJWkZTIHBsYWluIGZpbGUKICAgMTI3CTMuOTdNCSA1MDhL
CTEwMTZLCSAgIDhLCSA4LjAwCSAgMC4wMAkgICAgTDEgWkZTIGRpcmVjdG9yeQogICA4NjQJNS4y
MU0JMi4wMk0JNS45MU0JNy4wMUsJIDIuNTgJICAwLjAwCSAgICBMMCBaRlMgZGlyZWN0b3J5CiAg
IDk5MQk5LjE4TQkyLjUyTQk2LjkxTQk3LjE0SwkgMy42NAkgIDAuMDAJWkZTIGRpcmVjdG9yeQog
ICAgIDEJICAgMUsJICAgMUsJICAgOEsJICAgOEsJIDEuMDAJICAwLjAwCVpGUyBtYXN0ZXIgbm9k
ZQogICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgICAtCVpGUyBkZWxldGUg
cXVldWUKICAgICAtCSAgICAtCSAgICAtCSAgICAtCSAgICAtCSAgICAtCSAgICAgLQl6dm9sIG9i
amVjdAogICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgICAtCXp2b2wgcHJv
cAogICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgICAtCW90aGVyIHVpbnQ4
W10KICAgICAtCSAgICAtCSAgICAtCSAgICAtCSAgICAtCSAgICAtCSAgICAgLQlvdGhlciB1aW50
NjRbXQogICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgICAtCW90aGVyIFpB
UAogICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgICAtCXBlcnNpc3RlbnQg
ZXJyb3IgbG9nCiAgICAgMQkgMTI4SwkgICA0SwkgIDEySwkgIDEySwkzMi4wMAkgIDAuMDAJU1BB
IGhpc3RvcnkKICAgICAtCSAgICAtCSAgICAtCSAgICAtCSAgICAtCSAgICAtCSAgICAgLQlTUEEg
aGlzdG9yeSBvZmZzZXRzCiAgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAg
IC0JUG9vbCBwcm9wZXJ0aWVzCiAgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgLQkg
ICAgIC0JRFNMIHBlcm1pc3Npb25zCiAgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAg
LQkgICAgIC0JWkZTIEFDTAogICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAg
ICAtCVpGUyBTWVNBQ0wKICAgICAtCSAgICAtCSAgICAtCSAgICAtCSAgICAtCSAgICAtCSAgICAg
LQlGVUlEIHRhYmxlCiAgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgIC0J
RlVJRCB0YWJsZSBzaXplCiAgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAg
IC0JRFNMIGRhdGFzZXQgbmV4dCBjbG9uZXMKICAgICAtCSAgICAtCSAgICAtCSAgICAtCSAgICAt
CSAgICAtCSAgICAgLQlzY2FuIHdvcmsgcXVldWUKICAgICAtCSAgICAtCSAgICAtCSAgICAtCSAg
ICAtCSAgICAtCSAgICAgLQlaRlMgdXNlci9ncm91cC9wcm9qZWN0IHVzZWQKICAgICAtCSAgICAt
CSAgICAtCSAgICAtCSAgICAtCSAgICAtCSAgICAgLQlaRlMgdXNlci9ncm91cC9wcm9qZWN0IHF1
b3RhCiAgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgIC0Jc25hcHNob3Qg
cmVmY291bnQgdGFncwogICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgICAt
CUREVCBaQVAgYWxnb3JpdGhtCiAgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgLQkg
ICAgIC0JRERUIHN0YXRpc3RpY3MKICAgICAtCSAgICAtCSAgICAtCSAgICAtCSAgICAtCSAgICAt
CSAgICAgLQlTeXN0ZW0gYXR0cmlidXRlcwogICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgIC0J
ICAgIC0JICAgICAtCVNBIG1hc3RlciBub2RlCiAgICAgMQkxLjUwSwkxLjUwSwkgICA4SwkgICA4
SwkgMS4wMAkgIDAuMDAJU0EgYXR0ciByZWdpc3RyYXRpb24KICAgICAyCSAgMzJLCSAgIDhLCSAg
MTZLCSAgIDhLCSA0LjAwCSAgMC4wMAlTQSBhdHRyIGxheW91dHMKICAgICAtCSAgICAtCSAgICAt
CSAgICAtCSAgICAtCSAgICAtCSAgICAgLQlzY2FuIHRyYW5zbGF0aW9ucwogICAgIC0JICAgIC0J
ICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgICAtCWRlZHVwbGljYXRlZCBibG9jawogICAgIC0J
ICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgICAtCURTTCBkZWFkbGlzdCBtYXAKICAg
ICAtCSAgICAtCSAgICAtCSAgICAtCSAgICAtCSAgICAtCSAgICAgLQlEU0wgZGVhZGxpc3QgbWFw
IGhkcgogICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgICAtCURTTCBkaXIg
Y2xvbmVzCiAgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgIC0JYnBvYmog
c3Vib2JqCiAgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgIC0JZGVmZXJy
ZWQgZnJlZQogICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgICAtCWRlZHVw
IGRpdHRvCiAgICAxMQkgMTcwSwkyNC41SwkgIDk2Swk4LjczSwkgNi45NgkgIDAuMDAJb3RoZXIK
ICAgICAxCSAxMjhLCSAgIDRLCSAgIDhLCSAgIDhLCTMyLjAwCSAgMC4wMAkgICAgTDUgVG90YWwK
ICAgICAxCSAxMjhLCSAgIDRLCSAgIDhLCSAgIDhLCTMyLjAwCSAgMC4wMAkgICAgTDQgVG90YWwK
ICAgICAxCSAxMjhLCSAgIDRLCSAgIDhLCSAgIDhLCTMyLjAwCSAgMC4wMAkgICAgTDMgVG90YWwK
ICAgMjY3CTguNDRNCTEuMDdNCTIuMTNNCTguMThLCSA3LjkxCSAgMC4wMAkgICAgTDIgVG90YWwK
IDE5LjdLCSA2MzBNCSAxMjNNCSAyNDdNCTEyLjVLCSA1LjExCSAgMC4xMQkgICAgTDEgVG90YWwK
IDEuNzZNCSAyMjZHCSAyMjZHCSAyMjZHCSAxMjhLCSAxLjAwCSA5OS44OQkgICAgTDAgVG90YWwK
IDEuNzhNCSAyMjZHCSAyMjZHCSAyMjZHCSAxMjdLCSAxLjAwCTEwMC4wMAlUb3RhbAoKQmxvY2sg
U2l6ZSBIaXN0b2dyYW0KCiAgYmxvY2sgICBwc2l6ZSAgICAgICAgICAgICAgICBsc2l6ZSAgICAg
ICAgICAgICAgICBhc2l6ZQogICBzaXplICAgQ291bnQgICBTaXplICAgQ3VtLiAgQ291bnQgICBT
aXplICAgQ3VtLiAgQ291bnQgICBTaXplICAgQ3VtLgogICAgNTEyOiAgICAxMzggICAgNjlLICAg
IDY5SyAgICAxMzggICAgNjlLICAgIDY5SyAgICAgIDAgICAgICAwICAgICAgMAogICAgIDFLOiAg
ICAyNTEgICAzMDFLICAgMzcwSyAgICAyNTEgICAzMDFLICAgMzcwSyAgICAgIDAgICAgICAwICAg
ICAgMAogICAgIDJLOiAgICAxNjQgICA0MzJLICAgODAySyAgICAxNjQgICA0MzJLICAgODAySyAg
ICAgIDAgICAgICAwICAgICAgMAogICAgIDRLOiAgMTQuMEsgIDU2LjFNICA1Ni44TSAgICAxNTIg
ICA4NjJLICAxLjYyTSAgICAxODMgICA3MzJLICAgNzMySwogICAgIDhLOiAgNy4yMEsgIDc0LjBN
ICAgMTMxTSAgICAxMDkgIDEuMTRNICAyLjc3TSAgMTQuNEsgICAxMTZNICAgMTE3TQogICAgMTZL
OiAgICAgNjMgIDEuNDBNICAgMTMyTSAgICA5NDggIDE1LjJNICAxOC4wTSAgNy4xOUsgICAxNDhN
ICAgMjY0TQogICAgMzJLOiAgICAgOTEgIDQuMTdNICAgMTM2TSAgMjAuMEsgICA2NDJNICAgNjYw
TSAgICAxMDAgIDQuNDZNICAgMjY5TQogICAgNjRLOiAgICAyNDggIDI1LjFNICAgMTYyTSAgICAy
NDggIDI1LjFNICAgNjg2TSAgICAyMzUgIDIzLjVNICAgMjkyTQogICAxMjhLOiAgMS43Nk0gICAy
MjVHICAgMjI2RyAgMS43Nk0gICAyMjVHICAgMjI2RyAgMS43Nk0gICAyMjVHICAgMjI2RwogICAy
NTZLOiAgICAgIDAgICAgICAwICAgMjI2RyAgICAgIDAgICAgICAwICAgMjI2RyAgICAgIDAgICAg
ICAwICAgMjI2RwogICA1MTJLOiAgICAgIDAgICAgICAwICAgMjI2RyAgICAgIDAgICAgICAwICAg
MjI2RyAgICAgIDAgICAgICAwICAgMjI2RwogICAgIDFNOiAgICAgIDAgICAgICAwICAgMjI2RyAg
ICAgIDAgICAgICAwICAgMjI2RyAgICAgIDAgICAgICAwICAgMjI2RwogICAgIDJNOiAgICAgIDAg
ICAgICAwICAgMjI2RyAgICAgIDAgICAgICAwICAgMjI2RyAgICAgIDAgICAgICAwICAgMjI2Rwog
ICAgIDRNOiAgICAgIDAgICAgICAwICAgMjI2RyAgICAgIDAgICAgICAwICAgMjI2RyAgICAgIDAg
ICAgICAwICAgMjI2RwogICAgIDhNOiAgICAgIDAgICAgICAwICAgMjI2RyAgICAgIDAgICAgICAw
ICAgMjI2RyAgICAgIDAgICAgICAwICAgMjI2RwogICAgMTZNOiAgICAgIDAgICAgICAwICAgMjI2
RyAgICAgIDAgICAgICAwICAgMjI2RyAgICAgIDAgICAgICAwICAgMjI2RwoKICAgICAgICAgICAg
ICAgICAgICAgICAgICAgIGNhcGFjaXR5ICAgb3BlcmF0aW9ucyAgIGJhbmR3aWR0aCAgLS0tLSBl
cnJvcnMgLS0tLQpkZXNjcmlwdGlvbiAgICAgICAgICAgICAgICB1c2VkIGF2YWlsICByZWFkIHdy
aXRlICByZWFkIHdyaXRlICByZWFkIHdyaXRlIGNrc3VtCmJlbmNoICAgICAgICAgICAgICAgICAg
ICAgIDIxOUcgMi41MFQgICAzMzAgICAgIDAgOC45MU0gICAgIDAgICAgIDAgICAgIDAgICAgIDAK
ICAvZGV2L2dwdGlkLzNjMGY1Y2JjLWIwY2UtMTFlYS1hYjkxLWM4Y2JiOGNjM2FkNCAgICAgICAg
ICAgICAgICAgICAgICAgICAgMjE5RyAyLjUwVCAgIDMzMCAgICAgMCA4LjkxTSAgICAgMCAgICAg
MCAgICAgMCAgICAgMAo=
--00000000000072d31d05d5dba4a4--



Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?CADzRhsEsZMGE-SoeWLMG9NTtkwhhy6OGQQ046m9AxGFbp5h_kQ>