Date: Tue, 03 Apr 2012 15:22:05 +0200 From: Peter Maloney <peter.maloney@brockmann-consult.de> To: Volodymyr Kostyrko <c.kworr@gmail.com> Cc: freebsd-fs@freebsd.org Subject: Re: ZFS v28 and free space leakage Message-ID: <4F7AF97D.7060307@brockmann-consult.de> In-Reply-To: <4F7AB858.3030709@gmail.com> References: <4F75C7EC.30606@gmail.com> <4F75E05D.2060206@brockmann-consult.de> <4F7AB858.3030709@gmail.com>
next in thread | previous in thread | raw e-mail | index | archive | help
This is a multi-part message in MIME format. --------------020307070107060600020708 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit On 04/03/2012 10:44 AM, Volodymyr Kostyrko wrote: > Peter Maloney wrote: >> To prove there is a leak, you would need to fill up the disk, delete >> everything, and then fill it again to see if it fit less. If I did such >> a test and it was the same, I would just forget about the problem. > > kk, throwing junk in: > > # zpool list > NAME SIZE ALLOC FREE CAP DEDUP HEALTH ALTROOT > kohrah1 136G 22,4M 136G 0% 1.00x ONLINE - > kohrah1new 136G 2,29G 134G 1% 1.00x ONLINE - > # find /kohrah1new/ | wc -l > 150590 > # rm -rf /kohrah1new/* > # find /kohrah1new/ > /kohrah1new/ > # zpool list > NAME SIZE ALLOC FREE CAP DEDUP HEALTH ALTROOT > kohrah1 136G 22,4M 136G 0% 1.00x ONLINE - > kohrah1new 136G 436K 136G 0% 1.00x ONLINE - > > Not a same test you ask but it seems that ZFS leaks on metadata. Or > peruses them. Repeating the same tasks results in: Yes, my test was suggested so you would really fill it to the limit, and then delete and refill. It was expected that when removing, the "ALLOC" is high still, but the hypothesis was that it is just blank allocated space for data that doesn't exist, and will be reused when it is filled again. So to test what I wanted, you really need to fill it to the max twice. I thought you would do this since your pool is only 136 GB. So I decided to try it in a virtual machine, with a very small disk (700 MB slice). The result is attached. The conclusion is that the space is not really missing... if anything is missing it is probably less than a kilobyte after filling and removing all more than 11 times, probably 40 or 50 times. > > # zpool list > NAME SIZE ALLOC FREE CAP DEDUP HEALTH ALTROOT > kohrah1 136G 22,4M 136G 0% 1.00x ONLINE - > kohrah1new 136G 336K 136G 0% 1.00x ONLINE - > > So this feels like some leftover. --------------020307070107060600020708 Content-Type: text/plain; charset=UTF-8; name="zfsSpaceLeakExperiment.txt" Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="zfsSpaceLeakExperiment.txt" PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT0KemZzIHNwYWNlIGxlYWsgZXhwZXJp bWVudAo9PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PQoKUHJlcGFyZToKCltyb290 QGJjemZzdm0xdGVzdCAvdGVzdF0jIHVuYW1lIC1hCkZyZWVCU0QgYmN6ZnN2bTF0ZXN0LmJj LmxvY2FsIDguMi1TVEFCTEUtMjAxMjAyMDQgRnJlZUJTRCA4LjItU1RBQkxFLTIwMTIwMjA0 ICMwOiBNb24gRmViICA2IDEyOjEwOjMyIFVUQyAyMDEyICAgICByb290QGJjemZzdm0xLmJj LmxvY2FsOi91c3Ivb2JqL3Vzci9zcmMvc3lzL0dFTkVSSUMgIGFtZDY0Cgpbcm9vdEBiY3pm c3ZtMXRlc3Qgfl0jIHpwb29sIGNyZWF0ZSB0ZXN0IGRhMiAgICAgICAgICAgIAoKW3Jvb3RA YmN6ZnN2bTF0ZXN0IH5dIyB6cG9vbCBsaXN0IHRlc3QgICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgIApOQU1FICAgU0laRSAgQUxMT0MgICBGUkVFICAgIENB UCAgREVEVVAgIEhFQUxUSCAgQUxUUk9PVCAgICAgICAgICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgCnRl c3QgIDE5LjlHICA3OC41SyAgMTkuOUcgICAgIDAlICAxLjAweCAgT05MSU5FICAtICAgICAg ICAgICAgCgpbcm9vdEBiY3pmc3ZtMXRlc3Qgfl0jIHpmcyBsaXN0IHRlc3QKTkFNRSAgIFVT RUQgIEFWQUlMICBSRUZFUiAgTU9VTlRQT0lOVAp0ZXN0ICAgIDkxSyAgMTkuNkcgICAgMzFL ICAvdGVzdAoKW3Jvb3RAYmN6ZnN2bTF0ZXN0IH5dIyBjZCAvdGVzdApbcm9vdEBiY3pmc3Zt MXRlc3Qgfl0jIGNobW9kIHVnbz1yd3ggLgoKPT09PT09PT09PT09PT09PT09PT09PT09PT09 PT09CnRlc3QxYQo9PT09PT09PT09PT09PT09PT09PT09PT09PT09PT0KCltyb290QGJjemZz dm0xdGVzdCAvdGVzdF0jIGNwIH4vRnJlZUJTRC04LjItU1RBQkxFLTIwMTIwMjA0LmlzbyAx CmNwOiAxOiBObyBzcGFjZSBsZWZ0IG9uIGRldmljZQoKW3Jvb3RAYmN6ZnN2bTF0ZXN0IC90 ZXN0XSMgbHMgLWwgCnRvdGFsIDY3NTE3Ngotcnctci0tci0tICAxIHJvb3QgIHdoZWVsICA2 OTA4ODA1MTIgRmViIDIyIDE3OjUxIDEKCltyb290QGJjemZzdm0xdGVzdCAvdGVzdF0jIHpm cyBsaXN0IHRlc3QKTkFNRSAgICBVU0VEICBBVkFJTCAgUkVGRVIgIE1PVU5UUE9JTlQKdGVz dCAgIDY2ME0gICAgICAwICAgNjU5TSAgL3Rlc3QKCltyb290QGJjemZzdm0xdGVzdCAvdGVz dF0jIHJtIDEKCj09PT09PT09PT09PT09PT09PT09PT09PT09PT09PQp0ZXN0MWIKPT09PT09 PT09PT09PT09PT09PT09PT09PT09PT09Cgpbcm9vdEBiY3pmc3ZtMXRlc3QgL3Rlc3RdIyBj cCAvdGVzdC9GcmVlQlNELTguMi1TVEFCTEUtMjAxMjAyMDQuaXNvIDIKY3A6IDI6IE5vIHNw YWNlIGxlZnQgb24gZGV2aWNlCgpbcm9vdEBiY3pmc3ZtMXRlc3QgL3Rlc3RdIyBscyAtbAp0 b3RhbCA2NzUxNzcKLXJ3LXItLXItLSAgMSByb290ICB3aGVlbCAgNjkwODgwNTEyIEZlYiAy MiAxNzo1MiAyCgpbcm9vdEBiY3pmc3ZtMXRlc3QgL3Rlc3RdIyB6ZnMgbGlzdCB0ZXN0Ck5B TUUgICAgVVNFRCAgQVZBSUwgIFJFRkVSICBNT1VOVFBPSU5UCnRlc3QgICA2NjBNICAgICAg MCAgIDY1OU0gIC90ZXN0Cgpbcm9vdEBiY3pmc3ZtMXRlc3QgL3Rlc3RdIyBybSAyCgo9PT09 PT09PT09PT09PT09PT09PT09PT09PT09PT0KdGVzdDJhCj09PT09PT09PT09PT09PT09PT09 PT09PT09PT09PQoKW3Jvb3RAYmN6ZnN2bTF0ZXN0IC90ZXN0XSMgZm9yIGEgaW4gezEuLjEw fTsgZG8gbWtkaXIgJGE7IGRvbmUKCltyb290QGJjemZzdm0xdGVzdCAvdGVzdF0jIGZvciBh IGluIHsxLi4xMH07IGRvIG1rZGlyICRhOyBmb3IgYiBpbiB7MS4uNTAwMH07IGRvIGRkIGlm PS9kZXYvcmFuZG9tIG9mPSRhLyRiIGJzPTEyOGsgY291bnQ9MTA7IGRvbmU7IGRvbmUKCi4u LihydW5zIGxvbmcpCmRkOiAxLzEyMjc6IE5vIHNwYWNlIGxlZnQgb24gZGV2aWNlCgpbcm9v dEBiY3pmc3ZtMXRlc3QgL3Rlc3RdIyBkdSAtc3hjICoKNjc1MzkyICAxCjIgICAgICAgMTAK MiAgICAgICAyCjIgICAgICAgMwoyICAgICAgIDQKMiAgICAgICA1CjIgICAgICAgNgoyICAg ICAgIDcKMiAgICAgICA4CjIgICAgICAgOQo2NzU0MDUgIHRvdGFsCgpbcm9vdEBiY3pmc3Zt MXRlc3QgL3Rlc3RdIyB6ZnMgbGlzdCB0ZXN0Ck5BTUUgICAgVVNFRCAgQVZBSUwgIFJFRkVS ICBNT1VOVFBPSU5UCnRlc3QgICA2NjBNICAgMTg4SyAgIDY1OU0gIC90ZXN0Cgpbcm9vdEBi Y3pmc3ZtMXRlc3QgL3Rlc3RdIyB6cG9vbCBsaXN0IHRlc3QKTkFNRSAgICBTSVpFICBBTExP QyAgIEZSRUUgICAgQ0FQICBERURVUCAgSEVBTFRIICBBTFRST09UCnRlc3QgICA2OTJNICAg NjYwTSAgMzIuMU0gICAgOTUlICAxLjAweCAgT05MSU5FICAtCgpbcm9vdEBiY3pmc3ZtMXRl c3QgL3Rlc3RdIyBybSAtcmYgKgoKW3Jvb3RAYmN6ZnN2bTF0ZXN0IC90ZXN0XSMgemZzIGxp c3QgdGVzdApOQU1FICAgIFVTRUQgIEFWQUlMICBSRUZFUiAgTU9VTlRQT0lOVAp0ZXN0ICAg NDI0SyAgIDY2ME0gICAgMzFLICAvdGVzdAoKW3Jvb3RAYmN6ZnN2bTF0ZXN0IC90ZXN0XSMg enBvb2wgbGlzdCB0ZXN0Ck5BTUUgICAgU0laRSAgQUxMT0MgICBGUkVFICAgIENBUCAgREVE VVAgIEhFQUxUSCAgQUxUUk9PVAp0ZXN0ICAgNjkyTSAgIDQ2MEsgICA2OTJNICAgICAwJSAg MS4wMHggIE9OTElORSAgLQoKPT09PT09PT09PT09PT09PT09PT09PT09PT09PT09CnRlc3Qy Ygo9PT09PT09PT09PT09PT09PT09PT09PT09PT09PT0KCltyb290QGJjemZzdm0xdGVzdCAv dGVzdF0jIGZvciBhIGluIHsxLi4xMH07IGRvIG1rZGlyICRhOyBmb3IgYiBpbiB7MS4uNTAw MH07IGRvIGRkIGlmPS9kZXYvcmFuZG9tIG9mPSRhLyRiIGJzPTEyOGsgY291bnQ9MTA7IGRv bmU7IGRvbmUKCi4uLihydW5zIGxvbmcpCmRkOiAxLzk3NzogTm8gc3BhY2UgbGVmdCBvbiBk ZXZpY2UKCltyb290QGJjemZzdm0xdGVzdCAvdGVzdF0jIGR1IC1zeGMgKgo2NzUzOTEgIDEK Njc1MzkxICB0b3RhbAoKW3Jvb3RAYmN6ZnN2bTF0ZXN0IC90ZXN0XSMgemZzIGxpc3QgdGVz dApOQU1FICAgIFVTRUQgIEFWQUlMICBSRUZFUiAgTU9VTlRQT0lOVAp0ZXN0ICAgNjYwTSAg ICAgIDAgICA2NTlNICAvdGVzdAoKW3Jvb3RAYmN6ZnN2bTF0ZXN0IC90ZXN0XSMgenBvb2wg bGlzdCB0ZXN0Ck5BTUUgICAgU0laRSAgQUxMT0MgICBGUkVFICAgIENBUCAgREVEVVAgIEhF QUxUSCAgQUxUUk9PVAp0ZXN0ICAgNjkyTSAgIDY2ME0gIDMxLjhNICAgIDk1JSAgMS4wMHgg IE9OTElORSAgLQoKW3Jvb3RAYmN6ZnN2bTF0ZXN0IC90ZXN0XSMgcm0gLXJmICoKCltyb290 QGJjemZzdm0xdGVzdCAvdGVzdF0jIHpmcyBsaXN0IHRlc3QKTkFNRSAgICBVU0VEICBBVkFJ TCAgUkVGRVIgIE1PVU5UUE9JTlQKdGVzdCAgIDQyMEsgICA2NjBNICAgIDMxSyAgL3Rlc3QK Cltyb290QGJjemZzdm0xdGVzdCAvdGVzdF0jIHpwb29sIGxpc3QgdGVzdApOQU1FICAgIFNJ WkUgIEFMTE9DICAgRlJFRSAgICBDQVAgIERFRFVQICBIRUFMVEggIEFMVFJPT1QKdGVzdCAg IDY5Mk0gICA0NTZLICAgNjkyTSAgICAgMCUgIDEuMDB4ICBPTkxJTkUgIC0KCj09PT09PT09 PT09PT09PT09PT09PT09PT09PT09PQp0ZXN0MmMKPT09PT09PT09PT09PT09PT09PT09PT09 PT09PT09Cgpbcm9vdEBiY3pmc3ZtMXRlc3QgL3Rlc3RdIyBmb3IgYSBpbiB7MS4uMTB9OyBk byBta2RpciAkYTsgZm9yIGIgaW4gezEuLjUwMDB9OyBkbyBkZCBpZj0vZGV2L3JhbmRvbSBv Zj0kYS8kYiBicz0xMjhrIGNvdW50PTEwOyBkb25lOyBkb25lCgouLi4ocnVucyBsb25nKQpk ZDogMS8xMTkyOiBObyBzcGFjZSBsZWZ0IG9uIGRldmljZQoKW3Jvb3RAYmN6ZnN2bTF0ZXN0 IC90ZXN0XSMgZHUgLXN4YyAqCjY3NTM4MCAgMQo2NzUzODAgIHRvdGFsCgpbcm9vdEBiY3pm c3ZtMXRlc3QgL3Rlc3RdIyB4PTE7IHdoaWxlIHRydWU7IGRvIHRvdWNoIGJsYWhfJHg7IGxl dCB4Kys7IGRvbmUKCltyb290QGJjemZzdm0xdGVzdCAvdGVzdF0jIGR1IC1zeGMgKgo2NzUz ODAgIDEKNjc1MzgwICB0b3RhbAoKW3Jvb3RAYmN6ZnN2bTF0ZXN0IC90ZXN0XSMgcm0gLXJm IC90ZXN0LyoKCihzbyBmYXIsIGl0IGxvb2tzIGxpa2UgYSB2ZXJ5IHNtYWxsIGFtb3VudCBi ZXR3ZWVuIDExIGtCIGFuZCAxNCBrQiBpcyBsb3N0IGV2ZXJ5IHRpbWUpCgo9PT09PT09PT09 PT09PT09PT09PT09PT09PT09PT0KdGVzdDMKPT09PT09PT09PT09PT09PT09PT09PT09PT09 PT09CgpydW49MQpybSAtcmYgL3Rlc3QvKgp3aGlsZSB0cnVlOyBkbwogICAgZWNobyAiPT09 PT09PT09PT09PSIKICAgIGVjaG8gIlJ1biAjJHJ1biIKCiAgICBmdWxsPTAKICAgIGZvciBh IGluIHsxLi4xMH07IGRvIAogICAgICAgIG1rZGlyICRhCiAgICAgICAgZm9yIGIgaW4gezEu LjUwMH07IGRvIAogICAgICAgICAgICBkZCBpZj0vZGV2L3JhbmRvbSBvZj0kYS8kYiBicz0x MjhrIGNvdW50PTEwID4vZGV2L251bGwgMj4mMQogICAgICAgICAgICBpZiBbICIkPyIgIT0g MCBdOyB0aGVuCiAgICAgICAgICAgICAgICBmdWxsPTEKICAgICAgICAgICAgZmkKICAgICAg ICBkb25lCiAgICAgICAgaWYgWyAiJGZ1bGwiID0gMSBdOyB0aGVuCiAgICAgICAgICAgIGJy ZWFrCiAgICAgICAgZmkKICAgIGRvbmUKCiAgICBlY2hvICJGdWxsOiIKICAgIGR1IC1zeCAv dGVzdAogICAgemZzIGxpc3QgdGVzdAogICAgenBvb2wgbGlzdCB0ZXN0CgogICAgcm0gLXJm IC90ZXN0LyoKICAgIHNsZWVwIDMwCgogICAgZWNobyAiQ2xlYXI6IgogICAgemZzIGxpc3Qg dGVzdAogICAgenBvb2wgbGlzdCB0ZXN0CiAgICAKICAgIGxldCBydW4rKwpkb25lCgpvbGQg cnVuIHdpdGggdmVyc2lvbiAxIG9mIHRoZSBzY3JpcHQgKG9ubHkgZHUgb3V0cHV0KToKCjY3 NTI4MyAgMQo2NzUyODMgIHRvdGFsCjY3NTM4NyAgMQo2NzUzODcgIHRvdGFsCjY3NTI2NiAg MQo2NzUyNjYgIHRvdGFsCjY3NTUyMCAgMQo2NzU1MjAgIHRvdGFsCjY3NTM5OSAgMQo2NzUz OTkgIHRvdGFsCjY3NTI3MiAgMQo2NzUyNzIgIHRvdGFsCjY3NTM5MiAgMQo2NzUzOTIgIHRv dGFsCjY3NTUyNyAgMQo2NzU1MjcgIHRvdGFsCjY3NTI2OCAgMQo2NzUyNjggIHRvdGFsCjY3 NTM5OCAgMQo2NzUzOTggIHRvdGFsCgpydW4gd2l0aCB2ZXJzaW9uIDIgKHpmcyBsaXN0LCBl dGMuIGFkZGVkKToKCj09PT09PT09PT09PT0KUnVuICMxCkZ1bGw6CjY3NTI4MCAgL3Rlc3QK TkFNRSAgICBVU0VEICBBVkFJTCAgUkVGRVIgIE1PVU5UUE9JTlQKdGVzdCAgIDY2ME0gICAg ICAwICAgNjU5TSAgL3Rlc3QKTkFNRSAgICBTSVpFICBBTExPQyAgIEZSRUUgICAgQ0FQICBE RURVUCAgSEVBTFRIICBBTFRST09UCnRlc3QgICA2OTJNICAgNjYwTSAgMzEuOE0gICAgOTUl ICAxLjAweCAgT05MSU5FICAtCkNsZWFyOgpOQU1FICAgIFVTRUQgIEFWQUlMICBSRUZFUiAg TU9VTlRQT0lOVAp0ZXN0ICA4MC44TSAgIDU3OU0gIDgwLjJNICAvdGVzdApOQU1FICAgIFNJ WkUgIEFMTE9DICAgRlJFRSAgICBDQVAgIERFRFVQICBIRUFMVEggIEFMVFJPT1QKdGVzdCAg IDY5Mk0gIDgxLjBNICAgNjExTSAgICAxMSUgIDEuMDB4ICBPTkxJTkUgIC0KPT09PT09PT09 PT09PQpSdW4gIzIKRnVsbDoKNjc1NTQ3ICAvdGVzdApOQU1FICAgIFVTRUQgIEFWQUlMICBS RUZFUiAgTU9VTlRQT0lOVAp0ZXN0ICAgNjYwTSAgICAgIDAgICA2NjBNICAvdGVzdApOQU1F ICAgIFNJWkUgIEFMTE9DICAgRlJFRSAgICBDQVAgIERFRFVQICBIRUFMVEggIEFMVFJPT1QK dGVzdCAgIDY5Mk0gICA2NjFNICAzMS41TSAgICA5NSUgIDEuMDB4ICBPTkxJTkUgIC0KQ2xl YXI6Ck5BTUUgICAgVVNFRCAgQVZBSUwgIFJFRkVSICBNT1VOVFBPSU5UCnRlc3QgICAxMzJN ICAgNTI4TSAgIDEzMk0gIC90ZXN0Ck5BTUUgICAgU0laRSAgQUxMT0MgICBGUkVFICAgIENB UCAgREVEVVAgIEhFQUxUSCAgQUxUUk9PVAp0ZXN0ICAgNjkyTSAgIDEzMk0gICA1NjBNICAg IDE5JSAgMS4wMHggIE9OTElORSAgLQo9PT09PT09PT09PT09ClJ1biAjMwpGdWxsOgo2NzUz OTggIC90ZXN0Ck5BTUUgICAgVVNFRCAgQVZBSUwgIFJFRkVSICBNT1VOVFBPSU5UCnRlc3Qg ICA2NjBNICAgICAgMCAgIDY1OU0gIC90ZXN0Ck5BTUUgICAgU0laRSAgQUxMT0MgICBGUkVF ICAgIENBUCAgREVEVVAgIEhFQUxUSCAgQUxUUk9PVAp0ZXN0ICAgNjkyTSAgIDY2ME0gIDMx LjdNICAgIDk1JSAgMS4wMHggIE9OTElORSAgLQpDbGVhcjoKTkFNRSAgICBVU0VEICBBVkFJ TCAgUkVGRVIgIE1PVU5UUE9JTlQKdGVzdCAgNTkuNk0gICA2MDBNICA1OC45TSAgL3Rlc3QK TkFNRSAgICBTSVpFICBBTExPQyAgIEZSRUUgICAgQ0FQICBERURVUCAgSEVBTFRIICBBTFRS T09UCnRlc3QgICA2OTJNICA1OS44TSAgIDYzMk0gICAgIDglICAxLjAweCAgT05MSU5FICAt Cj09PT09PT09PT09PT0KUnVuICM0CkZ1bGw6CjY3NTI3NyAgL3Rlc3QKTkFNRSAgICBVU0VE ICBBVkFJTCAgUkVGRVIgIE1PVU5UUE9JTlQKdGVzdCAgIDY2ME0gICAgICAwICAgNjU5TSAg L3Rlc3QKTkFNRSAgICBTSVpFICBBTExPQyAgIEZSRUUgICAgQ0FQICBERURVUCAgSEVBTFRI ICBBTFRST09UCnRlc3QgICA2OTJNICAgNjYwTSAgMzEuOE0gICAgOTUlICAxLjAweCAgT05M SU5FICAtCkNsZWFyOgpOQU1FICAgIFVTRUQgIEFWQUlMICBSRUZFUiAgTU9VTlRQT0lOVAp0 ZXN0ICAzNC41TSAgIDYyNU0gIDMzLjlNICAvdGVzdApOQU1FICAgIFNJWkUgIEFMTE9DICAg RlJFRSAgICBDQVAgIERFRFVQICBIRUFMVEggIEFMVFJPT1QKdGVzdCAgIDY5Mk0gIDM0LjdN ICAgNjU3TSAgICAgNSUgIDEuMDB4ICBPTkxJTkUgIC0KPT09PT09PT09PT09PQpSdW4gIzUK RnVsbDoKNjc1MzkxICAvdGVzdApOQU1FICAgIFVTRUQgIEFWQUlMICBSRUZFUiAgTU9VTlRQ T0lOVAp0ZXN0ICAgNjYwTSAgICAgIDAgICA2NTlNICAvdGVzdApOQU1FICAgIFNJWkUgIEFM TE9DICAgRlJFRSAgICBDQVAgIERFRFVQICBIRUFMVEggIEFMVFJPT1QKdGVzdCAgIDY5Mk0g ICA2NjBNICAzMS43TSAgICA5NSUgIDEuMDB4ICBPTkxJTkUgIC0KQ2xlYXI6Ck5BTUUgICAg VVNFRCAgQVZBSUwgIFJFRkVSICBNT1VOVFBPSU5UCnRlc3QgICA1MDJNICAgMTU4TSAgIDUw Mk0gIC90ZXN0Ck5BTUUgICAgU0laRSAgQUxMT0MgICBGUkVFICAgIENBUCAgREVEVVAgIEhF QUxUSCAgQUxUUk9PVAp0ZXN0ICAgNjkyTSAgIDUwMk0gICAxOTBNICAgIDcyJSAgMS4wMHgg IE9OTElORSAgLQo9PT09PT09PT09PT09ClJ1biAjNgpGdWxsOgo2NzUzODYgIC90ZXN0Ck5B TUUgICAgVVNFRCAgQVZBSUwgIFJFRkVSICBNT1VOVFBPSU5UCnRlc3QgICA2NjBNICAgICAg MCAgIDY1OU0gIC90ZXN0Ck5BTUUgICAgU0laRSAgQUxMT0MgICBGUkVFICAgIENBUCAgREVE VVAgIEhFQUxUSCAgQUxUUk9PVAp0ZXN0ICAgNjkyTSAgIDY2ME0gIDMxLjlNICAgIDk1JSAg MS4wMHggIE9OTElORSAgLQpDbGVhcjoKTkFNRSAgICBVU0VEICBBVkFJTCAgUkVGRVIgIE1P VU5UUE9JTlQKdGVzdCAgODIuMU0gICA1NzhNICA4MS41TSAgL3Rlc3QKTkFNRSAgICBTSVpF ICBBTExPQyAgIEZSRUUgICAgQ0FQICBERURVUCAgSEVBTFRIICBBTFRST09UCnRlc3QgICA2 OTJNICA4Mi4yTSAgIDYxME0gICAgMTElICAxLjAweCAgT05MSU5FICAtCj09PT09PT09PT09 PT0KUnVuICM3CkZ1bGw6CjY3NTM5NSAgL3Rlc3QKTkFNRSAgICBVU0VEICBBVkFJTCAgUkVG RVIgIE1PVU5UUE9JTlQKdGVzdCAgIDY2ME0gICAgICAwICAgNjU5TSAgL3Rlc3QKTkFNRSAg ICBTSVpFICBBTExPQyAgIEZSRUUgICAgQ0FQICBERURVUCAgSEVBTFRIICBBTFRST09UCnRl c3QgICA2OTJNICAgNjYwTSAgMzEuNk0gICAgOTUlICAxLjAweCAgT05MSU5FICAtCkNsZWFy OgpOQU1FICAgIFVTRUQgIEFWQUlMICBSRUZFUiAgTU9VTlRQT0lOVAp0ZXN0ICAgMTE2TSAg IDU0NE0gICAxMTVNICAvdGVzdApOQU1FICAgIFNJWkUgIEFMTE9DICAgRlJFRSAgICBDQVAg IERFRFVQICBIRUFMVEggIEFMVFJPT1QKdGVzdCAgIDY5Mk0gICAxMTZNICAgNTc2TSAgICAx NiUgIDEuMDB4ICBPTkxJTkUgIC0KPT09PT09PT09PT09PQpSdW4gIzgKRnVsbDoKNjc1NDA5 ICAvdGVzdApOQU1FICAgIFVTRUQgIEFWQUlMICBSRUZFUiAgTU9VTlRQT0lOVAp0ZXN0ICAg NjYwTSAgICAgIDAgICA2NTlNICAvdGVzdApOQU1FICAgIFNJWkUgIEFMTE9DICAgRlJFRSAg ICBDQVAgIERFRFVQICBIRUFMVEggIEFMVFJPT1QKdGVzdCAgIDY5Mk0gICA2NjBNICAzMS43 TSAgICA5NSUgIDEuMDB4ICBPTkxJTkUgIC0KQ2xlYXI6Ck5BTUUgICAgVVNFRCAgQVZBSUwg IFJFRkVSICBNT1VOVFBPSU5UCnRlc3QgIDgyLjFNICAgNTc4TSAgODEuNU0gIC90ZXN0Ck5B TUUgICAgU0laRSAgQUxMT0MgICBGUkVFICAgIENBUCAgREVEVVAgIEhFQUxUSCAgQUxUUk9P VAp0ZXN0ICAgNjkyTSAgODIuM00gICA2MTBNICAgIDExJSAgMS4wMHggIE9OTElORSAgLQo9 PT09PT09PT09PT09CgoKUmVzdWx0cyBsb29rIHdlaXJkLCBidXQgaWYgSSBkbyBpdCBtYW51 YWxseSwgSSBjYW4gc2VlIHRoYXQgdGhlIHNwYWNlIGlzIGNsZWFyZWQgYSB3aGlsZSBhZnRl ciB0aGUgInJtIiBjb21tYW5kIGlzIGRvbmUuCgpbcm9vdEBiY3pmc3ZtMXRlc3QgL3Rlc3Rd IyB6ZnMgbGlzdCB0ZXN0Ck5BTUUgICAgVVNFRCAgQVZBSUwgIFJFRkVSICBNT1VOVFBPSU5U CnRlc3QgICA2MjBNICA0MC40TSAgIDYxOU0gIC90ZXN0Cgpbcm9vdEBiY3pmc3ZtMXRlc3Qg L3Rlc3RdIyB6cG9vbCBsaXN0IHRlc3QKTkFNRSAgICBTSVpFICBBTExPQyAgIEZSRUUgICAg Q0FQICBERURVUCAgSEVBTFRIICBBTFRST09UCnRlc3QgICA2OTJNICAgNjIwTSAgNzIuMk0g ICAgODklICAxLjAweCAgT05MSU5FICAtCltyb290QGJjemZzdm0xdGVzdCAvdGVzdF0jIHJt IC1yZiAqCgpbcm9vdEBiY3pmc3ZtMXRlc3QgL3Rlc3RdIyB6ZnMgbGlzdCB0ZXN0Ck5BTUUg ICAgVVNFRCAgQVZBSUwgIFJFRkVSICBNT1VOVFBPSU5UCnRlc3QgICA0NjRNICAgMTk2TSAg IDQ2NE0gIC90ZXN0Cgpbcm9vdEBiY3pmc3ZtMXRlc3QgL3Rlc3RdIyB6ZnMgbGlzdCB0ZXN0 Ck5BTUUgICAgVVNFRCAgQVZBSUwgIFJFRkVSICBNT1VOVFBPSU5UCnRlc3QgICA0NjRNICAg MTk2TSAgIDQ2NE0gIC90ZXN0Cgpbcm9vdEBiY3pmc3ZtMXRlc3QgL3Rlc3RdIyB6ZnMgbGlz dCB0ZXN0Ck5BTUUgICAgVVNFRCAgQVZBSUwgIFJFRkVSICBNT1VOVFBPSU5UCnRlc3QgICA2 NjRLICAgNjU5TSAgICAzMUsgIC90ZXN0Cgpbcm9vdEBiY3pmc3ZtMXRlc3QgL3Rlc3RdIyB6 ZnMgbGlzdCB0ZXN0Ck5BTUUgICAgVVNFRCAgQVZBSUwgIFJFRkVSICBNT1VOVFBPSU5UCnRl c3QgICA2NjRLICAgNjU5TSAgICAzMUsgIC90ZXN0CgoKCnJ1biB3aXRoIHZlcnNpb24gMyAo YiBmcm9tIDEuLjUwMCwgYW5kIHNsZWVwIDMwIGFkZGVkKToKCgpSdW4gIzIgKHN0YXJ0cyBv biAyIGJlY2F1c2UgYWNjaWRlbnRseSAiYyIgd2FzIGluc2VydGVkIGJlZm9yZSAicnVuPTEi KQpGdWxsOgo2NzUzOTQgIC90ZXN0Ck5BTUUgICAgVVNFRCAgQVZBSUwgIFJFRkVSICBNT1VO VFBPSU5UCnRlc3QgICA2NjBNICAgICAgMCAgIDY1OU0gIC90ZXN0Ck5BTUUgICAgU0laRSAg QUxMT0MgICBGUkVFICAgIENBUCAgREVEVVAgIEhFQUxUSCAgQUxUUk9PVAp0ZXN0ICAgNjky TSAgIDY2ME0gIDMxLjhNICAgIDk1JSAgMS4wMHggIE9OTElORSAgLQpDbGVhcjoKTkFNRSAg ICBVU0VEICBBVkFJTCAgUkVGRVIgIE1PVU5UUE9JTlQKdGVzdCAgIDcwMksgICA2NTlNICAg IDMxSyAgL3Rlc3QKTkFNRSAgICBTSVpFICBBTExPQyAgIEZSRUUgICAgQ0FQICBERURVUCAg SEVBTFRIICBBTFRST09UCnRlc3QgICA2OTJNICAgNzg4SyAgIDY5MU0gICAgIDAlICAxLjAw eCAgT05MSU5FICAtCj09PT09PT09PT09PT0KUnVuICMzCkZ1bGw6CjY3NTQwNSAgL3Rlc3QK TkFNRSAgICBVU0VEICBBVkFJTCAgUkVGRVIgIE1PVU5UUE9JTlQKdGVzdCAgIDY2ME0gICAg ICAwICAgNjU5TSAgL3Rlc3QKTkFNRSAgICBTSVpFICBBTExPQyAgIEZSRUUgICAgQ0FQICBE RURVUCAgSEVBTFRIICBBTFRST09UCnRlc3QgICA2OTJNICAgNjYwTSAgMzEuOE0gICAgOTUl ICAxLjAweCAgT05MSU5FICAtCkNsZWFyOgpOQU1FICAgIFVTRUQgIEFWQUlMICBSRUZFUiAg TU9VTlRQT0lOVAp0ZXN0ICAgNzEwSyAgIDY1OU0gICAgMzFLICAvdGVzdApOQU1FICAgIFNJ WkUgIEFMTE9DICAgRlJFRSAgICBDQVAgIERFRFVQICBIRUFMVEggIEFMVFJPT1QKdGVzdCAg IDY5Mk0gICA3OTZLICAgNjkxTSAgICAgMCUgIDEuMDB4ICBPTkxJTkUgIC0KPT09PT09PT09 PT09PQpSdW4gIzQKRnVsbDoKNjc1Mzk1ICAvdGVzdApOQU1FICAgIFVTRUQgIEFWQUlMICBS RUZFUiAgTU9VTlRQT0lOVAp0ZXN0ICAgNjYwTSAgICAgIDAgICA2NTlNICAvdGVzdApOQU1F ICAgIFNJWkUgIEFMTE9DICAgRlJFRSAgICBDQVAgIERFRFVQICBIRUFMVEggIEFMVFJPT1QK dGVzdCAgIDY5Mk0gICA2NjBNICAzMS44TSAgICA5NSUgIDEuMDB4ICBPTkxJTkUgIC0KQ2xl YXI6Ck5BTUUgICAgVVNFRCAgQVZBSUwgIFJFRkVSICBNT1VOVFBPSU5UCnRlc3QgICA3MDhL ICAgNjU5TSAgICAzMUsgIC90ZXN0Ck5BTUUgICAgU0laRSAgQUxMT0MgICBGUkVFICAgIENB UCAgREVEVVAgIEhFQUxUSCAgQUxUUk9PVAp0ZXN0ICAgNjkyTSAgIDc5M0sgICA2OTFNICAg ICAwJSAgMS4wMHggIE9OTElORSAgLQo9PT09PT09PT09PT09ClJ1biAjNQpGdWxsOgo2NzU0 MTAgIC90ZXN0Ck5BTUUgICAgVVNFRCAgQVZBSUwgIFJFRkVSICBNT1VOVFBPSU5UCnRlc3Qg ICA2NjBNICAgICAgMCAgIDY1OU0gIC90ZXN0Ck5BTUUgICAgU0laRSAgQUxMT0MgICBGUkVF ICAgIENBUCAgREVEVVAgIEhFQUxUSCAgQUxUUk9PVAp0ZXN0ICAgNjkyTSAgIDY2ME0gIDMx LjhNICAgIDk1JSAgMS4wMHggIE9OTElORSAgLQpDbGVhcjoKTkFNRSAgICBVU0VEICBBVkFJ TCAgUkVGRVIgIE1PVU5UUE9JTlQKdGVzdCAgIDY5NksgICA2NTlNICAgIDMxSyAgL3Rlc3QK TkFNRSAgICBTSVpFICBBTExPQyAgIEZSRUUgICAgQ0FQICBERURVUCAgSEVBTFRIICBBTFRS T09UCnRlc3QgICA2OTJNICAgNzk4SyAgIDY5MU0gICAgIDAlICAxLjAweCAgT05MSU5FICAt Cj09PT09PT09PT09PT0KUnVuICM2CkZ1bGw6CjY3NTI3NyAgL3Rlc3QKTkFNRSAgICBVU0VE ICBBVkFJTCAgUkVGRVIgIE1PVU5UUE9JTlQKdGVzdCAgIDY2ME0gICAgICAwICAgNjU5TSAg L3Rlc3QKTkFNRSAgICBTSVpFICBBTExPQyAgIEZSRUUgICAgQ0FQICBERURVUCAgSEVBTFRI ICBBTFRST09UCnRlc3QgICA2OTJNICAgNjYwTSAgMzEuOU0gICAgOTUlICAxLjAweCAgT05M SU5FICAtCkNsZWFyOgpOQU1FICAgIFVTRUQgIEFWQUlMICBSRUZFUiAgTU9VTlRQT0lOVAp0 ZXN0ICAgNjQ4SyAgIDY1OU0gICAgMzFLICAvdGVzdApOQU1FICAgIFNJWkUgIEFMTE9DICAg RlJFRSAgICBDQVAgIERFRFVQICBIRUFMVEggIEFMVFJPT1QKdGVzdCAgIDY5Mk0gICA3MTVL ICAgNjkxTSAgICAgMCUgIDEuMDB4ICBPTkxJTkUgIC0KPT09PT09PT09PT09PQpSdW4gIzcK RnVsbDoKNjc1MzkxICAvdGVzdApOQU1FICAgIFVTRUQgIEFWQUlMICBSRUZFUiAgTU9VTlRQ T0lOVAp0ZXN0ICAgNjYwTSAgICAgIDAgICA2NTlNICAvdGVzdApOQU1FICAgIFNJWkUgIEFM TE9DICAgRlJFRSAgICBDQVAgIERFRFVQICBIRUFMVEggIEFMVFJPT1QKdGVzdCAgIDY5Mk0g ICA2NjBNICAzMS44TSAgICA5NSUgIDEuMDB4ICBPTkxJTkUgIC0KQ2xlYXI6Ck5BTUUgICAg VVNFRCAgQVZBSUwgIFJFRkVSICBNT1VOVFBPSU5UCnRlc3QgICA3MDZLICAgNjU5TSAgICAz MUsgIC90ZXN0Ck5BTUUgICAgU0laRSAgQUxMT0MgICBGUkVFICAgIENBUCAgREVEVVAgIEhF QUxUSCAgQUxUUk9PVAp0ZXN0ICAgNjkyTSAgIDc5NEsgICA2OTFNICAgICAwJSAgMS4wMHgg IE9OTElORSAgLQo9PT09PT09PT09PT09ClJ1biAjOApGdWxsOgo2NzUyNjcgIC90ZXN0Ck5B TUUgICAgVVNFRCAgQVZBSUwgIFJFRkVSICBNT1VOVFBPSU5UCnRlc3QgICA2NjBNICAgICAg MCAgIDY1OU0gIC90ZXN0Ck5BTUUgICAgU0laRSAgQUxMT0MgICBGUkVFICAgIENBUCAgREVE VVAgIEhFQUxUSCAgQUxUUk9PVAp0ZXN0ICAgNjkyTSAgIDY2ME0gIDMxLjlNICAgIDk1JSAg MS4wMHggIE9OTElORSAgLQpDbGVhcjoKTkFNRSAgICBVU0VEICBBVkFJTCAgUkVGRVIgIE1P VU5UUE9JTlQKdGVzdCAgIDcxNEsgICA2NTlNICAgIDMxSyAgL3Rlc3QKTkFNRSAgICBTSVpF ICBBTExPQyAgIEZSRUUgICAgQ0FQICBERURVUCAgSEVBTFRIICBBTFRST09UCnRlc3QgICA2 OTJNICAgNzk4SyAgIDY5MU0gICAgIDAlICAxLjAweCAgT05MSU5FICAtCj09PT09PT09PT09 PT0KUnVuICM5CkZ1bGw6CjY3NTM5MiAgL3Rlc3QKTkFNRSAgICBVU0VEICBBVkFJTCAgUkVG RVIgIE1PVU5UUE9JTlQKdGVzdCAgIDY2ME0gICAgICAwICAgNjU5TSAgL3Rlc3QKTkFNRSAg ICBTSVpFICBBTExPQyAgIEZSRUUgICAgQ0FQICBERURVUCAgSEVBTFRIICBBTFRST09UCnRl c3QgICA2OTJNICAgNjYwTSAgMzEuOE0gICAgOTUlICAxLjAweCAgT05MSU5FICAtCkNsZWFy OgpOQU1FICAgIFVTRUQgIEFWQUlMICBSRUZFUiAgTU9VTlRQT0lOVAp0ZXN0ICAgNzAwSyAg IDY1OU0gICAgMzFLICAvdGVzdApOQU1FICAgIFNJWkUgIEFMTE9DICAgRlJFRSAgICBDQVAg IERFRFVQICBIRUFMVEggIEFMVFJPT1QKdGVzdCAgIDY5Mk0gICA3ODZLICAgNjkxTSAgICAg MCUgIDEuMDB4ICBPTkxJTkUgIC0KPT09PT09PT09PT09PQpSdW4gIzEwCkZ1bGw6CjY3NTM5 NCAgL3Rlc3QKTkFNRSAgICBVU0VEICBBVkFJTCAgUkVGRVIgIE1PVU5UUE9JTlQKdGVzdCAg IDY2ME0gICAgICAwICAgNjU5TSAgL3Rlc3QKTkFNRSAgICBTSVpFICBBTExPQyAgIEZSRUUg ICAgQ0FQICBERURVUCAgSEVBTFRIICBBTFRST09UCnRlc3QgICA2OTJNICAgNjYwTSAgMzEu OE0gICAgOTUlICAxLjAweCAgT05MSU5FICAtCkNsZWFyOgpOQU1FICAgIFVTRUQgIEFWQUlM ICBSRUZFUiAgTU9VTlRQT0lOVAp0ZXN0ICAgNDIySyAgIDY2ME0gICAgMzFLICAvdGVzdApO QU1FICAgIFNJWkUgIEFMTE9DICAgRlJFRSAgICBDQVAgIERFRFVQICBIRUFMVEggIEFMVFJP T1QKdGVzdCAgIDY5Mk0gICA0NThLICAgNjkyTSAgICAgMCUgIDEuMDB4ICBPTkxJTkUgIC0K PT09PT09PT09PT09PQpSdW4gIzExCkZ1bGw6CjY3NTM5OCAgL3Rlc3QKTkFNRSAgICBVU0VE ICBBVkFJTCAgUkVGRVIgIE1PVU5UUE9JTlQKdGVzdCAgIDY2ME0gICAgICAwICAgNjU5TSAg L3Rlc3QKTkFNRSAgICBTSVpFICBBTExPQyAgIEZSRUUgICAgQ0FQICBERURVUCAgSEVBTFRI ICBBTFRST09UCnRlc3QgICA2OTJNICAgNjYwTSAgMzEuOE0gICAgOTUlICAxLjAweCAgT05M SU5FICAtCkNsZWFyOgpOQU1FICAgIFVTRUQgIEFWQUlMICBSRUZFUiAgTU9VTlRQT0lOVAp0 ZXN0ICAgNDA2SyAgIDY2ME0gICAgMzFLICAvdGVzdApOQU1FICAgIFNJWkUgIEFMTE9DICAg RlJFRSAgICBDQVAgIERFRFVQICBIRUFMVEggIEFMVFJPT1QKdGVzdCAgIDY5Mk0gICA0NDJL ICAgNjkyTSAgICAgMCUgIDEuMDB4ICBPTkxJTkUgIC0KPT09PT09PT09PT09PQpSdW4gIzEy CkZ1bGw6CjY3NTQxOCAgL3Rlc3QKTkFNRSAgICBVU0VEICBBVkFJTCAgUkVGRVIgIE1PVU5U UE9JTlQKdGVzdCAgIDY2ME0gICAgICAwICAgNjU5TSAgL3Rlc3QKTkFNRSAgICBTSVpFICBB TExPQyAgIEZSRUUgICAgQ0FQICBERURVUCAgSEVBTFRIICBBTFRST09UCnRlc3QgICA2OTJN ICAgNjYwTSAgMzEuOE0gICAgOTUlICAxLjAweCAgT05MSU5FICAtCkNsZWFyOgpOQU1FICAg IFVTRUQgIEFWQUlMICBSRUZFUiAgTU9VTlRQT0lOVAp0ZXN0ICAgNDM2SyAgIDY2ME0gICAg MzFLICAvdGVzdApOQU1FICAgIFNJWkUgIEFMTE9DICAgRlJFRSAgICBDQVAgIERFRFVQICBI RUFMVEggIEFMVFJPT1QKdGVzdCAgIDY5Mk0gICA0NzJLICAgNjkyTSAgICAgMCUgIDEuMDB4 ICBPTkxJTkUgIC0KPT09PT09PT09PT09PQoKPT09PT09PT09PT09PT09PT09PT09PT09PT09 PT09CkNvbmNsdXNpb24KPT09PT09PT09PT09PT09PT09PT09PT09PT09PT09CgpJdCBzZWVt cyB0aGF0IHRoZSBtYXhpbXVtIHNwYWNlIHZhcmllcyBieSBhIHNtYWxsIGFtb3VudCwgYW5k IHNvIGRvZXMgdGhlICJVU0VEIiBhbmQgIkFMTE9DIiB3aGVuIGNsZWFyaW5nIHRoZSBwb29s LCBidXQgdGhlIGZyZWUgc3BhY2UgaXMgbm90IGNsZWFybHkgZ29pbmcgZG93biB3aXRoIGVh Y2ggaXRlcmF0aW9uIG9mIHJlbW92aW5nIGFuZCBmaWxsaW5nLgoKSWYgYW55dGhpbmcgaXMg bWlzc2luZyBpdCBpcyBwcm9iYWJseSBsZXNzIHRoYW4gYSBraWxvYnl0ZSBhZnRlciBmaWxs aW5nIGFuZCByZW1vdmluZyBhbGwgMTEgdGltZXMuIChub3RlIHRoYXQgcG9vbCB3YXMgbmV2 ZXIgZGVzdHJveWVkLCBhbmQgbG90cyBvZiB0ZXN0IHJ1bnMgdG9vayBwbGFjZSB0aGF0IGFy ZSBub3QgcmVjb3JkZWQgaGVyZSwgc28gdGhlcmUgYXJlIG1hbnkgbW9yZSB0aGFuIDExIHJ1 bnMsIHByb2JhYmx5IDQwLTUwKQoKQSByZXBlYXQgdGVzdCBvbiBhIGxhcmdlciBkaXNrLCBv ciB3aXRoIEZyZWVCU0QgOS4wIG1heSBiZSBhcHByb3ByaWF0ZS4= --------------020307070107060600020708--
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?4F7AF97D.7060307>