Skip site navigation (1)Skip section navigation (2)
Date:      Tue, 27 Aug 2013 16:29:00 +0200
From:      Harald Schmalzbauer <h.schmalzbauer@omnilan.de>
To:        Bryan Venteicher <bryanv@daemoninthecloset.org>
Cc:        FreeBSD Stable <freebsd-stable@freebsd.org>, current@freebsd.org
Subject:   Re: [CFT] VMware vmxnet3 ethernet driver
Message-ID:  <521CB7AC.90605@omnilan.de>
In-Reply-To: <1117188271.19176.1377577117350.JavaMail.root@daemoninthecloset.org>
References:  <601099152.721.1375661537866.JavaMail.root@daemoninthecloset.org> <5214D37F.5000307@omnilan.de> <1117188271.19176.1377577117350.JavaMail.root@daemoninthecloset.org>

next in thread | previous in thread | raw e-mail | index | archive | help
This is an OpenPGP/MIME signed message (RFC 2440 and 3156)
--------------enigA68C03B9D347177ACD70FBCB
Content-Type: multipart/mixed;
 boundary="------------030705050708030202060003"

This is a multi-part message in MIME format.
--------------030705050708030202060003
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

 Bez=C3=BCglich Bryan Venteicher's Nachricht vom 27.08.2013 06:18 (localt=
ime):

=2E..

>> It seems if_vmx doesn't support jumbo frames. If I set mtu 9000, I get=

>> =C2=BBvmx0: cannot populate Rx queue 0=C2=AB, I have no problems using=
 jumbo
>> frames with vmxnet3.
>>
> This could fail for two reasons - could not allocate an mbuf cluster,
> or the call to bus_dmamap_load_mbuf_sg() failed. For the former, you
> should check vmstat -z. For the later, the behavior of bus_dmamap_load_=
mbuf_sg()
> changed between 9.1 and 9.2, and I know it was broken for awhile. I don=
't
> recall exactly when I fixed it (I think shortly after I made the origin=
al
> announcement). Could you retry with the files from HEAD @ [1]? Also, th=
ere
> are new sysctl oids (dev.vmx.X.mbuf_load_failed & dev.vmx.X.mgetcl_fail=
ed)
> for these errors.
>
> I just compiled the driver on 9.2-RC2 with the sources from HEAD and wa=
s
> able to change the MTU to 9000.
>
> [1]- http://svnweb.freebsd.org/base/head/sys/dev/vmware/vmxnet3/

Thanks a lot for your ongoing work!
I can confirm that with recent if_vmx.c from head and compiled for
9.2-RC3, setting mtu to 9000 works as expected :-)


>> I took a oldish host (4x2,8GHz Core2[LGA775]) with recent software: ES=
Xi
>> 5.1U1 and FreeBSD-9.2-RC2
>> Two guests are connected to one MTU9000 "VMware Software Switch".
>>
> I've got a few performance things to still look at. What's the sysctl=20
> dev.vmx.X output for the if_vmx<->if_vmx tests?

Just repeated if_vmx simple iperf bench, results vary slightly from
standard 10sec run to run, but still noticable high Intr usage:

if_vmx <-> if_vmx
    1.32 GBits/sec, load: 10-45%Sys 40-48%Intr

if_vmxJumbo <-> if_vmxJumbo
    5.01 GBits/sec, load: 10-45%Sys 40-48%Intr

Please find attached the different outputs of dev.vmx.X (the mtu9000 run =
was only 3.47GBits/sec in that case, took the numbers anyway)

wbr,

-Harry


--------------030705050708030202060003
Content-Type: text/plain;
 name="dev_vmx_iperfclient-i386_mtu1500.txt"
Content-Transfer-Encoding: base64
Content-Disposition: attachment;
 filename="dev_vmx_iperfclient-i386_mtu1500.txt"

ZGV2LnZteC4wLiVkZXNjOiBWTXdhcmUgVk1YTkVUMyBFdGhlcm5ldCBBZGFwdGVyCmRldi52
bXguMC4lZHJpdmVyOiB2bXgKZGV2LnZteC4wLiVsb2NhdGlvbjogc2xvdD0wIGZ1bmN0aW9u
PTAgaGFuZGxlPVxfU0JfLlBDSTAuUEU0MC5TMUYwCmRldi52bXguMC4lcG5waW5mbzogdmVu
ZG9yPTB4MTVhZCBkZXZpY2U9MHgwN2IwIHN1YnZlbmRvcj0weDE1YWQgc3ViZGV2aWNlPTB4
MDdiMCBjbGFzcz0weDAyMDAwMApkZXYudm14LjAuJXBhcmVudDogcGNpMwpkZXYudm14LjAu
bnR4cXVldWVzOiAxCmRldi52bXguMC5ucnhxdWV1ZXM6IDEKZGV2LnZteC4wLmNvbGxhcHNl
ZDogMApkZXYudm14LjAubWdldGNsX2ZhaWxlZDogMApkZXYudm14LjAubWJ1Zl9sb2FkX2Zh
aWxlZDogMApkZXYudm14LjAudHhxMC5yaW5nZnVsbDogMTMzNDc5CmRldi52bXguMC50eHEw
Lm9mZmxvYWRfZmFpbGVkOiAwCmRldi52bXguMC50eHEwLmhzdGF0cy50c29fcGFja2V0czog
NTY0OTg2CmRldi52bXguMC50eHEwLmhzdGF0cy50c29fYnl0ZXM6IDE2ODYxODQ1ODAKZGV2
LnZteC4wLnR4cTAuaHN0YXRzLnVjYXN0X3BhY2tldHM6IDU3MDYwNApkZXYudm14LjAudHhx
MC5oc3RhdHMudW5pY2FzdF9ieXRlczogMTY5NDY3OTYwOApkZXYudm14LjAudHhxMC5oc3Rh
dHMubWNhc3RfcGFja2V0czogMApkZXYudm14LjAudHhxMC5oc3RhdHMubWNhc3RfYnl0ZXM6
IDAKZGV2LnZteC4wLnR4cTAuaHN0YXRzLmVycm9yOiAwCmRldi52bXguMC50eHEwLmhzdGF0
cy5kaXNjYXJkOiAwCmRldi52bXguMC50eHEwLmRlYnVnLmNtZF9oZWFkOiAxMDYKZGV2LnZt
eC4wLnR4cTAuZGVidWcuY21kX25leHQ6IDEwNgpkZXYudm14LjAudHhxMC5kZWJ1Zy5jbWRf
bmRlc2M6IDUxMgpkZXYudm14LjAudHhxMC5kZWJ1Zy5jbWRfZ2VuOiAwCmRldi52bXguMC50
eHEwLmRlYnVnLmNvbXBfbmV4dDogMjM4CmRldi52bXguMC50eHEwLmRlYnVnLmNvbXBfbmRl
c2M6IDUxMgpkZXYudm14LjAudHhxMC5kZWJ1Zy5jb21wX2dlbjogMQpkZXYudm14LjAucnhx
MC5oc3RhdHMubHJvX3BhY2tldHM6IDAKZGV2LnZteC4wLnJ4cTAuaHN0YXRzLmxyb19ieXRl
czogMApkZXYudm14LjAucnhxMC5oc3RhdHMudWNhc3RfcGFja2V0czogNTc5MTM3CmRldi52
bXguMC5yeHEwLmhzdGF0cy51bmljYXN0X2J5dGVzOiAzODQwOTMxMgpkZXYudm14LjAucnhx
MC5oc3RhdHMubWNhc3RfcGFja2V0czogMApkZXYudm14LjAucnhxMC5oc3RhdHMubWNhc3Rf
Ynl0ZXM6IDAKZGV2LnZteC4wLnJ4cTAuaHN0YXRzLmJjYXN0X3BhY2tldHM6IDI5CmRldi52
bXguMC5yeHEwLmhzdGF0cy5iY2FzdF9ieXRlczogMTc0MApkZXYudm14LjAucnhxMC5oc3Rh
dHMubm9idWZmZXI6IDAKZGV2LnZteC4wLnJ4cTAuaHN0YXRzLmVycm9yOiAwCmRldi52bXgu
MC5yeHEwLmRlYnVnLmNtZDBfZmlsbDogOTQKZGV2LnZteC4wLnJ4cTAuZGVidWcuY21kMF9u
ZGVzYzogMjU2CmRldi52bXguMC5yeHEwLmRlYnVnLmNtZDBfZ2VuOiAwCmRldi52bXguMC5y
eHEwLmRlYnVnLmNtZDFfZmlsbDogMApkZXYudm14LjAucnhxMC5kZWJ1Zy5jbWQxX25kZXNj
OiAyNTYKZGV2LnZteC4wLnJ4cTAuZGVidWcuY21kMV9nZW46IDAKZGV2LnZteC4wLnJ4cTAu
ZGVidWcuY29tcF9uZXh0OiA5NApkZXYudm14LjAucnhxMC5kZWJ1Zy5jb21wX25kZXNjOiA1
MTIKZGV2LnZteC4wLnJ4cTAuZGVidWcuY29tcF9nZW46IDAK
--------------030705050708030202060003
Content-Type: text/plain;
 name="dev_vmx_iperfclient-i386_mtu9000.txt"
Content-Transfer-Encoding: base64
Content-Disposition: attachment;
 filename="dev_vmx_iperfclient-i386_mtu9000.txt"

ZGV2LnZteC4wLiVkZXNjOiBWTXdhcmUgVk1YTkVUMyBFdGhlcm5ldCBBZGFwdGVyCmRldi52
bXguMC4lZHJpdmVyOiB2bXgKZGV2LnZteC4wLiVsb2NhdGlvbjogc2xvdD0wIGZ1bmN0aW9u
PTAgaGFuZGxlPVxfU0JfLlBDSTAuUEU0MC5TMUYwCmRldi52bXguMC4lcG5waW5mbzogdmVu
ZG9yPTB4MTVhZCBkZXZpY2U9MHgwN2IwIHN1YnZlbmRvcj0weDE1YWQgc3ViZGV2aWNlPTB4
MDdiMCBjbGFzcz0weDAyMDAwMApkZXYudm14LjAuJXBhcmVudDogcGNpMwpkZXYudm14LjAu
bnR4cXVldWVzOiAxCmRldi52bXguMC5ucnhxdWV1ZXM6IDEKZGV2LnZteC4wLmNvbGxhcHNl
ZDogMApkZXYudm14LjAubWdldGNsX2ZhaWxlZDogMApkZXYudm14LjAubWJ1Zl9sb2FkX2Zh
aWxlZDogMApkZXYudm14LjAudHhxMC5yaW5nZnVsbDogNTg5NTAKZGV2LnZteC4wLnR4cTAu
b2ZmbG9hZF9mYWlsZWQ6IDAKZGV2LnZteC4wLnR4cTAuaHN0YXRzLnRzb19wYWNrZXRzOiAy
MzA1MDgKZGV2LnZteC4wLnR4cTAuaHN0YXRzLnRzb19ieXRlczogNDMxNDAyMDExMgpkZXYu
dm14LjAudHhxMC5oc3RhdHMudWNhc3RfcGFja2V0czogMjM1MzgyCmRldi52bXguMC50eHEw
LmhzdGF0cy51bmljYXN0X2J5dGVzOiA0MzU2OTQzNTUyCmRldi52bXguMC50eHEwLmhzdGF0
cy5tY2FzdF9wYWNrZXRzOiAwCmRldi52bXguMC50eHEwLmhzdGF0cy5tY2FzdF9ieXRlczog
MApkZXYudm14LjAudHhxMC5oc3RhdHMuZXJyb3I6IDAKZGV2LnZteC4wLnR4cTAuaHN0YXRz
LmRpc2NhcmQ6IDAKZGV2LnZteC4wLnR4cTAuZGVidWcuY21kX2hlYWQ6IDMzMwpkZXYudm14
LjAudHhxMC5kZWJ1Zy5jbWRfbmV4dDogMzMzCmRldi52bXguMC50eHEwLmRlYnVnLmNtZF9u
ZGVzYzogNTEyCmRldi52bXguMC50eHEwLmRlYnVnLmNtZF9nZW46IDAKZGV2LnZteC4wLnR4
cTAuZGVidWcuY29tcF9uZXh0OiAzNzYKZGV2LnZteC4wLnR4cTAuZGVidWcuY29tcF9uZGVz
YzogNTEyCmRldi52bXguMC50eHEwLmRlYnVnLmNvbXBfZ2VuOiAwCmRldi52bXguMC5yeHEw
LmhzdGF0cy5scm9fcGFja2V0czogMApkZXYudm14LjAucnhxMC5oc3RhdHMubHJvX2J5dGVz
OiAwCmRldi52bXguMC5yeHEwLmhzdGF0cy51Y2FzdF9wYWNrZXRzOiAyNTU5MTgKZGV2LnZt
eC4wLnJ4cTAuaHN0YXRzLnVuaWNhc3RfYnl0ZXM6IDE3MDQzOTE4CmRldi52bXguMC5yeHEw
LmhzdGF0cy5tY2FzdF9wYWNrZXRzOiAwCmRldi52bXguMC5yeHEwLmhzdGF0cy5tY2FzdF9i
eXRlczogMApkZXYudm14LjAucnhxMC5oc3RhdHMuYmNhc3RfcGFja2V0czogMTUKZGV2LnZt
eC4wLnJ4cTAuaHN0YXRzLmJjYXN0X2J5dGVzOiA5MDAKZGV2LnZteC4wLnJ4cTAuaHN0YXRz
Lm5vYnVmZmVyOiAwCmRldi52bXguMC5yeHEwLmhzdGF0cy5lcnJvcjogMApkZXYudm14LjAu
cnhxMC5kZWJ1Zy5jbWQwX2ZpbGw6IDEyMQpkZXYudm14LjAucnhxMC5kZWJ1Zy5jbWQwX25k
ZXNjOiAyNTYKZGV2LnZteC4wLnJ4cTAuZGVidWcuY21kMF9nZW46IDEKZGV2LnZteC4wLnJ4
cTAuZGVidWcuY21kMV9maWxsOiAwCmRldi52bXguMC5yeHEwLmRlYnVnLmNtZDFfbmRlc2M6
IDI1NgpkZXYudm14LjAucnhxMC5kZWJ1Zy5jbWQxX2dlbjogMApkZXYudm14LjAucnhxMC5k
ZWJ1Zy5jb21wX25leHQ6IDQ0NQpkZXYudm14LjAucnhxMC5kZWJ1Zy5jb21wX25kZXNjOiA1
MTIKZGV2LnZteC4wLnJ4cTAuZGVidWcuY29tcF9nZW46IDAK
--------------030705050708030202060003
Content-Type: text/plain;
 name="dev_vmx_iperfserver-amd64_mtu1500.txt"
Content-Transfer-Encoding: base64
Content-Disposition: attachment;
 filename="dev_vmx_iperfserver-amd64_mtu1500.txt"

ZGV2LnZteC4wLiVkZXNjOiBWTXdhcmUgVk1YTkVUMyBFdGhlcm5ldCBBZGFwdGVyCmRldi52
bXguMC4lZHJpdmVyOiB2bXgKZGV2LnZteC4wLiVsb2NhdGlvbjogc2xvdD0wIGZ1bmN0aW9u
PTAgaGFuZGxlPVxfU0JfLlBDSTAuUEU0MS5TMUYwCmRldi52bXguMC4lcG5waW5mbzogdmVu
ZG9yPTB4MTVhZCBkZXZpY2U9MHgwN2IwIHN1YnZlbmRvcj0weDE1YWQgc3ViZGV2aWNlPTB4
MDdiMCBjbGFzcz0weDAyMDAwMApkZXYudm14LjAuJXBhcmVudDogcGNpNApkZXYudm14LjAu
bnR4cXVldWVzOiAxCmRldi52bXguMC5ucnhxdWV1ZXM6IDEKZGV2LnZteC4wLmNvbGxhcHNl
ZDogMApkZXYudm14LjAubWdldGNsX2ZhaWxlZDogMApkZXYudm14LjAubWJ1Zl9sb2FkX2Zh
aWxlZDogMApkZXYudm14LjAudHhxMC5yaW5nZnVsbDogMApkZXYudm14LjAudHhxMC5vZmZs
b2FkX2ZhaWxlZDogMApkZXYudm14LjAudHhxMC5oc3RhdHMudHNvX3BhY2tldHM6IDAKZGV2
LnZteC4wLnR4cTAuaHN0YXRzLnRzb19ieXRlczogMApkZXYudm14LjAudHhxMC5oc3RhdHMu
dWNhc3RfcGFja2V0czogNTc5MTM1CmRldi52bXguMC50eHEwLmhzdGF0cy51bmljYXN0X2J5
dGVzOiAzODQwOTE3NApkZXYudm14LjAudHhxMC5oc3RhdHMubWNhc3RfcGFja2V0czogMApk
ZXYudm14LjAudHhxMC5oc3RhdHMubWNhc3RfYnl0ZXM6IDAKZGV2LnZteC4wLnR4cTAuaHN0
YXRzLmVycm9yOiAwCmRldi52bXguMC50eHEwLmhzdGF0cy5kaXNjYXJkOiAwCmRldi52bXgu
MC50eHEwLmRlYnVnLmNtZF9oZWFkOiA2NApkZXYudm14LjAudHhxMC5kZWJ1Zy5jbWRfbmV4
dDogNjQKZGV2LnZteC4wLnR4cTAuZGVidWcuY21kX25kZXNjOiA1MTIKZGV2LnZteC4wLnR4
cTAuZGVidWcuY21kX2dlbjogMApkZXYudm14LjAudHhxMC5kZWJ1Zy5jb21wX25leHQ6IDY0
CmRldi52bXguMC50eHEwLmRlYnVnLmNvbXBfbmRlc2M6IDUxMgpkZXYudm14LjAudHhxMC5k
ZWJ1Zy5jb21wX2dlbjogMApkZXYudm14LjAucnhxMC5oc3RhdHMubHJvX3BhY2tldHM6IDAK
ZGV2LnZteC4wLnJ4cTAuaHN0YXRzLmxyb19ieXRlczogMApkZXYudm14LjAucnhxMC5oc3Rh
dHMudWNhc3RfcGFja2V0czogMTE0NzE4NgpkZXYudm14LjAucnhxMC5oc3RhdHMudW5pY2Fz
dF9ieXRlczogMTczMjA3MTE2MApkZXYudm14LjAucnhxMC5oc3RhdHMubWNhc3RfcGFja2V0
czogMApkZXYudm14LjAucnhxMC5oc3RhdHMubWNhc3RfYnl0ZXM6IDAKZGV2LnZteC4wLnJ4
cTAuaHN0YXRzLmJjYXN0X3BhY2tldHM6IDQ0CmRldi52bXguMC5yeHEwLmhzdGF0cy5iY2Fz
dF9ieXRlczogMjY0MApkZXYudm14LjAucnhxMC5oc3RhdHMubm9idWZmZXI6IDMxMwpkZXYu
dm14LjAucnhxMC5oc3RhdHMuZXJyb3I6IDAKZGV2LnZteC4wLnJ4cTAuZGVidWcuY21kMF9m
aWxsOiA5NApkZXYudm14LjAucnhxMC5kZWJ1Zy5jbWQwX25kZXNjOiAyNTYKZGV2LnZteC4w
LnJ4cTAuZGVidWcuY21kMF9nZW46IDEKZGV2LnZteC4wLnJ4cTAuZGVidWcuY21kMV9maWxs
OiAwCmRldi52bXguMC5yeHEwLmRlYnVnLmNtZDFfbmRlc2M6IDI1NgpkZXYudm14LjAucnhx
MC5kZWJ1Zy5jbWQxX2dlbjogMApkZXYudm14LjAucnhxMC5kZWJ1Zy5jb21wX25leHQ6IDM1
MApkZXYudm14LjAucnhxMC5kZWJ1Zy5jb21wX25kZXNjOiA1MTIKZGV2LnZteC4wLnJ4cTAu
ZGVidWcuY29tcF9nZW46IDEK
--------------030705050708030202060003
Content-Type: text/plain;
 name="dev_vmx_iperfserver-amd64_mtu9000.txt"
Content-Transfer-Encoding: base64
Content-Disposition: attachment;
 filename="dev_vmx_iperfserver-amd64_mtu9000.txt"

ZGV2LnZteC4wLiVkZXNjOiBWTXdhcmUgVk1YTkVUMyBFdGhlcm5ldCBBZGFwdGVyCmRldi52
bXguMC4lZHJpdmVyOiB2bXgKZGV2LnZteC4wLiVsb2NhdGlvbjogc2xvdD0wIGZ1bmN0aW9u
PTAgaGFuZGxlPVxfU0JfLlBDSTAuUEU0MS5TMUYwCmRldi52bXguMC4lcG5waW5mbzogdmVu
ZG9yPTB4MTVhZCBkZXZpY2U9MHgwN2IwIHN1YnZlbmRvcj0weDE1YWQgc3ViZGV2aWNlPTB4
MDdiMCBjbGFzcz0weDAyMDAwMApkZXYudm14LjAuJXBhcmVudDogcGNpNApkZXYudm14LjAu
bnR4cXVldWVzOiAxCmRldi52bXguMC5ucnhxdWV1ZXM6IDEKZGV2LnZteC4wLmNvbGxhcHNl
ZDogMApkZXYudm14LjAubWdldGNsX2ZhaWxlZDogMApkZXYudm14LjAubWJ1Zl9sb2FkX2Zh
aWxlZDogMApkZXYudm14LjAudHhxMC5yaW5nZnVsbDogMApkZXYudm14LjAudHhxMC5vZmZs
b2FkX2ZhaWxlZDogMApkZXYudm14LjAudHhxMC5oc3RhdHMudHNvX3BhY2tldHM6IDAKZGV2
LnZteC4wLnR4cTAuaHN0YXRzLnRzb19ieXRlczogMApkZXYudm14LjAudHhxMC5oc3RhdHMu
dWNhc3RfcGFja2V0czogMjU1OTE2CmRldi52bXguMC50eHEwLmhzdGF0cy51bmljYXN0X2J5
dGVzOiAxNzA0Mzc4MApkZXYudm14LjAudHhxMC5oc3RhdHMubWNhc3RfcGFja2V0czogMApk
ZXYudm14LjAudHhxMC5oc3RhdHMubWNhc3RfYnl0ZXM6IDAKZGV2LnZteC4wLnR4cTAuaHN0
YXRzLmVycm9yOiAwCmRldi52bXguMC50eHEwLmhzdGF0cy5kaXNjYXJkOiAwCmRldi52bXgu
MC50eHEwLmRlYnVnLmNtZF9oZWFkOiA0MjkKZGV2LnZteC4wLnR4cTAuZGVidWcuY21kX25l
eHQ6IDQyOQpkZXYudm14LjAudHhxMC5kZWJ1Zy5jbWRfbmRlc2M6IDUxMgpkZXYudm14LjAu
dHhxMC5kZWJ1Zy5jbWRfZ2VuOiAwCmRldi52bXguMC50eHEwLmRlYnVnLmNvbXBfbmV4dDog
NDI5CmRldi52bXguMC50eHEwLmRlYnVnLmNvbXBfbmRlc2M6IDUxMgpkZXYudm14LjAudHhx
MC5kZWJ1Zy5jb21wX2dlbjogMApkZXYudm14LjAucnhxMC5oc3RhdHMubHJvX3BhY2tldHM6
IDAKZGV2LnZteC4wLnJ4cTAuaHN0YXRzLmxyb19ieXRlczogMApkZXYudm14LjAucnhxMC5o
c3RhdHMudWNhc3RfcGFja2V0czogNTAxMTg2CmRldi52bXguMC5yeHEwLmhzdGF0cy51bmlj
YXN0X2J5dGVzOiA0MzcwMjQzODE2CmRldi52bXguMC5yeHEwLmhzdGF0cy5tY2FzdF9wYWNr
ZXRzOiAwCmRldi52bXguMC5yeHEwLmhzdGF0cy5tY2FzdF9ieXRlczogMApkZXYudm14LjAu
cnhxMC5oc3RhdHMuYmNhc3RfcGFja2V0czogOApkZXYudm14LjAucnhxMC5oc3RhdHMuYmNh
c3RfYnl0ZXM6IDQ4MApkZXYudm14LjAucnhxMC5oc3RhdHMubm9idWZmZXI6IDI4NwpkZXYu
dm14LjAucnhxMC5oc3RhdHMuZXJyb3I6IDAKZGV2LnZteC4wLnJ4cTAuZGVidWcuY21kMF9m
aWxsOiAxNDcKZGV2LnZteC4wLnJ4cTAuZGVidWcuY21kMF9uZGVzYzogMjU2CmRldi52bXgu
MC5yeHEwLmRlYnVnLmNtZDBfZ2VuOiAxCmRldi52bXguMC5yeHEwLmRlYnVnLmNtZDFfZmls
bDogMjM0CmRldi52bXguMC5yeHEwLmRlYnVnLmNtZDFfbmRlc2M6IDI1NgpkZXYudm14LjAu
cnhxMC5kZWJ1Zy5jbWQxX2dlbjogMQpkZXYudm14LjAucnhxMC5kZWJ1Zy5jb21wX25leHQ6
IDgwCmRldi52bXguMC5yeHEwLmRlYnVnLmNvbXBfbmRlc2M6IDUxMgpkZXYudm14LjAucnhx
MC5kZWJ1Zy5jb21wX2dlbjogMAo=
--------------030705050708030202060003--

--------------enigA68C03B9D347177ACD70FBCB
Content-Type: application/pgp-signature; name="signature.asc"
Content-Description: OpenPGP digital signature
Content-Disposition: attachment; filename="signature.asc"

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v2.0.18 (FreeBSD)

iEYEARECAAYFAlIct7EACgkQLDqVQ9VXb8gmZwCfb+hB8luHCI5PK3Q1LGJacJ9B
I0MAoL4Bj214AxpZ45K/+6nV5qtGQDKH
=QsK5
-----END PGP SIGNATURE-----

--------------enigA68C03B9D347177ACD70FBCB--



Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?521CB7AC.90605>