Date: Mon, 08 Jul 2013 10:54:09 +1200 From: Berend de Boer <berend@pobox.com> To: freebsd-fs <freebsd-fs@freebsd.org> Subject: Terrible NFS4 performance: FreeBSD 9.1 + ZFS + AWS EC2 Message-ID: <87y59i0yni.wl%berend@pobox.com>
next in thread | raw e-mail | index | archive | help
--pgp-sign-Multipart_Mon_Jul__8_10:54:09_2013-1
Content-Type: text/plain; charset=US-ASCII
Hi All,
I've just completed a round of NFS testing on FreeBSD 9.1 on AWS. The
underlying file system is ZFS. I have a real nfs killer test: doing
an "svn update" of a directory of 3541 files.
Performance on the NFS server itself is good: checking this out takes
11 seconds (doing the same on a not really comparable Linux NFS server
is 43 seconds).
Doing this on a client writing to an NFS mounted home directory is
however terrible. Really terrible. This takes 25 minutes! With
"sync=disable" it's 16 minutes.
(doing this against the underpowered Linux NFS server is about 4.5 minutes).
The problem might be that the NFS server (nfsd) runs at 70-80% CPU. So
my writing speed is cpu bound (go figure).
Repeating this with nfs4 + udp: doesn't work at all, get input/output
error after a few files.
nfs3: 1m55s (nfsd cpu is in the 6%-8% range)
Varying tcp/udp, lock/nolock, sync/async, or enabling zfs
sync=standard doesn't make any particular difference. All timing were
within the 1m49s - 2m3s range.
So what's up with NFS4 on FreeBSD?
--
All the best,
Berend de Boer
------------------------------------------------------
Awesome Drupal hosting: https://www.xplainhosting.com/
--pgp-sign-Multipart_Mon_Jul__8_10:54:09_2013-1
Content-Type: application/pgp-signature
Content-Transfer-Encoding: 7bit
Content-Description: OpenPGP Digital Signature
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v2.0.17 (GNU/Linux)
iQIcBAABCAAGBQJR2fGRAAoJEKOfeD48G3g5NBsP/2p6Di1zrqbEtUASd81QfoaM
598UTjg44oDr7HZor02JiTbwdTtVpvN94sEb8jZa5ZNhcLnOvL6uBdzTSS+Bz7Tb
X+ZQte2qfjtFLShBb8IwWt+L1hpVYiT/Hxg37hgnHtzzuW4Z3bR2mNUtAi5Bjdv6
HPNpZ0tjTY60huCLMI9tR67VBcGeo2yCBf/k32oM/wGoQoZQLgZlAxUdpk52KiQ1
jxeCY/fgjXyHA0MlC5H+q3e55Q9pS+sDK+0c6op3Z3QbCGstncWXSBPtWxWHMwuq
Fg+rhaM8A1tbAEMIUHgN2pI8YqTrGOokrG2MH4YHPy+i6QwupZr5PksbGE6VW+EK
3k8v8rxS9t7DErBZWZjQMclaFnswcVg95v7gCCyrwS2LCPEv+y6nvGQvKeyLnkp8
Vdq+WaEoPrOhR/Wv2dmHStO+9628t0A8aNCoUXjGUV+w9yg+Sf2RL33AwY++6pEX
frHzSIts+UjBf/H/l4FLY5OC/6TG+pnMG7pEWeNv069HR5NQ564rEMPnPLB++kqo
ySOicFdudetqCeS8gsF8LE2Z2SwT+U/mOwnDyUq/ukpclu9biMIwRauA6NpNLIaR
ywjZsVnTA9Ip4NlmV1dCYN3EPWx6zAroiXctAlshEfm4Ud6Tu3ubvj0LbJuCI7v2
KKnIZiqgv+F9AWaswJhL
=gJek
-----END PGP SIGNATURE-----
--pgp-sign-Multipart_Mon_Jul__8_10:54:09_2013-1--
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?87y59i0yni.wl%berend>