Date: Wed, 31 Jul 2013 13:08:43 +1200 From: Berend de Boer <berend@pobox.com> To: Rick Macklem <rmacklem@uoguelph.ca> Cc: freebsd-fs <freebsd-fs@freebsd.org> Subject: Re: Terrible NFS4 performance: FreeBSD 9.1 + UFS/ZFS + AWS EC2 Message-ID: <874nbb7cys.wl%berend@pobox.com> In-Reply-To: <153512858.1034456.1373755540674.JavaMail.root@uoguelph.ca> References: <8761wfvwml.wl%berend@pobox.com> <153512858.1034456.1373755540674.JavaMail.root@uoguelph.ca>
next in thread | previous in thread | raw e-mail | index | archive | help
--pgp-sign-Multipart_Wed_Jul_31_13:08:43_2013-1 Content-Type: text/plain; charset=US-ASCII >>>>> "Rick" == Rick Macklem <rmacklem@uoguelph.ca> writes: Rick> I think you mentioned that you were using a Linux client, Rick> but not what version. I'd suggest a recent kernel from Rick> kernel.org. (Fedora tracks updates/fixes for NFSv4 pretty Rick> closely, so the newest Fedora release should be pretty Rick> current.) This was Ubuntu 10.04 LTS. Have just tried a FreeBSD 9.1 client. Similar numbers. NFSv3 is about 30% slower on FreeBSD than Linux: 3m30s versus 2m10s. NFSv4 has the same terribly slow performance, i.e. 21m56s for the same test. Interestingly, the nfsd cpu usage doesn't rise as high as with Linux. But goes up to 20% (instead of over 50%). I had a look at collectd measurements as well, one cpu on the FreeBSD server is spending a lot of time in IRQ (whatever that means). BTS, this was a FreeBSD NFS4 out-of-the-box server, not with the patch (as the patch didn't do that much for me, it did some, but performance was still 8 times slower than nfs3). Rick> All I can suggest is capturing packets and then emailing be Rick> the captured packet trace. You can use tcpdump to do the Rick> capture, since wireshark will understand it: # tcpdump -s 0 Rick> -w <file>.pcap host <client-host> and then emailing me Rick> <file>.pcap. Rick> I can take a look at the packet capture and maybe see what Rick> is going on. Will email them shortly. -- All the best, Berend de Boer ------------------------------------------------------ Awesome Drupal hosting: https://www.xplainhosting.com/ --pgp-sign-Multipart_Wed_Jul_31_13:08:43_2013-1 Content-Type: application/pgp-signature Content-Transfer-Encoding: 7bit Content-Description: OpenPGP Digital Signature -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.17 (GNU/Linux) iQIcBAABCAAGBQJR+GObAAoJEKOfeD48G3g52tUQANGXsgDpVeOJaTCdCrL87Lfv JHU7KDVfHF2EsODVw0zV0nO/nd+iyggzjAO8sc4EUDXU9HljLOsZccmu9mUr1X/Q ytwuLN57ZL+RbQab9Mu7U/+NeGu0qhT1Y+RPAL4zeNYBRSXECAkqwD9z2pPmA/ca D7MAXRqssU6toPIb44xoTMyfxIPEWEjFRk5dgSWdJHXrsUmFgrfEQhAc4gU/1tS0 nH5Y/zEGi3Tp99pmZczncSrDIk6SkzA7ZxKyIfDSpZfdcd9cqgm8olZPXXy+OYHu o1PnFMHcCb5e77+ALlfExXvN+AQHfoA+VXXTK/XOeyPY9LH/lo6v6OlgnzEjcEd4 tZ9SSYTFF6UyDZc6fatzLLJwhcqRCZPwWdXKtPCdEGorUBONVZ626b304eUc4iG4 0CBIPU5Ziang+8+2PDnAxyDzJmUmHljWu8Cr54+hZjxs0m0T07hNHLaoDpqtLHB3 VMy1BSg2ABZ5+oOtBx5IS1uBDVqXMUGbxJfhvHxI/iyAdOhz18wgiv5e+HlVkvLn aOgCUgFdILBh8OquA1uUzfTWkadndcHHSpF7mN9OzM+Vc1i6KJIDyGpKmCIHLbVm yreJGrTDM/gS2WjqXpyuzf3mqFzVP5bwLsvstRIU//2zEGDqy8WLhLgvxvRFm9zv YaIA98hQsJKA6H2WqtzD =2Alm -----END PGP SIGNATURE----- --pgp-sign-Multipart_Wed_Jul_31_13:08:43_2013-1--
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?874nbb7cys.wl%berend>