From owner-freebsd-fs@FreeBSD.ORG Tue Jul 9 08:50:08 2013 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) by hub.freebsd.org (Postfix) with ESMTP id 7B58D654 for ; Tue, 9 Jul 2013 08:50:08 +0000 (UTC) (envelope-from berend@pobox.com) Received: from smtp.pobox.com (b-pb-sasl-quonix.pobox.com [208.72.237.35]) by mx1.freebsd.org (Postfix) with ESMTP id 2D2EC1132 for ; Tue, 9 Jul 2013 08:50:07 +0000 (UTC) Received: from smtp.pobox.com (unknown [127.0.0.1]) by b-sasl-quonix.pobox.com (Postfix) with ESMTP id E5A872C9AD; Tue, 9 Jul 2013 08:50:06 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha1; c=relaxed; d=pobox.com; h=date :message-id:from:to:cc:subject:in-reply-to:references :mime-version:content-type:content-transfer-encoding; s=sasl; bh=tboU3nG049FKipe+Ay3dDawXFmc=; b=P4hl75wsWcT8T2P3ue/qjwP50bvZ ii0bGXfL1PLcLyaQMYYgA1GRyp5c4RdHYvvBrdwS/2+hv7CeSOT+HVSCzZX7cLTY thSHuP8EbGhMBAFnbn19/WQp2IJPwzJE48h/c6V3Gsy37wRh/PigojylK8kv8yHg eLsdUFQMdz5txJ4= DomainKey-Signature: a=rsa-sha1; c=nofws; d=pobox.com; h=date:message-id :from:to:cc:subject:in-reply-to:references:mime-version :content-type:content-transfer-encoding; q=dns; s=sasl; b=KpYHAb A3w51zQQyK9i0nHaTCRgx0+Y3iohMcxQF97cFdzEKcr6Fsincr1/eBW8v6VHbK/j x1bnL6PyiZFtENrv3Qw2nldG+PrZIJPJNfaFN3nWbrJkvSwmwOedi3pj72oD9IxQ 1ovS1UITi9f8OYXC3vKVyMk4ssN2SU07sq3eE= Received: from b-pb-sasl-quonix.pobox.com (unknown [127.0.0.1]) by b-sasl-quonix.pobox.com (Postfix) with ESMTP id DAF152C9AB; Tue, 9 Jul 2013 08:50:06 +0000 (UTC) Received: from bmach.nederware.nl (unknown [27.252.169.66]) by b-sasl-quonix.pobox.com (Postfix) with ESMTPA id EF5E42C9A8; Tue, 9 Jul 2013 08:50:05 +0000 (UTC) Received: from quadrio.nederware.nl (quadrio.nederware.nl [192.168.33.13]) by bmach.nederware.nl (Postfix) with ESMTP id 16D7E5C77; Tue, 9 Jul 2013 20:49:59 +1200 (NZST) Received: from quadrio.nederware.nl (quadrio.nederware.nl [127.0.0.1]) by quadrio.nederware.nl (Postfix) with ESMTP id 59B2649FB97A; Tue, 9 Jul 2013 20:50:03 +1200 (NZST) Date: Tue, 09 Jul 2013 20:50:03 +1200 Message-ID: <8761wkyv5w.wl%berend@pobox.com> From: Berend de Boer To: Daniel Kalchev Subject: Re: Terrible NFS4 performance: FreeBSD 9.1 + ZFS + AWS EC2 In-Reply-To: <51DBC595.4020407@digsys.bg> References: <87y59i0yni.wl%berend@pobox.com> <580122426.2916694.1373242759482.JavaMail.root@uoguelph.ca> <87a9lwyy16.wl%berend@pobox.com> <51DBC595.4020407@digsys.bg> User-Agent: Wanderlust/2.15.9 (Almost Unreal) SEMI-EPG/1.14.7 (Harue) FLIM/1.14.9 (=?UTF-8?B?R29qxY0=?=) APEL/10.8 EasyPG/1.0.0 Emacs/24.3 (i686-pc-linux-gnu) MULE/6.0 (HANACHIRUSATO) Organization: Xplain Technology Ltd MIME-Version: 1.0 (generated by SEMI-EPG 1.14.7 - "Harue") Content-Type: multipart/signed; boundary="pgp-sign-Multipart_Tue_Jul__9_20:50:03_2013-1"; micalg=pgp-sha256; protocol="application/pgp-signature" Content-Transfer-Encoding: 7bit X-Pobox-Relay-ID: 8D5AE19A-E874-11E2-B78B-E84251E3A03C-48001098!b-pb-sasl-quonix.pobox.com Cc: freebsd-fs@freebsd.org X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 09 Jul 2013 08:50:08 -0000 --pgp-sign-Multipart_Tue_Jul__9_20:50:03_2013-1 Content-Type: text/plain; charset=US-ASCII >>>>> "Daniel" == Daniel Kalchev writes: Daniel> Could you please actually post a diagram of your setup, Daniel> with all the components, including the "low spec Linux Daniel> server". Do not forget the RTT (ping) between these Daniel> hosts. If you have made any network tuning too. To be honest, I think that's of little use. I have no impact on where my server is placed in the AWS data centre, nor what other load (cpu or i/o) is also taking place on these boxes. So having approximate values (I'm posting factors of 2 or 4) is the only useful strategy. As you can see I'm not talking about 5% differences here, only about 200% (or 2000%!!!) differences. Pings within an AWS data centre are similar, let's say about 0.450ms. But have a reasonable range. Unless you know AWS I think it's no use posting hardware specs (there are none). The Linux box is a c1.medium, the FreeBSD is an m1.large. FreeBSD is EBS optimised (but disks are not). Daniel> Networking protocols like NFS are heavily influenced by Daniel> factors like RTT. An "underpowered" box that is "nearby" Daniel> (has lover RTT) usually performs much better than a Daniel> "powerful box" with larger RTT and other network Daniel> bottlenecks. I fully agree with that. Daniel> Unfortunately, AWS is far from perfect hardware emulation Daniel> and there might be other layers that intervene with the Daniel> NFS protocol. Exactly right. Given that we are talking factors of difference here I think the hardware in this case does not matter. The problem is in the software. -- All the best, Berend de Boer ------------------------------------------------------ Awesome Drupal hosting: https://www.xplainhosting.com/ --pgp-sign-Multipart_Tue_Jul__9_20:50:03_2013-1 Content-Type: application/pgp-signature Content-Transfer-Encoding: 7bit Content-Description: OpenPGP Digital Signature -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.17 (GNU/Linux) iQIcBAABCAAGBQJR2867AAoJEKOfeD48G3g5+BkQAK1hqpXTzGsivtMBuHa9Rp4a JE1dVHH7+midancQrNifhK3PB4r7iL3RT8hU6DK4jmcVT1QfBLX1w62yzJzfpOtt /gK6NRDhsiv2IctUA/LwYb1Q3yJkAEJ4ukJAgJEtUld7tUQHvp7z1Bk+4qemRgLF tujdhkIYSOItYUfmoNA73A9iLA1QQrZJ99aQml1TzqbloUcPu9q+fMP80eHey0Ew pPTMRjaPtTktkPdFxxeMQu9VcHkdrY00uMU8VkLVICLkb9y0j/RUoIY5mkOLKOwF CPDQyNZLREDMrzlttARhZZaNOM3LK8qIlleLIuRYawtkrrjDa+u/KK0V+WRelv5E 8rrEoEs77ZClZScne/AGz55fvxm8fcMfqv2s6YkG9C2kg3IIEtEHJoNacdLp0kF0 IIShWNKgjMt7pymPt5QVDKUshe74WTolygkRupiBfo3X99JvtjiN2QFQdX3msRq5 oY6P4h2Ro+RJPLvZ+5r9Lvsx7QlEpMdF69lqVegKvVglc3sLAjtbyeXuUqYLLXtR E7/SogQVQHTvhE3km6nvCAXBqbv3mzbaHI5jf3q0WDq+fLma1m6NRgobJ36ycOlS z5DinD47LYZkbMGqwvANrblw6gK7yrzDU1KlIDV9kcCE6k0Lgzg1IDD7D0iPzMOV gS3pXLJCoYaconVkhTGO =Hhfq -----END PGP SIGNATURE----- --pgp-sign-Multipart_Tue_Jul__9_20:50:03_2013-1--