From owner-freebsd-fs@FreeBSD.ORG  Sun Aug  4 22:43:39 2013
Return-Path: <owner-freebsd-fs@FreeBSD.ORG>
Delivered-To: freebsd-fs@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115])
 (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits))
 (No client certificate requested)
 by hub.freebsd.org (Postfix) with ESMTP id 0145C108;
 Sun,  4 Aug 2013 22:43:39 +0000 (UTC)
 (envelope-from rmacklem@uoguelph.ca)
Received: from esa-annu.net.uoguelph.ca (esa-annu.mail.uoguelph.ca
 [131.104.91.36])
 by mx1.freebsd.org (Postfix) with ESMTP id A8BA02CAB;
 Sun,  4 Aug 2013 22:43:37 +0000 (UTC)
X-IronPort-Anti-Spam-Filtered: true
X-IronPort-Anti-Spam-Result: AqIEABLY/lGDaFve/2dsb2JhbABagztQgxC8BYEzdIIkAQEFI1YbGAICDRkCWQYTiBCkSpBcBIEojj00B4JmgScDqS+DMyCBbg
X-IronPort-AV: E=Sophos;i="4.89,814,1367985600"; d="scan'208";a="43084940"
Received: from muskoka.cs.uoguelph.ca (HELO zcs3.mail.uoguelph.ca)
 ([131.104.91.222])
 by esa-annu.net.uoguelph.ca with ESMTP; 04 Aug 2013 18:43:31 -0400
Received: from zcs3.mail.uoguelph.ca (localhost.localdomain [127.0.0.1])
 by zcs3.mail.uoguelph.ca (Postfix) with ESMTP id 45032B3F41;
 Sun,  4 Aug 2013 18:43:31 -0400 (EDT)
Date: Sun, 4 Aug 2013 18:43:31 -0400 (EDT)
From: Rick Macklem <rmacklem@uoguelph.ca>
To: Berend de Boer <berend@pobox.com>
Message-ID: <217266388.5736789.1375656211230.JavaMail.root@uoguelph.ca>
In-Reply-To: <87iozr5c03.wl%berend@pobox.com>
Subject: Re: Terrible NFS4 performance: FreeBSD 9.1 + UFS/ZFS + AWS EC2
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-Originating-IP: [172.17.91.203]
X-Mailer: Zimbra 7.2.1_GA_2790 (ZimbraWebClient - FF3.0 (Win)/7.2.1_GA_2790)
Cc: freebsd-fs <freebsd-fs@freebsd.org>
X-BeenThere: freebsd-fs@freebsd.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: Filesystems <freebsd-fs.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/options/freebsd-fs>,
 <mailto:freebsd-fs-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-fs>
List-Post: <mailto:freebsd-fs@freebsd.org>
List-Help: <mailto:freebsd-fs-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-fs>,
 <mailto:freebsd-fs-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Sun, 04 Aug 2013 22:43:39 -0000

Berend de Boer wrote:
> >>>>> "Julian" == Julian Elischer <julian@freebsd.org> writes:
> 
>     Julian> Recent evidence with AWS is suggesting that the
>     Julian> NOADAPTIVE_XXX options in the XENHVM kernel are now
>     Julian> seriously hindering AWS performance all over the place.
>     Julian> make sure you have tried with these options removed.
> 
> Julian, on the same machine nfs3 is better than Linux, and nfs4 is
> terrible.
> 
All I could tell from the packet trace is that it is doing a massive
number of lookups. I have no idea why the client does this, but it
could possibly be the way the system is storing directory modify times
and the change attribute (which is kinda like a modify time, in that
it changes whenever a file's data or metadata changes, for NFSv4 only).

I know absolutely nothing about this virtualized environment, so all
I can suggest is trying "real hardware" to see if the same behaviour
occurs when the server is running on a real hardware box.

rick

> 
> --
> All the best,
> 
> Berend de Boer
> 
> 
>           ------------------------------------------------------
>           Awesome Drupal hosting: https://www.xplainhosting.com/
> 
>