From owner-freebsd-fs@FreeBSD.ORG Mon Sep 2 14:10:41 2013 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTP id 1070CE62 for ; Mon, 2 Sep 2013 14:10:41 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) Received: from esa-annu.net.uoguelph.ca (esa-annu.mail.uoguelph.ca [131.104.91.36]) by mx1.freebsd.org (Postfix) with ESMTP id CA4AD25E0 for ; Mon, 2 Sep 2013 14:10:40 +0000 (UTC) X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: AqEEAA6cJFKDaFve/2dsb2JhbABahA2DJ7pMgnOBPXSCKyNWGxoCDRkCWQaIFacykXeBKY4iNAeCaYE0A6lbgzwggW4 X-IronPort-AV: E=Sophos;i="4.89,1007,1367985600"; d="scan'208";a="48116724" Received: from muskoka.cs.uoguelph.ca (HELO zcs3.mail.uoguelph.ca) ([131.104.91.222]) by esa-annu.net.uoguelph.ca with ESMTP; 02 Sep 2013 10:10:18 -0400 Received: from zcs3.mail.uoguelph.ca (localhost.localdomain [127.0.0.1]) by zcs3.mail.uoguelph.ca (Postfix) with ESMTP id 53324B3F49; Mon, 2 Sep 2013 10:10:18 -0400 (EDT) Date: Mon, 2 Sep 2013 10:10:18 -0400 (EDT) From: Rick Macklem To: "Sam Fourman Jr." Message-ID: <590302855.16994708.1378131018328.JavaMail.root@uoguelph.ca> In-Reply-To: Subject: Re: NFS on ZFS pure SSD pool MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [172.17.91.201] X-Mailer: Zimbra 7.2.1_GA_2790 (ZimbraWebClient - FF3.0 (Win)/7.2.1_GA_2790) Cc: FreeBSD FS X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 02 Sep 2013 14:10:41 -0000 Sam Fourman Jr. wrote: [lots of stuff snipped for brevity] > root@students:/users # nfsstat -e -s > > Server Info: > Getattr Setattr Lookup Readlink Read Write Create > Remove > 106273793 1417764 19593633 12021 2497674 7927757 1047249 > 772450 > Rename Link Symlink Mkdir Rmdir Readdir RdirPlus > Access > 319284 924 13813 63500 20980 526257 0 > 677005862 I didn't spot this when it first was posted, because of the wrap around. That's a *lot* of Access operations, imho. Maybe tweaking the Mac OS X client could reduce these? I see there are a couple of options in their nfs.conf(5) file that might help? nfs.client.access_cache_timeout nfs.client.access_for_getattr You could also look at their mount_nfs man page to see if there are other settings for access related stuff. As well, I'm wondering if the Macs may be doing Access ops like crazy because they see that ACLs are enabled. I think ZFS always have ACLs enabled, but you can change the line in sys/fs/nfs/nfs_commonsubs.c int nfsrv_useacl = 1; to int nfsrv_useacl = 0; and then build/boot a new kernel on the server to disable them. (It isn't a sysctl, because it normally depends on the server file system to say if they are supported.) Also, pull up a terminal window and do an "ls -l" on some directory, to make sure everything isn;t owned by "nobody". If it is, the name/uid mapping for NFSv4 isn;t working correctly. Good luck with it, rick