From owner-freebsd-fs@FreeBSD.ORG  Tue Oct  7 12:04:44 2014
Return-Path: <owner-freebsd-fs@FreeBSD.ORG>
Delivered-To: freebsd-fs@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115])
 (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits))
 (No client certificate requested)
 by hub.freebsd.org (Postfix) with ESMTPS id B3C9FE28
 for <freebsd-fs@freebsd.org>; Tue,  7 Oct 2014 12:04:44 +0000 (UTC)
Received: from esa-annu.net.uoguelph.ca (esa-annu.mail.uoguelph.ca
 [131.104.91.36]) by mx1.freebsd.org (Postfix) with ESMTP id E7D9B5DF
 for <freebsd-fs@freebsd.org>; Tue,  7 Oct 2014 12:04:43 +0000 (UTC)
X-IronPort-Anti-Spam-Filtered: true
X-IronPort-Anti-Spam-Result: ArYEAE/VM1SDaFve/2dsb2JhbABfDoQrBIJ/0TcCgSQBe4QEAQEEIwRSGxgCAg0ZAlkGE4g+rGGVCgEXgSyOZDQHgneBVAWYdYV6kFyDf4MjXCEvgUiBAgEBAQ
X-IronPort-AV: E=Sophos;i="5.04,670,1406606400"; d="scan'208";a="159895168"
Received: from muskoka.cs.uoguelph.ca (HELO zcs3.mail.uoguelph.ca)
 ([131.104.91.222])
 by esa-annu.net.uoguelph.ca with ESMTP; 07 Oct 2014 08:03:33 -0400
Received: from zcs3.mail.uoguelph.ca (localhost.localdomain [127.0.0.1])
 by zcs3.mail.uoguelph.ca (Postfix) with ESMTP id D212CB4031;
 Tue,  7 Oct 2014 08:03:33 -0400 (EDT)
Date: Tue, 7 Oct 2014 08:03:33 -0400 (EDT)
From: Rick Macklem <rmacklem@uoguelph.ca>
To: Garrett Wollman <wollman@csail.mit.edu>
Message-ID: <1109402573.59384867.1412683413852.JavaMail.root@uoguelph.ca>
In-Reply-To: <21554.52000.530951.15561@khavrinen.csail.mit.edu>
Subject: Re: 9.3 NFS client bug?
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-Originating-IP: [172.17.91.209]
X-Mailer: Zimbra 7.2.6_GA_2926 (ZimbraWebClient - FF3.0 (Win)/7.2.6_GA_2926)
Cc: freebsd-fs@freebsd.org
X-BeenThere: freebsd-fs@freebsd.org
X-Mailman-Version: 2.1.18-1
Precedence: list
List-Id: Filesystems <freebsd-fs.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/options/freebsd-fs>,
 <mailto:freebsd-fs-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-fs/>
List-Post: <mailto:freebsd-fs@freebsd.org>
List-Help: <mailto:freebsd-fs-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-fs>,
 <mailto:freebsd-fs-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Tue, 07 Oct 2014 12:04:44 -0000

Garrett Wollman wrote:
> <<On Fri, 3 Oct 2014 18:10:16 -0400 (EDT), Rick Macklem
> <rmacklem@uoguelph.ca> said:
> 
> > 2 - Try an "oldnfs" mount and see if the old client exhibits the
> > same behaviour.
> 
> Same behavior both old and new.  I'm doing binary search now to try
> to
> minimize the size of the workload that exhibits the issue.
> 
> -GAWollman
> 
By ay chance is your ZFS server allocating a ZFS inode (whatever they
call it) with a fileno/inode# that doesn't fit in 32 bits?
(There is a diagnostic printf w.r.t. this for NFSv4, but not NFSv3,
 so you might try an NFSv4 mount. The printf starts with "NFSv4 fileid > 32..".)

Since d_fileno in "struct dirent" is 32bits, NFS just truncates the
64bit fileid to 32bits (or fills the high order 32bits with 0s for the server).
ZFS is known to generate fileids with non-zero high order 32bits->busted.
(And not at all easy to fix. I actually have a somewhat hackish idea for
 a way to make 64bit d_fileno values work without busting backwards compatibility.
 I think I'll post that to freebsd-fs@ and see what others think?)

rick