From owner-freebsd-fs@freebsd.org Wed Jul 1 23:36:19 2015 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 17645992496 for ; Wed, 1 Jul 2015 23:36:19 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) Received: from esa-jnhn.mail.uoguelph.ca (esa-jnhn.mail.uoguelph.ca [131.104.91.44]) by mx1.freebsd.org (Postfix) with ESMTP id A96D622E2 for ; Wed, 1 Jul 2015 23:36:18 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: A2DhBADBeJRV/61jaINbg2VfBoMZuiGBZAqFLkoCggYSAQEBAQEBAYEKhCIBAQECAQEBAQEgKyALBQsCAQgOCgICDRkCAicBCSYCBAgHBAEaAgSIBggNtg6XEQEBAQEBAQQBAQEBAQEBG4EhiimENAEBBRc0B4JogUMFjBaHeoRdhDaECESGXY9nAiaEFiIxAQaBBTqBAgEBAQ X-IronPort-AV: E=Sophos;i="5.15,389,1432612800"; d="scan'208";a="221500174" Received: from nipigon.cs.uoguelph.ca (HELO zcs1.mail.uoguelph.ca) ([131.104.99.173]) by esa-jnhn.mail.uoguelph.ca with ESMTP; 01 Jul 2015 19:36:17 -0400 Received: from localhost (localhost [127.0.0.1]) by zcs1.mail.uoguelph.ca (Postfix) with ESMTP id 82C9F15F533; Wed, 1 Jul 2015 19:36:17 -0400 (EDT) Received: from zcs1.mail.uoguelph.ca ([127.0.0.1]) by localhost (zcs1.mail.uoguelph.ca [127.0.0.1]) (amavisd-new, port 10032) with ESMTP id r-ScHg8V0W5k; Wed, 1 Jul 2015 19:36:16 -0400 (EDT) Received: from localhost (localhost [127.0.0.1]) by zcs1.mail.uoguelph.ca (Postfix) with ESMTP id D7F3515F54D; Wed, 1 Jul 2015 19:36:16 -0400 (EDT) X-Virus-Scanned: amavisd-new at zcs1.mail.uoguelph.ca Received: from zcs1.mail.uoguelph.ca ([127.0.0.1]) by localhost (zcs1.mail.uoguelph.ca [127.0.0.1]) (amavisd-new, port 10026) with ESMTP id 1GjLwTQbD3mE; Wed, 1 Jul 2015 19:36:16 -0400 (EDT) Received: from zcs1.mail.uoguelph.ca (zcs1.mail.uoguelph.ca [172.17.95.18]) by zcs1.mail.uoguelph.ca (Postfix) with ESMTP id BD3CE15F533; Wed, 1 Jul 2015 19:36:16 -0400 (EDT) Date: Wed, 1 Jul 2015 19:36:16 -0400 (EDT) From: Rick Macklem To: Ahmed Kamal Cc: freebsd-fs@freebsd.org Message-ID: <684628776.2772174.1435793776748.JavaMail.zimbra@uoguelph.ca> In-Reply-To: References: Subject: Re: Linux NFSv4 clients are getting (bad sequence-id error!) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [172.17.95.10] X-Mailer: Zimbra 8.0.9_GA_6191 (ZimbraWebClient - FF34 (Win)/8.0.9_GA_6191) Thread-Topic: Linux NFSv4 clients are getting (bad sequence-id error!) Thread-Index: Iq69mADIXHh0Bf5jWZ4+5Tg8skxe/Q== X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 01 Jul 2015 23:36:19 -0000 Ahmed Kamal wrote: > Hi all, > > I'm a refugee from linux land. I just set up my first freebsd 10.1 zfs box, > sharing /home over nfs. Since every home directory is its own zfs dataset, > I chose to use nfsv4 to enable recursively sharing/mounting any directory > under /home (I understand nfs4 is a must in this scenario!) > > I'm able to mount form linux (rhel5 latest kernel) successfully. Users are > working fine. However every now and then a user screams that his session is > frozen. Usually the processes are stuck in nfs_wait or rpc_* state. I tried > using a much newer linux kernel (3.2 however it still faced the same > problem). The errors in Linux log files are mostly: > Jul 1 17:41:47 mammoth kernel: NFS: v4 server nas returned a *bad > sequence-id error*! > Jul 1 17:52:32 mammoth kernel: nfs4_reclaim_locks: unhandled error -11. > Zeroing state > Jul 1 17:52:32 mammoth kernel: nfs4_reclaim_open_state: Lock reclaim > failed! > Btw, a client should only do "reclaim" operations after the server has replied with NFS4ERR_STALE_CLIENTID or NFS4ERR_STALE_STATEID. I am pretty certain that the FreeBSD NFSv4 server only generates these replies after it has rebooted, so assuming the server didn't reboot, I have no idea why the client would attempt these and am not surprised they failed. I'm guessing that the DRC constipation somehow caused the Linux client to go into recovery mode? rick > My search led me to (https://access.redhat.com/solutions/1328073) a > detailed analysis of the issue, which you can read over here > https://dl.dropboxusercontent.com/u/51939288/nfs4-bad-seq.pdf .. NetApp > confirmed this was a bug for them (I'm wondering if this is still in > FreeBSD?!) > > PS: Right before sending this, I saw dmesg on the freebsd box advising > increasing vfs.nfsd.tcphighwater .. So I up'ed that to 64000. I also up'ed > the number of nfs server threads (-t) from 10 to 60 (we're roughly 40 linux > machines) > > Any advice is most appreciated! > > Thanks > _______________________________________________ > freebsd-fs@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-fs > To unsubscribe, send any mail to "freebsd-fs-unsubscribe@freebsd.org" >