From owner-freebsd-stable@FreeBSD.ORG Thu May 11 09:11:20 2006 Return-Path: X-Original-To: freebsd-stable@freebsd.org Delivered-To: freebsd-stable@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 315E316A41B for ; Thu, 11 May 2006 09:11:20 +0000 (UTC) (envelope-from yuri@irfu.se) Received: from elvira.ekonomikum.uu.se (elvira.its.UU.SE [130.238.164.5]) by mx1.FreeBSD.org (Postfix) with ESMTP id 76B5F43D62 for ; Thu, 11 May 2006 09:11:16 +0000 (GMT) (envelope-from yuri@irfu.se) Received: by elvira.ekonomikum.uu.se (Postfix, from userid 204) id 999D8E0A; Thu, 11 May 2006 11:11:14 +0200 (MSZ) Received: from elvira.its.uu.se(127.0.0.1) by elvira.its.uu.se via virus-scan id s26650; Thu, 11 May 06 11:11:10 +0200 Received: from hq.irfu.se (hq.irfu.se [130.238.30.10]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by elvira.ekonomikum.uu.se (Postfix) with ESMTP id CDDD0DD7; Thu, 11 May 2006 11:11:09 +0200 (MSZ) Received: from ice.irfu.se (ice.irfu.se [130.238.30.157]) (authenticated bits=0) by hq.irfu.se (8.13.4/8.13.4) with ESMTP id k4B9B8Hq071002 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Thu, 11 May 2006 11:11:08 +0200 (CEST) (envelope-from yuri@irfu.se) From: Yuri Khotyaintsev Organization: Swedish Institute of Space Physics To: Kris Kennaway Date: Thu, 11 May 2006 11:11:07 +0200 User-Agent: KMail/1.9.1 References: <200605081354.58807.yuri@irfu.se> <20060508174133.GA48163@xor.obsecurity.org> In-Reply-To: <20060508174133.GA48163@xor.obsecurity.org> MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable Content-Disposition: inline Message-Id: <200605111111.07882.yuri@irfu.se> X-Spam-Status: No, score=-4.0 required=7.0 tests=ALL_TRUSTED,AWL,BAYES_00 autolearn=ham version=3.1.0 X-Spam-Checker-Version: SpamAssassin 3.1.0 (2005-09-13) on hq.irfu.se Cc: freebsd-stable@freebsd.org Subject: Re: NFS/TCP problems X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 11 May 2006 09:11:20 -0000 On Monday 08 May 2006 19:41, Kris Kennaway wrote: > On Mon, May 08, 2006 at 01:54:58PM +0200, Yuri Khotyaintsev wrote: > > I have an NSF server and several clients which write large text files to > > the server. All machines are running max one week old STABLE and are > > connected to the same gigabit switch, and have identical nics (em). Amd > > mount options are: /defaults > > type:=3Dnfs;cache:=3Dall;opts:=3Drw,intr,nosuid,grpid,nfsv3,tcp,resvpor= t,soft > > > > Almost all the time I get the following messages on the server: > > > > nfsd send error 32 > > nfsd send error 32 > > nfsd send error 32 > > nfsd send error 32 > > nfsd send error 32 > > ... > > > > And corresponding messages on a client: > > > > impossible packet length (8996061) from nfs server db:/export/data1/caa > > impossible packet length (3123011) from nfs server db:/export/data1/caa > > impossible packet length (893006905) from nfs server db:/export/data1/c= aa > > impossible packet length (842018868) from nfs server db:/export/data1/c= aa > > impossible packet length (874220) from nfs server db:/export/data1/caa > > impossible packet length (14182767) from nfs server db:/export/data1/caa > > impossible packet length (16777216) from nfs server db:/export/data1/caa > > impossible packet length (758134573) from nfs server db:/export/data1/c= aa > > impossible packet length (1503661568) from nfs server > > db:/export/data1/caa impossible packet length (1300840) from nfs server > > db:/export/data1/caa ... > > > > And from time to time the files which are written to the server get > > truncated (regardless of the file size)... > > > > Does anybody have an idea how to make it work reliably and not to > > truncate the files? > > mohan committed a fix for one such problem a few days ago. It will > not be in 6.1-RELEASE, but you should be able to apply the patch > yourself. It would be nice to know how it works for you. > > =20 > http://www.freebsd.org/cgi/cvsweb.cgi/src/sys/nfsclient/nfs_socket.c.diff= ?r >1=3Dtext&tr1=3D1.136&r2=3Dtext&tr2=3D1.139 I have patched nfs_socket.c on all clients and run the same kind of process= ing=20 which was causing the problem. I can report that the problem is gone with=20 nfs_socket.c rev 1.139. I only got one "nfs send error 35" on one of the=20 clients instead of hundreds of messages I was seeing before. Thank you very= =20 much! BTW, what is better/faster TCP or UDP for running NFS between hosts connect= ed=20 to the same gigabit switch? =2D-=20 Dr. Yuri Khotyaintsev Institutet f=C3=B6r rymdfysik (IRF), Uppsala