From owner-freebsd-amd64@FreeBSD.ORG Tue May 8 19:30:06 2007 Return-Path: X-Original-To: freebsd-amd64@hub.freebsd.org Delivered-To: freebsd-amd64@hub.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 5C55716A406 for ; Tue, 8 May 2007 19:30:06 +0000 (UTC) (envelope-from gnats@FreeBSD.org) Received: from freefall.freebsd.org (freefall.freebsd.org [69.147.83.40]) by mx1.freebsd.org (Postfix) with ESMTP id 3CE0313C455 for ; Tue, 8 May 2007 19:30:06 +0000 (UTC) (envelope-from gnats@FreeBSD.org) Received: from freefall.freebsd.org (gnats@localhost [127.0.0.1]) by freefall.freebsd.org (8.13.4/8.13.4) with ESMTP id l48JU6Ja007774 for ; Tue, 8 May 2007 19:30:06 GMT (envelope-from gnats@freefall.freebsd.org) Received: (from gnats@localhost) by freefall.freebsd.org (8.13.4/8.13.4/Submit) id l48JU6ZT007773; Tue, 8 May 2007 19:30:06 GMT (envelope-from gnats) Resent-Date: Tue, 8 May 2007 19:30:06 GMT Resent-Message-Id: <200705081930.l48JU6ZT007773@freefall.freebsd.org> Resent-From: FreeBSD-gnats-submit@FreeBSD.org (GNATS Filer) Resent-To: freebsd-amd64@FreeBSD.org Resent-Reply-To: FreeBSD-gnats-submit@FreeBSD.org, Seraphi Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id CB6E216A407 for ; Tue, 8 May 2007 19:26:08 +0000 (UTC) (envelope-from nobody@FreeBSD.org) Received: from www.freebsd.org (www.freebsd.org [69.147.83.33]) by mx1.freebsd.org (Postfix) with ESMTP id BD48213C465 for ; Tue, 8 May 2007 19:26:08 +0000 (UTC) (envelope-from nobody@FreeBSD.org) Received: from www.freebsd.org (localhost [127.0.0.1]) by www.freebsd.org (8.13.1/8.13.1) with ESMTP id l48JQ89o038985 for ; Tue, 8 May 2007 19:26:08 GMT (envelope-from nobody@www.freebsd.org) Received: (from nobody@localhost) by www.freebsd.org (8.13.1/8.13.1/Submit) id l48JL7gO030815; Tue, 8 May 2007 19:21:07 GMT (envelope-from nobody) Message-Id: <200705081921.l48JL7gO030815@www.freebsd.org> Date: Tue, 8 May 2007 19:21:07 GMT From: Seraphi To: freebsd-gnats-submit@FreeBSD.org X-Send-Pr-Version: www-3.0 Cc: Subject: amd64/112528: NFS over TCP under load hangs with "impossible packet length" X-BeenThere: freebsd-amd64@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Porting FreeBSD to the AMD64 platform List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 08 May 2007 19:30:06 -0000 >Number: 112528 >Category: amd64 >Synopsis: NFS over TCP under load hangs with "impossible packet length" >Confidential: no >Severity: serious >Priority: high >Responsible: freebsd-amd64 >State: open >Quarter: >Keywords: >Date-Required: >Class: sw-bug >Submitter-Id: current-users >Arrival-Date: Tue May 08 19:30:05 GMT 2007 >Closed-Date: >Last-Modified: >Originator: Seraphi >Release: 6.2-RELEASE-p4 >Organization: >Environment: FreeBSD nfsclient05.domain.com 6.2-RELEASE-p4 FreeBSD 6.2-RELEASE-p4 #0: Tue May 8 13:59:19 EDT 2007 admin@nfsclient05.domain.com:/usr/obj/usr/src/sys/MYKERN_62_05042007 amd64 >Description: NFS over UDP will hang under load and throw the following errors to syslog: May 8 14:36:55 nfsclient05 kernel: impossible packet length (13050202) from nfs server 192.168.101.12:/store22 May 8 14:36:56 nfsclient05 kernel: impossible packet length (1669907873) from nfs server 192.168.101.12:/store22 May 8 14:37:01 nfsclient05 kernel: impossible packet length (46381) from nfs server 192.168.101.12:/store22 I have tried many mount options, but here is one set that will have this problem: 192.168.101.12:/store22 /s22 nfs ro,-i,-b,-3,-T,-r=16384,-w=16384 0 0 To get the error to occur, I simply copy a multi-gig file from NFS to a local drive. It happens very frequently. I have only tried this on gigabit networks. The error goes away if I use UDP, which is what I am using until this is fixed. I have tried this on FreeBSD 6.1 as well and had the same problem. I have also tried a different NFS server running a different OS on a different network with a different configuration on different hardware. It did not help. I have tried updating with freebsd-update but the status is unchanged. >How-To-Repeat: Put an NFS client and server on a gigabit network. Mount the server using TCP: 192.168.101.12:/store22 /s22 nfs ro,-i,-b,-3,-T,-r=16384,-w=16384 0 0 Copy a large file (1GB+) from the NFS mount to a local drive. Do this a couple of times, then check /var/log/messages >Fix: Use UDP: 192.168.101.12:/store22 /s22 nfs ro,-i,-b,-3,-U,-r=16384,-w=16384 0 0 >Release-Note: >Audit-Trail: >Unformatted: