From owner-freebsd-current@FreeBSD.ORG Tue Nov 8 00:55:09 2005 Return-Path: X-Original-To: freebsd-current@FreeBSD.org Delivered-To: freebsd-current@FreeBSD.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id C94AE16A420 for ; Tue, 8 Nov 2005 00:55:09 +0000 (GMT) (envelope-from yoshint@flab.fujitsu.co.jp) Received: from fgwmail5.fujitsu.co.jp (fgwmail5.fujitsu.co.jp [192.51.44.35]) by mx1.FreeBSD.org (Postfix) with ESMTP id CE25C43D49 for ; Tue, 8 Nov 2005 00:55:07 +0000 (GMT) (envelope-from yoshint@flab.fujitsu.co.jp) Received: from m4.gw.fujitsu.co.jp ([10.0.50.74]) by fgwmail5.fujitsu.co.jp (Fujitsu Gateway) id jA80t6LZ022729 for ; Tue, 8 Nov 2005 09:55:06 +0900 (envelope-from yoshint@flab.fujitsu.co.jp) Received: from s1.gw.fujitsu.co.jp by m4.gw.fujitsu.co.jp (8.12.10/Fujitsu Domain Master) id jA80t508001729 for ; Tue, 8 Nov 2005 09:55:05 +0900 (envelope-from yoshint@flab.fujitsu.co.jp) Received: from s1.gw.fujitsu.co.jp (s1 [127.0.0.1]) by s1.gw.fujitsu.co.jp (Postfix) with ESMTP id DEAB4178156 for ; Tue, 8 Nov 2005 09:55:04 +0900 (JST) Received: from dm.kawasaki.flab.fujitsu.co.jp (dm.kawasaki.flab.fujitsu.co.jp [10.25.192.1]) by s1.gw.fujitsu.co.jp (Postfix) with ESMTP id 6F73517814C for ; Tue, 8 Nov 2005 09:55:04 +0900 (JST) Received: from dm.kawasaki.flab.fujitsu.co.jp by dm.kawasaki.flab.fujitsu.co.jp (8.9.3p2/3.7W-051028-Fujitsu Labs. Kawasaki Domain Mail Master (NAVGW)) id JAA18946; Tue, 8 Nov 2005 09:55:04 +0900 (JST) Received: from palomino.cad.flab.fujitsu.co.jp ([10.25.155.139]) by dm.kawasaki.flab.fujitsu.co.jp (NAVGW 2.5.2.9) with SMTP id M2005110809550318058 for ; Tue, 08 Nov 2005 09:55:03 +0900 Received: from palomino.cad.flab.fujitsu.co.jp (localhost [IPv6:::1]) by palomino.cad.flab.fujitsu.co.jp (8.13.3/8.13.1) with ESMTP id jA80t148018267 for ; Tue, 8 Nov 2005 09:55:03 +0900 (JST) (envelope-from yoshint@flab.fujitsu.co.jp) From: TOMITA Yoshinori To: freebsd-current@FreeBSD.org MIME-Version: 1.0 (generated by WEMIKO 1.14.1 - =?ISO-2022-JP?B?Ig==?= =?ISO-2022-JP?B?GyRCNl9KXExTQ24bKEIi?=) Content-Type: text/plain; charset=US-ASCII Date: Tue, 08 Nov 2005 09:55:01 +0900 Message-ID: User-Agent: T-gnus/6.17.4 (based on No Gnus v0.4) WEMIKO/1.14.1 (=?ISO-2022-JP?B?GyRCNl9KXExTQ24bKEI=?=) SLIM/1.14.7 (=?ISO-2022-JP?B?GyRCPHIwZjpMTD4bKEI=?=) APEL/10.3 XEmacs/21.4.17 (i386-unknown-freebsd5.4) MULE Mule-UCS/0.84 (=?ISO-2022-JP?B?S09VR0VU?= =?ISO-2022-JP?B?U1VEQUk6GyRCOH43bkJmGyhC?=) Cc: Subject: FreeBSD 6.0 TCP NFS client stuck X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 08 Nov 2005 00:55:09 -0000 I saw a NFS client of FreeBSD 6.0-RC1 gets NFS stuck using TCP NFS and amd -w LARGE_NUMBER, where -w specifies dismount interval such as 3600. 6.0-STABLE cvsuped 2005-11-7 has same problem. It has always been OK on FreeBSD 4.X to 5.4-STABLE. FreeBSD 6.0 NFS client seems keep trying NFS access forever after NFS TCP connection is (half?) closed. I am not sure amd and -w argument are the key of this problem, but they raise probability from my experience. NFS Server: Solaris 2.6 NFS Client: FreeBSD 6.0-RC1 (cvsuped 2005-11-02) Starting amd at FreeBSD: /usr/sbin/amd -p -w 3600 -a /.amd_mnt -l syslog /host /etc/amd.map /net /etc/amd.map /etc/amd.map: # changed proto=udp to proto=tcp ------ /defaults type:=host;fs:=${autodir}/${rhost}/host;rhost:=${key} * opts:=rw,grpid,resvport,vers=3,proto=tcp,nosuid,nodev ------ tcpdump log: -------------------------------------------------- [several minutes passed after NFS auto-mounted] 11:09:38.852928 IP CLIENT.3254779904 > SERVER.nfs: 40 null 11:09:38.853261 IP SERVER.nfs > CLIENT.3254779904: reply ok 24 null 11:10:08.851290 IP CLIENT.3523215360 > SERVER.nfs: 40 null 11:10:08.851529 IP SERVER.nfs > CLIENT.3523215360: reply ok 24 null [FIN from NFS server, FreeBSD NFS client sends ACK] 11:10:08.854469 IP SERVER.nfsd > CLIENT.820: F 341:341(0) ack 200 win 10136 11:10:08.854555 IP CLIENT.820 > SERVER.nfsd: . ack 342 win 65535 11:10:08.864321 IP SERVER.nfsd > CLIENT.679: F 341:341(0) ack 200 win 10136 11:10:08.864383 IP CLIENT.679 > SERVER.nfsd: . ack 342 win 65535 11:10:08.895133 IP SERVER.nfsd > CLIENT.735: F 40141:40141(0) ack 1900 win 10136 11:10:08.895203 IP CLIENT.735 > SERVER.nfsd: . ack 40142 win 65535 [still NFS NULL continues from FreeBSD NFS client] 11:10:38.849614 IP CLIENT.3791650816 > SERVER.nfs: 40 null 11:10:38.849906 IP SERVER.nfs > CLIENT.3791650816: reply ok 24 null 11:11:08.847947 IP CLIENT.4060086272 > SERVER.nfs: 40 null 11:11:08.848289 IP SERVER.nfs > CLIENT.4060086272: reply ok 24 null 11:11:38.846275 IP CLIENT.33619968 > SERVER.nfs: 40 null 11:11:38.846555 IP SERVER.nfs > CLIENT.33619968: reply ok 24 null [do some NFS access, such as /bin/ls /host/SERVER/SOMEWHERE on FreeBSD] 11:12:08.413414 IP CLIENT.302055424 > SERVER.nfs: 40 null 11:12:08.413797 IP SERVER.nfs > CLIENT.302055424: reply ok 24 null 11:12:08.414096 IP CLIENT.1563723127 > SERVER.nfs: 132 access [|nfs] 11:12:08.507632 IP SERVER.nfsd > CLIENT.735: . ack 2032 win 10136 11:12:10.083443 IP CLIENT.1563723127 > SERVER.nfs: 132 access [|nfs] 11:12:10.177666 IP SERVER.nfsd > CLIENT.735: . ack 2164 win 10136 11:12:11.743299 IP CLIENT.1563723127 > SERVER.nfs: 132 access [|nfs] 11:12:11.837696 IP SERVER.nfsd > CLIENT.735: . ack 2296 win 10136 11:12:15.063018 IP CLIENT.1563723127 > SERVER.nfs: 132 access [|nfs] 11:12:15.157790 IP SERVER.nfsd > CLIENT.735: . ack 2428 win 10136 11:12:21.702417 IP CLIENT.1563723127 > SERVER.nfs: 132 access [|nfs] 11:12:21.798028 IP SERVER.nfsd > CLIENT.735: . ack 2560 win 10136 11:12:34.981251 IP CLIENT.1563723127 > SERVER.nfs: 132 access [|nfs] 11:12:35.078429 IP SERVER.nfsd > CLIENT.735: . ack 2692 win 10136 11:12:38.411967 IP CLIENT.570490880 > SERVER.nfs: 40 null 11:12:38.412267 IP SERVER.nfs > CLIENT.570490880: reply ok 24 null 11:13:01.538891 IP CLIENT.1563723127 > SERVER.nfs: 132 access [|nfs] [----> message repeats on FreeBSD NFS client] nfs server SERVER:/export/home: not responding -------------------------------------------------- [netstat @ Solaris NFS server, when NFS is OK] SERVER.nfsd CLIENT.820 131070 0 10136 0 ESTABLISHED SERVER.nfsd CLIENT.735 131070 0 10136 0 ESTABLISHED SERVER.nfsd CLIENT.679 131070 0 10136 0 ESTABLISHED [after NFS stuck] SERVER.nfsd CLIENT.820 131070 0 10136 0 FIN_WAIT_2 SERVER.nfsd CLIENT.735 131070 0 10136 0 FIN_WAIT_2 SERVER.nfsd CLIENT.679 131070 0 10136 0 FIN_WAIT_2 [netstat @ FreeBSD NFS client, after NFS stuck] tcp4 0 0 CLIENT.679 SERVER.nfsd CLOSE_WAIT tcp4 0 0 CLIENT.735 SERVER.nfsd CLOSE_WAIT tcp4 0 0 CLIENT.820 SERVER.nfsd CLOSE_WAIT -- --- TOMITA Yoshinori (Fujitsu Laboratories Ltd., Kawasaki, Japan)