From owner-freebsd-bugs@FreeBSD.ORG Thu Mar 24 22:30:02 2005 Return-Path: Delivered-To: freebsd-bugs@hub.freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id D933416A4CE for ; Thu, 24 Mar 2005 22:30:02 +0000 (GMT) Received: from freefall.freebsd.org (freefall.freebsd.org [216.136.204.21]) by mx1.FreeBSD.org (Postfix) with ESMTP id A4AC143D54 for ; Thu, 24 Mar 2005 22:30:02 +0000 (GMT) (envelope-from gnats@FreeBSD.org) Received: from freefall.freebsd.org (gnats@localhost [127.0.0.1]) by freefall.freebsd.org (8.13.3/8.13.3) with ESMTP id j2OMU2mU070440 for ; Thu, 24 Mar 2005 22:30:02 GMT (envelope-from gnats@freefall.freebsd.org) Received: (from gnats@localhost) by freefall.freebsd.org (8.13.3/8.13.1/Submit) id j2OMU2ZM070436; Thu, 24 Mar 2005 22:30:02 GMT (envelope-from gnats) Resent-Date: Thu, 24 Mar 2005 22:30:02 GMT Resent-Message-Id: <200503242230.j2OMU2ZM070436@freefall.freebsd.org> Resent-From: FreeBSD-gnats-submit@FreeBSD.org (GNATS Filer) Resent-To: freebsd-bugs@FreeBSD.org Resent-Reply-To: FreeBSD-gnats-submit@FreeBSD.org, Eli dart Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 1D63F16A4CE for ; Thu, 24 Mar 2005 22:25:16 +0000 (GMT) Received: from mx2.nersc.gov (mx2.nersc.gov [128.55.6.22]) by mx1.FreeBSD.org (Postfix) with ESMTP id BD75943D39 for ; Thu, 24 Mar 2005 22:25:15 +0000 (GMT) (envelope-from dart@nersc.gov) Received: by mx2.nersc.gov (Postfix, from userid 4002) id CD55C7786; Thu, 24 Mar 2005 14:21:26 -0800 (PST) Received: from mx2.nersc.gov (localhost [127.0.0.1]) by localhost.nersc.gov (Postfix) with ESMTP id 20F2977B1; Thu, 24 Mar 2005 14:21:21 -0800 (PST) Received: from omega.nersc.gov (omega.nersc.gov [128.55.14.26]) by mx2.nersc.gov (Postfix) with ESMTP id 59EAC7786; Thu, 24 Mar 2005 14:17:31 -0800 (PST) Received: by omega.nersc.gov (Postfix, from userid 31586) id 1F7CF11469; Thu, 24 Mar 2005 14:17:31 -0800 (PST) Message-Id: <20050324221731.1F7CF11469@omega.nersc.gov> Date: Thu, 24 Mar 2005 14:17:31 -0800 (PST) From: Eli dart To: FreeBSD-gnats-submit@FreeBSD.org X-Send-Pr-Version: 3.113 Subject: kern/79214: iozone hurts tcp-based NFS X-BeenThere: freebsd-bugs@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list Reply-To: Eli dart List-Id: Bug reports List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 24 Mar 2005 22:30:03 -0000 >Number: 79214 >Category: kern >Synopsis: iozone hurts tcp-based NFS >Confidential: no >Severity: serious >Priority: high >Responsible: freebsd-bugs >State: open >Quarter: >Keywords: >Date-Required: >Class: sw-bug >Submitter-Id: current-users >Arrival-Date: Thu Mar 24 22:30:02 GMT 2005 >Closed-Date: >Last-Modified: >Originator: Eli dart >Release: FreeBSD 5.4-PRERELEASE i386 >Organization: NERSC >Environment: System: FreeBSD omega.nersc.gov 5.4-PRERELEASE FreeBSD 5.4-PRERELEASE #0: Mon Mar 21 10:48:01 PST 2005 nickb@omega.nersc.gov:/usr/obj/usr/src/sys/OMEGA-STABLE-SMP i386 >Description: iozone causes NFS server problems when using TCP-based NFS: Mar 23 17:10:49 epsilon-new nfs server omega-nfs1:/data/flow: not responding Mar 23 17:10:49 epsilon-new nfs send error 35 for server omega-nfs1:/data/flow Mar 23 17:10:49 epsilon-new nfs server omega-nfs1:/data/syslog: not responding Mar 23 17:10:49 epsilon-new nfs send error 35 for server omega-nfs1:/data/flow Mar 23 17:10:49 epsilon-new nfs send error 35 for server omega-nfs1:/data/flow Mar 23 17:10:49 epsilon-new nfs send error 35 for server omega-nfs1:/data/flow Mar 23 17:10:49 epsilon-new nfs server omega-nfs1:/data/syslog: is alive again Mar 23 17:10:49 epsilon-new nfs server omega-nfs1:/data/flow: is alive again Mar 23 17:10:49 epsilon-new nfs server omega-nfs1:/data/flow: is alive again Mar 23 17:10:49 epsilon-new nfs server omega-nfs1:/data/flow: not responding Mar 23 17:10:49 epsilon-new nfs server omega-nfs1:/data/flow: not responding Mar 23 17:10:49 epsilon-new nfs server omega-nfs1:/data/flow: is alive again >How-To-Repeat: client and server are connected via back-to-back em interfaces (crossover cable, no switch). em driver modified to increase transmit and receive descriptor counts. Chipset version supports this. #define EM_MAX_TXD 4096 #define EM_MAX_RXD 4096 set up NFS as follows: ===== client /etc/fstab ===== omega-nfs1:/data/flow /data/flow nfs rw,nodev,noexec,nosuid,noinet6,nfsv3,intr,- U,-b,-r=32768,-w=65535 0 0 ===== Server config ===== # nfs rpcbind_enable="YES" rpcbind_flags="-h ${nfs_addr1} -h ${nfs_addr2}" rpc_lockd_enable="YES" rpc_statd_enable="YES" nfs_server_enable="YES" nfs_server_flags="-t -n 8 -h ${nfs_addr1} -h ${nfs_addr2}" mountd_enable="YES" ===== /etc/exports ===== /data/flow -maproot=nfsnobody:nogroup client-host Run iozone on client as follows: iozone 2048 32768 /data/flow/iozone/crunch iozone version is 2.01 >Fix: Use UDP for NFS. >Release-Note: >Audit-Trail: >Unformatted: