From owner-freebsd-fs@FreeBSD.ORG  Fri Aug  3 12:21:09 2012
Return-Path: <owner-freebsd-fs@FreeBSD.ORG>
Delivered-To: freebsd-fs@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52])
	by hub.freebsd.org (Postfix) with ESMTP id EC13B106564A
	for <freebsd-fs@freebsd.org>; Fri,  3 Aug 2012 12:21:08 +0000 (UTC)
	(envelope-from attila.bogar@linguamatics.com)
Received: from mail.linguamatics.com (mail.linguamatics.com [188.39.80.203])
	by mx1.freebsd.org (Postfix) with ESMTP id 6CC788FC16
	for <freebsd-fs@freebsd.org>; Fri,  3 Aug 2012 12:21:08 +0000 (UTC)
Received: from [10.252.10.232] (random.linguamatics.com [10.252.10.232])
	by mail.linguamatics.com (Postfix) with ESMTPSA id 44F98EFB44C
	for <freebsd-fs@freebsd.org>; Fri,  3 Aug 2012 13:21:07 +0100 (BST)
Message-ID: <501BC236.4030607@linguamatics.com>
Date: Fri, 03 Aug 2012 13:21:10 +0100
From: =?ISO-8859-1?Q?Attila_Bog=E1r?= <attila.bogar@linguamatics.com>
User-Agent: Mozilla/5.0 (X11; Linux x86_64;
	rv:14.0) Gecko/20120714 Thunderbird/14.0
MIME-Version: 1.0
To: freebsd-fs@freebsd.org
References: <501B153A.4060408@linguamatics.com>
In-Reply-To: <501B153A.4060408@linguamatics.com>
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 8bit
X-Content-Filtered-By: Mailman/MimeDel 2.1.5
Subject: Re: NFS I/O or permission denied errors
X-BeenThere: freebsd-fs@freebsd.org
X-Mailman-Version: 2.1.5
Precedence: list
List-Id: Filesystems <freebsd-fs.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-fs>,
	<mailto:freebsd-fs-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-fs>
List-Post: <mailto:freebsd-fs@freebsd.org>
List-Help: <mailto:freebsd-fs-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-fs>,
	<mailto:freebsd-fs-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Fri, 03 Aug 2012 12:21:09 -0000

On 03/08/12 01:03, Attila Bogár wrote:
> See the attached bash script.
Sorry, my script has been stripped off by the list.

It's nothing rocket science, takes an export list from a file 
(/root/fs.txt) and mounts the nfs shares in a loop.

-- 8< --
#!/bin/bash

sleepmount=0.33

function mount.all() {
   set -e
   j=0
   while read fs
   do
     echo mounting $fs
     sleep $sleepmount
     mount -t nfs -v -o sec=sys,vers=3,proto=tcp server:$fs /mnt/$j
     sleep $sleepmount
     umount -f /mnt/$j
     j=$[j+1]
   done < /root/fs.txt
   set +e
}

function umount.all() {
   umount -f /mnt/* &>/dev/null
}

fsno="$(wc -l /root/fs.txt|cut -d' ' -f1)"
umount.all
i=0;while [ $i -lt $fsno ]; do echo $i; mkdir /mnt/$i ; i=$[i+1]; done

i=0
while [ $i -lt 1000 ]
do
   i=$[i+1]
   echo "RUN: $i" | tee /tmp/nfstest.status
   mount.all
done
-- 8< --

sec=sys,vers=3,proto=udp seems stable, tcp gets an I/O error within 2-3 
minutes.

I'm testing this from an up to date CentOS 6.3 nfs client.

I suspicious about the network stack. I tried turning off msi and TSO on 
the bce card, but no change yet.
I also took down my lagg interface and tried the onboard single bce, no 
change.

This gentleman had a similar problem with nfsv4 but he got no hint from 
the list:
http://lists.freebsd.org/pipermail/freebsd-stable/2012-June/068658.html

Can someone reproduce the problem or it is specific to my hardware?

Thanks,
   Attila