Date: Thu, 15 May 2014 14:33:38 -0600 From: "Janky Jay, III" <jankyj@unfs.us> To: freebsd-infiniband@freebsd.org Subject: Re: FBSD to FBSD NFS Mounts over IB. Message-ID: <537524A2.1010901@unfs.us> In-Reply-To: <5374F7EA.6060505@unfs.us> References: <5374D431.5020501@unfs.us> <55BC554716A7EA5C54F5DD02@study64.tdx.co.uk> <5374F7EA.6060505@unfs.us>
next in thread | previous in thread | raw e-mail | index | archive | help
On 05/15/2014 11:22 AM, Janky Jay, III wrote: > Hello Karl, > > On 05/15/2014 10:50 AM, Karl Pielorz wrote: >> >> >> --On 15 May 2014 08:50:25 -0600 "Janky Jay, III" <jankyj@unfs.us> wrote: >> >>> I have set up one of the FBSD systems to run OpenSM and also be an >>> NFS >>> server which all the systems seem to be able to mount over the IB >>> devices >>> without any issue at all. Small reads and writes to and from the NFS >>> server to all the other nodes also seems to work without any issue. >>> However, if I try to dump large amounts of data using "dd" (in order to >>> test speeds and stability), the FBSD NFS client craps out immediately. I >>> just get the following message(s) over and over: >>> >>> newnfs server 10.11.1.1:/data: not responding >>> newnfs server 10.11.1.1:/data: not responding >> >> Can both sides 'ping' each other when this happens? >> > > I just tested this while node2 was hanging with another NFS > transfer (just a "cp /home/file /data/file") and both nodes (1 and 2) > can ping each other without any issues. > Quick update: I rebuild the kernel without the IPOIB_CM to get rid of connected mode and everything seems to be working fine now. Hopefully this will turn out to be as stable as I need and we can use ZFS for cluster storage. Thanks again for the replies and help, Karl! Regards, Janky Jay, III
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?537524A2.1010901>