Date: Thu, 17 Apr 2014 18:22:08 +0100 From: Karl Pielorz <kpielorz_lst@tdx.co.uk> To: Jason Bacon <jwbacon@tds.net>, =?UTF-8?Q?Stig_Inge_Lea_Bj=C3=B8rnsen?= <stiginge@pvv.org>, freebsd-infiniband@freebsd.org Subject: Re: Mellanox MT25418 performance IPOIB? Message-ID: <2E4C44F3E209188F46C55C4F@study64.tdx.co.uk> In-Reply-To: <534FD0BB.1070308@tds.net> References: <DF61C9D7E8748BF2824DDFED@study64.tdx.co.uk> <lilt1l$15v$1@ger.gmane.org> <830453C43410411669F120CC@study64.tdx.co.uk> <534FD0BB.1070308@tds.net>
next in thread | previous in thread | raw e-mail | index | archive | help
--On 17 April 2014 08:01:47 -0500 Jason Bacon <jwbacon@tds.net> wrote: > Hi Karl, > > What type of network are you running? DDR? QDR? FDR? Switch and HCA > models? Ok, still 'new' to IB - I've basically just got two MT25418 cards running back to back in two machines. 'ibportstate' seems to tell me I'm running LinkWidthActive 4X, LinkSpeedActive 5.0Gbps. > FYI, with some tuning effort, I was able to get up to 600 megabytes/sec > both ways over DDR IB from a CentOS NFS server with 12 SATA disks on a > PERC H710, ext4, RAID 6. Might be able to do a little better with > FreeBSD and ZFS where IB is providing 7.5gb/sec. I'm planning on using these cards for HAST between two boxes running ZFS (so they're just doing TCP/IP duties). Though at the moment I've not been overly impressed with HAST's performance (even running with 'none' as the secondary) - it seems to dull the IO performance of any disks it's using even when just reading. I'm going to give it the benefit of doubt though and just build the boxes up, sling a bunch of drives in and see what the performance comes out as. -Karl
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?2E4C44F3E209188F46C55C4F>