From owner-freebsd-infiniband@FreeBSD.ORG Tue Nov 20 18:59:57 2012 Return-Path: Delivered-To: freebsd-infiniband@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 3F195A11 for ; Tue, 20 Nov 2012 18:59:57 +0000 (UTC) (envelope-from gnn@neville-neil.com) Received: from vps.hungerhost.com (vps.hungerhost.com [216.38.53.176]) by mx1.freebsd.org (Postfix) with ESMTP id 0AAF98FC0C for ; Tue, 20 Nov 2012 18:59:56 +0000 (UTC) Received: from [38.105.238.108] (port=53084 helo=[10.7.1.235]) by vps.hungerhost.com with esmtpsa (TLSv1:AES128-SHA:128) (Exim 4.80) (envelope-from ) id 1Tat35-0008LO-EB; Tue, 20 Nov 2012 13:59:55 -0500 Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 6.2 \(1499\)) Subject: Re: Infiniband experiment environment setting up From: George Neville-Neil In-Reply-To: <20121119115350.3456c580209197b4aea33d75@bsdconsulting.co.jp> Date: Tue, 20 Nov 2012 13:59:54 -0500 Content-Transfer-Encoding: quoted-printable Message-Id: <2A385CE3-72E8-4D40-8413-69E00841536D@neville-neil.com> References: <20121119115350.3456c580209197b4aea33d75@bsdconsulting.co.jp> To: Daichi GOTO X-Mailer: Apple Mail (2.1499) X-AntiAbuse: This header was added to track abuse, please include it with any abuse report X-AntiAbuse: Primary Hostname - vps.hungerhost.com X-AntiAbuse: Original Domain - freebsd.org X-AntiAbuse: Originator/Caller UID/GID - [47 12] / [47 12] X-AntiAbuse: Sender Address Domain - neville-neil.com X-Get-Message-Sender-Via: vps.hungerhost.com: authenticated_id: gnn@neville-neil.com Cc: freebsd-infiniband@FreeBSD.org X-BeenThere: freebsd-infiniband@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Infiniband on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 20 Nov 2012 18:59:57 -0000 On Nov 18, 2012, at 21:53 , Daichi GOTO = wrote: > Hi, >=20 > Currently, we are getting ready to test InfiniBands on FreeBSD > using follow devices: >=20 > CPU: Intel Xeon E3-1240v2 > M/B: Super Micro X9SCM > RAM: Kingston KVR16E11/8 (8GBx4) >=20 > IB Card: Mellanox Technologies ConnectX-2 VPI MHQH19B-XTR > IB Card: Mellanox Technologies ConnectX-3 VPI = MCX353A-QCBT > IB Switch: Mellanox Technologies EXW-IS5022 > QSFP cable: MC22096-130-001 >=20 > Is there some information about above InfiniBand devices? Well it's only the cards you have to worry about. I know the ConnectX-2 = works but have not tested the ConnectX-3. Also, note that it depends on what you are testing. That is, Infiniband = has low latency at low payloads. The numbers quoted by Mellanox about low = latency depend on you sending one byte (yes, 1 byte). At real packet sizes Infiniband = is no faster than 10GbE. Best, George=