From owner-freebsd-infiniband@FreeBSD.ORG  Tue Jan  6 06:48:09 2015
Return-Path: <owner-freebsd-infiniband@FreeBSD.ORG>
Delivered-To: freebsd-infiniband@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115])
 (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits))
 (No client certificate requested)
 by hub.freebsd.org (Postfix) with ESMTPS id C20B7F6
 for <freebsd-infiniband@freebsd.org>; Tue,  6 Jan 2015 06:48:09 +0000 (UTC)
Received: from mail.turbocat.net (mail.turbocat.net
 [IPv6:2a01:4f8:d16:4514::2])
 (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits))
 (Client did not present a certificate)
 by mx1.freebsd.org (Postfix) with ESMTPS id 831A764CB2
 for <freebsd-infiniband@freebsd.org>; Tue,  6 Jan 2015 06:48:09 +0000 (UTC)
Received: from laptop015.home.selasky.org
 (cm-176.74.213.204.customer.telag.net [176.74.213.204])
 (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits))
 (No client certificate requested)
 by mail.turbocat.net (Postfix) with ESMTPSA id A348F1FE022;
 Tue,  6 Jan 2015 07:48:07 +0100 (CET)
Message-ID: <54AB8557.4020607@selasky.org>
Date: Tue, 06 Jan 2015 07:48:55 +0100
From: Hans Petter Selasky <hps@selasky.org>
User-Agent: Mozilla/5.0 (X11; FreeBSD amd64;
 rv:31.0) Gecko/20100101 Thunderbird/31.3.0
MIME-Version: 1.0
To: Karl Pielorz <kpielorz_lst@tdx.co.uk>, 
 freebsd-infiniband@freebsd.org
Subject: Re: Infiniband under FreeBSD 11.0-CURRENT...
References: <F41C4BFDA1646A9029886D1E@Karls-Mac-mini.local>
 <54AB853C.7070300@selasky.org>
In-Reply-To: <54AB853C.7070300@selasky.org>
Content-Type: text/plain; charset=windows-1252; format=flowed
Content-Transfer-Encoding: 7bit
X-BeenThere: freebsd-infiniband@freebsd.org
X-Mailman-Version: 2.1.18-1
Precedence: list
List-Id: Infiniband on FreeBSD <freebsd-infiniband.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/options/freebsd-infiniband>, 
 <mailto:freebsd-infiniband-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-infiniband/>
List-Post: <mailto:freebsd-infiniband@freebsd.org>
List-Help: <mailto:freebsd-infiniband-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-infiniband>, 
 <mailto:freebsd-infiniband-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Tue, 06 Jan 2015 06:48:09 -0000

On 01/06/15 07:48, Hans Petter Selasky wrote:
> On 01/06/15 00:12, Karl Pielorz wrote:
>>
>> Hi,
>>
>> I just built a couple of 11.0-CURRENT r275655M amd64 boxes up, both with:
>>
>> "
>> MT25418 [ConnectX VPI PCIe 2.0 2.5GT/s - IB DDR / 10GigE]
>> "
>>
>> Cards in that appear after boot as 'mlxen0' and 'mlxen1' (they're dual
>> port cards).
>>
>> I'd previously run these cards with FreeBSD 10.0. I noticed the
>> Infiniband options seem to be in GENERIC now, and opensm/ibstat appears
>> to be in base.
>>
>> But neither work, i.e.
>>
>> "
>> #ibstat
>> ibpanic: [1343] main: stat of IB device 'mthca0' failed: (m)
>> "
>>
>> And,
>>
>> "
>> #opensm
>> ...
>> No local ports detected!
>>
>> Error from osm_opensm_bind (0x2A)
>> Perhaps another instance of OpenSM is already running
>> Exiting SM
>> "
>>
>>
>> Things have obviously changed since 10.0 (and I realise this is work in
>> progress) - is there a setup guide or anywhere I can lookup how to get
>> this working? [presuming it does work :)]
>>
>
> Hi,
>
> Did you set the following sysctl(s) to specify the port mode:
>
> sysctl -a | grep eth
>
> sys.device.mlx4_core0.mlx4_port1: eth
> sys.device.mlx4_core0.mlx4_port2: eth
> sys.device.mlx4_core1.mlx4_port1: eth
> sys.device.mlx4_core1.mlx4_port2: eth
>
> --HPS

Valid options are: eth and ib

--HPS