From owner-freebsd-infiniband@freebsd.org  Mon Apr 18 06:55:11 2016
Return-Path: <owner-freebsd-infiniband@freebsd.org>
Delivered-To: freebsd-infiniband@mailman.ysv.freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org
 [IPv6:2001:1900:2254:206a::19:1])
 by mailman.ysv.freebsd.org (Postfix) with ESMTP id C5B82B1246F
 for <freebsd-infiniband@mailman.ysv.freebsd.org>;
 Mon, 18 Apr 2016 06:55:11 +0000 (UTC) (envelope-from hps@selasky.org)
Received: from mail.turbocat.net (mail.turbocat.net
 [IPv6:2a01:4f8:d16:4514::2])
 (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits))
 (Client did not present a certificate)
 by mx1.freebsd.org (Postfix) with ESMTPS id 8F69B1A23
 for <freebsd-infiniband@freebsd.org>; Mon, 18 Apr 2016 06:55:11 +0000 (UTC)
 (envelope-from hps@selasky.org)
Received: from laptop015.home.selasky.org (unknown [62.141.129.119])
 (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits))
 (No client certificate requested)
 by mail.turbocat.net (Postfix) with ESMTPSA id E58EE1FE023;
 Mon, 18 Apr 2016 08:55:09 +0200 (CEST)
Subject: Re: How to force IB cards to come up in IB mode?
To: Justin Clift <justin@postgresql.org>, Meny Yossefi <menyy@mellanox.com>
References: <9C08621D-AAE9-42D0-8079-716CDD9BC5E0@postgresql.org>
 <223ee8f3dd5240779d39bf78c383c50c@AMSPR05MB0580.eurprd05.prod.outlook.com>
 <DB5PR05MB1765AAD188E07C726CE5C005C3690@DB5PR05MB1765.eurprd05.prod.outlook.com>
 <0DE8164F-FB16-40E0-A512-F233658C52A0@postgresql.org>
Cc: "freebsd-infiniband@freebsd.org" <freebsd-infiniband@freebsd.org>,
 Yuval Bason <yuvalba@mellanox.com>
From: Hans Petter Selasky <hps@selasky.org>
Message-ID: <57148593.6090309@selasky.org>
Date: Mon, 18 Apr 2016 08:58:27 +0200
User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:38.0) Gecko/20100101
 Thunderbird/38.5.0
MIME-Version: 1.0
In-Reply-To: <0DE8164F-FB16-40E0-A512-F233658C52A0@postgresql.org>
Content-Type: text/plain; charset=windows-1252; format=flowed
Content-Transfer-Encoding: 7bit
X-BeenThere: freebsd-infiniband@freebsd.org
X-Mailman-Version: 2.1.21
Precedence: list
List-Id: Infiniband on FreeBSD <freebsd-infiniband.freebsd.org>
List-Unsubscribe: <https://lists.freebsd.org/mailman/options/freebsd-infiniband>, 
 <mailto:freebsd-infiniband-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-infiniband/>
List-Post: <mailto:freebsd-infiniband@freebsd.org>
List-Help: <mailto:freebsd-infiniband-request@freebsd.org?subject=help>
List-Subscribe: <https://lists.freebsd.org/mailman/listinfo/freebsd-infiniband>, 
 <mailto:freebsd-infiniband-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Mon, 18 Apr 2016 06:55:11 -0000

On 04/17/16 00:33, Justin Clift wrote:
> On 16 Apr 2016, at 15:55, Meny Yossefi <menyy@mellanox.com> wrote:
>> Hi Justin,
>>
>> It seems as the pre-boot configuration didn't work.
>>
>> loader.conf doesn't work on all sysctl params AFAIK.
>
> The solution in this case turned out to be super simple... I was
> just using the wrong file. :D
>
> It should have been /etc/sysctl.conf for the settings.  Adding this
> in there worked for the initial port mode setup:
>
>    # Ensure the IB card is in IB mode
>    sys.device.mlx4_core0.mlx4_port1="ib"
>    sys.device.mlx4_core0.mlx4_port2="ib"
>
> Apologies for the noise. ;)
>

No problem. Glad to read you figured it out. Maybe it will help somebody 
else.

--HPS