From owner-freebsd-infiniband@freebsd.org  Thu Nov 10 16:20:28 2016
Return-Path: <owner-freebsd-infiniband@freebsd.org>
Delivered-To: freebsd-infiniband@mailman.ysv.freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org
 [IPv6:2001:1900:2254:206a::19:1])
 by mailman.ysv.freebsd.org (Postfix) with ESMTP id D4AC2C3A231;
 Thu, 10 Nov 2016 16:20:28 +0000 (UTC)
 (envelope-from justin@postgresql.org)
Received: from meldrar.postgresql.org (meldrar.postgresql.org
 [IPv6:2a02:c0:301:0:ffff::31])
 (using TLSv1.2 with cipher ECDHE-RSA-AES256-SHA384 (256/256 bits))
 (Client CN "*.postgresql.org", Issuer "Gandi Standard SSL CA 2" (verified OK))
 by mx1.freebsd.org (Postfix) with ESMTPS id 99521CF2;
 Thu, 10 Nov 2016 16:20:28 +0000 (UTC)
 (envelope-from justin@postgresql.org)
Received: from meldrar.postgresql.org ([87.238.57.231]
 helo=webmail.postgresql.org)
 by meldrar.postgresql.org with esmtpsa (TLS1.0:ECDHE_RSA_AES_256_CBC_SHA1:256)
 (Exim 4.84_2) (envelope-from <justin@postgresql.org>)
 id 1c4s5N-0002Qs-IF; Thu, 10 Nov 2016 16:20:23 +0000
MIME-Version: 1.0
Content-Type: text/plain; charset=UTF-8;
 format=flowed
Content-Transfer-Encoding: 8bit
Date: Thu, 10 Nov 2016 16:20:20 +0000
From: Justin Clift <justin@postgresql.org>
To: =?UTF-8?Q?Vin=C3=ADcius_Ferr=C3=A3o?= <ferrao@vmio.com.br>
Cc: Meny Yossefi <menyy@mellanox.com>, Mark Bloch <markb@mellanox.com>,
 freebsd-infiniband@freebsd.org, Yuval Bason <yuvalba@mellanox.com>, Hans
 Petter Selasky <hanss@mellanox.com>, owner-freebsd-infiniband@freebsd.org
Subject: Re: Device hints to put mlx4 on IB mode
In-Reply-To: <D2621C85-E6C0-4A2B-8E6D-A32655DE5ABA@vmio.com.br>
References: <B1D279B3-FD90-4997-84D2-605D7B4AE967@vmio.com.br>
 <fabc0ffda5574d729360cacca6650267@AM5PR0502MB2916.eurprd05.prod.outlook.com>
 <DB5PR05MB176572180CC2D5143694F8B7C3B80@DB5PR05MB1765.eurprd05.prod.outlook.com>
 <D2621C85-E6C0-4A2B-8E6D-A32655DE5ABA@vmio.com.br>
Message-ID: <20872ef5058b19aa9793734d82ef3396@postgresql.org>
X-Sender: justin@postgresql.org
User-Agent: Roundcube Webmail/1.1.5
X-Pg-Spam-Score: -5.8 (-----)
X-BeenThere: freebsd-infiniband@freebsd.org
X-Mailman-Version: 2.1.23
Precedence: list
List-Id: Infiniband on FreeBSD <freebsd-infiniband.freebsd.org>
List-Unsubscribe: <https://lists.freebsd.org/mailman/options/freebsd-infiniband>, 
 <mailto:freebsd-infiniband-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-infiniband/>
List-Post: <mailto:freebsd-infiniband@freebsd.org>
List-Help: <mailto:freebsd-infiniband-request@freebsd.org?subject=help>
List-Subscribe: <https://lists.freebsd.org/mailman/listinfo/freebsd-infiniband>, 
 <mailto:freebsd-infiniband-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Thu, 10 Nov 2016 16:20:28 -0000

On 2016-11-10 15:39, Vinícius Ferrão wrote:
> Hello Meny,
> 
> Thanks for the input. You’re recommending a driver code change to
> start always on IB mode. This appears to be OK, but it's little
> dangerous. I will need to keep the patches for the drivers/modules if
> anything changes, right?
> 
> Another question, changing the starting mode cannot be done in other
> place? Like the Connect-X3 firmware? If not, since you’re on Mellanox
> can we recommend a better approach from the upstream (mlx) or this
> would be inviable?
> 
> Thanks for your attention and time, it was really helpful.

As a thought, are you using a config mgmt system? (eg Ansible, Salt, 
Puppet, etc)

If so, that would be able to set this correctly (via sysctl) for all the 
nodes. :)

+ Justin