From owner-freebsd-net@freebsd.org Thu May 10 09:21:12 2018 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 7EA89FBE6D3 for ; Thu, 10 May 2018 09:21:12 +0000 (UTC) (envelope-from list1@gjunka.com) Received: from msa1.earth.yoonka.com (yoonka.com [88.98.225.149]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "msa1.earth.yoonka.com", Issuer "msa1.earth.yoonka.com" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 129A66977C for ; Thu, 10 May 2018 09:21:11 +0000 (UTC) (envelope-from list1@gjunka.com) Received: from crayon2.yoonka.com (crayon2.yoonka.com [10.70.7.20]) (authenticated bits=0) by msa1.earth.yoonka.com (8.15.2/8.15.2) with ESMTPSA id w4A9LA4n047244 (version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128 verify=NO); Thu, 10 May 2018 09:21:10 GMT (envelope-from list1@gjunka.com) Subject: Re: Unrecognized Inifiniband HCA To: freebsd-net@freebsd.org References: <169976f0-2159-9ef0-d956-b13e717ef783@gjunka.com> <7218e2c4b23ebf4553a352633fe49e72@postgresql.org> Cc: justin@postgresql.org From: Grzegorz Junka Message-ID: Date: Thu, 10 May 2018 09:21:10 +0000 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:52.0) Gecko/20100101 Thunderbird/52.6.0 MIME-Version: 1.0 In-Reply-To: <7218e2c4b23ebf4553a352633fe49e72@postgresql.org> Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 8bit Content-Language: en-GB-large X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 10 May 2018 09:21:12 -0000 On 08/05/2018 23:41, Justin Clift wrote: > On 2018-05-08 21:59, Grzegorz Junka wrote: >> Hi All, >> >> pciconf -lv >> >> gives me >> >> none1@pci0:3:0:0:       class=0x0c0600 card=0x000315b3 chip=0x634015b3 >> rev=0xa0 hdr=0x00 >>     vendor     = 'Mellanox Technologies' >>     device     = 'MT25408 [ConnectX VPI - IB SDR / 10GigE]' >>     class      = serial bus >> >> Does it mean that my card is unrecognized? It supposed to be 10GB x 2 >> Infiniband PCI-E HCA 500EX-D Dual-Port Card Mellanox Firmware. >> Currently the card doesn't show when doing ifconfig. What should I do >> to have the proper device name instead of none1 or for the card to >> appear in ifconfig? >> >> # kldstat >> Id Refs Address            Size     Name >>  1   28 0xffffffff80200000 1f67a88  kernel >>  2    1 0xffffffff82169000 316708   zfs.ko >>  3    2 0xffffffff82480000 cb78     opensolaris.ko >>  4    1 0xffffffff8248d000 42c28    mps.ko >>  5    1 0xffffffff82621000 bdb0     if_lagg.ko >>  6    1 0xffffffff8262d000 3650     ums.ko >>  7    1 0xffffffff82631000 6679     nullfs.ko >>  8    1 0xffffffff82638000 bdfe     unionfs.ko >>  9    2 0xffffffff82644000 2094f    mlx5.ko >> 10    2 0xffffffff82665000 103e1    linuxkpi.ko >> 11    1 0xffffffff82676000 15965    mlx5en.ko > > That's probably a ConnectX (series 1) Mellanox card.  Those can > operate in > either Infiniband mode, or Ethernet mode. > > Which mode are you wanting it to run in? :) > > As a thought, the FreeBSD wiki page has a bit of info: > >   https://wiki.freebsd.org/InfiniBand > > For that card to be recognised at all, it'll need the mlx4 driver(s) > to load. > > I don't remember the exact one off hand (it's been a while), but some > searching > online for mlx4 and FreeBSD should turn up the right bits. Many thanks Justin. This is the first time I am hearing about an Infiniband card operating in Ethernet mode. These cards come with two CX4/SFF 8470 ports. It's not possible to connect standard Ethernet cables that I know of (not even SFP modules). Do you mean that they can operate in Ethernet mode over the CX4 cable? GrzegorzJ