Skip site navigation (1)Skip section navigation (2)
Date:      Thu, 10 May 2018 09:21:10 +0000
From:      Grzegorz Junka <list1@gjunka.com>
To:        freebsd-net@freebsd.org
Cc:        justin@postgresql.org
Subject:   Re: Unrecognized Inifiniband HCA
Message-ID:  <ba1264c8-7a45-1d3f-465e-9a45f89105b2@gjunka.com>
In-Reply-To: <7218e2c4b23ebf4553a352633fe49e72@postgresql.org>
References:  <169976f0-2159-9ef0-d956-b13e717ef783@gjunka.com> <7218e2c4b23ebf4553a352633fe49e72@postgresql.org>

index | next in thread | previous in thread | raw e-mail


On 08/05/2018 23:41, Justin Clift wrote:
> On 2018-05-08 21:59, Grzegorz Junka wrote:
>> Hi All,
>>
>> pciconf -lv
>>
>> gives me
>>
>> none1@pci0:3:0:0:       class=0x0c0600 card=0x000315b3 chip=0x634015b3
>> rev=0xa0 hdr=0x00
>>     vendor     = 'Mellanox Technologies'
>>     device     = 'MT25408 [ConnectX VPI - IB SDR / 10GigE]'
>>     class      = serial bus
>>
>> Does it mean that my card is unrecognized? It supposed to be 10GB x 2
>> Infiniband PCI-E HCA 500EX-D Dual-Port Card Mellanox Firmware.
>> Currently the card doesn't show when doing ifconfig. What should I do
>> to have the proper device name instead of none1 or for the card to
>> appear in ifconfig?
>>
>> # kldstat
>> Id Refs Address            Size     Name
>>  1   28 0xffffffff80200000 1f67a88  kernel
>>  2    1 0xffffffff82169000 316708   zfs.ko
>>  3    2 0xffffffff82480000 cb78     opensolaris.ko
>>  4    1 0xffffffff8248d000 42c28    mps.ko
>>  5    1 0xffffffff82621000 bdb0     if_lagg.ko
>>  6    1 0xffffffff8262d000 3650     ums.ko
>>  7    1 0xffffffff82631000 6679     nullfs.ko
>>  8    1 0xffffffff82638000 bdfe     unionfs.ko
>>  9    2 0xffffffff82644000 2094f    mlx5.ko
>> 10    2 0xffffffff82665000 103e1    linuxkpi.ko
>> 11    1 0xffffffff82676000 15965    mlx5en.ko
>
> That's probably a ConnectX (series 1) Mellanox card.  Those can 
> operate in
> either Infiniband mode, or Ethernet mode.
>
> Which mode are you wanting it to run in? :)
>
> As a thought, the FreeBSD wiki page has a bit of info:
>
>   https://wiki.freebsd.org/InfiniBand
>
> For that card to be recognised at all, it'll need the mlx4 driver(s) 
> to load.
>
> I don't remember the exact one off hand (it's been a while), but some 
> searching
> online for mlx4 and FreeBSD should turn up the right bits.

Many thanks Justin. This is the first time I am hearing about an 
Infiniband card operating in Ethernet mode. These cards come with two 
CX4/SFF 8470 ports. It's not possible to connect standard Ethernet 
cables that I know of (not even SFP modules). Do you mean that they can 
operate in Ethernet mode over the CX4 cable?
GrzegorzJ


help

Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?ba1264c8-7a45-1d3f-465e-9a45f89105b2>