Skip site navigation (1)Skip section navigation (2)
Date:      Thu, 10 May 2018 08:36:44 +0000
From:      Grzegorz Junka <list1@gjunka.com>
To:        freebsd-net@freebsd.org
Cc:        gpalmer@freebsd.org, freebsd-rwg@pdx.rh.CN85.dnsmgr.net
Subject:   Missing mlx4, was Re: Unrecognized Inifiniband HCA
Message-ID:  <848a8ac1-0b04-82fe-eb01-e5b7ec331ccb@gjunka.com>
In-Reply-To: <201805090039.w490dfXn063341@pdx.rh.CN85.dnsmgr.net>
References:  <201805090039.w490dfXn063341@pdx.rh.CN85.dnsmgr.net>

next in thread | previous in thread | raw e-mail | index | archive | help

On 09/05/2018 00:39, Rodney W. Grimes wrote:
>> On Tue, May 08, 2018 at 08:59:20PM +0000, Grzegorz Junka wrote:
>>> Hi All,
>>>
>>> pciconf -lv
>>>
>>> gives me
>>>
>>> none1@pci0:3:0:0:???????????? class=0x0c0600 card=0x000315b3 chip=0x634015b3
>>> rev=0xa0 hdr=0x00
>>>   ?????? vendor???????? = 'Mellanox Technologies'
>>>   ?????? device???????? = 'MT25408 [ConnectX VPI - IB SDR / 10GigE]'
>>>   ?????? class?????????? = serial bus
>>>
>>> Does it mean that my card is unrecognized? It supposed to be 10GB x 2
>>> Infiniband PCI-E HCA 500EX-D Dual-Port Card Mellanox Firmware. Currently
>>> the card doesn't show when doing ifconfig. What should I do to have the
>>> proper device name instead of none1 or for the card to appear in ifconfig?
>>>
>>> # kldstat
>>> Id Refs Address?????????????????????? Size???????? Name
>>>   ??1???? 28 0xffffffff80200000 1f67a88?? kernel
>>>   ??2?????? 1 0xffffffff82169000 316708???? zfs.ko
>>>   ??3?????? 2 0xffffffff82480000 cb78???????? opensolaris.ko
>>>   ??4?????? 1 0xffffffff8248d000 42c28?????? mps.ko
>>>   ??5?????? 1 0xffffffff82621000 bdb0???????? if_lagg.ko
>>>   ??6?????? 1 0xffffffff8262d000 3650???????? ums.ko
>>>   ??7?????? 1 0xffffffff82631000 6679???????? nullfs.ko
>>>   ??8?????? 1 0xffffffff82638000 bdfe???????? unionfs.ko
>>>   ??9?????? 2 0xffffffff82644000 2094f?????? mlx5.ko
>>> 10?????? 2 0xffffffff82665000 103e1?????? linuxkpi.ko
>>> 11?????? 1 0xffffffff82676000 15965?????? mlx5en.ko
>> mlx5en is for ConnectX-4.  I think that's an older card.  Try mlx4en,
>> which supports ConnectX-2 and ConnectX-3.
>  From a quick grep this infact should be supported by the mlx4/mlx5en
> drivers:
> net/mlx4/main.c:        /* MT25408 "Hermon" SDR */
> net/mlx4/main.c:        /* MT25408 "Hermon" DDR */
> net/mlx4/main.c:        /* MT25408 "Hermon" QDR */
> net/mlx4/main.c:        /* MT25408 "Hermon" DDR PCIe gen2 */
> net/mlx4/main.c:        /* MT25408 "Hermon" QDR PCIe gen2 */
> net/mlx4/main.c:        /* MT25408 "Hermon" EN 10GigE */
> net/mlx4/main.c:        /* MT25408 "Hermon" EN 10GigE PCIe gen2 */
>

Thank you Gary and Rod for your quick reply. I don't seem to have mlx4 
in my /boot/kernel. I unloaded mlx5 and mlx5en and tried to load mlx 
instead, but strangely, it says mlx is already loaded. How?

# kldload mlx
kldload: can't load mlx: module already loaded or in kernel

# kldstat
Id Refs Address            Size     Name
  1   22 0xffffffff80200000 1f67a88  kernel
  2    1 0xffffffff82169000 316708   zfs.ko
  3    2 0xffffffff82480000 cb78     opensolaris.ko
  4    1 0xffffffff8248d000 42c28    mps.ko
  5    1 0xffffffff82621000 bdb0     if_lagg.ko
  6    1 0xffffffff8262d000 3650     ums.ko
  7    1 0xffffffff82631000 6679     nullfs.ko
  8    1 0xffffffff82638000 bdfe     unionfs.ko

# ls -l /boot/kernel/mlx
mlx.ko*    mlx5.ko*   mlx5en.ko*

Anyways, mlx seems to be rather unrelated to this problem: 
https://www.freebsd.org/cgi/man.cgi?query=mlx

Looks like mlx4 is available in the kernel: 
https://github.com/freebsd/freebsd/tree/master/sys/modules/mlx4

However, it seems that it may not compile: 
https://forums.freebsd.org/threads/mellanox-mt26448.64350/

Does it mean, that mlx4 is no longer compiled in the default kernel and 
I would need to compile the kernel manually? Can I just compile the 
mlx4/en/ib kernel module without having to compile the whole kernel?

Thanks
GrzegorzJ




Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?848a8ac1-0b04-82fe-eb01-e5b7ec331ccb>