From owner-freebsd-infiniband@freebsd.org Tue May 8 23:42:03 2018 Return-Path: Delivered-To: freebsd-infiniband@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id EE2E7FCDD14; Tue, 8 May 2018 23:42:02 +0000 (UTC) (envelope-from justin@postgresql.org) Received: from meldrar.postgresql.org (meldrar.postgresql.org [IPv6:2a02:c0:301:0:ffff::31]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-SHA384 (256/256 bits)) (Client CN "meldrar.postgresql.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 8683A72EF1; Tue, 8 May 2018 23:42:02 +0000 (UTC) (envelope-from justin@postgresql.org) Received: from meldrar.postgresql.org ([87.238.57.231] helo=webmail.postgresql.org) by meldrar.postgresql.org with esmtpsa (TLS1.2:ECDHE_RSA_AES_256_CBC_SHA384:256) (Exim 4.89) (envelope-from ) id 1fGCF2-0006A1-Vy; Tue, 08 May 2018 23:42:00 +0000 MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit Date: Wed, 09 May 2018 00:41:55 +0100 From: Justin Clift To: Grzegorz Junka Cc: freebsd-infiniband@freebsd.org, freebsd-net@freebsd.org, owner-freebsd-infiniband@freebsd.org Subject: Re: Unrecognized Inifiniband HCA In-Reply-To: <169976f0-2159-9ef0-d956-b13e717ef783@gjunka.com> References: <169976f0-2159-9ef0-d956-b13e717ef783@gjunka.com> Message-ID: <7218e2c4b23ebf4553a352633fe49e72@postgresql.org> X-Sender: justin@postgresql.org User-Agent: Roundcube Webmail/1.2.3 X-Pg-Spam-Score: -2.9 (--) X-BeenThere: freebsd-infiniband@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Infiniband on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 08 May 2018 23:42:03 -0000 On 2018-05-08 21:59, Grzegorz Junka wrote: > Hi All, > > pciconf -lv > > gives me > > none1@pci0:3:0:0:       class=0x0c0600 card=0x000315b3 chip=0x634015b3 > rev=0xa0 hdr=0x00 >     vendor     = 'Mellanox Technologies' >     device     = 'MT25408 [ConnectX VPI - IB SDR / 10GigE]' >     class      = serial bus > > Does it mean that my card is unrecognized? It supposed to be 10GB x 2 > Infiniband PCI-E HCA 500EX-D Dual-Port Card Mellanox Firmware. > Currently the card doesn't show when doing ifconfig. What should I do > to have the proper device name instead of none1 or for the card to > appear in ifconfig? > > # kldstat > Id Refs Address            Size     Name >  1   28 0xffffffff80200000 1f67a88  kernel >  2    1 0xffffffff82169000 316708   zfs.ko >  3    2 0xffffffff82480000 cb78     opensolaris.ko >  4    1 0xffffffff8248d000 42c28    mps.ko >  5    1 0xffffffff82621000 bdb0     if_lagg.ko >  6    1 0xffffffff8262d000 3650     ums.ko >  7    1 0xffffffff82631000 6679     nullfs.ko >  8    1 0xffffffff82638000 bdfe     unionfs.ko >  9    2 0xffffffff82644000 2094f    mlx5.ko > 10    2 0xffffffff82665000 103e1    linuxkpi.ko > 11    1 0xffffffff82676000 15965    mlx5en.ko That's probably a ConnectX (series 1) Mellanox card. Those can operate in either Infiniband mode, or Ethernet mode. Which mode are you wanting it to run in? :) As a thought, the FreeBSD wiki page has a bit of info: https://wiki.freebsd.org/InfiniBand For that card to be recognised at all, it'll need the mlx4 driver(s) to load. I don't remember the exact one off hand (it's been a while), but some searching online for mlx4 and FreeBSD should turn up the right bits. Hope that helps. :) Regards and best wishes, Justin Clift