Date: Fri, 28 Sep 2012 09:56:50 -0600 From: John Nielsen <lists@jnielsen.net> To: freebsd-net@freebsd.org Subject: Fwd: using ConnectX card as Ethernet (mlxen) Message-ID: <CD5A3AE0-8615-41A1-A68B-44326AAA9B52@jnielsen.net> References: <3A359B33-380C-4230-A62C-623765E9376A@jnielsen.net>
next in thread | previous in thread | raw e-mail | index | archive | help
No takers on -current, anyone on -net know how to do this? Begin forwarded message: > From: John Nielsen <lists@jnielsen.net> > Subject: using ConnectX card as Ethernet (mlxen) > Date: September 24, 2012 10:37:30 AM MDT > To: freebsd-current@freebsd.org >=20 > I have a machine running "FreeBSD 10.0-CURRENT #0 r240887" amd64 with = two ConnectX (InfiniBand) cards. Relevant bits of dmesg and pciconf -lv = below. The cards are connected directly to a 10GB Ethernet switch so I = need to run them in "eth" mode rather than "ib". Unfortunately they come = up in "ib" mode and I don't know how to change it. >=20 > The same hardware works fine under CentOS 6.3, though I need to = manually set the cards to 'eth' there as well (which I do using a = 'connectx_port_config script from Mellanox that twiddles the mlx4_port1 = entries under /sys (sysfs). Under FreeBSD I see these sysctls but I = can't set them to 'eth' either via /boot/loader.conf or by sysctl after = boot, with or without mlxen and/or mlx4ib loaded: > sys.device.mlx4_core0.mlx4_port1: ib > sys.device.mlx4_core1.mlx4_port1: ib >=20 > Assuming mlxen is actually supported, how do I configure the card so = it will attach? >=20 >=20 > mlx4_core0: <mlx4_core> mem = 0xdfa00000-0xdfafffff,0xdd800000-0xddffffff irq 32 at device 0.0 on pci4 > mlx4_core: Mellanox ConnectX core driver v1.0-ofed1.5.2 (August 4, = 2010) > mlx4_core: Initializing mlx4_core > mlx4_en: Mellanox ConnectX HCA Ethernet driver v1.5.2 (July 2010) > mlx4_en mlx4_core0: UDP RSS is not supported on this device. > mlx4_core1: <mlx4_core> mem = 0xdf900000-0xdf9fffff,0xdd000000-0xdd7fffff irq 42 at device 0.0 on pci7 > mlx4_core: Initializing mlx4_core >=20 > mlx4_core0@pci0:4:0:0: class=3D0x0c0600 card=3D0x002215b3 = chip=3D0x673c15b3 rev=3D0xb0 hdr=3D0x00 > vendor =3D 'Mellanox Technologies' > device =3D 'MT26428 [ConnectX VPI PCIe 2.0 5GT/s - IB QDR / = 10GigE]' > class =3D serial bus > mlx4_core1@pci0:7:0:0: class=3D0x028000 card=3D0x001715b3 = chip=3D0x100315b3 rev=3D0x00 hdr=3D0x00 > vendor =3D 'Mellanox Technologies' > device =3D 'MT27500 Family [ConnectX-3]' > class =3D network >=20 > Thanks, >=20 > JN
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?CD5A3AE0-8615-41A1-A68B-44326AAA9B52>