From owner-freebsd-current@FreeBSD.ORG Tue Jul 9 20:10:40 2013 Return-Path: Delivered-To: freebsd-current@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) by hub.freebsd.org (Postfix) with ESMTP id B9F22148; Tue, 9 Jul 2013 20:10:40 +0000 (UTC) (envelope-from lists@jnielsen.net) Received: from ns1.jnielsen.net (secure.freebsdsolutions.net [69.55.234.48]) by mx1.freebsd.org (Postfix) with ESMTP id A24221997; Tue, 9 Jul 2013 20:10:39 +0000 (UTC) Received: from [10.10.1.32] (office.betterlinux.com [199.58.199.60]) (authenticated bits=0) by ns1.jnielsen.net (8.14.4/8.14.4) with ESMTP id r69K8MJe099977 (version=TLSv1/SSLv3 cipher=AES128-SHA bits=128 verify=NOT); Tue, 9 Jul 2013 16:08:22 -0400 (EDT) (envelope-from lists@jnielsen.net) Content-Type: text/plain; charset=iso-8859-1 Mime-Version: 1.0 (Mac OS X Mail 6.5 \(1508\)) Subject: Re: using ConnectX card as Ethernet (mlxen) From: John Nielsen In-Reply-To: <201307091158.19381.jhb@freebsd.org> Date: Tue, 9 Jul 2013 14:08:38 -0600 Content-Transfer-Encoding: quoted-printable Message-Id: <2BA72819-3004-4FB6-BB4F-5964B41F6B2F@jnielsen.net> References: <3A359B33-380C-4230-A62C-623765E9376A@jnielsen.net> <201307091158.19381.jhb@freebsd.org> To: John Baldwin X-Mailer: Apple Mail (2.1508) X-DCC-Etherboy-Metrics: ns1.jnielsen.net 1002; Body=2 Fuz1=2 Fuz2=2 X-Virus-Scanned: clamav-milter 0.97.5 at ns1.jnielsen.net X-Virus-Status: Clean Cc: freebsd-current@freebsd.org X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 09 Jul 2013 20:10:40 -0000 On Jul 9, 2013, at 9:58 AM, John Baldwin wrote: > On Monday, September 24, 2012 12:37:30 pm John Nielsen wrote: >> I have a machine running "FreeBSD 10.0-CURRENT #0 r240887" amd64 with = two=20 > ConnectX (InfiniBand) cards. Relevant bits of dmesg and pciconf -lv = below. The=20 > cards are connected directly to a 10GB Ethernet switch so I need to = run them=20 > in "eth" mode rather than "ib". Unfortunately they come up in "ib" = mode and I=20 > don't know how to change it. >>=20 >> The same hardware works fine under CentOS 6.3, though I need to = manually set=20 > the cards to 'eth' there as well (which I do using a = 'connectx_port_config=20 > script from Mellanox that twiddles the mlx4_port1 entries under /sys = (sysfs).=20 > Under FreeBSD I see these sysctls but I can't set them to 'eth' either = via=20 > /boot/loader.conf or by sysctl after boot, with or without mlxen = and/or mlx4ib=20 > loaded: >> sys.device.mlx4_core0.mlx4_port1: ib >> sys.device.mlx4_core1.mlx4_port1: ib >=20 > So this was just fixed (finally) in HEAD in r253048. You can how use = the > sysctls to change this. I saw the commit. Thanks! I'll give it a try at some point (whenever my = schedule and hardware availability align). JN