From owner-freebsd-net@freebsd.org Wed Sep 13 14:25:12 2017 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 8B0B9E239BD for ; Wed, 13 Sep 2017 14:25:12 +0000 (UTC) (envelope-from bu7cher@yandex.ru) Received: from forward105o.mail.yandex.net (forward105o.mail.yandex.net [IPv6:2a02:6b8:0:1a2d::608]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "forwards.mail.yandex.net", Issuer "Yandex CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 29B2866ABB for ; Wed, 13 Sep 2017 14:25:12 +0000 (UTC) (envelope-from bu7cher@yandex.ru) Received: from mxback6g.mail.yandex.net (mxback6g.mail.yandex.net [IPv6:2a02:6b8:0:1472:2741:0:8b7:167]) by forward105o.mail.yandex.net (Yandex) with ESMTP id 532F84444E53; Wed, 13 Sep 2017 17:25:07 +0300 (MSK) Received: from smtp3o.mail.yandex.net (smtp3o.mail.yandex.net [2a02:6b8:0:1a2d::27]) by mxback6g.mail.yandex.net (nwsmtp/Yandex) with ESMTP id Hc9bCOjImJ-P7nmBIG1; Wed, 13 Sep 2017 17:25:07 +0300 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yandex.ru; s=mail; t=1505312707; bh=pyMvuuf6lpC13kACyD7tzwNnrNSFjLKS0jtoYhXbGsM=; h=Subject:To:Cc:References:From:Message-ID:Date:In-Reply-To; b=j07oPbPLRPSvBW+LCMBsIbJ+BsI6kJPRD2HstcoqQhLH3o6W7XLEmyXwdKwuA6kME V/GbXQvPU6Xu7z3hqc6aoWGrNO5Zw0+syt+lESTK0aC+QGt7mLxYTNxwYXccAY6BS3 AYNX7RC3PpH6GdNB/r5CGJdcG/pZupCXjKRYY77U= Received: by smtp3o.mail.yandex.net (nwsmtp/Yandex) with ESMTPSA id 1w3RK3mHlW-P66WRmWt; Wed, 13 Sep 2017 17:25:06 +0300 (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client certificate not present) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yandex.ru; s=mail; t=1505312706; bh=pyMvuuf6lpC13kACyD7tzwNnrNSFjLKS0jtoYhXbGsM=; h=Subject:To:Cc:References:From:Message-ID:Date:In-Reply-To; b=iuSv4QHz29rxamNeHTjv+1UCb8U2mcvxN0GJsD2ObfRMk5eOOAvRGtDEmDorLNBbs sMKayjYJi4uMSETAgBlLAJZZLdhKTIj0H5oLoWJHypoVetP/i+XTIt5Ya3E8wNY5gH +ejCJh6CKAGkNZmi+LzFpvyuCUIItKXsoXTRHr0I= Authentication-Results: smtp3o.mail.yandex.net; dkim=pass header.i=@yandex.ru Subject: Re: Splitting Mellanox ConnectX-4 interface using breakout cables To: David Horn Cc: freebsd-net@freebsd.org References: From: "Andrey V. Elsukov" Openpgp: id=E6591E1B41DA1516F0C9BC0001C5EA0410C8A17A Message-ID: Date: Wed, 13 Sep 2017 17:21:02 +0300 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:52.0) Gecko/20100101 Thunderbird/52.2.1 MIME-Version: 1.0 In-Reply-To: Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="kb92NhR02Cm0jIB93hOr0pRbMhebxoXtL" X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 13 Sep 2017 14:25:12 -0000 This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --kb92NhR02Cm0jIB93hOr0pRbMhebxoXtL Content-Type: multipart/mixed; boundary="nn8aClrOSdSuji3n1Hvasjbn4wttluAp1"; protected-headers="v1" From: "Andrey V. Elsukov" To: David Horn Cc: freebsd-net@freebsd.org Message-ID: Subject: Re: Splitting Mellanox ConnectX-4 interface using breakout cables References: In-Reply-To: --nn8aClrOSdSuji3n1Hvasjbn4wttluAp1 Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: quoted-printable On 13.09.2017 16:43, David Horn wrote: > I was under the impression that these Mellanox 40G->4x10G breakout > cables were for the Mellanox switch side (not Mellanox NIC) to provide > more flexible utilization options for the switch. I have never heard o= f > doing this from the 40G NIC (on any OS). >=20 > Please reply if you have seen this working on *any* OS from the Mellano= x > 40G NIC, as I am curious as well and have a both ConnectX-3 and -4 HW. We have several Intel-XL710-QDA1 cards that work like this: ixl0@pci0:6:0:0: class=3D0x020000 card=3D0x00028086 chip=3D0x15848086 rev= =3D0x01 hdr=3D0x00 ixl1@pci0:6:0:1: class=3D0x020000 card=3D0x00008086 chip=3D0x15848086 rev= =3D0x01 hdr=3D0x00 ixl2@pci0:6:0:2: class=3D0x020000 card=3D0x00008086 chip=3D0x15848086 rev= =3D0x01 hdr=3D0x00 ixl3@pci0:6:0:3: class=3D0x020000 card=3D0x00008086 chip=3D0x15848086 rev= =3D0x01 hdr=3D0x00 This is one card with QSPF28 splited into 4x10G. --=20 WBR, Andrey V. Elsukov --nn8aClrOSdSuji3n1Hvasjbn4wttluAp1-- --kb92NhR02Cm0jIB93hOr0pRbMhebxoXtL Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/ iQEzBAEBCAAdFiEE5lkeG0HaFRbwybwAAcXqBBDIoXoFAlm5Ps4ACgkQAcXqBBDI oXrkHAf+Jk2yVidcKt5bGPYKRCZSuVYtPDjO4S3VcwByzFLB3zAYyNjiGlHW97ow gxtBZ+7HqySUMJqRoj7OFBZw6js9Eul8xO3UUNVlIol61PX9vp6SY+Tfx9agGkDE 8m/X8LT/IJym3+QMFemmnHl5P4biby8lJg1ahMR9G2qK5X9IJv/M1AWhFjG2mOzB bvkOVy4zyPIFmknm5k4dG8ci+3QzDpPFcXaxyvfXgSustpM0LrpXcGzqUoQW48h1 r5YRJFoROviSCEL7uXr3p9/ihFuNwyoXhKBHlch8WBOxr+3sW9CCgI2m0dg7WWlm Jm4SZcE+gKWiYhXmF2Al8lvnmC9bqw== =6LKA -----END PGP SIGNATURE----- --kb92NhR02Cm0jIB93hOr0pRbMhebxoXtL--