From owner-freebsd-questions@freebsd.org  Fri Jan 22 18:54:34 2021
Return-Path: <owner-freebsd-questions@freebsd.org>
Delivered-To: freebsd-questions@mailman.nyi.freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1])
 by mailman.nyi.freebsd.org (Postfix) with ESMTP id EC1A14FBCB2
 for <freebsd-questions@mailman.nyi.freebsd.org>;
 Fri, 22 Jan 2021 18:54:34 +0000 (UTC) (envelope-from kp@FreeBSD.org)
Received: from smtp.freebsd.org (smtp.freebsd.org [96.47.72.83])
 (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)
 key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256
 client-signature RSA-PSS (4096 bits) client-digest SHA256)
 (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK))
 by mx1.freebsd.org (Postfix) with ESMTPS id 4DMpMt6S8sz3p7K;
 Fri, 22 Jan 2021 18:54:34 +0000 (UTC) (envelope-from kp@FreeBSD.org)
Received: from venus.codepro.be (venus.codepro.be [5.9.86.228])
 (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits))
 (Client CN "mx1.codepro.be", Issuer "R3" (verified OK))
 (Authenticated sender: kp)
 by smtp.freebsd.org (Postfix) with ESMTPSA id B6D852F99A;
 Fri, 22 Jan 2021 18:54:34 +0000 (UTC) (envelope-from kp@FreeBSD.org)
Received: by venus.codepro.be (Postfix, authenticated sender kp) id 233A14B42A;
 Fri, 22 Jan 2021 19:54:33 +0100 (CET)
From: "Kristof Provost" <kp@FreeBSD.org>
To: "Robert Healey" <healer@rpi.edu>
Cc: freebSD-questions@freebsd.org
Subject: Re: 100G NIC questions
Date: Fri, 22 Jan 2021 19:54:32 +0100
X-Mailer: MailMate (1.13.2r5673)
Message-ID: <0010210B-1C92-410F-883C-277FF6E9EABB@FreeBSD.org>
In-Reply-To: <5f016000-06e6-a918-9435-37f1988fbbff@rpi.edu>
References: <5f016000-06e6-a918-9435-37f1988fbbff@rpi.edu>
MIME-Version: 1.0
Content-Type: text/plain; charset="UTF-8"; format=flowed
Content-Transfer-Encoding: 8bit
X-BeenThere: freebsd-questions@freebsd.org
X-Mailman-Version: 2.1.34
Precedence: list
List-Id: User questions <freebsd-questions.freebsd.org>
List-Unsubscribe: <https://lists.freebsd.org/mailman/options/freebsd-questions>, 
 <mailto:freebsd-questions-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-questions/>
List-Post: <mailto:freebsd-questions@freebsd.org>
List-Help: <mailto:freebsd-questions-request@freebsd.org?subject=help>
List-Subscribe: <https://lists.freebsd.org/mailman/listinfo/freebsd-questions>, 
 <mailto:freebsd-questions-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Fri, 22 Jan 2021 18:54:35 -0000

On 22 Jan 2021, at 19:46, Robert Healey wrote:
> I'm in the process of building a new file server for work, and part of 
> the spec is 100G connectivity.  A preference is for me to use a 
> Mellanox/NVIDIA NIC since the switch and the 2 clients both have 
> Mellanox/NVIDIA hardware.  How well does the Mellanox gear work, or 
> should be looking at an alternate OEM such as Intel?  Or is 100G too 
> exotic for FreeBSD?
>
I’ll leave comments about Mellanox kit to hps@, given that he actively 
maintains those drivers.
My understanding is that they work.

I know for a fact that Chelsio 100G hardware works, because I’ve got 
two machines with that hardware (T62100-LP-CR). (Mostly for perf 
testing, so I care about netmap support.)
I believe there is support for Intel 100G kit as well, but I’ve not 
explicitly checked.

100G networking kit is not exotic by our standards, and you should have 
several options.

Best regards,
Kristof