Date: Fri, 26 Jul 2013 08:30:58 -0700 (PDT) From: Barney Cordoba <barney_cordoba@yahoo.com> To: "Alexander V. Chernikov" <melifaro@FreeBSD.org> Cc: "freebsd-net@freebsd.org" <freebsd-net@freebsd.org> Subject: Re: Recommendations for 10gbps NIC Message-ID: <1374852658.90079.YahooMailNeo@web121601.mail.ne1.yahoo.com> In-Reply-To: <51F16A07.9030505@FreeBSD.org> References: <51F0386D.2000709@acm.poly.edu> <51F16A07.9030505@FreeBSD.org>
next in thread | previous in thread | raw e-mail | index | archive | help
________________________________ From: Alexander V. Chernikov <melifaro@FreeBSD.org> To: Boris Kochergin <spawk@acm.poly.edu> Cc: freebsd-net@freebsd.org Sent: Thursday, July 25, 2013 2:10 PM Subject: Re: Recommendations for 10gbps NIC On 25.07.2013 00:26, Boris Kochergin wrote: > Hi. Hello. > > I am looking for recommendations for a 10gbps NIC from someone who has > successfully used it on FreeBSD. It will be used on FreeBSD 9.1-R/amd64 > to capture packets. Some desired features are: > > - PCIe > - LC connectors > - 10GBASE-SR > - Either single- or dual-port > - Multiqueue Intel 82598/99/X520 Emulex OCe10102-NM Mellanox ConnectX Chelsio T4 Do they all cost the same, have the exact same features and have equally well-written drivers? Which do you recommend and why? BC From owner-freebsd-net@FreeBSD.ORG Fri Jul 26 16:26:54 2013 Return-Path: <owner-freebsd-net@FreeBSD.ORG> Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTP id F19DD36D for <freebsd-net@freebsd.org>; Fri, 26 Jul 2013 16:26:54 +0000 (UTC) (envelope-from melifaro@FreeBSD.org) Received: from mail.ipfw.ru (unknown [IPv6:2a01:4f8:120:6141::2]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 882DD24F4 for <freebsd-net@freebsd.org>; Fri, 26 Jul 2013 16:26:54 +0000 (UTC) Received: from dhcp170-36-red.yandex.net ([95.108.170.36]) by mail.ipfw.ru with esmtpsa (TLSv1:CAMELLIA256-SHA:256) (Exim 4.76 (FreeBSD)) (envelope-from <melifaro@FreeBSD.org>) id 1V2ku4-0005aC-5Z; Fri, 26 Jul 2013 20:30:04 +0400 Message-ID: <51F2A313.9070105@FreeBSD.org> Date: Fri, 26 Jul 2013 20:25:55 +0400 From: "Alexander V. Chernikov" <melifaro@FreeBSD.org> User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:17.0) Gecko/20130418 Thunderbird/17.0.5 MIME-Version: 1.0 To: Barney Cordoba <barney_cordoba@yahoo.com> Subject: Re: Recommendations for 10gbps NIC References: <51F0386D.2000709@acm.poly.edu> <51F16A07.9030505@FreeBSD.org> <1374852658.90079.YahooMailNeo@web121601.mail.ne1.yahoo.com> In-Reply-To: <1374852658.90079.YahooMailNeo@web121601.mail.ne1.yahoo.com> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Content-Filtered-By: Mailman/MimeDel 2.1.14 Cc: "freebsd-net@freebsd.org" <freebsd-net@freebsd.org> X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Networking and TCP/IP with FreeBSD <freebsd-net.freebsd.org> List-Unsubscribe: <http://lists.freebsd.org/mailman/options/freebsd-net>, <mailto:freebsd-net-request@freebsd.org?subject=unsubscribe> List-Archive: <http://lists.freebsd.org/pipermail/freebsd-net>; List-Post: <mailto:freebsd-net@freebsd.org> List-Help: <mailto:freebsd-net-request@freebsd.org?subject=help> List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-net>, <mailto:freebsd-net-request@freebsd.org?subject=subscribe> X-List-Received-Date: Fri, 26 Jul 2013 16:26:55 -0000 On 26.07.2013 19:30, Barney Cordoba wrote: > > > ------------------------------------------------------------------------ > *From:* Alexander V. Chernikov <melifaro@FreeBSD.org> > *To:* Boris Kochergin <spawk@acm.poly.edu> > *Cc:* freebsd-net@freebsd.org > *Sent:* Thursday, July 25, 2013 2:10 PM > *Subject:* Re: Recommendations for 10gbps NIC > > On 25.07.2013 00:26, Boris Kochergin wrote: > > Hi. > Hello. > > > > I am looking for recommendations for a 10gbps NIC from someone who has > > successfully used it on FreeBSD. It will be used on FreeBSD 9.1-R/amd64 > > to capture packets. Some desired features are: > > > > - PCIe > > - LC connectors > > - 10GBASE-SR > > - Either single- or dual-port > > - Multiqueue > Intel 82598/99/X520 > Emulex OCe10102-NM > Mellanox ConnectX > Chelsio T4 > > Do they all cost the same, have the exact same features and have > equally well-written drivers? Which do you recommend > and why? Well, Intel/Chelsio/Mellanox costs $500-600 / 2 ports, Emulex costs a bit higher (of course, YMMV) Regarding features: it depends on your needs mostly (e.g. forwarding / TCP server / IB ). for forwarding: Each one is capable of doing at least 8 rx/tx queues per port with adjustable rx/tx ring size. One important thing to note is that netmap is currently not available for any non-Intel NIC. General hw offload features: LRO/TSO4/vlans/jumbo are supported by all of them (not sure about TSO6 in Mellanox) however I can't say how good it works. SFP+/Twinax: Intel was very restrictive on supported spf/cables (however, Jack changed this a moth ago). Chelsio is much better here. Advanced features: Intel (82599-based NICs) has hw firewall called FlowDirector which can be programmed to redirect particular IPv4/IPv6 TCP/UDP streams to given queue (or dropped). However it is currently not supported on FreeBSD. (Intel also has IPSEC offload functionality, which, afaik, is currently not supported) On the other side, Chelsio has similar functionality which is supported via cxgbetool binary (available in tools/) Usability: IMHO Chelsio/Intel are the best (a lot of things are runtime-configurable, lots of counters, etc..) > > BC
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?1374852658.90079.YahooMailNeo>