From owner-freebsd-net@freebsd.org Sun Jun 28 11:57:08 2015 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 719B098E6AB for ; Sun, 28 Jun 2015 11:57:08 +0000 (UTC) (envelope-from rizzo.unipi@gmail.com) Received: from mail-la0-x235.google.com (mail-la0-x235.google.com [IPv6:2a00:1450:4010:c03::235]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id D7C5B10DE for ; Sun, 28 Jun 2015 11:57:07 +0000 (UTC) (envelope-from rizzo.unipi@gmail.com) Received: by lacny3 with SMTP id ny3so97431385lac.3 for ; Sun, 28 Jun 2015 04:57:06 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:in-reply-to:references:date:message-id:subject :from:to:cc:content-type; bh=oO/lGvryWBmaZF3PL3XxnYiJ5FacvCuBK1Sqaor0lZ0=; b=f1Zh0Rcah0UayqlezStkavIfU3WtOLz7THJufvAJz+sQOxsb3NCzRvT62FzTT3fX67 VxjyeTLRVhLqaJkqd9p3ARMfUg6A4nhzrCi8EXls3APp769q5cEfc1BqnCJ3A0cRYOvC QEaiK04NCyBx3ZApibaKvAb5wt/pC4VIjQc8SPdCeSX/akyk21GA0s5Ww78sE0CAVKi3 U2ZhAo+ksp0K7j7kA7VsRfTplb2F1WOcCTdJxsXtB3gnnnQ1KDLHBSGG6xd20QfopCqD UP7u6dh+U/oS+Kzi8pFN8jPZ/DTM8gtaq1Lt6vJP3M4/sC8WWBmW+HJ4IJlRzTaoy+yY hWaw== MIME-Version: 1.0 X-Received: by 10.152.88.98 with SMTP id bf2mr732391lab.23.1435492625965; Sun, 28 Jun 2015 04:57:05 -0700 (PDT) Sender: rizzo.unipi@gmail.com Received: by 10.114.230.103 with HTTP; Sun, 28 Jun 2015 04:57:05 -0700 (PDT) In-Reply-To: References: Date: Sun, 28 Jun 2015 13:57:05 +0200 X-Google-Sender-Auth: V_Lp1X0-sTnEFZku3SNGZIEze5Y Message-ID: Subject: Re: Intel XL710 40GE NIC, i40 driver and wire speed performance with netmap From: Luigi Rizzo To: Pavel Odintsov Cc: "freebsd-net@freebsd.org" Content-Type: text/plain; charset=UTF-8 X-Content-Filtered-By: Mailman/MimeDel 2.1.20 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 28 Jun 2015 11:57:08 -0000 On Sunday, June 28, 2015, Pavel Odintsov wrote: > Hello, Luigi! > > Thank you for detailed answer! Well, this issue related to NIC > itself.... not so good to hear this. Thus, Intel / Chelsio is out of > the game :( > > Well before throwing them out kewp in mind that from my (albeit limited) experience Intel and chelsio are the most performing NICs you can find; all others I have tried (including mellanox 10 and 40g) were way slower. I am happy to be proven wrong and hear actual experimental data from vendors, but figures in data sheets often do not reflect reality, or if they do, there are lots of strings attached. This is a general consideration. Cheers Luigi I just found Mellanox NIC's ConnectX 4 Lx which offer 75 mpps for 50 > GE in data sheet: > > http://www.mellanox.com/related-docs/prod_adapter_cards/PB_ConnectX-4_Lx-EN_Card.pdf > > ConnectX-4 Lx EN provides an unmatched combination of 10, 25, 40, and > 50GbE bandwidth, sub microsecond latency and a 75 million packets per > second message rate. > > Do you have experience with this cards > > On Sun, Jun 28, 2015 at 2:19 PM, Luigi Rizzo > wrote: > > Those 42mpps are probably close to the best you can get, take or leave a > few > > MPPs. I do not know of any pcie nic that can do 40g at 64byte frames. On > > freebsd, Chelsio with netmap is in the 40-45mpps range too, and from > what I > > can tell those are HW limited, not CPU bound numbers. I40e with netmap is > > between 32 and 36 mpps on TX (did not bother to optimize it), 28 mpps on > RX, > > and surely I won't be able to beat dpdk which is highly optimized for the > > CPU and nic. > > > > Cheers > > Luigi > > > > On Sunday, June 28, 2015, Pavel Odintsov > wrote: > >> > >> Hello, folks! > >> > >> I'm looking for solution which could do wire speed (56 mpps with > >> 64byte packets) for 40GE. > >> > >> We have tested PF_RING/DPDK on Linux and could not achieve more than > >> ~42 mpps and it's not enough for us. > >> > >> Could anybody share experience regarding performance estimations with > >> netmap and this NIC on best-ever-and-ever FreeBSD? > >> > >> Thank you! > >> > >> -- > >> Sincerely yours, Pavel Odintsov > >> _______________________________________________ > >> freebsd-net@freebsd.org mailing list > >> http://lists.freebsd.org/mailman/listinfo/freebsd-net > >> To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org > " > > > > > > > > -- > > -----------------------------------------+------------------------------- > > Prof. Luigi RIZZO, rizzo@iet.unipi.it . Dip. di Ing. > dell'Informazione > > http://www.iet.unipi.it/~luigi/ . Universita` di Pisa > > TEL +39-050-2217533 . via Diotisalvi 2 > > Mobile +39-338-6809875 . 56122 PISA (Italy) > > -----------------------------------------+------------------------------- > > > > > > -- > Sincerely yours, Pavel Odintsov > _______________________________________________ > freebsd-net@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-net > To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org > " > -- -----------------------------------------+------------------------------- Prof. Luigi RIZZO, rizzo@iet.unipi.it . Dip. di Ing. dell'Informazione http://www.iet.unipi.it/~luigi/ . Universita` di Pisa TEL +39-050-2217533 . via Diotisalvi 2 Mobile +39-338-6809875 . 56122 PISA (Italy) -----------------------------------------+-------------------------------