From owner-freebsd-net@freebsd.org Sun Jun 28 11:42:34 2015 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 1EB6198E54C for ; Sun, 28 Jun 2015 11:42:34 +0000 (UTC) (envelope-from pavel.odintsov@gmail.com) Received: from mail-wg0-x231.google.com (mail-wg0-x231.google.com [IPv6:2a00:1450:400c:c00::231]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id AE36B1DA7 for ; Sun, 28 Jun 2015 11:42:33 +0000 (UTC) (envelope-from pavel.odintsov@gmail.com) Received: by wgjx7 with SMTP id x7so46869031wgj.2 for ; Sun, 28 Jun 2015 04:42:32 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=Aqgoxj/aGZ4FbjusUyNyYbW7kn5qgsayDy7M0l/ygMU=; b=XQz0M7rD+57zudIxycDkHo+rEo1Yocfpc+YjQdKLVaG9M3p2BQkbPGnH2i+7y+p00o Z9xA9o4M+q5tvGTdWmhDgtqENPA2lLRK+EPnQoVTuWzEP10Km4IJ/zsWg953p0tc8E6R dZfvNIQBdCercUdwIPPDzjM6cEwM/Z/au7VZb4IDovagNBz70MxrTv7qR9goh/Zz/Wkc U4thw7yGG71KqUN/3iFxjNKZi1q85qHHeiez1bjt6JPSlOOuZCsLFFemQsTZ4XAtuNrE C8zLtlCIRutkU4oZatvfTIrjoYv0N5wbV3Jn8RH3+Q8MeCcMjsg//D1pnmKQdFylYhUu r20w== MIME-Version: 1.0 X-Received: by 10.180.106.195 with SMTP id gw3mr13291667wib.25.1435491752270; Sun, 28 Jun 2015 04:42:32 -0700 (PDT) Received: by 10.27.178.129 with HTTP; Sun, 28 Jun 2015 04:42:32 -0700 (PDT) In-Reply-To: References: Date: Sun, 28 Jun 2015 14:42:32 +0300 Message-ID: Subject: Re: Intel XL710 40GE NIC, i40 driver and wire speed performance with netmap From: Pavel Odintsov To: Luigi Rizzo Cc: "freebsd-net@freebsd.org" Content-Type: text/plain; charset=UTF-8 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 28 Jun 2015 11:42:34 -0000 Hello, Luigi! Thank you for detailed answer! Well, this issue related to NIC itself.... not so good to hear this. Thus, Intel / Chelsio is out of the game :( I just found Mellanox NIC's ConnectX 4 Lx which offer 75 mpps for 50 GE in data sheet: http://www.mellanox.com/related-docs/prod_adapter_cards/PB_ConnectX-4_Lx-EN_Card.pdf ConnectX-4 Lx EN provides an unmatched combination of 10, 25, 40, and 50GbE bandwidth, sub microsecond latency and a 75 million packets per second message rate. Do you have experience with this cards? On Sun, Jun 28, 2015 at 2:19 PM, Luigi Rizzo wrote: > Those 42mpps are probably close to the best you can get, take or leave a few > MPPs. I do not know of any pcie nic that can do 40g at 64byte frames. On > freebsd, Chelsio with netmap is in the 40-45mpps range too, and from what I > can tell those are HW limited, not CPU bound numbers. I40e with netmap is > between 32 and 36 mpps on TX (did not bother to optimize it), 28 mpps on RX, > and surely I won't be able to beat dpdk which is highly optimized for the > CPU and nic. > > Cheers > Luigi > > On Sunday, June 28, 2015, Pavel Odintsov wrote: >> >> Hello, folks! >> >> I'm looking for solution which could do wire speed (56 mpps with >> 64byte packets) for 40GE. >> >> We have tested PF_RING/DPDK on Linux and could not achieve more than >> ~42 mpps and it's not enough for us. >> >> Could anybody share experience regarding performance estimations with >> netmap and this NIC on best-ever-and-ever FreeBSD? >> >> Thank you! >> >> -- >> Sincerely yours, Pavel Odintsov >> _______________________________________________ >> freebsd-net@freebsd.org mailing list >> http://lists.freebsd.org/mailman/listinfo/freebsd-net >> To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org" > > > > -- > -----------------------------------------+------------------------------- > Prof. Luigi RIZZO, rizzo@iet.unipi.it . Dip. di Ing. dell'Informazione > http://www.iet.unipi.it/~luigi/ . Universita` di Pisa > TEL +39-050-2217533 . via Diotisalvi 2 > Mobile +39-338-6809875 . 56122 PISA (Italy) > -----------------------------------------+------------------------------- > -- Sincerely yours, Pavel Odintsov