From owner-freebsd-arch@FreeBSD.ORG Sun Sep 22 20:02:22 2013 Return-Path: Delivered-To: freebsd-arch@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTP id D762FFB8; Sun, 22 Sep 2013 20:02:22 +0000 (UTC) (envelope-from melifaro@yandex-team.ru) Received: from forward-corp1g.mail.yandex.net (forward-corp1g.mail.yandex.net [IPv6:2a02:6b8:0:1402::10]) by mx1.freebsd.org (Postfix) with ESMTP id 827D92358; Sun, 22 Sep 2013 20:02:22 +0000 (UTC) Received: from smtpcorp4.mail.yandex.net (smtpcorp4.mail.yandex.net [95.108.252.2]) by forward-corp1g.mail.yandex.net (Yandex) with ESMTP id C54B9366009A; Mon, 23 Sep 2013 00:02:20 +0400 (MSK) Received: from smtpcorp4.mail.yandex.net (localhost [127.0.0.1]) by smtpcorp4.mail.yandex.net (Yandex) with ESMTP id 2EF512C0337; Mon, 23 Sep 2013 00:02:20 +0400 (MSK) Received: from dhcp170-36-red.yandex.net (dhcp170-36-red.yandex.net [95.108.170.36]) by smtpcorp4.mail.yandex.net (nwsmtp/Yandex) with ESMTP id sZ8d66c12V-2KiurqgF; Mon, 23 Sep 2013 00:02:20 +0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yandex-team.ru; s=default; t=1379880140; bh=ckqWsTOIe/Kq2fUVwOM8tdSMGh1wrt74DVOIcVSoROQ=; h=Message-ID:Date:From:User-Agent:MIME-Version:To:CC:Subject: References:In-Reply-To:Content-Type:Content-Transfer-Encoding; b=UqhwclJ5XqEh3ojfScL1sDTZYC6IyJM1t6cWll5wv/fCnjrOTu4KyAfG/wQzY9rkf FNwVc0pgaxTowGHI03/Hgr3+l9ByEYnLs4ZAX36XWRwghuhfnKgXNNKA8RXVJZ8xyb lztFaDePItV+hzB91UQp9tJrQKpHpBB8VWUc+YRI= Authentication-Results: smtpcorp4.mail.yandex.net; dkim=pass header.i=@yandex-team.ru Message-ID: <523F4C8D.6080903@yandex-team.ru> Date: Mon, 23 Sep 2013 00:01:17 +0400 From: "Alexander V. Chernikov" User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:17.0) Gecko/20130824 Thunderbird/17.0.8 MIME-Version: 1.0 To: Slawa Olhovchenkov Subject: Re: Network stack changes References: <521E41CB.30700@yandex-team.ru> <521E78B0.6080709@freebsd.org> <20130829013241.GB70584@zxy.spb.ru> In-Reply-To: <20130829013241.GB70584@zxy.spb.ru> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: adrian@freebsd.org, Andre Oppermann , freebsd-hackers@freebsd.org, freebsd-arch@freebsd.org, luigi@freebsd.org, ae@FreeBSD.org, Gleb Smirnoff , FreeBSD Net X-BeenThere: freebsd-arch@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Discussion related to FreeBSD architecture List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 22 Sep 2013 20:02:22 -0000 On 29.08.2013 05:32, Slawa Olhovchenkov wrote: > On Thu, Aug 29, 2013 at 12:24:48AM +0200, Andre Oppermann wrote: > >>> .. >>> while Intel DPDK claims 80MPPS (and 6windgate talks about 160 or so) on the same-class hardware and >>> _userland_ forwarding. >> Those numbers sound a bit far out. Maybe if the packet isn't touched >> or looked at at all in a pure netmap interface to interface bridging >> scenario. I don't believe these numbers. > 80*64*8 = 40.960 Gb/s > May be DCA? And use CPU with 40 PCIe lane and 4 memory chanell. Intel introduces DDIO instead of DCA: http://www.intel.com/content/www/us/en/io/direct-data-i-o.html (and it seems DCA does not help much): https://www.myricom.com/software/myri10ge/790-how-do-i-enable-intel-direct-cache-access-dca-with-the-linux-myri10ge-driver.html https://www.myricom.com/software/myri10ge/783-how-do-i-get-the-best-performance-with-my-myri-10g-network-adapters-on-a-host-that-supports-intel-data-direct-i-o-ddio.html (However, DPDK paper notes DDIO is of signifficant helpers)