From owner-freebsd-net@FreeBSD.ORG Tue Jul 8 21:06:19 2008 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 915B3106567A for ; Tue, 8 Jul 2008 21:06:19 +0000 (UTC) (envelope-from kip.macy@gmail.com) Received: from wa-out-1112.google.com (wa-out-1112.google.com [209.85.146.181]) by mx1.freebsd.org (Postfix) with ESMTP id 19D788FC17 for ; Tue, 8 Jul 2008 21:06:18 +0000 (UTC) (envelope-from kip.macy@gmail.com) Received: by wa-out-1112.google.com with SMTP id j4so1543589wah.3 for ; Tue, 08 Jul 2008 14:06:18 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:to :subject:cc:in-reply-to:mime-version:content-type :content-transfer-encoding:content-disposition:references; bh=C6pSsOlCJbmxG7Z4tKFgNyBRw+nRJ9JDESmM9E1q4hw=; b=IXctnL37pgLyvrgmLEvoZAbGB3nAY3ACvFGKoTkT17ZKUAK5SM8N6bBhafMeLrMEjR CeLH/A+MuWsuePpv3j4PRaFERqNidJpjhp5N9U6cGxKrUuzonhWs+f+jy5PSMbSeWMd7 pAsIWIR00IJ78WWigCXdgDUlKqs7tWFQ1Jkwc= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:to:subject:cc:in-reply-to:mime-version :content-type:content-transfer-encoding:content-disposition :references; b=ZZuHfLU6akuqt5kH2SVCJVb5yF+iHrc3WnvripTaQGYHJtLDWgRawas4WFu8R9cARl lsi7Zl5G6yuPwunFtcxc6cP+7hXqFqIUzZ8Ti930VylncgdVOqR1GuSuS6g1pJlgo5dx aUMg61y++uQgRYL/7CGoCNamiXSqkjiovGo24= Received: by 10.114.144.1 with SMTP id r1mr8475638wad.97.1215551177914; Tue, 08 Jul 2008 14:06:17 -0700 (PDT) Received: by 10.114.59.4 with HTTP; Tue, 8 Jul 2008 14:06:17 -0700 (PDT) Message-ID: Date: Tue, 8 Jul 2008 14:06:17 -0700 From: "Kip Macy" To: "Brian McGinty" In-Reply-To: <601bffc40807081346q454c1f40td47a0f54806d8a8c@mail.gmail.com> MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline References: <4867420D.7090406@gtcomm.net> <486A7E45.3030902@gtcomm.net> <486A8F24.5010000@gtcomm.net> <486A9A0E.6060308@elischer.org> <486B41D5.3060609@gtcomm.net> <4871E85C.8090907@freebsd.org> <48726422.7050703@gtcomm.net> <200807080107.m6817XxO021966@lava.sentex.ca> <601bffc40807081346q454c1f40td47a0f54806d8a8c@mail.gmail.com> Cc: FreeBSD Net , Paul , Andre Oppermann , Mike Tancsa Subject: Re: Freebsd IP Forwarding performance (question, and some info) [7-stable, current, em, smp] X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 08 Jul 2008 21:06:19 -0000 On Tue, Jul 8, 2008 at 1:46 PM, Brian McGinty wrote: >> I have a pre-production card. With some bug fixes and some tuning of >> interrupt handling (custom stack - I've been asked to push the changes >> back in to CVS, I just don't have time right now) an otherwise >> unoptimized igb can forward 1.04Mpps from one port to another (1.04 >> Mpps in on igb0 and 1.04 Mpps out on igb1) using 3.5 cores on an 8 >> core system. > > I have a 8 core system running stock Linux that easily does line rate > (ie, 1.488 Mpps) on 3 (82575) interfaces. Ie, 3 * 1.48 Mpps! Hi Brian I very much doubt that this is ceteris paribus. This is 384 random IPs -> 384 random IP addresses with a flow lookup for each packet. Also, I've read through igb on Linux - it has a lot of optimizations that the FreeBSD driver lacks and I have yet to implement. Thanks, Kip