From owner-freebsd-net@FreeBSD.ORG Sun Sep 1 01:38:20 2013 Return-Path: Delivered-To: net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTP id BA512D6D for ; Sun, 1 Sep 2013 01:38:20 +0000 (UTC) (envelope-from btv1==95617f36530==tgubatayao@barracuda.com) Received: from bsf03.barracuda.com (bsf03.barracuda.com [64.235.145.83]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 804152E64 for ; Sun, 1 Sep 2013 01:38:20 +0000 (UTC) X-ASG-Debug-ID: 1377999493-05b9635b3b681360001-oFaieN Received: from BN-SCL-FE02.Cudanet.local (bn-scl-fe02.cudanet.local [10.8.96.69]) by bsf03.barracuda.com with ESMTP id 8Sv0VtqUTg8hSNp3 (version=TLSv1 cipher=AES128-SHA bits=128 verify=NO); Sat, 31 Aug 2013 18:38:13 -0700 (PDT) X-Barracuda-Envelope-From: tgubatayao@barracuda.com Received: from bn-scl-be02.Cudanet.local (10.8.1.52) by BN-SCL-FE02.Cudanet.local (10.8.96.69) with Microsoft SMTP Server (TLS) id 8.3.298.1; Sat, 31 Aug 2013 18:38:13 -0700 Received: from BN-SCL-MBX03.Cudanet.local ([fe80::e5b6:9fef:a4d2:a5ba]) by bn-scl-be02.Cudanet.local ([::1]) with mapi; Sat, 31 Aug 2013 18:38:13 -0700 From: "T.C. Gubatayao" To: Barney Cordoba , Luigi Rizzo , Alan Somers Date: Sat, 31 Aug 2013 18:38:12 -0700 Subject: RE: Flow ID, LACP, and igb Thread-Topic: Flow ID, LACP, and igb X-ASG-Orig-Subj: RE: Flow ID, LACP, and igb Thread-Index: Ac6mR3pN1wEcLwZWQ96rJZRpG6eRNwAaarS4 Message-ID: References: <521BBD21.4070304@freebsd.org> <521EE8DA.3060107@freebsd.org> , <1377952913.44129.YahooMailNeo@web121605.mail.ne1.yahoo.com> In-Reply-To: <1377952913.44129.YahooMailNeo@web121605.mail.ne1.yahoo.com> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: acceptlanguage: en-US Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-Barracuda-Connect: bn-scl-fe02.cudanet.local[10.8.96.69] X-Barracuda-Start-Time: 1377999493 X-Barracuda-Encrypted: AES128-SHA X-Barracuda-URL: http://10.8.98.66:8000/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at barracuda.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.62 X-Barracuda-Spam-Status: No, SCORE=0.62 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=9.0 tests=COMMA_SUBJECT, THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.2.139982 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... 0.60 COMMA_SUBJECT Subject is like 'Re: FDSDS, this is a subject' Cc: Jack F Vogel , "Justin T. Gibbs" , Andre Oppermann , "net@freebsd.org" X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 01 Sep 2013 01:38:20 -0000 On Sat, Aug 31, 2013 at 8:41 AM, Barney Cordoba = wrote: > Also, the *most* important thing is distribution with realistic data. The= goal > should be to use the most trivial function that gives the most balanced > distribution with real numbers. Faster is not better if the result is an > unbalanced distribution. Agreed, with a caveat. It's critical that this distribution be by "flow", = so that out of order packet delivery is minimized. > Many of your ports will be 80 and 53, and if you're going through a route= r > your ethernets may not be very unique, so why even bother to include them= ? > Does getting a good distribution require that you hash every element > individually, or can you get the same distribution with a faster, simpler= way > of creating the seed? > > There's also the other consideration of packet size. Packets on port 53 a= re > likely to be smaller than packets on port 80. What you want is equal > distribution PER PORT on the ports that will carry that vast majority of = your > traffic. Unfortunately, trying to evenly distribute traffic per port based on packet size will likely result in the reordering of packets, and bandwidth wasted = on TCP retransmissions. > Or better yet, use the same number of queues on igb as you have LAGG port= s, > and use the queue id (or RSS) as the hash, so that your traffic is sync'd > between the ethernet adapter queues and the LAGG ports. The card has alre= ady > done the work for you. Isn't this hash for selecting an outbound link? The ingress adapter hash (= RSS) won't help for packets originating from the host, or for packets that may h= ave been translated or otherwise modified while traversing the stack. T.C.=