From owner-freebsd-net@FreeBSD.ORG  Mon Jun 23 22:54:29 2014
Return-Path: <owner-freebsd-net@FreeBSD.ORG>
Delivered-To: freebsd-net@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org
 [IPv6:2001:1900:2254:206a::19:1])
 (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits))
 (No client certificate requested)
 by hub.freebsd.org (Postfix) with ESMTPS id E96CD9C;
 Mon, 23 Jun 2014 22:54:29 +0000 (UTC)
Received: from mail-qc0-x22c.google.com (mail-qc0-x22c.google.com
 [IPv6:2607:f8b0:400d:c01::22c])
 (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits))
 (Client CN "smtp.gmail.com",
 Issuer "Google Internet Authority G2" (verified OK))
 by mx1.freebsd.org (Postfix) with ESMTPS id 99B7F2E7F;
 Mon, 23 Jun 2014 22:54:29 +0000 (UTC)
Received: by mail-qc0-f172.google.com with SMTP id o8so6818657qcw.31
 for <multiple recipients>; Mon, 23 Jun 2014 15:54:28 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113;
 h=mime-version:sender:in-reply-to:references:date:message-id:subject
 :from:to:cc:content-type;
 bh=l6HmwZbJoMZE7fpg0IS5vku24k4DXa6+XjWrkUqzE10=;
 b=IBJNsS09Abr/+c8Ca46jjxjM6v04addDOwLtwO9q6xaV6tPw12/F6eUR/YzrJcKY0X
 xrw63dBZSsk5AQMBq++IF9hwEZYcenfBzWh5PwCr7X2kxkcWwbWbPq7exKxwJkRUKxdl
 ndnhvhOdSf+5zq8KUcItvgAUqlHPp8H9T5VBPImYggi20EQ5wj+v6fmt8p/hjbNZd9N1
 NMh1c89IDu47r6KIsjqsvu1MWj2f97sMja3Npdzc8i5Dr8hefAjdxeSc+tieP0bwQVg5
 RQvj1iaa1YtRyDNVeZOO+v9y9r2BInkSfLob5zgXkmqSbOdt1wlMmuKtwwr86dnP88Yb
 +vpQ==
MIME-Version: 1.0
X-Received: by 10.140.80.49 with SMTP id b46mr32208219qgd.102.1403564068836;
 Mon, 23 Jun 2014 15:54:28 -0700 (PDT)
Sender: adrian.chadd@gmail.com
Received: by 10.224.43.134 with HTTP; Mon, 23 Jun 2014 15:54:28 -0700 (PDT)
In-Reply-To: <CAOfEmZja8Tkv_xG8LyR5Nbj+Oga=vvdy=b3pxHqZi0-BBq25Uw@mail.gmail.com>
References: <CAOfEmZjmb1bdvn0gR6vD1WeP8o8g7KwXod4TE0iJfa=nicyeng@mail.gmail.com>
 <CAJ-Vmomt2QDXAVBVUk6m8oH4Pa5yErDdG6wWrP3X7+DW137xiA@mail.gmail.com>
 <CAOfEmZja8Tkv_xG8LyR5Nbj+Oga=vvdy=b3pxHqZi0-BBq25Uw@mail.gmail.com>
Date: Mon, 23 Jun 2014 15:54:28 -0700
X-Google-Sender-Auth: ypWfYoEZJH30MeamQSbVWAOi9ms
Message-ID: <CAJ-VmomY2wP1EyVK4J16sGmMid=sJ9MPZrUY6pgcKGBDXm1T4g@mail.gmail.com>
Subject: Re: [patch][lagg] - Set a better granularity and distribution on
 roundrobin protocol.
From: Adrian Chadd <adrian@freebsd.org>
To: araujo@freebsd.org
Content-Type: text/plain; charset=UTF-8
Cc: FreeBSD Net <freebsd-net@freebsd.org>
X-BeenThere: freebsd-net@freebsd.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: Networking and TCP/IP with FreeBSD <freebsd-net.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/options/freebsd-net>,
 <mailto:freebsd-net-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-net/>
List-Post: <mailto:freebsd-net@freebsd.org>
List-Help: <mailto:freebsd-net-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-net>,
 <mailto:freebsd-net-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Mon, 23 Jun 2014 22:54:30 -0000

Hi,

No, don't introduce out of order behaviour. Ever. You may not think
it's a problem for TCP, but UDP things and VPN things will start
getting very angry. There are VPN configurations out there that will
drop the VPN if frames are out of order.

The ixgbe driver is setting the flowid to the msix queue ID, rather
than a 32 bit unique flow id hash value for the flow. That makes it
hard to do traffic distribution where the flowid is available.

There's an lagg option to re-hash the mbuf rather than rely on the
flowid for outbound port choice - have you looked at using that? Did
that make any difference?



-a