From owner-freebsd-net@freebsd.org  Fri Sep  2 14:39:05 2016
Return-Path: <owner-freebsd-net@freebsd.org>
Delivered-To: freebsd-net@mailman.ysv.freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org
 [IPv6:2001:1900:2254:206a::19:1])
 by mailman.ysv.freebsd.org (Postfix) with ESMTP id 4C99ABCC84E
 for <freebsd-net@mailman.ysv.freebsd.org>;
 Fri,  2 Sep 2016 14:39:05 +0000 (UTC)
 (envelope-from asomers@gmail.com)
Received: from mail-oi0-x22c.google.com (mail-oi0-x22c.google.com
 [IPv6:2607:f8b0:4003:c06::22c])
 (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits))
 (Client CN "smtp.gmail.com",
 Issuer "Google Internet Authority G2" (verified OK))
 by mx1.freebsd.org (Postfix) with ESMTPS id 10320B1B
 for <freebsd-net@freebsd.org>; Fri,  2 Sep 2016 14:39:05 +0000 (UTC)
 (envelope-from asomers@gmail.com)
Received: by mail-oi0-x22c.google.com with SMTP id p186so128620845oia.2
 for <freebsd-net@freebsd.org>; Fri, 02 Sep 2016 07:39:05 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113;
 h=mime-version:sender:in-reply-to:references:from:date:message-id
 :subject:to:cc:content-transfer-encoding;
 bh=gxy4lz4mHK6wwNIVosf3GVHsjXCn6RDFuONhUnqLk4M=;
 b=0nC5I/h6xd6YRcHd+g4IUNDteeL/rO61Mpj7XHDE3d3GqaILOukDTO2m56Qw9NvAtI
 iihJJuPp5D9KqGiot7UvthyViuXPWoi/MiF+oYikkLDH2qb7PDRThbUIVcTEP09CQUYN
 zM7Wp7AI+O3GokqnF3kykBg5HS1b0uvd75tLhIXDBijtAZPHu79reFTEEOxOxh6cpZtx
 Sk9SSyNLwcCL3eeOMyI2s1MY0eCBSpzYmkcvACQwOmaUSDMufj4AmgqXd+O8G8kCuQX2
 UuqFV5y2qH17qilBKjCpR7DcFQ9A/TQ5YXo9w0t+gomiQD9tx1PzRQ89rMpOxyzXQEiO
 4n3Q==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
 d=1e100.net; s=20130820;
 h=x-gm-message-state:mime-version:sender:in-reply-to:references:from
 :date:message-id:subject:to:cc:content-transfer-encoding;
 bh=gxy4lz4mHK6wwNIVosf3GVHsjXCn6RDFuONhUnqLk4M=;
 b=FE29cgGrPJqn7N+RQRAUCq0+8CyUPRPwZqIUoY+r9AEaEf7CnKqF6WkIo/dgLalW3b
 cmEw6YYmmFKkVQiFjJ4fd/608WSIh+sFfxbFrAAvvUwvsEUOBS/s6VxvoxUHITM8MM34
 yZzAkmsI6IIMdI6ErLAYg5deG0OqrCeTM9TIT60HZBPsJCRZfJgMEbWx0QV84hufvvND
 H0O8hZyDpM0Xr29WNeFc9Csln8ENb/HF/UnhdnZKfMd3f5EYECLWYp4H37hux1L+ztSZ
 gLAuaeW2MNPTmbhsk9BCWSIV9KNURk7jilQyOrJBaH+ihnqaya7eeyqxfqj1KcncqypH
 Wn0g==
X-Gm-Message-State: AE9vXwOQ9dZChKXBZNFImuhIV4YnHDt87Wn/VS2rFRbrWxd7rWGyKAkiukv4I+jVsIr5ynzMBiFd4sCDHhYSHw==
X-Received: by 10.202.230.8 with SMTP id d8mr20404691oih.182.1472827144270;
 Fri, 02 Sep 2016 07:39:04 -0700 (PDT)
MIME-Version: 1.0
Sender: asomers@gmail.com
Received: by 10.202.75.216 with HTTP; Fri, 2 Sep 2016 07:39:03 -0700 (PDT)
In-Reply-To: <20160902140711.GC34394@zxy.spb.ru>
References: <20160901211825.GG88122@zxy.spb.ru>
 <224082ab-95f5-0935-6429-7e7a612f1312@selasky.org>
 <20160902100203.GK88122@zxy.spb.ru> <6699041.g38mlsGLrS@energia>
 <20160902140711.GC34394@zxy.spb.ru>
From: Alan Somers <asomers@freebsd.org>
Date: Fri, 2 Sep 2016 08:39:03 -0600
X-Google-Sender-Auth: wphxoTVVq358OW3uf40OLkRdcWg
Message-ID: <CAOtMX2jiLdJggEpwgHRYrxVaNprLfQhYm=65njZZXEXY_X3F9Q@mail.gmail.com>
Subject: Re: 60G+ network connection
To: Slawa Olhovchenkov <slw@zxy.spb.ru>
Cc: Kajetan Staszkiewicz <vegeta@tuxpowered.net>,
 FreeBSD Net <freebsd-net@freebsd.org>
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable
X-BeenThere: freebsd-net@freebsd.org
X-Mailman-Version: 2.1.22
Precedence: list
List-Id: Networking and TCP/IP with FreeBSD <freebsd-net.freebsd.org>
List-Unsubscribe: <https://lists.freebsd.org/mailman/options/freebsd-net>,
 <mailto:freebsd-net-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-net/>
List-Post: <mailto:freebsd-net@freebsd.org>
List-Help: <mailto:freebsd-net-request@freebsd.org?subject=help>
List-Subscribe: <https://lists.freebsd.org/mailman/listinfo/freebsd-net>,
 <mailto:freebsd-net-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Fri, 02 Sep 2016 14:39:05 -0000

On Fri, Sep 2, 2016 at 8:07 AM, Slawa Olhovchenkov <slw@zxy.spb.ru> wrote:
> On Fri, Sep 02, 2016 at 04:02:20PM +0200, Kajetan Staszkiewicz wrote:
>
>> On day pi=C4=85tek, 2 wrze=C5=9Bnia 2016 13:02:03 Slawa Olhovchenkov wro=
te:
>>
>> > > > PS: 100G transmiters and connectiveti too expensive, 2x40G prefer.
>> > >
>> > > You can put 2x 40GBit/s modules in the CX-4. I'm not sure if you can
>> > > combine 2x 40GBit/s into a single 80GBit/s.
>> >
>> > I can do it by if_lagg.
>>
>> Plase note that by using link aggregation you can not achieve full speed=
 over
>> a single TCP stream. Onle when multiple streams are in operation you wil=
l
>> really get the aggregated speed.
>
> NP, I am have more then 40K TCP stream.
>
> PS: link aggregation with round-roubin policy can achieve full speed.

At those speeds I would recommend link aggregation with LACP.  It has
less lock contention than round-robin and should give you fine
distribution with 40K streams.

-Alan