From owner-freebsd-stable@freebsd.org Tue Nov 17 15:55:04 2015 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 41CC6A30BE8 for ; Tue, 17 Nov 2015 15:55:04 +0000 (UTC) (envelope-from asomers@gmail.com) Received: from mail-oi0-x22e.google.com (mail-oi0-x22e.google.com [IPv6:2607:f8b0:4003:c06::22e]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 0659B1367 for ; Tue, 17 Nov 2015 15:55:04 +0000 (UTC) (envelope-from asomers@gmail.com) Received: by oige206 with SMTP id e206so7252769oig.2 for ; Tue, 17 Nov 2015 07:55:03 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:in-reply-to:references:date:message-id:subject :from:to:cc:content-type; bh=mJ68nrBUKNfosztn0AcUx0FAfJzqe1qJydYTah61+Sk=; b=OvSzacWfxUnY0LbwDpTfxbo2HZ0ceq643Doz++CWPEXSaV9CXI64Bj+C1BSXPhhTSm MhWfcC4absXPVlW+X6Mri4QkzCzwDJwvB+xzDsnqR9Y/VnNgMRX23tqLq7ZlnQQiE099 dCOF0jK5VTng6kFAIfCLqPe3H1/I2C90nB02hHX07Wh6gppcGacZHZD2Vm/mlWOhVYdi /g2643kWE5KPr4u61wIOIjJNFspwRcGQgf6jiE3AzJV493NYnJnuaGs+fIAXZrPWhLyg 99lSnNcV8ERhEWifaHZ9tbfVXEqXtJ5MpEnuUK6Vvi5okOEmOfcPUinqLxVHlkp8Ztsk SNNQ== MIME-Version: 1.0 X-Received: by 10.202.171.139 with SMTP id u133mr24510968oie.107.1447775703318; Tue, 17 Nov 2015 07:55:03 -0800 (PST) Sender: asomers@gmail.com Received: by 10.202.0.7 with HTTP; Tue, 17 Nov 2015 07:55:03 -0800 (PST) In-Reply-To: <564B4736.3000100@gmail.com> References: <564B4736.3000100@gmail.com> Date: Tue, 17 Nov 2015 08:55:03 -0700 X-Google-Sender-Auth: JLcyW-f3Mbg2RmKpsbbD9-GVO24 Message-ID: Subject: Re: LACP with 3 interfaces. From: Alan Somers To: Johan Hendriks Cc: FreeBSD Content-Type: text/plain; charset=UTF-8 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 17 Nov 2015 15:55:04 -0000 On Tue, Nov 17, 2015 at 8:26 AM, Johan Hendriks wrote: > Is there something we can do to make sure lagg0 uses all the interfaces. Nope. LACP doesn't actively load balance its interfaces. Each flow gets assigned to a single interface based on a hash of the source and destination MACs, IP addresses, and TCP/UDP ports. With many clients, all interfaces will probably be used, but with few clients, there's a lot of luck involved. If you want more bandwidth, you can try fiddling with IP addresses and port numbers to influence the hash function, but even if you get it to distribute the way you want, all your work may be undone by a reboot. The best option is to buy a 10Gbps NIC for the server. They aren't too expensive, anymore, though the switches are still pricey. A cheaper option, if you'll only ever have 4 clients, is to discard the lagg and assign a separate IP address to each igb port, then manually distribute those addresses amongst your clients. If you do this, you unfortunately won't gain the reliability features of LACP. -Alan