From owner-freebsd-stable@freebsd.org Tue Nov 17 15:26:49 2015 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id E308EA3059A for ; Tue, 17 Nov 2015 15:26:49 +0000 (UTC) (envelope-from joh.hendriks@gmail.com) Received: from mail-wm0-x232.google.com (mail-wm0-x232.google.com [IPv6:2a00:1450:400c:c09::232]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 7196015CC for ; Tue, 17 Nov 2015 15:26:49 +0000 (UTC) (envelope-from joh.hendriks@gmail.com) Received: by wmvv187 with SMTP id v187so233189958wmv.1 for ; Tue, 17 Nov 2015 07:26:48 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=to:from:subject:message-id:date:user-agent:mime-version :content-type; bh=NPx8M80i6m8yoq6RtE2Q0DTnUOrIHMFcXU2gu+ZaeOY=; b=ARjDiCDCLaK3Ji9W2Zg0AKG2JDCtk5GL1fQZDJ0YAVo5+0RiIhpnYA94W4lFfKCgeQ ShEh9Lc9Yqv9hoX89b0aa/BkP8H1shJz9mwTD8GYGv+ynLwj85TBk/jRBD/b/1o5Oj1s Oag84QB2bGRK5kWMYc5V43OGIDSLQIThfveYcempERzTLLXU+YGA9owRW3yNRWga0wRJ 7gSSIpY3drR9UMtAbQJfc0jlBjZhhRvgpoEi0dYmHiqCmVO0BvS2i/KoWRW0X8+DDMvd 9o3YEv0WOOqSXMXZBxqRr4bQVCpN6bVxHqvwKR7+GmGKP409U5XA1baTG5MANhQndjml ilXQ== X-Received: by 10.28.52.213 with SMTP id b204mr3601136wma.32.1447774008001; Tue, 17 Nov 2015 07:26:48 -0800 (PST) Received: from Johans-MacBook-Air.local (92-70-102-130.glasvezel.netexpo.nl. [92.70.102.130]) by smtp.googlemail.com with ESMTPSA id lx4sm32137897wjb.5.2015.11.17.07.26.47 for (version=TLSv1/SSLv3 cipher=OTHER); Tue, 17 Nov 2015 07:26:47 -0800 (PST) To: freebsd-stable@freebsd.org From: Johan Hendriks Subject: LACP with 3 interfaces. X-Enigmail-Draft-Status: N1110 Message-ID: <564B4736.3000100@gmail.com> Date: Tue, 17 Nov 2015 16:26:46 +0100 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.11; rv:38.0) Gecko/20100101 Thunderbird/38.3.0 MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Content-Filtered-By: Mailman/MimeDel 2.1.20 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 17 Nov 2015 15:26:50 -0000 Hello all We have a NFS server witch has three network ports. We have bonded these interfaces as a lagg interface, but when we use the server it looks like only two interfaces are used. This is our rc.conf file ifconfig_igb0="up" ifconfig_igb1="up" ifconfig_igb2="up" cloned_interfaces="lagg0" ifconfig_lagg0="laggproto lacp laggport igb0 laggport igb1 laggport igb2 192.168.100.222 netmask 255.255.255.0" ifconfig tell us the following. lagg0: flags=8843 metric 0 mtu 1500 options=403bb ether a0:36:9f:7d:fc:2f inet 192.168.100.222 netmask 0xffffff00 broadcast 192.168.100.255 nd6 options=29 media: Ethernet autoselect status: active laggproto lacp lagghash l2,l3,l4 laggport: igb1 flags=1c laggport: igb2 flags=1c laggport: igb3 flags=1c So all looks fine But with 4 machines putting a 1GB file on the server one is always using full wirespeed, the rest is around 30 / 40 MB. It never uses all three intefaces but two at max. So we are topped at 200MB/s where we were expecting around 300MB/s #systat -if shows this also. It shows two interfaces at work where igb1 is sitting and doing nothing? /0 /1 /2 /3 /4 /5 /6 /7 /8 /9 /10 Load Average | Interface Traffic Peak Total lagg1 in 0.253 KB/s 0.683 KB/s 459.781 KB out 0.000 KB/s 0.000 KB/s 0.000 KB lagg0 in 0.289 KB/s 215.439 MB/s 4.113 GB out 0.091 KB/s 114.269 MB/s 2.061 GB lo0 in 0.000 KB/s 0.068 KB/s 0.770 KB out 0.000 KB/s 0.068 KB/s 0.770 KB igb2 in 0.011 KB/s *98.401 MB/s* 1.039 GB out 0.022 KB/s 1.474 MB/s 27.311 MB igb1 in 0.143 KB/s *0.466 KB/s* 192.422 KB out 0.022 KB/s 1.959 MB/s 27.066 MB igb0 in 0.135 KB/s *117.340 MB/s * 3.074 GB out 0.114 KB/s 112.679 MB/s 2.007 GB Is there something we can do to make sure lagg0 uses all the interfaces. regards Johan