From owner-freebsd-net@FreeBSD.ORG Fri Apr 25 11:46:18 2014 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id BC5A5DE6 for ; Fri, 25 Apr 2014 11:46:18 +0000 (UTC) Received: from smtp1.multiplay.co.uk (smtp1.multiplay.co.uk [85.236.96.35]) by mx1.freebsd.org (Postfix) with ESMTP id 801B41767 for ; Fri, 25 Apr 2014 11:46:18 +0000 (UTC) Received: by smtp1.multiplay.co.uk (Postfix, from userid 65534) id 1E0AB20E7088A; Fri, 25 Apr 2014 11:46:11 +0000 (UTC) X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on smtp1.multiplay.co.uk X-Spam-Level: ** X-Spam-Status: No, score=3.0 required=8.0 tests=AWL,BAYES_05,DOS_OE_TO_MX, FSL_HELO_NON_FQDN_1,HELO_NO_DOMAIN,RDNS_DYNAMIC,STOX_REPLY_TYPE autolearn=no version=3.3.1 Received: from r2d2 (82-69-141-170.dsl.in-addr.zen.co.uk [82.69.141.170]) by smtp1.multiplay.co.uk (Postfix) with ESMTPS id C64F920E70885; Fri, 25 Apr 2014 11:46:06 +0000 (UTC) Message-ID: <6312D8095E3B480DAEDDAB9C39A4B581@multiplay.co.uk> From: "Steven Hartland" To: "Robert Blacquiere" , References: <535A1354.2040309@wp.pl> <20140425111316.GJ9177@calendar.blacquiere.nl> Subject: Re: NFS over LAGG / lacp poor performance Date: Fri, 25 Apr 2014 12:46:10 +0100 MIME-Version: 1.0 Content-Type: text/plain; format=flowed; charset="iso-8859-1"; reply-type=original Content-Transfer-Encoding: 7bit X-Priority: 3 X-MSMail-Priority: Normal X-Mailer: Microsoft Outlook Express 6.00.2900.5931 X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2900.6157 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 25 Apr 2014 11:46:18 -0000 ----- Original Message ----- From: "Robert Blacquiere" > Hi Marek, > > On Fri, Apr 25, 2014 at 09:48:36AM +0200, Marek Salwerowicz wrote: >> Hi list, >> > >> Both boxes are connected to the same switch (HP 1910-48G) >> >> I need to transfer around 10 TB of data from storage1 to storage2 >> I obeserve that during copying, only one NIC (instead of all 4) is used. >> >> Boxes are not stressed during copying >> >> What's more, apart from having 1 NIC saturated (transfer around 120 >> MB/s), I observe transfer rate on level of 70-80 MB/s > > Default lacp 802.3ad works with mac based hashes to loadbalance traffic. > So single host (mac) will be transfered by one ethernet adaptor as you > have seen. In FreeBSD 10 onwards the default is l2,l3 & l4 hash this is not true for the switch side, so may need to tune the switch. Regards Steve