From owner-freebsd-net@FreeBSD.ORG Fri Apr 25 16:01:01 2014 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 0DCCAE93 for ; Fri, 25 Apr 2014 16:01:01 +0000 (UTC) Received: from smtp1.multiplay.co.uk (smtp1.multiplay.co.uk [85.236.96.35]) by mx1.freebsd.org (Postfix) with ESMTP id BEDD315D0 for ; Fri, 25 Apr 2014 16:01:00 +0000 (UTC) Received: by smtp1.multiplay.co.uk (Postfix, from userid 65534) id 5A05020E7088B; Fri, 25 Apr 2014 16:00:59 +0000 (UTC) X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on smtp1.multiplay.co.uk X-Spam-Level: ** X-Spam-Status: No, score=2.2 required=8.0 tests=AWL,BAYES_00,DOS_OE_TO_MX, FSL_HELO_NON_FQDN_1,HELO_NO_DOMAIN,RDNS_DYNAMIC,STOX_REPLY_TYPE autolearn=no version=3.3.1 Received: from r2d2 (82-69-141-170.dsl.in-addr.zen.co.uk [82.69.141.170]) by smtp1.multiplay.co.uk (Postfix) with ESMTPS id 67A0620E70885; Fri, 25 Apr 2014 16:00:55 +0000 (UTC) Message-ID: From: "Steven Hartland" To: =?iso-8859-1?Q?Gerrit_K=FChn?= References: <535A1354.2040309@wp.pl> <20140425113711.e7c7d1c2.gerrit.kuehn@aei.mpg.de> <535A482E.1030106@wp.pl> <20140425140123.a76c18f9.gerrit.kuehn@aei.mpg.de> <535A5268.100@wp.pl> <8247FE6336414E1F97ADA561D0680097@multiplay.co.uk> <535A5DD9.9060206@wp.pl> <535A69CE.9010800@wp.pl> <4E7A280CACC84910A3DE068085976E30@multiplay.co.uk> <20140425161312.3ad95e3a.gerrit.kuehn@aei.mpg.de> <1BD2C00D4F0D405C939C975246D41C60@multiplay.co.uk> <20140425163433.e35e5de3.gerrit.kuehn@aei.mpg.de> <006183CE786F4EAC9435B797E5F271CF@multiplay.co.uk> <20140425175231.9714afc3.gerrit.kuehn@aei.mpg.de> Subject: Re: NFS over LAGG / lacp poor performance Date: Fri, 25 Apr 2014 17:00:59 +0100 MIME-Version: 1.0 Content-Type: text/plain; format=flowed; charset="iso-8859-1"; reply-type=original Content-Transfer-Encoding: 8bit X-Priority: 3 X-MSMail-Priority: Normal X-Mailer: Microsoft Outlook Express 6.00.2900.5931 X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2900.6157 Cc: freebsd-net@freebsd.org X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 25 Apr 2014 16:01:01 -0000 ----- Original Message ----- From: "Gerrit Kühn" To: "Steven Hartland" Cc: Sent: Friday, April 25, 2014 4:52 PM Subject: Re: NFS over LAGG / lacp poor performance > On Fri, 25 Apr 2014 15:55:29 +0100 "Steven Hartland" > wrote about Re: NFS over LAGG / lacp poor > performance: > > SH> Run top then enable system processes (shift+S) and threads (shift+H) > SH> then disable idle process display (z) if your seeing significant CPU > SH> usage to the igb interrupt handlers try reducing the number. > > Hm, I'm a bit unsure what I see here: > > --- > last pid: 71026; load averages: 0.36, 0.37, 0.27 > up 18+03:14:21 17:48:02 > 295 processes: 5 running, 259 sleeping, 31 waiting > CPU: 0.0% user, 0.0% nice, 0.0% system, 0.0% interrupt, 100% idle > Mem: 3596K Active, 59M Inact, 11G Wired, 900K Cache, 1236M Buf, 1019M Free > Swap: 16G Total, 14M Used, 16G Free > > PID USERNAME PRI NICE SIZE RES STATE C TIME WCPU COMMAND > 0 root -16 0 0K 2672K - 2 272:01 0.00% kernel{zio_write_issue_} > 0 root -16 0 0K 2672K - 0 271:55 0.00% kernel{zio_write_issue_} > 0 root -16 0 0K 2672K - 3 271:54 0.00% kernel{zio_write_issue_} > 0 root -16 0 0K 2672K - 1 271:52 0.00% kernel{zio_write_issue_} > 1455 root 20 0 9912K 472K rpcsvc 2 173:53 0.00% nfsd{nfsd: master} > 1455 root 20 0 9912K 472K rpcsvc 0 166:37 0.00% nfsd{nfsd: service} > 1455 root 20 0 9912K 472K rpcsvc 0 164:25 0.00% nfsd{nfsd: service} > 1455 root 20 0 9912K 472K rpcsvc 3 163:06 0.00% nfsd{nfsd: service} > 12 root -92 - 0K 496K WAIT 1 155:36 0.00% intr{irq262: igb1:que} > [...] > --- > > > The irq-igb1 clibs to top every now and then (always less than 1% cpu > usage though), but there is never much cpu usage shown for any task. > However, the overall load is significant. What might the system be doing? Thats not your issue then. Regards Steve