From owner-freebsd-fs@FreeBSD.ORG Wed Apr 24 23:02:37 2013 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by hub.freebsd.org (Postfix) with ESMTP id 7E183716 for ; Wed, 24 Apr 2013 23:02:37 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) Received: from esa-annu.net.uoguelph.ca (esa-annu.mail.uoguelph.ca [131.104.91.36]) by mx1.freebsd.org (Postfix) with ESMTP id 463EE12DC for ; Wed, 24 Apr 2013 23:02:36 +0000 (UTC) X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: AqIEABpjeFGDaFvO/2dsb2JhbABRgzyDMrp6gRh0gh8BAQEEAQEBICsgCxsYAgINGQIpAQkmBggHBAEcBIdzDKtqgQ6RLIEjjFt+ATMHgjiBEwOTTYENgkKBJY97gyogMoEFNQ X-IronPort-AV: E=Sophos;i="4.87,546,1363147200"; d="scan'208";a="25388715" Received: from erie.cs.uoguelph.ca (HELO zcs3.mail.uoguelph.ca) ([131.104.91.206]) by esa-annu.net.uoguelph.ca with ESMTP; 24 Apr 2013 19:02:29 -0400 Received: from zcs3.mail.uoguelph.ca (localhost.localdomain [127.0.0.1]) by zcs3.mail.uoguelph.ca (Postfix) with ESMTP id 87AB4B3F23; Wed, 24 Apr 2013 19:02:29 -0400 (EDT) Date: Wed, 24 Apr 2013 19:02:29 -0400 (EDT) From: Rick Macklem To: "Marc G. Fournier" Message-ID: <753914397.1123782.1366844549491.JavaMail.root@erie.cs.uoguelph.ca> In-Reply-To: <8A0622F0-D9FD-493B-8BDF-82D1359463F3@hub.org> Subject: Re: NFS Performance issue against NetApp MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Originating-IP: [172.17.91.202] X-Mailer: Zimbra 6.0.10_GA_2692 (ZimbraWebClient - FF3.0 (Win)/6.0.10_GA_2692) Cc: freebsd-fs@freebsd.org X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 24 Apr 2013 23:02:37 -0000 Marc G. Fournier wrote: > On 2013-04-24, at 14:18 , Rainer Duffner > wrote: >=20 > > > > Am 24.04.2013 um 23:02 schrieb "Marc G. Fournier" : > > > >> > >> On 2013-04-24, at 12:48 , Rainer Duffner > >> wrote: > >> > >>> > >>> In the NFS mount options. > >>> I've re-done my tests and it still seems to be a problem. > >> > >> 'k, just to clarify =E2=80=A6 your tests are with the Broadcom chipset= (s)? > >> I have an Intel card on order, so will run tests against that as > >> soon as it gets here to see how it changes =E2=80=A6 > >> > > > > > > No, with the intel card then. > > Even then it was slow. > > > > > > > >> Just curious, but what are you running for tests? I noticed it > >> visually, but other then using something like iozone21, not sure > >> what is useful for coming up with a benchmark =E2=80=A6 > > > > > > I've just ran something like > > dd if=3D/dev/zero of=3Dbla bs=3D1000000 count=3D1000 > > > > on the nfsmount on the client. > > >=20 > Here is what I'm seeing with the Broadcom card: >=20 > IOZONE performance measurements: > 108561574 bytes/second for writing the file > 95311340 bytes/second for reading the file >=20 >=20 > That is using 'ozone 1024' for a 1G file =E2=80=A6 and no mount / kernel > settings =E2=80=A6 >=20 > The problem isn't with the single file read / write though =E2=80=A6 the > problem is when starting up an app server like jboss =E2=80=A6 my "refere= nce > server" is an old 32bit, 2 CPU + HT server with local drives =E2=80=A6 st= art > up takes, from jboss start to deploy: >=20 > JBoss AS 7.1.1.Final "Brontes" started in 87916ms >=20 > now, I do acknowledge that this is with local drives, so will always > be faster the NFS drives =E2=80=A6 but =E2=80=A6 >=20 > HP Proliant Gen8, 64bit, 16G of RAM, Oodles of CPU: > FreeBSD/SMP: Multiprocessor System Detected: 24 CPUs > FreeBSD/SMP: 2 package(s) x 6 core(s) x 2 SMT threads > Brand new HP Procurve 2910al-24G =E2=80=A6 brand new 3xxx series NetApp > running 8.1.2 =E2=80=A6 and everything pretty much idle (non production y= et), > and: >=20 > JBoss AS 7.1.1.Final "Brontes" started in 310249ms >=20 >=20 > So, over 4x slower? >=20 > Can you send me what your mount options are in /etc/fstab? I'd like to > try that out and compare against the two above =E2=80=A6 and I do have th= e > Intel card on the way, so see if that makes a difference =E2=80=A6 >=20 Along with rsize,wsize you might want to try increasing readahead. The default is only 1. rick >=20 >=20 >=20 > _______________________________________________ > freebsd-fs@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-fs > To unsubscribe, send any mail to "freebsd-fs-unsubscribe@freebsd.org"