From owner-freebsd-fs@FreeBSD.ORG Tue Apr 23 23:26:08 2013 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by hub.freebsd.org (Postfix) with ESMTP id 8DAFA128 for ; Tue, 23 Apr 2013 23:26:08 +0000 (UTC) (envelope-from scrappy@hub.org) Received: from hub.org (hub.org [200.46.208.146]) by mx1.freebsd.org (Postfix) with ESMTP id 43A5714C1 for ; Tue, 23 Apr 2013 23:26:08 +0000 (UTC) Received: from maia.hub.org (unknown [200.46.151.188]) by hub.org (Postfix) with ESMTP id 20ED9A12C3F for ; Tue, 23 Apr 2013 20:26:05 -0300 (ADT) Received: from hub.org ([200.46.208.146]) by maia.hub.org (mx1.hub.org [200.46.151.188]) (amavisd-maia, port 10024) with ESMTP id 19965-05 for ; Tue, 23 Apr 2013 23:25:59 +0000 (UTC) Received: from [10.5.250.150] (remote.ilcs.sd63.bc.ca [142.31.148.2]) by hub.org (Postfix) with ESMTPA id 2D2B2A12C3E for ; Tue, 23 Apr 2013 20:25:57 -0300 (ADT) From: "Marc G. Fournier" Subject: NFS Performance issue against NetApp Message-Id: <4F9A2AAE-938F-4FF5-A30C-72689D7F1F39@hub.org> Date: Tue, 23 Apr 2013 16:25:56 -0700 To: freebsd-fs@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 6.3 \(1503\)) X-Mailer: Apple Mail (2.1503) Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.14 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 23 Apr 2013 23:26:08 -0000 Morning =85 I'm trying to figure out where performance issues are arising, and I = suspect its a lack of tuning on the FreeBSD side =85=20 Hardware wise, I have an HP Proliant DL360p Gen8 Server, 16G of RAM, = bge ethernet =85 I have two ethernet ports in use, one used as a private = backend for the NFS filer, the other for the public IP front end. =20 The switch is an HP 2910al-24G. The NetApp is a 3xxx series machine, with the private IP assigned to = a two 1G port trunk into the HP switch. The network itself is pretty much dead, since we haven't gone = production yet =85 the only time you see any traffic on the switch is = when running tests, and even then, *max* is ~45%. The application is jboss =85 on a standalone machine, startup takes = <60s =85 on the NFS mounted, it takes >4m =85 I expect some discrepancy, = but 4x? I talked to NetApp first, and they got me to run perfstat to gather = information when I'm running through the jboss start up, and the numbers = / graphs show *very* low =85 read latency down around 0.6ms, as an = example I did a search of NetApps kb, and found an article that talks about = several kernel settings, but they are fine FreeBSD 4.x =85 do any (or = all) of them still apply? =3D=3D=3D It is recommended that the latest stable release of the FreeBSD kernel = be used, that is, currently version 4.11, which is also the last of the = 4-STABLE branch releases. The latest and final FreeBSD release from the 5-STABLE branch is 5.5, = and was released in May 2006. As for the 6-STABLE release, FreeBSD = version 6.1 was released on May 8, 2006. Make the following kernel parameter changes below. These can be added to = /etc/sysctl.conf and the system rebooted or they can be set temporarily = with sysctl -w