From owner-freebsd-questions@FreeBSD.ORG Sat Mar 16 21:20:34 2013 Return-Path: Delivered-To: freebsd-questions@freebsd.org Received: from mx1.freebsd.org (mx1.FreeBSD.org [8.8.178.115]) by hub.freebsd.org (Postfix) with ESMTP id 39E03A8E for ; Sat, 16 Mar 2013 21:20:34 +0000 (UTC) (envelope-from m.e.sanliturk@gmail.com) Received: from mail-vb0-x22a.google.com (mail-vb0-x22a.google.com [IPv6:2607:f8b0:400c:c02::22a]) by mx1.freebsd.org (Postfix) with ESMTP id F3F812DA for ; Sat, 16 Mar 2013 21:20:33 +0000 (UTC) Received: by mail-vb0-f42.google.com with SMTP id ff1so2656605vbb.29 for ; Sat, 16 Mar 2013 14:20:32 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:x-received:in-reply-to:references:date:message-id :subject:from:to:cc:content-type; bh=1Zi6p0wB+WyxoUXRa2SWRW0lM0M7+XJ3nwtgxjyS8D4=; b=R4v6UbC7k9dRLEiulkt8Y5LJ9AnZX009CFncsLbEe1LeQqqf1UsVY2Zdl+nvq+IcXa o0KrBOjmYyAJ5e1MbwVODlETKlKhWdWGnWoqDFOAI0DeJEtIiQ+rdzP1Hqf6FQ6uTLWN Z9uY2Id8yINmq30SBplMHl3GBfbYPjcP7AX6ts0L+tLdGwFMRMEy0YgbT+5I+HAPIfMk PBg8nxLFbxeFf8HQYWda8WhpwezLxNUJzBFxINWQZaPCds9o9+cRfAFIk2Ij4zvtYDSp w0beVNrBdOkNgL8GSupXZbOwTmaM+4vgDWnBO5PsDBm1vWsBodLR5xjyCT7ejY98NXeZ TZkg== MIME-Version: 1.0 X-Received: by 10.52.23.238 with SMTP id p14mr2492394vdf.86.1363468832798; Sat, 16 Mar 2013 14:20:32 -0700 (PDT) Received: by 10.58.132.203 with HTTP; Sat, 16 Mar 2013 14:20:32 -0700 (PDT) In-Reply-To: <5144BEB7.3090906@tundraware.com> References: <5144BEB7.3090906@tundraware.com> Date: Sat, 16 Mar 2013 14:20:32 -0700 Message-ID: Subject: Re: NFS Performance: Weirder And Weirder From: Mehmet Erol Sanliturk To: Tim Daneliuk Content-Type: text/plain; charset=UTF-8 X-Content-Filtered-By: Mailman/MimeDel 2.1.14 Cc: FreeBSD Mailing List X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 16 Mar 2013 21:20:34 -0000 On Sat, Mar 16, 2013 at 11:49 AM, Tim Daneliuk wrote: > This is really weird. A FreeBSD 9.1 system mounts the following: > > /dev/ad4s1a 989M 625M 285M 69% / > devfs 1.0k 1.0k 0B 100% /dev > /dev/ad4s1d 7.8G 1G 6.1G 14% /var > /dev/ad4s1e 48G 9.4G 35G 21% /usr > /dev/ad4s1f 390G 127G 231G 35% /usr1 > /dev/ad6s1d 902G 710G 120G 86% /usr1/BKU > > /usr1/something (under ad4s1f) and /usr1/BKU (all of ad6s1d) are > exported for NFS mounting on the LAN. I have tested the > speeds of these two drives locally doing a 'dd if=/dev/zero ....'. > Their speeds are quite comparable - around 55-60 MB/s so the > problem below is not an artifact of a slow drive. > > The two mounts are imported like this on a Linux Mint 12 machine: > > > machine:/usr1/BKU /BKU nfs rw,soft,intr 0 0 > machine:/usr1/shared /shared nfs rw,soft,intr 0 0 > > Problem: > > When I write files from the LM12 machines to /BKU the writes are > 1/10 the speed of when writing to /shared. Reads are fine in both > cases, at near native disk speeds being reported. > > Someone here suggested I get rid of any symlinks in the mount and I did > that to no avail. > > > Incidentally, the only reason I just noticed this is that I upgraded the > NIC on the FreeBSD machine and the switch into which it connects to > 1000Base > because the LM12 machine had a built in 1000Base NIC. I also changed > the cables on both machines to ensure they were not the problem. Prior > to this, I was bandwidth constrained by the 100Base so I never saw NFS > performance as an issue. When I upgraded, I expected faster transfers > and when I didn't get them, I started this whole investigation. > > So ... I'm stumped: > > - It's not the drive or SATA ports because both drives show comparable > performance. > - It's not the cables because I can get great throughput on one of the NFS > mountpoints. > - It's neither NIC for the same reason. > > Does anyone: > > A) Have a clue what might be doing this > B) Have a suggestion how to track down the problem > > Thanks, > > -- > ------------------------------**------------------------------** > ---------------- > Tim Daneliuk tundra@tundraware.com > PGP Key: http://www.tundraware.com/PGP/ > > With respect to your mount points : /usr1 is spanning TWO different partitions : /dev/ad4s1f 390G 127G 231G 35% /usr1 /dev/ad6s1d 902G 710G 120G 86% /usr1/BKU because /usr1/BKU is a sub-directory of /usr1 . If you create a new directory , for example /usr2 , and /usr2/BKU , and using this new separate directory for sharing , such as : /dev/ad6s1d 902G 710G 120G 86% /usr2/BKU and machine:/usr2/BKU /BKU nfs rw,soft,intr 0 0 will it make difference ? Mehmet Erol Sanliturk