From owner-freebsd-stable@FreeBSD.ORG Tue Jun 24 13:11:04 2014 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id DC9BD2E4 for ; Tue, 24 Jun 2014 13:11:04 +0000 (UTC) Received: from smarthost1.sentex.ca (smarthost1.sentex.ca [IPv6:2607:f3e0:0:1::12]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client CN "smarthost.sentex.ca", Issuer "smarthost.sentex.ca" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id A60152734 for ; Tue, 24 Jun 2014 13:11:04 +0000 (UTC) Received: from [IPv6:2607:f3e0:0:4:f025:8813:7603:7e4a] (saphire3.sentex.ca [IPv6:2607:f3e0:0:4:f025:8813:7603:7e4a]) by smarthost1.sentex.ca (8.14.9/8.14.9) with ESMTP id s5ODB0Jf009793; Tue, 24 Jun 2014 09:11:00 -0400 (EDT) (envelope-from mike@sentex.net) Message-ID: <53A978D1.2000207@sentex.net> Date: Tue, 24 Jun 2014 09:10:41 -0400 From: Mike Tancsa Organization: Sentex Communications User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:24.0) Gecko/20100101 Thunderbird/24.6.0 MIME-Version: 1.0 To: Rick Macklem Subject: Re: nfs slowdown (RELENG_8) References: <2091718059.2982836.1403563319620.JavaMail.root@uoguelph.ca> In-Reply-To: <2091718059.2982836.1403563319620.JavaMail.root@uoguelph.ca> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit X-Scanned-By: MIMEDefang 2.74 Cc: FreeBSD-STABLE Mailing List X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 24 Jun 2014 13:11:04 -0000 On 6/23/2014 6:41 PM, Rick Macklem wrote: >> > I suggest you try disabling TSO on the nics (or setting wsize=32786 > on all mounts). Usually such slowdowns are related to the underlying > network fabric and there are known TSO issues for nics/drivers that > only handle 32 transmit buffers when 64K writes are being used. Thanks Rick, I tried that. Both doing ifconfig em1 -tso and set net.inet.tcp.tso to 0. No impact on these particular boxes. Mount is done /sbin/mount_nfs -o tcp,rsize=32768,wsize=32768,async I looked at the tcpdump between the working and non working servers and they look identical. Tried changing switch ports and the problem does not follow the port, only the server. ---Mike -- ------------------- Mike Tancsa, tel +1 519 651 3400 Sentex Communications, mike@sentex.net Providing Internet services since 1994 www.sentex.net Cambridge, Ontario Canada http://www.tancsa.com/