From owner-freebsd-fs@freebsd.org Wed Apr 4 19:56:03 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id C861AF71678 for ; Wed, 4 Apr 2018 19:56:03 +0000 (UTC) (envelope-from mike@sentex.net) Received: from smarthost2.sentex.ca (smarthost2.sentex.ca [IPv6:2607:f3e0:80:80::2]) (using TLSv1 with cipher DHE-RSA-CAMELLIA256-SHA (256/256 bits)) (Client CN "smarthost.sentex.ca", Issuer "smarthost.sentex.ca" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 1D6D4706AF for ; Wed, 4 Apr 2018 19:56:03 +0000 (UTC) (envelope-from mike@sentex.net) Received: from lava.sentex.ca (lava.sentex.ca [IPv6:2607:f3e0:0:5::11]) by smarthost2.sentex.ca (8.15.2/8.15.2) with ESMTPS id w34Ju2tu012741 (version=TLSv1 cipher=DHE-RSA-CAMELLIA256-SHA bits=256 verify=NO) for ; Wed, 4 Apr 2018 15:56:02 -0400 (EDT) (envelope-from mike@sentex.net) Received: from [192.168.43.26] (saphire3.sentex.net [192.168.43.26]) by lava.sentex.ca (8.15.2/8.15.2) with ESMTP id w34JtxMr017214; Wed, 4 Apr 2018 15:56:00 -0400 (EDT) (envelope-from mike@sentex.net) Subject: Re: Linux NFS client and FreeBSD server strangeness To: =?UTF-8?Q?Karli_Sj=c3=b6berg?= , freebsd-fs@freebsd.org References: <369fab06-6213-ba87-cc66-c9829e8a76a0@sentex.net> <2019ee5a-5b2b-853d-98c5-a365940d93b5@madpilot.net> From: Mike Tancsa Organization: Sentex Communications Message-ID: Date: Wed, 4 Apr 2018 15:56:00 -0400 User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:52.0) Gecko/20100101 Thunderbird/52.6.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: 8bit X-Scanned-By: MIMEDefang 2.78 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 04 Apr 2018 19:56:03 -0000 On 4/4/2018 3:44 PM, Karli Sjöberg wrote: > > Although I understand it might be difficult for you, it would be interresting to know if a FreeBSD client exhibits the same behaviour. It may be a client problem instead of the server? I am starting to wonder if its the Linux client's (seeming) massive write caching, or the way that dump might sputter out data on linux.... It could be causing a certain edge case where the LINUX's NFS client doesnt bother writing for a while. I do note that the burst is pushing 8-9Gb/s. doing a straight up cat of /dev/zero to a file over NFS is nice and steady and works as expected. FreeBSD dump also works as expected, but then again, the client might have all sorts of different caching rules that are different igb1 Kbps in Kbps out 250.20 16.57 16299.44 441.57 121562.3 3267.12 304158.3 8128.84 205250.2 5485.41 159533.5 4294.59 252426.0 6465.67 59065.87 1587.44 109203.0 2935.75 139746.6 3750.78 167724.0 4735.38 96619.25 2597.97 ---Mike -- ------------------- Mike Tancsa, tel +1 519 651 3400 x203 Sentex Communications, mike@sentex.net Providing Internet services since 1994 www.sentex.net Cambridge, Ontario Canada