From owner-freebsd-fs@freebsd.org  Wed Apr  4 20:34:15 2018
Return-Path: <owner-freebsd-fs@freebsd.org>
Delivered-To: freebsd-fs@mailman.ysv.freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1])
 by mailman.ysv.freebsd.org (Postfix) with ESMTP id 4A376F74421
 for <freebsd-fs@mailman.ysv.freebsd.org>; Wed,  4 Apr 2018 20:34:15 +0000 (UTC)
 (envelope-from mike@sentex.net)
Received: from smarthost2.sentex.ca (smarthost2.sentex.ca
 [IPv6:2607:f3e0:80:80::2])
 (using TLSv1 with cipher DHE-RSA-CAMELLIA256-SHA (256/256 bits))
 (Client CN "smarthost.sentex.ca", Issuer "smarthost.sentex.ca" (not verified))
 by mx1.freebsd.org (Postfix) with ESMTPS id D541972622
 for <freebsd-fs@freebsd.org>; Wed,  4 Apr 2018 20:34:14 +0000 (UTC)
 (envelope-from mike@sentex.net)
Received: from lava.sentex.ca (lava.sentex.ca [IPv6:2607:f3e0:0:5::11])
 by smarthost2.sentex.ca (8.15.2/8.15.2) with ESMTPS id w34KYEOr019252
 (version=TLSv1 cipher=DHE-RSA-CAMELLIA256-SHA bits=256 verify=NO)
 for <freebsd-fs@freebsd.org>; Wed, 4 Apr 2018 16:34:14 -0400 (EDT)
 (envelope-from mike@sentex.net)
Received: from [192.168.43.26] (saphire3.sentex.ca [192.168.43.26])
 by lava.sentex.ca (8.15.2/8.15.2) with ESMTP id w34KYBAd017296;
 Wed, 4 Apr 2018 16:34:12 -0400 (EDT) (envelope-from mike@sentex.net)
Subject: Re: Linux NFS client and FreeBSD server strangeness
To: "Russell L. Carter" <rcarter@pinyon.org>
Cc: "freebsd-fs@freebsd.org" <freebsd-fs@freebsd.org>
References: <369fab06-6213-ba87-cc66-c9829e8a76a0@sentex.net>
 <6ca61caa-f4a9-68e4-32d9-6142e175e09b@pinyon.org>
From: Mike Tancsa <mike@sentex.net>
Organization: Sentex Communications
Message-ID: <2df965b6-9d39-2474-da22-5ed53756c467@sentex.net>
Date: Wed, 4 Apr 2018 16:34:12 -0400
User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:52.0) Gecko/20100101
 Thunderbird/52.6.0
MIME-Version: 1.0
In-Reply-To: <6ca61caa-f4a9-68e4-32d9-6142e175e09b@pinyon.org>
Content-Type: text/plain; charset=utf-8
Content-Language: en-US
Content-Transfer-Encoding: 8bit
X-Scanned-By: MIMEDefang 2.78
X-BeenThere: freebsd-fs@freebsd.org
X-Mailman-Version: 2.1.25
Precedence: list
List-Id: Filesystems <freebsd-fs.freebsd.org>
List-Unsubscribe: <https://lists.freebsd.org/mailman/options/freebsd-fs>,
 <mailto:freebsd-fs-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-fs/>
List-Post: <mailto:freebsd-fs@freebsd.org>
List-Help: <mailto:freebsd-fs-request@freebsd.org?subject=help>
List-Subscribe: <https://lists.freebsd.org/mailman/listinfo/freebsd-fs>,
 <mailto:freebsd-fs-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Wed, 04 Apr 2018 20:34:15 -0000

On 4/4/2018 4:20 PM, Russell L. Carter wrote:
> # NFS client sux0rs w/o:
> net.inet.tcp.tso=0
> 
> A caveat is I use NFS V4.1, though.

Thanks, I do have tso enabled the the Chelsio, but it doesnt seem to be
in use according to the stats as the counters are zero

net.inet.tcp.tso: 1
hw.hn.tso_maxlen: 65535
hw.vtnet.tso_disable: 0
dev.cxl.0.txq.7.tso_wrs: 0
dev.cxl.0.txq.6.tso_wrs: 0
dev.cxl.0.txq.5.tso_wrs: 0
dev.cxl.0.txq.4.tso_wrs: 0
dev.cxl.0.txq.3.tso_wrs: 0
dev.cxl.0.txq.2.tso_wrs: 0
dev.cxl.0.txq.1.tso_wrs: 0
dev.cxl.0.txq.0.tso_wrs: 0
dev.igb.1.mac_stats.tso_ctx_fail: 0
dev.igb.1.mac_stats.tso_txd: 0
dev.igb.0.mac_stats.tso_ctx_fail: 0
dev.igb.0.mac_stats.tso_txd: 0
# sysctl -ad dev.cxl.0.txq.4.tso_wrs
dev.cxl.0.txq.4.tso_wrs: # of TSO work requests