From nobody Mon Oct 28 23:40:59 2024 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Xcqdq6B8Zz5bvn3 for ; Mon, 28 Oct 2024 23:41:03 +0000 (UTC) (envelope-from void@f-m.fm) Received: from fhigh-a5-smtp.messagingengine.com (fhigh-a5-smtp.messagingengine.com [103.168.172.156]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Xcqdp3ycRz3xR5 for ; Mon, 28 Oct 2024 23:41:02 +0000 (UTC) (envelope-from void@f-m.fm) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=f-m.fm header.s=fm3 header.b="tQkFjY/j"; dkim=pass header.d=messagingengine.com header.s=fm3 header.b="P/hG6/qx"; spf=pass (mx1.freebsd.org: domain of void@f-m.fm designates 103.168.172.156 as permitted sender) smtp.mailfrom=void@f-m.fm; dmarc=pass (policy=none) header.from=f-m.fm Received: from phl-compute-03.internal (phl-compute-03.phl.internal [10.202.2.43]) by mailfhigh.phl.internal (Postfix) with ESMTP id A2ABC114019F for ; Mon, 28 Oct 2024 19:41:01 -0400 (EDT) Received: from phl-mailfrontend-01 ([10.202.2.162]) by phl-compute-03.internal (MEProxy); Mon, 28 Oct 2024 19:41:01 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=f-m.fm; h=cc :content-type:content-type:date:date:from:from:in-reply-to :in-reply-to:message-id:mime-version:references:reply-to:subject :subject:to:to; s=fm3; t=1730158861; x=1730245261; bh=3kQQOq2x0Y hAGeW3ts1B7Uuy9IZdl9X5UYZtctDXdbk=; b=tQkFjY/jMefv8Op5elFcW3e0zo jadR0sI9R4LanS0tVPdnF4Kaab8/QOYBkAYBL+yUOFsObGZPIaELACQDu2w+Gbn9 jiSMXXEnyhESVGwwTUh0iQWOEIBXQMTIXj7DhTidMAh9Xu20RNcKln2RBKM47L7+ Wd0nlAhUJD2/tUh8hZJC5GUSwt2SGxYDlFjdNyL2ObeGrajxc3+McFWPtvxiPfhc Z2wA/uklJYF9wPm771vSi0MS3d9MalItjz1cE5IoPoZWi4+n7OdfxS8sjNTbjgKv cJ+mfRjfhEeCplcB/Q59OlcVRqB8Knk5DNlnB0aOL67aCHo14nDnYItN1nZw== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:content-type:content-type:date:date :feedback-id:feedback-id:from:from:in-reply-to:in-reply-to :message-id:mime-version:references:reply-to:subject:subject:to :to:x-me-proxy:x-me-sender:x-me-sender:x-sasl-enc; s=fm3; t= 1730158861; x=1730245261; bh=3kQQOq2x0YhAGeW3ts1B7Uuy9IZdl9X5UYZ tctDXdbk=; b=P/hG6/qxToy6RrrH86T3FYJCGNceM4VIGduR5qjyS/c8JJORQMd mhQqQcQ6YWi8uIwgh+H5yTkG8YKtJeU7t7wJ4BS4UHZTGWksJHtOn/hfhRqbCrb3 CkLTUNvzYXkVWU2afKdPq05gb/DbKiFPe/mjh+hRwndXQG8KtJwAOvIVMG843Iq8 +i92kHA4bi+g1I+7i7QCaTQGi14/AydOj5Q2dfFZTco+ChiHDgnl0u36OMSrlt9R cy1AimMHHSJQkczfsGkfAUwIzP1VDyREzqwuvUvvTcJtq/WVCSbt/l5Yulh2Gk/T tpSYqesexsMYrcwQchlRTuBYPH+sqZ/vseQ== X-ME-Sender: X-ME-Received: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgeeftddrvdektddgudefucetufdoteggodetrfdotf fvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdggtfgfnhhsuhgsshgtrhhisggvpdfu rfetoffkrfgpnffqhgenuceurghilhhouhhtmecufedttdenucenucfjughrpeffhffvuf fkfhggtggujgesthdtredttddtvdenucfhrhhomhepvhhoihguuceovhhoihgusehfqdhm rdhfmheqnecuggftrfgrthhtvghrnhepkeeluddvlefhieelfefggffhffektdehleelgf dugfdvgeekjeejuddtheehgfeunecuvehluhhsthgvrhfuihiivgeptdenucfrrghrrghm pehmrghilhhfrhhomhepvhhoihgusehfqdhmrdhfmhdpnhgspghrtghpthhtohepuddpmh houggvpehsmhhtphhouhhtpdhrtghpthhtohepfhhrvggvsghsugdqfhhssehfrhgvvggs shgurdhorhhg X-ME-Proxy: Feedback-ID: i2541463c:Fastmail Received: by mail.messagingengine.com (Postfix) with ESMTPA for ; Mon, 28 Oct 2024 19:41:01 -0400 (EDT) Date: Mon, 28 Oct 2024 23:40:59 +0000 From: void To: freebsd-fs@freebsd.org Subject: Re: improving nfs client & server performance Message-ID: Mail-Followup-To: freebsd-fs@freebsd.org References: List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@FreeBSD.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii; format=flowed Content-Disposition: inline In-Reply-To: X-Spamd-Result: default: False [-3.30 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.70)[-0.704]; MID_RHS_NOT_FQDN(0.50)[]; DMARC_POLICY_ALLOW(-0.50)[f-m.fm,none]; R_DKIM_ALLOW(-0.20)[f-m.fm:s=fm3,messagingengine.com:s=fm3]; R_SPF_ALLOW(-0.20)[+ip4:103.168.172.128/27]; MIME_GOOD(-0.10)[text/plain]; RCVD_IN_DNSWL_LOW(-0.10)[103.168.172.156:from]; FREEMAIL_FROM(0.00)[f-m.fm]; RCVD_TLS_LAST(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_COUNT_THREE(0.00)[3]; RCPT_COUNT_ONE(0.00)[1]; ARC_NA(0.00)[]; FROM_HAS_DN(0.00)[]; FREEMAIL_ENVFROM(0.00)[f-m.fm]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; TO_DN_NONE(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; DKIM_TRACE(0.00)[f-m.fm:+,messagingengine.com:+]; MLMMJ_DEST(0.00)[freebsd-fs@freebsd.org]; MISSING_XM_UA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; ASN(0.00)[asn:209242, ipnet:103.168.172.0/24, country:US]; DWL_DNSWL_NONE(0.00)[messagingengine.com:dkim] X-Rspamd-Queue-Id: 4Xcqdp3ycRz3xR5 X-Spamd-Bar: --- On Mon, Oct 21, 2024 at 03:52:12PM -0700, Rick Macklem wrote: (stuff) Hi Rick I tried the various things suggested and did notice a performance improvement. What I'm seeing though right now is the following, in a different context [1] login[some_pid] Getting pipebuf resource limit: Invalid argument [1] context is root creating a tar on a nfs mount. The tar is huge, over a Tb, as it's backing up homedirs [2]. It seems to be running ok though. For the mment. But I'm not seeing anything remotely approaching maximums in netstat -m, and thought with root doing the backup its resources would be pretty much unlimited. It's not spamming the console though. [2] The SMR hd is showing signs it's ill. Slow everything. Trying to move all the data off there before a (cold) reboot. Thing is with these SMRs (I've had two) it seems nothing much happens in the bad blocks sense. it just gets *very* *slow*. It's zfs, but single disk, 8Tb. --