From nobody Mon Jan 6 04:34:06 2025 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4YRM7B4mJFz5jssL for ; Mon, 06 Jan 2025 04:45:26 +0000 (UTC) (envelope-from pmc@citylink.dinoex.sub.org) Received: from uucp.dinoex.org (uucp.dinoex.org [IPv6:2a0b:f840::12]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "uucp.dinoex.sub.de", Issuer "R11" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4YRM786TFtz534g for ; Mon, 6 Jan 2025 04:45:24 +0000 (UTC) (envelope-from pmc@citylink.dinoex.sub.org) Authentication-Results: mx1.freebsd.org; dkim=none; spf=pass (mx1.freebsd.org: domain of pmc@citylink.dinoex.sub.org designates 2a0b:f840::12 as permitted sender) smtp.mailfrom=pmc@citylink.dinoex.sub.org; dmarc=none; arc=pass ("uucp.dinoex.org:s=M20221114:i=1") Received: from uucp.dinoex.org (uucp.dinoex.org [IPv6:2a0b:f840:0:0:0:0:0:12]) by uucp.dinoex.org (8.18.1/8.18.1) with ESMTPS id 5064j6Vb010077 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NO) for ; Mon, 6 Jan 2025 05:45:06 +0100 (CET) (envelope-from pmc@citylink.dinoex.sub.org) ARC-Seal: i=1; a=rsa-sha256; d=uucp.dinoex.org; s=M20221114; t=1736138709; cv=none; b=gNYrbt7kthB0ZhZRInxq5gZIXcMuXGGz5BJgVqNsnrfa5guws6pGw6TjnEu4/pVTS7sPbNEk1MwDVD0KbsGwILwb67q2MX7vZ+nLltja+aFX7j9Pyx+m882fXfVbDMnH1dbUSiSUAXmp5jnIRIYwDeeSiaCcQNi8iMIVBNP2fk4= ARC-Message-Signature: i=1; a=rsa-sha256; d=uucp.dinoex.org; s=M20221114; t=1736138709; c=relaxed/simple; bh=5rKiu2mMmkdMs0rRV/NG/+zcP7G5XxmT+/Y/xdd44PY=; h=Received:Received:Received:Received:X-Authentication-Warning:Date: From:To:Subject:Message-ID:MIME-Version:Content-Type: Content-Disposition:X-Milter:X-Greylist; b=hUAbkQNBKba57G3cY8BKbacIY8SmX6hxNEj7Jj6QGrvTmACtFRjoTj4/WA98+gH+yUPf39zd66aGKPL2dEUdd7BEVkHDX3cuj3mLi4h8OETfLBuINZ6p1zPLWZjmHaua44IPdi99GsFi3l3yZK0hl3cIU548zWKj3pCbOjgKqww= ARC-Authentication-Results: i=1; uucp.dinoex.org X-MDaemon-Deliver-To: Received: (from uucp@localhost) by uucp.dinoex.org (8.18.1/8.18.1/Submit) with UUCP id 5064j6aJ010076 for freebsd-fs@freebsd.org; Mon, 6 Jan 2025 05:45:06 +0100 (CET) (envelope-from pmc@citylink.dinoex.sub.org) Received: from disp.intra.daemon.contact (disp-e.intra.daemon.contact [IPv6:fd00:0:0:0:0:0:0:112]) by admn.intra.daemon.contact (8.18.1/8.18.1) with ESMTPS id 5064a5kM067707 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=OK) for ; Mon, 6 Jan 2025 05:36:05 +0100 (CET) (envelope-from pmc@citylink.dinoex.sub.org) Received: from disp.intra.daemon.contact (localhost [127.0.0.1]) by disp.intra.daemon.contact (8.18.1/8.18.1) with ESMTPS id 5064Y6pw088367 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NO) for ; Mon, 6 Jan 2025 05:34:06 +0100 (CET) (envelope-from pmc@citylink.dinoex.sub.org) Received: (from pmc@localhost) by disp.intra.daemon.contact (8.18.1/8.18.1/Submit) id 5064Y6h2088366 for freebsd-fs@freebsd.org; Mon, 6 Jan 2025 05:34:06 +0100 (CET) (envelope-from pmc@citylink.dinoex.sub.org) X-Authentication-Warning: disp.intra.daemon.contact: pmc set sender to pmc@citylink.dinoex.sub.org using -f Date: Mon, 6 Jan 2025 05:34:06 +0100 From: "Peter 'PMc' Much" To: freebsd-fs@freebsd.org Subject: system stalled, no I/O but 100% CPU from nfs Message-ID: List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@FreeBSD.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline X-Milter: Spamilter (Reciever: uucp.dinoex.org; Sender-ip: 0:0:2a0b:f840::; Sender-helo: uucp.dinoex.org;) X-Greylist: Sender passed SPF test, not delayed by milter-greylist-4.6.4 (uucp.dinoex.org [IPv6:2a0b:f840:0:0:0:0:0:12]); Mon, 06 Jan 2025 05:45:09 +0100 (CET) X-Rspamd-Queue-Id: 4YRM786TFtz534g X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.23 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; ARC_ALLOW(-1.00)[uucp.dinoex.org:s=M20221114:i=1]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.93)[-0.928]; R_SPF_ALLOW(-0.20)[+mx]; MIME_GOOD(-0.10)[text/plain]; MISSING_XM_UA(0.00)[]; DMARC_NA(0.00)[sub.org]; ASN(0.00)[asn:205376, ipnet:2a0b:f840::/32, country:DE]; RCVD_TLS_LAST(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; HAS_XAW(0.00)[]; R_DKIM_NA(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; RCVD_COUNT_FIVE(0.00)[5]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; TO_DN_NONE(0.00)[]; MLMMJ_DEST(0.00)[freebsd-fs@freebsd.org]; MIME_TRACE(0.00)[0:+] Cheers, This doesn't look good. It goes on for hours. What can be done about it? (13.4 client & server) 44 processes: 4 running, 39 sleeping, 1 waiting CPU: 0.4% user, 0.0% nice, 99.6% system, 0.0% interrupt, 0.0% idle Mem: 21M Active, 198M Inact, 1190M Wired, 278M Buf, 3356M Free ARC: 418M Total, 39M MFU, 327M MRU, 128K Anon, 7462K Header, 43M Other 332M Compressed, 804M Uncompressed, 2.42:1 Ratio Swap: 15G Total, 15G Free PID USERNAME THR PRI NICE SIZE RES STATE TIME WCPU COMMAND 417 root 4 52 0 12M 2148K RUN 20:55 99.12% nfscbd 0 root 65 -16 - 0B 1040K swapin 0:17 0.64% kernel 11054 root 1 52 0 18M 7664K RUN 0:04 0.10% bsdtar 11 root 15 -56 - 0B 240K WAIT 0:15 0.05% intr 16 root 1 -16 - 0B 16K - 0:01 0.03% racctd 11062 root 1 20 0 14M 3804K RUN 0:00 0.03% top 7 root 3 -16 - 0B 48K psleep 0:00 0.01% pagedaemon 11056 root 1 20 0 21M 10M select 0:00 0.01% sshd 6 root 1 -16 - 0B 16K - 0:00 0.01% rand_harvest Interface Traffic Peak Total vtnet0 in 5.380 KB/s 9.113 KB/s 781.439 MB out 4.012 KB/s 8.002 KB/s 674.294 MB # nfsstat -zc > /dev/null ; sleep 1 ; nfsstat -c Rpc Counts: Getattr Setattr Lookup Readlink Read Write Create Remove 1 2 5 0 0 0 0 0 Rename Link Symlink Mkdir Rmdir Readdir RdirPlus Access 0 0 0 0 0 1 0 1 Mknod Fsstat Fsinfo PathConf Commit 0 0 0 0 0 Rpc Info: TimedOut Invalid X Replies Retries Requests 0 0 0 0 11 Cache Info: Attr Hits Attr Misses Lkup Hits Lkup Misses BioR Hits BioR Misses BioW Hits BioW Misses 11 1 2 5 0 0 0 0 BioRL Hits BioRL Misses BioD Hits BioD Misses DirE Hits DirE Misses Accs Hits Accs Misses 0 0 1 1 1 0 8 1