Skip site navigation (1)Skip section navigation (2)
Date:      Tue, 16 Jan 2024 09:48:43 -0500
From:      mike tancsa <mike@sentex.net>
To:        FreeBSD-STABLE Mailing List <freebsd-stable@freebsd.org>
Subject:   tracking down i386 mount issue between Aug 2023 and now-- RELENG_13
Message-ID:  <1c266591-11b0-4f75-addf-6a02469441a8@sentex.net>

next in thread | raw e-mail | index | archive | help
Not sure exactly where to start, but I noticed this recently on an i386 
nanobsd image running on old PC Engines Alix devices that had been rock 
solid for years. We have a few dozen in the field running with RELENG_13 
from Aug that have been very stable with STABLE over the years.  
However, somewhere between Aug 2023 and now I am getting some lock ups 
that are difficult to diagnose as the devices are remote.  I did manage 
to find one odd thing on a local test unit where a remount of a backup 
partition is hung.

# ps -auxwwwwp 3443
USER  PID %CPU %MEM  VSZ  RSS TT  STAT STARTED     TIME COMMAND
root 3443  3.3  0.9 4708 2320  -  D<   20:18   34:55.20 /sbin/mount -ur 
/dev/ada0s4 /logs

I dont have truss on the box to attach to the process and ktrace doesnt 
seem to show anything either.  Does this sort of hang ring a bell for 
anyone ? Looking back at the git logs, a coarse search for anything to 
do with mount, doesnt come up with much (2 below).   Also since then a 
new version of clang so not quite where to start.

Any guidance appreciated. Testing is difficult as the hang doesnt always 
happen -- sometimes within a day, sometimes 5 days.  ssh is usually 
borked as well as some processes.  I have a scaled down telegraf agent 
collecting some basic stats, and the cpu is pegged at 100%. These are 
single core devices so not sure what is pegging the CPU.  RAM still 
shows some available so it doesnt seem to be memory pressures.


commit 71fceff2480999b3fc921f47ec9adea9eff32041
Author: Andrew Gierth <andrew@tao146.riddles.org.uk>
Date:   Sun Dec 24 14:04:21 2023 +0200

     vfs_domount_update(): correct fsidcmp() usage

     (cherry picked from commit 2a1d50fc12f6e604da834fbaea961d412aae6e85)

and

commit 608ccfc29fb48d8edc59a97382936790c02d27f3
Author: Konstantin Belousov <kib@FreeBSD.org>
Date:   Thu Nov 9 22:18:47 2023 +0200

     vfs_domount_update(): ensure that 'goto end' works

     PR:     274992

     (cherry picked from commit ede4c412b3ea9289ef42c664b01b6b5ff7eac434)




Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?1c266591-11b0-4f75-addf-6a02469441a8>