Date: Thu, 26 Jun 2025 08:15:02 -0600 From: Alan Somers <asomers@freebsd.org> To: freebsd-fs@freebsd.org, freebsd-current@freebsd.org Subject: Re: device in raidz2 array only partially recognised by the OS Message-ID: <CAOtMX2gRtp5KJEwb2pk=5Ob5LiSO9b2Og5JoiwkHm_-_j-095w@mail.gmail.com> In-Reply-To: <aF1UtxMn6v03JC9w@int21h>
index | next in thread | previous in thread | raw e-mail
[-- Attachment #1 --] On Thu, Jun 26, 2025 at 8:10 AM void <void@f-m.fm> wrote: > (posted to both -current and -fs because am unsure which is more relevant) > > On a machine running GENERIC-NODEBUG amd64 1500026 1500026 FreeBSD > 15.0-CURRENT #0 main- > n273486-88dd0550920c, a disk in the raidz2 array dropped out and is no > longer recognised by > the OS in terms of zfs but *is* recognised by smartctl. I've tried > onlining the device but > it says it can't find /dev/da7. The array is connected in HBA mode to a > HP Smart Array P440 Controller. The disk dropped out of the array after > an extended power outage. > > zpool status: > > NAME STATE READ WRITE CKSUM > data DEGRADED 0 0 0 > raidz2-0 DEGRADED 0 0 0 > da1 ONLINE 0 0 0 > da2 ONLINE 0 0 0 > da3 ONLINE 0 0 0 > da4 ONLINE 0 0 0 > da5 ONLINE 0 0 0 > da6 ONLINE 0 0 0 > 114031416858974629 UNAVAIL 0 0 0 was /dev/da7 > > da0 is the boot disk and is not part of the array. It's not a root-on-zfs. > > smartctl: > > doas smartctl -x -d cciss,7 /dev/ciss0 > > smartctl 7.4 2023-08-01 r5530 [FreeBSD 15.0-CURRENT amd64] (local build) > Copyright (C) 2002-23, Bruce Allen, Christian Franke, > www.smartmontools.org > > === START OF INFORMATION SECTION === > Vendor: SEAGATE > Product: ST4000NM0023 > Revision: A001 > Compliance: SPC-4 > User Capacity: 4,000,787,030,016 bytes [4.00 TB] > Logical block size: 512 bytes > LU is fully provisioned > Rotation Rate: 7200 rpm > Form Factor: 3.5 inches > > (etc etc) > > There are no relevant errors in the iLo. How can I make the zpool see the > disk again? Does the /dev/da7 device node exist? If not, does "camcontrol rescan all" bring it back? If it does exist, can it be read from? Does smartctl report any errors? Does "zdb -l /dev/da7" show a ZFS label? [-- Attachment #2 --] <div dir="ltr"><div class="gmail_quote gmail_quote_container"><div dir="ltr" class="gmail_attr">On Thu, Jun 26, 2025 at 8:10 AM void <<a href="mailto:void@f-m.fm">void@f-m.fm</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">(posted to both -current and -fs because am unsure which is more relevant)<br> <br> On a machine running GENERIC-NODEBUG amd64 1500026 1500026 FreeBSD 15.0-CURRENT #0 main-<br> n273486-88dd0550920c, a disk in the raidz2 array dropped out and is no longer recognised by<br> the OS in terms of zfs but *is* recognised by smartctl. I've tried onlining the device but<br> it says it can't find /dev/da7. The array is connected in HBA mode to a <br> HP Smart Array P440 Controller. The disk dropped out of the array after <br> an extended power outage.<br> <br> zpool status:<br> <br> NAME STATE READ WRITE CKSUM<br> data DEGRADED 0 0 0<br> raidz2-0 DEGRADED 0 0 0<br> da1 ONLINE 0 0 0<br> da2 ONLINE 0 0 0<br> da3 ONLINE 0 0 0<br> da4 ONLINE 0 0 0<br> da5 ONLINE 0 0 0<br> da6 ONLINE 0 0 0<br> 114031416858974629 UNAVAIL 0 0 0 was /dev/da7<br> <br> da0 is the boot disk and is not part of the array. It's not a root-on-zfs.<br> <br> smartctl:<br> <br> doas smartctl -x -d cciss,7 /dev/ciss0<br> <br> smartctl 7.4 2023-08-01 r5530 [FreeBSD 15.0-CURRENT amd64] (local build)<br> Copyright (C) 2002-23, Bruce Allen, Christian Franke, <a href="http://www.smartmontools.org" rel="noreferrer" target="_blank">www.smartmontools.org</a><br> <br> === START OF INFORMATION SECTION ===<br> Vendor: SEAGATE<br> Product: ST4000NM0023<br> Revision: A001<br> Compliance: SPC-4<br> User Capacity: 4,000,787,030,016 bytes [4.00 TB]<br> Logical block size: 512 bytes<br> LU is fully provisioned<br> Rotation Rate: 7200 rpm<br> Form Factor: 3.5 inches<br> <br> (etc etc)<br> <br> There are no relevant errors in the iLo. How can I make the zpool see the disk again?</blockquote><div><br></div><div>Does the /dev/da7 device node exist? If not, does "camcontrol rescan all" bring it back? If it does exist, can it be read from? Does smartctl report any errors? Does "zdb -l /dev/da7" show a ZFS label? <br></div></div></div>help
Want to link to this message? Use this
URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?CAOtMX2gRtp5KJEwb2pk=5Ob5LiSO9b2Og5JoiwkHm_-_j-095w>