Skip site navigation (1)Skip section navigation (2)
Date:      Fri, 15 Nov 2019 08:01:50 +0000
From:      bugzilla-noreply@freebsd.org
To:        bugs@FreeBSD.org
Subject:   [Bug 241980] panic: I/O to pool appears to be hung on vdev
Message-ID:  <bug-241980-227@https.bugs.freebsd.org/bugzilla/>

next in thread | raw e-mail | index | archive | help
https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D241980

            Bug ID: 241980
           Summary: panic: I/O to pool appears to be hung on vdev
           Product: Base System
           Version: 11.3-STABLE
          Hardware: Any
                OS: Any
            Status: New
          Keywords: panic
          Severity: Affects Only Me
          Priority: ---
         Component: kern
          Assignee: bugs@FreeBSD.org
          Reporter: eugen@freebsd.org
                CC: avg@FreeBSD.org, mav@FreeBSD.org

11.2-STABLE/amd64 r344922 paniced with message like: panic: I/O to pool app=
ears
to be hung on vdev

It paniced same way 2 days after upgrade to 11.3-STABLE r354667:
http://www.grosbein.net/freebsd/zpanic.png

Hardware: Dell PowerEdge R640 with 360G RAM, mrsas(4)-supported controller =
PERC
H730/P Mini LSI MegaRAID SAS-3 3108 [Invader]

7 SSD devices, two of them keep FreeBSD installation (distinct boot pool) a=
nd
five others are GELI-encrypted and combined to another (RAIDZ1) pool 'sata'
mentioned on screenshot.

vfs.zfs.arc_max=3D160g

# zpool status -v sata
  pool: sata
 state: ONLINE
  scan: resilvered 58,0G in 0 days 00:08:02 with 0 errors on Wed Mar 13
21:34:28 2019
config:

        NAME         STATE     READ WRITE CKSUM
        sata         ONLINE       0     0     0
          raidz1-0   ONLINE       0     0     0
            da2.eli  ONLINE       0     0     0
            da3.eli  ONLINE       0     0     0
            da4.eli  ONLINE       0     0     0
            da5.eli  ONLINE       0     0     0
            da6.eli  ONLINE       0     0     0
        logs
          raid/r0s3  ONLINE       0     0     0
        cache
          raid/r1    ONLINE       0     0     0

errors: No known data errors

SSD devices da0 and da1 are combined with GEOM_RAID array having 3 volumes:
mirrored boot volume /dev/raid/r0 spans over beginning of both devices, has=
 MBR
partitioning and keeps non-dedundant ZFS boot pool "os" as /dev/raid/r0s2 w=
hile
/dev/raid/r0s1 is swap space and /dev/raid/r0s3 acts as ZFS Log device for
"sata" pool shown above. The tail of da0 SSD (/dev/raid/r1) is used as ZFS
Cache (L2ARC) for "sata" pool and the tail of da1 (/dev/raid/r2) is unused
(reserved).

# gpart show
=3D>       63  448790465  raid/r0  MBR  (214G)
         63        441           - free -  (221K)
        504  134217728        1  freebsd  (64G)
  134218232  104857600        2  freebsd  [active]  (50G)
  239075832  209714696        3  freebsd  (100G)
# graid list
Geom name: Promise
State: OPTIMAL
Metadata: Promise
Providers:
1. Name: raid/r1
   Mediasize: 250256121856 (233G)
   Sectorsize: 512
   Stripesize: 131072
   Stripeoffset: 0
   Mode: r1w1e1
   Subdisks: da0 (ACTIVE)
   Dirty: Yes
   State: OPTIMAL
   Strip: 131072
   Components: 1
   Transformation: CONCAT
   RAIDLevel: RAID0
   Label: r1
   descr: Promise RAID0 volume
2. Name: raid/r0
   Mediasize: 229780750336 (214G)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r3w3e6
   Subdisks: da0 (ACTIVE), da1 (ACTIVE)
   Dirty: Yes
   State: OPTIMAL
   Strip: 131072
   Components: 2
   Transformation: RAID1
   RAIDLevel: RAID1
   Label: r0
   descr: Promise RAID1 volume
3. Name: raid/r2
   Mediasize: 250256121856 (233G)
   Sectorsize: 512
   Stripesize: 131072
   Stripeoffset: 0
   Mode: r0w0e0
   Subdisks: da1 (ACTIVE)
   Dirty: No
   State: OPTIMAL
   Strip: 131072
   Components: 1
   Transformation: CONCAT
   RAIDLevel: RAID0
   Label: r2
   descr: Promise RAID0 volume
Consumers:
1. Name: da0
   Mediasize: 480103981056 (447G)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r1w1e1
   ReadErrors: 0
   Subdisks: r1(r1):0@229780750336, r0(r0):0@0
   State: ACTIVE (ACTIVE, ACTIVE)
2. Name: da1
   Mediasize: 480103981056 (447G)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r1w1e1
   ReadErrors: 0
   Subdisks: r0(r0):1@0, r2(r2):0@229780750336
   State: ACTIVE (ACTIVE, ACTIVE)

>From dmesg.boot:

AVAGO MegaRAID SAS FreeBSD mrsas driver version: 07.709.04.00-fbsd
mrsas0: <AVAGO Invader SAS Controller> port 0x4000-0x40ff mem
0xa0c00000-0xa0c0ffff,0xa0b00000-0xa0bfffff irq 32 at device 0.0 numa-domai=
n 0
on pci5
mrsas0: FW now in Ready state
mrsas0: Using MSI-X with 32 number of vectors
mrsas0: FW supports <96> MSIX vector,Online CPU 32 Current MSIX <32>
mrsas0: max sge: 0x46, max chain frame size: 0x400, max fw cmd: 0x39f
mrsas0: Issuing IOC INIT command to FW.
mrsas0: IOC INIT response received from FW.
mrsas0: System PD created target ID: 0x0
mrsas0: System PD created target ID: 0x1
mrsas0: System PD created target ID: 0x2
mrsas0: System PD created target ID: 0x3
mrsas0: System PD created target ID: 0x4
mrsas0: System PD created target ID: 0x5
mrsas0: System PD created target ID: 0x6
mrsas0: FW supports: UnevenSpanSupport=3D1
mrsas0: max_fw_cmds: 927  max_scsi_cmds: 911
mrsas0: MSI-x interrupts setup success
mrsas0: mrsas_ocr_thread

da5 at mrsas0 bus 1 scbus17 target 5 lun 0
da2 at mrsas0 bus 1 scbus17 target 2 lun 0
da3 at mrsas0 bus 1 scbus17 target 3 lun 0
da4 at mrsas0 bus 1 scbus17 target 4 lun 0
da4: <ATA Micron_5200_MTFD U404> Fixed Direct Access SPC-4 SCSI device
da4: Serial Number 18531FF58A9B
da4: 150.000MB/s transfers
da4: 3662830MB (7501476528 512 byte sectors)
da2: <ATA Micron_5200_MTFD U404> Fixed Direct Access SPC-4 SCSI device
da2: Serial Number 18532039E29C
da2: 150.000MB/s transfers
da2: 3662830MB (7501476528 512 byte sectors)
da3: <ATA Micron_5200_MTFD U404> Fixed Direct Access SPC-4 SCSI device
da3: Serial Number 18531FF58CF6
da3: 150.000MB/s transfers
da3: 3662830MB (7501476528 512 byte sectors)
da5: <ATA Micron_5200_MTFD U404> Fixed Direct Access SPC-4 SCSI device
da5: Serial Number 18531FF586C2
da5: 150.000MB/s transfers
da5: 3662830MB (7501476528 512 byte sectors)
da6 at mrsas0 bus 1 scbus17 target 6 lun 0
da6: <ATA XA3840LE10063 00ZU> Fixed Direct Access SPC-4 SCSI device
da6: Serial Number HKT01DYR
da6: 150.000MB/s transfers
da6: 3662830MB (7501476528 512 byte sectors)

--=20
You are receiving this mail because:
You are the assignee for the bug.=



Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?bug-241980-227>