Skip site navigation (1)Skip section navigation (2)
Date:      Sun, 1 Dec 2019 10:18:53 +0300
From:      Ivan Safonov <isafonov@me.com>
To:        freebsd-fs@freebsd.org
Subject:   zfs panic: solaris assert
Message-ID:  <78272047-A0E6-4EE0-B3B3-1F927D29EC12@me.com>
References:  <C5344C23-2C22-4F97-B555-48A7CCC682D9@me.com>

next in thread | previous in thread | raw e-mail | index | archive | help
Hi there
I have a small home server with a ZFS pool created in FreeBSD 11.1 and =
updated to 12.0 -> 12.1. A few days ago, the server rebooted with panic

panic: solaris assert: size <=3D (1ULL << 24) (0x1401000 <=3D =
0x1000000), file: =
/usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/abd.c, line: 296
cpuid =3D 3
time =3D 1574981747
KDB: stack backtrace:
#0 0xffffffff80c1d297 at kdb_backtrace+0x67
#1 0xffffffff80bd05cd at vpanic+0x19d
#2 0xffffffff80bd0423 at panic+0x43
#3 0xffffffff82a6e22c at assfail3+0x2c
#4 0xffffffff8284a8f7 at abd_alloc+0x67
#5 0xffffffff82850319 at arc_hdr_alloc_pabd+0x99
#6 0xffffffff8284d554 at arc_hdr_alloc+0x124
#7 0xffffffff8284ef13 at arc_read+0x243
#8 0xffffffff8287942d at traverse_prefetch_metadata+0xbd
#9 0xffffffff828788cc at traverse_visitbp+0x3dc
#10 0xffffffff82878930 at traverse_visitbp+0x440
#11 0xffffffff82878930 at traverse_visitbp+0x440
#12 0xffffffff82878930 at traverse_visitbp+0x440
#13 0xffffffff82878930 at traverse_visitbp+0x440
#14 0xffffffff82879513 at traverse_dnode+0xd3
#15 0xffffffff82878c30 at traverse_visitbp+0x740
#16 0xffffffff828780a7 at traverse_impl+0x317
#17 0xffffffff8287837c at traverse_pool+0x14c
Uptime: 1m0s

I tested the memory and drives and they look OK. Then I installed =
FreeBSD 12.1 on a USB drive
zpool import

   pool: zroot
     id: 5722521002676846505
  state: ONLINE
 status: Some supported features are not enabled on the pool.
 action: The pool can be imported using its name or numeric identifier, =
though
        some features will not be available without an explicit 'zpool =
upgrade'.
 config:

        zroot                 ONLINE
          raidz1-0            ONLINE
            gpt/D0-33GTM0VGS  ONLINE
            gpt/D1-Z1E3Q7KP   ONLINE
            gpt/D2-Z4ZARG1V   ONLINE

I tried to import the pool but got the same panic
zpool import -o readonly -f -F -N -R /pool zroot

zdb -ue zroot

Uberblock:
    magic =3D 0000000000bab10c
    version =3D 5000
    txg =3D 11751485
    guid_sum =3D 14638353410936556308
    timestamp =3D 1574776136 UTC =3D Tue Nov 26 16:48:56 2019
    checkpoint_txg =3D 0

zdb -l /dev/gpt/D0-33GTM0VGS
Code:
------------------------------------
LABEL 0
------------------------------------
    version: 5000
    name: 'zroot'
    state: 0
    txg: 11750848
    pool_guid: 5722521002676846505
    hostid: 1550328424
    hostname: ''
    top_guid: 10071190156355008053
    guid: 4016597551985842896
    vdev_children: 1
    vdev_tree:
        type: 'raidz'
        id: 0
        guid: 10071190156355008053
        nparity: 1
        metaslab_array: 39
        metaslab_shift: 35
        ashift: 12
        asize: 5997325713408
        is_log: 0
        create_txg: 4
        children[0]:
            type: 'disk'
            id: 0
            guid: 4016597551985842896
            path: '/dev/gpt/D0-33GTM0VGS'
            whole_disk: 1
            DTL: 70406
            create_txg: 4
        children[1]:
            type: 'disk'
            id: 1
            guid: 18015782253695591313
            path: '/dev/gpt/D1-Z1E3Q7KP'
            whole_disk: 1
            DTL: 70405
            create_txg: 4
        children[2]:
            type: 'disk'
            id: 2
            guid: 13705750593642370773
            path: '/dev/gpt/D2-Z4ZARG1V'
            whole_disk: 1
            DTL: 70323
            create_txg: 4
    features_for_read:
        com.delphix:hole_birth
        com.delphix:embedded_data
------------------------------------
LABEL 1
------------------------------------
    version: 5000
    name: 'zroot'
    state: 0
    txg: 11750848
    pool_guid: 5722521002676846505
    hostid: 1550328424
    hostname: ''
    top_guid: 10071190156355008053
    guid: 4016597551985842896
    vdev_children: 1
    vdev_tree:
        type: 'raidz'
        id: 0
        guid: 10071190156355008053
        nparity: 1
        metaslab_array: 39
        metaslab_shift: 35
        ashift: 12
        asize: 5997325713408
        is_log: 0
        create_txg: 4
        children[0]:
            type: 'disk'
            id: 0
            guid: 4016597551985842896
            path: '/dev/gpt/D0-33GTM0VGS'
            whole_disk: 1
            DTL: 70406
            create_txg: 4
        children[1]:
            type: 'disk'
            id: 1
            guid: 18015782253695591313
            path: '/dev/gpt/D1-Z1E3Q7KP'
            whole_disk: 1
            DTL: 70405
            create_txg: 4
        children[2]:
            type: 'disk'
            id: 2
            guid: 13705750593642370773
            path: '/dev/gpt/D2-Z4ZARG1V'
            whole_disk: 1
            DTL: 70323
            create_txg: 4
    features_for_read:
        com.delphix:hole_birth
        com.delphix:embedded_data
------------------------------------
LABEL 2
------------------------------------
    version: 5000
    name: 'zroot'
    state: 0
    txg: 11750848
    pool_guid: 5722521002676846505
    hostid: 1550328424
    hostname: ''
    top_guid: 10071190156355008053
    guid: 4016597551985842896
    vdev_children: 1
    vdev_tree:
        type: 'raidz'
        id: 0
        guid: 10071190156355008053
        nparity: 1
        metaslab_array: 39
        metaslab_shift: 35
        ashift: 12
        asize: 5997325713408
        is_log: 0
        create_txg: 4
        children[0]:
            type: 'disk'
            id: 0
            guid: 4016597551985842896
            path: '/dev/gpt/D0-33GTM0VGS'
            whole_disk: 1
            DTL: 70406
            create_txg: 4
        children[1]:
            type: 'disk'
            id: 1
            guid: 18015782253695591313
            path: '/dev/gpt/D1-Z1E3Q7KP'
            whole_disk: 1
            DTL: 70405
            create_txg: 4
        children[2]:
            type: 'disk'
            id: 2
            guid: 13705750593642370773
            path: '/dev/gpt/D2-Z4ZARG1V'
            whole_disk: 1
            DTL: 70323
            create_txg: 4
    features_for_read:
        com.delphix:hole_birth
        com.delphix:embedded_data
------------------------------------
LABEL 3
------------------------------------
    version: 5000
    name: 'zroot'
    state: 0
    txg: 11750848
    pool_guid: 5722521002676846505
    hostid: 1550328424
    hostname: ''
    top_guid: 10071190156355008053
    guid: 4016597551985842896
    vdev_children: 1
    vdev_tree:
        type: 'raidz'
        id: 0
        guid: 10071190156355008053
        nparity: 1
        metaslab_array: 39
        metaslab_shift: 35
        ashift: 12
        asize: 5997325713408
        is_log: 0
        create_txg: 4
        children[0]:
            type: 'disk'
            id: 0
            guid: 4016597551985842896
            path: '/dev/gpt/D0-33GTM0VGS'
            whole_disk: 1
            DTL: 70406
            create_txg: 4
        children[1]:
            type: 'disk'
            id: 1
            guid: 18015782253695591313
            path: '/dev/gpt/D1-Z1E3Q7KP'
            whole_disk: 1
            DTL: 70405
            create_txg: 4
        children[2]:
            type: 'disk'
            id: 2
            guid: 13705750593642370773
            path: '/dev/gpt/D2-Z4ZARG1V'
            whole_disk: 1
            DTL: 70323
            create_txg: 4
    features_for_read:
        com.delphix:hole_birth
        com.delphix:embedded_data

zdb -AAA -F -X zroot

...
                            capacity   operations   bandwidth  ---- =
errors ----
description                used avail  read write  read write  read =
write cksum
zroot                     1.47T 3.97T    82     0  351K     0     0     =
0    30
  raidz1                  1.47T 3.97T    82     0  351K     0     0     =
0   121
    /dev/gpt/D0-33GTM0VGS                27     0  146K     0     0     =
0     0
    /dev/gpt/D1-Z1E3Q7KP                 27     0  146K     0     0     =
0     0
    /dev/gpt/D2-Z4ZARG1V                 27     0  146K     0     0     =
0     0
    ...

Is it possible to somehow restore the pool or data?=



Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?78272047-A0E6-4EE0-B3B3-1F927D29EC12>