Skip site navigation (1)Skip section navigation (2)
Date:      Fri, 13 Jul 2018 13:12:27 +0200
From:      Alexander Leidinger <Alexander@leidinger.net>
To:        freebsd-fs@freebsd.org
Subject:   solaris assert triggered after panic in ZFS at mount time
Message-ID:  <20180713131227.Horde.S0gjPFGdZFb-68KklzQBXig@webmail.leidinger.net>

next in thread | raw e-mail | index | archive | help
This message is in MIME format and has been PGP signed.

--=_rELKE2e2SIl2I_KIBI1orEV
Content-Type: text/plain; charset=utf-8; format=flowed; DelSp=Yes
Content-Disposition: inline
Content-Transfer-Encoding: quoted-printable

Hi,

This is with r336194.

I have a dataset which panics the machine at mount time (during reboot=20=
=20
after=20a panic):
---snip---
panic: solaris assert: dmu_object_claim(zfsvfs->z_os, obj,=20=20
DMU_OT_PLAIN_FILE_CONTENTS,=200, obj_type, bonuslen, tx) =3D=3D 0 (0x11 =3D=
=3D=20=20
0x0),=20file:=20=20
/usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_znode.c,=20=20
line:=20819
cpuid =3D 2
time =3D 1531477050
KDB: stack backtrace:
db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe009ab62=
a00
vpanic() at vpanic+0x1a3/frame 0xfffffe009ab62a60
panic() at panic+0x43/frame 0xfffffe009ab62ac0
assfail3() at assfail3+0x2c/frame 0xfffffe009ab62ae0
zfs_mknode() at zfs_mknode+0x1a1/frame 0xfffffe009ab62f30
zfs_freebsd_create() at zfs_freebsd_create+0x56f/frame 0xfffffe009ab63000
VOP_CREATE_APV() at VOP_CREATE_APV+0xd3/frame 0xfffffe009ab63030
zfs_replay_create() at zfs_replay_create+0x60b/frame 0xfffffe009ab63250
zil_replay_log_record() at zil_replay_log_record+0x215/frame=20=20
0xfffffe009ab633a0
zil_parse()=20at zil_parse+0x2b5/frame 0xfffffe009ab635a0
zil_replay() at zil_replay+0xec/frame 0xfffffe009ab63600
zfsvfs_setup() at zfsvfs_setup+0xb5/frame 0xfffffe009ab63630
zfs_mount() at zfs_mount+0x72f/frame 0xfffffe009ab637c0
vfs_domount() at vfs_domount+0x734/frame 0xfffffe009ab639e0
vfs_donmount() at vfs_donmount+0x807/frame 0xfffffe009ab63a90
sys_nmount() at sys_nmount+0x50/frame 0xfffffe009ab63ac0
amd64_syscall() at amd64_syscall+0x263/frame 0xfffffe009ab63bf0
fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe009ab63bf0
--- syscall (378, FreeBSD ELF64, sys_nmount), rip =3D 0x800369b3a, rsp =3D=
=20=20
0x7fffffffca98,=20rbp =3D 0x7fffffffcb10 ---


230             __asm("movq %%gs:%1,%0" : "=3Dr" (td)
(kgdb) #0  __curthread () at ./machine/pcpu.h:230
#1  doadump (textdump=3D1) at /usr/src/sys/kern/kern_shutdown.c:366
#2  0xffffffff80485e11 in kern_reboot (howto=3D260)
     at /usr/src/sys/kern/kern_shutdown.c:446
#3  0xffffffff804863f3 in vpanic (fmt=3D<optimized out>, ap=3D0xfffffe009ab=
62aa0)
     at /usr/src/sys/kern/kern_shutdown.c:863
#4  0xffffffff80486443 in panic (fmt=3D<unavailable>)
     at /usr/src/sys/kern/kern_shutdown.c:790
#5  0xffffffff817c524c in assfail3 (a=3D<unavailable>, lv=3D<unavailable>,
     op=3D<unavailable>, rv=3D<unavailable>, f=3D<unavailable>, l=3D<optimi=
zed out>)
     at /usr/src/sys/cddl/compat/opensolaris/kern/opensolaris_cmn_err.c:91
#6  0xffffffff81445641 in zfs_mknode (dzp=3D0xfffff8007644fc60,
     vap=3D0xfffffe009ab630f8, tx=3D0xfffff8019fcbbb00, cr=3D0xfffff8000206=
8000,
     flag=3D0, zpp=3D0xfffffe009ab62fb8, acl_ids=3D0xfffffe009ab62f58)
     at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_znode.c=
:817
#7  0xffffffff81485b1f in zfs_create (
     excl=3D<error reading variable: Cannot access memory at address 0x0>,
     mode=3D<error reading variable: Cannot access memory at address 0x0>,
     dvp=3D<optimized out>, name=3D<optimized out>, vap=3D<optimized out>,
     vpp=3D<optimized out>, cr=3D<optimized out>, td=3D<optimized out>)
     at=20=20
/usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vnops.c:1883
#8=20 zfs_freebsd_create (ap=3D<optimized out>)
     at=20=20
/usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vnops.c:4995
#9=20 0xffffffff807c16f3 in VOP_CREATE_APV (vop=3D<optimized out>,
     a=3D0xfffffe009ab63098) at vnode_if.c:263
#10 0xffffffff8147c4bb in VOP_CREATE (dvp=3D<optimized out>, vpp=3D0x0,
     cnp=3D0xffffffff8082c59a, vap=3D0x1a400000001) at ./vnode_if.h:109
#11 zfs_replay_create (arg1=3D<optimized out>, arg2=3D<optimized out>,
     byteswap=3D<optimized out>)
     at=20=20
/usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_replay.c:505
#12=200xffffffff8144e9d5 in zil_replay_log_record (zilog=3D0xfffff80048f54c=
00,
     lr=3D0xfffffe00c7880000, zra=3D<optimized out>, claim_txg=3D<optimized=
 out>)
     at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zil.c:3243
#13 0xffffffff81449d65 in zil_parse (zilog=3D0xfffff80048f54c00,
     parse_blk_func=3D0xffffffff8144e7b0 <zil_incr_blks>,
     parse_lr_func=3D0xffffffff8144e7c0 <zil_replay_log_record>,
     arg=3D0xfffffe009ab635c0, txg=3D11396685)
     at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zil.c:383
#14 0xffffffff8144e76c in zil_replay (os=3D<optimized out>,
     arg=3D0xfffffe00ab6be000, replay_func=3D0xffffffff8154b9b0=20=20
<zfs_replay_vector>)
=20    at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zil.c:329=
7
#15 0xffffffff81482515 in zfsvfs_setup (zfsvfs=3D0xfffffe00ab6be000, mounti=
ng=3D1)
     at=20=20
/usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vfsops.c:1278
#16=200xffffffff8147fb9f in zfs_domount (vfsp=3D<optimized out>,
     osname=3D<optimized out>)
     at=20=20
/usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vfsops.c:1433
#17=20zfs_mount (vfsp=3D0xfffff80076958000)
     at=20=20
/usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vfsops.c:1915
#18=200xffffffff8054e714 in vfs_domount_first (td=3D<optimized out>,
     fspath=3D<optimized out>, vp=3D<optimized out>, optlist=3D0xfffffe009a=
b63a28,
     vfsp=3D<optimized out>, fsflags=3D<optimized out>)
     at /usr/src/sys/kern/vfs_mount.c:892
#19 vfs_domount (td=3D0xfffff8004ebcb000, fstype=3D<optimized out>,
     fspath=3D<optimized out>, fsflags=3D<optimized out>,
(kgdb) up 6
#6  0xffffffff81445641 in zfs_mknode (dzp=3D0xfffff8007644fc60,=20=20
vap=3D0xfffffe009ab630f8, tx=3D0xfffff8019fcbbb00,
     cr=3D0xfffff80002068000, flag=3D0, zpp=3D0xfffffe009ab62fb8,=20=20
acl_ids=3D0xfffffe009ab62f58)
     at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_znode.c=
:817
817                             VERIFY0(dmu_object_claim(zfsvfs->z_os, obj,
(kgdb) list
812                                 zfsvfs->z_norm, DMU_OT_DIRECTORY_CONTEN=
TS,
813                                 obj_type, bonuslen, tx);
814                     }
815             } else {
816                     if (zfsvfs->z_replay) {
817                             VERIFY0(dmu_object_claim(zfsvfs->z_os, obj,
818                                 DMU_OT_PLAIN_FILE_CONTENTS, 0,
819                                 obj_type, bonuslen, tx));
820                     } else {
821                             obj =3D dmu_object_alloc(zfsvfs->z_os,
(kgdb) print obj
$2 =3D 16393
(kgdb) print zfsvfs
$3 =3D (zfsvfs_t *) 0xfffffe00ab6be000
(kgdb) print obj_type
$4 =3D DMU_OT_SA
(kgdb) print bonuslen
$5 =3D <optimized out>
(kgdb) print tx
$6 =3D (dmu_tx_t *) 0xfffff8019fcbbb00
---snip---

Which options do I have to fix this (instead of destroying it)?
I tried already this: zdb -AAFdd mpool/iocage/jails/www-f/root/usr
but this leads to immediate panic.

Bye,
Alexander.

--=20
http://www.Leidinger.net=20Alexander@Leidinger.net: PGP 0x8F31830F9F2772BF
http://www.FreeBSD.org    netchild@FreeBSD.org  : PGP 0x8F31830F9F2772BF

--=_rELKE2e2SIl2I_KIBI1orEV
Content-Type: application/pgp-signature
Content-Description: Digitale PGP-Signatur
Content-Disposition: inline

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1

iQIcBAABAgAGBQJbSIkbAAoJEKrxQhqFIICEsiUP/2uoa6tF6Ted01elCGDahWx9
anMYj1hHOTaku5gpDXYKFZ07qJuXSMPzVm0Usv2EjGTc/sDzDsutJG5yMNUqfSME
lGowux4GIgRA4JA81WIgKkir4rrEjQMQzHbTuWJkiSzy7O43a6Wqj0rSYBzZDdTy
m4jra1jGP6m5Dt1etvDcVjqeSGG5dBP+ui8WmkhxTCcWS3+/+FVer8gOHFd/Y8oS
lijl9w4pgrcw8ddsJILtC2ToIwdkFipdAzjFD+8h6/oodpf45e20ou/IdOytA0KX
Dik2DOZnm32lW0xeLOHXtEVALrxla8Vz+qEUi06PRahzE6+xMazt45nd+VyJIEFh
3/uihQjyQujRCp5YZD9IruwWDzWO0JndMmBVUlo/egir0ZO2nQBCpoTWQ37hRA1l
JSJixBhOeedgXh08v26zsLPmRWXd0tW/EtK2OEdz3PuyOV6eH90qOvhVC2TlysWk
Cv2AfbXvau7vKXgQfhURv0Lj/fHcVD4SuRFs/9QB1SZtFha95I+BS0G1VdcSICzf
c0LvwWxW6ZgBjClUsSKCqwh2BGLVwmWIkb/vFjdjM+URSwgyygNCxlYCBHDXskL0
IZJ27LiAS46v298/7DU9r+fdHa9yOuvxxO0JD4c8I93OowyUOvLekxvNvaKoGVz2
m20ISjxYANHrAv9RvnpG
=pHeH
-----END PGP SIGNATURE-----

--=_rELKE2e2SIl2I_KIBI1orEV--



Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?20180713131227.Horde.S0gjPFGdZFb-68KklzQBXig>