From owner-freebsd-fs@freebsd.org Sun Sep 29 07:15:54 2019 Return-Path: Delivered-To: freebsd-fs@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 2FF22F701D for ; Sun, 29 Sep 2019 07:15:54 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 46gxdk1H2Pz4DSs for ; Sun, 29 Sep 2019 07:15:54 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 2A04BF701C; Sun, 29 Sep 2019 07:15:54 +0000 (UTC) Delivered-To: fs@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 28A76F701B for ; Sun, 29 Sep 2019 07:15:54 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 46gxdk0jHwz4DSr for ; Sun, 29 Sep 2019 07:15:54 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id EB603E825 for ; Sun, 29 Sep 2019 07:15:53 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id x8T7Frck012469 for ; Sun, 29 Sep 2019 07:15:53 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id x8T7FrLd012468 for fs@FreeBSD.org; Sun, 29 Sep 2019 07:15:53 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 240831] zfs: Panic during snapshot on 12.1-STABLE r352648 (solaris assert: txg_list_empty) Date: Sun, 29 Sep 2019 07:15:53 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 12.1-RELEASE X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: hlh@restart.be X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: mfc-stable11? mfc-stable12? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 29 Sep 2019 07:15:54 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D240831 --- Comment #12 from hlh@restart.be --- kgdb) p *dp $1 =3D {dp_spa =3D 0xfffffe004ebe8000, dp_meta_objset =3D 0xfffff80008af340= 0, dp_root_dir =3D 0xfffff80004e75c00,=20 dp_mos_dir =3D 0xfffff80004e75800, dp_free_dir =3D 0xfffff80004a68c00, dp_leak_dir =3D 0x0, dp_origin_snap =3D 0xfffff80004a6d000,=20 dp_root_dir_obj =3D 32, dp_vnrele_taskq =3D 0xfffff80004bc7c20, dp_meta_r= ootbp =3D {blk_dva =3D {{dva_word =3D {8, 447810216}}, { dva_word =3D {8, 738256336}}, {dva_word =3D {8, 1208077200}}}, blk_= prop =3D 9226475966770118659, blk_pad =3D {0, 0},=20 blk_phys_birth =3D 0, blk_birth =3D 2864862, blk_fill =3D 2024, blk_cks= um =3D {zc_word =3D {16400598605, 7775230236364,=20 1847786449934068, 293504487061283720}}}, dp_tmp_userrefs_obj =3D 0, dp_free_bpobj =3D {bpo_lock =3D {lock_object =3D { lo_name =3D 0xffffffff81bd0df4 <.L.str.19+1> "bpo->bpo_lock", lo_fl= ags =3D 577830912, lo_data =3D 0, lo_witness =3D 0x0},=20 sx_lock =3D 1}, bpo_os =3D 0xfffff80008af3400, bpo_object =3D 41, bpo= _epb =3D 1024, bpo_havecomp =3D 1 '\001',=20 bpo_havesubobj =3D 1 '\001', bpo_phys =3D 0xfffff80008977a00, bpo_dbuf = =3D 0xfffff8000845d420, bpo_cached_dbuf =3D 0x0},=20 dp_bptree_obj =3D 0, dp_empty_bpobj =3D 20, dp_obsolete_bpobj =3D {bpo_lo= ck =3D {lock_object =3D {lo_name =3D 0x0, lo_flags =3D 0,=20 lo_data =3D 0, lo_witness =3D 0x0}, sx_lock =3D 0}, bpo_os =3D 0x0,= bpo_object =3D 0, bpo_epb =3D 0, bpo_havecomp =3D 0 '\000',=20 bpo_havesubobj =3D 0 '\000', bpo_phys =3D 0x0, bpo_dbuf =3D 0x0, bpo_ca= ched_dbuf =3D 0x0}, dp_scan =3D 0xfffff80004e73c00, dp_lock =3D { lock_object =3D {lo_name =3D 0xffffffff81be58bf <.L.str.71+1> "dp->dp_l= ock", lo_flags =3D 577830912, lo_data =3D 0, lo_witness =3D 0x0},=20 sx_lock =3D 1}, dp_spaceavail_cv =3D {cv_description =3D 0xffffffff81bb= 59a8 <.L.str.72+1> "dp->dp_spaceavail_cv", cv_waiters =3D 0},=20 dp_dirty_pertxg =3D {0, 0, 0, 0}, dp_dirty_total =3D 0, dp_long_free_dirt= y_pertxg =3D {0, 0, 0, 0}, dp_mos_used_delta =3D 0,=20 dp_mos_compressed_delta =3D 0, dp_mos_uncompressed_delta =3D 0, dp_last_w= akeup =3D 0, dp_tx =3D {tx_cpu =3D 0xfffff800033cf800,=20 tx_sync_lock =3D {lock_object =3D {lo_name =3D 0xffffffff81bd38ff <.L.s= tr.7+1> "tx->tx_sync_lock", lo_flags =3D 577830912,=20 lo_data =3D 0, lo_witness =3D 0x0}, sx_lock =3D 1}, tx_open_txg =3D= 2864865, tx_quiescing_txg =3D 0, tx_quiesced_txg =3D 0,=20 tx_syncing_txg =3D 2864864, tx_synced_txg =3D 2864863, tx_open_time =3D 5149924275093, tx_sync_txg_waiting =3D 2864864,=20 tx_quiesce_txg_waiting =3D 2864865, tx_sync_more_cv =3D {cv_description= =3D 0xffffffff81bdade6 <.L.str.8+1> "tx->tx_sync_more_cv",=20 cv_waiters =3D 0}, tx_sync_done_cv =3D {cv_description =3D 0xffffffff= 81beb698 <.L.str.9+1> "tx->tx_sync_done_cv", cv_waiters =3D 1},=20 tx_quiesce_more_cv =3D {cv_description =3D 0xffffffff81bb6249 <.L.str.1= 0+1> "tx->tx_quiesce_more_cv", cv_waiters =3D 1},=20 tx_quiesce_done_cv =3D {cv_description =3D 0xffffffff81bd53c7 <.L.str.1= 1+1> "tx->tx_quiesce_done_cv", cv_waiters =3D 0},=20 tx_timeout_cv =3D {cv_description =3D 0x0, cv_waiters =3D 0}, tx_exit_c= v =3D { cv_description =3D 0xffffffff81bc31f1 <.L.str.12+1> "tx->tx_exit_cv", cv_waiters =3D 0}, tx_threads =3D 2 '\002',=20 tx_exiting =3D 0 '\000', tx_sync_thread =3D 0xfffff80008e9d000, tx_quiesce_thread =3D 0xfffff80008e9c000, tx_commit_cb_taskq =3D 0x0},=20 dp_dirty_datasets =3D {tl_lock =3D {lock_object =3D {lo_name =3D 0xffffff= ff81be221e <.L.str.28+1> "tl->tl_lock", lo_flags =3D 577830912,=20 lo_data =3D 0, lo_witness =3D 0x0}, sx_lock =3D 1}, tl_offset =3D 9= 28, tl_spa =3D 0xfffffe004ebe8000, tl_head =3D {0x0, 0x0, 0x0,=20 0x0}}, dp_dirty_zilogs =3D {tl_lock =3D {lock_object =3D {lo_name =3D 0xffffffff81be221e <.L.str.28+1> "tl->tl_lock",=20 lo_flags =3D 577830912, lo_data =3D 0, lo_witness =3D 0x0}, sx_lock= =3D 1}, tl_offset =3D 840, tl_spa =3D 0xfffffe004ebe8000,=20 tl_head =3D {0x0, 0x0, 0x0, 0x0}}, dp_dirty_dirs =3D {tl_lock =3D {lock= _object =3D { lo_name =3D 0xffffffff81be221e <.L.str.28+1> "tl->tl_lock", lo_flag= s =3D 577830912, lo_data =3D 0, lo_witness =3D 0x0},=20 sx_lock =3D 1}, tl_offset =3D 96, tl_spa =3D 0xfffffe004ebe8000, tl_h= ead =3D {0xfffff80008fb2c60, 0x0, 0x0, 0x0}}, dp_sync_tasks =3D { tl_lock =3D {lock_object =3D {lo_name =3D 0xffffffff81be221e <.L.str.28= +1> "tl->tl_lock", lo_flags =3D 577830912, lo_data =3D 0,=20 lo_witness =3D 0x0}, sx_lock =3D 1}, tl_offset =3D 0, tl_spa =3D 0xfffffe004ebe8000, tl_head =3D {0x0, 0x0, 0x0, 0x0}},=20 dp_early_sync_tasks =3D {tl_lock =3D {lock_object =3D {lo_name =3D 0xffff= ffff81be221e <.L.str.28+1> "tl->tl_lock", lo_flags =3D 577830912,=20 lo_data =3D 0, lo_witness =3D 0x0}, sx_lock =3D 1}, tl_offset =3D 0= , tl_spa =3D 0xfffffe004ebe8000, tl_head =3D {0x0, 0x0, 0x0, 0x0}},=20 dp_sync_taskq =3D 0xfffff80004bc7c40, dp_zil_clean_taskq =3D 0xfffff80004= bc7c30, dp_config_rwlock =3D {rr_lock =3D {lock_object =3D { lo_name =3D 0xffffffff81bb98ae <.L.str.1+1> "rrl->rr_lock", lo_flag= s =3D 577830912, lo_data =3D 0, lo_witness =3D 0x0},=20 sx_lock =3D 1}, rr_cv =3D {cv_description =3D 0xffffffff81bc8820 <.L.= str.2+1> "rrl->rr_cv", cv_waiters =3D 0}, rr_writer =3D 0x0,=20 rr_anon_rcount =3D {rc_mtx =3D {lock_object =3D {lo_name =3D 0xffffffff= 81bd9017 <.L.str.3+1> "rc->rc_mtx", lo_flags =3D 577830912,=20 lo_data =3D 0, lo_witness =3D 0x0}, sx_lock =3D 1}, rc_tracked = =3D 0, rc_list =3D {list_size =3D 40, list_offset =3D 0, list_head =3D { list_next =3D 0xfffff80004b72d18, list_prev =3D 0xfffff80004b72d1= 8}}, rc_removed =3D {list_size =3D 40, list_offset =3D 0,=20 list_head =3D {list_next =3D 0xfffff80004b72d38, list_prev =3D 0xfffff80004b72d38}}, rc_count =3D 0, rc_removed_count =3D 0},=20 --Type for more, q to quit, c to continue without paging-- rr_linked_rcount =3D {rc_mtx =3D {lock_object =3D {lo_name =3D 0xffffff= ff81bd9017 <.L.str.3+1> "rc->rc_mtx", lo_flags =3D 577830912,=20 lo_data =3D 0, lo_witness =3D 0x0}, sx_lock =3D 1}, rc_tracked = =3D 0, rc_list =3D {list_size =3D 40, list_offset =3D 0, list_head =3D { list_next =3D 0xfffff80004b72d90, list_prev =3D 0xfffff80004b72d9= 0}}, rc_removed =3D {list_size =3D 40, list_offset =3D 0,=20 list_head =3D {list_next =3D 0xfffff80004b72db0, list_prev =3D 0xfffff80004b72db0}}, rc_count =3D 0, rc_removed_count =3D 0},=20 rr_writer_wanted =3D 0, rr_track_all =3D 1}, dp_blkstats =3D 0x0} (kgdb) p *dp->dp_spa $2 =3D {spa_name =3D "dpool", '\000' , spa_comment =3D 0= x0, spa_avl =3D {avl_child =3D {0x0, 0x0},=20 avl_pcb =3D 18446741875996868873}, spa_config =3D 0xfffff80008c45800, spa_config_syncing =3D 0x0, spa_config_splitting =3D 0x0,=20 spa_load_info =3D 0xfffff80004c94220, spa_config_txg =3D 2029544, spa_syn= c_pass =3D 1, spa_state =3D POOL_STATE_ACTIVE,=20 spa_inject_ref =3D 0, spa_sync_on =3D 1 '\001', spa_load_state =3D SPA_LO= AD_NONE, spa_indirect_vdevs_loaded =3D 1, spa_trust_config =3D 1,=20 spa_config_source =3D SPA_CONFIG_SRC_MOS, spa_import_flags =3D 0, spa_zio= _taskq =3D {{{stqs_count =3D 1,=20 stqs_taskq =3D 0xfffff80004deff00}, {stqs_count =3D 0, stqs_taskq = =3D 0x0}, {stqs_count =3D 1, stqs_taskq =3D 0xfffff8000496b3c0}, { stqs_count =3D 0, stqs_taskq =3D 0x0}}, {{stqs_count =3D 1, stqs_ta= skq =3D 0xfffff8000496b3e0}, {stqs_count =3D 0,=20 stqs_taskq =3D 0x0}, {stqs_count =3D 8, stqs_taskq =3D 0xfffff80008= 7e38c0}, {stqs_count =3D 0, stqs_taskq =3D 0x0}}, {{ stqs_count =3D 1, stqs_taskq =3D 0xfffff80004bc7e10}, {stqs_count = =3D 1, stqs_taskq =3D 0xfffff80004bc7df0}, {stqs_count =3D 1,=20 stqs_taskq =3D 0xfffff80004bc7dd0}, {stqs_count =3D 1, stqs_taskq = =3D 0xfffff80004bc7db0}}, {{stqs_count =3D 8,=20 stqs_taskq =3D 0xfffff800087e3180}, {stqs_count =3D 0, stqs_taskq = =3D 0x0}, {stqs_count =3D 1, stqs_taskq =3D 0xfffff80004bc7d10}, { stqs_count =3D 0, stqs_taskq =3D 0x0}}, {{stqs_count =3D 1, stqs_ta= skq =3D 0xfffff80004bc7cf0}, {stqs_count =3D 0,=20 stqs_taskq =3D 0x0}, {stqs_count =3D 1, stqs_taskq =3D 0xfffff80004= bc7cd0}, {stqs_count =3D 0, stqs_taskq =3D 0x0}}, {{ stqs_count =3D 1, stqs_taskq =3D 0xfffff80004bc7cb0}, {stqs_count = =3D 0, stqs_taskq =3D 0x0}, {stqs_count =3D 1,=20 stqs_taskq =3D 0xfffff80004bc7c90}, {stqs_count =3D 0, stqs_taskq = =3D 0x0}}}, spa_dsl_pool =3D 0xfffff80004b72800,=20 spa_is_initializing =3D 0, spa_normal_class =3D 0xfffff80004e74000, spa_l= og_class =3D 0xfffff80004a68400, spa_first_txg =3D 2863817,=20 spa_final_txg =3D 18446744073709551615, spa_freeze_txg =3D 18446744073709= 551615, spa_load_max_txg =3D 18446744073709551615,=20 spa_claim_max_txg =3D 2863817, spa_loaded_ts =3D {tv_sec =3D 1569501932, = tv_nsec =3D 655368601}, spa_meta_objset =3D 0xfffff80008af3400,=20 spa_evicting_os_lock =3D {lock_object =3D {lo_name =3D 0xffffffff81bce36c <.L.str.16+1> "spa->spa_evicting_os_lock",=20 lo_flags =3D 577830912, lo_data =3D 0, lo_witness =3D 0x0}, sx_lock = =3D 1}, spa_evicting_os_list =3D {list_size =3D 896,=20 list_offset =3D 304, list_head =3D {list_next =3D 0xfffffe004ebe8380, l= ist_prev =3D 0xfffffe004ebe8380}}, spa_evicting_os_cv =3D { cv_description =3D 0xffffffff81bd1a69 <.L.str.26+1> "spa->spa_evicting_os_cv", cv_waiters =3D 0}, spa_vdev_txg_list =3D {tl_loc= k =3D { lock_object =3D {lo_name =3D 0xffffffff81be221e <.L.str.28+1> "tl->tl= _lock", lo_flags =3D 577830912, lo_data =3D 0,=20 lo_witness =3D 0x0}, sx_lock =3D 1}, tl_offset =3D 688, tl_spa =3D 0xfffffe004ebe8000, tl_head =3D {0x0, 0x0, 0x0,=20 0xfffff80008c432b0}}, spa_root_vdev =3D 0xfffff80008c44000, spa_min_a= shift =3D 12, spa_max_ashift =3D 12,=20 spa_config_guid =3D 11714503416111511200, spa_load_guid =3D 6215109065070= 704231, spa_last_synced_guid =3D 11714503416111511200,=20 spa_config_dirty_list =3D {list_size =3D 2280, list_offset =3D 736, list_= head =3D {list_next =3D 0xfffffe004ebe8428,=20 list_prev =3D 0xfffffe004ebe8428}}, spa_state_dirty_list =3D {list_si= ze =3D 2280, list_offset =3D 752, list_head =3D { list_next =3D 0xfffffe004ebe8448, list_prev =3D 0xfffffe004ebe8448}}, spa_alloc_locks =3D 0xfffff80008180380,=20 spa_alloc_trees =3D 0xfffff80004bf7300, spa_alloc_count =3D 4, spa_spares= =3D {sav_object =3D 0, sav_config =3D 0x0, sav_vdevs =3D 0x0,=20 sav_count =3D 0, sav_sync =3D 0, sav_pending =3D 0x0, sav_npending =3D = 0}, spa_l2cache =3D {sav_object =3D 275,=20 sav_config =3D 0xfffff80004dee0a0, sav_vdevs =3D 0xfffff8000496bb70, sa= v_count =3D 1, sav_sync =3D 0, sav_pending =3D 0x0,=20 sav_npending =3D 0}, spa_label_features =3D 0xfffff80004c94200, spa_config_object =3D 57, spa_config_generation =3D 0,=20 spa_syncing_txg =3D 2864864, spa_deferred_bpobj =3D {bpo_lock =3D {lock_o= bject =3D { lo_name =3D 0xffffffff81bd0df4 <.L.str.19+1> "bpo->bpo_lock", lo_fl= ags =3D 577830912, lo_data =3D 0, lo_witness =3D 0x0},=20 sx_lock =3D 1}, bpo_os =3D 0xfffff80008af3400, bpo_object =3D 61, bpo= _epb =3D 128, bpo_havecomp =3D 1 '\001',=20 bpo_havesubobj =3D 1 '\001', bpo_phys =3D 0xfffff80008977800, bpo_dbuf = =3D 0xfffff800089709a0,=20 bpo_cached_dbuf =3D 0xfffff8000d450000}, spa_free_bplist =3D {{bpl_lock= =3D {lock_object =3D { lo_name =3D 0xffffffff81bc03ee <.L.str.1+1> "bpl->bpl_lock", lo_f= lags =3D 577830912, lo_data =3D 0, lo_witness =3D 0x0},=20 sx_lock =3D 1}, bpl_list =3D {list_size =3D 144, list_offset =3D 12= 8, list_head =3D {list_next =3D 0xfffffe004ebe8570,=20 list_prev =3D 0xfffffe004ebe8570}}}, {bpl_lock =3D {lock_object = =3D { lo_name =3D 0xffffffff81bc03ee <.L.str.1+1> "bpl->bpl_lock", lo_f= lags =3D 577830912, lo_data =3D 0, lo_witness =3D 0x0},=20 sx_lock =3D 1}, bpl_list =3D {list_size =3D 144, list_offset =3D 12= 8, list_head =3D {list_next =3D 0xfffffe004ebe85b0,=20 list_prev =3D 0xfffffe004ebe85b0}}}, {bpl_lock =3D {lock_object = =3D { --Type for more, q to quit, c to continue without paging-- lo_name =3D 0xffffffff81bc03ee <.L.str.1+1> "bpl->bpl_lock", lo_f= lags =3D 577830912, lo_data =3D 0, lo_witness =3D 0x0},=20 sx_lock =3D 1}, bpl_list =3D {list_size =3D 144, list_offset =3D 12= 8, list_head =3D {list_next =3D 0xfffffe004ebe85f0,=20 list_prev =3D 0xfffffe004ebe85f0}}}, {bpl_lock =3D {lock_object = =3D { lo_name =3D 0xffffffff81bc03ee <.L.str.1+1> "bpl->bpl_lock", lo_f= lags =3D 577830912, lo_data =3D 0, lo_witness =3D 0x0},=20 sx_lock =3D 1}, bpl_list =3D {list_size =3D 144, list_offset =3D 12= 8, list_head =3D {list_next =3D 0xfffffe004ebe8630,=20 list_prev =3D 0xfffffe004ebe8630}}}}, spa_cksum_salt =3D { zcs_bytes =3D "=C3=9E8\235\t=C3=82=C3=BDW=C3=BA\224\200=C3=80=C3=90=C3=9E=C3=A0W\264=C3= =80u\203W=C3=B55[s\226-=C3=87\276\002\367?{"}, spa_cksum_tmpls_lock =3D {lock_object =3D { lo_name =3D 0xffffffff81bc30ff <.L.str.20+1> "spa->spa_cksum_tmpls_lo= ck", lo_flags =3D 577830912, lo_data =3D 0,=20 lo_witness =3D 0x0}, sx_lock =3D 1}, spa_cksum_tmpls =3D {0x0 }, spa_ubsync =3D {ub_magic =3D 12235020,=20 ub_version =3D 5000, ub_txg =3D 2864863, ub_guid_sum =3D 18220986535216= 77264, ub_timestamp =3D 1569507067, ub_rootbp =3D {blk_dva =3D {{ dva_word =3D {8, 447810216}}, {dva_word =3D {8, 738256336}}, {dva= _word =3D {8, 1208077200}}}, blk_prop =3D 9226475966770118659,=20 blk_pad =3D {0, 0}, blk_phys_birth =3D 0, blk_birth =3D 2864862, blk_= fill =3D 2024, blk_cksum =3D {zc_word =3D {16400598605,=20 7775230236364, 1847786449934068, 293504487061283720}}}, ub_software_version =3D 5000, ub_mmp_magic =3D 0, ub_mmp_delay =3D 0,=20 ub_mmp_seq =3D 0, ub_checkpoint_txg =3D 0}, spa_uberblock =3D {ub_magic= =3D 12235020, ub_version =3D 5000, ub_txg =3D 2864863,=20 ub_guid_sum =3D 1822098653521677264, ub_timestamp =3D 1569507067, ub_ro= otbp =3D {blk_dva =3D {{dva_word =3D {8, 447810216}}, { dva_word =3D {8, 738256336}}, {dva_word =3D {8, 1208077200}}}, bl= k_prop =3D 9226475966770118659, blk_pad =3D {0, 0},=20 blk_phys_birth =3D 0, blk_birth =3D 2864862, blk_fill =3D 2024, blk_c= ksum =3D {zc_word =3D {16400598605, 7775230236364,=20 1847786449934068, 293504487061283720}}}, ub_software_version =3D = 5000, ub_mmp_magic =3D 0, ub_mmp_delay =3D 0, ub_mmp_seq =3D 0,=20 ub_checkpoint_txg =3D 0}, spa_extreme_rewind =3D 0, spa_last_io =3D 510= 6579, spa_scrub_lock =3D {lock_object =3D { lo_name =3D 0xffffffff81bb612d <.L.str.21+1> "spa->spa_scrub_lock", lo_flags =3D 577830912, lo_data =3D 0, lo_witness =3D 0x0},=20 sx_lock =3D 1}, spa_scrub_inflight =3D 0, spa_load_verify_ios =3D 0, spa_scrub_io_cv =3D { cv_description =3D 0xffffffff81be7b03 <.L.str.28+1> "spa->spa_scrub_io_= cv", cv_waiters =3D 0}, spa_scrub_active =3D 0 '\000',=20 spa_scrub_type =3D 0 '\000', spa_scrub_finished =3D 0 '\000', spa_scrub_s= tarted =3D 0 '\000', spa_scrub_reopen =3D 0 '\000',=20 spa_scan_pass_start =3D 1569501933, spa_scan_pass_scrub_pause =3D 0, spa_scan_pass_scrub_spent_paused =3D 0, spa_scan_pass_exam =3D 0,=20 spa_scan_pass_issued =3D 0, spa_async_lock =3D {lock_object =3D {lo_name = =3D 0xffffffff81bbf0d9 <.L.str.13+1> "spa->spa_async_lock",=20 lo_flags =3D 577830912, lo_data =3D 0, lo_witness =3D 0x0}, sx_lock = =3D 1}, spa_async_thread =3D 0x0, spa_async_thread_vd =3D 0x0,=20 spa_async_suspended =3D 0, spa_async_cv =3D {cv_description =3D 0xfffffff= f81bce39b <.L.str.25+1> "spa->spa_async_cv", cv_waiters =3D 0},=20 spa_async_tasks =3D 0, spa_missing_tvds =3D 0, spa_missing_tvds_allowed = =3D 0, spa_removing_phys =3D {sr_state =3D 0,=20 sr_removing_vdev =3D 18446744073709551615, sr_prev_indirect_vdev =3D 18446744073709551615, sr_start_time =3D 0, sr_end_time =3D 0,=20 sr_to_copy =3D 0, sr_copied =3D 0}, spa_vdev_removal =3D 0x0, spa_condensing_indirect_phys =3D {scip_vdev =3D 0,=20 scip_prev_obsolete_sm_object =3D 0, scip_next_mapping_object =3D 0}, spa_condensing_indirect =3D 0x0,=20 spa_condense_zthr =3D 0xfffff80008533900, spa_checkpoint_txg =3D 0, spa_checkpoint_info =3D {sci_timestamp =3D 0, sci_dspace =3D 0},=20 spa_checkpoint_discard_zthr =3D 0xfffff80008533880, spa_root =3D 0x0, spa= _ena =3D 0, spa_last_open_failed =3D 0,=20 spa_last_ubsync_txg =3D 0, spa_last_ubsync_txg_ts =3D 0, spa_load_txg =3D= 0, spa_load_txg_ts =3D 1569501768, spa_load_meta_errors =3D 0,=20 spa_load_data_errors =3D 0, spa_verify_min_txg =3D 2863813, spa_errlog_lo= ck =3D {lock_object =3D { lo_name =3D 0xffffffff81bc8a75 <.L.str.15+1> "spa->spa_errlog_lock", lo_flags =3D 577830912, lo_data =3D 0, lo_witness =3D 0x0},=20 sx_lock =3D 1}, spa_errlog_last =3D 0, spa_errlog_scrub =3D 0, spa_errl= ist_lock =3D {lock_object =3D { lo_name =3D 0xffffffff81be958d <.L.str.14+1> "spa->spa_errlist_lock", lo_flags =3D 577830912, lo_data =3D 0, lo_witness =3D 0x0},=20 sx_lock =3D 1}, spa_errlist_last =3D {avl_root =3D 0x0, avl_compar =3D 0xffffffff81af53f0 , avl_offset =3D 40,=20 avl_numnodes =3D 0, avl_size =3D 64}, spa_errlist_scrub =3D {avl_root = =3D 0x0,=20 avl_compar =3D 0xffffffff81af53f0 , avl_offset= =3D 40, avl_numnodes =3D 0, avl_size =3D 64}, spa_deflate =3D 1,=20 spa_history =3D 62, spa_history_lock =3D {lock_object =3D {lo_name =3D 0xffffffff81bd7331 <.L.str.17+1> "spa->spa_history_lock",=20 lo_flags =3D 577830912, lo_data =3D 0, lo_witness =3D 0x0}, sx_lock = =3D 1}, spa_pending_vdev =3D 0x0, spa_props_lock =3D {lock_object =3D { lo_name =3D 0xffffffff81be5e02 <.L.str.19+1> "spa->spa_props_lock", lo_flags =3D 577830912, lo_data =3D 0, lo_witness =3D 0x0},=20 --Type for more, q to quit, c to continue without paging-- sx_lock =3D 1}, spa_pool_props_object =3D 0, spa_bootfs =3D 0, spa_fail= mode =3D 0, spa_delegation =3D 1, spa_config_list =3D { list_size =3D 24, list_offset =3D 0, list_head =3D {list_next =3D 0xfffff80004c94260, list_prev =3D 0xfffff80004c94260}},=20 spa_async_zio_root =3D 0xfffff80004ded0c0, spa_suspend_zio_root =3D 0x0, spa_txg_zio =3D {0xfffff800818cc418, 0xfffff80004c6b418,=20 0xfffff800818dd418, 0xfffff80081848000}, spa_suspend_lock =3D {lock_obj= ect =3D { lo_name =3D 0xffffffff81bdccac <.L.str.22+1> "spa->spa_suspend_lock", lo_flags =3D 577830912, lo_data =3D 0, lo_witness =3D 0x0},=20 sx_lock =3D 1}, spa_suspend_cv =3D {cv_description =3D 0xffffffff81bb61= 42 <.L.str.29+1> "spa->spa_suspend_cv", cv_waiters =3D 0},=20 spa_suspended =3D 0 '\000', spa_claiming =3D 0 '\000', spa_is_root =3D 0, spa_minref =3D 11, spa_mode =3D 3, spa_log_state =3D SPA_LOG_GOOD,=20 spa_autoexpand =3D 0, spa_bootsize =3D 0, spa_ddt =3D {0xfffffe004bd98000, 0xfffffe004bda0000, 0xfffffe004bda8000, 0xfffffe004bdb0000,=20 0xfffffe004bdb8000, 0xfffffe004bdc0000, 0xfffffe004bdc8000, 0xfffffe004bdd0000, 0xfffffe004bdd8000, 0xfffffe004bde0000,=20 0xfffffe004fa00000, 0xfffffe004fa08000, 0xfffffe004fa10000}, spa_ddt_stat_object =3D 0, spa_dedup_ditto =3D 0,=20 spa_dedup_checksum =3D 8, spa_dspace =3D 987842478080, spa_vdev_top_lock = =3D {lock_object =3D { lo_name =3D 0xffffffff81be0b46 <.L.str.23+1> "spa->spa_vdev_top_lock", lo_flags =3D 577830912, lo_data =3D 0, lo_witness =3D 0x0},=20 sx_lock =3D 1}, spa_proc_lock =3D {lock_object =3D {lo_name =3D 0xfffff= fff81bce387 <.L.str.18+1> "spa->spa_proc_lock",=20 lo_flags =3D 577830912, lo_data =3D 0, lo_witness =3D 0x0}, sx_lock = =3D 1}, spa_proc_cv =3D { cv_description =3D 0xffffffff81beb620 <.L.str.27+1> "spa->spa_proc_cv", cv_waiters =3D 0}, spa_proc_state =3D SPA_PROC_NONE,=20 spa_proc =3D 0xffffffff814e6fb0 , spa_did =3D 0, spa_trim_thread = =3D 0xfffff80008af85e0, spa_trim_lock =3D {lock_object =3D { lo_name =3D 0xffffffff81be1317 <.L.str.8+1> "spa->spa_trim_lock", lo_= flags =3D 577830912, lo_data =3D 0, lo_witness =3D 0x0},=20 sx_lock =3D 1}, spa_trim_cv =3D {cv_description =3D 0xffffffff81bd7d34 <.L.str.9+1> "spa->spa_trim_cv", cv_waiters =3D 4795},=20 spa_autoreplace =3D 0, spa_vdev_locks =3D 0, spa_creation_version =3D 500= 0, spa_prev_software_version =3D 5000,=20 spa_feat_for_write_obj =3D 59, spa_feat_for_read_obj =3D 58, spa_feat_des= c_obj =3D 60, spa_feat_enabled_txg_obj =3D 63,=20 spa_feat_stats_lock =3D {lock_object =3D {lo_name =3D 0xffffffff81bd7348 <.L.str.24+1> "spa->spa_feat_stats_lock",=20 lo_flags =3D 577830912, lo_data =3D 0, lo_witness =3D 0x0}, sx_lock = =3D 1}, spa_feat_stats =3D 0xfffff800087d1ca0,=20 spa_feat_refcount_cache =3D {0, 3399, 1, 0, 116, 14, 1, 0, 1, 0, 0, 0, 0,= 0, 0, 0, 0, 0, 1}, spa_deadman_cycid =3D {c_links =3D {le =3D { le_next =3D 0x0, le_prev =3D 0xfffffe00031b3f60}, sle =3D {sle_next= =3D 0x0}, tqe =3D {tqe_next =3D 0x0,=20 tqe_prev =3D 0xfffffe00031b3f60}}, c_time =3D 26413723334338, c_pre= cision =3D 268435437500, c_arg =3D 0xfffffe004ebe8000,=20 c_func =3D 0xffffffff81b08630 , c_lock =3D 0x0, c_= flags =3D 2, c_iflags =3D 20, c_cpu =3D 0}, spa_deadman_task =3D { ta_link =3D {stqe_next =3D 0x0}, ta_pending =3D 0, ta_priority =3D 0, t= a_func =3D 0xffffffff81b08560 ,=20 ta_context =3D 0xfffffe004ebe8000}, spa_deadman_calls =3D 0, spa_sync_s= tarttime =3D 5149924275093,=20 spa_deadman_synctime =3D 1000000000000, spa_all_vdev_zaps =3D 64, spa_avz= _action =3D AVZ_ACTION_NONE, spa_lowmem_page_load =3D 0,=20 spa_lowmem_last_txg =3D 0, spa_ccw_fail_time =3D 0, spa_config_lock =3D {= {scl_lock =3D {lock_object =3D { lo_name =3D 0xffffffff81bc4b2f <.L.str.106+1> "scl->scl_lock", lo= _flags =3D 577830912, lo_data =3D 0, lo_witness =3D 0x0},=20 sx_lock =3D 1}, scl_writer =3D 0x0, scl_write_wanted =3D 0, scl_cv = =3D { cv_description =3D 0xffffffff81bdadbd <.L.str.107+1> "scl->scl_cv", cv_waiters =3D 0}, scl_count =3D {rc_mtx =3D {lock_object =3D { lo_name =3D 0xffffffff81bd9017 <.L.str.3+1> "rc->rc_mtx", lo_fl= ags =3D 577830912, lo_data =3D 0, lo_witness =3D 0x0},=20 sx_lock =3D 1}, rc_tracked =3D 0, rc_list =3D {list_size =3D 40, = list_offset =3D 0, list_head =3D {list_next =3D 0xfffffe004ebe8f38,=20 list_prev =3D 0xfffffe004ebe8f38}}, rc_removed =3D {list_size = =3D 40, list_offset =3D 0, list_head =3D { list_next =3D 0xfffffe004ebe8f58, list_prev =3D 0xfffffe004ebe8= f58}}, rc_count =3D 1, rc_removed_count =3D 0}}, {scl_lock =3D { lock_object =3D {lo_name =3D 0xffffffff81bc4b2f <.L.str.106+1> "scl->scl_lock", lo_flags =3D 577830912, lo_data =3D 0,=20 lo_witness =3D 0x0}, sx_lock =3D 1}, scl_writer =3D 0x0, scl_writ= e_wanted =3D 0, scl_cv =3D { cv_description =3D 0xffffffff81bdadbd <.L.str.107+1> "scl->scl_cv", cv_waiters =3D 0}, scl_count =3D {rc_mtx =3D {lock_object =3D { lo_name =3D 0xffffffff81bd9017 <.L.str.3+1> "rc->rc_mtx", lo_fl= ags =3D 577830912, lo_data =3D 0, lo_witness =3D 0x0},=20 sx_lock =3D 1}, rc_tracked =3D 0, rc_list =3D {list_size =3D 40, = list_offset =3D 0, list_head =3D {list_next =3D 0xfffffe004ebe8ff0,=20 list_prev =3D 0xfffffe004ebe8ff0}}, rc_removed =3D {list_size = =3D 40, list_offset =3D 0, list_head =3D { list_next =3D 0xfffffe004ebe9010, list_prev =3D 0xfffffe004ebe9= 010}}, rc_count =3D 0, rc_removed_count =3D 0}}, {scl_lock =3D { --Type for more, q to quit, c to continue without paging-- lock_object =3D {lo_name =3D 0xffffffff81bc4b2f <.L.str.106+1> "scl->scl_lock", lo_flags =3D 577830912, lo_data =3D 0,=20 lo_witness =3D 0x0}, sx_lock =3D 1}, scl_writer =3D 0x0, scl_writ= e_wanted =3D 0, scl_cv =3D { cv_description =3D 0xffffffff81bdadbd <.L.str.107+1> "scl->scl_cv", cv_waiters =3D 0}, scl_count =3D {rc_mtx =3D {lock_object =3D { lo_name =3D 0xffffffff81bd9017 <.L.str.3+1> "rc->rc_mtx", lo_fl= ags =3D 577830912, lo_data =3D 0, lo_witness =3D 0x0},=20 sx_lock =3D 1}, rc_tracked =3D 0, rc_list =3D {list_size =3D 40, = list_offset =3D 0, list_head =3D {list_next =3D 0xfffffe004ebe90a8,=20 list_prev =3D 0xfffffe004ebe90a8}}, rc_removed =3D {list_size = =3D 40, list_offset =3D 0, list_head =3D { list_next =3D 0xfffffe004ebe90c8, list_prev =3D 0xfffffe004ebe9= 0c8}}, rc_count =3D 0, rc_removed_count =3D 0}}, {scl_lock =3D { lock_object =3D {lo_name =3D 0xffffffff81bc4b2f <.L.str.106+1> "scl->scl_lock", lo_flags =3D 577830912, lo_data =3D 0,=20 lo_witness =3D 0x0}, sx_lock =3D 1}, scl_writer =3D 0x0, scl_writ= e_wanted =3D 0, scl_cv =3D { cv_description =3D 0xffffffff81bdadbd <.L.str.107+1> "scl->scl_cv", cv_waiters =3D 0}, scl_count =3D {rc_mtx =3D {lock_object =3D { lo_name =3D 0xffffffff81bd9017 <.L.str.3+1> "rc->rc_mtx", lo_fl= ags =3D 577830912, lo_data =3D 0, lo_witness =3D 0x0},=20 sx_lock =3D 1}, rc_tracked =3D 0, rc_list =3D {list_size =3D 40, = list_offset =3D 0, list_head =3D {list_next =3D 0xfffffe004ebe9160,=20 list_prev =3D 0xfffffe004ebe9160}}, rc_removed =3D {list_size = =3D 40, list_offset =3D 0, list_head =3D { list_next =3D 0xfffffe004ebe9180, list_prev =3D 0xfffffe004ebe9= 180}}, rc_count =3D 0, rc_removed_count =3D 0}}, {scl_lock =3D { lock_object =3D {lo_name =3D 0xffffffff81bc4b2f <.L.str.106+1> "scl->scl_lock", lo_flags =3D 577830912, lo_data =3D 0,=20 lo_witness =3D 0x0}, sx_lock =3D 1}, scl_writer =3D 0x0, scl_writ= e_wanted =3D 0, scl_cv =3D { cv_description =3D 0xffffffff81bdadbd <.L.str.107+1> "scl->scl_cv", cv_waiters =3D 0}, scl_count =3D {rc_mtx =3D {lock_object =3D { lo_name =3D 0xffffffff81bd9017 <.L.str.3+1> "rc->rc_mtx", lo_fl= ags =3D 577830912, lo_data =3D 0, lo_witness =3D 0x0},=20 sx_lock =3D 1}, rc_tracked =3D 0, rc_list =3D {list_size =3D 40, = list_offset =3D 0, list_head =3D {list_next =3D 0xfffffe004ebe9218,=20 list_prev =3D 0xfffffe004ebe9218}}, rc_removed =3D {list_size = =3D 40, list_offset =3D 0, list_head =3D { list_next =3D 0xfffffe004ebe9238, list_prev =3D 0xfffffe004ebe9= 238}}, rc_count =3D 0, rc_removed_count =3D 0}}, {scl_lock =3D { lock_object =3D {lo_name =3D 0xffffffff81bc4b2f <.L.str.106+1> "scl->scl_lock", lo_flags =3D 577830912, lo_data =3D 0,=20 lo_witness =3D 0x0}, sx_lock =3D 1}, scl_writer =3D 0x0, scl_writ= e_wanted =3D 0, scl_cv =3D { cv_description =3D 0xffffffff81bdadbd <.L.str.107+1> "scl->scl_cv", cv_waiters =3D 0}, scl_count =3D {rc_mtx =3D {lock_object =3D { lo_name =3D 0xffffffff81bd9017 <.L.str.3+1> "rc->rc_mtx", lo_fl= ags =3D 577830912, lo_data =3D 0, lo_witness =3D 0x0},=20 sx_lock =3D 1}, rc_tracked =3D 0, rc_list =3D {list_size =3D 40, = list_offset =3D 0, list_head =3D {list_next =3D 0xfffffe004ebe92d0,=20 list_prev =3D 0xfffffe004ebe92d0}}, rc_removed =3D {list_size = =3D 40, list_offset =3D 0, list_head =3D { list_next =3D 0xfffffe004ebe92f0, list_prev =3D 0xfffffe004ebe9= 2f0}}, rc_count =3D 0, rc_removed_count =3D 0}}, {scl_lock =3D { lock_object =3D {lo_name =3D 0xffffffff81bc4b2f <.L.str.106+1> "scl->scl_lock", lo_flags =3D 577830912, lo_data =3D 0,=20 lo_witness =3D 0x0}, sx_lock =3D 1}, scl_writer =3D 0x0, scl_writ= e_wanted =3D 0, scl_cv =3D { cv_description =3D 0xffffffff81bdadbd <.L.str.107+1> "scl->scl_cv", cv_waiters =3D 0}, scl_count =3D {rc_mtx =3D {lock_object =3D { lo_name =3D 0xffffffff81bd9017 <.L.str.3+1> "rc->rc_mtx", lo_fl= ags =3D 577830912, lo_data =3D 0, lo_witness =3D 0x0},=20 sx_lock =3D 1}, rc_tracked =3D 0, rc_list =3D {list_size =3D 40, = list_offset =3D 0, list_head =3D {list_next =3D 0xfffffe004ebe9388,=20 list_prev =3D 0xfffffe004ebe9388}}, rc_removed =3D {list_size = =3D 40, list_offset =3D 0, list_head =3D { list_next =3D 0xfffffe004ebe93a8, list_prev =3D 0xfffffe004ebe9= 3a8}}, rc_count =3D 0, rc_removed_count =3D 0}}},=20 spa_refcount =3D {rc_mtx =3D {lock_object =3D {lo_name =3D 0xffffffff81bd= 9017 <.L.str.3+1> "rc->rc_mtx", lo_flags =3D 577830912,=20 lo_data =3D 0, lo_witness =3D 0x0}, sx_lock =3D 1}, rc_tracked =3D = 0, rc_list =3D {list_size =3D 40, list_offset =3D 0, list_head =3D { list_next =3D 0xfffffe004ebe9400, list_prev =3D 0xfffffe004ebe9400}= }, rc_removed =3D {list_size =3D 40, list_offset =3D 0,=20 list_head =3D {list_next =3D 0xfffffe004ebe9420, list_prev =3D 0xfffffe004ebe9420}}, rc_count =3D 64, rc_removed_count =3D 0},=20 spa_splitting_newspa =3D 0} (kgdb) --=20 You are receiving this mail because: You are the assignee for the bug.=