From nobody Fri Jan 28 20:16:31 2022 X-Original-To: bugs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 9C3DB1984C75 for ; Fri, 28 Jan 2022 20:16:31 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JlpdC1Xblz4Scb for ; Fri, 28 Jan 2022 20:16:31 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 14A2F6C5 for ; Fri, 28 Jan 2022 20:16:31 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 20SKGUfq003760 for ; Fri, 28 Jan 2022 20:16:30 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 20SKGUDA003759 for bugs@FreeBSD.org; Fri, 28 Jan 2022 20:16:30 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: bugs@FreeBSD.org Subject: [Bug 261538] zfs panic: VERIFY3(l->blk_birth == r->blk_birth) failed Date: Fri, 28 Jan 2022 20:16:31 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: new X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: jfc@mit.edu X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: bugs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_id short_desc product version rep_platform op_sys bug_status bug_severity priority component assigned_to reporter Message-ID: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Bug reports List-Archive: https://lists.freebsd.org/archives/freebsd-bugs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-bugs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1643400991; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=P57Sn81NvyGDXWdSgska3UFQsRFaWHFUyZlp5OmV8z8=; b=RsrMZOLNfPwv8culyeU/6Yf2q0K38O7S5i9ozv7d2bkooExkfTBKaRROjq2pGaYx9F8n9T XkjiY6JYiTIPp0de9ENYOOi+9kd/JZ3BDBnCFc9Z6/jXzFrK60PqjBt3hyHbyhMgoHZ3RP 7DKjzRGg4MQfbzrp2rfZpKgVYkFBxMUwG90nK63sxQyEIa6Vmze8BGz209+G0zNGiYZc48 WG37YKUBWOMLDZ7ZCk+hli1SCsMhJwbZEKa8yZSdoE6OdUS0NQbj4W3+ZjbM1bXp6Pbn5d eESH+cCXErGUaXWfY1guDgCnvnOUAARwp0iRi4kWbo2YJ8vxr40hhSaoOzw2Kg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1643400991; a=rsa-sha256; cv=none; b=ASPvqYSs75JMQX/0RiQ8yj/Gyzue5X8VtVsV3me2gzfD/7qedJugSeWfQvpn1rz5JCfdS3 9+B+z7haG/yfpx2W0A1pHKrLTf3E/5JgCBHtvaNc8VlAUJuHHwwJjTQUXRs5dAIv21qvAv eE0IH0kzTU4GKajnFkwcLv07c8ifqHhTlV2gMcT6ViOGCByqcN8ybFaJPmld/TTT65GPMY PF/U99hr62G/IzM4dd/vCFbOmRLO8PVXIEqjJM3YGS6tF2rs62jl21nPFuSNhEMgX/75WF TltZ+TLN5FYOqEDoajs6bOvH0eRw5XreI6MVCNxdWbIIwK2XI28N3tXPLmQbGg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D261538 Bug ID: 261538 Summary: zfs panic: VERIFY3(l->blk_birth =3D=3D r->blk_birth) failed Product: Base System Version: 13.0-STABLE Hardware: arm64 OS: Any Status: New Severity: Affects Only Me Priority: --- Component: kern Assignee: bugs@FreeBSD.org Reporter: jfc@mit.edu While an overnight poudriere run was cleaning up my system crashed with a z= fs panic. On the console I saw (retyped): panic: VERIFY3(l->blk_birth =3D=3D r->blk_birth) failed (9269896 =3D=3D 926= 9889) cpuid =3D 15 time =3D 1643398268 #3 livelist_compare #4 avl_find #5 dsl_livelist_iterate #6 bpobj_iterate_blkptrs+0x104 #7 bpobj_iterate_impl+0x154 #8 dsl_process_sub_livelist+0x60 #9 spa_livelist_delete_cb+0xf8 #10 zthr_procedure+0xc0 #11 fork_exit+0x74 #12 fork_trampoline+0x10 Uptime: 1d3h46m6s In the terminal window with my ssh connection: [18:50:24] Logs: /data/logs/bulk/builder-default/2022-01-27_19h05m48s [19:25:12] [24] [19:24:56] Finished devel/llvm13 | llvm13-13.0.0_3: Success [19:25:15] Stopping 32 builders builder-default-job-01: removed builder-default-job-02: removed builder-default-job-01-n: removed builder-default-job-02-n: removed builder-default-job-03: removed builder-default-job-03-n: removed builder-default-job-04: removed builder-default-job-04-n: removed builder-default-job-05: removed builder-default-job-05-n: removed builder-default-job-06: removed builder-default-job-06-n: removed builder-default-job-07: removed builder-default-job-07-n: removed client_loop: send disconnect: Broken pipe My server is an Ampere eMAG (32 cores) with root on ZFS on an NVMe drive. = It is running a very recent version of stable/13. The dump will take hours to complete and I don't know if I will have a usab= le crash dump at the end. --=20 You are receiving this mail because: You are the assignee for the bug.=