From nobody Sun Dec 31 18:34:45 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4T38bF0Swkz557pG for ; Sun, 31 Dec 2023 19:40:09 +0000 (UTC) (envelope-from pi@freebsd.org) Received: from fc.opsec.eu (fc.opsec.eu [IPv6:2001:14f8:200:4::4]) by mx1.freebsd.org (Postfix) with ESMTP id 4T38bD08Gtz3P8p for ; Sun, 31 Dec 2023 19:40:07 +0000 (UTC) (envelope-from pi@freebsd.org) Authentication-Results: mx1.freebsd.org; dkim=none; spf=softfail (mx1.freebsd.org: 2001:14f8:200:4::4 is neither permitted nor denied by domain of pi@freebsd.org) smtp.mailfrom=pi@freebsd.org; dmarc=none Received: from pi (uid 104) (envelope-from pi@freebsd.org) id 18a9f by fc.opsec.eu (DragonFly Mail Agent v0.13+ on fc.opsec.eu); Sun, 31 Dec 2023 19:34:45 +0100 Date: Sun, 31 Dec 2023 19:34:45 +0100 From: Kurt Jaeger To: freebsd-current@freebsd.org Subject: ZFS problems since recently ? Message-ID: List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline X-Spamd-Result: default: False [2.78 / 15.00]; VIOLATED_DIRECT_SPF(3.50)[]; SUBJECT_ENDS_QUESTION(1.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_SPAM_SHORT(0.18)[0.184]; RCVD_NO_TLS_LAST(0.10)[]; MIME_GOOD(-0.10)[text/plain]; ONCE_RECEIVED(0.10)[]; DMARC_NA(0.00)[freebsd.org]; ARC_NA(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; FREEFALL_USER(0.00)[pi]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:12502, ipnet:2001:14f8::/32, country:DE]; TO_DN_NONE(0.00)[]; RCVD_COUNT_ONE(0.00)[1]; FROM_HAS_DN(0.00)[]; R_SPF_SOFTFAIL(0.00)[~all]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; TO_MATCH_ENVRCPT_ALL(0.00)[]; GREYLIST(0.00)[pass,body]; TO_DOM_EQ_FROM_DOM(0.00)[] X-Rspamd-Queue-Id: 4T38bD08Gtz3P8p X-Spamd-Bar: ++ Hi! Short overview: - Had CURRENT system from around September - Upgrade on the 23th of December - crashes in ZFS, see https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=261538 for details - Reinstalled from scratch with new SSDs drives from https://download.freebsd.org/snapshots/amd64/amd64/ISO-IMAGES/15.0/ freebsd-openzfs-amd64-2020081900-memstick.img.xz - Had one crash with sysctl -a https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=276039 - Still see crashes with ZFS (and other) when using poudriere to build ports. Problem: I happen to run in several cases of crashes in ZFS, some of them fatal (zpool non-recoverable). The latest was: panic: VERIFY(BP_GET_DEDUP(bp)) failed cpuid = 29 time = 1704050745 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe02def538c0 vpanic() at vpanic+0x131/frame 0xfffffe02def539f0 spl_panic() at spl_panic+0x3a/frame 0xfffffe02def53a50 dsl_livelist_iterate() at dsl_livelist_iterate+0x2de/frame 0xfffffe02def53b30 bpobj_iterate_blkptrs() at bpobj_iterate_blkptrs+0x235/frame 0xfffffe02def53bf0 bpobj_iterate_impl() at bpobj_iterate_impl+0x16e/frame 0xfffffe02def53c80 dsl_process_sub_livelist() at dsl_process_sub_livelist+0x5c/frame 0xfffffe02def53d00 spa_livelist_delete_cb() at spa_livelist_delete_cb+0xf6/frame 0xfffffe02def53ea0 zthr_procedure() at zthr_procedure+0xa5/frame 0xfffffe02def53ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe02def53f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe02def53f30 --- trap 0x85baac33, rip = 0xdfda59b01bda59f, rsp = 0xaaca3ed7a68a3ed3, rbp = 0x16f512f91ab512fd --- before I had to nuke that pool and restart... I already have vfs.zfs.dmu_offset_next_sync=0 which is supposed to disable block-cloning. Does anyone else see this with recent versions or is it just me ? -- pi@FreeBSD.org +49 171 3101372 Now what ?