From owner-freebsd-fs@freebsd.org Tue Oct 8 00:40:17 2019 Return-Path: Delivered-To: freebsd-fs@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 2D27813D344 for ; Tue, 8 Oct 2019 00:40:17 +0000 (UTC) (envelope-from yuripv@yuripv.net) Received: from wout5-smtp.messagingengine.com (wout5-smtp.messagingengine.com [64.147.123.21]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 46nJR34pgNz3GPs for ; Tue, 8 Oct 2019 00:40:12 +0000 (UTC) (envelope-from yuripv@yuripv.net) Received: from compute5.internal (compute5.nyi.internal [10.202.2.45]) by mailout.west.internal (Postfix) with ESMTP id EC6654EB for ; Mon, 7 Oct 2019 20:40:08 -0400 (EDT) Received: from imap36 ([10.202.2.86]) by compute5.internal (MEProxy); Mon, 07 Oct 2019 20:40:09 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yuripv.net; h= mime-version:message-id:date:from:to:subject:content-type; s= fm1; bh=eJxrzh4xjq1Y3b5yapAWKhw+SrrJttsN5SDAgpSn4Uo=; b=d15UE+s/ shz9V6Z9o/QO5P4XZzick/7bg6pNbqmlPjBch6838JZUR4Z4rHiLzwctmG8Gvprg kR7AkUfvKnsBEsTY5rA5vV9xCCI4pfBRlf8w8fqaUwztdjheQz1I0YQ1xiS/aDG3 s3H0n2acAOs8ooKgYoooYUz+86wk1htz6jV/FSUxEyu7BxVZJDjp/uE7xW8Kyj44 yxTVu+wIrFPTlzrV7Bpb07iRfkBwdJPCYioCqGo91/tiV8rIzEOKwDLTk8qbcbTu +kTz+QsmYOuvlT20Kkvj8hwtDP74xgZPPwc8jTLLxjy5ncJZ4G1vagke8/AIhvvu F0eEwodmA7o3NA== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=content-type:date:from:message-id :mime-version:subject:to:x-me-proxy:x-me-proxy:x-me-sender :x-me-sender:x-sasl-enc; s=fm1; bh=eJxrzh4xjq1Y3b5yapAWKhw+SrrJt tsN5SDAgpSn4Uo=; b=WhhDSiYwG0VMtw6XhtOj9lKKiRB9je8ikjzoKL3M0m5ne bzAnb9hHwkPuL4EeUjdRMsX5pObBG7p/L23/FVsLOikg6j5BFnZlwfoFDuAYbLUx gWewsYs3xrbt3tiMej9YSeLvoF28f1LzxxBt+pNGShaM0r5w6/f/1bix1ak0Cgya eYzRzywHtIsYYMLMScyXgJ8mrK5a31SE9sHaU9CAVRu9exE7ka8Hitarbc/Rl0/9 51E9zszo2/txwfEcFMsFA6ry2O1DojB4mHt8J6yPhLPenHxWAghFRDIbh4T4navU lTxnQbDXMlqV87EKFaWnOSijtUFUR5goh8eyYUDCA== X-ME-Sender: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgedufedrheekgdefiecutefuodetggdotefrodftvf curfhrohhfihhlvgemucfhrghsthforghilhdpqfgfvfdpuffrtefokffrpgfnqfghnecu uegrihhlohhuthemuceftddtnecunecujfgurhepofgfggfkfffhvffutgesthdtredtre ertdenucfhrhhomhepfdgjuhhrihcurfgrnhhkohhvfdcuoeihuhhrihhpvheshihurhhi phhvrdhnvghtqeenucffohhmrghinhepfhhrvggvsghsugdrohhrghenucfrrghrrghmpe hmrghilhhfrhhomhephihurhhiphhvseihuhhrihhpvhdrnhgvthenucevlhhushhtvghr ufhiiigvpedt X-ME-Proxy: Received: by mailuser.nyi.internal (Postfix, from userid 501) id 3050C188005C; Mon, 7 Oct 2019 20:40:08 -0400 (EDT) X-Mailer: MessagingEngine.com Webmail Interface User-Agent: Cyrus-JMAP/3.1.7-360-g7dda896-fmstable-20191004v2 Mime-Version: 1.0 Message-Id: <68853b35-e202-40b9-80ad-b29bc49bb5b4@www.fastmail.com> Date: Tue, 08 Oct 2019 03:39:45 +0300 From: "Yuri Pankov" To: freebsd-fs@FreeBSD.org Subject: panic: Memory modified after free Content-Type: text/plain X-Rspamd-Queue-Id: 46nJR34pgNz3GPs X-Spamd-Bar: ----- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yuripv.net header.s=fm1 header.b=d15UE+s/; dkim=pass header.d=messagingengine.com header.s=fm1 header.b=WhhDSiYw; dmarc=none; spf=pass (mx1.freebsd.org: domain of yuripv@yuripv.net designates 64.147.123.21 as permitted sender) smtp.mailfrom=yuripv@yuripv.net X-Spamd-Result: default: False [-5.08 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-0.999,0]; R_DKIM_ALLOW(-0.20)[yuripv.net:s=fm1,messagingengine.com:s=fm1]; XM_UA_NO_VERSION(0.01)[]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:64.147.123.21]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; TO_DN_NONE(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; RCVD_COUNT_THREE(0.00)[4]; DMARC_NA(0.00)[yuripv.net]; MV_CASE(0.50)[]; DKIM_TRACE(0.00)[yuripv.net:+,messagingengine.com:+]; IP_SCORE(-3.49)[ip: (-9.81), ipnet: 64.147.123.0/24(-4.90), asn: 11403(-2.68), country: US(-0.05)]; RCVD_IN_DNSWL_LOW(-0.10)[21.123.147.64.list.dnswl.org : 127.0.5.1]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:11403, ipnet:64.147.123.0/24, country:US]; RCVD_TLS_LAST(0.00)[]; MID_RHS_WWW(0.50)[] X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 08 Oct 2019 00:40:17 -0000 (posting to fs@ as backtrace suggests zfs) Started seeing the following panic (sometimes reproducible, so can't point specific revision or time range) untaring an archive over ssh into my home directory on zfs: panic: Memory modified after free 0xfffff80404cff000(4096) val=dead40de @ 0xfffff80404cff694 cpuid = 4 time = 1570493241 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00df912650 vpanic() at vpanic+0x19d/frame 0xfffffe00df9126a0 panic() at panic+0x43/frame 0xfffffe00df912700 trash_ctor() at trash_ctor+0x49/frame 0xfffffe00df912710 uma_zalloc_arg() at uma_zalloc_arg+0xa24/frame 0xfffffe00df9127a0 abd_alloc() at abd_alloc+0x152/frame 0xfffffe00df9127f0 arc_hdr_alloc_pabd() at arc_hdr_alloc_pabd+0x166/frame 0xfffffe00df912820 arc_write_ready() at arc_write_ready+0x463/frame 0xfffffe00df912860 zio_ready() at zio_ready+0xde/frame 0xfffffe00df9128a0 zio_execute() at zio_execute+0x17c/frame 0xfffffe00df9128e0 taskqueue_run_locked() at taskqueue_run_locked+0x10c/frame 0xfffffe00df912940 taskqueue_thread_loop() at taskqueue_thread_loop+0x88/frame 0xfffffe00df912970 fork_exit() at fork_exit+0x84/frame 0xfffffe00df9129b0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00df9129b0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Full text dump is at https://people.freebsd.org/~yuripv/core.txt.0. Real problem or failing hardware (memory?)?