From owner-freebsd-fs@freebsd.org Wed May 10 09:38:04 2017 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id BDF83D63682; Wed, 10 May 2017 09:38:04 +0000 (UTC) (envelope-from srs0=vtve=4q=sigsegv.be=kristof@codepro.be) Received: from venus.codepro.be (venus.codepro.be [IPv6:2a01:4f8:162:1127::2]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "*.codepro.be", Issuer "Gandi Standard SSL CA 2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 5A66D1D79; Wed, 10 May 2017 09:38:04 +0000 (UTC) (envelope-from srs0=vtve=4q=sigsegv.be=kristof@codepro.be) Received: from [192.168.42.121] (unknown [123.201.149.9]) (Authenticated sender: kp) by venus.codepro.be (Postfix) with ESMTPSA id EFE1E9001; Wed, 10 May 2017 11:38:00 +0200 (CEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=sigsegv.be; s=mail; t=1494409081; bh=rlEhZaxi14Z7kIXnhIXvU629VLVo2bju4Qi50hpVwBg=; h=From:To:Subject:Date; b=0sWZqdW6Rvcx4ykfyYf/nX0VW7rpKJgroNvODxwXYviGsbR4k3pN9N4VJ3QjZuHzP 4HunCXEl5XkdnU28ccRCAZP2gGMd3imc+Z+kCrKOvrknOWaHqn1Y6M8aPlp70Q7ayQ Ilrq3hc4zUS4PozJgFv7kXJXBBrrJWEGUCu3lz38= From: "Kristof Provost" To: "Freebsd current" , freebsd-fs@freebsd.org Subject: zfs recv panic Date: Wed, 10 May 2017 15:07:57 +0530 Message-ID: <18A74EE1-3358-4276-88EA-C13E28D8563A@sigsegv.be> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 8bit X-Mailer: MailMate (2.0BETAr6082) X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 10 May 2017 09:38:04 -0000 Hi, I have a reproducible panic on CURRENT (r318136) doing (jupiter) # zfs send -R -v zroot/var@before-kernel-2017-04-26 | nc dual 1234 (dual) # nc -l 1234 | zfs recv -v -F tank/jupiter/var For clarity, the receiving machine is CURRENT r318136, the sending machine is running a somewhat older CURRENT version. The receiving machine panics a few seconds in: receiving full stream of zroot/var@before-kernel-2017-04-03 into tank/jupiter/var@before-kernel-2017-04-03 panic: solaris assert: dbuf_is_metadata(db) == arc_is_metadata(buf) (0x0 == 0x1), file: /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/dbuf.c, line: 2007 cpuid = 0 time = 1494408122 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0120cad930 vpanic() at vpanic+0x19c/frame 0xfffffe0120cad9b0 panic() at panic+0x43/frame 0xfffffe0120cada10 assfail3() at assfail3+0x2c/frame 0xfffffe0120cada30 dbuf_assign_arcbuf() at dbuf_assign_arcbuf+0xf2/frame 0xfffffe0120cada80 dmu_assign_arcbuf() at dmu_assign_arcbuf+0x170/frame 0xfffffe0120cadad0 receive_writer_thread() at receive_writer_thread+0x6ac/frame 0xfffffe0120cadb70 fork_exit() at fork_exit+0x84/frame 0xfffffe0120cadbb0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0120cadbb0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- KDB: enter: panic [ thread pid 7 tid 100672 ] Stopped at kdb_enter+0x3b: movq $0,kdb_why db> kgdb backtrace: #0 doadump (textdump=0) at pcpu.h:232 #1 0xffffffff803a208b in db_dump (dummy=, dummy2=, dummy3=, dummy4=) at /usr/src/sys/ddb/db_command.c:546 #2 0xffffffff803a1e7f in db_command (cmd_table=) at /usr/src/sys/ddb/db_command.c:453 #3 0xffffffff803a1bb4 in db_command_loop () at /usr/src/sys/ddb/db_command.c:506 #4 0xffffffff803a4c7f in db_trap (type=, code=) at /usr/src/sys/ddb/db_main.c:248 #5 0xffffffff80a93cb3 in kdb_trap (type=3, code=-61456, tf=) at /usr/src/sys/kern/subr_kdb.c:654 #6 0xffffffff80ed3de6 in trap (frame=0xfffffe0120cad860) at /usr/src/sys/amd64/amd64/trap.c:537 #7 0xffffffff80eb62f1 in calltrap () at /usr/src/sys/amd64/amd64/exception.S:236 #8 0xffffffff80a933eb in kdb_enter (why=0xffffffff8143d8f5 "panic", msg=) at cpufunc.h:63 #9 0xffffffff80a51cf9 in vpanic (fmt=, ap=0xfffffe0120cad9f0) at /usr/src/sys/kern/kern_shutdown.c:772 #10 0xffffffff80a51d63 in panic (fmt=) at /usr/src/sys/kern/kern_shutdown.c:710 #11 0xffffffff8262b26c in assfail3 (a=, lv=, op=, rv=, f=, l=) at /usr/src/sys/cddl/compat/opensolaris/kern/opensolaris_cmn_err.c:91 #12 0xffffffff822ad892 in dbuf_assign_arcbuf (db=0xfffff8008f23e560, buf=0xfffff8008f09fcc0, tx=0xfffff8008a8d5200) at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/dbuf.c:2007 #13 0xffffffff822b87f0 in dmu_assign_arcbuf (handle=, offset=0, buf=0xfffff8008f09fcc0, tx=0xfffff8008a8d5200) at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/dmu.c:1542 #14 0xffffffff822bf7fc in receive_writer_thread (arg=0xfffffe0120a1d168) at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/dmu_send.c:2284 #15 0xffffffff80a13704 in fork_exit (callout=0xffffffff822bf150 , arg=0xfffffe0120a1d168, frame=0xfffffe0120cadbc0) at /usr/src/sys/kern/kern_fork.c:1038 #16 0xffffffff80eb682e in fork_trampoline () at /usr/src/sys/amd64/amd64/exception.S:611 #17 0x0000000000000000 in ?? () Let me know if there’s any other information I can provide, or things I can test. Fortunately the target machine is not a production machine, so I can panic it as often as required. Regards, Kristof