From owner-freebsd-fs@FreeBSD.ORG Fri Apr 11 01:06:12 2014 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 856BF707 for ; Fri, 11 Apr 2014 01:06:12 +0000 (UTC) Received: from anubis.delphij.net (anubis.delphij.net [IPv6:2001:470:1:117::25]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "anubis.delphij.net", Issuer "StartCom Class 1 Primary Intermediate Server CA" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 573BE1A98 for ; Fri, 11 Apr 2014 01:06:12 +0000 (UTC) Received: from zeta.ixsystems.com (unknown [69.198.165.132]) (using TLSv1 with cipher ECDHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by anubis.delphij.net (Postfix) with ESMTPSA id 09A8046CB; Thu, 10 Apr 2014 18:06:10 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=delphij.net; s=anubis; t=1397178371; bh=hzJygbCZYFkF2yACvLmoEnZTr8afiLeJT2UxlcTcmeY=; h=Date:From:Reply-To:To:Subject:References:In-Reply-To; b=rvMA1GyL8w18MrxahmzAML9GXAbZ0Q9P8jaCsSIXx0L26NpNEzisCTzyERIlOAdr0 yy3f3PO6JyDcvmSLLT4BHEdq89ZogPexQf43VugRn/efkNViUm0y5GUmPCzB9c+d/b 7IxQadiNAScSM2TcV48ksJTnapTjJXXDAag1PZqA= Message-ID: <53474002.5020003@delphij.net> Date: Thu, 10 Apr 2014 18:06:10 -0700 From: Xin Li Organization: The FreeBSD Project MIME-Version: 1.0 To: Garrett Wollman , freebsd-fs@freebsd.org Subject: Re: ZFS panic: solaris assert: BP_EQUAL(bp, &zio->io_bp_orig) References: <21319.15860.827329.334067@hergotha.csail.mit.edu> In-Reply-To: <21319.15860.827329.334067@hergotha.csail.mit.edu> X-Enigmail-Version: 1.6 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list Reply-To: d@delphij.net List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 11 Apr 2014 01:06:12 -0000 -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA512 On 04/10/14 17:57, Garrett Wollman wrote: > I have a file server that has panic()ed twice today with the > following: > > panic: solaris assert: BP_EQUAL(bp, &zio->io_bp_orig), file: > /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c, > line: 2955 cpuid = 20 KDB: stack backtrace: db_trace_self_wrapper() > at db_trace_self_wrapper+0x2a/frame 0xffffff98a38d2900 > kdb_backtrace() at kdb_backtrace+0x37/frame 0xffffff98a38d29c0 > panic() at panic+0x1ce/frame 0xffffff98a38d2ac0 assfail() at > assfail+0x1a/frame 0xffffff98a38d2ad0 zio_done() at > zio_done+0x120/frame 0xffffff98a38d2b30 zio_execute() at > zio_execute+0xc3/frame 0xffffff98a38d2b70 taskqueue_run_locked() at > taskqueue_run_locked+0x74/frame 0xffffff98a38d2bc0 > taskqueue_thread_loop() at taskqueue_thread_loop+0x46/frame > 0xffffff98a38d2be0 fork_exit() at fork_exit+0x11f/frame > 0xffffff98a38d2c30 fork_trampoline() at fork_trampoline+0xe/frame > 0xffffff98a38d2c30 --- trap 0, rip = 0, rsp = 0xffffff98a38d2cf0, > rbp = 0 --- Uptime: 11d15h27m51s Automatic reboot in 15 seconds - > press a key on the console to abort --> Press a key on the console > to reboot, --> or switch off the system now. > > (It also failed to reboot automatically, as if a character had > been sent to the console.) > > Anyone have a guess about what's going on here? I obviously can't > keep manually restarting a production file server every 14 hours. > Here's the code in question: > > if (bp != NULL) { ASSERT(bp->blk_pad[0] == 0); > ASSERT(bp->blk_pad[1] == 0); ASSERT(bcmp(bp, &zio->io_bp_copy, > sizeof (blkptr_t)) == 0 || (bp == zio_unique_parent(zio)->io_bp)); > if (zio->io_type == ZIO_TYPE_WRITE && !BP_IS_HOLE(bp) && > zio->io_bp_override == NULL && !(zio->io_flags & > ZIO_FLAG_IO_REPAIR)) { ASSERT(!BP_SHOULD_BYTESWAP(bp)); > ASSERT3U(zio->io_prop.zp_copies, <=, BP_GET_NDVAS(bp)); > ASSERT(BP_COUNT_GANG(bp) == 0 || (BP_COUNT_GANG(bp) == > BP_GET_NDVAS(bp))); } if (zio->io_flags & ZIO_FLAG_NOPWRITE) > VERIFY(BP_EQUAL(bp, &zio->io_bp_orig)); } > > And it just now panicked again. Help! Have you tried setting vfs.zfs.nopwrite_enabled=0 in /boot/loader.conf? Cheers, - -- Xin LI https://www.delphij.net/ FreeBSD - The Power to Serve! Live free or die -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.22 (FreeBSD) iQIcBAEBCgAGBQJTR0ACAAoJEJW2GBstM+nsewsP/RqBXgufS6cAv0m9c8EQI0AP mnBdmIpN2fGNUZM+3vaHf+cRxwLNpgfzZ+6XZGJOPJbMYjT/EQkx7jOpXvmnWSV9 F4RmDMrwzkgmP/ER12mk03HTaXaQTsrHbIPmtzuUfOWBchQONXXDCdVXLN1XIv4u fkihDDsT/E22Be+3HoW0Z9r3uW4PCAe2td92N4nRMUZR0KRnju2qwOkXWJDN4TYG Sp/xfAeqpURY8sBHB6cQj/L3Q8zd5DHD72MGLvZk32BOJXfUubTjLI7Zdn15cUci hiz6XTzINn4ft/C8Y8qqBcrrD3BkMSkufIdBn3m9JmXlDLDdg7vmPomf8tOPIKo7 3SaU8nrt/N6D/CnSjQ09SRX+URyeTWYzkv3kyZIMDnE7XbktF5MZYL5Qm/Tahk7t 7ehpYiwP/OJ3HtiZqmdmupffECM/AYKO5srgr70znuvSxwEEEC6MDsBunrJfymfF GZiK5OTPGBdLzYOHcTSe2bHofswr514cyTttw0rTekI5Rsp1ycpbQjfiLtT3FUfU Ymhz8jEHLLLOf4uFGF02C4cJrrkhe/SuNv9LFXZvblswyyvF3U0rSubCUC1W6b+w dlqYe+HzlM1wEM2+2JYHzC0SdLE/G30lo3Ecu1HDYGPgxmJlw38QzIgnSwNODVhy dYAfTPyGcOqCr6WeFKtb =ff1A -----END PGP SIGNATURE-----