From owner-freebsd-fs@FreeBSD.ORG Thu May 15 13:00:54 2014 Return-Path: Delivered-To: freebsd-fs@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 6BD85131 for ; Thu, 15 May 2014 13:00:54 +0000 (UTC) Received: from smtp1.multiplay.co.uk (smtp1.multiplay.co.uk [85.236.96.35]) by mx1.freebsd.org (Postfix) with ESMTP id 3127A2580 for ; Thu, 15 May 2014 13:00:53 +0000 (UTC) Received: by smtp1.multiplay.co.uk (Postfix, from userid 65534) id 3080220E7088A; Thu, 15 May 2014 13:00:53 +0000 (UTC) X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on smtp1.multiplay.co.uk X-Spam-Level: ** X-Spam-Status: No, score=2.2 required=8.0 tests=AWL,BAYES_00,DOS_OE_TO_MX, FSL_HELO_NON_FQDN_1,HELO_NO_DOMAIN,RDNS_DYNAMIC,STOX_REPLY_TYPE autolearn=no version=3.3.1 Received: from r2d2 (82-69-141-170.dsl.in-addr.zen.co.uk [82.69.141.170]) by smtp1.multiplay.co.uk (Postfix) with ESMTPS id 10ABF20E70885; Thu, 15 May 2014 13:00:49 +0000 (UTC) Message-ID: <14010473114D42CC92756838300EEE64@multiplay.co.uk> From: "Steven Hartland" To: "Radim Kolar" , References: <201405151240.s4FCe1Hw087808@freefall.freebsd.org> Subject: Re: kern/189355: zfs panic on 10-stable Date: Thu, 15 May 2014 14:00:44 +0100 MIME-Version: 1.0 Content-Type: text/plain; format=flowed; charset="iso-8859-1"; reply-type=original Content-Transfer-Encoding: 7bit X-Priority: 3 X-MSMail-Priority: Normal X-Mailer: Microsoft Outlook Express 6.00.2900.5931 X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2900.6157 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 15 May 2014 13:00:54 -0000 ----- Original Message ----- From: "Radim Kolar" snip > #11 0xc0cb801e in vdev_queue_io_to_issue (vq=3D0xc46a4b00) > at /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/f= > s/zfs/vdev_queue.c:471 > #12 0xc0cb7fb8 in vdev_queue_io (zio=3D0xc4855000) > at /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/f= > s/zfs/vdev_queue.c:744 > #13 0xc0cd84ee in zio_vdev_io_start (ziop=3D) > at /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/f= > s/zfs/zio.c:2607 > #14 0xc0cd4c18 in zio_execute (zio=3D0xc4855000) > at /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/f= > s/zfs/zio.c:1350 > #15 0xc0cb74e4 in vdev_mirror_io_start (zio=3D0xc4823894) > at /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/f= > s/zfs/vdev_mirror.c:284 Its not totally clear as the faulting line shouldn't ever do so but I suspect you may be seeing corruption earlier on due to some edge cases in the new queing code. This could be something that has already has a fixed in head but wasn't expected to get triggered without TRIM queueing which isn't in 10-stable yet. The fix is also likely to change based on feedback from the openzfs guys, hence isn't in 10-stable yet. Can you try appling the following patches from head to your 10-stable and see if that helps:- http://svnweb.freebsd.org/base?view=revision&revision=265046 http://svnweb.freebsd.org/base?view=revision&revision=265321 Regards Steve