From owner-freebsd-bugs@FreeBSD.ORG Mon Mar 10 11:40:01 2014 Return-Path: Delivered-To: freebsd-bugs@smarthost.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 6E58831D for ; Mon, 10 Mar 2014 11:40:01 +0000 (UTC) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2001:1900:2254:206c::16:87]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 324A3C5A for ; Mon, 10 Mar 2014 11:40:01 +0000 (UTC) Received: from freefall.freebsd.org (localhost [127.0.0.1]) by freefall.freebsd.org (8.14.8/8.14.8) with ESMTP id s2ABe1r9055846 for ; Mon, 10 Mar 2014 11:40:01 GMT (envelope-from gnats@freefall.freebsd.org) Received: (from gnats@localhost) by freefall.freebsd.org (8.14.8/8.14.8/Submit) id s2ABe1gF055845; Mon, 10 Mar 2014 11:40:01 GMT (envelope-from gnats) Resent-Date: Mon, 10 Mar 2014 11:40:01 GMT Resent-Message-Id: <201403101140.s2ABe1gF055845@freefall.freebsd.org> Resent-From: FreeBSD-gnats-submit@FreeBSD.org (GNATS Filer) Resent-To: freebsd-bugs@FreeBSD.org Resent-Reply-To: FreeBSD-gnats-submit@FreeBSD.org, Gordon Yeu Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 7FF76317 for ; Mon, 10 Mar 2014 11:39:39 +0000 (UTC) Received: from cgiserv.freebsd.org (cgiserv.freebsd.org [IPv6:2001:1900:2254:206a::50:4]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 6E05CC54 for ; Mon, 10 Mar 2014 11:39:39 +0000 (UTC) Received: from cgiserv.freebsd.org ([127.0.1.6]) by cgiserv.freebsd.org (8.14.8/8.14.8) with ESMTP id s2ABddcr069148 for ; Mon, 10 Mar 2014 11:39:39 GMT (envelope-from nobody@cgiserv.freebsd.org) Received: (from nobody@localhost) by cgiserv.freebsd.org (8.14.8/8.14.8/Submit) id s2ABddJS069144; Mon, 10 Mar 2014 11:39:39 GMT (envelope-from nobody) Message-Id: <201403101139.s2ABddJS069144@cgiserv.freebsd.org> Date: Mon, 10 Mar 2014 11:39:39 GMT From: Gordon Yeu To: freebsd-gnats-submit@FreeBSD.org X-Send-Pr-Version: www-3.1 Subject: kern/187414: ZFS Write Deadlock X-BeenThere: freebsd-bugs@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: Bug reports List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 10 Mar 2014 11:40:01 -0000 >Number: 187414 >Category: kern >Synopsis: ZFS Write Deadlock >Confidential: no >Severity: non-critical >Priority: low >Responsible: freebsd-bugs >State: open >Quarter: >Keywords: >Date-Required: >Class: sw-bug >Submitter-Id: current-users >Arrival-Date: Mon Mar 10 11:40:00 UTC 2014 >Closed-Date: >Last-Modified: >Originator: Gordon Yeu >Release: 8.4-STABLE >Organization: >Environment: FreeBSD kmd.twbbs.org 8.4-STABLE FreeBSD 8.4-STABLE #6 r262357: Sun Feb 23 18:38:39 CST 2014 root@kmd.twbbs.org:/usr/obj/usr/src/sys/MERCURY amd64 >Description: Just did a periodical update to 8.4-STABLE r262357 on a self-build home server. The only change I did after update is upgrade zpool version to latest (version 28). My zpool is in mirror configuration, built from dual Seagate 3TB hard drives (ST3000DM001). Moving large files in ~4GB size hangs the target directory, and Bonnie++ leads to deadlock as well. So I believe it was caused by large write operations. Here are logs for both cases. mv: procstat -kk -a http://pastebin.com/WManZzbv bonnie++: procstat -kk -a http://pastebin.com/fe2bmbbY bonnie++: kgdb (thread apply all bt) http://pastebin.com/kdm5xQwM >How-To-Repeat: run bonnie++ and set -d scratch-dir on ZFS. >Fix: >Release-Note: >Audit-Trail: >Unformatted: