From owner-freebsd-stable@FreeBSD.ORG Fri May 16 13:33:23 2014 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 6E93EAEF for ; Fri, 16 May 2014 13:33:23 +0000 (UTC) Received: from leviathan.boiteameuh.org (leviathan.boiteameuh.org [188.165.231.223]) by mx1.freebsd.org (Postfix) with ESMTP id 0777A2EFB for ; Fri, 16 May 2014 13:33:22 +0000 (UTC) Received: from [192.168.94.8] (marcellus.villenico.boiteameuh.org [192.168.94.8]) by leviathan.boiteameuh.org (Postfix) with ESMTP id C465C73B22 for ; Fri, 16 May 2014 15:21:32 +0200 (CEST) Message-ID: <5376115D.5050704@boiteameuh.org> Date: Fri, 16 May 2014 09:23:41 -0400 From: Nicolas Haller User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:24.0) Gecko/20100101 Icedove/24.5.0 MIME-Version: 1.0 To: freebsd-stable@freebsd.org Subject: gmirror + ZFS issues Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 16 May 2014 13:33:23 -0000 Hello, I've got a new server and I installed FreeBSD 10 on it. I have a problem to create a new zfs pool. The command stalls on IO wait (D state / zio->io_cv). The device for the pool is a 1.7T partition (index 4) of a gmirror device. root@daedalus:~ # uname -a FreeBSD daedalus 10.0-RELEASE-p3 FreeBSD 10.0-RELEASE-p3 #0: Tue May 13 18:31:10 UTC 2014 root@amd64-builder.daemonology.net:/usr/obj/usr/src/sys/GENERIC amd64 root@daedalus:~ # dmesg | grep ada ada0 at ahcich0 bus 0 scbus0 target 0 lun 0 ada0: ATA-8 SATA 3.x device ada0: Serial Number PN2134P6HE028P ada0: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 8192bytes) ada0: Command Queueing enabled ada0: 1907729MB (3907029168 512 byte sectors: 16H 63S/T 16383C) ada0: Previously was known as ad4 ada1 at ahcich1 bus 0 scbus1 target 0 lun 0 ada1: ATA-8 SATA 3.x device ada1: Serial Number PN2134P6HAZTVP ada1: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 8192bytes) ada1: Command Queueing enabled ada1: 1907729MB (3907029168 512 byte sectors: 16H 63S/T 16383C) ada1: Previously was known as ad6 root@daedalus:~ # gmirror status Name Status Components mirror/gm0 COMPLETE ada0 (ACTIVE) ada1 (ACTIVE) root@daedalus:~ # gpart show => 63 3907029104 mirror/gm0 MBR (1.8T) 63 3907029042 1 freebsd [active] (1.8T) 3907029105 62 - free - (31K) => 0 3907029042 mirror/gm0s1 BSD (1.8T) 0 204800000 1 freebsd-ufs (98G) 204800000 20971520 2 freebsd-swap (10G) 225771520 3681257522 4 freebsd-ufs (1.7T) So the blocked command is the following: root@daedalus:~ # zpool create tank /dev/mirror/gm0s1d root@daedalus:~ # ps -O comm,mwchan PID COMMAND MWCHAN TT STAT TIME COMMAND 1104 getty ttyin v0 Is+ 0:00.00 /usr/libexec/getty Pc ttyv0 1105 getty ttyin v1 Is+ 0:00.00 /usr/libexec/getty Pc ttyv1 1106 getty ttyin v2 Is+ 0:00.00 /usr/libexec/getty Pc ttyv2 1107 getty ttyin v3 Is+ 0:00.00 /usr/libexec/getty Pc ttyv3 1108 getty ttyin v4 Is+ 0:00.00 /usr/libexec/getty Pc ttyv4 1109 getty ttyin v5 Is+ 0:00.00 /usr/libexec/getty Pc ttyv5 1110 getty ttyin v6 Is+ 0:00.00 /usr/libexec/getty Pc ttyv6 1111 getty ttyin v7 Is+ 0:00.00 /usr/libexec/getty Pc ttyv7 85215 csh pause 2 Ss 0:00.12 /bin/csh 86210 ps - 2 R+ 0:00.00 ps -O comm,mwchan 85081 csh pause 0 Is 0:00.01 -csh (csh) 85084 screen pause 0 S+ 0:00.11 screen 85086 csh pause 1 Is 0:00.12 /bin/csh 85159 zpool zio->io_ 1 D+ 0:00.00 zpool create tank /dev/mirror/gm0s1d root@daedalus:/proc/85159 # cat status zpool 85159 1 85159 85086 pts/1 ctty 1400242849,897702 0,0 0,1876 zio->io_cv 0 0 0,0,5 - There is no activity on disks: root@daedalus:~ # iostat 1 tty ada0 ada1 pass0 cpu tin tout KB/t tps MB/s KB/t tps MB/s KB/t tps MB/s us ni sy in id 0 41 124.91 457 55.80 125.92 454 55.80 0.00 0 0.00 0 0 0 0 99 0 465 0.00 0 0.00 0.00 0 0.00 0.00 0 0.00 0 0 0 0 100 0 155 0.00 0 0.00 0.00 0 0.00 0.00 0 0.00 0 0 0 0 100 0 151 0.00 0 0.00 0.00 0 0.00 0.00 0 0.00 0 0 0 0 100 I have also a FreeBSD 9.0-RELEASE-p3 setup the same way and it works like a charm. (but not the same hardware on this one) Actually, I'm trying to zeroing the partition, we never know :-) Anyone has an idea ? Thanks, -- Nicolas Haller