From owner-freebsd-fs@FreeBSD.ORG Mon Jan 7 20:24:55 2013 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by hub.freebsd.org (Postfix) with ESMTP id 5D43A7DB for ; Mon, 7 Jan 2013 20:24:55 +0000 (UTC) (envelope-from marck@rinet.ru) Received: from woozle.rinet.ru (woozle.rinet.ru [195.54.192.68]) by mx1.freebsd.org (Postfix) with ESMTP id E1A45384 for ; Mon, 7 Jan 2013 20:24:54 +0000 (UTC) Received: from localhost (localhost [127.0.0.1]) by woozle.rinet.ru (8.14.5/8.14.5) with ESMTP id r07KJFXv008880 for ; Tue, 8 Jan 2013 00:19:15 +0400 (MSK) (envelope-from marck@rinet.ru) Date: Tue, 8 Jan 2013 00:19:15 +0400 (MSK) From: Dmitry Morozovsky To: freebsd-fs@freebsd.org Subject: zfs -> ufs rsync: livelock in wdrain state Message-ID: User-Agent: Alpine 2.00 (BSF 1167 2008-08-23) X-NCC-RegID: ru.rinet X-OpenPGP-Key-ID: 6B691B03 MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.2.7 (woozle.rinet.ru [0.0.0.0]); Tue, 08 Jan 2013 00:19:15 +0400 (MSK) X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 07 Jan 2013 20:24:55 -0000 Dear colleagues, I have archive server with pretty large ZFS (24*2T in single raidz2 raidgroup) Sometimes we moved really old archives to external SATA drives, which are formatted with UFS2/SU. Files are copied via rsync The system in question is stable/8; upgrade to stable/9 is planned, but not yet completed. Now, during last rsync, the process is stuck as dump.2012062219.bin.gz 3208015437 100% 102.42MB/s 0:00:29 (xfer#66, to-check=196/721) dump.2012062220.bin.gz load: 0.01 cmd: rsync 47543 [wdrain] 1904.69r 443.01u 241.12s 0% 1736k ^C rsync error: received SIGINT, SIGTERM, or SIGHUP (code 20) at rsync.c(645) [sender=3.0.9] As we can see, rsync writer stops in wdrain state. I terminated it by ^C in terminal session, as it was not autogenerated backup. Now, zfs and other system is working seemingly well, but trying to sync manually stucks console forever: root@moose:/ar# sync load: 0.00 cmd: sync 67229 [wdrain] 468.17r 0.00u 0.00s 0% 596k Any hints? Quick searching throug freebsd mailing lists and/or open PRs does not reveal much. Thanks! -- Sincerely, D.Marck [DM5020, MCK-RIPE, DM3-RIPN] [ FreeBSD committer: marck@FreeBSD.org ] ------------------------------------------------------------------------ *** Dmitry Morozovsky --- D.Marck --- Wild Woozle --- marck@rinet.ru *** ------------------------------------------------------------------------