From owner-freebsd-stable@freebsd.org Sat Nov 28 23:11:00 2015 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id DB487A3B6FF for ; Sat, 28 Nov 2015 23:11:00 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id B2BAD17CA for ; Sat, 28 Nov 2015 23:11:00 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) Received: by mailman.ysv.freebsd.org (Postfix) id B1EC2A3B6FD; Sat, 28 Nov 2015 23:11:00 +0000 (UTC) Delivered-To: stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id B04A5A3B6FC; Sat, 28 Nov 2015 23:11:00 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) Received: from esa-jnhn.mail.uoguelph.ca (esa-jnhn.mail.uoguelph.ca [131.104.91.44]) by mx1.freebsd.org (Postfix) with ESMTP id 5409017BE; Sat, 28 Nov 2015 23:10:59 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) IronPort-PHdr: 9a23:7GhgDxaV+FtbiaHoA8T7dwf/LSx+4OfEezUN459isYplN5qZpcu8bnLW6fgltlLVR4KTs6sC0LqL9fC9EjVcuN6oizMrTt9lb1c9k8IYnggtUoauKHbQC7rUVRE8B9lIT1R//nu2YgB/Ecf6YEDO8DXptWZBUiv2OQc9HOnpAIma153xjLDvvc2OKFwU3XKUWvBbElaflU3prM4YgI9veO4a6yDihT92QdlQ3n5iPlmJnhzxtY+a9Z9n9DlM6bp6r5YTGY2zRakzTKRZATI6KCh1oZSz7ViQBTeIs1kdVmEbiVJ0AQ/I6BL3RN+lsCr+sudm8DKGNMb1C7YwD2eM9aBuHSXpgyRPEjcy82Xaj4QklqdSqxGlqhlX3onbfYyRLPo4daqLLoBSfnZIQssED38JOYi7dYZaSrNZZes= X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: A2DQAQBfM1pW/61jaINdhA5vBr4bAQ2BZhcKhSRKAkyBDxQBAQEBAQEBAYEJgi2CBwEBAQMBAQEBIAQnIAsFCwIBCBMFAgINGQICJwEJJgIECAcEARwEiAUIDakvj0ABAQEBAQEBAQEBAQEBAQEBAQEBGoEBhVOEfoQ7AQEFgzOBRAWOGIg/hSqFIoUQmjsCHwEBQoIRHYF0IDQHhCk6gQcBAQE X-IronPort-AV: E=Sophos;i="5.20,358,1444708800"; d="scan'208";a="253183225" Received: from nipigon.cs.uoguelph.ca (HELO zcs1.mail.uoguelph.ca) ([131.104.99.173]) by esa-jnhn.mail.uoguelph.ca with ESMTP; 28 Nov 2015 18:10:58 -0500 Received: from localhost (localhost [127.0.0.1]) by zcs1.mail.uoguelph.ca (Postfix) with ESMTP id C7DFB15F5E4; Sat, 28 Nov 2015 18:10:58 -0500 (EST) Received: from zcs1.mail.uoguelph.ca ([127.0.0.1]) by localhost (zcs1.mail.uoguelph.ca [127.0.0.1]) (amavisd-new, port 10032) with ESMTP id Bz7UTgeI6pCk; Sat, 28 Nov 2015 18:10:58 -0500 (EST) Received: from localhost (localhost [127.0.0.1]) by zcs1.mail.uoguelph.ca (Postfix) with ESMTP id 2E07715F5E9; Sat, 28 Nov 2015 18:10:58 -0500 (EST) X-Virus-Scanned: amavisd-new at zcs1.mail.uoguelph.ca Received: from zcs1.mail.uoguelph.ca ([127.0.0.1]) by localhost (zcs1.mail.uoguelph.ca [127.0.0.1]) (amavisd-new, port 10026) with ESMTP id CpEvMSxdw0s4; Sat, 28 Nov 2015 18:10:58 -0500 (EST) Received: from zcs1.mail.uoguelph.ca (zcs1.mail.uoguelph.ca [172.17.95.18]) by zcs1.mail.uoguelph.ca (Postfix) with ESMTP id 135D015F5E4; Sat, 28 Nov 2015 18:10:58 -0500 (EST) Date: Sat, 28 Nov 2015 18:10:58 -0500 (EST) From: Rick Macklem To: Jilles Tjoelker Cc: "Mikhail T." , freebsd-fs , stable@freebsd.org Message-ID: <1399144047.110083450.1448752258051.JavaMail.zimbra@uoguelph.ca> In-Reply-To: <20151128224101.GA8470@stack.nl> References: <5659CB64.5020105@aldan.algebra.com> <20151128224101.GA8470@stack.nl> Subject: Re: cp from NFS to ZFS hung in "fifoor" MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [172.17.95.11] X-Mailer: Zimbra 8.0.9_GA_6191 (ZimbraWebClient - FF34 (Win)/8.0.9_GA_6191) Thread-Topic: cp from NFS to ZFS hung in "fifoor" Thread-Index: HxYXiQVyopzcEgTBG1wBftCEbqqH5w== X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 28 Nov 2015 23:11:00 -0000 Jilles Tjoelker wrote: > On Sat, Nov 28, 2015 at 10:42:28AM -0500, Mikhail T. wrote: > > I was copying /home from an old server (narawntapu) to a new one > > (aldan). The narawntapu:/home is mounted on aldan as /mnt with flags > > ro,intr. On narawntapu /home was simply located on an SSD, but on aldan > > I created a ZFS filesystem for it. > > > The copying was started thus: > > > root@aldan:/home (435) cp -Rpn /mnt/* . > > > for a while this was proceeding at a decent clip with cp making > > newnfsreq-uests: > > > load: 0.78 cmd: cp 38711 [newnfsreq] 802.84r 1.57u 140.63s 20% 10768k > > /mnt/mi/.kde/share/apps/kmail/dimap/.42838394.directory/sent/cur/1219621413.32392.hd8cl:2,S > > -> > > ./mi/.kde/share/apps/kmail/dimap/.42838394.directory/sent/cur/1219621413.32392.hd8cl:2,S > > 100% > > load: 1.23 cmd: cp 38711 [newnfsreq] 874.19r 1.66u 154.74s 17% 4576k > > /mnt/mi/.kde/share/apps/kmail/dimap/.42838394.directory/ML/cur/1219595347.32392.rMDFf:2,S > > -> > > ./mi/.kde/share/apps/kmail/dimap/.42838394.directory/ML/cur/1219595347.32392.rMDFf:2,S > > 100% > > > ZFS on the destination compressing and writing stuff out and the traffic > > between the two ranging from 30 to 50Mb/s (according to systat), but > > then something happened and the cp-process is now hung: > > > load: 0.55 cmd: cp 38711 [fifoor] 1107.67r 2.09u 194.12s 0% 3300k > > load: 0.50 cmd: cp 38711 [fifoor] 1112.66r 2.09u 194.12s 0% 3300k > > load: 0.22 cmd: cp 38711 [fifoor] 1642.37r 2.09u 194.12s 0% 3300k > > This normally means that the process is opening a fifo for reading and > is waiting for a writer. Although cp -R will normally copy a fifo by > calling mkfifo at the destination, it may open one if a regular file is > replaced with a fifo between the time it reads the directory and it > copies that file. This is not that unlikely if large directory trees are > copied during that time. > Oops, thanks. I didn't know that [fifoor] in these lines meant that was what the WCHAN is. Obviously, you should now ignore everything I said;-) rick > On the other hand, cp without -R/-r/-l/-s will always open a fifo. > > You can make cp continue by opening the fifo (which you'll need to find > first, for example by checking what has been copied already) for > writing, like : >/path/to/some/fifo. It will be replaced with an empty > file at the destination. > > -- > Jilles Tjoelker > _______________________________________________ > freebsd-stable@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-stable > To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.org" >