From owner-freebsd-questions@FreeBSD.ORG Fri Oct 31 16:14:52 2008 Return-Path: Delivered-To: freebsd-questions@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 510381065677 for ; Fri, 31 Oct 2008 16:14:52 +0000 (UTC) (envelope-from erikt@midgard.homeip.net) Received: from ch-smtp01.sth.basefarm.net (ch-smtp01.sth.basefarm.net [80.76.149.212]) by mx1.freebsd.org (Postfix) with ESMTP id CF4818FC1D for ; Fri, 31 Oct 2008 16:14:51 +0000 (UTC) (envelope-from erikt@midgard.homeip.net) Received: from c83-255-48-78.bredband.comhem.se ([83.255.48.78]:57138 helo=falcon.midgard.homeip.net) by ch-smtp01.sth.basefarm.net with esmtp (Exim 4.68) (envelope-from ) id 1KvweA-0006Pj-3l for freebsd-questions@freebsd.org; Fri, 31 Oct 2008 17:14:50 +0100 Received: (qmail 62331 invoked from network); 31 Oct 2008 17:14:49 +0100 Received: from owl.midgard.homeip.net (10.1.5.7) by falcon.midgard.homeip.net with ESMTP; 31 Oct 2008 17:14:49 +0100 Received: (qmail 32374 invoked by uid 1001); 31 Oct 2008 17:14:49 +0100 Date: Fri, 31 Oct 2008 17:14:49 +0100 From: Erik Trulsson To: Jeremy Chadwick Message-ID: <20081031161449.GA31919@owl.midgard.homeip.net> References: <490AC650.3000904@kukulies.org> <20081031110159.GA30244@icarus.home.lan> <490B17D2.6010000@kukulies.org> <20081031151307.GA34850@icarus.home.lan> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20081031151307.GA34850@icarus.home.lan> User-Agent: Mutt/1.5.18 (2008-05-17) X-Originating-IP: 83.255.48.78 X-Scan-Result: No virus found in message 1KvweA-0006Pj-3l. X-Scan-Signature: ch-smtp01.sth.basefarm.net 1KvweA-0006Pj-3l 3c32a7401cb303694d79bb4f5f2683ad Cc: Christoph Kukulies , Ivan Voras , freebsd-questions@freebsd.org Subject: Re: fastest raw device copy? X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 31 Oct 2008 16:14:52 -0000 On Fri, Oct 31, 2008 at 08:13:07AM -0700, Jeremy Chadwick wrote: > On Fri, Oct 31, 2008 at 03:36:02PM +0100, Christoph Kukulies wrote: > > Ivan Voras schrieb: > >> Jeremy Chadwick wrote: > >> > >>> On Fri, Oct 31, 2008 at 09:48:16AM +0100, Christoph Kukulies wrote: > >>> > >> > >> > >>>> What would be the fastest way to do that sector by sector copy? I'm > >>>> using dd right now, > >>>> > >>>> dd if=/dev/ad0 of=/dev/da0 bs=10000000 > >>>> > >> > >> > >>> On the flip side, your blocksize (bs) there is quite high for no good > >>> reason. I'd pick something more like bs=64k or bs=128k. The default > >>> (512) is too small for what you want, but 10MBytes is silly. > >>> > >> > >> Not only that, but "10000000" isn't even correct - it needs to be a > >> multiple of sector size. Generally, using suffixes will do the right thing: > >> > >> dd if=/dev/ad0 of=/dev/da0 bs=1m > >> > >> > > OK, I understand that 10000000 isn't good, I just thought it wouldn't > > harm. But if it is a transfer rate killer then I'd better think of > > typing ^C now. The command is running for 6 hours now. > > Six hours? Hmm... That seems too long, but of course the FreeBSD USB > stack is involved, and a USB device in general. I would have assumed > that copy should have finished after 2-3 hours tops. 2-3 hours is about the *minimum* amount of time needed to read all of a large modern disk - and that is when you do the transfer over SATA/IDE. Over USB it will be significantly slower. A modern, fairly fast disk has an average sequential transfer rate of around 60MB/s (higher on the outer tracks, and lower on the innermost track, but the average will come out to about that.) Assume a 500GB disk. Then we get 500GB/(60MB/s) = 500*1000/60 s = 8333s = 2h18min to read all of it. Over USB you probably will not get much more than 20-25MB/s. 20MB/s is exactly a third of the 60MB/s we used earlier gives a total time of 3*(2h18min) ~= 7h. Those 6 hours do not sound unreasonable at all. (All of this assumes just reading the disk from start to end. If you need to seek back and forth it will take even longer.) -- Erik Trulsson ertr1013@student.uu.se