From owner-freebsd-questions@FreeBSD.ORG Sat Jun 24 16:00:54 2006 Return-Path: X-Original-To: freebsd-questions@freebsd.org Delivered-To: freebsd-questions@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 4FFFE16A50C for ; Sat, 24 Jun 2006 16:00:54 +0000 (UTC) (envelope-from nikolas.britton@gmail.com) Received: from nz-out-0102.google.com (nz-out-0102.google.com [64.233.162.206]) by mx1.FreeBSD.org (Postfix) with ESMTP id 6487643D5A for ; Sat, 24 Jun 2006 16:00:43 +0000 (GMT) (envelope-from nikolas.britton@gmail.com) Received: by nz-out-0102.google.com with SMTP id i11so858128nzi for ; Sat, 24 Jun 2006 09:00:42 -0700 (PDT) DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=beta; d=gmail.com; h=received:message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; b=dwkNX2HDawRmA1JpAjGhf5Bxt8iyY+3BgbCKPtPACIZMrO41X0dmo8t5ZOVZcEaozMBvMFjIiaGYFii9KLuk1CphFhZojYd+g613CnWV3XCtR50pVbMVkJmbct0RFDrMS2I0PxpHIuqdTjLt3HjyhLxh4WDY+9tVBav97gVwAs0= Received: by 10.36.224.2 with SMTP id w2mr1306456nzg; Sat, 24 Jun 2006 09:00:42 -0700 (PDT) Received: by 10.36.12.11 with HTTP; Sat, 24 Jun 2006 09:00:42 -0700 (PDT) Message-ID: Date: Sat, 24 Jun 2006 09:00:42 -0700 From: "Nikolas Britton" To: "Dan Nelson" In-Reply-To: MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Content-Disposition: inline References: <20060624023139.GA83209@dan.emsphone.com> Cc: FreeBSD Mailing List Subject: Re: help with 'tar|rsh tar' X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 24 Jun 2006 16:00:54 -0000 On 6/23/06, Nikolas Britton wrote: > On 6/23/06, Dan Nelson wrote: > > In the last episode (Jun 23), Nikolas Britton said: > > > I need to backup the /data directory on hostA to /data on hostB, > > > about 1TB of data on a gigabit link. Right now I'm using scp but the > > > handshake latency and ssh overhead is killing me. > > > > > > I've looked at many examples of tar|rsh tar and I can't figure it out, > > > most of the examples on the net look like this: > > > # tar cf - . | rsh hostname dd of=tape-device obs=20b > > > # tar -cf -...|rsh ...tar xf -... > > > > Two quick options even more lightweight than rsh are netcat (base > > system) and ttcp (in ports). Usage examples: > > > > host2$ ttcp -r | tar xvf - > > host1$ tar cf - . | ttcp -t host2 > > > > host2$ nc -l 1234 | tar xvf - > > host1$ tar cf - . | nc host2 1234 > > > > Thanks!, but I got rsh going. I first had to edit /etc/hosts.equiv, > after that I figured it out: > > tar cf - . | rsh 192.168.1.242 'cd /data; tar xpvf -' > > I was thinking tar -f as in file.tar but it's not, you have to cd into > the source directory you want to copy... anyways... I'm getting around > 30MB/s now... it should be in the 50-60MB/s range... Good enough for > now though. Thanks again... > hostA = P4 3GHz Prescott, Intel 82547EI GigE, FreeBSD 6.1/i386. hostB = Athlon64 3000, Marvell Yukon Lite GigE, FreeBSD 6.1/amd64. Anyone know why load is so high on hostA, is it because I used tar -v? top shows: hostA: ------ last pid: 21138; load averages: 1.62, 1.34, 1.27 up 25+04:06:44 10:35:54 65 processes: 2 running, 63 sleeping CPU states: 0.0% user, 1.5% nice, 26.2% system, 61.4% interrupt, 10.9% idle Mem: 189M Active, 573M Inact, 178M Wired, 51M Cache, 111M Buf, 1652K Free Swap: 6144M Total, 1012K Used, 6143M Free PID USERNAME THR PRI NICE SIZE RES STATE TIME WCPU COMMAND 18698 nbritton 1 130 20 1292K 832K RUN 171:46 28.12% rsh 18696 nbritton 1 -4 -20 1588K 1068K getblk 48:25 6.88% bsdtar hostB: ------ last pid: 9169; load averages: 0.66, 0.65, 0.60 up 0+15:57:38 15:44:02 32 processes: 1 running, 31 sleeping CPU states: 2.6% user, 0.0% nice, 12.4% system, 36.1% interrupt, 48.9% idle Mem: 26M Active, 126M Inact, 51M Wired, 13M Cache, 34M Buf, 644K Free Swap: 483M Total, 480K Used, 482M Free, 8K In PID USERNAME THR PRI NICE SIZE RES STATE TIME WCPU COMMAND 7445 nbritton 1 4 -15 8112K 3288K sbwait 133:50 9.57% bsdtar -- BSD Podcasts @: http://bsdtalk.blogspot.com/ http://freebsdforall.blogspot.com/