From owner-freebsd-hackers Fri Aug 24 20:32:29 2001 Delivered-To: freebsd-hackers@freebsd.org Received: from femail33.sdc1.sfba.home.com (femail33.sdc1.sfba.home.com [24.254.60.23]) by hub.freebsd.org (Postfix) with ESMTP id F34D237B40F for ; Fri, 24 Aug 2001 20:32:25 -0700 (PDT) (envelope-from europax@home.com) Received: from home.com ([24.12.186.185]) by femail33.sdc1.sfba.home.com (InterMail vM.4.01.03.20 201-229-121-120-20010223) with ESMTP id <20010825033225.HRTD4276.femail33.sdc1.sfba.home.com@home.com>; Fri, 24 Aug 2001 20:32:25 -0700 Message-ID: <3B871C39.1CCC2030@home.com> Date: Fri, 24 Aug 2001 20:32:09 -0700 From: Rob X-Mailer: Mozilla 4.76 [en] (X11; U; FreeBSD 4.3-STABLE i386) X-Accept-Language: en MIME-Version: 1.0 To: Julian Elischer Cc: "hackers@FreeBSD.ORG" Subject: Re: running diff on huge files References: Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit Sender: owner-freebsd-hackers@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.ORG Julian Elischer wrote: > > On Fri, 24 Aug 2001, Rob wrote: > > > Rob wrote: > > > > > > I am trying to run diff on two huge files (220M) and I run out of swap > > > space. Is there another alternative? I have a Python script that does > > > something similar, but works on huge files, but it is much slower than > > > diff. Thanks, Rob. > > > > > > To Unsubscribe: send mail to majordomo@FreeBSD.org > > > with "unsubscribe freebsd-hackers" in the body of the message > > > > > > split -b 50000k put the files into managable size. Rob. > > doesn't work for files that have diffs across the 50k boundary.. > you need a streaming diff... > > Interestingly this is not impossible.. you may be able to make one > read the sources to diff. > :-) It worked out OK. But I'll have to take an extra look at the file boundaries in the future. Rob. To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-hackers" in the body of the message