Date: Mon, 7 Nov 2005 11:19:45 +0700 (ICT) From: Olivier Nicole <on@cs.ait.ac.th> To: kirk@strauser.com Cc: freebsd-questions@freebsd.org Subject: Re: Fast diff command for large files? Message-ID: <200511070419.jA74JjS7068019@banyan.cs.ait.ac.th> In-Reply-To: <200511041129.17912.kirk@strauser.com> (message from Kirk Strauser on Fri, 4 Nov 2005 11:29:12 -0600) References: <200511040956.19087.kirk@strauser.com> <436B8ADF.4000703@mac.com> <200511041129.17912.kirk@strauser.com>
next in thread | previous in thread | raw e-mail | index | archive | help
> We do the mirroring by running a program that dumps the FoxPro > tables out as tab-delimited files. Thus far, we'd been using > PostgreSQL's "copy from" command to read those files into the > database. In reality, though, a very, very small percentage of > rows in those tables actually change. So, I wrote a program > that takes the output of diff and converts it into a series of I think the problem could be considered another way. if you have access to the "legacy/FoxPro" application, it should be modifed to add a timestamp to each reccord modification. Then you could only dump those reccords that were modified since the last change. That seems to me the only long term viable solution that could sizeup nicely with your set of data. Not to mention that once implemented it would be much much faster. Olivier
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?200511070419.jA74JjS7068019>