From owner-freebsd-questions@FreeBSD.ORG Thu Oct 4 12:43:33 2007 Return-Path: Delivered-To: questions@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 0C77D16A4BF for ; Thu, 4 Oct 2007 12:43:33 +0000 (UTC) (envelope-from iaccounts@ibctech.ca) Received: from pearl.ibctech.ca (pearl.ibctech.ca [208.70.104.210]) by mx1.freebsd.org (Postfix) with ESMTP id 97BE613C46A for ; Thu, 4 Oct 2007 12:43:32 +0000 (UTC) (envelope-from iaccounts@ibctech.ca) Received: (qmail 35781 invoked by uid 1002); 4 Oct 2007 12:43:31 -0000 Received: from iaccounts@ibctech.ca by pearl.ibctech.ca by uid 89 with qmail-scanner-1.22 (spamassassin: 2.64. Clear:RC:1(208.70.104.100):. Processed in 11.386892 secs); 04 Oct 2007 12:43:31 -0000 Received: from unknown (HELO ?192.168.30.110?) (steve@ibctech.ca@208.70.104.100) by pearl.ibctech.ca with (DHE-RSA-AES256-SHA encrypted) SMTP; 4 Oct 2007 12:43:19 -0000 Message-ID: <4704DFF3.9040200@ibctech.ca> Date: Thu, 04 Oct 2007 08:43:31 -0400 From: Steve Bertrand User-Agent: Thunderbird 2.0.0.6 (Windows/20070728) MIME-Version: 1.0 To: questions@freebsd.org X-Enigmail-Version: 0.95.3 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Cc: Subject: Managing very large files X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 04 Oct 2007 12:43:33 -0000 Hi all, I've got a 28GB tcpdump capture file that I need to (hopefully) break down into a series of 100,000k lines or so, hopefully without the need of reading the entire file all at once. I need to run a few Perl processes on the data in the file, but AFAICT, doing so on the entire original file is asking for trouble. Is there any way to accomplish this, preferably with the ability to incrementally name each newly created file? TIA, Steve