From owner-freebsd-questions@freebsd.org Tue Nov 7 18:05:50 2017 Return-Path: Delivered-To: freebsd-questions@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 750D4E6051F for ; Tue, 7 Nov 2017 18:05:50 +0000 (UTC) (envelope-from byrnejb@harte-lyne.ca) Received: from inet08.hamilton.harte-lyne.ca (inet08.hamilton.harte-lyne.ca [216.185.71.28]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "inet08.hamilton.harte-lyne.ca", Issuer "CA_HLL_ISSUER_2016" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4260D7C4B3 for ; Tue, 7 Nov 2017 18:05:50 +0000 (UTC) (envelope-from byrnejb@harte-lyne.ca) Received: from localhost (localhost [127.0.0.1]) by inet08.hamilton.harte-lyne.ca (Postfix) with ESMTP id AB0AD622F2; Tue, 7 Nov 2017 13:05:48 -0500 (EST) X-Virus-Scanned: amavisd-new at harte-lyne.ca Received: from inet08.hamilton.harte-lyne.ca ([127.0.0.1]) by localhost (inet08.hamilton.harte-lyne.ca [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id FNqeCM7WB38e; Tue, 7 Nov 2017 13:05:46 -0500 (EST) Received: from webmail.harte-lyne.ca (inet04.hamilton.harte-lyne.ca [216.185.71.24]) (using TLSv1 with cipher ECDHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by inet08.hamilton.harte-lyne.ca (Postfix) with ESMTPSA id 4DDB162223; Tue, 7 Nov 2017 13:05:46 -0500 (EST) Received: from 216.185.71.44 (SquirrelMail authenticated user byrnejb_hll) by webmail.harte-lyne.ca with HTTP; Tue, 7 Nov 2017 13:05:46 -0500 Message-ID: In-Reply-To: References: Date: Tue, 7 Nov 2017 13:05:46 -0500 Subject: Re: sed - remove nul lines from file From: "James B. Byrne" To: "Tim Daneliuk" Cc: freebsd-questions@freebsd.org Reply-To: byrnejb@harte-lyne.ca User-Agent: SquirrelMail/1.4.22-5.el6 MIME-Version: 1.0 Content-Type: text/plain;charset=iso-8859-1 Content-Transfer-Encoding: 8bit X-Priority: 3 (Normal) Importance: Normal X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 07 Nov 2017 18:05:50 -0000 On Tue, November 7, 2017 12:46, Tim Daneliuk wrote: > On 11/07/2017 11:12 AM, James B. Byrne via freebsd-questions wrote: >> >> I have a data file created by an ancient proprietary scripting >> language called QTP. There is a bug in this program which, on >> occasion, manifests itself by inserting output records consisting >> entirely of nul (^@) (\x00) bytes at regular intervals. In the >> present case every 47th. record consists entirely of nuls. > > > I don't have the magic off the top of my head, but this might be a > good job for 'tr'... I have not found a way to get tr to actually delete the lines. Getting rid of all the nul characters I can do using three different ways that I know of. What I want to get rid of is the entire line. -- *** e-Mail is NOT a SECURE channel *** Do NOT transmit sensitive data via e-Mail Do NOT open attachments nor follow links sent by e-Mail James B. Byrne mailto:ByrneJB@Harte-Lyne.ca Harte & Lyne Limited http://www.harte-lyne.ca 9 Brockley Drive vox: +1 905 561 1241 Hamilton, Ontario fax: +1 905 561 0757 Canada L8E 3C3