From owner-freebsd-questions@FreeBSD.ORG Sun Oct 11 08:11:57 2009 Return-Path: Delivered-To: freebsd-questions@FreeBSD.ORG Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id C92FF1065695 for ; Sun, 11 Oct 2009 08:11:57 +0000 (UTC) (envelope-from kline@thought.org) Received: from aristotle.thought.org (aristotle.thought.org [209.180.213.210]) by mx1.freebsd.org (Postfix) with ESMTP id 6956D8FC16 for ; Sun, 11 Oct 2009 08:11:57 +0000 (UTC) Received: from thought.org (tao.thought.org [10.47.0.250]) (authenticated bits=0) by aristotle.thought.org (8.14.2/8.14.2) with ESMTP id n9B89vJk010799 for ; Sun, 11 Oct 2009 01:09:58 -0700 (PDT) (envelope-from kline@thought.org) Received: by thought.org (nbSMTP-1.00) for uid 1002 kline@thought.org; Sun, 11 Oct 2009 01:11:52 -0700 (PDT) Date: Sun, 11 Oct 2009 01:11:52 -0700 From: Gary Kline To: freebsd-questions@FreeBSD.ORG Message-ID: <20091011081151.GA98601@thought.org> References: <20091009083516.GA60096@thought.org> <200910091026.n99AQPUv014685@lurza.secnetix.de> Mime-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: <200910091026.n99AQPUv014685@lurza.secnetix.de> User-Agent: Mutt/1.4.2.3i X-Organization: Thought Unlimited. Public service Unix since 1986. X-Of_Interest: With 23 years of service to the Unix community. X-Spam-Status: No, score=-4.4 required=3.6 tests=ALL_TRUSTED,BAYES_00 autolearn=ham version=3.2.3 X-Spam-Checker-Version: SpamAssassin 3.2.3 (2007-08-08) on aristotle.thought.org Cc: Subject: Re: for perl wizards. X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 11 Oct 2009 08:11:57 -0000 On Fri, Oct 09, 2009 at 12:26:25PM +0200, Oliver Fromme wrote: > Gary Kline wrote: > > > > Whenever I save a wordpeocessoe file [OOo, say] into a > > text file, I get a slew of hex codes to indicate the char to be > > used. I'm looking for a perl one-liner or script to translate > > hex back into ', ", -- [that's a dash), and so forth. Why does > > this fail to trans the hex code to an apostrophe? > > > > perl -pi.bak -e 's/\xe2\x80\x99/'/g' > > You need to escape the inner quote character, of course. > I think sed is better suited for this task than perl. > > > If there any another other tools, I'm interested! > > That "hex code" rather looks like UTF-8. > > For conversion between character encodings I recommend recode > from the ports collection (ports/converters/recode). > For example, to convert file.txt from UTF-8 to ISO8859-15: > > $ recode utf8..iso8859-15 file.txt > > To preserve the previous file contents, do this: > > $ recode utf8..iso8859-15 new.txt recode works just fine, thanks. i'm not sure if openoffice asks to use 8859-1 or utf8, but yes, the text is interspersperced with bits of utf8. FWIW, I did check this on google before my post; still couldn't find anything that worked. and of course, above, with the " ' " i did try escaping the punctuation. my shell gave me problems regardless. dunno ... so i asked here:-) thanks to everyone, gary > > Best regards > Oliver > > -- > Oliver Fromme, secnetix GmbH & Co. KG, Marktplatz 29, 85567 Grafing b. M. > Handelsregister: Registergericht Muenchen, HRA 74606, Geschäftsfuehrung: > secnetix Verwaltungsgesellsch. mbH, Handelsregister: Registergericht Mün- > chen, HRB 125758, Geschäftsführer: Maik Bachmann, Olaf Erb, Ralf Gebhart > > FreeBSD-Dienstleistungen, -Produkte und mehr: http://www.secnetix.de/bsd > > "Python tricks" is a tough one, cuz the language is so clean. E.g., > C makes an art of confusing pointers with arrays and strings, which > leads to lotsa neat pointer tricks; APL mistakes everything for an > array, leading to neat one-liners; and Perl confuses everything > period, making each line a joyous adventure . > -- Tim Peters -- Gary Kline kline@thought.org http://www.thought.org Public Service Unix http://jottings.thought.org http://transfinite.thought.org The 7.31a release of Jottings: http://jottings.thought.org/index.php