From owner-freebsd-arch@FreeBSD.ORG Wed Jul 30 05:54:46 2014 Return-Path: Delivered-To: freebsd-arch@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id BE5087A3 for ; Wed, 30 Jul 2014 05:54:46 +0000 (UTC) Received: from na01-bn1-obe.outbound.protection.outlook.com (mail-bn1blp0188.outbound.protection.outlook.com [207.46.163.188]) (using TLSv1 with cipher ECDHE-RSA-AES256-SHA (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "MSIT Machine Auth CA 2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 6040C2CCC for ; Wed, 30 Jul 2014 05:54:45 +0000 (UTC) Received: from BY2PR05CA051.namprd05.prod.outlook.com (10.141.250.41) by DM2PR05MB736.namprd05.prod.outlook.com (10.141.178.25) with Microsoft SMTP Server (TLS) id 15.0.995.14; Wed, 30 Jul 2014 05:54:36 +0000 Received: from BL2FFO11FD025.protection.gbl (2a01:111:f400:7c09::139) by BY2PR05CA051.outlook.office365.com (2a01:111:e400:2c5f::41) with Microsoft SMTP Server (TLS) id 15.0.995.14 via Frontend Transport; Wed, 30 Jul 2014 05:54:36 +0000 Received: from P-EMF02-SAC.jnpr.net (66.129.239.16) by BL2FFO11FD025.mail.protection.outlook.com (10.173.161.104) with Microsoft SMTP Server (TLS) id 15.0.990.10 via Frontend Transport; Wed, 30 Jul 2014 05:54:35 +0000 Received: from magenta.juniper.net (172.17.27.123) by P-EMF02-SAC.jnpr.net (172.24.192.21) with Microsoft SMTP Server (TLS) id 14.3.146.0; Tue, 29 Jul 2014 22:54:33 -0700 Received: from chaos.jnpr.net (chaos.jnpr.net [172.21.16.28]) by magenta.juniper.net (8.11.3/8.11.3) with ESMTP id s6U5sUn83834; Tue, 29 Jul 2014 22:54:31 -0700 (PDT) (envelope-from sjg@juniper.net) Received: from chaos (localhost [127.0.0.1]) by chaos.jnpr.net (Postfix) with ESMTP id A78B1580A2; Tue, 29 Jul 2014 22:54:30 -0700 (PDT) To: Garance A Drosehn Subject: Re: XML Output: libxo - provide single API to output TXT, XML, JSON and HTML In-Reply-To: <1092D020-F782-4587-A199-C7313BC2CD20@rpi.edu> References: <20140725044921.9F0D3580A2@chaos.jnpr.net> <20140728054217.AC1A0580A2@chaos.jnpr.net> <20140728055336.GJ50802@ivaldir.etoilebsd.net> <20140729230345.31E9B580A2@chaos.jnpr.net> <53D85495.4050408@mu.org> <448BB170-6DDC-442B-A5C5-973EC35FF7B9@rpi.edu> <1092D020-F782-4587-A199-C7313BC2CD20@rpi.edu> Comments: In-reply-to: Garance A Drosehn message dated "Tue, 29 Jul 2014 23:40:14 -0400." From: "Simon J. Gerraty" X-Mailer: MH-E 7.82+cvs; nmh 1.3; GNU Emacs 22.3.1 Date: Tue, 29 Jul 2014 22:54:30 -0700 Message-ID: <20140730055430.A78B1580A2@chaos.jnpr.net> MIME-Version: 1.0 Content-Type: text/plain X-EOPAttributedMessage: 0 X-Forefront-Antispam-Report: CIP:66.129.239.16; CTRY:US; IPV:NLI; IPV:NLI; EFV:NLI; SFV:NSPM; SFS:(6009001)(164054003)(189002)(199002)(51704005)(2171001)(70486001)(88136002)(99396002)(87286001)(87936001)(57986006)(74502001)(31966008)(92726001)(81342001)(77982001)(97736001)(76506005)(90896003)(74662001)(110136001)(79102001)(76482001)(85852003)(89996001)(46102001)(83072002)(48376002)(50466002)(85306003)(106466001)(68736004)(69596002)(81156004)(21056001)(93916002)(86362001)(95666004)(4396001)(50226001)(105596002)(20776003)(47776003)(93886003)(83322001)(62966002)(101356003)(81542001)(64706001)(50986999)(76176999)(80022001)(33656002)(92566001)(93546004)(84676001)(77156001)(102836001)(107046002)(104166001)(102176002)(6806004)(42262001); DIR:OUT; SFP:; SCL:1; SRVR:DM2PR05MB736; H:P-EMF02-SAC.jnpr.net; FPR:; MLV:sfv; PTR:InfoDomainNonexistent; MX:1; LANG:en; X-Microsoft-Antispam: BCL:0;PCL:0;RULEID: X-Forefront-PRVS: 0288CD37D9 Received-SPF: SoftFail (protection.outlook.com: domain of transitioning juniper.net discourages use of 66.129.239.16 as permitted sender) Authentication-Results: spf=softfail (sender IP is 66.129.239.16) smtp.mailfrom=sjg@juniper.net; X-OriginatorOrg: juniper.net Cc: phil@juniper.net, freebsd-arch@freebsd.org X-BeenThere: freebsd-arch@freebsd.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: Discussion related to FreeBSD architecture List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 30 Jul 2014 05:54:46 -0000 [+phil who somehow got dropped] On Tue, 29 Jul 2014 23:40:14 -0400, Garance A Drosehn writes: >I also wanted to highlight an issue that Simon brought up in the initial >message for this thread: > > "The main open issue (assuming this functionality is still desired) > is support of wide characters. > > We figure the worst case solution is a sed(1) script to generate > the wide version of the API from the normal one, but perhaps simply > always using UTF8 would be a better solution?" Thanks, good not to lose sight of that in all the color discussions ;-) >In my own experiments I've pretended that all the output 'lpq' generates >is simple ascii, although that's not necessarily true. The filename >field is set by whatever generated the output, which might be a PC or Mac >which may or may not be unicode-aware. The field might be gibberish (aka >"invalid unicode"). Obviously "pretending" is the wrong way to handle >this issue. Indeed. UTF-8 has its attractions since i18n cannot simply be ignored in this case.