From owner-freebsd-current@FreeBSD.ORG Sat Nov 15 09:16:54 2008 Return-Path: Delivered-To: freebsd-current@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 8F8EA1065670 for ; Sat, 15 Nov 2008 09:16:54 +0000 (UTC) (envelope-from alexanderchuranov@gmail.com) Received: from ik-out-1112.google.com (ik-out-1112.google.com [66.249.90.181]) by mx1.freebsd.org (Postfix) with ESMTP id 152288FC16 for ; Sat, 15 Nov 2008 09:16:53 +0000 (UTC) (envelope-from alexanderchuranov@gmail.com) Received: by ik-out-1112.google.com with SMTP id c21so1431860ika.3 for ; Sat, 15 Nov 2008 01:16:52 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:to :subject:cc:in-reply-to:mime-version:content-type:references; bh=zouVAG+zyYeWQx1pcbZgkldwaljZoEx11SAbDHRE82w=; b=p+ddlcoewjbLutFVlUmrJOTwsMWuFppXvW1XSIJH38++clqLpTSihX1F7F2BfcT0sB MrXrl1bGsZPANZaRm88x68OslEOuNmHVV+6of4pjD6Dof8ibFx+IA0EfSe/2wS1+JbRi BkVv8Cp4kannIvY+ozjEHctgMyuEbX0t6gUDA= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:to:subject:cc:in-reply-to:mime-version :content-type:references; b=FoBzT6jUWKeVEJfTzz+0+MxKCSYjkANgQV/nudBme58SpcHa9DvhCtMt5uPe69IYKS IuOh738a2bne6QyHjjeYj17aPrJ0r13JlSBonTycTc4XJaw2+qBnN32vwERru0Fnkz9d sDPvs+eIsxY7qawin+sb5feSnki8KWWWqhxdU= Received: by 10.210.116.14 with SMTP id o14mr1975649ebc.86.1226740612877; Sat, 15 Nov 2008 01:16:52 -0800 (PST) Received: by 10.210.130.15 with HTTP; Sat, 15 Nov 2008 01:16:52 -0800 (PST) Message-ID: <3cb459ed0811150116p4c27dca9j911384c51f54aa20@mail.gmail.com> Date: Sat, 15 Nov 2008 12:16:52 +0300 From: "Alexander Churanov" To: "army. of. root" In-Reply-To: MIME-Version: 1.0 References: <3cb459ed0808221700w335b0906g6901d8b8bec4dad9@mail.gmail.com> <3cb459ed0808241958v552eafejf7841f0f9993928e@mail.gmail.com> <3cb459ed0811110616t76235e72n24f2411a324a9807@mail.gmail.com> <3cb459ed0811110629g5c7cef8ascb024a9c1a920efa@mail.gmail.com> <20081111152011.GF9030@detritus.paeps.cx> <3cb459ed0811120718y755b123g90970461da2773be@mail.gmail.com> <20081113091808.12121w3199o1l2v4@webmail.leidinger.net> Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Cc: freebsd-current@freebsd.org Subject: Re: Unicode-based FreeBSD X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 15 Nov 2008 09:16:54 -0000 army. of. root, The approach used by me is very close to what you suggest. Syscons will decode UTF-8 output to sequence of code points (this is actually the same as UTF-32). The "code point => 8-bit" mapping is used just for adapting renderers to unicode in order to simplify implementation and reuse (actually, not to modify) much of current implementation. As for the transcoding, there are no problems with transforming UTF-8 ti UTF-16, UTF-32 to UTF-8 - all of these is not too complex and already implemented in IBM ICU with BSD-style license. Alexander Churanov