From owner-freebsd-i18n@FreeBSD.ORG Tue Sep 10 09:39:44 2013 Return-Path: Delivered-To: freebsd-i18n@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTP id 55121ED2; Tue, 10 Sep 2013 09:39:44 +0000 (UTC) (envelope-from wolfgang@lyxys.ka.sub.org) Received: from saturn.lyxys.ka.sub.org (saturn.lyxys.ka.sub.org [217.29.35.151]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id B6C3D2800; Tue, 10 Sep 2013 09:39:43 +0000 (UTC) Received: from juno.lyxys.ka.sub.org (juno.lyx [IPv6:fd2a:89ca:7d54:0:20f:feff:fe0e:7312]) by saturn.lyxys.ka.sub.org (8.14.7/8.14.7) with ESMTP id r8A9U9bC051081 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Tue, 10 Sep 2013 11:30:10 +0200 (CEST) (envelope-from wolfgang@lyxys.ka.sub.org) Received: from juno.lyxys.ka.sub.org (localhost [127.0.0.1]) by juno.lyxys.ka.sub.org (8.14.7/8.14.7) with ESMTP id r8A9U97C025910; Tue, 10 Sep 2013 11:30:09 +0200 (CEST) (envelope-from wolfgang@lyxys.ka.sub.org) Received: (from wolfgang@localhost) by juno.lyxys.ka.sub.org (8.14.7/8.14.7/Submit) id r8A9U9No025909; Tue, 10 Sep 2013 11:30:09 +0200 (CEST) (envelope-from wolfgang@lyxys.ka.sub.org) X-Authentication-Warning: juno.lyxys.ka.sub.org: wolfgang set sender to wolfgang@lyxys.ka.sub.org using -f Date: Tue, 10 Sep 2013 11:30:09 +0200 From: Wolfgang Zenker To: freebsd-stable@freebsd.org Subject: Re: State of Unicode collation support in FreeBSD? Message-ID: <20130910093009.GA25595@lyxys.ka.sub.org> References: <20130828131017.GA89499@lyxys.ka.sub.org> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: Organization: private site User-Agent: Mutt/1.5.21 (2010-09-15) X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.4.3 (saturn.lyxys.ka.sub.org [IPv6:fd2a:89ca:7d54:1:200:24ff:feca:b4cc]); Tue, 10 Sep 2013 11:30:10 +0200 (CEST) Cc: freebsd-i18n@freebsd.org X-BeenThere: freebsd-i18n@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: FreeBSD Internationalization Effort List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 10 Sep 2013 09:39:44 -0000 * David Demelier [130910 10:26]: > 2013/8/28 Wolfgang Zenker : >> [crossposted to -stable and -i18n] >> could someone point me to infos regarding Unicode collation support in FreeBSD? >> All I could find was https://wiki.freebsd.org/KonradJankowski/Collation but >> that page has not been changed in more than two years. Looking at sources of >> -current it doesn't look like those changes made it into the source tree yet. > I think no one is really interested to add real UTF-8 support to > Syscons. Currently you can get UTF-8 output by using Syscons xterm > ttys (which is default) and set your appropriate locales. For input > it's currently (unfortunately) not supported. > If you use X.Org, then your fine using UTF-8. There might be a misunderstanding: Collation is about ordering characters and sorting strings. What we have in FreeBSD right now is support for input and output of utf-8 characters, and with X11 and the right set of fonts they display ok, and at least using vim editing utf-8 text works ok. But sorting utf-8 strings yields "interesting" results as soon as you have non-ascii characters in your strings. Wolfgang