From owner-freebsd-i18n@FreeBSD.ORG Tue Sep 10 08:26:30 2013 Return-Path: Delivered-To: freebsd-i18n@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTP id A92A642D; Tue, 10 Sep 2013 08:26:30 +0000 (UTC) (envelope-from demelier.david@gmail.com) Received: from mail-ie0-x22c.google.com (mail-ie0-x22c.google.com [IPv6:2607:f8b0:4001:c03::22c]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 74E582385; Tue, 10 Sep 2013 08:26:30 +0000 (UTC) Received: by mail-ie0-f172.google.com with SMTP id c10so15505925ieb.31 for ; Tue, 10 Sep 2013 01:26:30 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=23Q9ki+gG7P5PZAWls1yePNzPSiAd+Fg09GpB69b8Aw=; b=G6Z6Udj8X/uk5ToC7ZVrA/csuW2kIBsn9XnQru4luM232G3rr4UkW+nLkUsxwEHlwz Df85gHRfscM7eiGgRQ0V+ulkWLoi9QH4Z2KCRdcwtbppww+sICKo1VewOApI3YbkQUoI /K72E2pJs5duq1CHsED/VT/YUpfDnwNsvw+HQV4rB88mSF/Kfqo6mvSUHoByglqCSQP+ iwKyLVI2Fgm6koXUp+E34yD9a9z7jpNPHQTSDXePc7oUNG6CELrLhhHg6Mk4TvSY+cDy EmMkMoZxvmeBVFjxojMB3Ve9p6i3sL+iaaQ1rVzrwRkIjDaOrS4BbAV12FejHRp40zgv 187A== MIME-Version: 1.0 X-Received: by 10.50.154.41 with SMTP id vl9mr10600672igb.10.1378801589927; Tue, 10 Sep 2013 01:26:29 -0700 (PDT) Received: by 10.64.60.1 with HTTP; Tue, 10 Sep 2013 01:26:29 -0700 (PDT) In-Reply-To: <20130828131017.GA89499@lyxys.ka.sub.org> References: <20130828131017.GA89499@lyxys.ka.sub.org> Date: Tue, 10 Sep 2013 10:26:29 +0200 Message-ID: Subject: Re: State of Unicode collation support in FreeBSD? From: David Demelier To: freebsd-stable@freebsd.org Content-Type: text/plain; charset=UTF-8 Cc: freebsd-i18n@freebsd.org X-BeenThere: freebsd-i18n@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: FreeBSD Internationalization Effort List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 10 Sep 2013 08:26:30 -0000 2013/8/28 Wolfgang Zenker : > [crossposted to -stable and -i18n, replies directed to -stable] > > Hi everyone, > > could someone point me to infos regarding Unicode collation support in FreeBSD? > All I could find was https://wiki.freebsd.org/KonradJankowski/Collation but > that page has not been changed in more than two years. Looking at sources of > -current it doesn't look like those changes made it into the source tree yet. > > Wolfgang I think no one is really interested to add real UTF-8 support to Syscons. Currently you can get UTF-8 output by using Syscons xterm ttys (which is default) and set your appropriate locales. For input it's currently (unfortunately) not supported. If you use X.Org, then your fine using UTF-8. Cheers, -- Demelier David From owner-freebsd-i18n@FreeBSD.ORG Tue Sep 10 08:46:01 2013 Return-Path: Delivered-To: freebsd-i18n@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTP id 11BDBB3E; Tue, 10 Sep 2013 08:46:01 +0000 (UTC) (envelope-from slw@zxy.spb.ru) Received: from zxy.spb.ru (zxy.spb.ru [195.70.199.98]) by mx1.freebsd.org (Postfix) with ESMTP id C222024CD; Tue, 10 Sep 2013 08:46:00 +0000 (UTC) Received: from slw by zxy.spb.ru with local (Exim 4.69 (FreeBSD)) (envelope-from ) id 1VJJcB-0002vK-LJ; Tue, 10 Sep 2013 12:48:03 +0400 Date: Tue, 10 Sep 2013 12:48:03 +0400 From: Slawa Olhovchenkov To: David Demelier Subject: Re: State of Unicode collation support in FreeBSD? Message-ID: <20130910084803.GA11079@zxy.spb.ru> References: <20130828131017.GA89499@lyxys.ka.sub.org> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.5.21 (2010-09-15) X-SA-Exim-Connect-IP: X-SA-Exim-Mail-From: slw@zxy.spb.ru X-SA-Exim-Scanned: No (on zxy.spb.ru); SAEximRunCond expanded to false Cc: freebsd-stable@freebsd.org, freebsd-i18n@freebsd.org X-BeenThere: freebsd-i18n@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: FreeBSD Internationalization Effort List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 10 Sep 2013 08:46:01 -0000 On Tue, Sep 10, 2013 at 10:26:29AM +0200, David Demelier wrote: > 2013/8/28 Wolfgang Zenker : > > [crossposted to -stable and -i18n, replies directed to -stable] > > > > Hi everyone, > > > > could someone point me to infos regarding Unicode collation support in FreeBSD? > > All I could find was https://wiki.freebsd.org/KonradJankowski/Collation but > > that page has not been changed in more than two years. Looking at sources of > > -current it doesn't look like those changes made it into the source tree yet. > > > > Wolfgang > > I think no one is really interested to add real UTF-8 support to > Syscons. Currently you can get UTF-8 output by using Syscons xterm > ttys (which is default) and set your appropriate locales. For input > it's currently (unfortunately) not supported. > > If you use X.Org, then your fine using UTF-8. Why you talk about syscons? This is about sort, postgres and other software. From owner-freebsd-i18n@FreeBSD.ORG Tue Sep 10 09:39:44 2013 Return-Path: Delivered-To: freebsd-i18n@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTP id 55121ED2; Tue, 10 Sep 2013 09:39:44 +0000 (UTC) (envelope-from wolfgang@lyxys.ka.sub.org) Received: from saturn.lyxys.ka.sub.org (saturn.lyxys.ka.sub.org [217.29.35.151]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id B6C3D2800; Tue, 10 Sep 2013 09:39:43 +0000 (UTC) Received: from juno.lyxys.ka.sub.org (juno.lyx [IPv6:fd2a:89ca:7d54:0:20f:feff:fe0e:7312]) by saturn.lyxys.ka.sub.org (8.14.7/8.14.7) with ESMTP id r8A9U9bC051081 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Tue, 10 Sep 2013 11:30:10 +0200 (CEST) (envelope-from wolfgang@lyxys.ka.sub.org) Received: from juno.lyxys.ka.sub.org (localhost [127.0.0.1]) by juno.lyxys.ka.sub.org (8.14.7/8.14.7) with ESMTP id r8A9U97C025910; Tue, 10 Sep 2013 11:30:09 +0200 (CEST) (envelope-from wolfgang@lyxys.ka.sub.org) Received: (from wolfgang@localhost) by juno.lyxys.ka.sub.org (8.14.7/8.14.7/Submit) id r8A9U9No025909; Tue, 10 Sep 2013 11:30:09 +0200 (CEST) (envelope-from wolfgang@lyxys.ka.sub.org) X-Authentication-Warning: juno.lyxys.ka.sub.org: wolfgang set sender to wolfgang@lyxys.ka.sub.org using -f Date: Tue, 10 Sep 2013 11:30:09 +0200 From: Wolfgang Zenker To: freebsd-stable@freebsd.org Subject: Re: State of Unicode collation support in FreeBSD? Message-ID: <20130910093009.GA25595@lyxys.ka.sub.org> References: <20130828131017.GA89499@lyxys.ka.sub.org> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: Organization: private site User-Agent: Mutt/1.5.21 (2010-09-15) X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.4.3 (saturn.lyxys.ka.sub.org [IPv6:fd2a:89ca:7d54:1:200:24ff:feca:b4cc]); Tue, 10 Sep 2013 11:30:10 +0200 (CEST) Cc: freebsd-i18n@freebsd.org X-BeenThere: freebsd-i18n@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: FreeBSD Internationalization Effort List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 10 Sep 2013 09:39:44 -0000 * David Demelier [130910 10:26]: > 2013/8/28 Wolfgang Zenker : >> [crossposted to -stable and -i18n] >> could someone point me to infos regarding Unicode collation support in FreeBSD? >> All I could find was https://wiki.freebsd.org/KonradJankowski/Collation but >> that page has not been changed in more than two years. Looking at sources of >> -current it doesn't look like those changes made it into the source tree yet. > I think no one is really interested to add real UTF-8 support to > Syscons. Currently you can get UTF-8 output by using Syscons xterm > ttys (which is default) and set your appropriate locales. For input > it's currently (unfortunately) not supported. > If you use X.Org, then your fine using UTF-8. There might be a misunderstanding: Collation is about ordering characters and sorting strings. What we have in FreeBSD right now is support for input and output of utf-8 characters, and with X11 and the right set of fonts they display ok, and at least using vim editing utf-8 text works ok. But sorting utf-8 strings yields "interesting" results as soon as you have non-ascii characters in your strings. Wolfgang From owner-freebsd-i18n@FreeBSD.ORG Fri Sep 13 06:58:42 2013 Return-Path: Delivered-To: freebsd-i18n@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTP id C6B98FB8; Fri, 13 Sep 2013 06:58:42 +0000 (UTC) (envelope-from demelier.david@gmail.com) Received: from mail-wg0-x230.google.com (mail-wg0-x230.google.com [IPv6:2a00:1450:400c:c00::230]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 3EF2F2B7D; Fri, 13 Sep 2013 06:58:42 +0000 (UTC) Received: by mail-wg0-f48.google.com with SMTP id n12so733712wgh.27 for ; Thu, 12 Sep 2013 23:58:40 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=/VS0/L1EmDXFK/l8b8S8kzfJ/CGVktSRZskmYT1Sxz4=; b=Y7q5E+mTHxnZPbmzXqx+HtqBjR+h/itHQ0wGsggFxWd/aAUCF4VD0WUVEOxathTtaN B2gvFGf6RzW57N2I1ERbZnbeY7/A2y0f+lHAqXySFFKzE6vi5WsjKDNTcE3m204YSJyA L/ZJpI3B73fGu6kau7dUwEnOqI6wmQW7ycACnwHXD0nyCj13C3Xvlmg4fpxt3bCosioZ ErN3jsTX3EhnbyowbD8lVpS6UYLbSaMZtgaJ/Ex/hddjGmVQyzPfhzutxP+xvV2igNdQ jFSojmsjkA4LNE+t/O02WdTqfr271CgCfvPEbuYJWCMSVckb/0ib6aiYsawNsk7/DAse lZQA== MIME-Version: 1.0 X-Received: by 10.180.85.65 with SMTP id f1mr1212271wiz.33.1379055520489; Thu, 12 Sep 2013 23:58:40 -0700 (PDT) Received: by 10.194.157.69 with HTTP; Thu, 12 Sep 2013 23:58:40 -0700 (PDT) In-Reply-To: <20130910093009.GA25595@lyxys.ka.sub.org> References: <20130828131017.GA89499@lyxys.ka.sub.org> <20130910093009.GA25595@lyxys.ka.sub.org> Date: Fri, 13 Sep 2013 08:58:40 +0200 Message-ID: Subject: Re: State of Unicode collation support in FreeBSD? From: David Demelier To: Wolfgang Zenker Content-Type: text/plain; charset=UTF-8 Cc: freebsd-stable@freebsd.org, freebsd-i18n@freebsd.org X-BeenThere: freebsd-i18n@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: FreeBSD Internationalization Effort List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 13 Sep 2013 06:58:42 -0000 2013/9/10 Wolfgang Zenker : > * David Demelier [130910 10:26]: >> 2013/8/28 Wolfgang Zenker : >>> [crossposted to -stable and -i18n] >>> could someone point me to infos regarding Unicode collation support in FreeBSD? >>> All I could find was https://wiki.freebsd.org/KonradJankowski/Collation but >>> that page has not been changed in more than two years. Looking at sources of >>> -current it doesn't look like those changes made it into the source tree yet. > >> I think no one is really interested to add real UTF-8 support to >> Syscons. Currently you can get UTF-8 output by using Syscons xterm >> ttys (which is default) and set your appropriate locales. For input >> it's currently (unfortunately) not supported. > >> If you use X.Org, then your fine using UTF-8. > > There might be a misunderstanding: Collation is about ordering characters and > sorting strings. What we have in FreeBSD right now is support for input and > output of utf-8 characters, and with X11 and the right set of fonts they > display ok, and at least using vim editing utf-8 text works ok. But sorting > utf-8 strings yields "interesting" results as soon as you have non-ascii > characters in your strings. > Aaah, okay sorry I really did misunderstanding the question yes ;-). Regards, -- Demelier David