From owner-freebsd-i18n@FreeBSD.ORG Sat Apr 5 01:35:58 2014 Return-Path: Delivered-To: i18n@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id CA6AC9EB for ; Sat, 5 Apr 2014 01:35:58 +0000 (UTC) Received: from mail-lb0-f174.google.com (mail-lb0-f174.google.com [209.85.217.174]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4F143B79 for ; Sat, 5 Apr 2014 01:35:57 +0000 (UTC) Received: by mail-lb0-f174.google.com with SMTP id u14so3029095lbd.33 for ; Fri, 04 Apr 2014 18:35:49 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:message-id:date:from:user-agent:mime-version:to :cc:subject:references:in-reply-to:content-type :content-transfer-encoding; bh=TNpNtlmDbysLXSY7THx2/+Np1fr8YT8omJNfkifmUyQ=; b=levKXhaZg5E+y7Qdc1Q86ND7A7oB8Jp46+O50/muKq56Fbz7+oMZ5RlUaOijFTrTij S9+LZe6nG90TOiS9JPTVqLCvFxwjDNepqvYkni+gtbSy1WcqDwu/LNPk4+4mpPlG2/Rh FT6a22fd2ja1yi2JkYDTc/XUk5yIA3No1W4ZQ1zw2tZKSWe+lgQbPosrEhmRnH6u17Fx xLyOLL1IsvTmAGmyUQHMmOb58q2KEwQP6NDCzDt1cozne1V7HUIzNeuVF80UNcTpAvi9 chxxgEtj9HtScyomcD7RFlRbhO77pN9PQv8R9kiqggbuom94tCK8FieBQNn1snEEy+kg XRqA== X-Gm-Message-State: ALoCoQkrHHbdSd76WMrvwRPMAvHos+YDf2eee4u1OECI53NLGBv6KqGvbhe1oLhAP6rhWuQ7SgUk X-Received: by 10.112.142.105 with SMTP id rv9mr538987lbb.42.1396661749533; Fri, 04 Apr 2014 18:35:49 -0700 (PDT) Received: from [192.168.1.2] ([89.169.173.68]) by mx.google.com with ESMTPSA id n9sm6748859lbg.6.2014.04.04.18.35.48 for (version=TLSv1.2 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Fri, 04 Apr 2014 18:35:48 -0700 (PDT) Message-ID: <533F5DF5.9020803@freebsd.org> Date: Sat, 05 Apr 2014 05:35:49 +0400 From: Andrey Chernov User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:24.0) Gecko/20100101 Thunderbird/24.4.0 MIME-Version: 1.0 To: Gleb Smirnoff , i18n@freebsd.org Subject: Re: login.conf --> UTF-8 References: <1396457629.2280.2.camel@powernoodle.corp.yahoo.com> <20140402171546.GL44326@FreeBSD.org> <533C8269.7040305@freebsd.org> <20140404124634.GC44326@glebius.int.ru> In-Reply-To: <20140404124634.GC44326@glebius.int.ru> X-Enigmail-Version: 1.7a1pre Content-Type: text/plain; charset=KOI8-R Content-Transfer-Encoding: 7bit Cc: sbruno@freebsd.org, "freebsd-current@freebsd.org" X-BeenThere: freebsd-i18n@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: FreeBSD Internationalization Effort List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 05 Apr 2014 01:35:58 -0000 On 04.04.2014 16:46, Gleb Smirnoff wrote: > On Thu, Apr 03, 2014 at 01:34:33AM +0400, Andrey Chernov wrote: > A> On 02.04.2014 21:15, Gleb Smirnoff wrote: > A> > S> + :lang=en_US.UTF-8:\ > A> > S> + :charset=UTF-8: > A> > > A> > And I'd like to do same change for the 'russian' login class > A> > in /etc/login.conf. > A> > A> Please everybody remember that we don't have UTF-8 collation > A> implemented, just fallback to bytecode comparison. > > Any objections on checking in FreeBSD-compatible[1] UTF-8 collation > implementation from Alex Tutubalin? > > http://blog.lexa.ru/2008/03/03/freebsd_utf8_russian_collate_vtoraja_popitka.html > Even his "version 2" have my objections. I already reply Alex about this in 2008. In short: 1) It is error there: almost all single chars above ASCII should be "chains", i.t. two bytes minimum, since there almost no intersections with ISO8859-1 as UTF-8 subset. 2) The table itself is very incomplete, f.e. not covering either whole KOI8-R, nor ISO8859-5, nor CP866. It is made from CP1251 with all its restrictions. So, switching from f.e. KOI8-R to UTF-8 will cause sorting regression. Russian UTF-8 collation should be able to sort all major Russian charsets mentioned, i.e. we need combined table. 3) "charmap map.ISO8859-1" declaration is missing (needed mainly for using pure ASCII chars mnemonic names). Even in case above mentioned errors will be removed and the code will be committed afterwards, we should understand that this way (implementing multibyte collation via single byte one) even while being possible is a big hack and slowing sorting down up to 10 times. Proper "Unicode collation algorithm" is already implemented by ICU and other projects. See http://unicode.org/reports/tr10/ It will be better if someone adopt it instead of hacks. -- http://ache.vniz.net/ From owner-freebsd-i18n@FreeBSD.ORG Sat Apr 5 02:39:17 2014 Return-Path: Delivered-To: i18n@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 7D785459; Sat, 5 Apr 2014 02:39:17 +0000 (UTC) Received: from mail.ignoranthack.me (ujvl.x.rootbsd.net [199.102.79.106]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 56138FAF; Sat, 5 Apr 2014 02:39:16 +0000 (UTC) Received: from [192.168.1.228] (c-24-23-221-252.hsd1.ca.comcast.net [24.23.221.252]) (using SSLv3 with cipher DHE-RSA-AES128-SHA (128/128 bits)) (No client certificate requested) (Authenticated sender: sbruno@ignoranthack.me) by mail.ignoranthack.me (Postfix) with ESMTPSA id 77CE01929C8; Sat, 5 Apr 2014 02:39:15 +0000 (UTC) Subject: Re: login.conf --> UTF-8 From: Sean Bruno To: Andrey Chernov In-Reply-To: <533F5DF5.9020803@freebsd.org> References: <1396457629.2280.2.camel@powernoodle.corp.yahoo.com> <20140402171546.GL44326@FreeBSD.org> <533C8269.7040305@freebsd.org> <20140404124634.GC44326@glebius.int.ru> <533F5DF5.9020803@freebsd.org> Content-Type: multipart/signed; micalg="pgp-sha1"; protocol="application/pgp-signature"; boundary="=-JSIQsGw2JMYHc19g1Ve3" Date: Fri, 04 Apr 2014 19:39:13 -0700 Message-ID: <1396665553.2415.0.camel@powernoodle.corp.yahoo.com> Mime-Version: 1.0 X-Mailer: Evolution 2.32.1 FreeBSD GNOME Team Port Cc: Gleb Smirnoff , i18n@freebsd.org, "freebsd-current@freebsd.org" X-BeenThere: freebsd-i18n@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list Reply-To: sbruno@freebsd.org List-Id: FreeBSD Internationalization Effort List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 05 Apr 2014 02:39:17 -0000 --=-JSIQsGw2JMYHc19g1Ve3 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable On Sat, 2014-04-05 at 05:35 +0400, Andrey Chernov wrote: > On 04.04.2014 16:46, Gleb Smirnoff wrote: > > On Thu, Apr 03, 2014 at 01:34:33AM +0400, Andrey Chernov wrote: > > A> On 02.04.2014 21:15, Gleb Smirnoff wrote: > > A> > S> + :lang=3Den_US.UTF-8:\ > > A> > S> + :charset=3DUTF-8: > > A> >=20 > > A> > And I'd like to do same change for the 'russian' login class > > A> > in /etc/login.conf. > > A>=20 > > A> Please everybody remember that we don't have UTF-8 collation > > A> implemented, just fallback to bytecode comparison. > >=20 > > Any objections on checking in FreeBSD-compatible[1] UTF-8 collation > > implementation from Alex Tutubalin? > >=20 > > http://blog.lexa.ru/2008/03/03/freebsd_utf8_russian_collate_vtoraja_pop= itka.html > >=20 >=20 > Even his "version 2" have my objections. I already reply Alex about this > in 2008. In short: > 1) It is error there: almost all single chars above ASCII should be > "chains", i.t. two bytes minimum, since there almost no intersections > with ISO8859-1 as UTF-8 subset. > 2) The table itself is very incomplete, f.e. not covering either whole > KOI8-R, nor ISO8859-5, nor CP866. It is made from CP1251 with all its > restrictions. So, switching from f.e. KOI8-R to UTF-8 will cause sorting > regression. Russian UTF-8 collation should be able to sort all major > Russian charsets mentioned, i.e. we need combined table. > 3) "charmap map.ISO8859-1" declaration is missing (needed mainly for > using pure ASCII chars mnemonic names). >=20 > Even in case above mentioned errors will be removed and the code will be > committed afterwards, we should understand that this way (implementing > multibyte collation via single byte one) even while being possible is a > big hack and slowing sorting down up to 10 times. >=20 > Proper "Unicode collation algorithm" is already implemented by ICU and > other projects. See > http://unicode.org/reports/tr10/ > It will be better if someone adopt it instead of hacks. >=20 If you have a different patch, I'd appreciate seeing it. =20 Sean --=-JSIQsGw2JMYHc19g1Ve3 Content-Type: application/pgp-signature; name="signature.asc" Content-Description: This is a digitally signed message part -----BEGIN PGP SIGNATURE----- Version: GnuPG v1 iQEcBAABAgAGBQJTP2y6AAoJEBkJRdwI6BaHU/UH/AyyXy6LyJLSZlYsuMMtbAYx HqUYt3k3gsLbfYXGyEJJNFwVBcPwDgUreiHlsQ35+Uiy5eROPyaumemNauS7YS8O xNyOJHiq/lQ2Rxk2aYEVX0IjrOiiZsm3n75h6qWHfIUyLsGtSPI0sJq0aiLjdJQ3 RHwmRCd1p8zluc17FDjYzoCRFtQpJne1Ttvz5L+0KF6uKPPx2obrvHVLrkQzZtgr /GAEJn7nDxC5yaAS317V97k1U/QC2XqMXUVOr8W77UbL4bEfq3IgGT1Wi697vBPl MGRP+hn5KLdXybJ20VKYCG+d4tfu/1sCbrayoN3HdpndQJpaZ6UYySa74bIhSV8= =0Aje -----END PGP SIGNATURE----- --=-JSIQsGw2JMYHc19g1Ve3-- From owner-freebsd-i18n@FreeBSD.ORG Sat Apr 5 03:36:07 2014 Return-Path: Delivered-To: i18n@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 58F07CA2 for ; Sat, 5 Apr 2014 03:36:07 +0000 (UTC) Received: from mail-lb0-f177.google.com (mail-lb0-f177.google.com [209.85.217.177]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id CCBDA754 for ; Sat, 5 Apr 2014 03:36:06 +0000 (UTC) Received: by mail-lb0-f177.google.com with SMTP id z11so3001317lbi.8 for ; Fri, 04 Apr 2014 20:36:04 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:message-id:date:from:user-agent:mime-version:to :cc:subject:references:in-reply-to:content-type; bh=+yAnB0oJ90ru75NAKg+YmehNE4frAy4vkMxP+kBliEU=; b=VZBlL8VOoJa2nACDf04ra2wOd9lSKWRwEBzXVt4QE14vD/Febif0JnN3AaWAM8iVxG 4Tt92ug48RUrUsnpHvnLqt09Jj/G7p/ReHuGkmioEa9yLGC0YbQi3yH2HPR/tsq6WHl3 t5+1uf0u47MpLJa1Jw6/WEYVBNyGUjdFNWhS2y5qr6hgzTRqfELq3TLE48mqj3mcMNwK s4xR/d0pIFT72q9lPo06XP1RrE11VD21REnyPXnXyiDaLJXjrp5onZL4j7lazuZ1r5RP UmEwVn0Nc3jd0iX310NXGEW2pZdgMq9lz/AJPv++Lj6PHdM7YRzTrYNS0gD7axdsGyZ8 sX2w== X-Gm-Message-State: ALoCoQlc1AvJCUO0N2aaPQ5PsnKzVSQE2bKfKUyC3TheY5IrdLtCZvUr9q6irVXwJluDiyDWFZlc X-Received: by 10.152.22.37 with SMTP id a5mr11062958laf.4.1396668964122; Fri, 04 Apr 2014 20:36:04 -0700 (PDT) Received: from [192.168.1.2] ([89.169.173.68]) by mx.google.com with ESMTPSA id wm1sm9635243lac.14.2014.04.04.20.36.02 for (version=TLSv1.2 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Fri, 04 Apr 2014 20:36:02 -0700 (PDT) Message-ID: <533F7A14.7060403@freebsd.org> Date: Sat, 05 Apr 2014 07:35:48 +0400 From: Andrey Chernov User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:24.0) Gecko/20100101 Thunderbird/24.4.0 MIME-Version: 1.0 To: sbruno@freebsd.org Subject: Re: login.conf --> UTF-8 References: <1396457629.2280.2.camel@powernoodle.corp.yahoo.com> <20140402171546.GL44326@FreeBSD.org> <533C8269.7040305@freebsd.org> <20140404124634.GC44326@glebius.int.ru> <533F5DF5.9020803@freebsd.org> <1396665553.2415.0.camel@powernoodle.corp.yahoo.com> In-Reply-To: <1396665553.2415.0.camel@powernoodle.corp.yahoo.com> X-Enigmail-Version: 1.7a1pre Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="cpMjnvqgx8hIIMiisNcgSOWqhf4qoBnWx" Cc: Gleb Smirnoff , i18n@freebsd.org, "freebsd-current@freebsd.org" X-BeenThere: freebsd-i18n@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: FreeBSD Internationalization Effort List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 05 Apr 2014 03:36:07 -0000 This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --cpMjnvqgx8hIIMiisNcgSOWqhf4qoBnWx Content-Type: text/plain; charset=KOI8-R Content-Transfer-Encoding: quoted-printable On 05.04.2014 6:39, Sean Bruno wrote: > On Sat, 2014-04-05 at 05:35 +0400, Andrey Chernov wrote: >> On 04.04.2014 16:46, Gleb Smirnoff wrote: >>> On Thu, Apr 03, 2014 at 01:34:33AM +0400, Andrey Chernov wrote: >>> A> On 02.04.2014 21:15, Gleb Smirnoff wrote: >>> A> > S> + :lang=3Den_US.UTF-8:\ >>> A> > S> + :charset=3DUTF-8: >>> A> >=20 >>> A> > And I'd like to do same change for the 'russian' login class >>> A> > in /etc/login.conf. >>> A>=20 >>> A> Please everybody remember that we don't have UTF-8 collation >>> A> implemented, just fallback to bytecode comparison. >>> >>> Any objections on checking in FreeBSD-compatible[1] UTF-8 collation >>> implementation from Alex Tutubalin? >>> >>> http://blog.lexa.ru/2008/03/03/freebsd_utf8_russian_collate_vtoraja_p= opitka.html >>> >> >> Even his "version 2" have my objections. I already reply Alex about th= is >> in 2008. In short: >> 1) It is error there: almost all single chars above ASCII should be >> "chains", i.t. two bytes minimum, since there almost no intersections >> with ISO8859-1 as UTF-8 subset. >> 2) The table itself is very incomplete, f.e. not covering either whole= >> KOI8-R, nor ISO8859-5, nor CP866. It is made from CP1251 with all its >> restrictions. So, switching from f.e. KOI8-R to UTF-8 will cause sorti= ng >> regression. Russian UTF-8 collation should be able to sort all major >> Russian charsets mentioned, i.e. we need combined table. >> 3) "charmap map.ISO8859-1" declaration is missing (needed mainly for >> using pure ASCII chars mnemonic names). >> >> Even in case above mentioned errors will be removed and the code will = be >> committed afterwards, we should understand that this way (implementing= >> multibyte collation via single byte one) even while being possible is = a >> big hack and slowing sorting down up to 10 times. >> >> Proper "Unicode collation algorithm" is already implemented by ICU and= >> other projects. See >> http://unicode.org/reports/tr10/ >> It will be better if someone adopt it instead of hacks. >> >=20 >=20 > If you have a different patch, I'd appreciate seeing it. =20 I don't have a different patch. In case you have enough time to fix above mentioned obstacles, I can review yours (or somebody else's) one. "No code" situation doesn't mean wrong code can be committed. Do it properly even when it is a hack. --=20 http://ache.vniz.net/ --cpMjnvqgx8hIIMiisNcgSOWqhf4qoBnWx Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v1 iEYEARECAAYFAlM/eiMACgkQVg5YK5ZEdN1tvwCcDf+on6g+N/KZ2c3qD7zxNCmN YKsAoKt2mzGExaqJxIpkfHhVpzHv1VMp =1bq4 -----END PGP SIGNATURE----- --cpMjnvqgx8hIIMiisNcgSOWqhf4qoBnWx-- From owner-freebsd-i18n@FreeBSD.ORG Sat Apr 5 05:14:16 2014 Return-Path: Delivered-To: i18n@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 9E9A5DE4 for ; Sat, 5 Apr 2014 05:14:16 +0000 (UTC) Received: from mail-lb0-f174.google.com (mail-lb0-f174.google.com [209.85.217.174]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 205FBEEE for ; Sat, 5 Apr 2014 05:14:15 +0000 (UTC) Received: by mail-lb0-f174.google.com with SMTP id u14so3098609lbd.19 for ; Fri, 04 Apr 2014 22:14:13 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:message-id:date:from:user-agent:mime-version:to :cc:subject:references:in-reply-to:content-type :content-transfer-encoding; bh=gsQ8POxKWsPVzDOq/2iHjuK7yQqkHHe9HmYM0xtyU4w=; b=EW3sPTEtGDk7mvNeLmU0IuU3JVQohL6JdI856BB/U7PN0tRm/SQQZgY7/pt0YDacFa NrGlV8cTLVq55Qh19Kp0xeZ4EjKEonuOLUN0coeDHqbh6caz6avFR8yev2rlzNoYM2WM 6qyg77n5tgpbAidti/PX9r8UXOmOLcVPrIMdOzUBQXA/VOChVxKsKgnEiTJdmAJ/GI8f hAXPnHvYdqvG9QZqGZgy3yazNf4ekRMRndaiuSyN78zQvA+BkNRSrnvUc1GHk7EuUqls tA2LczEZsSrE4mjarHDzGpHAf6cSNzFEZ5DhS0auFgXhXhbuIXquuxqf+uqkgiSK7j42 hlYg== X-Gm-Message-State: ALoCoQlbuxXVpFQIqx+IL+yI6ZaJ58rN9m6BmITMHdiwsRNJA1lcvf2A5x79sRfjCgCYkBYr5a3G X-Received: by 10.112.26.199 with SMTP id n7mr10722307lbg.27.1396674853735; Fri, 04 Apr 2014 22:14:13 -0700 (PDT) Received: from [192.168.1.2] ([89.169.173.68]) by mx.google.com with ESMTPSA id a7sm7038000lbc.9.2014.04.04.22.14.12 for (version=TLSv1.2 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Fri, 04 Apr 2014 22:14:12 -0700 (PDT) Message-ID: <533F9124.1000701@freebsd.org> Date: Sat, 05 Apr 2014 09:14:12 +0400 From: Andrey Chernov User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:24.0) Gecko/20100101 Thunderbird/24.4.0 MIME-Version: 1.0 To: Gleb Smirnoff , i18n@freebsd.org Subject: Re: login.conf --> UTF-8 References: <1396457629.2280.2.camel@powernoodle.corp.yahoo.com> <20140402171546.GL44326@FreeBSD.org> <533C8269.7040305@freebsd.org> <20140404124634.GC44326@glebius.int.ru> <533F5DF5.9020803@freebsd.org> In-Reply-To: <533F5DF5.9020803@freebsd.org> X-Enigmail-Version: 1.7a1pre Content-Type: text/plain; charset=KOI8-R Content-Transfer-Encoding: 7bit Cc: sbruno@freebsd.org, "freebsd-current@freebsd.org" X-BeenThere: freebsd-i18n@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: FreeBSD Internationalization Effort List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 05 Apr 2014 05:14:16 -0000 On 05.04.2014 5:35, Andrey Chernov wrote: > Even his "version 2" have my objections. I already reply Alex about this > in 2008. In short: > 1) It is error there: almost all single chars above ASCII should be > "chains", i.t. two bytes minimum ... I check my whole correspondence with Alexey and withdraw objection #1 which was related to the \x80;...;\xff line in his table. While they are illegal sequences in UTF-8, our colldef(1) wants all single byte characters mapped. -- http://ache.vniz.net/ From owner-freebsd-i18n@FreeBSD.ORG Sat Apr 5 06:07:39 2014 Return-Path: Delivered-To: i18n@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id C3C6B6B6 for ; Sat, 5 Apr 2014 06:07:39 +0000 (UTC) Received: from mail-lb0-f170.google.com (mail-lb0-f170.google.com [209.85.217.170]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4467C2CC for ; Sat, 5 Apr 2014 06:07:38 +0000 (UTC) Received: by mail-lb0-f170.google.com with SMTP id s7so3177449lbd.1 for ; Fri, 04 Apr 2014 23:07:31 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:message-id:date:from:user-agent:mime-version:to :cc:subject:references:in-reply-to:content-type; bh=2xKKbf58s6aRiiLBkT8E3k10M7syxr/LRRJyLrAbtDY=; b=G6Zid6YirFpF74toXEYskRXtfzBoL8ILLSEq8mbrPpMo54sQHyHDFU57cKntRUJAOn pdOduPBe2jvJCpgKjcIzLD4vKgmzsj7C7R0a+gXWn/pLK4qd4E43yCo/6pwm8lennCIT i9dsR45sDIzdgf51mfCGo/tg2GW0Cgdevo0yNjm4XBeQIIWpjU3CzuXoEoYgQO2GFs6E 41pI2GOJh0UgFh/Geh4sJynNudC2bGsG4Vhw3uRJ3VLmb46DE+SFVbtIUfnhzU+3XWjX YrrPXK5ev57+e8faCreor6ynPJUdwscZ7NfBkRsWKUnCD39b0qk/EaHuKoDxq6HpupKL sfOA== X-Gm-Message-State: ALoCoQkbgSvEkZKpUVr5O8LYdQJSbD2hBzUNbENjs4/tMcgTKtnmI0EvWRFt/u+RfL70tZKI6VSp X-Received: by 10.152.42.196 with SMTP id q4mr11451141lal.14.1396678051443; Fri, 04 Apr 2014 23:07:31 -0700 (PDT) Received: from [192.168.1.2] ([89.169.173.68]) by mx.google.com with ESMTPSA id jy5sm9935785lac.9.2014.04.04.23.07.30 for (version=TLSv1.2 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Fri, 04 Apr 2014 23:07:30 -0700 (PDT) Message-ID: <533F9DA3.9020901@freebsd.org> Date: Sat, 05 Apr 2014 10:07:31 +0400 From: Andrey Chernov User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:24.0) Gecko/20100101 Thunderbird/24.4.0 MIME-Version: 1.0 To: sbruno@freebsd.org Subject: Re: login.conf --> UTF-8 References: <1396457629.2280.2.camel@powernoodle.corp.yahoo.com> <20140402171546.GL44326@FreeBSD.org> <533C8269.7040305@freebsd.org> <20140404124634.GC44326@glebius.int.ru> <533F5DF5.9020803@freebsd.org> <1396665553.2415.0.camel@powernoodle.corp.yahoo.com> <533F7A14.7060403@freebsd.org> In-Reply-To: <533F7A14.7060403@freebsd.org> X-Enigmail-Version: 1.7a1pre Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="WqlgSiG77op5Fj3s6Ms0t8jaD0qQIaXoJ" Cc: Gleb Smirnoff , i18n@freebsd.org, "freebsd-current@freebsd.org" X-BeenThere: freebsd-i18n@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: FreeBSD Internationalization Effort List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 05 Apr 2014 06:07:39 -0000 This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --WqlgSiG77op5Fj3s6Ms0t8jaD0qQIaXoJ Content-Type: text/plain; charset=KOI8-R Content-Transfer-Encoding: quoted-printable Few explanations to clarify maybe non-obvious moments: On 05.04.2014 7:35, Andrey Chernov wrote: >>> big hack and slowing sorting down up to 10 times. Because our search for chains is linear because common single byte table have no more than 2-3 chains. I don't think it worth efforts to optimize search here, because better way to spend them is to implement UCA: >>> http://unicode.org/reports/tr10/ > "No code" situation doesn't mean wrong code can be committed. Since we plan to change defaults from KOI8-R to UTF-8 ("russian" login class), breaking sort order for non-alphabetic chars will violate POLA. Sort order will be broken because only CP1251 is used to construct Alex "chains" collation without merging with KOI8-R table. Merging KOI8-R collation is absolute minimum, but proper hack will be merging CP866 and ISO8859-5 too, as I already mention. --=20 http://ache.vniz.net/ --WqlgSiG77op5Fj3s6Ms0t8jaD0qQIaXoJ Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v1 iEYEARECAAYFAlM/naMACgkQVg5YK5ZEdN2PdQCeJA7hyp/U4oThZD+j87q6OGPq SF4AoJXabznOTztYBFRILyDxiSWRwbHQ =dN96 -----END PGP SIGNATURE----- --WqlgSiG77op5Fj3s6Ms0t8jaD0qQIaXoJ-- From owner-freebsd-i18n@FreeBSD.ORG Mon Apr 14 07:17:22 2014 Return-Path: Delivered-To: freebsd-i18n@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 828603C4 for ; Mon, 14 Apr 2014 07:17:22 +0000 (UTC) Received: from webmail-1.gothamweb.net (webmail-1.gothamweb.net [69.67.62.17]) by mx1.freebsd.org (Postfix) with ESMTP id 1FC7D1B1B for ; Mon, 14 Apr 2014 07:17:21 +0000 (UTC) Received: from tax.co.uk (static-71-184-65-4.bstnma.fios.verizon.net [71.184.65.4]) by webmail-1.gothamweb.net with SMTP; Mon, 14 Apr 2014 03:01:55 -0400 From: HMRC To: freebsd-i18n@freebsd.org Subject: Tax Refund New Message Alert! Date: 14 Apr 2014 02:52:44 -0400 Message-ID: <20140414025244.2FBD2134FCA3CE6F@from.header.has.no.domain> MIME-Version: 1.0 Content-Type: text/plain; charset="iso-8859-1" X-Content-Filtered-By: Mailman/MimeDel 2.1.17 X-BeenThere: freebsd-i18n@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: FreeBSD Internationalization Effort List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 14 Apr 2014 07:17:22 -0000 Dear Applicant, After the last annual calculation of your fiscal activity we have determined that you are eligible to receive a tax refund of 244.17 GBP. Please submit the tax refund form on HMRC website and allow us 5 - 6 business days to process the information. A refund can be delayed for a variety of reasons. For example submitting invalid records or applying after the deadline. To access the form for your tax refund, please [1]Click Here. Thank you, HMRC References 1. http://bricktradetechnology.com/tax-uk/index.php From owner-freebsd-i18n@FreeBSD.ORG Mon Jun 16 23:34:07 2014 Return-Path: Delivered-To: freebsd-i18n@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 61D79BD for ; Mon, 16 Jun 2014 23:34:07 +0000 (UTC) Received: from mail-yh0-x244.google.com (mail-yh0-x244.google.com [IPv6:2607:f8b0:4002:c01::244]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 29AF32AEA for ; Mon, 16 Jun 2014 23:34:07 +0000 (UTC) Received: by mail-yh0-f68.google.com with SMTP id a41so1551133yho.7 for ; Mon, 16 Jun 2014 16:34:06 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:date:message-id:subject:from:to:content-type; bh=VZJxwmwlmvVxM1VzEmUgYi8U4jwiyonCPRWLJrxLNds=; b=uL0wkIdD0ggeSq+DfIoEcoAPBZYg1T31R4D4/DkxfJrlHmuFSyJVhjWmr/0p9WET4I edRN3wKFa/HTMSqLhKTxKNoP1SoYBuy4kNGHuFJ7HfFGAUeltFe2h7L4Da83q2SmywUc yOpFWpiS/NlBcqdS9k+4W3z5J9ovGeWbafRhEMJGVyM71KRzKu5NhSmznmO4ThcJ4Twk SVhFwDL9fEPtad2audaFIJXbYTxJTEP5SJ65nRhwNBxiFhbqLXOTUQAxJCtQeGhg1Vx+ UPRGHkMMcNEdlpjJ9aecCeysU3KLvMRFrR1a/HusRIkM76i/gtxHrFcH1aHV3B35J1rf zTEg== MIME-Version: 1.0 X-Received: by 10.236.87.129 with SMTP id y1mr18495897yhe.121.1402961646298; Mon, 16 Jun 2014 16:34:06 -0700 (PDT) Received: by 10.170.88.67 with HTTP; Mon, 16 Jun 2014 16:34:06 -0700 (PDT) Received: by 10.170.88.67 with HTTP; Mon, 16 Jun 2014 16:34:06 -0700 (PDT) Date: Mon, 16 Jun 2014 16:34:06 -0700 Message-ID: Subject: From: Brett Everett To: freebsd-i18n@freebsd.org Content-Type: text/plain; charset=UTF-8 X-Content-Filtered-By: Mailman/MimeDel 2.1.18 X-BeenThere: freebsd-i18n@freebsd.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: FreeBSD Internationalization Effort List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 16 Jun 2014 23:34:07 -0000 Hey