From owner-svn-src-all@freebsd.org Sun Jul 24 15:48:07 2016 Return-Path: Delivered-To: svn-src-all@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 5480EBA3AC4 for ; Sun, 24 Jul 2016 15:48:07 +0000 (UTC) (envelope-from mailing-machine@vniz.net) Received: from mail-lf0-f51.google.com (mail-lf0-f51.google.com [209.85.215.51]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id EB8F61C4C for ; Sun, 24 Jul 2016 15:48:06 +0000 (UTC) (envelope-from mailing-machine@vniz.net) Received: by mail-lf0-f51.google.com with SMTP id g62so113884487lfe.3 for ; Sun, 24 Jul 2016 08:48:06 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:subject:to:references:cc:from:message-id:date :user-agent:mime-version:in-reply-to; bh=qB3TV5aWZcTPFV35QyZQ8MbxT3wdjsbtXCTdl0xDH+A=; b=ZPefgeE/z5hCQeKZpDm98RvMc2YJ87+eS6kkY8YQdn4bhW0SejufsqgYp+xnDuL3ba J4EidawOviaPZA0T+h+IV9+EfxwORlDAZNHCI6locDQIqR/bHW4DlMxsT9GOcqyRP5zZ jVmiH3ithdV3SwuKak1vzbKMJbFHohMBWfDpTv2jhAXQoP3pKCFrnhYMtO9tvmmjoR/N uzFqBmug5JOViqjGsa1Hi2b4KZfm2ZYd2YU+4GxEovq4G3WvZ91Snm1MVVE2/f426YqS /1HHQzOV1gtPJujR7Yj7KXdYYcbxmLEh5AWoG47X3D456DSVmKeEUHFRcnHyM0CxAyre IZ/A== X-Gm-Message-State: AEkoouvD1shTrverUkId1a3OmZdkv0tV0pWKnc/49v6WoLr/Gw5+C6DMnaUDm67NDrisxA== X-Received: by 10.25.81.139 with SMTP id f133mr6074607lfb.78.1469375284982; Sun, 24 Jul 2016 08:48:04 -0700 (PDT) Received: from [192.168.1.2] ([89.169.173.68]) by smtp.gmail.com with ESMTPSA id c125sm4789119lfe.10.2016.07.24.08.48.03 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Sun, 24 Jul 2016 08:48:04 -0700 (PDT) Subject: Re: svn commit: r303218 - head/tools/tools/locale/tools To: Baptiste Daroussin References: <201607231124.u6NBO5aJ003824@repo.freebsd.org> <97566d46-1d37-8c95-f276-f55b190bddbb@freebsd.org> <20160723115244.76vhhzl55qoyw4kf@ivaldir.etoilebsd.net> <2ddb2814-9edf-82a9-350c-aebf34cdb4ab@freebsd.org> <20160723123228.i2tmxaklkoad6vkh@ivaldir.etoilebsd.net> Cc: src-committers@freebsd.org, svn-src-all@freebsd.org, svn-src-head@freebsd.org From: Andrey Chernov Message-ID: Date: Sun, 24 Jul 2016 18:48:00 +0300 User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:45.0) Gecko/20100101 Thunderbird/45.2.0 MIME-Version: 1.0 In-Reply-To: <20160723123228.i2tmxaklkoad6vkh@ivaldir.etoilebsd.net> Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="4ELSWsHPTtIeDWI984PUX9wu0jMrAHKvg" X-BeenThere: svn-src-all@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: "SVN commit messages for the entire src tree \(except for " user" and " projects" \)" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 24 Jul 2016 15:48:07 -0000 This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --4ELSWsHPTtIeDWI984PUX9wu0jMrAHKvg Content-Type: multipart/mixed; boundary="jFl3RWirmM27nRf4sS3RKbOCKcJvbl8wg" From: Andrey Chernov To: Baptiste Daroussin Cc: src-committers@freebsd.org, svn-src-all@freebsd.org, svn-src-head@freebsd.org Message-ID: Subject: Re: svn commit: r303218 - head/tools/tools/locale/tools References: <201607231124.u6NBO5aJ003824@repo.freebsd.org> <97566d46-1d37-8c95-f276-f55b190bddbb@freebsd.org> <20160723115244.76vhhzl55qoyw4kf@ivaldir.etoilebsd.net> <2ddb2814-9edf-82a9-350c-aebf34cdb4ab@freebsd.org> <20160723123228.i2tmxaklkoad6vkh@ivaldir.etoilebsd.net> In-Reply-To: <20160723123228.i2tmxaklkoad6vkh@ivaldir.etoilebsd.net> --jFl3RWirmM27nRf4sS3RKbOCKcJvbl8wg Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable On 23.07.2016 15:32, Baptiste Daroussin wrote: > On Sat, Jul 23, 2016 at 02:58:31PM +0300, Andrey Chernov wrote: >> On 23.07.2016 14:52, Baptiste Daroussin wrote: >>> On Sat, Jul 23, 2016 at 02:41:39PM +0300, Andrey Chernov wrote: >>>> On 23.07.2016 14:24, Baptiste Daroussin wrote: >>>>> Author: bapt >>>>> Date: Sat Jul 23 11:24:05 2016 >>>>> New Revision: 303218 >>>>> URL: https://svnweb.freebsd.org/changeset/base/303218 >>>>> >>>>> Log: >>>>> Add another hack to add weekday to date format to more locales >>>>> >>>>> While here only initialize the iconv converter when needed >>>>> >>>>> Modified: >>>>> head/tools/tools/locale/tools/cldr2def.pl >>>> >>>> BTW, is there any progress in generating all collates with -m ${area= } as >>>> you planned? >>>> >>> you mean the @modifier? >> >> No, I mean that: >>>> Perhaps all uk_UA should be generated with -m ${area} too - Ukrainia= ns >>>> have extended Cyrillics in their alphabet and I am not sure that the= ir >>>> order match default Unicode order for Cyrillic. The same about be_BY= , >>>> bg_BG and sr_Cyrl_RS. They may match or may not, I don't check such >>> deeply. >>>> >>>> It seems the safest side will be to generate all with -m ${area} >>>> >>> Yes that is my plan, except for the 1 or 2 that cannot be generated >> >from cldr >>> directly >> >=20 > Nope I haven't made any progress, and I actually did a bunch of tests o= f some > (honnestly not all locales) trying to get a representative set and coul= d not > find differnce in ordering between locales generated with -m ${area}. >=20 > It would also needs lots of work on the generation tools. >=20 > I first need to write a tool that compares collation rules for various = ${area} > (not done yet) to see how much this is really needed and use it in the > generation tools. >=20 > I will try to do that for 12 if it is really worth it (based on the res= ult from > that comparison tools) IMHO we don't need comparison tools, just blindly adding -m ${area} to generating of every collate with different area be enough. CLDR may involve from time to time including national alphabets changes (which may happen often enough too), so it will be better to not run such tests every time with new CLDR import, but just the make code which do it correctly independently (-m ${area}) and forget about it, it will be much easier to maintain. Moreover, you'll spend more time writing such testing tool than adding -m ${area} :) --jFl3RWirmM27nRf4sS3RKbOCKcJvbl8wg-- --4ELSWsHPTtIeDWI984PUX9wu0jMrAHKvg Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- iQEcBAEBCAAGBQJXlOMwAAoJEKUckv0MjfbKwfkIAMVYxgd0EEL94EYXtiaBpnL/ VdT0suOHkjYzXICMMkxH1Av9Luu7v9Oq1M11vYhcwiHJqTZMzIGvDgPugSDdbyx7 ilkCiTxJERPFsSQzn4YAuOMMZuJgFKvfKNXM5WUTYhv8A1R6FyHfmUDrP6Y7VUVK d3hrVX/Q4ZBYhVMlNT0zjxqkVk8xTMRiznCLHz4EmgSqzoLiBtm4VBXzanwghse5 ltP08tMj2dkF0UdqeswXugnyVeJ98FaT8Fzi1l8vN/tu9rv29jumj6pNsXxsC7Ds t3ayUmtMNWBsKrwfUKDSML1tsEJ2G45AsAGQHX8+MXykLrUcOU34QYlswkTIYrg= =ldlB -----END PGP SIGNATURE----- --4ELSWsHPTtIeDWI984PUX9wu0jMrAHKvg--