From owner-freebsd-current@freebsd.org Sun Nov 15 07:24:40 2015 Return-Path: Delivered-To: freebsd-current@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id E9C80A2F6D4; Sun, 15 Nov 2015 07:24:40 +0000 (UTC) (envelope-from yaneurabeya@gmail.com) Received: from mail-ig0-x231.google.com (mail-ig0-x231.google.com [IPv6:2607:f8b0:4001:c05::231]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id AF4B91CCB; Sun, 15 Nov 2015 07:24:40 +0000 (UTC) (envelope-from yaneurabeya@gmail.com) Received: by igbxm8 with SMTP id xm8so38743774igb.1; Sat, 14 Nov 2015 23:24:40 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=content-type:mime-version:subject:from:in-reply-to:date:cc :content-transfer-encoding:message-id:references:to; bh=ktKLy6yCjYYHISuMCxnCEysrSDGYx2BUZaO6kKywFtY=; b=X0wxWYW88DbrGNCi0ac8E+oGqjwpJKE/4yvH+p/R79obW+RrYCQDMs9yp91y85uy7U If0Bm4a6bgaW6ItR0xaPUB69AIiGOMdWQYMkdRgFyh0EX+AhRMv2/3qHp9Yi44oIR1W5 SIa58EwCcabCVnLQ7DKR/tbXxQRVXyOm+LvcszdA2ao2EKtue31BhBRaes8wpDnrGWDT nEgKL0X5bNNebFS3bLGs3R867RPKKnWQDba/LPGMPcUVpfKtv5P+Ex2ktbUbBUS9TtWh 90NJYCaXocpX67wI9MICiojcampcR8gut+yBCAFAexi0K51GT+oEhqQAqvFDxPd8jDeP m5Zw== X-Received: by 10.50.43.197 with SMTP id y5mr10545064igl.45.1447572280099; Sat, 14 Nov 2015 23:24:40 -0800 (PST) Received: from ?IPv6:2601:601:800:126d:fd52:9a90:172f:f1ee? ([2601:601:800:126d:fd52:9a90:172f:f1ee]) by smtp.gmail.com with ESMTPSA id ie20sm4351327igb.10.2015.11.14.23.24.37 (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Sat, 14 Nov 2015 23:24:38 -0800 (PST) Content-Type: text/plain; charset=utf-8 Mime-Version: 1.0 (Mac OS X Mail 8.2 \(2104\)) Subject: Re: Need help fixing failing locale tests From: NGie Cooper In-Reply-To: <56482FA9.2010803@marino.st> Date: Sat, 14 Nov 2015 23:24:36 -0800 Cc: Craig Rodrigues , Baptiste Daroussin , freebsd-current Current , "freebsd-testing@freebsd.org" Content-Transfer-Encoding: quoted-printable Message-Id: <02FA2ED1-42BF-4BF2-879D-5463A119C000@gmail.com> References: <69242BD8-9010-47F0-9706-BE206376ECEA@gmail.com> <289892B6-EACE-4BDA-B838-D3DC750319DE@gmail.com> <56482FA9.2010803@marino.st> To: John Marino X-Mailer: Apple Mail (2.2104) X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 15 Nov 2015 07:24:41 -0000 > On Nov 14, 2015, at 23:09, John Marino wrote: >=20 > On 11/15/2015 4:46 AM, NGie Cooper wrote: >>=20 >>> On Nov 14, 2015, at 19:28, NGie Cooper = wrote: >>=20 >> =E2=80=A6 >>=20 >>> Why were these locales removed? >>>=20 >>> 58 OLD_FILES+=3Dusr/share/locale/la_LN.ISO8859-1/LC_COLLATE >>> 59 OLD_FILES+=3Dusr/share/locale/la_LN.ISO8859-1/LC_CTYPE >>> 60 OLD_FILES+=3Dusr/share/locale/la_LN.ISO8859-1/LC_TIME >>> 61 OLD_DIRS+=3Dusr/share/locale/la_LN.ISO8859-1 >>> 62 OLD_FILES+=3Dusr/share/locale/la_LN.ISO8859-13/LC_COLLATE >>> 63 OLD_FILES+=3Dusr/share/locale/la_LN.ISO8859-13/LC_CTYPE >>> 64 OLD_DIRS+=3Dusr/share/locale/la_LN.ISO8859-13 >>=20 >> la_LN.ISO8859-1 is the old Latin locale, which is no longer = installed. Copying over locale files from a stable/10 host works, but = I=E2=80=99m confused as to why a bunch of locales weren=E2=80=99t ported = over in their non-UTF-8 forms. >> Thanks, >>=20 >=20 > We (DragonFly) didn't just update locales. We took the opportunity to > do spring cleaning. We didn't want to be as drastic as OpenBSD which > removed all encodings except for C/POSIX and UTF, but we did remove > several locales intentionally. >=20 > In the case of ISO8859-1: > All ISO8859-* is basically obsolete. > In western Europe, if somebody wants ISO-8859, they want ISO8859-15, = not > ISO8859-1. They are similar, but the former is tailored for western > europe with "Euro" currency and 9 other symbols. It comes at the > expense of removing 10 characters from ISO8859-1. There's also a = common > problem that users view -15 documents with -1 accidently. So there = was > a conscience decision to have either ISO8859-1 or ISO8859-15 but not > both. For western Europe this means the ISO8859-1 versions were = dropped. >=20 > ISO8859-15: > In the case of USA and other non-European countries, they keep -1 and > dropped -15. >=20 > currency based: > In the case of countries where the currency symbols is not part of > ISO8859, it was dropped. E.g. Costa Rica uses the Colon which is only > in UTF-8, so there's no ISO8859-* encoding at all for CR. >=20 > Latin: > Who speaks Latin today? > This was mainly an alias for 7-bit ascii. We originally dropped that, > but later moved it to US-ASCII (which was just a symlink to Latin = before) >=20 > Bapt liked DF approach well enough that he adopted it. Even Edwin was > first in desiring to clean up locales. The major update was a perfect = time. >=20 > Bottom line: > The testsuite needs to be updated. > e.g. use de_DE.ISO8859-15 intead of de_DE.ISO8859-1 > For latin, replace with US-ASCII equivalent. I wish this had been clearly communicated here: = https://svnweb.freebsd.org/changeset/base/290494 =E2=80=A6 instead, = there are some POLA violations: 1. No RelNotes. 2. No summary of locales that have been removed. 3. No UPDATING entry for people to migrate from a locale to = another. 4. Deprecated locales (as you described it above) are still = present on my system after running `make delete-old` (assuming I have my = acronyms right, for example, ca_ES, it_CH, etc should be -1, not -15 = based on your claim above). I will update the testcases to use locales if possible, but more = work needs to be done finishing off this project and documenting for = end-users what has changed. Thanks, -NGie=