From owner-freebsd-current@freebsd.org Sun Nov 15 07:09:38 2015 Return-Path: Delivered-To: freebsd-current@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 1E8F3A2F3AE; Sun, 15 Nov 2015 07:09:38 +0000 (UTC) (envelope-from dragonflybsd@marino.st) Received: from shepard.synsport.net (mail.synsport.com [208.69.230.148]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 149D613C6; Sun, 15 Nov 2015 07:09:37 +0000 (UTC) (envelope-from dragonflybsd@marino.st) Received: from [192.168.1.22] (210.Red-81-38-187.dynamicIP.rima-tde.net [81.38.187.210]) (using TLSv1 with cipher DHE-RSA-AES128-SHA (128/128 bits)) (No client certificate requested) by shepard.synsport.net (Postfix) with ESMTP id 00EC543BA2; Sun, 15 Nov 2015 01:09:33 -0600 (CST) Subject: Re: Need help fixing failing locale tests To: NGie Cooper , Craig Rodrigues References: <69242BD8-9010-47F0-9706-BE206376ECEA@gmail.com> <289892B6-EACE-4BDA-B838-D3DC750319DE@gmail.com> Cc: Baptiste Daroussin , freebsd-current Current , "freebsd-testing@freebsd.org" From: John Marino X-Enigmail-Draft-Status: N1110 Message-ID: <56482FA9.2010803@marino.st> Date: Sun, 15 Nov 2015 08:09:29 +0100 User-Agent: Mozilla/5.0 (Windows NT 6.3; WOW64; rv:38.0) Gecko/20100101 Thunderbird/38.0.1 MIME-Version: 1.0 In-Reply-To: <289892B6-EACE-4BDA-B838-D3DC750319DE@gmail.com> Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 8bit X-Mailman-Approved-At: Sun, 15 Nov 2015 12:17:35 +0000 X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 15 Nov 2015 07:09:38 -0000 On 11/15/2015 4:46 AM, NGie Cooper wrote: > >> On Nov 14, 2015, at 19:28, NGie Cooper wrote: > > … > >> Why were these locales removed? >> >> 58 OLD_FILES+=usr/share/locale/la_LN.ISO8859-1/LC_COLLATE >> 59 OLD_FILES+=usr/share/locale/la_LN.ISO8859-1/LC_CTYPE >> 60 OLD_FILES+=usr/share/locale/la_LN.ISO8859-1/LC_TIME >> 61 OLD_DIRS+=usr/share/locale/la_LN.ISO8859-1 >> 62 OLD_FILES+=usr/share/locale/la_LN.ISO8859-13/LC_COLLATE >> 63 OLD_FILES+=usr/share/locale/la_LN.ISO8859-13/LC_CTYPE >> 64 OLD_DIRS+=usr/share/locale/la_LN.ISO8859-13 > > la_LN.ISO8859-1 is the old Latin locale, which is no longer installed. Copying over locale files from a stable/10 host works, but I’m confused as to why a bunch of locales weren’t ported over in their non-UTF-8 forms. > Thanks, > We (DragonFly) didn't just update locales. We took the opportunity to do spring cleaning. We didn't want to be as drastic as OpenBSD which removed all encodings except for C/POSIX and UTF, but we did remove several locales intentionally. In the case of ISO8859-1: All ISO8859-* is basically obsolete. In western Europe, if somebody wants ISO-8859, they want ISO8859-15, not ISO8859-1. They are similar, but the former is tailored for western europe with "Euro" currency and 9 other symbols. It comes at the expense of removing 10 characters from ISO8859-1. There's also a common problem that users view -15 documents with -1 accidently. So there was a conscience decision to have either ISO8859-1 or ISO8859-15 but not both. For western Europe this means the ISO8859-1 versions were dropped. ISO8859-15: In the case of USA and other non-European countries, they keep -1 and dropped -15. currency based: In the case of countries where the currency symbols is not part of ISO8859, it was dropped. E.g. Costa Rica uses the Colon which is only in UTF-8, so there's no ISO8859-* encoding at all for CR. Latin: Who speaks Latin today? This was mainly an alias for 7-bit ascii. We originally dropped that, but later moved it to US-ASCII (which was just a symlink to Latin before) Bapt liked DF approach well enough that he adopted it. Even Edwin was first in desiring to clean up locales. The major update was a perfect time. Bottom line: The testsuite needs to be updated. e.g. use de_DE.ISO8859-15 intead of de_DE.ISO8859-1 For latin, replace with US-ASCII equivalent. John