From owner-svn-src-projects@freebsd.org Sat Aug 8 00:28:25 2015 Return-Path: Delivered-To: svn-src-projects@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id D3BD19B6F41 for ; Sat, 8 Aug 2015 00:28:25 +0000 (UTC) (envelope-from bapt@FreeBSD.org) Received: from repo.freebsd.org (repo.freebsd.org [IPv6:2001:1900:2254:2068::e6a:0]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id BE648189C; Sat, 8 Aug 2015 00:28:25 +0000 (UTC) (envelope-from bapt@FreeBSD.org) Received: from repo.freebsd.org ([127.0.1.70]) by repo.freebsd.org (8.14.9/8.14.9) with ESMTP id t780SPvK027989; Sat, 8 Aug 2015 00:28:25 GMT (envelope-from bapt@FreeBSD.org) Received: (from bapt@localhost) by repo.freebsd.org (8.14.9/8.14.9/Submit) id t780SO8L027985; Sat, 8 Aug 2015 00:28:24 GMT (envelope-from bapt@FreeBSD.org) Message-Id: <201508080028.t780SO8L027985@repo.freebsd.org> X-Authentication-Warning: repo.freebsd.org: bapt set sender to bapt@FreeBSD.org using -f From: Baptiste Daroussin Date: Sat, 8 Aug 2015 00:28:24 +0000 (UTC) To: src-committers@freebsd.org, svn-src-projects@freebsd.org Subject: svn commit: r286434 - in projects/collation/tools/tools/locale: . etc etc/charmaps etc/final-maps tools X-SVN-Group: projects MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit X-BeenThere: svn-src-projects@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: "SVN commit messages for the src " projects" tree" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 08 Aug 2015 00:28:26 -0000 Author: bapt Date: Sat Aug 8 00:28:23 2015 New Revision: 286434 URL: https://svnweb.freebsd.org/changeset/base/286434 Log: Add set of tools created by edwin@ long time ago to generate locales Those tools were modified and extended by John Marino Add the generated charmaps and maps for LC_CTYPE generation Obtained from: Dragonfly Added: projects/collation/tools/tools/locale/ projects/collation/tools/tools/locale/Makefile (contents, props changed) projects/collation/tools/tools/locale/etc/ projects/collation/tools/tools/locale/etc/charmaps/ projects/collation/tools/tools/locale/etc/charmaps.xml (contents, props changed) projects/collation/tools/tools/locale/etc/charmaps/ARMSCII-8.TXT (contents, props changed) projects/collation/tools/tools/locale/etc/charmaps/Big5.TXT (contents, props changed) projects/collation/tools/tools/locale/etc/charmaps/Big5HKSCS.TXT (contents, props changed) projects/collation/tools/tools/locale/etc/charmaps/CP1131.TXT (contents, props changed) projects/collation/tools/tools/locale/etc/charmaps/CP1251.TXT (contents, props changed) projects/collation/tools/tools/locale/etc/charmaps/CP866.TXT (contents, props changed) projects/collation/tools/tools/locale/etc/charmaps/GB18030.TXT (contents, props changed) projects/collation/tools/tools/locale/etc/charmaps/GB2312.TXT (contents, props changed) projects/collation/tools/tools/locale/etc/charmaps/GBK.TXT (contents, props changed) projects/collation/tools/tools/locale/etc/charmaps/ISCII-DEV.TXT (contents, props changed) projects/collation/tools/tools/locale/etc/charmaps/ISO8859-1.TXT (contents, props changed) projects/collation/tools/tools/locale/etc/charmaps/ISO8859-13.TXT (contents, props changed) projects/collation/tools/tools/locale/etc/charmaps/ISO8859-15.TXT (contents, props changed) projects/collation/tools/tools/locale/etc/charmaps/ISO8859-2.TXT (contents, props changed) projects/collation/tools/tools/locale/etc/charmaps/ISO8859-4.TXT (contents, props changed) projects/collation/tools/tools/locale/etc/charmaps/ISO8859-5.TXT (contents, props changed) projects/collation/tools/tools/locale/etc/charmaps/ISO8859-7.TXT (contents, props changed) projects/collation/tools/tools/locale/etc/charmaps/ISO8859-9.TXT (contents, props changed) projects/collation/tools/tools/locale/etc/charmaps/KOI8-R.TXT (contents, props changed) projects/collation/tools/tools/locale/etc/charmaps/KOI8-U.TXT (contents, props changed) projects/collation/tools/tools/locale/etc/charmaps/PT154.TXT (contents, props changed) projects/collation/tools/tools/locale/etc/charmaps/SJIS.TXT (contents, props changed) projects/collation/tools/tools/locale/etc/charmaps/US-ASCII.TXT (contents, props changed) projects/collation/tools/tools/locale/etc/charmaps/charmaps.txt (contents, props changed) projects/collation/tools/tools/locale/etc/charmaps/eucCN.TXT (contents, props changed) projects/collation/tools/tools/locale/etc/charmaps/eucJP.TXT (contents, props changed) projects/collation/tools/tools/locale/etc/charmaps/eucKR.TXT (contents, props changed) projects/collation/tools/tools/locale/etc/final-maps/ projects/collation/tools/tools/locale/etc/final-maps/map.ARMSCII-8 projects/collation/tools/tools/locale/etc/final-maps/map.Big5 projects/collation/tools/tools/locale/etc/final-maps/map.Big5HKSCS projects/collation/tools/tools/locale/etc/final-maps/map.CP1131 projects/collation/tools/tools/locale/etc/final-maps/map.CP1251 projects/collation/tools/tools/locale/etc/final-maps/map.CP866 projects/collation/tools/tools/locale/etc/final-maps/map.GB18030 projects/collation/tools/tools/locale/etc/final-maps/map.GB2312 projects/collation/tools/tools/locale/etc/final-maps/map.GBK projects/collation/tools/tools/locale/etc/final-maps/map.ISCII-DEV projects/collation/tools/tools/locale/etc/final-maps/map.ISO8859-1 projects/collation/tools/tools/locale/etc/final-maps/map.ISO8859-13 projects/collation/tools/tools/locale/etc/final-maps/map.ISO8859-15 projects/collation/tools/tools/locale/etc/final-maps/map.ISO8859-2 projects/collation/tools/tools/locale/etc/final-maps/map.ISO8859-4 projects/collation/tools/tools/locale/etc/final-maps/map.ISO8859-5 projects/collation/tools/tools/locale/etc/final-maps/map.ISO8859-7 projects/collation/tools/tools/locale/etc/final-maps/map.ISO8859-9 projects/collation/tools/tools/locale/etc/final-maps/map.KOI8-R projects/collation/tools/tools/locale/etc/final-maps/map.KOI8-U projects/collation/tools/tools/locale/etc/final-maps/map.PT154 projects/collation/tools/tools/locale/etc/final-maps/map.SJIS projects/collation/tools/tools/locale/etc/final-maps/map.US-ASCII projects/collation/tools/tools/locale/etc/final-maps/map.UTF-8 projects/collation/tools/tools/locale/etc/final-maps/map.eucCN projects/collation/tools/tools/locale/etc/final-maps/map.eucJP projects/collation/tools/tools/locale/etc/final-maps/map.eucKR projects/collation/tools/tools/locale/etc/final-maps/widths.txt (contents, props changed) projects/collation/tools/tools/locale/etc/unicode.conf (contents, props changed) projects/collation/tools/tools/locale/tools/ projects/collation/tools/tools/locale/tools/UTF82encoding.pl (contents, props changed) projects/collation/tools/tools/locale/tools/changeoffset.pl (contents, props changed) projects/collation/tools/tools/locale/tools/charmaps.pm (contents, props changed) projects/collation/tools/tools/locale/tools/cldr2def.pl (contents, props changed) projects/collation/tools/tools/locale/tools/convert_map.pl (contents, props changed) projects/collation/tools/tools/locale/tools/finalize (contents, props changed) projects/collation/tools/tools/locale/tools/unicode2src.pl (contents, props changed) projects/collation/tools/tools/locale/tools/whatis.pl (contents, props changed) Added: projects/collation/tools/tools/locale/Makefile ============================================================================== --- /dev/null 00:00:00 1970 (empty, because file is newly added) +++ projects/collation/tools/tools/locale/Makefile Sat Aug 8 00:28:23 2015 (r286434) @@ -0,0 +1,106 @@ +# $FreeBSD$ +# See https://wiki.freebsd.org/LocaleNewApproach +# Taken from FreeBSD svn [base]/user/edwin/locale/cldr +# +# needs: +# devel/p5-Tie-IxHash +# +# Modified by John Marino to suit DragonFly needs +# + +.if !defined(CLDRDIR) +CLDRDIR!= grep ^cldr etc/unicode.conf | cut -f 2 -d " " +.endif +.if !defined(UNIDATADIR) +UNIDATADIR!= grep ^unidata etc/unicode.conf | cut -f 2 -d " " +.endif +PASSON= CLDRDIR="${CLDRDIR}" UNIDATADIR="${UNIDATADIR}" + +ETCDIR= ${.CURDIR}/etc + +KNOWN= monetdef numericdef msgdef timedef colldef ctypedef +TYPES?= ${KNOWN} +LOCALE_DESTDIR?= /tmp/generated-locales/ + +.if defined(LC) +LC:= --lc=${LC} +.endif + +all: +.for t in ${TYPES} +. if ${KNOWN:M${t}} + test -d ${t} || mkdir ${t} + make build-${t} +. endif +.endfor + @echo "" + @find . -name *failed + +install: +.for t in ${TYPES} +. if ${KNOWN:M${t}} + rm -rf ${.CURDIR}/${t}.draft + rm -rf ${DESTDIR}/usr/src/share/${t} + mv ${.CURDIR}/${t} ${DESTDIR}/usr/src/share/ +. endif +.endfor + +post-install: +.for t in ${TYPES} +. if ${KNOWN:M${t}} + (cd ${DESTDIR}/usr/src/share/${t} && \ + make && make install && make clean) +. endif +.endfor + +.for t in ${TYPES} +build-${t}: + mkdir -p ${t} ${t}.draft + perl -I tools tools/cldr2def.pl \ + --cldr=$$(realpath ${CLDRDIR}) \ + --unidata=$$(realpath ${UNIDATADIR}) \ + --etc=$$(realpath ${ETCDIR}) \ + --type=${t} ${LC} + env ${PASSON} tools/finalize ${t} +.endfor + +clean: +.for t in ${TYPES} + rm -rf ${t} ${t}.draft +.endfor + +BASE_LOCALES_OF_INTEREST?= \ + af_ZA am_ET be_BY bg_BG ca_AD ca_ES ca_FR ca_IT \ + cs_CZ da_DK de_AT de_CH de_DE el_GR en_AU en_CA \ + en_GB en_HK en_IE en_NZ en_PH en_SG en_US en_ZA \ + es_AR es_CR es_ES es_MX et_EE eu_ES fi_FI fr_BE \ + fr_CA fr_CH fr_FR he_IL hi_IN hr_HR hu_HU hy_AM \ + is_IS it_CH it_IT ja_JP ko_KR lt_LT lv_LV \ + nb_NO nl_BE nl_NL nn_NO pl_PL pt_BR pt_PT ro_RO \ + ru_RU se_FI se_NO sk_SK sl_SI sv_FI sv_SE tr_TR \ + uk_UA \ + kk_Cyrl_KZ mn_Cyrl_MN sr_Cyrl_RS sr_Latn_RS \ + zh_Hans_CN zh_Hant_HK zh_Hant_TW + +POSIX: +.if exists (${CLDRDIR}/tools/java/cldr.jar) + mkdir -p ${CLDRDIR}/posix +. for area in ${BASE_LOCALES_OF_INTEREST} +. if !exists(${CLDRDIR}/posix/${area}.UTF-8.src) + java -DCLDR_DIR=${CLDRDIR:Q} -jar ${CLDRDIR}/tools/java/cldr.jar \ + org.unicode.cldr.posix.GeneratePOSIX \ + -d ${CLDRDIR}/posix -m ${area} -c UTF-8 +. endif +. endfor +. if !exists(${CLDRDIR}/posix/UTF-8.cm) + java -DCLDR_DIR=${CLDRDIR:Q} -jar ${CLDRDIR}/tools/java/cldr.jar \ + org.unicode.cldr.posix.GenerateCharmap \ + -d ${CLDRDIR}/posix +. endif +.else + @echo "Please install CLDR toolset for the desired release" + @echo "It should go at ${CLDRDIR}/tools" +.endif + +clean-POSIX: + rm -f {CLDRDIR}/posix/* Added: projects/collation/tools/tools/locale/etc/charmaps.xml ============================================================================== --- /dev/null 00:00:00 1970 (empty, because file is newly added) +++ projects/collation/tools/tools/locale/etc/charmaps.xml Sat Aug 8 00:28:23 2015 (r286434) @@ -0,0 +1,728 @@ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + "; + ""; + ""; + ""; + ""; + ""; + ""; + ""; + ""; + ""; + ""; + "" + ]]> + + + "; + ""; + ""; + ""; + ""; + ""; + ""; + "

"; + ""; + ""; + "

"; + "

" + ]]> + + + "; + ""; + ""; + ""; + ""; + ""; + ""; + ""; + ""; + ""; + ""; + "" + ]]> + + + "; + ""; + ""; + ""; + ""; + ""; + ""; + ""; + ""; + ""; + ""; + "" + ]]> + + + "; + ""; + ""; + ""; + ""; + ""; + "

"; + "

"; + ""; + "

"; + "

"; + "" + ]]> + + + "; + ""; + ""; + ""; + ""; + ""; + ""; + ""; + ""; + ""; + ""; + "" + ]]> + + + "; + ""; + ""; + ""; + ""; + ""; + "

"; + "

"; + ""; + "

"; + "

"; + "" + ]]> + + + "; + ""; + ""; + ""; + ""; + ""; + ""; + ""; + ""; + ""; + ""; + "" + ]]> + + + "; + ""; + ""; + ""; + ""; + ""; + ""; + ""; + ""; + ""; + ""; + "" + ]]> + + + + + Added: projects/collation/tools/tools/locale/etc/charmaps/ARMSCII-8.TXT ============================================================================== --- /dev/null 00:00:00 1970 (empty, because file is newly added) +++ projects/collation/tools/tools/locale/etc/charmaps/ARMSCII-8.TXT Sat Aug 8 00:28:23 2015 (r286434) @@ -0,0 +1,263 @@ +# +# Obtained from +# http://haible.de/bruno/charsets/conversion-tables/Armenian.html +# in the file libiconv-1.0/ARMSCII-8.TXT +# +# Updated with libiconv-1.13.1/tests/ARMSCII-8.TXT +# +# $FreeBSD$ +# +0x00 0x0000 +0x01 0x0001 +0x02 0x0002 +0x03 0x0003 +0x04 0x0004 +0x05 0x0005 +0x06 0x0006 +0x07 0x0007 +0x08 0x0008 +0x09 0x0009 +0x0A 0x000A +0x0B 0x000B +0x0C 0x000C +0x0D 0x000D +0x0E 0x000E +0x0F 0x000F +0x10 0x0010 +0x11 0x0011 +0x12 0x0012 +0x13 0x0013 +0x14 0x0014 +0x15 0x0015 +0x16 0x0016 +0x17 0x0017 +0x18 0x0018 +0x19 0x0019 +0x1A 0x001A +0x1B 0x001B +0x1C 0x001C +0x1D 0x001D +0x1E 0x001E +0x1F 0x001F +0x20 0x0020 +0x21 0x0021 +0x22 0x0022 +0x23 0x0023 +0x24 0x0024 +0x25 0x0025 +0x26 0x0026 +0x27 0x0027 +0x28 0x0028 +0x29 0x0029 +0x2A 0x002A +0x2B 0x002B +0x2C 0x002C +0x2D 0x002D +0x2E 0x002E +0x2F 0x002F +0x30 0x0030 +0x31 0x0031 +0x32 0x0032 +0x33 0x0033 +0x34 0x0034 +0x35 0x0035 +0x36 0x0036 +0x37 0x0037 +0x38 0x0038 +0x39 0x0039 +0x3A 0x003A +0x3B 0x003B +0x3C 0x003C +0x3D 0x003D +0x3E 0x003E +0x3F 0x003F +0x40 0x0040 +0x41 0x0041 +0x42 0x0042 +0x43 0x0043 +0x44 0x0044 +0x45 0x0045 +0x46 0x0046 +0x47 0x0047 +0x48 0x0048 +0x49 0x0049 +0x4A 0x004A +0x4B 0x004B +0x4C 0x004C +0x4D 0x004D +0x4E 0x004E +0x4F 0x004F +0x50 0x0050 +0x51 0x0051 +0x52 0x0052 +0x53 0x0053 +0x54 0x0054 +0x55 0x0055 +0x56 0x0056 +0x57 0x0057 +0x58 0x0058 +0x59 0x0059 +0x5A 0x005A +0x5B 0x005B +0x5C 0x005C +0x5D 0x005D +0x5E 0x005E +0x5F 0x005F +0x60 0x0060 +0x61 0x0061 +0x62 0x0062 +0x63 0x0063 +0x64 0x0064 +0x65 0x0065 +0x66 0x0066 +0x67 0x0067 +0x68 0x0068 +0x69 0x0069 +0x6A 0x006A +0x6B 0x006B +0x6C 0x006C +0x6D 0x006D +0x6E 0x006E +0x6F 0x006F +0x70 0x0070 +0x71 0x0071 +0x72 0x0072 +0x73 0x0073 +0x74 0x0074 +0x75 0x0075 +0x76 0x0076 +0x77 0x0077 +0x78 0x0078 +0x79 0x0079 +0x7A 0x007A +0x7B 0x007B +0x7C 0x007C +0x7D 0x007D +0x7E 0x007E +0x7F 0x007F +0x80 0x0080 +0x81 0x0081 +0x82 0x0082 +0x83 0x0083 +0x84 0x0084 +0x85 0x0085 +0x86 0x0086 +0x87 0x0087 +0x88 0x0088 +0x89 0x0089 +0x8A 0x008A +0x8B 0x008B +0x8C 0x008C +0x8D 0x008D +0x8E 0x008E +0x8F 0x008F +0x90 0x0090 +0x91 0x0091 +0x92 0x0092 +0x93 0x0093 *** DIFF OUTPUT TRUNCATED AT 1000 LINES ***