Date: Mon, 4 Mar 2002 18:28:11 +1100 From: "Tim J. Robbins" <tim@robbins.dropbear.id.au> To: freebsd-standards@FreeBSD.ORG Subject: iconv utility and <iconv.h> Message-ID: <20020304182811.A29732@descent.robbins.dropbear.id.au>
index | next in thread | raw e-mail
[-- Attachment #1 --] Hi, Here's an implementation of the iconv utility as well as the <iconv.h> header file and functions. For ease of testing, the iconv*() libc functions aren't actually added to the library, they are just compiled with the utility. A script in the tarball, unicode.pl, converts Unicode Consortium mapping files into POSIX CHARMAP files. Some useful maps can be made from: http://www.unicode.org/Public/MAPPINGS/ I think the licence on these files is liberal enough to allow them to be included in FreeBSD. There is also a UTF-8 CHARMAP file here: http://www-124.ibm.com/developerworks/oss/cvs/locale/ul/src/cmap/charmap.utf8?sortby=rev The licence on this file apparently isn't fit for src/ in general, but maybe the src/gnu tree. This charmap file is *huge* and consumes a lot of memory due to malloc() overhead and fixed-size buffers in the structures. Using an arena allocator and string pooling would bring memory consumption closer to the size of the file (~2.7MB). Comments? Tim [-- Attachment #2 --] <
