From owner-freebsd-current@FreeBSD.ORG Tue Jun 15 17:01:55 2010 Return-Path: Delivered-To: freebsd-current@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 21D7D106566C; Tue, 15 Jun 2010 17:01:55 +0000 (UTC) (envelope-from gleb.kurtsou@gmail.com) Received: from mail-bw0-f54.google.com (mail-bw0-f54.google.com [209.85.214.54]) by mx1.freebsd.org (Postfix) with ESMTP id 3D2538FC18; Tue, 15 Jun 2010 17:01:53 +0000 (UTC) Received: by bwz8 with SMTP id 8so257651bwz.13 for ; Tue, 15 Jun 2010 10:01:53 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:date:from:to:cc:subject :message-id:references:mime-version:content-type:content-disposition :in-reply-to:user-agent; bh=CDUii5vuCia8DK1TewIs2tp/HTzoattqdc/br6m2OJs=; b=pxhh2aWJ9+0y+JQycuydDdnwBufv1Um2agCfJFBuGG2VWA04Etv1dV1glmh7Ai03aS C98SSVY3DVrYVqLpwHzMdPOz0SxxPctgGihvX4756+/vecf5h8f3tjh2ngBBnM5DtkeT tkPZq1B51fqSPbGq0bFQa1Jwf8YEBwIDt/d4E= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=date:from:to:cc:subject:message-id:references:mime-version :content-type:content-disposition:in-reply-to:user-agent; b=Bv+pyAOrfaXfizucfPnYTM/orKhFn4o7Vo77YMo7fORWjw/jZyQgsHpgMx0cRtCsZh 80f0BCaO3zpKLATMfw82bj7OlxnEWoha9FUOWgzQRPeXvVxdLUGV+7nRB62lUSZINEKL Cqmmpwb92YiWdaZTfhL8Pw61zQTnPmimS9G8I= Received: by 10.204.47.25 with SMTP id l25mr5637974bkf.46.1276621312316; Tue, 15 Jun 2010 10:01:52 -0700 (PDT) Received: from localhost ([212.98.186.134]) by mx.google.com with ESMTPS id f13sm25202151bka.23.2010.06.15.10.01.50 (version=TLSv1/SSLv3 cipher=RC4-MD5); Tue, 15 Jun 2010 10:01:51 -0700 (PDT) Date: Tue, 15 Jun 2010 20:01:58 +0300 From: Gleb Kurtsou To: Gabor Kovesdan Message-ID: <20100615170158.GA2131@tops> References: <4C16C5B5.1070308@FreeBSD.org> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Disposition: inline In-Reply-To: <4C16C5B5.1070308@FreeBSD.org> User-Agent: Mutt/1.5.20 (2009-06-14) Cc: Edwin Groothuis , FreeBSD Current , Xin LI , i18n@FreeBSD.org Subject: Re: [CFT] BSDL iconv in base system X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 15 Jun 2010 17:01:55 -0000 On (15/06/2010 02:13), Gabor Kovesdan wrote: > Hello Folks, > > during the last summer, Google generously founded my Summer of Code > project, which was providing a BSD-licensed iconv implementation for > FreeBSD. I'm proud to announce that the work has been completed and a > patch is available to add it to the base system. > > The results of this work are: > - The Citrus implementation has been ported from NetBSD. > - Some utilities have been added. There is a conversion table generator, > which can compare conversion tables to reference data generated by GNU > libiconv. This helps ensuring conversion compatibility. > - UTF-16 surrogate support and some endianness issues have been fixed. > - The rather chaotic Makefiles to build metadata have been refactored > and cleaned up, now it is easy to read and it is also easier to add > support for new encodings. > - A bunch of new encodings and encoding aliases have been added. > - Support for 1->2, 1->3 and 1->4 mappings, which is needed for > transliterating with flying accents as GNU does, like "u. > - Lots of warnings have been fixed, the major part of the code is now > WARNS=6 clean. > - New section 1 and section 5 manual pages have been added. > - Some GNU-specific calls have been implemented: iconvlist(), > iconvctl(), iconv_canonicalize(), iconv_open_into() > - Support for GNU's //IGNORE suffix has been added. > - The "-" argument for stdin is now recognized in iconv(1) as per POSIX. > - The Big5 conversion module has been fixed. > - The iconv.h header files is supposed to be compatible with the GNU > version, i.e. sources should build with base iconv.h and GNU libiconv. > I've just did a very quick test and it seems ports can safely link to > GNU libiconv, there's no conflict. > - Various cleanups and style(9) fixes. > - A bachelor thesis written in Hungarian language: > http://www.kovesdan.org/files/bsc_iconv.pdf > > The rather big patch (42,5M) is available here: > http://www.kovesdan.org/patches/iconv_base_integrate.diff > > Any comments, suggestions or bugreports are very welcome. Awesome! Thanks for working on it. Are there any plans to resurrect/finish multibyte collation support GSoC'2008 project: http://wiki.freebsd.org/KonradJankowski/Collation And are you aware of any plans on adding utf8-aware regex? I think NetBSD has already imported one: http://blog.netbsd.org/tnf/entry/efficient_wide_character_regular_expressions Thanks, Gleb. > -- > Gabor Kovesdan > FreeBSD Volunteer > > EMAIL:gabor@FreeBSD.org .:|:.gabor@kovesdan.org > WEB:http://people.FreeBSD.org/~gabor .:|:.http://kovesdan.org > > _______________________________________________ > freebsd-current@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-current > To unsubscribe, send any mail to "freebsd-current-unsubscribe@freebsd.org"