From owner-freebsd-current@FreeBSD.ORG  Sun Jun 22 12:58:21 2008
Return-Path: <owner-freebsd-current@FreeBSD.ORG>
Delivered-To: current@FreeBSD.org
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34])
	by hub.freebsd.org (Postfix) with ESMTP id 253D51065675;
	Sun, 22 Jun 2008 12:58:21 +0000 (UTC)
	(envelope-from gabor@FreeBSD.org)
Received: from viefep31-int.chello.at (viefep31-int.chello.at [62.179.121.49])
	by mx1.freebsd.org (Postfix) with ESMTP id D1E048FC1A;
	Sun, 22 Jun 2008 12:58:19 +0000 (UTC)
	(envelope-from gabor@FreeBSD.org)
Received: from [89.134.207.231] by viefep31-int.chello.at
	(InterMail vM.7.08.02.02 201-2186-121-104-20070414) with ESMTP
	id <20080622125818.NXLM25153.viefep31-int.chello.at@[89.134.207.231]>; 
	Sun, 22 Jun 2008 14:58:18 +0200
Message-ID: <485E4C69.1080805@FreeBSD.org>
Date: Sun, 22 Jun 2008 14:58:17 +0200
From: Gabor Kovesdan <gabor@FreeBSD.org>
User-Agent: Thunderbird 2.0.0.14 (Windows/20080421)
MIME-Version: 1.0
To: Andrey Chernov <ache@nagual.pp.ru>
References: <48577510.4020007@aueb.gr> <48577BD2.4070205@bluemedia.pl>
	<20080617102900.GA46479@nagual.pp.ru>
	<485798C4.2050605@FreeBSD.org>
	<20080618055851.GA85018@nagual.pp.ru> <86zlpjduew.fsf@ds4.des.no>
	<20080618083739.GA87100@nagual.pp.ru>
	<867icndqv5.fsf@ds4.des.no> <4858DBF6.5070001@bluemedia.pl>
	<86skvbc9gn.fsf@ds4.des.no> <20080618114917.GB89383@nagual.pp.ru>
In-Reply-To: <20080618114917.GB89383@nagual.pp.ru>
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 8bit
Cc: Doug Barton <dougb@FreeBSD.org>, current@FreeBSD.org,
	Konrad Jankowski <konrad.jankowski@bluemedia.pl>,
	Diomidis Spinellis <dds@aueb.gr>, hackers@FreeBSD.org,
	Dag-Erling Sm??rgrav <des@des.no>, "Sean C. Farley" <scf@FreeBSD.org>,
	Max Khon <fjoe@samodelkin.net>
Subject: Re: CFT: BSD-licensed grep [Fwd: cvs commit:	ports/textproc/bsdgrep
 Makefile distinfo]
X-BeenThere: freebsd-current@freebsd.org
X-Mailman-Version: 2.1.5
Precedence: list
List-Id: Discussions about the use of FreeBSD-current
	<freebsd-current.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-current>, 
	<mailto:freebsd-current-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-current>
List-Post: <mailto:freebsd-current@freebsd.org>
List-Help: <mailto:freebsd-current-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-current>,
	<mailto:freebsd-current-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Sun, 22 Jun 2008 12:58:21 -0000

Andrey Chernov escribió:
> On Wed, Jun 18, 2008 at 12:40:24PM +0200, Dag-Erling Sm??rgrav wrote:
>   
>> For grep, I believe it should simply be a matter of calling setlocale(),
>> using wide strings, and using a multibyte regex engine (for appropriate
>> values of "simply").
>>     
>
> See my prev reply telling more details. Using wide strings is not so easy, 
> f.e. all ctype BSD grep now uses should be converted to wctype, input 
> conversion added, etc.
>   
I've started to work on doing this big change, the first step:
http://kovesdan.org/patches/grep-i18n.diff

It doesn't work though, each file is recognized as binary with this 
change. Do you have any idea, why this happens? What am I doing wrong?

Regards,
Gabor