From owner-freebsd-bugs@FreeBSD.ORG Sun Sep 19 17:20:02 2010 Return-Path: Delivered-To: freebsd-bugs@hub.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 4A7BD1065673 for ; Sun, 19 Sep 2010 17:20:02 +0000 (UTC) (envelope-from gnats@FreeBSD.org) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2001:4f8:fff6::28]) by mx1.freebsd.org (Postfix) with ESMTP id 2315D8FC15 for ; Sun, 19 Sep 2010 17:20:02 +0000 (UTC) Received: from freefall.freebsd.org (localhost [127.0.0.1]) by freefall.freebsd.org (8.14.4/8.14.4) with ESMTP id o8JHK1h5075370 for ; Sun, 19 Sep 2010 17:20:01 GMT (envelope-from gnats@freefall.freebsd.org) Received: (from gnats@localhost) by freefall.freebsd.org (8.14.4/8.14.4/Submit) id o8JHK11H075369; Sun, 19 Sep 2010 17:20:01 GMT (envelope-from gnats) Resent-Date: Sun, 19 Sep 2010 17:20:01 GMT Resent-Message-Id: <201009191720.o8JHK11H075369@freefall.freebsd.org> Resent-From: FreeBSD-gnats-submit@FreeBSD.org (GNATS Filer) Resent-To: freebsd-bugs@FreeBSD.org Resent-Reply-To: FreeBSD-gnats-submit@FreeBSD.org, Pete French Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id EE336106564A for ; Sun, 19 Sep 2010 17:12:55 +0000 (UTC) (envelope-from pete@twisted.org.uk) Received: from smtp-out3.blueyonder.co.uk (smtp-out3.blueyonder.co.uk [195.188.213.6]) by mx1.freebsd.org (Postfix) with ESMTP id B23678FC0A for ; Sun, 19 Sep 2010 17:12:55 +0000 (UTC) Received: from [172.23.170.142] (helo=anti-virus02-09) by smtp-out3.blueyonder.co.uk with smtp (Exim 4.52) id 1OxJV6-00055S-Ex for FreeBSD-gnats-submit@freebsd.org; Sun, 19 Sep 2010 14:00:12 +0100 Received: from [94.170.122.25] (helo=skerry.twisted.org.uk) by asmtp-out1.blueyonder.co.uk with esmtp (Exim 4.52) id 1OxJV2-00052e-Jg for FreeBSD-gnats-submit@freebsd.org; Sun, 19 Sep 2010 14:00:08 +0100 Received: from pete by skerry.twisted.org.uk with local (Exim 4.72 (FreeBSD)) (envelope-from ) id 1OxJV2-0007vM-4I for FreeBSD-gnats-submit@freebsd.org; Sun, 19 Sep 2010 14:00:08 +0100 Message-Id: Date: Sun, 19 Sep 2010 14:00:08 +0100 From: Pete French To: FreeBSD-gnats-submit@FreeBSD.org X-Send-Pr-Version: 3.113 Cc: Subject: bin/150727: diff on UTF-8 text files thinks they are binary - regression from 7.X X-BeenThere: freebsd-bugs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: Pete French List-Id: Bug reports List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 19 Sep 2010 17:20:02 -0000 >Number: 150727 >Category: bin >Synopsis: diff on UTF-8 text files thinks they are binary - regression from 7.X >Confidential: no >Severity: non-critical >Priority: low >Responsible: freebsd-bugs >State: open >Quarter: >Keywords: >Date-Required: >Class: sw-bug >Submitter-Id: current-users >Arrival-Date: Sun Sep 19 17:20:01 UTC 2010 >Closed-Date: >Last-Modified: >Originator: Pete French >Release: FreeBSD 8.1-STABLE amd64 >Organization: >Environment: System: FreeBSD skerry.drayhouse 8.1-STABLE FreeBSD 8.1-STABLE #0: Sat Sep 18 14:03:44 BST 2010 pete@skerry.drayhouse:/usr/obj/usr/src/sys/GENERIC amd64 >Description: When give two files containing valid UTF-8 text characters, diff simply reports "Files x and y differ". Note that this happens even if your locale is correctly set as UTF-8. Diff from 7.X does not do this. This breaks scripts which are relying on diff to produce the differences in the text files. In the test I tried the actualldiffering lines were plain ASCII - the UTF-8 characters were elsewhere in the file. >How-To-Repeat: Create two UTF-8 files, change one, diff the pair and observe that diff does produce the differences. >Fix: 'diff -a' provides a workaround >Release-Note: >Audit-Trail: >Unformatted: