From owner-freebsd-python@FreeBSD.ORG Thu Jan 29 06:38:22 2015 Return-Path: Delivered-To: freebsd-python@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 106D682F for ; Thu, 29 Jan 2015 06:38:22 +0000 (UTC) Received: from mail-ie0-x231.google.com (mail-ie0-x231.google.com [IPv6:2607:f8b0:4001:c03::231]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id D90B86BB for ; Thu, 29 Jan 2015 06:38:21 +0000 (UTC) Received: by mail-ie0-f177.google.com with SMTP id vy18so29871675iec.8 for ; Wed, 28 Jan 2015 22:38:21 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:date:message-id:subject:from:to:content-type :content-transfer-encoding; bh=iTEg1tI7AudD7e/D1A1yKht1Uriu9dwLj+Vzj7Rtly8=; b=ffIT3XtZGV8kxZyar8xF/iC6MwbBWZgTI5hMIiDnxh6v/9uF01lyfWCWMfTgp2gZDt vWeH/V6AFOv92dZhY6vcNrFidt6q/rJFOKI7RIF/PvLjlWKAjZiKVe+VsILE9+YwV2DT SKSB7c1Den4YVrEU2jQPxGpwFKionyWLWS9ddnGqZzhKem0NY9VVYexVQm6l83rqRRN0 fJdxYKmBJJpVDHwWksOU/sva6GMdwXs9xpWEjnljtaIz2MaI/gDwln0iooO2ObJQbpXS k6scaSt/cPeQy8xOYbTuUe0JfNImrWn0Nmq1cHe9ZyucX8tiZvu8drc8YpyXcFg3fnGc aGbg== MIME-Version: 1.0 X-Received: by 10.50.79.228 with SMTP id m4mr572853igx.43.1422513501125; Wed, 28 Jan 2015 22:38:21 -0800 (PST) Received: by 10.36.8.215 with HTTP; Wed, 28 Jan 2015 22:38:21 -0800 (PST) Date: Thu, 29 Jan 2015 01:38:21 -0500 Message-ID: Subject: Unicode Problem From: Robert Simmons To: freebsd-python@freebsd.org Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable X-BeenThere: freebsd-python@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: FreeBSD-specific Python issues List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 29 Jan 2015 06:38:22 -0000 I'm having a unicode problem on FreeBSD lang/python34 that does not appear on MacOS X. I've condensed the problem to one single line to enter in the interpreter: FreeBSD: Python 3.4.2 (default, Jan 28 2015, 22:23:57) [GCC 4.2.1 Compatible FreeBSD Clang 3.4.1 (tags/RELEASE_34/dot1-final 208032)] on freebsd10 Type "help", "copyright", "credits" or "license" for more information. >>> b'\xc3\xa2'.decode('utf-8') '\xe2' MacOS X: Python 3.4.2 (default, Oct 19 2014, 17:55:38) [GCC 4.2.1 Compatible Apple LLVM 6.0 (clang-600.0.54)] on darwin Type "help", "copyright", "credits" or "license" for more information. >>> b'\xc3\xa2'.decode('utf-8') '=C3=A2' Why is Python on FreeBSD incorrectly decoding this?