From owner-freebsd-questions@FreeBSD.ORG Mon Nov 5 19:05:25 2012 Return-Path: Delivered-To: freebsd-questions@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 091BE8BF for ; Mon, 5 Nov 2012 19:05:25 +0000 (UTC) (envelope-from grarpamp@gmail.com) Received: from mail-oa0-f54.google.com (mail-oa0-f54.google.com [209.85.219.54]) by mx1.freebsd.org (Postfix) with ESMTP id BD0A38FC0A for ; Mon, 5 Nov 2012 19:05:24 +0000 (UTC) Received: by mail-oa0-f54.google.com with SMTP id n9so7692143oag.13 for ; Mon, 05 Nov 2012 11:05:17 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=NXTn3Uz3Um0WTZB8j3Tticba4QwF42m8453IfscdSGk=; b=xHEExexW/p0QCcf9Q2dWEx9Y5erf2Yx72sDFFe7ZK/fZSa2re2QDiZSCuAZ/rTdatA m+NiCjLD8NiLxM8zJIIj78ufSZZ+hFBdlGF8xiv/RWOHk93lPmHx7DPHU2b+fg74d5Jj mO61sjVs8oQN74SavfsszONrufeji6tSZB1ei+uBaX4PbCM9VINI4EmvTkNNFxDguVz9 cGaScwfkt3mhrIMesjzv0hnUbCJtcHFazuum6mHViPUwaFt/B0Rr4tGWCvL54Gc9VTQf O6KQbYPi7i3jvql+OR0HdCOVDZRgiyY68ARbImpd96QUvNuBv/j2BXMgglzL4UvEE8OM izWw== MIME-Version: 1.0 Received: by 10.60.19.168 with SMTP id g8mr8436805oee.101.1352142317815; Mon, 05 Nov 2012 11:05:17 -0800 (PST) Received: by 10.76.68.39 with HTTP; Mon, 5 Nov 2012 11:05:17 -0800 (PST) In-Reply-To: <20121105022745.adc3e4c2.freebsd@edvax.de> References: <20121105022745.adc3e4c2.freebsd@edvax.de> Date: Mon, 5 Nov 2012 14:05:17 -0500 Message-ID: Subject: Re: Character set conversion, locales, UTF-8, etc From: grarpamp To: freebsd-questions@freebsd.org Content-Type: text/plain; charset=UTF-8 X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 05 Nov 2012 19:05:25 -0000 >> As an aside, why does FreeBSD seem to default to the above locale >> instead of say, en_US.UTF-8 ? > > FreeBSD's file system does not default to any locale, as far as I > know. The system is "agnostic" to what the characters in the file > name mean or what symbol they should represent. Sure the fs is just binary, then viewed and written through the mask of the selected langauge layer I think. I think in my case some data was said to be in a particular encoding when in fact it may have been in another, and then pushed down to disk by the app through that wrong mask. > There isn't much you can do on file system level except renaming > the files: write a program that reads the file names according > to the preferred interpretation and write new names for them, I'll read more on language to see if I can reverse that and recover them or just replace with X's. I was looking mostly for a tool that would show me what a filename or data looks like in hex, octal, and different selected encodings. Doing it by hand is slow. I'll check ports again.