From owner-freebsd-standards@FreeBSD.ORG Sat Jul 7 15:00:24 2012 Return-Path: Delivered-To: freebsd-standards@hub.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 030C21065672 for ; Sat, 7 Jul 2012 15:00:23 +0000 (UTC) (envelope-from gnats@FreeBSD.org) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2001:4f8:fff6::28]) by mx1.freebsd.org (Postfix) with ESMTP id AB9618FC0C for ; Sat, 7 Jul 2012 15:00:23 +0000 (UTC) Received: from freefall.freebsd.org (localhost [127.0.0.1]) by freefall.freebsd.org (8.14.5/8.14.5) with ESMTP id q67F0Nj8004776 for ; Sat, 7 Jul 2012 15:00:23 GMT (envelope-from gnats@freefall.freebsd.org) Received: (from gnats@localhost) by freefall.freebsd.org (8.14.5/8.14.5/Submit) id q67F0Nnh004775; Sat, 7 Jul 2012 15:00:23 GMT (envelope-from gnats) Resent-Date: Sat, 7 Jul 2012 15:00:23 GMT Resent-Message-Id: <201207071500.q67F0Nnh004775@freefall.freebsd.org> Resent-From: FreeBSD-gnats-submit@FreeBSD.org (GNATS Filer) Resent-To: freebsd-standards@FreeBSD.org Resent-Reply-To: FreeBSD-gnats-submit@FreeBSD.org, Volodymyr Kostyrko Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 42C271065672 for ; Sat, 7 Jul 2012 14:50:34 +0000 (UTC) (envelope-from nobody@FreeBSD.org) Received: from red.freebsd.org (red.freebsd.org [IPv6:2001:4f8:fff6::22]) by mx1.freebsd.org (Postfix) with ESMTP id 2E35D8FC16 for ; Sat, 7 Jul 2012 14:50:34 +0000 (UTC) Received: from red.freebsd.org (localhost [127.0.0.1]) by red.freebsd.org (8.14.4/8.14.4) with ESMTP id q67EoXYW038200 for ; Sat, 7 Jul 2012 14:50:33 GMT (envelope-from nobody@red.freebsd.org) Received: (from nobody@localhost) by red.freebsd.org (8.14.4/8.14.4/Submit) id q67EoX2H038199; Sat, 7 Jul 2012 14:50:33 GMT (envelope-from nobody) Message-Id: <201207071450.q67EoX2H038199@red.freebsd.org> Date: Sat, 7 Jul 2012 14:50:33 GMT From: Volodymyr Kostyrko To: freebsd-gnats-submit@FreeBSD.org X-Send-Pr-Version: www-3.1 Cc: Subject: standards/169697: syslogd(8) is not BOM aware X-BeenThere: freebsd-standards@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Standards compliance List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 07 Jul 2012 15:00:24 -0000 >Number: 169697 >Category: standards >Synopsis: syslogd(8) is not BOM aware >Confidential: no >Severity: non-critical >Priority: low >Responsible: freebsd-standards >State: open >Quarter: >Keywords: >Date-Required: >Class: sw-bug >Submitter-Id: current-users >Arrival-Date: Sat Jul 07 15:00:23 UTC 2012 >Closed-Date: >Last-Modified: >Originator: Volodymyr Kostyrko >Release: RELENG_9 >Organization: None >Environment: # uname -a FreeBSD limbo.xim.bz 9.0-STABLE FreeBSD 9.0-STABLE #2 r238059M: Tue Jul 3 15:27:12 EEST 2012 arcade@limbo.xim.bz:/usr/obj/usr/src/sys/MINIMALx32 i386 >Description: Sending a UTF-8 formatted string starting with BOM to syslogd via /dev/log almost works: #!/usr/bin/evn python from __future__ import unicode_literals import logging, logging.handlers logger = logging.getLogger('test') handler = logging.handlers.SysLogHandler('/dev/log') handler.setFormatter(logging.Formatter('%(name)s[%(process)s]: %(message)s')) logger.addHandler(handler) logger.critical('test') This results in following line in log: Jul 7 17:31:19 limbo test[9154]: test But hexdump of it shows: 00000000 4a 75 6c 20 20 37 20 31 37 3a 32 37 3a 32 37 20 |Jul 7 17:27:27 | 00000010 6c 69 6d 62 6f 20 ef bb bf 74 65 73 74 5b 35 36 |limbo ...test[56| 00000020 37 33 5d 3a 20 74 65 73 74 0a |73]: test.| 0000002a Note the BOM before logger name. It account as part of name, and such messages can't be rerouted via /etc/syslogd.conf as they just doesn't match. Including BOM field into the logs is also not a good thing. >How-To-Repeat: >Fix: I think BOM can be safely dropped if: - line starts with BOM; - '-8' switch is given. >Release-Note: >Audit-Trail: >Unformatted: