From owner-freebsd-hackers@FreeBSD.ORG Tue May 6 16:41:25 2008 Return-Path: Delivered-To: hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id C9DE01065676 for ; Tue, 6 May 2008 16:41:25 +0000 (UTC) (envelope-from zbeeble@gmail.com) Received: from ti-out-0910.google.com (ti-out-0910.google.com [209.85.142.188]) by mx1.freebsd.org (Postfix) with ESMTP id 4B3AD8FC28 for ; Tue, 6 May 2008 16:41:24 +0000 (UTC) (envelope-from zbeeble@gmail.com) Received: by ti-out-0910.google.com with SMTP id d27so746052tid.3 for ; Tue, 06 May 2008 09:41:23 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:references; bh=SvPXgEhP+ox7gxKsYSiNgcbHgO8t0SeRh4PyWjcdtvU=; b=BOsJZ9Ttgqjo1Relq7hiiM+gAykeE6gNUjb7KChTYgf6+p1jP1Y842mlJbHMS6TBDdxHmGhnRU6D8jwr/EfqdxvqYc+cZvz135F14eX5EUYZFO7scAVGc1ix26HfcXfpuWhE9yaw6k2G1tsxPtOSVgfWpoKEB0DrH53bjMDjhos= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:references; b=LfPHqxbb0gQF9WOQMDqQh0/1K9kCxDI1DOGGQlSnNJBm0o0WrgAHoOP3mCmZetsxFl557OoQ8tMwY2pE6+l8HzPHFjY9HfjV+ePFJ5la60shjhUplob9+u4gaHIvV/jNZQi9n2Wxx9DqlSkYRWW7WPFZXrqYLUyUgkYNEieqz8Y= Received: by 10.150.79.42 with SMTP id c42mr923335ybb.163.1210092082320; Tue, 06 May 2008 09:41:22 -0700 (PDT) Received: by 10.150.53.13 with HTTP; Tue, 6 May 2008 09:41:22 -0700 (PDT) Message-ID: <5f67a8c40805060941n7d2882aayea7d72d0a76cd89d@mail.gmail.com> Date: Tue, 6 May 2008 12:41:22 -0400 From: "Zaphod Beeblebrox" To: "Robert Watson" In-Reply-To: <20080506171525.O52391@fledge.watson.org> MIME-Version: 1.0 References: <481B7ED4.3020208@mschuette.name> <20080506171525.O52391@fledge.watson.org> Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Cc: hackers@freebsd.org, =?ISO-8859-1?Q?Martin_Sch=FCtte?= Subject: Re: Improving Syslog X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 06 May 2008 16:41:25 -0000 On Tue, May 6, 2008 at 12:21 PM, Robert Watson wrote: > > This sounds like an exciting project -- while I recognize the concerns > other have expressed about complexity, I think that complexity can be > managed if done carefully. I'm not sure if you've looked at Apple's > extended syslog, which among other things, includes a binary log file format > making it more mechanically searched and managed, do take a look if you > haven't. ... and I'm not just saying this to be ornery, but what about test log file formats is not mechanically searchable? Note that I'm not playing the XML card here (I'm not an XML fan) but the only real draw of a binary format (to me) is a small amount of innate compression (numbers and dates in binary form) and the ability to have field separators that are not part of the printable character set. UN*X has a strong tradition of text files that work around these two limitations in a variety of ways --- and UN*X tools are built with these assumptions. There's a strong set of reasons to consider retaining text formats and continuing to improve our tools around them. One way to strengthen the syslog format is to have syslog enforce a format _and_ enforce that whatever field separator is chosen cannot be written within a field.