From owner-freebsd-current@FreeBSD.ORG Fri Nov 9 20:54:59 2012 Return-Path: Delivered-To: current@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id CB9085E6 for ; Fri, 9 Nov 2012 20:54:59 +0000 (UTC) (envelope-from alexander@leidinger.net) Received: from mail.ebusiness-leidinger.de (mail.ebusiness-leidinger.de [217.11.53.44]) by mx1.freebsd.org (Postfix) with ESMTP id 2CCCC8FC08 for ; Fri, 9 Nov 2012 20:54:58 +0000 (UTC) Received: from outgoing.leidinger.net (p5DD448F9.dip.t-dialin.net [93.212.72.249]) by mail.ebusiness-leidinger.de (Postfix) with ESMTPSA id E09CA844D0E; Fri, 9 Nov 2012 21:54:45 +0100 (CET) Received: from unknown (IO.Leidinger.net [192.168.1.12]) by outgoing.leidinger.net (Postfix) with ESMTPS id EF020203E; Fri, 9 Nov 2012 21:54:42 +0100 (CET) DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=leidinger.net; s=outgoing-alex; t=1352494483; bh=IcIO/Hw8m6PqvzDmOXkFwBNLyaAI2qn6PgFgccw2wNc=; h=Date:From:To:Cc:Subject:In-Reply-To:References; b=FlSitw5gBlFkvBe1rCfkbLFCJoRBZcwwW/ny+1ybReN3r6meIJj7dZ0cL+bTmQCCH ss3BSu4iDaxIQTpIcNyNTqRlloZZBHVkd5S710VTJepF06PwrNHbVRLFg4Nuw2yrn8 qY2VRdBBDoyf4rb+LF9Um7hu4knBqpqiHwkVqPBPMEPmdyGJRIXyr5oUPOWLpBLZXn tgBDqSsW4v8PPkAgRQ+HBEKHRcLkTm8WQEMGPnN93EGqX79wTa3u496lwr0QqHq786 TrrIY8cITi147sUvVgRlArhHqyLURrucfpwCHY5AG/JpH4iJ+9iIp4MIjz4F/Avyi+ stk4H+rHJ4hkQ== Date: Fri, 9 Nov 2012 21:54:48 +0100 From: Alexander Leidinger To: Konstantin Belousov Subject: Re: watchdogd coredump Message-ID: <20121109215448.00002c7c@unknown> In-Reply-To: <20121103220843.GI73505@kib.kiev.ua> References: <20121103225542.00001118@unknown> <20121103220843.GI73505@kib.kiev.ua> X-Mailer: Claws Mail 3.8.0cvs30 (GTK+ 2.24.10; i586-pc-mingw32msvc) Mime-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit X-EBL-MailScanner-Information: Please contact the ISP for more information X-EBL-MailScanner-ID: E09CA844D0E.A3972 X-EBL-MailScanner: Found to be clean X-EBL-MailScanner-SpamCheck: not spam, spamhaus-ZEN, SpamAssassin (not cached, score=-1.677, required 6, autolearn=disabled, ALL_TRUSTED -1.00, AWL -0.78, DKIM_SIGNED 0.10, T_DKIM_INVALID 0.01, T_RP_MATCHES_RCVD -0.01) X-EBL-MailScanner-From: alexander@leidinger.net X-EBL-MailScanner-Watermark: 1353099286.38815@+muIaldF1ufI5UtLO3u4eA X-EBL-Spam-Status: No Cc: current@freebsd.org X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 09 Nov 2012 20:54:59 -0000 On Sun, 4 Nov 2012 00:08:43 +0200 Konstantin Belousov wrote: > On Sat, Nov 03, 2012 at 10:55:42PM +0100, Alexander Leidinger wrote: > > Hi, > > > > I updated from r239708 to r242511 and my watchdogd coredumps (and > > brings down the system... well, the WD works). > > > > Before I have a deeper look (recompiling with debugging and such) at > > this, can someone confirm that with a recent -current and a WD > > configured to call a shell script which does a simple ls > > to /dev/null there is a segfault in watchdogd? > > > > watchdogd_flags="-e /root/bin/wd_check.sh -s 5 -t 60" > > > > ---snip--- > > # cat /root/bin/wd_check.sh > > #!/bin/sh > > > > exec ls / /space/jails >/dev/null 2>&1 > ---snip--- > > > > The not so useful backtrace of the watchdogd core: > > ---snip--- > > #0 0x0000000800609520 in dlopen () from /libexec/ld-elf.so.1 > > #1 0x000000080060309d in .text () from /libexec/ld-elf.so.1 > > #2 0x0000000000000246 in ?? () > > #3 0xfffffe001ee700f8 in ?? () > > #4 0xfffffe001ee700f8 in ?? () > > #5 0xffffffff80647e80 in ?? () > > #6 0x0000000000000001 in ?? () > > #7 0x00007fffffffdb90 in ?? () > > #8 0x0000000000000013 in ?? () > > #9 0x00007fffffffdb80 in ?? () > > #10 0x0000000000000000 in ?? () > > #11 0x0000000000000206 in ?? () > > #12 0x00007fffffffdaf0 in ?? () > > #13 0x000000080061cc00 in ?? () > > #14 0x0000000000000031 in ?? () > > #15 0x0000000800c93dc9 in system () from /lib/libc.so.7 > > #16 0x0000000000401558 in ?? () > > #17 0x0000000000400f7e in ?? () > > #18 0x000000080061c000 in ?? () > > #19 0x0000000000000000 in ?? () > > #20 0x0000000000000007 in ?? () > > #21 0x00007fffffffdef8 in ?? () > > ---snip--- > > Are you sure that your kernel is at r242511 ? > > The issue should have been fixed by r242011. I got some time again to look into this. I recompiled the libs with debugging symbols and installed unstripped versions, but I don't get an useful backtrace: ---snip--- # gdb /usr/sbin/watchdogd /watchdogd.core GNU gdb 6.1.1 [FreeBSD] Copyright 2004 Free Software Foundation, Inc. GDB is free software, covered by the GNU General Public License, and you are welcome to change it and/or distribute copies of it under certain conditions. Type "show copying" to see the conditions. There is absolutely no warranty for GDB. Type "show warranty" for details. This GDB was configured as "amd64-marcel-freebsd"...(no debugging symbols found)... Core was generated by `watchdogd'. Program terminated with signal 11, Segmentation fault. Reading symbols from /lib/libm.so.5...done. Loaded symbols for /lib/libm.so.5 Reading symbols from /lib/libutil.so.9...done. Loaded symbols for /lib/libutil.so.9 Reading symbols from /lib/libc.so.7...done. Loaded symbols for /lib/libc.so.7 Reading symbols from /libexec/ld-elf.so.1...done. Loaded symbols for /libexec/ld-elf.so.1 #0 0x0000000800609520 in dlopen () from /libexec/ld-elf.so.1 (gdb) bt #0 0x0000000800609520 in dlopen () from /libexec/ld-elf.so.1 #1 0x000000080060309d in .text () from /libexec/ld-elf.so.1 #2 0x0000000000000246 in ?? () #3 0xfffffe0179f060f8 in ?? () #4 0xfffffe0179f060f8 in ?? () #5 0xffffffff80647e80 in ?? () #6 0x0000000000000001 in ?? () #7 0x00007fffffffdb90 in ?? () #8 0x0000000000000013 in ?? () #9 0x00007fffffffdb80 in ?? () #10 0x0000000000000000 in ?? () #11 0x0000000000000206 in ?? () #12 0x00007fffffffdaf0 in ?? () #13 0x000000080061cc00 in ?? () #14 0x0000000000000031 in ?? () #15 0x0000000800c93dc9 in __system ( command=0x801406040 "/root/bin/wd_check.sh") at /space/system/usr_src/lib/libc/stdlib/system.c:70 #16 0x0000000000401558 in main () # uname -v FreeBSD 10.0-CURRENT #10 r242511M: Sat Nov 3 17:49:09 CET 2012 ---snip--- How can I debug this further? Bye, Alexander. -- http://www.Leidinger.net Alexander @ Leidinger.net: PGP ID = B0063FE7 http://www.FreeBSD.org netchild @ FreeBSD.org : PGP ID = 72077137