From owner-freebsd-hackers@FreeBSD.ORG Thu Jun 4 12:22:19 2009 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id EB4D11065679 for ; Thu, 4 Jun 2009 12:22:19 +0000 (UTC) (envelope-from jhb@freebsd.org) Received: from cyrus.watson.org (cyrus.watson.org [65.122.17.42]) by mx1.freebsd.org (Postfix) with ESMTP id BE7F78FC18 for ; Thu, 4 Jun 2009 12:22:19 +0000 (UTC) (envelope-from jhb@freebsd.org) Received: from bigwig.baldwin.cx (66.111.2.69.static.nyinternet.net [66.111.2.69]) by cyrus.watson.org (Postfix) with ESMTPSA id 44D2646B23; Thu, 4 Jun 2009 08:22:19 -0400 (EDT) Received: from jhbbsd.hudson-trading.com (unknown [209.249.190.8]) by bigwig.baldwin.cx (Postfix) with ESMTPA id 433E18A02C; Thu, 4 Jun 2009 08:22:18 -0400 (EDT) From: John Baldwin To: freebsd-hackers@freebsd.org Date: Thu, 4 Jun 2009 07:49:16 -0400 User-Agent: KMail/1.9.7 References: <4A2792B7.5010006@peterhost.ru> In-Reply-To: <4A2792B7.5010006@peterhost.ru> MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable Content-Disposition: inline Message-Id: <200906040749.17206.jhb@freebsd.org> X-Greylist: Sender succeeded SMTP AUTH, not delayed by milter-greylist-4.0.1 (bigwig.baldwin.cx); Thu, 04 Jun 2009 08:22:18 -0400 (EDT) X-Virus-Scanned: clamav-milter 0.95 at bigwig.baldwin.cx X-Virus-Status: Clean X-Spam-Status: No, score=-2.5 required=4.2 tests=AWL,BAYES_00,RDNS_NONE autolearn=no version=3.2.5 X-Spam-Checker-Version: SpamAssassin 3.2.5 (2008-06-10) on bigwig.baldwin.cx Cc: Menshikov Konstantin Subject: Re: Inline function (difficult debug) X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 04 Jun 2009 12:22:20 -0000 On Thursday 04 June 2009 5:24:07 am Menshikov Konstantin wrote: > Hi. > My system FreeBSD 7.1 RELEASE periodically freeze. >=20 > I`m compiling kernel with WITNESS and get backtrace. >=20 > #0 doadump () at pcpu.h:195 > #1 0xffffffff801a899c in db_fncall (dummy1=3DVariable "dummy1" is not=20 > available. > ) at /usr/src/sys/ddb/db_command.c:516 > #2 0xffffffff801a8ecf in db_command (last_cmdp=3D0xffffffff80825688,=20 > cmd_table=3D0x0, dopager=3D1) > at /usr/src/sys/ddb/db_command.c:413 > #3 0xffffffff801a90e0 in db_command_loop () at=20 > /usr/src/sys/ddb/db_command.c:466 > #4 0xffffffff801aaa19 in db_trap (type=3DVariable "type" is not available. > ) at /usr/src/sys/ddb/db_main.c:228 > #5 0xffffffff803d5e55 in kdb_trap (type=3D3, code=3D0,=20 > tf=3D0xffffffffabf284c0) at /usr/src/sys/kern/subr_kdb.c:524 > #6 0xffffffff8059a0e5 in trap (frame=3D0xffffffffabf284c0) at=20 > /usr/src/sys/amd64/amd64/trap.c:538 > #7 0xffffffff8057f60e in calltrap () at=20 > /usr/src/sys/amd64/amd64/exception.S:209 > #8 0xffffffff803d602d in kdb_enter_why (why=3D0xffffffff80628137=20 > "witness", msg=3D0xa
) > at cpufunc.h:63 > #9 0xffffffff803e70c3 in witness_checkorder (lock=3DVariable "lock" is no= t=20 > available. > ) at /usr/src/sys/kern/subr_witness.c:1126 > #10 0xffffffff8039e341 in _mtx_lock_spin_flags (m=3D0xffffffff8084fad0,=20 > opts=3D0, file=3Ddwarf2_read_address: Corrupted DWARF expression. > ) at /usr/src/sys/kern/kern_mutex.c:227 > #11 0xffffffff80319838 in sc_puts (scp=3D0xffffffff8084f980,=20 > buf=3D0xffffffffabf286a7 "a@\az\200=D0=AA=D0=AA=D0=AA=D0=AA", len=3D1) > at /usr/src/sys/dev/syscons/syscons.c:2519 > #12 0xffffffff8031b3da in sc_cnputc (cd=3DVariable "cd" is not available. > ) at /usr/src/sys/dev/syscons/syscons.c:1561 > #13 0xffffffff803f9d89 in cnputc (c=3D97) at /usr/src/sys/kern/tty_cons.c= :632 > #14 0xffffffff803d993b in putchar (c=3D97, arg=3DVariable "arg" is not=20 > available. > ) at /usr/src/sys/kern/subr_prf.c:421 > #15 0xffffffff803d7f22 in kvprintf (fmt=3D0xffffffff80628b89 "cquiring=20 > duplicate lock of same type: \"%s\"\n", > func=3D0xffffffff803d98d0 , arg=3D0xffffffffabf28890, radix=3D10= ,=20 > ap=3DVariable "ap" is not available. > ) at /usr/src/sys/kern/subr_prf.c:674 > #16 0xffffffff803d9384 in printf (fmt=3DVariable "fmt" is not available. > ) at /usr/src/sys/kern/subr_prf.c:314 > #17 0xffffffff803e705d in witness_checkorder (lock=3D0xffffffff808668f8,= =20 > flags=3D0, > file=3D0xffffffff80626cf8 "/usr/src/sys/kern/subr_sleepqueue.c", line=3D2= 32)=20 > at /usr/src/sys/kern/subr_witness.c:948 > #18 0xffffffff8039e341 in _mtx_lock_spin_flags (m=3D0xffffffff808668f8,=20 > opts=3D0, file=3Ddwarf2_read_address: Corrupted DWARF expression. > ) at /usr/src/sys/kern/kern_mutex.c:227 > #19 0xffffffff803b2271 in wakeup (ident=3D0xffffffff80850ac0) at=20 > /usr/src/sys/kern/kern_synch.c:341 > #20 0xffffffff803aed95 in tdsignal (p=3D0xffffff00017978f0,=20 > td=3D0xffffff000146a6e0, sig=3D14, ksi=3DVariable "ksi" is not available. > ) > at /usr/src/sys/kern/kern_sig.c:2292 > #21 0xffffffff803ba2de in realitexpire (arg=3DVariable "arg" is not avail= able. > ) at /usr/src/sys/kern/kern_time.c:669 > #22 0xffffffff803bbe1a in softclock (dummy=3DVariable "dummy" is not=20 > available. > ) at /usr/src/sys/kern/kern_timeout.c:274 > #23 0xffffffff8038c120 in ithread_loop (arg=3D0xffffff00010ebc00) at=20 > /usr/src/sys/kern/kern_intr.c:1088 > #24 0xffffffff8038978a in fork_exit (callout=3D0xffffffff8038c040=20 > , arg=3D0xffffff00010ebc00, > frame=3D0xffffffffabf28c80) at /usr/src/sys/kern/kern_fork.c:804 > #25 0xffffffff8057f9de in fork_trampoline () at=20 > /usr/src/sys/amd64/amd64/exception.S:455 >=20 > But file /usr/src/sys/kern/kern_sig.c:2292 > hasn`t run function wake up on string 2292 > I`m think, what compiler use inline function, therefore code and trace=20 > differ. > Tell me please, how compile kernel without any inline function. makeoptions DEBUG=3D"-g -fno-inline" However. I think you already have enough information to debug this. Can yo= u=20 go to frame 17 and do an 'l'? I think the two things you want to print out= =20 are "i", "*lock", "*lock1", and "*lock2". =2D-=20 John Baldwin