From owner-freebsd-bugs@FreeBSD.ORG Mon Nov 13 09:30:04 2006 Return-Path: X-Original-To: freebsd-bugs@hub.freebsd.org Delivered-To: freebsd-bugs@hub.freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 8DE4D16AEA4 for ; Mon, 13 Nov 2006 09:30:04 +0000 (UTC) (envelope-from gnats@FreeBSD.org) Received: from freefall.freebsd.org (freefall.freebsd.org [216.136.204.21]) by mx1.FreeBSD.org (Postfix) with ESMTP id 53E5143D6A for ; Mon, 13 Nov 2006 09:30:03 +0000 (GMT) (envelope-from gnats@FreeBSD.org) Received: from freefall.freebsd.org (gnats@localhost [127.0.0.1]) by freefall.freebsd.org (8.13.4/8.13.4) with ESMTP id kAD9U3JP081208 for ; Mon, 13 Nov 2006 09:30:03 GMT (envelope-from gnats@freefall.freebsd.org) Received: (from gnats@localhost) by freefall.freebsd.org (8.13.4/8.13.4/Submit) id kAD9U3PI081206; Mon, 13 Nov 2006 09:30:03 GMT (envelope-from gnats) Resent-Date: Mon, 13 Nov 2006 09:30:03 GMT Resent-Message-Id: <200611130930.kAD9U3PI081206@freefall.freebsd.org> Resent-From: FreeBSD-gnats-submit@FreeBSD.org (GNATS Filer) Resent-To: freebsd-bugs@FreeBSD.org Resent-Reply-To: FreeBSD-gnats-submit@FreeBSD.org, Dmitriy Kirhlarov Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 0AD8216AE9E for ; Mon, 13 Nov 2006 09:23:58 +0000 (UTC) (envelope-from dkirhlarov@oilspace.com) Received: from office.oilspace.com (office.oilspace.com [194.129.65.230]) by mx1.FreeBSD.org (Postfix) with ESMTP id 27C4443D6B for ; Mon, 13 Nov 2006 09:23:56 +0000 (GMT) (envelope-from dkirhlarov@oilspace.com) Received: from dkirhlarov.mow.oilspace.com (proxy-mow.oilspace.com [81.222.156.190]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by office.oilspace.com (Postfix) with ESMTP id F32CE17A9F4 for ; Mon, 13 Nov 2006 08:16:10 +0000 (GMT) Received: from dkirhlarov.mow.oilspace.com (localhost [127.0.0.1]) by dkirhlarov.mow.oilspace.com (8.13.8/8.13.8) with ESMTP id kAD8G8WL060214 for ; Mon, 13 Nov 2006 11:16:08 +0300 (MSK) (envelope-from dkirhlarov@dkirhlarov.mow.oilspace.com) Received: (from dkirhlarov@localhost) by dkirhlarov.mow.oilspace.com (8.13.8/8.13.8/Submit) id kAD8G8YD060213; Mon, 13 Nov 2006 11:16:08 +0300 (MSK) (envelope-from dkirhlarov) Message-Id: <200611130816.kAD8G8YD060213@dkirhlarov.mow.oilspace.com> Date: Mon, 13 Nov 2006 11:16:08 +0300 (MSK) From: Dmitriy Kirhlarov To: FreeBSD-gnats-submit@FreeBSD.org X-Send-Pr-Version: 3.113 Cc: Subject: kern/105464: panic under heavy load X-BeenThere: freebsd-bugs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: Dmitriy Kirhlarov List-Id: Bug reports List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 13 Nov 2006 09:30:04 -0000 >Number: 105464 >Category: kern >Synopsis: panic under heavy load >Confidential: no >Severity: critical >Priority: high >Responsible: freebsd-bugs >State: open >Quarter: >Keywords: >Date-Required: >Class: sw-bug >Submitter-Id: current-users >Arrival-Date: Mon Nov 13 09:30:02 GMT 2006 >Closed-Date: >Last-Modified: >Originator: Dmitriy Kirhlarov >Release: FreeBSD 6.2-PRERELEASE i386 >Organization: >Environment: System: FreeBSD lbsd02.lc.oilspace.net 6.2-PRERELEASE FreeBSD 6.2-PRERELEASE #0: Fri Nov 10 11:03:10 UTC 2006 root@jailhost1:/usr/obj/usr/src/sys/OILSPACE1DEB i386 >Description: I have reproduceble panic under heavy load. >How-To-Repeat: >Fix: unknown --- btfull.0 begins here --- GNU gdb 6.1.1 [FreeBSD] Copyright 2004 Free Software Foundation, Inc. GDB is free software, covered by the GNU General Public License, and you are welcome to change it and/or distribute copies of it under certain conditions. Type "show copying" to see the conditions. There is absolutely no warranty for GDB. Type "show warranty" for details. This GDB was configured as "i386-marcel-freebsd". Unread portion of the kernel message buffer: panic: thread 100083(nagios):1 holds process lock but isn't blocked on a lock cpuid = 0 KDB: enter: panic Physical memory: 1015 MB Dumping 125 MB: 110 94 78 62 46 30 14 #0 doadump () at pcpu.h:165 in pcpu.h (kgdb) #0 doadump () at pcpu.h:165 No locals. #1 0xd04897b6 in db_fncall (dummy1=1016, dummy2=0, dummy3=1016, dummy4=0xf66519cc "") at /usr/src/sys/ddb/db_command.c:492 fn_addr = -798992304 args = {0, 0, -797010818, -796751017, 0, -161146472, -800541819, 32, -796674272, 2} nargs = 0 retval = 32 t = 0 #2 0xd0489532 in db_command (last_cmdp=0xd08784a4, cmd_table=0x0, aux_cmd_tablep=0xd08328cc, aux_cmd_tablep_end=0xd08328e8) at /usr/src/sys/ddb/db_command.c:350 cmd = (struct command *) 0xd083b8c0 t = 0 modif = "\000\000\000\000ø\003\000\000è\031eööªwÐø\003\000\000ø\003\000\000\r\000\000\000\024\032eö5­wÐü\031eöø\003\000\000\200%\000\000\f\000\017\003\v\206dÐx\000\000\000 \215\207Ð\000\000\000\000,\032eö\221¼HÐ0Ã\200Ð\020¹HÐ\000\000\000\000\020\000\000\000\000\000\000\000 \215\207Ð\026¯HР\215\207Ðà\204\207Ðx\000\000\000\220\032eö" addr = 1016 count = 1016 have_addr = 0 result = 0 #3 0xd0489645 in db_command_loop () at /usr/src/sys/ddb/db_command.c:458 No locals. #4 0xd048b845 in db_trap (type=3, code=0) at /usr/src/sys/ddb/db_main.c:222 jb = {{_jb = {-161146224, -161146252, -161146172, 1, 0, -800540698, 0, 0, 0, 0, -161146172, -798862896}}} prev_jb = (void *) 0x0 bkpt = 0 #5 0xd062527e in kdb_trap (type=0, code=0, tf=0xf6651b2c) at /usr/src/sys/kern/subr_kdb.c:473 did_stop_cpus = 1 handled = -161146068 #6 0xd07ac1a8 in trap (frame= {tf_fs = 8, tf_es = 40, tf_ds = -161152984, tf_edi = 256, tf_esi = 1, tf_ebp = -161145996, tf_isp = -161146024, tf_ebx = -161145936, tf_edx = 0, tf_ecx = -788320256, tf_eax = 18, tf_trapno = 3, tf_err = 0, tf_eip = -798863536, tf_cs = 32, tf_eflags = 150, tf_esp = -796858807, tf_ss = -796868175}) at /usr/src/sys/i386/i386/trap.c:594 td = (struct thread *) 0xd5be5d80 p = (struct proc *) 0xd5039430 sticks = 3496067121 i = 0 ucode = 0 type = 3 code = 0 eva = 0 #7 0xd07951ba in calltrap () at /usr/src/sys/i386/i386/exception.s:139 No locals. #8 0xd0624f50 in kdb_enter (msg=0x12
) at cpufunc.h:60 No locals. #9 0xd060625e in panic (fmt=0xd080f86c "thread %d(%s):%d holds %s but isn't blocked on a lock\n") at /usr/src/sys/kern/kern_shutdown.c:549 td = (struct thread *) 0xd5be5d80 bootopt = 256 newpanic = 1 ap = 0xf6651bb0 "ó\206\001" buf = "thread 100083(nagios):1 holds process lock but isn't blocked on a lock\n", '\0' #10 0xd062f0f8 in propagate_priority (td=0xd5c73900) at /usr/src/sys/kern/subr_turnstile.c:239 tc = (struct turnstile_chain *) 0xd5c73900 ts = (struct turnstile *) 0xd51b71c0 pri = 197 #11 0xd062fe02 in turnstile_wait (lock=0xd5039498, owner=0xd5c73900) at /usr/src/sys/kern/subr_turnstile.c:643 tc = (struct turnstile_chain *) 0xd0885dc0 ts = (struct turnstile *) 0xd51b71c0 td = (struct thread *) 0xd5be5d80 td1 = (struct thread *) 0xd5c73900 #12 0xd05fae91 in _mtx_lock_sleep (m=0xd5039498, tid=3586022784, opts=0, file=0x12
, line=18) at /usr/src/sys/kern/kern_mutex.c:579 owner = (volatile struct thread *) 0xd5c73900 v = 0 #13 0xd05fa862 in _mtx_lock_flags (m=0xd5039498, opts=0, file=0xd080cfd0 "/usr/src/sys/kern/kern_thread.c", line=824) at /usr/src/sys/kern/kern_mutex.c:288 No locals. #14 0xd0613210 in thread_single (mode=0) at /usr/src/sys/kern/kern_thread.c:824 td = (struct thread *) 0xd5be5d80 td2 = (struct thread *) 0x0 p = (struct proc *) 0xd5039430 remaining = 18 #15 0xd05e9789 in fork1 (td=0xd5be5d80, flags=20, pages=0, procp=0xf6651ccc) at /usr/src/sys/kern/kern_fork.c:274 p1 = (struct proc *) 0xd5039430 p2 = (struct proc *) 0xd5be5d80 pptr = (struct proc *) 0xd1033000 newproc = (struct proc *) 0xd5039430 ok = -708944512 trypid = -721185640 curfail = 0 pidchecked = 85274 lastfail = {tv_sec = 0, tv_usec = 0} fd = (struct filedesc *) 0xd5039430 fdtol = (struct filedesc_to_leader *) 0x2de7afe9 td2 = (struct thread *) 0x45563fe4 kg2 = (struct ksegrp *) 0xd5039498 newsigacts = (struct sigacts *) 0xd50d1000 error = -726800032 #16 0xd05e93d9 in fork (td=0xd5be5d80, uap=0xf6651d04) at /usr/src/sys/kern/kern_fork.c:98 error = 0 p2 = (struct proc *) 0xd5be5d80 #17 0xd07acb90 in syscall (frame= {tf_fs = 59, tf_es = 59, tf_ds = -809566149, tf_edi = 137529352, tf_esi = 674594660, tf_ebp = -809526344, tf_isp = -161145500, tf_ebx = 673543348, tf_edx = 0, tf_ecx = 134975744, tf_eax = 2, tf_trapno = 12, tf_err = 2, tf_eip = 673966451, tf_cs = 51, tf_eflags = 646, tf_esp = -809526436, tf_ss = 59}) at /usr/src/sys/i386/i386/trap.c:983 params = 0xcfbf9b60
callp = (struct sysent *) 0xd084fef8 td = (struct thread *) 0xd5be5d80 p = (struct proc *) 0xd5039430 orig_tf_eflags = 646 sticks = 0 error = 0 narg = 0 args = {9, 135135232, 4096, 0, -721185744, 2, -708944512, 134962040} code = 2 #18 0xd079520f in Xint0x80_syscall () at /usr/src/sys/i386/i386/exception.s:200 No locals. #19 0x00000033 in ?? () No symbol table info available. (kgdb) --- btfull.0 ends here --- >Release-Note: >Audit-Trail: >Unformatted: