From owner-freebsd-hackers@FreeBSD.ORG Tue Aug 29 20:08:07 2006 Return-Path: X-Original-To: hackers@freebsd.org Delivered-To: freebsd-hackers@FreeBSD.ORG Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 9DBD416A4DD for ; Tue, 29 Aug 2006 20:08:07 +0000 (UTC) (envelope-from alive@dienub.org) Received: from pfepb.post.tele.dk (pfepb.post.tele.dk [195.41.46.236]) by mx1.FreeBSD.org (Postfix) with ESMTP id 6E17543D5C for ; Tue, 29 Aug 2006 20:08:05 +0000 (GMT) (envelope-from alive@dienub.org) Received: from m00h.dienub.org (dienub.org [83.88.67.155]) by pfepb.post.tele.dk (Postfix) with ESMTP id 3F3EBA5007B for ; Tue, 29 Aug 2006 22:08:02 +0200 (CEST) Received: from [192.168.0.2] (unknown [192.168.0.2]) by m00h.dienub.org (Postfix) with ESMTP id C47091CC0B for ; Tue, 29 Aug 2006 22:08:03 +0200 (CEST) Message-ID: <44F49EA2.2060703@dienub.org> Date: Tue, 29 Aug 2006 22:08:02 +0200 From: "Daniel A." User-Agent: Thunderbird 1.5.0.5 (Windows/20060719) MIME-Version: 1.0 References: <44EDC84C.6010505@dienub.org> In-Reply-To: <44EDC84C.6010505@dienub.org> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: hackers@freebsd.org Subject: Re: doadump at pcpu.h:165 X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 29 Aug 2006 20:08:07 -0000 Daniel A. wrote: > Hi guys, > My server crashes very often and it's very random. So not long ago, I > was suggested that I read the FreeBSD Handbook pages about kernel > debugging, and here is the result: > root@m00h DIENUB $ kgdb kernel.debug /var/crash/vmcore.3 > [GDB will not be able to debug user-mode threads: > /usr/lib/libthread_db.so: Undefined symbol "ps_pglobal_lookup"] > GNU gdb 6.1.1 [FreeBSD] > Copyright 2004 Free Software Foundation, Inc. > GDB is free software, covered by the GNU General Public License, and you > are > welcome to change it and/or distribute copies of it under certain > conditions. > Type "show copying" to see the conditions. > There is absolutely no warranty for GDB. Type "show warranty" for details. > This GDB was configured as "i386-marcel-freebsd". > > Unread portion of the kernel message buffer: > > > Fatal trap 28: machine check trap while in kernel mode > instruction pointer = 0x20:0xc06830b0 > stack pointer = 0x28:0xd446ea7c > frame pointer = 0x28:0xd446ea8c > code segment = base 0x0, limit 0xfffff, type 0x1b > = DPL 0, pres 1, def32 1, gran 1 > processor eflags = interrupt enabled, resume, IOPL = 0 > current process = 14 (swi1: net) > trap number = 28 > panic: machine check trap > Uptime: 1d4h24m37s > Dumping 511 MB (2 chunks) > chunk 0: 1MB (160 pages) ... ok > chunk 1: 511MB (130800 pages) 495 479 463 447 431 415 399 383 367 351 > 335 319 303 287 271 255 239 223 207 191 175 159 143 127 111 95 79 63 47 > 31 15 > > #0 doadump () at pcpu.h:165 > 165 __asm __volatile("movl %%fs:0,%0" : "=r" (td)); > (kgdb) q > > > As far as I understand, the issue is CPU-related, but that doesn't make > sense, as my network interface cards are constantly giving me watchdog > timeouts. > > root@m00h include $ uname -a > FreeBSD m00h.dienub.org 6.1-RELEASE FreeBSD 6.1-RELEASE #0: Mon May 29 > 20:40:41 CEST 2006 root@m00h.dienub.org:/usr/obj/usr/src/sys/DIENUB > i386 > > Thanks for any help. Also, please CC any replies to me. > _______________________________________________ > freebsd-hackers@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-hackers > To unsubscribe, send any mail to "freebsd-hackers-unsubscribe@freebsd.org" root@m00h DIENUB $ kgdb kernel.debug /var/crash/vmcore.5 [GDB will not be able to debug user-mode threads: /usr/lib/libthread_db.so: Undefined symbol "ps_pglobal_lookup"] GNU gdb 6.1.1 [FreeBSD] Copyright 2004 Free Software Foundation, Inc. GDB is free software, covered by the GNU General Public License, and you are welcome to change it and/or distribute copies of it under certain conditions. Type "show copying" to see the conditions. There is absolutely no warranty for GDB. Type "show warranty" for details. This GDB was configured as "i386-marcel-freebsd". Unread portion of the kernel message buffer: panic: softdep_setup_inomapdep: found inode Uptime: 3h37m58s Dumping 511 MB (2 chunks) chunk 0: 1MB (160 pages) ... ok chunk 1: 511MB (130800 pages) 495 479 463 447 431 415 399 383 367 351 335 319 303 287 271 255 239 223 207 191 175 159 143 127 111 95 79 63 47 31 15 #0 doadump () at pcpu.h:165 165 __asm __volatile("movl %%fs:0,%0" : "=r" (td)); (kgdb) bt #0 doadump () at pcpu.h:165 #1 0xc064dda5 in boot (howto=260) at /usr/src/sys/kern/kern_shutdown.c:402 #2 0xc064e03c in panic (fmt=0xc08b7de8 "softdep_setup_inomapdep: found inode") at /usr/src/sys/kern/kern_shutdown.c:558 #3 0xc079639b in softdep_setup_inomapdep (bp=0xcd81bb60, ip=0x0, newinum=3639) at /usr/src/sys/ufs/ffs/ffs_softdep.c:1519 #4 0xc0788cea in ffs_nodealloccg (ip=0xc3b36a50, cg=0, ipref=3639, mode=33152) at /usr/src/sys/ufs/ffs/ffs_alloc.c:1762 #5 0xc0787458 in ffs_hashalloc (ip=0xc3b36a50, cg=0, pref=105, size=33152, allocator=0xc0788658 ) at /usr/src/sys/ufs/ffs/ffs_alloc.c:1248 #6 0xc0786b82 in ffs_valloc (pvp=0xc3ad9440, mode=33152, cred=0xc3afbc80, vpp=0xd896d8d4) at /usr/src/sys/ufs/ffs/ffs_alloc.c:932 #7 0xc07ae73f in ufs_makeinode (mode=33152, dvp=0xc3ad9440, vpp=0xd896dbe0, cnp=0xd896dbf4) at /usr/src/sys/ufs/ufs/ufs_vnops.c:2181 #8 0xc07ab89d in ufs_create (ap=0x0) at /usr/src/sys/ufs/ufs/ufs_vnops.c:171 #9 0xc0851f18 in VOP_CREATE_APV (vop=0x0, a=0xd896da64) at vnode_if.c:204 #10 0xc06b0364 in vn_open_cred (ndp=0xd896dbcc, flagp=0xd896dccc, cmode=384, cred=0xc3afbc80, fdidx=5) at vnode_if.h:111 #11 0xc06b01a2 in vn_open (ndp=0x0, flagp=0xd896dccc, cmode=384, fdidx=5) at /usr/src/sys/kern/vfs_vnops.c:91 #12 0xc06a8be6 in kern_open (td=0xc38b4c00, path=0x0, pathseg=UIO_USERSPACE, flags=2562, mode=439) at /usr/src/sys/kern/vfs_syscalls.c:1002 ---Type to continue, or q to quit--- #13 0xc06a8afa in open (td=0xc38b4c00, uap=0xd896dd04) at /usr/src/sys/kern/vfs_syscalls.c:968 #14 0xc084176b in syscall (frame= {tf_fs = 59, tf_es = 59, tf_ds = 59, tf_edi = 439, tf_esi = 134615073, tf_ebp = -1077941720, tf_isp = -661201564, tf_ebx = 4, tf_edx = -1, tf_ecx = 672523528, tf_eax = 5, tf_trapno = 12, tf_err = 2, tf_eip = 672414443, tf_cs = 51, tf_eflags = 514, tf_esp = -1077941764, tf_ss = 59}) at /usr/src/sys/i386/i386/trap.c:981 #15 0xc0830ccf in Xint0x80_syscall () at /usr/src/sys/i386/i386/exception.s:200 #16 0x00000033 in ?? () Previous frame inner to this frame (corrupt stack?) (kgdb)