From owner-freebsd-hackers@FreeBSD.ORG Fri Dec 2 10:00:19 2005 Return-Path: X-Original-To: hackers@freebsd.org Delivered-To: freebsd-hackers@FreeBSD.ORG Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id D4BF616A41F; Fri, 2 Dec 2005 10:00:19 +0000 (GMT) (envelope-from yuri@irfu.se) Received: from colibri.its.uu.se (colibri.its.UU.SE [130.238.4.154]) by mx1.FreeBSD.org (Postfix) with ESMTP id E8BB043D66; Fri, 2 Dec 2005 10:00:15 +0000 (GMT) (envelope-from yuri@irfu.se) Received: by colibri.its.uu.se (Postfix, from userid 211) id C0C48D6D0; Fri, 2 Dec 2005 11:00:14 +0100 (NFT) Received: from colibri.its.uu.se(127.0.0.1) by colibri.its.uu.se via virus-scan id s14350; Fri, 2 Dec 05 11:00:07 +0100 Received: from hq.irfu.se (hq.irfu.se [130.238.30.10]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by colibri.its.uu.se (Postfix) with ESMTP id BC831D6D0; Fri, 2 Dec 2005 11:00:06 +0100 (NFT) Received: from ice.irfu.se (ice.irfu.se [130.238.30.157]) (authenticated bits=0) by hq.irfu.se (8.13.4/8.13.4) with ESMTP id jB2A03tt033705 (version=TLSv1/SSLv3 cipher=RC4-MD5 bits=128 verify=NO); Fri, 2 Dec 2005 11:00:04 +0100 (CET) (envelope-from yuri@irfu.se) From: Yuri Khotyaintsev Organization: Swedish Institute of Space Physics To: freebsd-stable@freebsd.org Date: Fri, 2 Dec 2005 11:00:02 +0100 User-Agent: KMail/1.8.3 MIME-Version: 1.0 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable Content-Disposition: inline Message-Id: <200512021100.03167.yuri@irfu.se> X-Spam-Status: No, score=-1.4 required=7.0 tests=ALL_TRUSTED autolearn=failed version=3.1.0 X-Spam-Checker-Version: SpamAssassin 3.1.0 (2005-09-13) on hq.irfu.se X-Mailman-Approved-At: Fri, 02 Dec 2005 13:01:30 +0000 Cc: hackers@freebsd.org Subject: Fatal trap 12: page fault while in kernel mode X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 02 Dec 2005 10:00:20 -0000 I have the following panic occurring several times a week. The machine is a= n=20 NFS server, and it usually panics early in the morning, when first people t= ry=20 to access it. After reboot it may work OK for 1-2 days, and then panics=20 again. I have tried changing memory and replacing disk which was exported v= ia=20 NFS, but nothing helped :( Any suggestion on how to fix this panic will be very much appreciated !=20 /Yuri [root@XXX][/var/crash]# uname -a =46reeBSD XXX.irfu.se 6.0-STABLE FreeBSD 6.0-STABLE #0: Tue Nov 29 13:31:15= CET=20 2005 root@XXX.irfu.se:/usr/obj/usr/src/sys/HEM i386 [root@XXX][/var/crash]# kgdb /usr/obj/usr/src/sys/HEM/kernel.debug vmcore.7 [GDB will not be able to debug user-mode threads: /usr/lib/libthread_db.so:= =20 Undefined symbol "ps_pglobal_lookup"] GNU gdb 6.1.1 [FreeBSD] Copyright 2004 Free Software Foundation, Inc. GDB is free software, covered by the GNU General Public License, and you are welcome to change it and/or distribute copies of it under certain condition= s. Type "show copying" to see the conditions. There is absolutely no warranty for GDB. Type "show warranty" for details. This GDB was configured as "i386-marcel-freebsd". Unread portion of the kernel message buffer: kernel trap 12 with interrupts disabled =46atal trap 12: page fault while in kernel mode fault virtual address =3D 0x74 fault code =3D supervisor read, page not present instruction pointer =3D 0x20:0xc053a426 stack pointer =3D 0x28:0xd56c0b88 frame pointer =3D 0x28:0xd56c0b8c code segment =3D base 0x0, limit 0xfffff, type 0x1b =3D DPL 0, pres 1, def32 1, gran 1 processor eflags =3D resume, IOPL =3D 0 current process =3D 77 (vnlru) trap number =3D 12 panic: page fault Uptime: 2d12h22m11s Dumping 511 MB (2 chunks) chunk 0: 1MB (160 pages) ... ok chunk 1: 511MB (130800 pages) 495 479 463 447 431 415 399 383 367 351 335= =20 319 303 287 271 255 239 223 207 191 175 159 143 127 111 95 79 63 47 31 15 #0 doadump () at pcpu.h:165 165 pcpu.h: No such file or directory. in pcpu.h (kgdb) where #0 doadump () at pcpu.h:165 #1 0xc051577a in boot (howto=3D260) at /usr/src/sys/kern/kern_shutdown.c:3= 99 #2 0xc0515a84 in panic (fmt=3D0xc06ce475 "%s")=20 at /usr/src/sys/kern/kern_shutdown.c:555 #3 0xc06b4815 in trap_fatal (frame=3D0xd56c0b48, eva=3D0) at /usr/src/sys/i386/i386/trap.c:836 #4 0xc06b3f2d in trap (frame=3D {tf_fs =3D 1133445128, tf_es =3D 40, tf_ds =3D 40, tf_edi =3D -101799= 7312,=20 tf_esi =3D -1020120704, tf_ebp =3D -714339444, tf_isp =3D -714339468, tf_eb= x =3D=20 =2D1012942272, tf_edx =3D -1020120704, tf_ecx =3D 0, tf_eax =3D 0, tf_trapn= o =3D 12,=20 tf_err =3D 0, tf_eip =3D -1068260314, tf_cs =3D 32, tf_eflags =3D 589831, t= f_esp =3D=20 =2D1020120704, tf_ss =3D -714339408}) at /usr/src/sys/i386/i386/trap.c:269 #5 0xc06a24fa in calltrap () at /usr/src/sys/i386/i386/exception.s:139 #6 0xc053a426 in turnstile_setowner (ts=3D0xc39fba40, owner=3D0x0) at /usr/src/sys/kern/subr_turnstile.c:417 #7 0xc053a752 in turnstile_wait (lock=3D0xc461fe00, owner=3D0x0) at /usr/src/sys/kern/subr_turnstile.c:576 #8 0xc050b511 in _mtx_lock_sleep (m=3D0xc461fe00, tid=3D3274846592, opts= =3D0,=20 file=3D0x0, line=3D0) at /usr/src/sys/kern/kern_mutex.c:555 #9 0xc064becd in ufsdirhash_free (ip=3D0xc4a33840) at /usr/src/sys/ufs/ufs/ufs_dirhash.c:289 #10 0xc064de66 in ufs_reclaim (ap=3D0x0) at /usr/src/sys/ufs/ufs/ufs_inode.= c:175 #11 0xc06bef38 in VOP_RECLAIM_APV (vop=3D0x0, a=3D0xc3323180) at vnode_if.c= :1589 #12 0xc057adfe in vgonel (vp=3D0xc3cf3aa0) at vnode_if.h:818 #13 0xc0577530 in vtryrecycle (vp=3D0xc3cf3aa0)=20 at /usr/src/sys/kern/vfs_subr.c:840 #14 0xc0576ec6 in vnlru_free (count=3D1376) at /usr/src/sys/kern/vfs_subr.c= :668 #15 0xc0577019 in vnlru_proc () at /usr/src/sys/kern/vfs_subr.c:703 #16 0xc04fc310 in fork_exit (callout=3D0xc0576f24 , arg=3D0x0,= =20 frame=3D0x0) at /usr/src/sys/kern/kern_fork.c:789 #17 0xc06a255c in fork_trampoline () at /usr/src/sys/i386/i386/exception.s:= 208 (kgdb) quit =2D-=20 Dr. Yuri Khotyaintsev Institutet f=F6r rymdfysik (IRF), Uppsala