From owner-freebsd-bugs@FreeBSD.ORG Tue Nov 11 09:50:15 2003 Return-Path: Delivered-To: freebsd-bugs@hub.freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 5C6D416A4CE for ; Tue, 11 Nov 2003 09:50:15 -0800 (PST) Received: from freefall.freebsd.org (freefall.freebsd.org [216.136.204.21]) by mx1.FreeBSD.org (Postfix) with ESMTP id 3745B43FDF for ; Tue, 11 Nov 2003 09:50:13 -0800 (PST) (envelope-from gnats@FreeBSD.org) Received: from freefall.freebsd.org (gnats@localhost [127.0.0.1]) by freefall.freebsd.org (8.12.9/8.12.9) with ESMTP id hABHoDFY016886 for ; Tue, 11 Nov 2003 09:50:13 -0800 (PST) (envelope-from gnats@freefall.freebsd.org) Received: (from gnats@localhost) by freefall.freebsd.org (8.12.9/8.12.9/Submit) id hABHoDnP016885; Tue, 11 Nov 2003 09:50:13 -0800 (PST) (envelope-from gnats) Resent-Date: Tue, 11 Nov 2003 09:50:13 -0800 (PST) Resent-Message-Id: <200311111750.hABHoDnP016885@freefall.freebsd.org> Resent-From: FreeBSD-gnats-submit@FreeBSD.org (GNATS Filer) Resent-To: freebsd-bugs@FreeBSD.org Resent-Reply-To: FreeBSD-gnats-submit@FreeBSD.org, Alexey Popov Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 14D5216A4CE for ; Tue, 11 Nov 2003 09:49:18 -0800 (PST) Received: from mx3.mail.ru (mx3.mail.ru [194.67.23.23]) by mx1.FreeBSD.org (Postfix) with ESMTP id 94BC043F85 for ; Tue, 11 Nov 2003 09:49:16 -0800 (PST) (envelope-from megapopoff@mail.ru) Received: from [80.252.128.110] (port=62189 helo=192.168.254.177) by mx3.mail.ru with esmtp id 1AJcde-000MWX-00 for FreeBSD-gnats-submit@freebsd.org; Tue, 11 Nov 2003 20:49:14 +0300 Message-Id: <5011225942.20031111205012@mail.ru> Date: Tue, 11 Nov 2003 20:50:12 +0300 From: Alexey Popov To: FreeBSD-gnats-submit@FreeBSD.org Subject: kern/59185: 4.9-RELEASE kernel panic (page fault) X-BeenThere: freebsd-bugs@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list Reply-To: Alexey Popov List-Id: Bug reports List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 11 Nov 2003 17:50:15 -0000 >Number: 59185 >Category: kern >Synopsis: 4.9-RELEASE kernel panic (page fault) >Confidential: no >Severity: serious >Priority: high >Responsible: freebsd-bugs >State: open >Quarter: >Keywords: >Date-Required: >Class: sw-bug >Submitter-Id: current-users >Arrival-Date: Tue Nov 11 09:50:12 PST 2003 >Closed-Date: >Last-Modified: >Originator: Alexey Popov >Release: FreeBSD 4.9-RELEASE i386 >Organization: >Environment: System: FreeBSD nikulino.myhost.ru 4.9-RELEASE FreeBSD 4.9-RELEASE #1: Mon Nov 3 19:42:51 MSK 2003 lollypop@nikulino.myhost.ru:/usr/obj/usr/src/sys/NIKULINO i386 This is Internet gateway with on-board fxp, additional xl and dc network adapters (dc not used). It is running MPD,Squid,Postfix,MySQL,Apache,cyrus-imapd,ipcad. Sources updated with cvsup from 4.7-release to 4.8 and then to 4.9. System always pgraded by make buildworld/installword procedure. Custom kernel used. In /etc/make.conf: CPUTYPE=p3 CFLAGS= -O -pipe COMPAT3X= yes >Description: Sometimes it panics, not depending on curent load etc. It may run OK for a month or panic 3 times a day. GDB backtraces always almost identical (always at /usr/src/sys/kern/kern_timeout.c:252). The same problem was with 4.8-Release and AFAIR with 4.7-Release, but I had no debugging kernel becouse I thought it panics due to broken xl(4).a Here is gdb backtrace: Script started on Mon Nov 10 23:43:18 2003 nikulino# pwd /usr/obj/usr/src/sys/NIKULINO nikulino# gdb -k kernel.debug /var/crash/vmcore.4 GNU gdb 4.18 (FreeBSD) Copyright 1998 Free Software Foundation, Inc. GDB is free software, covered by the GNU General Public License, and you are welcome to change it and/or distribute copies of it under certain conditions. Type "show copying" to see the conditions. There is absolutely no warranty for GDB. Type "show warranty" for details. This GDB was configured as "i386-unknown-freebsd"...Deprecated bfd_read called at /usr/src/gnu/usr.bin/binutils/gdb/../../../../contrib/gdb/gdb/dbxread.c line 2627 in elfstab_build_psymtabs Deprecated bfd_read called at /usr/src/gnu/usr.bin/binutils/gdb/../../../../contrib/gdb/gdb/dbxread.c line 933 in fill_symbuf IdlePTD at phsyical address 0x00375000 initial pcb at physical address 0x002e4c20 panicstr: page fault panic messages: --- Fatal trap 12: page fault while in kernel mode fault virtual address = 0x3a800 fault code = supervisor write, page not present instruction pointer = 0x8:0xc016cafc stack pointer = 0x10:0xc02b2034 frame pointer = 0x10:0xc02b2040 code segment = base 0x0, limit 0xfffff, type 0x1b = DPL 0, pres 1, def32 1, gran 1 processor eflags = interrupt enabled, resume, IOPL = 0 current process = Idle interrupt mask = net tty bio cam trap number = 12 panic: page fault syncing disks... Fatal trap 12: page fault while in kernel mode fault virtual address = 0x30 fault code = supervisor read, page not present instruction pointer = 0x8:0xc0223838 stack pointer = 0x10:0xc02b1e54 frame pointer = 0x10:0xc02b1e5c code segment = base 0x0, limit 0xfffff, type 0x1b = DPL 0, pres 1, def32 1, gran 1 processor eflags = interrupt enabled, resume, IOPL = 0 current process = Idle interrupt mask = net tty bio cam trap number = 12 panic: page fault Uptime: 3d12h8m18s dumping to dev #ad/0x20001, offset 788992 dump ata0: resetting devices .. done 126 125 124 123 122 121 120 119 118 117 116 115 114 113 112 111 110 109 108 107 106 105 104 103 102 101 100 99 98 97 96 95 94 93 92 91 90 89 88 87 86 85 84 83 82 81 80 79 78 77 76 75 74 73 72 71 70 69 68 67 66 65 64 63 62 61 60 59 58 57 56 55 54 53 52 51 50 49 48 47 46 45 44 43 42 41 40 39 38 37 36 35 34 33 32 31 30 29 28 27 26 25 24 23 22 21 20 19 18 17 16 15 14 13 12 11 10 9 8 7 6 5 4 3 2 1 0 --- #0 dumpsys () at /usr/src/sys/kern/kern_shutdown.c:487 487 if (dumping++) { (kgdb) where #0 dumpsys () at /usr/src/sys/kern/kern_shutdown.c:487 #1 0xc01666f8 in boot (howto=260) at /usr/src/sys/kern/kern_shutdown.c:316 #2 0xc0166b2c in poweroff_wait (junk=0xc02a920c, howto=-1070953201) at /usr/src/sys/kern/kern_shutdown.c:595 #3 0xc0268b93 in trap_fatal (frame=0xc02b1e14, eva=48) at /usr/src/sys/i386/i386/trap.c:974 #4 0xc026884d in trap_pfault (frame=0xc02b1e14, usermode=0, eva=48) at /usr/src/sys/i386/i386/trap.c:867 #5 0xc0268423 in trap (frame={tf_fs = 16, tf_es = 51314704, tf_ds = -1072300016, tf_edi = 0, tf_esi = 2, tf_ebp = -1070916004, tf_isp = -1070916032, tf_ebx = -1070767204, tf_edx = 6864960, tf_ecx = -1070620160, tf_eax = 0, tf_trapno = 12, tf_err = 0, tf_eip = -1071499208, tf_cs = 8, tf_eflags = 66182, tf_esp = -1070915884, tf_ss = 2}) at /usr/src/sys/i386/i386/trap.c:466 #6 0xc0223838 in acquire_lock (lk=0xc02d639c) at /usr/src/sys/ufs/ffs/ffs_softdep.c:266 #7 0xc0227f86 in softdep_fsync_mountdev (vp=0xc862a9c0) at /usr/src/sys/ufs/ffs/ffs_softdep.c:4024 #8 0xc022c296 in ffs_fsync (ap=0xc02b1ed4) at /usr/src/sys/ufs/ffs/ffs_vnops.c:134 #9 0xc022aed4 in ffs_sync (mp=0xc0bfb200, waitfor=2, cred=0xc0727600, p=0xc02fa200) at vnode_if.h:558 #10 0xc0197fa3 in sync (p=0xc02fa200, uap=0x0) ---Type to continue, or q to quit--- at /usr/src/sys/kern/vfs_syscalls.c:577 #11 0xc01664b3 in boot (howto=256) at /usr/src/sys/kern/kern_shutdown.c:235 #12 0xc0166b2c in poweroff_wait (junk=0xc02a920c, howto=-1070953201) at /usr/src/sys/kern/kern_shutdown.c:595 #13 0xc0268b93 in trap_fatal (frame=0xc02b1ff4, eva=239616) at /usr/src/sys/i386/i386/trap.c:974 #14 0xc026884d in trap_pfault (frame=0xc02b1ff4, usermode=0, eva=239616) at /usr/src/sys/i386/i386/trap.c:867 #15 0xc0268423 in trap (frame={tf_fs = -1070923760, tf_es = 4587536, tf_ds = 16, tf_edi = -1, tf_esi = 30289325, tf_ebp = -1070915520, tf_isp = -1070915552, tf_ebx = -1019062480, tf_edx = -1019061856, tf_ecx = 268507, tf_eax = 239616, tf_trapno = 12, tf_err = 2, tf_eip = -1072248068, tf_cs = 8, tf_eflags = 66050, tf_esp = -1019062480, tf_ss = 4194304}) at /usr/src/sys/i386/i386/trap.c:466 #16 0xc016cafc in callout_reset (c=0xc3425730, to_ticks=1, ftn=0xc01ec7ac , arg=0x0) at /usr/src/sys/kern/kern_timeout.c:252 #17 0xc016ca32 in timeout (ftn=0xc01ec7ac , arg=0x0, to_ticks=1) at /usr/src/sys/kern/kern_timeout.c:177 #18 0xc01ecaae in nfs_timer (arg=0x0) at /usr/src/sys/nfs/nfs_socket.c:1509 #19 0xc016c9b1 in softclock () at /usr/src/sys/kern/kern_timeout.c:131 #20 0xc025bcd3 in doreti_swi () (kgdb) quit nikulino# ^Dexit Script done on Mon Nov 10 23:44:16 2003 Here is /var/run/dmesg.boot: 0 Fatal trap 12: page fault while in kernel mode fault virtual address = 0x3a800 fault code = supervisor write, page not present instruction pointer = 0x8:0xc016cafc stack pointer = 0x10:0xc02b2034 frame pointer = 0x10:0xc02b2040 code segment = base 0x0, limit 0xfffff, type 0x1b = DPL 0, pres 1, def32 1, gran 1 processor eflags = interrupt enabled, resume, IOPL = 0 current process = Idle interrupt mask = net tty bio cam trap number = 12 panic: page fault syncing disks... Fatal trap 12: page fault while in kernel mode fault virtual address = 0x30 fault code = supervisor read, page not present instruction pointer = 0x8:0xc0223838 stack pointer = 0x10:0xc02b1e54 frame pointer = 0x10:0xc02b1e5c code segment = base 0x0, limit 0xfffff, type 0x1b = DPL 0, pres 1, def32 1, gran 1 processor eflags = interrupt enabled, resume, IOPL = 0 current process = Idle interrupt mask = net tty bio cam trap number = 12 panic: page fault Uptime: 3d12h8m18s dumping to dev #ad/0x20001, offset 788992 dump ata0: resetting devices .. done 126 125 124 123 122 121 120 119 118 117 116 115 114 113 112 111 110 109 108 107 106 105 104 103 102 101 100 99 98 97 96 95 94 93 92 91 90 89 88 87 86 85 84 83 82 81 80 79 78 77 76 75 74 73 72 71 70 69 68 67 66 65 64 63 62 61 60 59 58 57 56 55 54 53 52 51 50 49 48 47 46 45 44 43 42 41 40 39 38 37 36 35 34 33 32 31 30 29 28 27 26 25 24 23 22 21 20 19 18 17 16 15 14 13 12 11 10 9 8 7 6 5 4 3 2 1 0 succeeded Automatic reboot in 15 seconds - press a key on the console to abort Rebooting... Copyright (c) 1992-2003 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD 4.9-RELEASE #1: Mon Nov 3 19:42:51 MSK 2003 lollypop@nikulino.myhost.ru:/usr/obj/usr/src/sys/NIKULINO Timecounter "i8254" frequency 1193182 Hz Timecounter "TSC" frequency 929890344 Hz CPU: Intel Pentium III (929.89-MHz 686-class CPU) Origin = "GenuineIntel" Id = 0x686 Stepping = 6 Features=0x383fbff real memory = 132907008 (129792K bytes) avail memory = 125988864 (123036K bytes) Preloaded elf kernel "kernel" at 0xc0356000. Pentium Pro MTRR support enabled md0: Malloc disk Using $PIR table, 12 entries at 0xc00f2a70 npx0: on motherboard npx0: INT 16 interface pcib0: on motherboard pci0: on pcib0 pci0: at 2.0 irq 11 pcib1: at device 30.0 on pci0 pci1: on pcib1 fxp0: port 0xdf00-0xdf3f mem 0xff8fd000-0xff8fdfff irq 11 at device 8.0 on pci1 fxp0: Ethernet address 00:03:47:d1:90:fc inphy0: on miibus0 inphy0: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto xl0: <3Com 3c905C-TX Fast Etherlink XL> port 0xdc00-0xdc7f mem 0xff8fec00-0xff8fec7f irq 11 at device 10.0 on pci1 xl0: Ethernet address: 00:10:22:fd:da:57 miibus1: on xl0 xlphy0: <3c905C 10/100 internal PHY> on miibus1 xlphy0: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto dc0: port 0xd800-0xd8ff mem 0xff8ffc00-0xff8ffcff irq 10 at device 11.0 on pci1 dc0: Ethernet address: 00:08:a1:1c:53:d2 miibus2: on dc0 ukphy0: on miibus2 ukphy0: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto isab0: at device 31.0 on pci0 isa0: on isab0 atapci0: port 0xffa0-0xffaf at device 31.1 on pci0 ata0: at 0x1f0 irq 14 on atapci0 ata1: at 0x170 irq 15 on atapci0 pci0: at 31.2 irq 11 pci0: (vendor=0x8086, dev=0x2443) at 31.3 irq 9 pci0: at 31.4 irq 10 pci0: (vendor=0x8086, dev=0x2445) at 31.5 irq 9 orm0: