From owner-freebsd-current@FreeBSD.ORG Mon Aug 23 20:32:20 2004 Return-Path: Delivered-To: freebsd-current@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id C206716A4CE; Mon, 23 Aug 2004 20:32:20 +0000 (GMT) Received: from imf17aec.mail.bellsouth.net (imf17aec.mail.bellsouth.net [205.152.59.65]) by mx1.FreeBSD.org (Postfix) with ESMTP id 4335743D54; Mon, 23 Aug 2004 20:32:20 +0000 (GMT) (envelope-from kruptos@bellsouth.net) Received: from [172.23.23.23] ([67.35.154.55]) by imf17aec.mail.bellsouth.netESMTP <20040823203217.QMGH1758.imf17aec.mail.bellsouth.net@[172.23.23.23]>; Mon, 23 Aug 2004 16:32:17 -0400 From: Kevin Brunelle To: freebsd-current@freebsd.org In-Reply-To: <1093188163.2100.4.camel@fnord.quux.edu> References: <1093141197.643.28.camel@fnord.quux.edu> <1093188163.2100.4.camel@fnord.quux.edu> Content-Type: multipart/mixed; boundary="=-vpYO8kooTC9NnTLQkRkK" Message-Id: <1093293236.618.12.camel@fnord.quux.edu> Mime-Version: 1.0 X-Mailer: Ximian Evolution 1.4.6 Date: Mon, 23 Aug 2004 16:33:56 -0400 cc: freebsd-hackers@freebsd.org Subject: Re: Fatal trap 12: page fault while in kernel mode X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 23 Aug 2004 20:32:20 -0000 --=-vpYO8kooTC9NnTLQkRkK Content-Type: text/plain Content-Transfer-Encoding: 7bit Alright, this is driving me nuts. For a little while there I could not get the system to panic -- it would spontaniously reboot when running a GL program instead of panic. This afternoon it finally panic'd (who would think that would be something I want to see but it was). I am attaching the transcript of me playing around with it. It includes the panic message as well as some debug output from gdb. Although I am not certain that is as helpful as I hoped it would be. At the very end I have included yet another uname -a and copy of my kernel configuration file. The error this time was a double fault (are we playing tennis?). My original issue was with a page fault in kernel mode. And my original problem also was related to a different function. The function this time is . Take a look at all those sig-11s. I would suspect bad memory but I ran memtest86+ on this machine less than a week ago and everything was fine -- not even a whiff of a problem. I caused this panic by running another gl application and I feel it is related to my orginal problem. Another thing that interested me is that the kernel dump seems "corrupted" or incomplete... does the line "---Can't read userspace from dump, or kernel process---" possibly imply that I did not get a good dump at the time of the panic? If anyone has any ideas about what to fix I would love to hear them. I am tempted to change a few things myself that might be an issue (for example, removing the FreeBSD agp which nvidia complains about in my dmesg -- and also upgrading to 3-Beta1 ... so at least my kernel panics will relate to making that system better). But, until I know that this is a dead end and no one wants to see anything, I am not touching anything. I don't want to ruin the chances of this being a real bug and it not being fixed because I change something that just hides it. If you want me to get any information from the dump or try anything please let me know. You may have to tell me how to go about doing stuff with gdb (I am not very experienced with its advanced features) but I am willing to learn and do what I can. -Kevin -- "Down with disease, up before the dawn. A thousand barefoot children, dancin? on my lawn" -Phish "Down with Disease" --=-vpYO8kooTC9NnTLQkRkK Content-Disposition: attachment; filename=typescript Content-Type: text/plain; name=typescript; charset=iso-8859-1 Content-Transfer-Encoding: 7bit Script started on Mon Aug 23 16:14:53 2004 /home/kevinb/crash# gdb -k kernel.debug vmcore.1 GNU gdb 5.2.1 (FreeBSD) Copyright 2002 Free Software Foundation, Inc. GDB is free software, covered by the GNU General Public License, and you are welcome to change it and/or distribute copies of it under certain conditions. Type "show copying" to see the conditions. There is absolutely no warranty for GDB. Type "show warranty" for details. This GDB was configured as "i386-unknown-freebsd"... panic: swp_pager_meta_free_all: failed to locate all swap meta blocks panic messages: --- panic: double fault syncing disks, buffers remaining... 2177 2177 Copyright (c) 1992-2004 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD 5.2.1-RELEASE-p9 #0: Sun Aug 22 14:00:38 EDT 2004 kevinb@fnord.quux.edu:/usr/obj/usr/src/sys/FOOKERN Preloaded elf kernel "/boot/kernel/kernel" at 0xc0ce4000. Preloaded elf module "/boot/modules/nvidia.ko" at 0xc0ce4244. Preloaded elf module "/boot/kernel/linux.ko" at 0xc0ce42f0. Preloaded elf module "/boot/kernel/acpi.ko" at 0xc0ce439c. Timecounter "i8254" frequency 1193182 Hz quality 0 CPU: Intel Pentium III (863.87-MHz 686-class CPU) Origin = "GenuineIntel" Id = 0x683 Stepping = 3 Features=0x383f9ff real memory = 268173312 (255 MB) avail memory = 246661120 (235 MB) Pentium Pro MTRR support enabled npx0: [FAST] npx0: on motherboard npx0: INT 16 interface acpi0: on motherboard pcibios: BIOS version 2.10 Using $PIR table, 12 entries at 0xc00f2d00 acpi0: Power Button (fixed) Timecounter "ACPI-fast" frequency 3579545 Hz quality 1000 acpi_timer0: <24-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0 acpi_cpu0: port 0x530-0x537 on acpi0 acpi_button0: on acpi0 pcib0: port 0xcf8-0xcff on acpi0 pci0: on pcib0 pcib0: slot 31 INTD is routed to irq 10 pcib0: slot 31 INTB is routed to irq 9 agp0: mem 0xf8000000-0xfbffffff at device 0.0 on pci0 pcib1: at device 1.0 on pci0 pci2: on pcib1 pcib0: slot 1 INTA is routed to irq 11 pcib1: slot 0 INTA is routed to irq 11 nvidia0: mem 0xf2000000-0xf3ffffff,0xfd000000-0xfdffffff irq 11 at device 0.0 on pci2 pcib2: at device 30.0 on pci0 pci1: on pcib2 pcib2: slot 9 INTA is routed to irq 3 pcib2: slot 12 INTA is routed to irq 9 xl0: <3Com 3c905C-TX Fast Etherlink XL> port 0xdc00-0xdc7f mem 0xfc9ff800-0xfc9ff87f irq 3 at device 9.0 on pci1 xl0: Ethernet address: 00:01:03:23:9d:ba miibus0: on xl0 xlphy0: <3c905C 10/100 internal PHY> on miibus0 xlphy0: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto pcm0: port 0xdf00-0xdf3f irq 9 at device 12.0 on pci1 pcm0: isab0: at device 31.0 on pci0 isa0: on isab0 atapci0: port 0xffa0-0xffaf at device 31.1 on pci0 ata0: at 0x1f0 irq 14 on atapci0 ata0: [MPSAFE] ata1: at 0x170 irq 15 on atapci0 ata1: [MPSAFE] uhci0: port 0xef80-0xef9f irq 10 at device 31.2 on pci0 usb0: on uhci0 usb0: USB revision 1.0 uhub0: Intel UHCI root hub, class 9/0, rev 1.00/1.00, addr 1 uhub0: 2 ports with 2 removable, self powered ums0: Logitech USB-PS/2 Optical Mouse, rev 2.00/11.10, addr 2, iclass 3/1 ums0: 3 buttons and Z dir. pci0: at device 31.3 (no driver attached) atkbdc0: port 0x64,0x60 irq 1 on acpi0 atkbd0: flags 0x1 irq 1 on atkbdc0 kbd0 at atkbd0 fdc0: port 0x3f7,0x3f4-0x3f5,0x3f2-0x3f3,0x3f0-0x3f1 irq 6 drq 2 on acpi0 fdc0: FIFO enabled, 8 bytes threshold fd0: <1440-KB 3.5" drive> on fdc0 drive 0 sio0 port 0x3f8-0x3ff irq 4 on acpi0 sio0: type 16550A ppc0 port 0x778-0x77f,0x378-0x37f irq 7 drq 3 on acpi0 ppc0: SMC-like chipset (ECP/EPP/PS2/NIBBLE) in COMPATIBLE mode ppc0: FIFO with 16/16/8 bytes threshold ppbus0: on ppc0 ppbus0: IEEE1284 device found /NIBBLE/ECP Probing for PnP devices on ppbus0: ppbus0: MLC,PCL,PML plip0: on ppbus0 lpt0: on ppbus0 lpt0: Interrupt-driven port ppi0: on ppbus0 pmtimer0 on isa0 sc0: at flags 0x100 on isa0 sc0: VGA <16 virtual consoles, flags=0x300> sio1: configured irq 3 not in bitmap of probed irqs 0 sio1: port may not be enabled vga0: at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0 Timecounter "TSC" frequency 863868717 Hz quality 800 Timecounters tick every 10.000 msec GEOM: create disk ad0 dp=0xc3138960 ad0: 28629MB [58168/16/63] at ata0-master UDMA66 GEOM: create disk ad1 dp=0xc3138660 ad1: 57220MB [116257/16/63] at ata0-slave UDMA100 acd0: CDRW at ata1-master PIO4 acd1: CDROM at ata1-slave PIO4 Mounting root from ufs:/dev/ad0s1a WARNING: / was not properly dismounted WARNING: /tmp was not properly dismounted WARNING: /usr was not properly dismounted WARNING: /var was not properly dismounted WARNING: /drv1 was not properly dismounted /drv1: superblock summary recomputed NVRM: detected agp.ko, aborting NVIDIA AGP setup! NVRM: detected agp.ko, aborting NVIDIA AGP setup! Fatal double fault: eip = 0xc064c41d esp = 0xd31f1ffc ebp = 0xd31f2034 panic: double fault syncing disks, buffers remaining... 2176 2176 Copyright (c) 1992-2004 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD 5.2.1-RELEASE-p9 #0: Sun Aug 22 14:00:38 EDT 2004 kevinb@fnord.quux.edu:/usr/obj/usr/src/sys/FOOKERN Preloaded elf kernel "/boot/kernel/kernel" at 0xc0cf8000. Preloaded elf module "/boot/kernel/splash_bmp.ko" at 0xc0cf8244. Preloaded splash_image_data "/boot/splash.bmp" at 0xc0cf82f4. Preloaded elf module "/boot/kernel/linux.ko" at 0xc0cf8344. Preloaded elf module "/boot/modules/nvidia.ko" at 0xc0cf83f0. Preloaded elf module "/boot/kernel/acpi.ko" at 0xc0cf849c. Timecounter "i8254" frequency 1193182 Hz quality 0 CPU: Intel Pentium III (863.87-MHz 686-class CPU) Origin = "GenuineIntel" Id = 0x683 Stepping = 3 Features=0x383f9ff real memory = 268173312 (255 MB) avail memory = 246661120 (235 MB) Pentium Pro MTRR support enabled npx0: [FAST] npx0: on motherboard npx0: INT 16 interface acpi0: on motherboard pcibios: BIOS version 2.10 Using $PIR table, 12 entries at 0xc00f2d00 acpi0: Power Button (fixed) Timecounter "ACPI-fast" frequency 3579545 Hz quality 1000 acpi_timer0: <24-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0 acpi_cpu0: port 0x530-0x537 on acpi0 acpi_button0: on acpi0 pcib0: port 0xcf8-0xcff on acpi0 pci0: on pcib0 pcib0: slot 31 INTD is routed to irq 10 pcib0: slot 31 INTB is routed to irq 9 agp0: mem 0xf8000000-0xfbffffff at device 0.0 on pci0 pcib1: at device 1.0 on pci0 pci2: on pcib1 pcib0: slot 1 INTA is routed to irq 11 pcib1: slot 0 INTA is routed to irq 11 nvidia0: mem 0xf2000000-0xf3ffffff,0xfd000000-0xfdffffff irq 11 at device 0.0 on pci2 pcib2: at device 30.0 on pci0 pci1: on pcib2 pcib2: slot 9 INTA is routed to irq 3 pcib2: slot 12 INTA is routed to irq 9 xl0: <3Com 3c905C-TX Fast Etherlink XL> port 0xdc00-0xdc7f mem 0xfc9ff800-0xfc9ff87f irq 3 at device 9.0 on pci1 xl0: Ethernet address: 00:01:03:23:9d:ba miibus0: on xl0 xlphy0: <3c905C 10/100 internal PHY> on miibus0 xlphy0: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto pcm0: port 0xdf00-0xdf3f irq 9 at device 12.0 on pci1 pcm0: isab0: at device 31.0 on pci0 isa0: on isab0 atapci0: port 0xffa0-0xffaf at device 31.1 on pci0 ata0: at 0x1f0 irq 14 on atapci0 ata0: [MPSAFE] ata1: at 0x170 irq 15 on atapci0 ata1: [MPSAFE] uhci0: port 0xef80-0xef9f irq 10 at device 31.2 on pci0 usb0: on uhci0 usb0: USB revision 1.0 uhub0: Intel UHCI root hub, class 9/0, rev 1.00/1.00, addr 1 uhub0: 2 ports with 2 removable, self powered ums0: Logitech USB-PS/2 Optical Mouse, rev 2.00/11.10, addr 2, iclass 3/1 ums0: 3 buttons and Z dir. pci0: at device 31.3 (no driver attached) atkbdc0: port 0x64,0x60 irq 1 on acpi0 atkbd0: flags 0x1 irq 1 on atkbdc0 kbd0 at atkbd0 fdc0: port 0x3f7,0x3f4-0x3f5,0x3f2-0x3f3,0x3f0-0x3f1 irq 6 drq 2 on acpi0 fdc0: FIFO enabled, 8 bytes threshold fd0: <1440-KB 3.5" drive> on fdc0 drive 0 sio0 port 0x3f8-0x3ff irq 4 on acpi0 sio0: type 16550A ppc0 port 0x778-0x77f,0x378-0x37f irq 7 drq 3 on acpi0 ppc0: SMC-like chipset (ECP/EPP/PS2/NIBBLE) in COMPATIBLE mode ppc0: FIFO with 16/16/8 bytes threshold ppbus0: on ppc0 ppbus0: IEEE1284 device found /NIBBLE/ECP Probing for PnP devices on ppbus0: ppbus0: MLC,PCL,PML plip0: on ppbus0 lpt0: on ppbus0 lpt0: Interrupt-driven port ppi0: on ppbus0 pmtimer0 on isa0 sc0: at flags 0x100 on isa0 sc0: VGA <16 virtual consoles, flags=0x300> sio1: configured irq 3 not in bitmap of probed irqs 0 sio1: port may not be enabled vga0: at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0 Timecounter "TSC" frequency 863866045 Hz quality 800 Timecounters tick every 10.000 msec GEOM: create disk ad0 dp=0xc31c3460 ad0: 28629MB [58168/16/63] at ata0-master UDMA66 GEOM: create disk ad1 dp=0xc31c3160 ad1: 57220MB [116257/16/63] at ata0-slave UDMA100 acd0: CDRW at ata1-master PIO4 acd1: CDROM at ata1-slave PIO4 Mounting root from ufs:/dev/ad0s1a WARNING: / was not properly dismounted WARNING: /tmp was not properly dismounted WARNING: /usr was not properly dismounted WARNING: /var was not properly dismounted WARNING: /drv1 was not properly dismounted /drv1: mount pending error: blocks 108 files 0 NVRM: detected agp.ko, aborting NVIDIA AGP setup! NVRM: detected agp.ko, aborting NVIDIA AGP setup! pid 3725 (stairs), uid 1000: exited on signal 10 (core dumped) pid 3757 (dd), uid 2: exited on signal 11 pid 3796 (dd), uid 2: exited on signal 11 pid 3859 (dd), uid 2: exited on signal 11 pid 3921 (dd), uid 2: exited on signal 11 pid 3981 (dd), uid 2: exited on signal 11 pid 4041 (dd), uid 2: exited on signal 11 pid 4103 (dd), uid 2: exited on signal 11 pid 4136 (dd), uid 2: exited on signal 11 pid 4193 (dd), uid 2: exited on signal 11 pid 4250 (dd), uid 2: exited on signal 11 pid 4306 (dd), uid 2: exited on signal 11 pid 4363 (dd), uid 2: exited on signal 11 pid 4423 (dd), uid 2: exited on signal 11 pid 4455 (dd), uid 2: exited on signal 11 pid 4511 (dd), uid 2: exited on signal 11 pid 4569 (dd), uid 2: exited on signal 11 pid 4625 (dd), uid 2: exited on signal 11 pid 4682 (dd), uid 2: exited on signal 11 pid 4742 (dd), uid 2: exited on signal 11 pid 4774 (dd), uid 2: exited on signal 11 pid 4832 (dd), uid 2: exited on signal 11 pid 4888 (dd), uid 2: exited on signal 11 pid 4945 (dd), uid 2: exited on signal 11 pid 5002 (dd), uid 2: exited on signal 11 pid 1841 (xscreensaver), uid 1000: exited on signal 4 pid 5036 (xscreensaver), uid 1000: exited on signal 4 pid 5057 (glsnake), uid 1000: exited on signal 11 (core dumped) pid 5058 (gltext), uid 1000: exited on signal 11 (core dumped) pid 5059 (gltext), uid 1000: exited on signal 11 (core dumped) pid 5060 (gltext), uid 1000: exited on signal 11 (core dumped) pid 5061 (gltext), uid 1000: exited on signal 11 (core dumped) pid 5066 (glplanet), uid 1000: exited on signal 11 (core dumped) pid 5067 (glplanet), uid 1000: exited on signal 11 (core dumped) pid 5068 (glmatrix), uid 1000: exited on signal 11 (core dumped) pid 5069 (glmatrix), uid 1000: exited on signal 11 (core dumped) pid 5071 (glplanet), uid 1000: exited on signal 11 (core dumped) pid 5072 (glmatrix), uid 1000: exited on signal 11 (core dumped) pid 5073 (gltext), uid 1000: exited on signal 11 (core dumped) pid 9782 (dd), uid 2: exited on signal 11 pid 10650 (dd), uid 2: exited on signal 11 pid 13114 (bouncingcow), uid 1000: exited on signal 11 (core dumped) pid 12995 (tcsh), uid 1000: exited on signal 11 (core dumped) pid 5167 (firefox-bin), uid 1000: exited on signal 11 (core dumped) pid 1837 (wmaker), uid 1000: exited on signal 11 (core dumped) panic: swp_pager_meta_free_all: failed to locate all swap meta blocks syncing disks, buffers remaining... 1712 1672 1672 1672 1672 1672 1672 1672 1672 1672 1672 1672 1672 1672 1672 1672 ad1: WARNING - WRITE_DMA interrupt was seen but timeout fired LBA=38562655 1672 1672 1672 1672 1672 giving up on 435 buffers Uptime: 12h25m26s Dumping 255 MB [CTRL-C to abort] [CTRL-C to abort] [CTRL-C to abort] 16 32 48 64 80 96 112 128 144 160 176 192[CTRL-C to abort] [CTRL-C to abort] [CTRL-C to abort] [CTRL-C to abort] [CTRL-C to abort] [CTRL-C to abort] 208[CTRL-C to abort] [CTRL-C to abort] [CTRL-C to abort] [CTRL-C to abort] [CTRL-C to abort] [CTRL-C to abort] 224[CTRL-C to abort] [CTRL-C to abort] [CTRL-C to abort] 240 --- warning: cannot find file for module nvidia.ko Error while mapping shared library sections: nvidia.ko: No such file or directory. Reading symbols from /boot/kernel/splash_bmp.ko...done. Loaded symbols for /boot/kernel/splash_bmp.ko Reading symbols from /usr/obj/usr/src/sys/FOOKERN/modules/usr/src/sys/modules/linux/linux.ko.debug...done. Loaded symbols for /usr/obj/usr/src/sys/FOOKERN/modules/usr/src/sys/modules/linux/linux.ko.debug Error while reading shared library symbols: nvidia.ko: No such file or directory. Reading symbols from /usr/obj/usr/src/sys/FOOKERN/modules/usr/src/sys/modules/acpi/acpi.ko.debug...done. Loaded symbols for /usr/obj/usr/src/sys/FOOKERN/modules/usr/src/sys/modules/acpi/acpi.ko.debug #0 doadump () at /usr/src/sys/kern/kern_shutdown.c:240 240 dumping++; (kgdb) where #0 doadump () at /usr/src/sys/kern/kern_shutdown.c:240 #1 0xc0527cf7 in boot (howto=256) at /usr/src/sys/kern/kern_shutdown.c:372 #2 0xc0528027 in panic () at /usr/src/sys/kern/kern_shutdown.c:550 #3 0xc0621025 in swp_pager_meta_free_all (object=0xc38d9b58) at /usr/src/sys/vm/swap_pager.c:1980 #4 0xc061ef04 in swap_pager_dealloc (object=0xc38d9b58) at /usr/src/sys/vm/swap_pager.c:552 #5 0xc063532a in vm_pager_deallocate (object=0x0) at /usr/src/sys/vm/vm_pager.c:261 #6 0xc062dc03 in vm_object_terminate (object=0xc38d9b58) at /usr/src/sys/vm/vm_object.c:637 #7 0xc062da31 in vm_object_deallocate (object=0xc38d9b58) at /usr/src/sys/vm/vm_object.c:551 #8 0xc0629c28 in vm_map_entry_delete (map=0xc1acb1d8, entry=0xc38d412c) at /usr/src/sys/vm/vm_map.c:2090 #9 0xc0629e88 in vm_map_delete (map=0xc1acb1d8, start=3280814380, end=3217031168) at /usr/src/sys/vm/vm_map.c:2190 #10 0xc0629f05 in vm_map_remove (map=0xc1acb1d8, start=0, end=3217031168) at /usr/src/sys/vm/vm_map.c:2212 #11 0xc0511d9d in exit1 (td=0xc31d8dc0, rv=139) at /usr/src/sys/vm/vm_map.h:201 #12 0xc052c4cc in sigexit () at /usr/src/sys/kern/kern_sig.c:2428 #13 0xc052c129 in postsig (sig=11) at /usr/src/sys/kern/kern_sig.c:2313 #14 0xc054b018 in ast (framep=0xd2936d48) at /usr/src/sys/kern/subr_trap.c:262 #15 0xc065cb5d in doreti_ast () at {standard input}:348 ---Can't read userspace from dump, or kernel process--- (kgdb) dia sas 0xc064c41d Dump of assembler code for function scterm_puts: 0xc064c370 : push %ebp 0xc064c371 : mov %esp,%ebp 0xc064c373 : push %edi 0xc064c374 : push %esi 0xc064c375 : push %ebx 0xc064c376 : sub $0x2c,%esp 0xc064c379 : mov 0x8(%ebp),%eax 0xc064c37c : mov 0x7c(%eax),%eax 0xc064c37f : mov %eax,0xfffffff0(%ebp) 0xc064c382 : lea 0x0(%esi,1),%esi 0xc064c389 : lea 0x0(%edi,1),%edi 0xc064c390 : mov 0x8(%ebp),%edx 0xc064c393 : mov 0x4(%edx),%eax 0xc064c396 : incb 0x3f(%eax) 0xc064c399 : mov 0xfffffff0(%ebp),%ecx 0xc064c39c : cmpl $0x0,0x4(%ecx) 0xc064c3a0 : je 0xc064c3c0 0xc064c3a2 : mov 0xc(%ebp),%eax 0xc064c3a5 : movzbl (%eax),%eax 0xc064c3a8 : mov %eax,0x8(%esp,1) 0xc064c3ac : mov %ecx,0x4(%esp,1) 0xc064c3b0 : mov %edx,(%esp,1) 0xc064c3b3 : call 0xc064b0a0 0xc064c3b8 : jmp 0xc064c3d9 0xc064c3ba : lea 0x0(%esi),%esi 0xc064c3c0 : mov 0xc(%ebp),%eax 0xc064c3c3 : cmpb $0x1b,(%eax) 0xc064c3c6 : jne 0xc064c3e4 0xc064c3c8 : mov 0xfffffff0(%ebp),%eax 0xc064c3cb : movl $0x1,0x4(%eax) 0xc064c3d2 : movl $0x0,0x8(%eax) 0xc064c3d9 : incl 0xc(%ebp) 0xc064c3dc : decl 0x10(%ebp) 0xc064c3df : jmp 0xc064c60a 0xc064c3e4 : mov 0x8(%ebp),%edi 0xc064c3e7 : mov 0xfffffff0(%ebp),%edx 0xc064c3ea : mov 0x30(%edx),%edx 0xc064c3ed : mov %edx,0xffffffec(%ebp) 0xc064c3f0 : mov 0xc(%ebp),%esi 0xc064c3f3 : mov 0x10(%ebp),%ecx 0xc064c3f6 : mov %ecx,0xffffffe0(%ebp) 0xc064c3f9 : cmpb $0x1b,(%esi) 0xc064c3fc : ja 0xc064c410 0xc064c3fe : movzbl (%esi),%eax 0xc064c401 : sub $0xe,%al 0xc064c403 : cmp $0xc,%al 0xc064c405 : jbe 0xc064c410 0xc064c407 : cmpb $0x6,(%esi) ---Type to continue, or q to quit--- 0xc064c40a : ja 0xc064c503 0xc064c410 : mov 0x88(%edi),%eax 0xc064c416 : mov %eax,0x4(%esp,1) 0xc064c41a : lea 0x28(%edi),%eax 0xc064c41d : mov %eax,(%esp,1) 0xc064c420 : call 0xc064e5c0 0xc064c425 : mov %eax,%edx 0xc064c427 : mov 0x4(%edi),%eax 0xc064c42a : add $0x60,%eax 0xc064c42d : mov %eax,0xffffffe8(%ebp) 0xc064c430 : mov 0x4c(%edi),%eax 0xc064c433 : sub 0x44(%edi),%eax 0xc064c436 : cmp 0xffffffe0(%ebp),%eax 0xc064c439 : cmovg 0xffffffe0(%ebp),%eax 0xc064c43d : mov %eax,0xffffffe4(%ebp) 0xc064c440 : mov %eax,%ebx 0xc064c442 : lea 0x28(%edi),%ecx 0xc064c445 : mov %ecx,0xffffffdc(%ebp) 0xc064c448 : nop 0xc064c449 : lea 0x0(%esi,1),%esi 0xc064c450 : mov 0xffffffec(%ebp),%eax 0xc064c453 : mov %eax,0xc(%esp,1) 0xc064c457 : movzbl (%esi),%eax 0xc064c45a : mov 0xffffffe8(%ebp),%ecx 0xc064c45d : movzbl (%eax,%ecx,1),%eax 0xc064c461 : mov %eax,0x8(%esp,1) 0xc064c465 : mov %edx,0x4(%esp,1) 0xc064c469 : mov 0xffffffdc(%ebp),%eax 0xc064c46c : mov %eax,(%esp,1) 0xc064c46f : call 0xc064e5a0 0xc064c474 : mov %eax,%edx 0xc064c476 : inc %esi 0xc064c477 : dec %ebx 0xc064c478 : test %ebx,%ebx 0xc064c47a : jle 0xc064c48f 0xc064c47c : cmpb $0x1b,(%esi) 0xc064c47f : ja 0xc064c450 0xc064c481 : movzbl (%esi),%eax 0xc064c484 : sub $0xe,%al 0xc064c486 : cmp $0xc,%al 0xc064c488 : jbe 0xc064c450 0xc064c48a : cmpb $0x6,(%esi) 0xc064c48d : jbe 0xc064c450 0xc064c48f : mov 0xffffffe4(%ebp),%eax 0xc064c492 : sub %ebx,%eax 0xc064c494 : sub %eax,0xffffffe0(%ebp) 0xc064c497 : mov 0x88(%edi),%eax 0xc064c49d : cmp 0x70(%edi),%eax 0xc064c4a0 : jge 0xc064c4a7 ---Type to continue, or q to quit---q Quit (kgdb) q /home/kevinb/crash# grep /var/log/messages  /" A u g   /2 3   /0 3 : 3 "  Aug 23 03:37:55 fnord syslogd: kernel boot file is /boot/kernel/kernel Aug 23 03:37:55 fnord kernel: Aug 23 03:37:55 fnord kernel: Fatal double fault: Aug 23 03:37:55 fnord kernel: eip = 0xc064c41d Aug 23 03:37:55 fnord kernel: esp = 0xd31f1ffc Aug 23 03:37:55 fnord kernel: ebp = 0xd31f2034 Aug 23 03:37:55 fnord kernel: panic: double fault Aug 23 03:37:55 fnord kernel: Aug 23 03:37:55 fnord kernel: syncing disks, buffers remaining... 2176 2176 Copyright (c) 1992-2004 The FreeBSD Project. Aug 23 03:37:55 fnord kernel: Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 Aug 23 03:37:55 fnord kernel: The Regents of the University of California. All rights reserved. Aug 23 03:37:55 fnord kernel: FreeBSD 5.2.1-RELEASE-p9 #0: Sun Aug 22 14:00:38 EDT 2004 Aug 23 03:37:55 fnord kernel: kevinb@fnord.quux.edu:/usr/obj/usr/src/sys/FOOKERN Aug 23 03:37:55 fnord kernel: Preloaded elf kernel "/boot/kernel/kernel" at 0xc0cf8000. Aug 23 03:37:55 fnord kernel: Preloaded elf module "/boot/kernel/splash_bmp.ko" at 0xc0cf8244. Aug 23 03:37:55 fnord kernel: Preloaded splash_image_data "/boot/splash.bmp" at 0xc0cf82f4. Aug 23 03:37:55 fnord kernel: Preloaded elf module "/boot/kernel/linux.ko" at 0xc0cf8344. Aug 23 03:37:55 fnord kernel: Preloaded elf module "/boot/modules/nvidia.ko" at 0xc0cf83f0. Aug 23 03:37:55 fnord kernel: Preloaded elf module "/boot/kernel/acpi.ko" at 0xc0cf849c. Aug 23 03:37:55 fnord kernel: Timecounter "i8254" frequency 1193182 Hz quality 0 Aug 23 03:37:55 fnord kernel: CPU: Intel Pentium III (863.87-MHz 686-class CPU) Aug 23 03:37:55 fnord kernel: Origin = "GenuineIntel" Id = 0x683 Stepping = 3 Aug 23 03:37:55 fnord kernel: Features=0x383f9ff Aug 23 03:37:55 fnord kernel: real memory = 268173312 (255 MB) Aug 23 03:37:55 fnord kernel: avail memory = 246661120 (235 MB) Aug 23 03:37:55 fnord kernel: Pentium Pro MTRR support enabled Aug 23 03:37:55 fnord kernel: npx0: [FAST] Aug 23 03:37:55 fnord kernel: npx0: on motherboard Aug 23 03:37:55 fnord kernel: npx0: INT 16 interface Aug 23 03:37:55 fnord kernel: acpi0: on motherboard Aug 23 03:37:55 fnord kernel: pcibios: BIOS version 2.10 Aug 23 03:37:55 fnord kernel: Using $PIR table, 12 entries at 0xc00f2d00 Aug 23 03:37:55 fnord kernel: acpi0: Power Button (fixed) Aug 23 03:37:55 fnord kernel: Timecounter "ACPI-fast" frequency 3579545 Hz quality 1000 Aug 23 03:37:55 fnord kernel: acpi_timer0: <24-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0 Aug 23 03:37:55 fnord kernel: acpi_cpu0: port 0x530-0x537 on acpi0 Aug 23 03:37:55 fnord kernel: acpi_button0: on acpi0 Aug 23 03:37:55 fnord kernel: pcib0: port 0xcf8-0xcff on acpi0 Aug 23 03:37:55 fnord kernel: pci0: on pcib0 Aug 23 03:37:55 fnord kernel: pcib0: slot 31 INTD is routed to irq 10 Aug 23 03:37:55 fnord kernel: pcib0: slot 31 INTB is routed to irq 9 Aug 23 03:37:55 fnord kernel: agp0: mem 0xf8000000-0xfbffffff at device 0.0 on pci0 Aug 23 03:37:55 fnord kernel: pcib1: at device 1.0 on pci0 Aug 23 03:37:55 fnord kernel: pci2: on pcib1 Aug 23 03:37:55 fnord kernel: pcib0: slot 1 INTA is routed to irq 11 Aug 23 03:37:55 fnord kernel: pcib1: slot 0 INTA is routed to irq 11 Aug 23 03:37:55 fnord kernel: nvidia0: mem 0xf2000000-0xf3ffffff,0xfd000000-0xfdffffff irq 11 at device 0.0 on pci2 Aug 23 03:37:55 fnord kernel: pcib2: at device 30.0 on pci0 Aug 23 03:37:55 fnord kernel: pci1: on pcib2 Aug 23 03:37:55 fnord kernel: pcib2: slot 9 INTA is routed to irq 3 Aug 23 03:37:55 fnord kernel: pcib2: slot 12 INTA is routed to irq 9 Aug 23 03:37:55 fnord kernel: xl0: <3Com 3c905C-TX Fast Etherlink XL> port 0xdc00-0xdc7f mem 0xfc9ff800-0xfc9ff87f irq 3 at device 9.0 on pci1 Aug 23 03:37:55 fnord kernel: xl0: Ethernet address: 00:01:03:23:9d:ba Aug 23 03:37:55 fnord kernel: miibus0: on xl0 Aug 23 03:37:55 fnord kernel: xlphy0: <3c905C 10/100 internal PHY> on miibus0 Aug 23 03:37:55 fnord kernel: xlphy0: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto Aug 23 03:37:55 fnord kernel: pcm0: port 0xdf00-0xdf3f irq 9 at device 12.0 on pci1 Aug 23 03:37:55 fnord kernel: pcm0: Aug 23 03:37:55 fnord kernel: isab0: at device 31.0 on pci0 Aug 23 03:37:55 fnord kernel: isa0: on isab0 Aug 23 03:37:55 fnord kernel: atapci0: port 0xffa0-0xffaf at device 31.1 on pci0 Aug 23 03:37:55 fnord kernel: ata0: at 0x1f0 irq 14 on atapci0 Aug 23 03:37:55 fnord kernel: ata0: [MPSAFE] Aug 23 03:37:55 fnord kernel: ata1: at 0x170 irq 15 on atapci0 Aug 23 03:37:55 fnord kernel: ata1: [MPSAFE] Aug 23 03:37:55 fnord kernel: uhci0: port 0xef80-0xef9f irq 10 at device 31.2 on pci0 Aug 23 03:37:55 fnord kernel: usb0: on uhci0 Aug 23 03:37:55 fnord kernel: usb0: USB revision 1.0 Aug 23 03:37:55 fnord kernel: uhub0: Intel UHCI root hub, class 9/0, rev 1.00/1.00, addr 1 Aug 23 03:37:55 fnord kernel: uhub0: 2 ports with 2 removable, self powered Aug 23 03:37:55 fnord kernel: ums0: Logitech USB-PS/2 Optical Mouse, rev 2.00/11.10, addr 2, iclass 3/1 Aug 23 03:37:55 fnord kernel: ums0: 3 buttons and Z dir. Aug 23 03:37:55 fnord kernel: pci0: at device 31.3 (no driver attached) Aug 23 03:37:55 fnord kernel: atkbdc0: port 0x64,0x60 irq 1 on acpi0 Aug 23 03:37:55 fnord kernel: atkbd0: flags 0x1 irq 1 on atkbdc0 Aug 23 03:37:55 fnord kernel: kbd0 at atkbd0 Aug 23 03:37:55 fnord kernel: fdc0: port 0x3f7,0x3f4-0x3f5,0x3f2-0x3f3,0x3f0-0x3f1 irq 6 drq 2 on acpi0 Aug 23 03:37:55 fnord kernel: fdc0: FIFO enabled, 8 bytes threshold Aug 23 03:37:55 fnord kernel: fd0: <1440-KB 3.5" drive> on fdc0 drive 0 Aug 23 03:37:55 fnord kernel: sio0 port 0x3f8-0x3ff irq 4 on acpi0 Aug 23 03:37:55 fnord kernel: sio0: type 16550A Aug 23 03:37:55 fnord kernel: ppc0 port 0x778-0x77f,0x378-0x37f irq 7 drq 3 on acpi0 Aug 23 03:37:55 fnord kernel: ppc0: SMC-like chipset (ECP/EPP/PS2/NIBBLE) in COMPATIBLE mode Aug 23 03:37:55 fnord kernel: ppc0: FIFO with 16/16/8 bytes threshold Aug 23 03:37:55 fnord kernel: ppbus0: on ppc0 Aug 23 03:37:55 fnord kernel: ppbus0: IEEE1284 device found /NIBBLE/ECP Aug 23 03:37:55 fnord kernel: Probing for PnP devices on ppbus0: Aug 23 03:37:55 fnord kernel: ppbus0: MLC,PCL,PML Aug 23 03:37:55 fnord kernel: plip0: on ppbus0 Aug 23 03:37:55 fnord kernel: lpt0: on ppbus0 Aug 23 03:37:55 fnord kernel: lpt0: Interrupt-driven port Aug 23 03:37:55 fnord kernel: ppi0: on ppbus0 Aug 23 03:37:55 fnord kernel: pmtimer0 on isa0 Aug 23 03:37:55 fnord kernel: sc0: at flags 0x100 on isa0 Aug 23 03:37:55 fnord kernel: sc0: VGA <16 virtual consoles, flags=0x300> Aug 23 03:37:55 fnord kernel: sio1: configured irq 3 not in bitmap of probed irqs 0 Aug 23 03:37:55 fnord kernel: sio1: port may not be enabled Aug 23 03:37:55 fnord kernel: vga0: at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0 Aug 23 03:37:55 fnord kernel: Timecounter "TSC" frequency 863866045 Hz quality 800 Aug 23 03:37:55 fnord kernel: Timecounters tick every 10.000 msec Aug 23 03:37:55 fnord kernel: GEOM: create disk ad0 dp=0xc31c3460 Aug 23 03:37:55 fnord kernel: ad0: 28629MB [58168/16/63] at ata0-master UDMA66 Aug 23 03:37:55 fnord kernel: GEOM: create disk ad1 dp=0xc31c3160 Aug 23 03:37:55 fnord kernel: ad1: 57220MB [116257/16/63] at ata0-slave UDMA100 Aug 23 03:37:55 fnord kernel: acd0: CDRW at ata1-master PIO4 Aug 23 03:37:55 fnord kernel: acd1: CDROM at ata1-slave PIO4 Aug 23 03:37:55 fnord kernel: Mounting root from ufs:/dev/ad0s1a Aug 23 03:37:55 fnord kernel: WARNING: / was not properly dismounted Aug 23 03:37:55 fnord kernel: WARNING: /tmp was not properly dismounted Aug 23 03:37:55 fnord kernel: WARNING: /usr was not properly dismounted Aug 23 03:37:55 fnord kernel: WARNING: /var was not properly dismounted Aug 23 03:37:55 fnord kernel: WARNING: /drv1 was not properly dismounted Aug 23 03:37:55 fnord kernel: /drv1: mount pending error: blocks 108 files 0 Aug 23 03:37:55 fnord savecore: no dumps found Aug 23 03:37:56 fnord lpd[417]: lpd startup: logging=0 net-secure Aug 23 03:38:02 fnord kernel: NVRM: detected agp.ko, aborting NVIDIA AGP setup! Aug 23 03:38:02 fnord kernel: NVRM: detected agp.ko, aborting NVIDIA AGP setup! Aug 23 03:39:01 fnord fsck: /dev/ad0s1e: 38 files, 66 used, 506421 free (37 frags, 63298 blocks, 0.0% fragmentation) /home/kevinb/crash# uname -a FreeBSD fnord.quux.edu 5.2.1-RELEASE-p9 FreeBSD 5.2.1-RELEASE-p9 #0: Sun Aug 22 14:00:38 EDT 2004 kevinb@fnord.quux.edu:/usr/obj/usr/src/sys/FOOKERN i386 /home/kevinb/crash# cat /usr/src/sys/i386/conf/DFOOKERN # # FOOKERN -- Desktop kernel configuration file for FreeBSD/i386 # # For more information on this file, please read the handbook section on # Kernel Configuration Files: # # http://www.FreeBSD.org/doc/en_US.ISO8859-1/books/handbook/kernelconfig-config.html # # The handbook is also available locally in /usr/share/doc/handbook # if you've installed the doc distribution, otherwise always see the # FreeBSD World Wide Web server (http://www.FreeBSD.org/) for the # latest information. # # An exhaustive list of options and more detailed explanations of the # device lines is also present in the ../../conf/NOTES and NOTES files. # If you are in doubt as to the purpose or necessity of a line, check first # in NOTES. # machine i386 cpu I686_CPU ident FOOKERN makeoptions DEBUG=-g options DDB options SCHED_4BSD #4BSD scheduler options INET #InterNETworking options FFS #Berkeley Fast Filesystem options SOFTUPDATES #Enable FFS soft updates support options UFS_ACL #Support for access control lists options UFS_DIRHASH #Improve performance on big directories options MD_ROOT #MD is a potential root device options NFSCLIENT #Network Filesystem Client options NFSSERVER #Network Filesystem Server options NFS_ROOT #NFS usable as /, requires NFSCLIENT options MSDOSFS #MSDOS Filesystem options CD9660 #ISO 9660 Filesystem options PROCFS #Process filesystem (requires PSEUDOFS) options PSEUDOFS #Pseudo-filesystem framework options COMPAT_43 #Compatible with BSD 4.3 [KEEP THIS!] options COMPAT_FREEBSD4 #Compatible with FreeBSD4 options KTRACE #ktrace(1) support options SYSVSHM #SYSV-style shared memory options SYSVMSG #SYSV-style message queues options SYSVSEM #SYSV-style semaphores options _KPOSIX_PRIORITY_SCHEDULING #Posix P1003_1B real-time extensions options KBD_INSTALL_CDEV # install a CDEV entry in /dev options AHC_REG_PRETTY_PRINT # Print register bitfields in debug # output. Adds ~128k to driver. options AHD_REG_PRETTY_PRINT # Print register bitfields in debug # output. Adds ~215k to driver. options PFIL_HOOKS # pfil(9) framework options INVARIANT_SUPPORT #Extra sanity checks of internal structures, required by INVARIANTS device isa device eisa device pci # Floppy drives device fdc # ATA and ATAPI devices device ata device atadisk # ATA disk drives device ataraid # ATA RAID drives device atapicd # ATAPI CDROM drives device atapifd # ATAPI floppy drives device atapist # ATAPI tape drives options ATA_STATIC_ID #Static device numbering # SCSI peripherals device scbus # SCSI bus (required for SCSI) # atkbdc0 controls both the keyboard and the PS/2 mouse device atkbdc # AT keyboard controller device atkbd # AT keyboard device psm # PS/2 mouse device vga # VGA video card driver device splash # Splash screen and screen saver support # syscons is the default console driver, resembling an SCO console device sc device agp # support several AGP chipsets # Floating point support - do not disable. device npx # Add suspend/resume support for the i8254. device pmtimer # PCCARD (PCMCIA) support # Pcmcia and cardbus bridge support device cbb # cardbus (yenta) bridge #device pcic # ExCA ISA and PCI bridges device pccard # PC Card (16-bit) bus device cardbus # CardBus (32-bit) bus # Serial (COM) ports device sio # 8250, 16[45]50 based serial ports # Parallel port device ppc device ppbus # Parallel port bus (required) device lpt # Printer device plip # TCP/IP over parallel device ppi # Parallel port interface device # PCI Ethernet NICs that use the common MII bus controller code. # NOTE: Be sure to keep the 'device miibus' line in order to use these NICs! device miibus # MII bus support device xl # 3Com 3c90x (``Boomerang'', ``Cyclone'') # Pseudo devices - the number indicates how many units to allocate. device random # Entropy device device loop # Network loopback device ether # Ethernet support device ppp # Kernel PPP device tun # Packet tunnel. device pty # Pseudo-ttys (telnet etc) device md # Memory "disks" device gif # IPv6 and IPv4 tunneling device faith # IPv6-to-IPv4 relaying (translation) # The `bpf' device enables the Berkeley Packet Filter. # Be aware of the administrative consequences of enabling this! device bpf # Berkeley packet filter # USB support device uhci # UHCI PCI->USB interface device ohci # OHCI PCI->USB interface device usb # USB Bus (required) device ugen # Generic device ums # Mouse device pcm /home/kevinb/crash# EXIT EXIT: Command not found. /home/kevinb/crash# exit exit Script done on Mon Aug 23 16:21:18 2004 --=-vpYO8kooTC9NnTLQkRkK--