From owner-freebsd-questions Thu Aug 22 4:16:38 2002 Delivered-To: freebsd-questions@freebsd.org Received: from mx1.FreeBSD.org (mx1.FreeBSD.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 79C2837B401 for ; Thu, 22 Aug 2002 04:16:24 -0700 (PDT) Received: from perimeter.co.za (obelix.perimeter.co.za [209.212.102.154]) by mx1.FreeBSD.org (Postfix) with ESMTP id 032B643E75 for ; Thu, 22 Aug 2002 04:16:13 -0700 (PDT) (envelope-from bsd@perimeter.co.za) Received: from PATRICK (gateway.mip.co.za [209.212.102.245]) (AUTH: LOGIN bsd@perimeter.co.za) by perimeter.co.za with esmtp; Thu, 22 Aug 2002 13:16:04 +0200 Message-ID: <02be01c249cd$856139a0$b50d030a@PATRICK> From: "Patrick O'Reilly" To: "FreeBSD Question List" References: <025201c24833$3144f550$b50d030a@PATRICK> Subject: Re: ! Fatal trap 12: System Crash twice in last 2 days Date: Thu, 22 Aug 2002 13:17:33 +0200 MIME-Version: 1.0 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: 7bit X-Priority: 3 X-MSMail-Priority: Normal X-Mailer: Microsoft Outlook Express 5.50.4522.1200 X-MIMEOLE: Produced By Microsoft MimeOLE V5.50.4522.1200 Sender: owner-freebsd-questions@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.ORG Gents, OK - she's fallen over two more times overnight. I have included below the output from gdb, following the prompting of the onlamp article by Michael Lucas. This is the first time I have ever used gdb or anything like it, so please forgive me for stopping my digging so quickly. BTW: Michael Lucas suggests posting this info to hackers@freebsd.org. Greg: Should I move this thread over to that list, or shall we pursue it here? Crash 0: ---------- Script started on Thu Aug 22 11:22:18 200 root obelix.perimeter.co.za:/var/crash# l total 470394 drwxr-x--- 2 root wheel 512 Aug 22 11:22 . drwxr-xr-x 23 root wheel 512 Aug 11 21:36 .. -rw-r--r-- 1 root wheel 43 Aug 22 11:22 20020822a -rw-r--r-- 1 root wheel 2 Aug 22 09:05 bounds -rw-r--r-- 1 root wheel 2322424 Aug 21 22:30 kernel.0 -rw-r--r-- 1 root wheel 2322424 Aug 22 09:05 kernel.1 -rwxr-xr-x 1 root wheel 8926009 Aug 21 12:11 kernel.debug.200208211211 -rw-r--r-- 1 root wheel 5 Jan 28 2002 minfree -rw------- 1 root wheel 234799104 Aug 21 22:30 vmcore.0 -rw------- 1 root wheel 234799104 Aug 22 09:05 vmcore.1 root obelix.perimeter.co.za:/var/crash# gdb -k kernel.debug.200208211211 vmcore.0 GNU gdb 4.18 (FreeBSD) Copyright 1998 Free Software Foundation, Inc. GDB is free software, covered by the GNU General Public License, and you are welcome to change it and/or distribute copies of it under certain conditions. Type "show copying" to see the conditions. There is absolutely no warranty for GDB. Type "show warranty" for details. This GDB was configured as "i386-unknown-freebsd"... IdlePTD at phsyical address 0x00373000 initial pcb at physical address 0x002d9a60 panicstr: page fault panic messages: --- Fatal trap 12: page fault while in kernel mode fault virtual address = 0x0 fault code = supervisor read, page not present instruction pointer = 0x8:0xc10bf75d stack pointer = 0x10:0xcc8c5b94 frame pointer = 0x10:0xcc8c5ba8 code segment = base 0x0, limit 0xfffff, type 0x1b = DPL 0, pres 1, def32 1, gran 1 processor eflags = interrupt enabled, resume, IOPL = 0 current process = 12326 (rateup) interrupt mask = none trap number = 12 panic: page fault syncing disks... 18 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 giving up on 1 buffers Uptime: 9h40m7s dumping to dev #ad/0x20001, offset 1638560 dump ata0: resetting devices .. done 223 222 221 220 219 218 217 216 215 214 213 212 211 210 209 208 207 206 205 204 203 202 201 200 199 198 197 196 195 194 193 192 191 190 189 188 187 186 185 184 183 182 181 180 179 178 177 176 175 174 173 172 171 170 169 168 167 166 165 164 163 162 161 160 159 158 157 156 155 154 153 152 151 150 149 148 147 146 145 144 143 142 141 140 139 138 137 136 135 134 133 132 131 130 129 128 127 126 125 124 123 122 121 120 119 118 117 116 115 114 113 112 111 110 109 108 107 106 105 104 103 102 101 100 99 98 97 96 95 94 93 92 91 90 89 88 87 86 85 84 83 82 81 80 79 78 77 76 75 74 73 72 71 70 69 68 67 66 65 64 63 62 61 60 59 58 57 56 55 54 53 52 51 50 49 48 47 46 45 44 43 42 41 40 39 38 37 36 35 34 33 32 31 30 29 28 27 26 25 24 23 22 21 20 19 18 17 16 15 14 13 12 11 10 9 8 7 6 5 4 3 2 1 0 --- #0 dumpsys () at /usr/src/sys/kern/kern_shutdown.c:487 487 if (dumping++) { (kgdb) where #0 dumpsys () at /usr/src/sys/kern/kern_shutdown.c:487 #1 0xc0159b07 in boot (howto=256) at /usr/src/sys/kern/kern_shutdown.c:316 #2 0xc0159f45 in panic (fmt=0xc02ac34c "%s") at /usr/src/sys/kern/kern_shutdown.c:595 #3 0xc026e4f3 in trap_fatal (frame=0xcc8c5b54, eva=0) at /usr/src/sys/i386/i386/trap.c:966 #4 0xc026e1a1 in trap_pfault (frame=0xcc8c5b54, usermode=0, eva=0) at /usr/src/sys/i386/i386/trap.c:859 #5 0xc026dd47 in trap (frame={tf_fs = 16, tf_es = 16, tf_ds = 16, tf_edi = -1053490176, tf_esi = 1, tf_ebp = -863216728, tf_isp = -863216768, tf_ebx = -1053683168, tf_edx = -1055428608, tf_ecx = 0, tf_eax = 0, tf_trapno = 12, tf_err = 0, tf_eip = -1056180387, tf_cs = 8, tf_eflags = 66182, tf_esp = -1055428608, tf_ss = -1055426560}) at /usr/src/sys/i386/i386/trap.c:458 #6 0xc10bf75d in ?? () #7 0xc10bf582 in ?? () #8 0xc10bf3ea in ?? () #9 0xc019241c in spec_strategy (ap=0xcc8c5c2c) at /usr/src/sys/miscfs/specfs/spec_vnops.c:479 #10 0xc0191e45 in spec_vnoperate (ap=0xcc8c5c2c) at /usr/src/sys/miscfs/specfs/spec_vnops.c:119 #11 0xc0235f89 in ufs_vnoperatespec (ap=0xcc8c5c2c) at /usr/src/sys/ufs/ufs/ufs_vnops.c:2440 #12 0xc017ef16 in bwrite (bp=0xc5907f38) at vnode_if.h:944 #13 0xc022598c in ffs_update (vp=0xccbd5f00, waitfor=1) at /usr/src/sys/ufs/ffs/ffs_inode.c:114 #14 0xc0226114 in ffs_truncate (vp=0xccbd5f00, length=0, flags=0, cred=0xc19f1380, p=0xcc872f60) at /usr/src/sys/ufs/ffs/ffs_inode.c:302 #15 0xc0233b32 in ufs_setattr (ap=0xcc8c5dfc) at /usr/src/sys/ufs/ufs/ufs_vnops.c:509 #16 0xc0235f59 in ufs_vnoperate (ap=0xcc8c5dfc) at /usr/src/sys/ufs/ufs/ufs_vnops.c:2422 #17 0xc018ddd6 in vn_open (ndp=0xcc8c5ec8, fmode=1026, cmode=420) at vnode_if.h:305 #18 0xc0189d1c in open (p=0xcc872f60, uap=0xcc8c5f80) at /usr/src/sys/kern/vfs_syscalls.c:1028 #19 0xc026e7a9 in syscall2 (frame={tf_fs = 47, tf_es = 47, tf_ds = 47, tf_edi = 8, tf_esi = 672424736, tf_ebp = -1077937960, tf_isp = -863215660, tf_ebx = 672349540, tf_edx = 672424736, tf_ecx = 16, tf_eax = 5, tf_trapno = 0, tf_err = 2, tf_eip = 672258228, tf_cs = 31, tf_eflags = 643, tf_esp = -1077938004, tf_ss = 47}) at /usr/src/sys/i386/i386/trap.c:1167 #20 0xc025fb05 in Xint0x80_syscall () #21 0x804d91f in ?? () #22 0x8050e49 in ?? () #23 0x8048da9 in ?? () (kgdb) up9 Undefined command: "up9". Try "help". (kgdb) up 9 #9 0xc019241c in spec_strategy (ap=0xcc8c5c2c) at /usr/src/sys/miscfs/specfs/spec_vnops.c:479 479 BUF_STRATEGY(bp, 0); (kgdb) p bp $1 = (struct buf *) 0x0 (kgdb) ---------- That's me out of ideas. Now, here's the second crash. Crash 1: ---------- Script started on Thu Aug 22 13:05:48 200 root obelix.perimeter.co.za:/var/crash# gdb -k kernel.debug.200208211211 vmcore.1 GNU gdb 4.18 (FreeBSD) Copyright 1998 Free Software Foundation, Inc. GDB is free software, covered by the GNU General Public License, and you are welcome to change it and/or distribute copies of it under certain conditions. Type "show copying" to see the conditions. There is absolutely no warranty for GDB. Type "show warranty" for details. This GDB was configured as "i386-unknown-freebsd"... IdlePTD at phsyical address 0x00373000 initial pcb at physical address 0x002d9a60 panicstr: page fault panic messages: --- Fatal trap 12: page fault while in kernel mode fault virtual address = 0x0 fault code = supervisor read, page not present instruction pointer = 0x8:0xc10bf75d stack pointer = 0x10:0xcc8c5b94 frame pointer = 0x10:0xcc8c5ba8 code segment = base 0x0, limit 0xfffff, type 0x1b = DPL 0, pres 1, def32 1, gran 1 processor eflags = interrupt enabled, resume, IOPL = 0 current process = 12326 (rateup) interrupt mask = none trap number = 12 panic: page fault syncing disks... 18 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 giving up on 1 buffers Uptime: 9h40m7s dumping to dev #ad/0x20001, offset 1638560 dump ata0: resetting devices .. done 223 222 221 220 219 218 217 216 215 214 213 212 211 210 209 208 207 206 205 204 203 202 201 200 199 198 197 196 195 194 193 192 191 190 189 188 187 186 185 184 183 182 181 180 179 178 177 176 175 174 173 172 171 170 169 168 167 166 165 164 163 162 161 160 159 158 157 156 155 154 153 152 151 150 149 148 147 146 145 144 143 142 141 140 139 138 137 136 135 134 133 132 131 130 129 128 127 126 125 124 123 122 121 120 119 118 117 116 115 114 113 112 111 110 109 108 107 106 105 104 103 102 101 100 99 98 97 96 95 94 93 92 91 90 89 88 87 86 85 84 83 82 81 80 79 78 77 76 75 74 73 72 71 70 69 68 67 66 65 64 63 62 61 60 59 58 57 56 55 54 53 52 51 50 49 48 47 46 45 44 43 42 41 40 39 38 37 36 35 34 33 32 31 30 29 28 27 26 25 24 23 22 21 20 19 18 17 16 15 14 13 12 11 10 9 8 7 6 5 4 3 2 1 0 Copyright (c) 1992-2002 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD 4.6.2-RELEASE #7: Wed Aug 21 12:11:11 SAST 2002 peri@obelix.perimeter.co.za:/usr/obj/usr/src/sys/obelix Timecounter "i8254" frequency 1193182 Hz CPU: AMD Athlon(TM) XP 1700+ (1470.01-MHz 686-class CPU) Origin = "AuthenticAMD" Id = 0x662 Stepping = 2 Features=0x383fbff AMD Features=0xc0400000 real memory = 234799104 (229296K bytes) avail memory = 224907264 (219636K bytes) Preloaded elf kernel "kernel" at 0xc0354000. Pentium Pro MTRR support enabled md0: Malloc disk Using $PIR table, 10 entries at 0xc00f2070 npx0: on motherboard npx0: INT 16 interface pcib0: on motherboard pci0: on pcib0 pci0: (vendor=0x10de, dev=0x01ac) at 0.1 pci0: (vendor=0x10de, dev=0x01ad) at 0.2 pci0: (vendor=0x10de, dev=0x01aa) at 0.3 isab0: at device 1.0 on pci0 isa0: on isab0 pci0: (vendor=0x10de, dev=0x01b4) at 1.1 irq 5 pci0: at 2.0 irq 10 pci0: at 3.0 irq 10 pci0: (vendor=0x10de, dev=0x01c3) at 4.0 irq 10 pci0: (vendor=0x10de, dev=0x01b0) at 5.0 irq 5 pci0: (vendor=0x10de, dev=0x01b1) at 6.0 irq 11 pcib1: at device 8.0 on pci0 pci1: on pcib1 dc0: port 0xb800-0xb8ff mem 0xe4800000-0xe48003ff irq 5 at device 6.0 on pci1 dc0: Ethernet address: 08:00:08:00:08:00 miibus0: on dc0 ukphy0: on miibus0 ukphy0: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto atapci0: port 0xa800-0xa80f at device 9.0 on pci0 ata0: at 0x1f0 irq 14 on atapci0 ata1: at 0x170 irq 15 on atapci0 pcib2: at device 30.0 on pci0 pci2: on pcib2 pci2: at 0.0 irq 11 fdc0: at port 0x3f0-0x3f5,0x3f7 irq 6 drq 2 on isa0 fdc0: FIFO enabled, 8 bytes threshold fd0: <1440-KB 3.5" drive> on fdc0 drive 0 atkbdc0: at port 0x60,0x64 on isa0 vga0: at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0 sc0: at flags 0x100 on isa0 sc0: VGA <16 virtual consoles, flags=0x300> sio0 at port 0x3f8-0x3ff irq 4 flags 0x10 on isa0 sio0: type 16550A sio1 at port 0x2f8-0x2ff irq 3 on isa0 sio1: type 16550A ppc0: at port 0x378-0x37f irq 7 on isa0 ppc0: SMC-like chipset (ECP/EPP/PS2/NIBBLE) in COMPATIBLE mode ppc0: FIFO with 16/16/9 bytes threshold plip0: on ppbus0 lpt0: on ppbus0 lpt0: Interrupt-driven port ppi0: on ppbus0 IP packet filtering initialized, divert enabled, rule-based forwarding enabled, default to deny, unlimited logging DUMMYNET initialized (011031) ad0: 19541MB [39703/16/63] at ata0-master UDMA100 ad1: 39083MB [79408/16/63] at ata0-slave UDMA100 ad2: 39083MB [79408/16/63] at ata1-master UDMA100 Mounting root from ufs:/dev/ad0s1a WARNING: / was not properly dismounted ad2: UDMA ICRC error reading fsbn 0 (ad2 bn 0; cn 0 tn 0 sn 0) retrying ad2: UDMA ICRC error reading fsbn 0 (ad2 bn 0; cn 0 tn 0 sn 0) retrying ad2: UDMA ICRC error reading fsbn 0 (ad2 bn 0; cn 0 tn 0 sn 0) retrying ad2: UDMA ICRC error reading fsbn 0 (ad2 bn 0; cn 0 tn 0 sn 0) falling back to PIO mode dc0: promiscuous mode enabled dc0: TX underrun -- increasing TX threshold dc0: watchdog timeout dc0: TX underrun -- increasing TX threshold dc0: watchdog timeout dc0: TX underrun -- increasing TX threshold dc0: watchdog timeout dc0: TX underrun -- using store and forward mode Fatal trap 12: page fault while in kernel mode fault virtual address = 0x0 fault code = supervisor read, page not present instruction pointer = 0x8:0xc10bf75d stack pointer = 0x10:0xcc95fb34 frame pointer = 0x10:0xcc95fb48 code segment = base 0x0, limit 0xfffff, type 0x1b = DPL 0, pres 1, def32 1, gran 1 processor eflags = interrupt enabled, resume, IOPL = 0 current process = 11514 (rateup) interrupt mask = none trap number = 12 panic: page fault syncing disks... 138 84 25 7 done Uptime: 10h33m24s dumping to dev #ad/0x20001, offset 1638560 dump ata0: resetting devices .. done 223 222 221 220 219 218 217 216 215 214 213 212 211 210 209 208 207 206 205 204 203 202 201 200 199 198 197 196 195 194 193 192 191 190 189 188 187 186 185 184 183 182 181 180 179 178 177 176 175 174 173 172 171 170 169 168 167 166 165 164 163 162 161 160 159 158 157 156 155 154 153 152 151 150 149 148 147 146 145 144 143 142 141 140 139 138 137 136 135 134 133 132 131 130 129 128 127 126 125 124 123 122 121 120 119 118 117 116 115 114 113 112 111 110 109 108 107 106 105 104 103 102 101 100 99 98 97 96 95 94 93 92 91 90 89 88 87 86 85 84 83 82 81 80 79 78 77 76 75 74 73 72 71 70 69 68 67 66 65 64 63 62 61 60 59 58 57 56 55 54 53 52 51 50 49 48 47 46 45 44 43 42 41 40 39 38 37 36 35 34 33 32 31 30 29 28 27 26 25 24 23 22 21 20 19 18 17 16 15 14 13 12 11 10 9 8 7 6 5 4 3 2 1 0 --- #0 dumpsys () at /usr/src/sys/kern/kern_shutdown.c:487 487 if (dumping++) { (kgdb) where #0 dumpsys () at /usr/src/sys/kern/kern_shutdown.c:487 #1 0xc0159b07 in boot (howto=256) at /usr/src/sys/kern/kern_shutdown.c:316 #2 0xc0159f45 in panic (fmt=0xc02ac34c "%s") at /usr/src/sys/kern/kern_shutdown.c:595 #3 0xc026e4f3 in trap_fatal (frame=0xcc95faf4, eva=0) at /usr/src/sys/i386/i386/trap.c:966 #4 0xc026e1a1 in trap_pfault (frame=0xcc95faf4, usermode=0, eva=0) at /usr/src/sys/i386/i386/trap.c:859 #5 0xc026dd47 in trap (frame={tf_fs = 16, tf_es = 16, tf_ds = 16, tf_edi = -1053663232, tf_esi = 1, tf_ebp = -862586040, tf_isp = -862586080, tf_ebx = -1050352096, tf_edx = -1055428608, tf_ecx = 0, tf_eax = 0, tf_trapno = 12, tf_err = 0, tf_eip = -1056180387, tf_cs = 8, tf_eflags = 66182, tf_esp = -1055428608, tf_ss = -1055426560}) at /usr/src/sys/i386/i386/trap.c:458 #6 0xc10bf75d in ?? () #7 0xc10bf582 in ?? () #8 0xc10bf3ea in ?? () #9 0xc019241c in spec_strategy (ap=0xcc95fbc8) at /usr/src/sys/miscfs/specfs/spec_vnops.c:479 #10 0xc0191e45 in spec_vnoperate (ap=0xcc95fbc8) at /usr/src/sys/miscfs/specfs/spec_vnops.c:119 #11 0xc0235f89 in ufs_vnoperatespec (ap=0xcc95fbc8) at /usr/src/sys/ufs/ufs/ufs_vnops.c:2440 #12 0xc0235889 in ufs_strategy (ap=0xcc95fc0c) at vnode_if.h:944 #13 0xc0235f59 in ufs_vnoperate (ap=0xcc95fc0c) at /usr/src/sys/ufs/ufs/ufs_vnops.c:2422 #14 0xc017ef16 in bwrite (bp=0xc5919c88) at vnode_if.h:944 #15 0xc018463e in vop_stdbwrite (ap=0xcc95fc48) at /usr/src/sys/kern/vfs_default.c:331 #16 0xc0184499 in vop_defaultop (ap=0xcc95fc48) at /usr/src/sys/kern/vfs_default.c:150 #17 0xc0235f59 in ufs_vnoperate (ap=0xcc95fc48) at /usr/src/sys/ufs/ufs/ufs_vnops.c:2422 #18 0xc017f29d in bowrite (bp=0xc5919c88) at vnode_if.h:1193 #19 0xc0231d24 in ufs_direnter (dvp=0xcccda100, tvp=0x0, dirp=0xcc95fd38, cnp=0xcc95fec0, newdirbp=0x0) at /usr/src/sys/ufs/ufs/ufs_lookup.c:934 #20 0xc0234841 in ufs_rename (ap=0xcc95fe68) at /usr/src/sys/ufs/ufs/ufs_vnops.c:1105 #21 0xc0235f59 in ufs_vnoperate (ap=0xcc95fe68) at /usr/src/sys/ufs/ufs/ufs_vnops.c:2422 #22 0xc018c2e3 in rename (p=0xcc877be0, uap=0xcc95ff80) at vnode_if.h:645 #23 0xc026e7a9 in syscall2 (frame={tf_fs = 47, tf_es = 47, tf_ds = 47, tf_edi = 961113600, tf_esi = -1077937620, tf_ebp = -1077937364, tf_isp = -862584876, tf_ebx = -1077937492, tf_edx = 672426264, tf_ecx = 134811648, tf_eax = 128, tf_trapno = 0, tf_err = 2, tf_eip = 672036076, tf_cs = 31, tf_eflags = 647, tf_esp = -1077938032, tf_ss = 47}) at /usr/src/sys/i386/i386/trap.c:1167 #24 0xc025fb05 in Xint0x80_syscall () #25 0x8050f7f in ?? () #26 0x8048da9 in ?? () (kgdb) up 9 #9 0xc019241c in spec_strategy (ap=0xcc95fbc8) at /usr/src/sys/miscfs/specfs/spec_vnops.c:479 479 BUF_STRATEGY(bp, 0); (kgdb) p bp $1 = (struct buf *) 0x0 (kgdb) q ---------- OK - I don't understand much of this - but I do see that the problem occured in the same place both times. I assume that must be a small glimmer of good news??? I'm also curious about the lines #5, #6 and #7 before the trap... Why are there no details there? Anyway - I hope someone more intelligent will be able to make something of this. Regards, Patrick O'Reilly. ___ _ __ / _ )__ __ (_)_ __ ___ _/ /____ __ / __/ -_) _) / ~ ) -_), ,-/ -_) _) /_/ \__/_//_/_/~/_/\__/ \__/\__/_/ http://www.perimeter.co.za To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-questions" in the body of the message