Skip site navigation (1)Skip section navigation (2)
Date:      Thu, 22 Aug 2002 13:17:33 +0200
From:      "Patrick O'Reilly" <bsd@perimeter.co.za>
To:        "FreeBSD Question List" <freebsd-questions@freebsd.org>
Subject:   Re: ! Fatal trap 12: System Crash twice in last 2 days
Message-ID:  <02be01c249cd$856139a0$b50d030a@PATRICK>
References:  <025201c24833$3144f550$b50d030a@PATRICK>

next in thread | previous in thread | raw e-mail | index | archive | help
Gents,

OK - she's fallen over two more times overnight.

I have included below the output from gdb, following the prompting of
the onlamp article by Michael Lucas.  This is the first time I have ever
used gdb or anything like it, so please forgive me for stopping my
digging so quickly.

BTW: Michael Lucas suggests posting this info to hackers@freebsd.org.
Greg: Should I move this thread over to that list, or shall we pursue it
here?

Crash 0:
----------
Script started on Thu Aug 22 11:22:18 200
root obelix.perimeter.co.za:/var/crash# l
total 470394
drwxr-x---   2 root  wheel        512 Aug 22 11:22 .
drwxr-xr-x  23 root  wheel        512 Aug 11 21:36 ..
-rw-r--r--   1 root  wheel         43 Aug 22 11:22 20020822a
-rw-r--r--   1 root  wheel          2 Aug 22 09:05 bounds
-rw-r--r--   1 root  wheel    2322424 Aug 21 22:30 kernel.0
-rw-r--r--   1 root  wheel    2322424 Aug 22 09:05 kernel.1
-rwxr-xr-x   1 root  wheel    8926009 Aug 21 12:11
kernel.debug.200208211211
-rw-r--r--   1 root  wheel          5 Jan 28  2002 minfree
-rw-------   1 root  wheel  234799104 Aug 21 22:30 vmcore.0
-rw-------   1 root  wheel  234799104 Aug 22 09:05 vmcore.1
root obelix.perimeter.co.za:/var/crash# gdb -k kernel.debug.200208211211
vmcore.0
GNU gdb 4.18 (FreeBSD)
Copyright 1998 Free Software Foundation, Inc.
GDB is free software, covered by the GNU General Public License, and you
are
welcome to change it and/or distribute copies of it under certain
conditions.
Type "show copying" to see the conditions.
There is absolutely no warranty for GDB.  Type "show warranty" for
details.
This GDB was configured as "i386-unknown-freebsd"...
IdlePTD at phsyical address 0x00373000
initial pcb at physical address 0x002d9a60
panicstr: page fault
panic messages:
---
Fatal trap 12: page fault while in kernel mode
fault virtual address   = 0x0
fault code              = supervisor read, page not present
instruction pointer     = 0x8:0xc10bf75d
stack pointer           = 0x10:0xcc8c5b94
frame pointer           = 0x10:0xcc8c5ba8
code segment            = base 0x0, limit 0xfffff, type 0x1b
                        = DPL 0, pres 1, def32 1, gran 1
processor eflags        = interrupt enabled, resume, IOPL = 0
current process         = 12326 (rateup)
interrupt mask          = none
trap number             = 12
panic: page fault

syncing disks... 18 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1
giving up on 1 buffers
Uptime: 9h40m7s

dumping to dev #ad/0x20001, offset 1638560
dump ata0: resetting devices .. done
223 222 221 220 219 218 217 216 215 214 213 212 211 210 209 208 207 206
205 204 203 202 201 200 199 198 197 196 195 194 193 192 191 190 189 188
187 186 185 184 183 182 181 180 179 178 177 176 175 174 173 172 171 170
169 168 167 166 165 164 163 162 161 160 159 158 157 156 155 154 153 152
151 150 149 148 147 146 145 144 143 142 141 140 139 138 137 136 135 134
133 132 131 130 129 128 127 126 125 124 123 122 121 120 119 118 117 116
115 114 113 112 111 110 109 108 107 106 105 104 103 102 101 100 99 98 97
96 95 94 93 92 91 90 89 88 87 86 85 84 83 82 81 80 79 78 77 76 75 74 73
72 71 70 69 68 67 66 65 64 63 62 61 60 59 58 57 56 55 54 53 52 51 50 49
48 47 46 45 44 43 42 41 40 39 38 37 36 35 34 33 32 31 30 29 28 27 26 25
24 23 22 21 20 19 18 17 16 15 14 13 12 11 10 9 8 7 6 5 4 3 2 1 0
---
#0  dumpsys () at /usr/src/sys/kern/kern_shutdown.c:487
487             if (dumping++) {
(kgdb) where
#0  dumpsys () at /usr/src/sys/kern/kern_shutdown.c:487
#1  0xc0159b07 in boot (howto=256) at
/usr/src/sys/kern/kern_shutdown.c:316
#2  0xc0159f45 in panic (fmt=0xc02ac34c "%s") at
/usr/src/sys/kern/kern_shutdown.c:595
#3  0xc026e4f3 in trap_fatal (frame=0xcc8c5b54, eva=0) at
/usr/src/sys/i386/i386/trap.c:966
#4  0xc026e1a1 in trap_pfault (frame=0xcc8c5b54, usermode=0, eva=0) at
/usr/src/sys/i386/i386/trap.c:859
#5  0xc026dd47 in trap (frame={tf_fs = 16, tf_es = 16, tf_ds = 16,
tf_edi = -1053490176, tf_esi = 1, tf_ebp = -863216728,
      tf_isp = -863216768, tf_ebx = -1053683168, tf_edx = -1055428608,
tf_ecx = 0, tf_eax = 0, tf_trapno = 12, tf_err = 0,
      tf_eip = -1056180387, tf_cs = 8, tf_eflags = 66182, tf_esp
= -1055428608, tf_ss = -1055426560})
    at /usr/src/sys/i386/i386/trap.c:458
#6  0xc10bf75d in ?? ()
#7  0xc10bf582 in ?? ()
#8  0xc10bf3ea in ?? ()
#9  0xc019241c in spec_strategy (ap=0xcc8c5c2c) at
/usr/src/sys/miscfs/specfs/spec_vnops.c:479
#10 0xc0191e45 in spec_vnoperate (ap=0xcc8c5c2c) at
/usr/src/sys/miscfs/specfs/spec_vnops.c:119
#11 0xc0235f89 in ufs_vnoperatespec (ap=0xcc8c5c2c) at
/usr/src/sys/ufs/ufs/ufs_vnops.c:2440
#12 0xc017ef16 in bwrite (bp=0xc5907f38) at vnode_if.h:944
#13 0xc022598c in ffs_update (vp=0xccbd5f00, waitfor=1) at
/usr/src/sys/ufs/ffs/ffs_inode.c:114
#14 0xc0226114 in ffs_truncate (vp=0xccbd5f00, length=0, flags=0,
cred=0xc19f1380, p=0xcc872f60)
    at /usr/src/sys/ufs/ffs/ffs_inode.c:302
#15 0xc0233b32 in ufs_setattr (ap=0xcc8c5dfc) at
/usr/src/sys/ufs/ufs/ufs_vnops.c:509
#16 0xc0235f59 in ufs_vnoperate (ap=0xcc8c5dfc) at
/usr/src/sys/ufs/ufs/ufs_vnops.c:2422
#17 0xc018ddd6 in vn_open (ndp=0xcc8c5ec8, fmode=1026, cmode=420) at
vnode_if.h:305
#18 0xc0189d1c in open (p=0xcc872f60, uap=0xcc8c5f80) at
/usr/src/sys/kern/vfs_syscalls.c:1028
#19 0xc026e7a9 in syscall2 (frame={tf_fs = 47, tf_es = 47, tf_ds = 47,
tf_edi = 8, tf_esi = 672424736, tf_ebp = -1077937960,
      tf_isp = -863215660, tf_ebx = 672349540, tf_edx = 672424736,
tf_ecx = 16, tf_eax = 5, tf_trapno = 0, tf_err = 2,
      tf_eip = 672258228, tf_cs = 31, tf_eflags = 643, tf_esp
= -1077938004, tf_ss = 47}) at /usr/src/sys/i386/i386/trap.c:1167
#20 0xc025fb05 in Xint0x80_syscall ()
#21 0x804d91f in ?? ()
#22 0x8050e49 in ?? ()
#23 0x8048da9 in ?? ()
(kgdb) up9
Undefined command: "up9".  Try "help".
(kgdb) up 9
#9  0xc019241c in spec_strategy (ap=0xcc8c5c2c) at
/usr/src/sys/miscfs/specfs/spec_vnops.c:479
479             BUF_STRATEGY(bp, 0);
(kgdb) p bp
$1 = (struct buf *) 0x0
(kgdb)
----------

That's me out of ideas.  Now, here's  the second crash.

Crash 1:
----------
Script started on Thu Aug 22 13:05:48 200
root obelix.perimeter.co.za:/var/crash# gdb -k kernel.debug.200208211211
vmcore.1
GNU gdb 4.18 (FreeBSD)
Copyright 1998 Free Software Foundation, Inc.
GDB is free software, covered by the GNU General Public License, and you
are
welcome to change it and/or distribute copies of it under certain
conditions.
Type "show copying" to see the conditions.
There is absolutely no warranty for GDB.  Type "show warranty" for
details.
This GDB was configured as "i386-unknown-freebsd"...
IdlePTD at phsyical address 0x00373000
initial pcb at physical address 0x002d9a60
panicstr: page fault
panic messages:
---
Fatal trap 12: page fault while in kernel mode
fault virtual address   = 0x0
fault code              = supervisor read, page not present
instruction pointer     = 0x8:0xc10bf75d
stack pointer           = 0x10:0xcc8c5b94
frame pointer           = 0x10:0xcc8c5ba8
code segment            = base 0x0, limit 0xfffff, type 0x1b
                        = DPL 0, pres 1, def32 1, gran 1
processor eflags        = interrupt enabled, resume, IOPL = 0
current process         = 12326 (rateup)
interrupt mask          = none
trap number             = 12
panic: page fault

syncing disks... 18 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1
giving up on 1 buffers
Uptime: 9h40m7s

dumping to dev #ad/0x20001, offset 1638560
dump ata0: resetting devices .. done
223 222 221 220 219 218 217 216 215 214 213 212 211 210 209 208 207 206
205 204 203 202 201 200 199 198 197 196 195 194 193 192 191 190 189 188
187 186 185 184 183 182 181 180 179 178 177 176 175 174 173 172 171 170
169 168 167 166 165 164 163 162 161 160 159 158 157 156 155 154 153 152
151 150 149 148 147 146 145 144 143 142 141 140 139 138 137 136 135 134
133 132 131 130 129 128 127 126 125 124 123 122 121 120 119 118 117 116
115 114 113 112 111 110 109 108 107 106 105 104 103 102 101 100 99 98 97
96 95 94 93 92 91 90 89 88 87 86 85 84 83 82 81 80 79 78 77 76 75 74 73
72 71 70 69 68 67 66 65 64 63 62 61 60 59 58 57 56 55 54 53 52 51 50 49
48 47 46 45 44 43 42 41 40 39 38 37 36 35 34 33 32 31 30 29 28 27 26 25
24 23 22 21 20 19 18 17 16 15 14 13 12 11 10 9 8 7 6 5 4 3 2 1 0
Copyright (c) 1992-2002 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
        The Regents of the University of California. All rights
reserved.
FreeBSD 4.6.2-RELEASE #7: Wed Aug 21 12:11:11 SAST 2002
    peri@obelix.perimeter.co.za:/usr/obj/usr/src/sys/obelix
Timecounter "i8254"  frequency 1193182 Hz
CPU: AMD Athlon(TM) XP 1700+ (1470.01-MHz 686-class CPU)
  Origin = "AuthenticAMD"  Id = 0x662  Stepping = 2

Features=0x383fbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,
MCA,CMOV,PAT,PSE36,MMX,FXSR,SSE>
  AMD Features=0xc0400000<AMIE,DSP,3DNow!>
real memory  = 234799104 (229296K bytes)
avail memory = 224907264 (219636K bytes)
Preloaded elf kernel "kernel" at 0xc0354000.
Pentium Pro MTRR support enabled
md0: Malloc disk
Using $PIR table, 10 entries at 0xc00f2070
npx0: <math processor> on motherboard
npx0: INT 16 interface
pcib0: <Host to PCI bridge> on motherboard
pci0: <PCI bus> on pcib0
pci0: <unknown card> (vendor=0x10de, dev=0x01ac) at 0.1
pci0: <unknown card> (vendor=0x10de, dev=0x01ad) at 0.2
pci0: <unknown card> (vendor=0x10de, dev=0x01aa) at 0.3
isab0: <PCI to ISA bridge (vendor=10de device=01b2)> at device 1.0 on
pci0
isa0: <ISA bus> on isab0
pci0: <unknown card> (vendor=0x10de, dev=0x01b4) at 1.1 irq 5
pci0: <OHCI USB controller> at 2.0 irq 10
pci0: <OHCI USB controller> at 3.0 irq 10
pci0: <unknown card> (vendor=0x10de, dev=0x01c3) at 4.0 irq 10
pci0: <unknown card> (vendor=0x10de, dev=0x01b0) at 5.0 irq 5
pci0: <unknown card> (vendor=0x10de, dev=0x01b1) at 6.0 irq 11
pcib1: <PCI to PCI bridge (vendor=10de device=01b8)> at device 8.0 on
pci0
pci1: <PCI bus> on pcib1
dc0: <Accton EN2242 MiniPCI 10/100BaseTX> port 0xb800-0xb8ff mem
0xe4800000-0xe48003ff irq 5 at device 6.0 on pci1
dc0: Ethernet address: 08:00:08:00:08:00
miibus0: <MII bus> on dc0
ukphy0: <Generic IEEE 802.3u media interface> on miibus0
ukphy0:  10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto
atapci0: <nVIDIA nForce ATA100 controller> port 0xa800-0xa80f at device
9.0 on pci0
ata0: at 0x1f0 irq 14 on atapci0
ata1: at 0x170 irq 15 on atapci0
pcib2: <PCI to PCI bridge (vendor=10de device=01b7)> at device 30.0 on
pci0
pci2: <PCI bus> on pcib2
pci2: <NVidia model 01a0 graphics accelerator> at 0.0 irq 11
fdc0: <NEC 72065B or clone> at port 0x3f0-0x3f5,0x3f7 irq 6 drq 2 on
isa0
fdc0: FIFO enabled, 8 bytes threshold
fd0: <1440-KB 3.5" drive> on fdc0 drive 0
atkbdc0: <Keyboard controller (i8042)> at port 0x60,0x64 on isa0
vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on
isa0
sc0: <System console> at flags 0x100 on isa0
sc0: VGA <16 virtual consoles, flags=0x300>
sio0 at port 0x3f8-0x3ff irq 4 flags 0x10 on isa0
sio0: type 16550A
sio1 at port 0x2f8-0x2ff irq 3 on isa0
sio1: type 16550A
ppc0: <Parallel port> at port 0x378-0x37f irq 7 on isa0
ppc0: SMC-like chipset (ECP/EPP/PS2/NIBBLE) in COMPATIBLE mode
ppc0: FIFO with 16/16/9 bytes threshold
plip0: <PLIP network interface> on ppbus0
lpt0: <Printer> on ppbus0
lpt0: Interrupt-driven port
ppi0: <Parallel I/O> on ppbus0
IP packet filtering initialized, divert enabled, rule-based forwarding
enabled, default to deny, unlimited logging
DUMMYNET initialized (011031)
ad0: 19541MB <Maxtor 2B020H1> [39703/16/63] at ata0-master UDMA100
ad1: 39083MB <Maxtor 4D040H2> [79408/16/63] at ata0-slave UDMA100
ad2: 39083MB <Maxtor 4D040H2> [79408/16/63] at ata1-master UDMA100
Mounting root from ufs:/dev/ad0s1a
WARNING: / was not properly dismounted
ad2: UDMA ICRC error reading fsbn 0 (ad2 bn 0; cn 0 tn 0 sn 0) retrying
ad2: UDMA ICRC error reading fsbn 0 (ad2 bn 0; cn 0 tn 0 sn 0) retrying
ad2: UDMA ICRC error reading fsbn 0 (ad2 bn 0; cn 0 tn 0 sn 0) retrying
ad2: UDMA ICRC error reading fsbn 0 (ad2 bn 0; cn 0 tn 0 sn 0) falling
back to PIO mode
dc0: promiscuous mode enabled
dc0: TX underrun -- increasing TX threshold
dc0: watchdog timeout
dc0: TX underrun -- increasing TX threshold
dc0: watchdog timeout
dc0: TX underrun -- increasing TX threshold
dc0: watchdog timeout
dc0: TX underrun -- using store and forward mode


Fatal trap 12: page fault while in kernel mode
fault virtual address   = 0x0
fault code              = supervisor read, page not present
instruction pointer     = 0x8:0xc10bf75d
stack pointer           = 0x10:0xcc95fb34
frame pointer           = 0x10:0xcc95fb48
code segment            = base 0x0, limit 0xfffff, type 0x1b
                        = DPL 0, pres 1, def32 1, gran 1
processor eflags        = interrupt enabled, resume, IOPL = 0
current process         = 11514 (rateup)
interrupt mask          = none
trap number             = 12
panic: page fault

syncing disks... 138 84 25 7
done
Uptime: 10h33m24s

dumping to dev #ad/0x20001, offset 1638560
dump ata0: resetting devices .. done
223 222 221 220 219 218 217 216 215 214 213 212 211 210 209 208 207 206
205 204 203 202 201 200 199 198 197 196 195 194 193 192 191 190 189 188
187 186 185 184 183 182 181 180 179 178 177 176 175 174 173 172 171 170
169 168 167 166 165 164 163 162 161 160 159 158 157 156 155 154 153 152
151 150 149 148 147 146 145 144 143 142 141 140 139 138 137 136 135 134
133 132 131 130 129 128 127 126 125 124 123 122 121 120 119 118 117 116
115 114 113 112 111 110 109 108 107 106 105 104 103 102 101 100 99 98 97
96 95 94 93 92 91 90 89 88 87 86 85 84 83 82 81 80 79 78 77 76 75 74 73
72 71 70 69 68 67 66 65 64 63 62 61 60 59 58 57 56 55 54 53 52 51 50 49
48 47 46 45 44 43 42 41 40 39 38 37 36 35 34 33 32 31 30 29 28 27 26 25
24 23 22 21 20 19 18 17 16 15 14 13 12 11 10 9 8 7 6 5 4 3 2 1 0
---
#0  dumpsys () at /usr/src/sys/kern/kern_shutdown.c:487
487             if (dumping++) {
(kgdb) where
#0  dumpsys () at /usr/src/sys/kern/kern_shutdown.c:487
#1  0xc0159b07 in boot (howto=256) at
/usr/src/sys/kern/kern_shutdown.c:316
#2  0xc0159f45 in panic (fmt=0xc02ac34c "%s") at
/usr/src/sys/kern/kern_shutdown.c:595
#3  0xc026e4f3 in trap_fatal (frame=0xcc95faf4, eva=0) at
/usr/src/sys/i386/i386/trap.c:966
#4  0xc026e1a1 in trap_pfault (frame=0xcc95faf4, usermode=0, eva=0) at
/usr/src/sys/i386/i386/trap.c:859
#5  0xc026dd47 in trap (frame={tf_fs = 16, tf_es = 16, tf_ds = 16,
tf_edi = -1053663232, tf_esi = 1, tf_ebp = -862586040,
      tf_isp = -862586080, tf_ebx = -1050352096, tf_edx = -1055428608,
tf_ecx = 0, tf_eax = 0, tf_trapno = 12, tf_err = 0,
      tf_eip = -1056180387, tf_cs = 8, tf_eflags = 66182, tf_esp
= -1055428608, tf_ss = -1055426560}) at
/usr/src/sys/i386/i386/trap.c:458
#6  0xc10bf75d in ?? ()
#7  0xc10bf582 in ?? ()
#8  0xc10bf3ea in ?? ()
#9  0xc019241c in spec_strategy (ap=0xcc95fbc8) at
/usr/src/sys/miscfs/specfs/spec_vnops.c:479
#10 0xc0191e45 in spec_vnoperate (ap=0xcc95fbc8) at
/usr/src/sys/miscfs/specfs/spec_vnops.c:119
#11 0xc0235f89 in ufs_vnoperatespec (ap=0xcc95fbc8) at
/usr/src/sys/ufs/ufs/ufs_vnops.c:2440
#12 0xc0235889 in ufs_strategy (ap=0xcc95fc0c) at vnode_if.h:944
#13 0xc0235f59 in ufs_vnoperate (ap=0xcc95fc0c) at
/usr/src/sys/ufs/ufs/ufs_vnops.c:2422
#14 0xc017ef16 in bwrite (bp=0xc5919c88) at vnode_if.h:944
#15 0xc018463e in vop_stdbwrite (ap=0xcc95fc48) at
/usr/src/sys/kern/vfs_default.c:331
#16 0xc0184499 in vop_defaultop (ap=0xcc95fc48) at
/usr/src/sys/kern/vfs_default.c:150
#17 0xc0235f59 in ufs_vnoperate (ap=0xcc95fc48) at
/usr/src/sys/ufs/ufs/ufs_vnops.c:2422
#18 0xc017f29d in bowrite (bp=0xc5919c88) at vnode_if.h:1193
#19 0xc0231d24 in ufs_direnter (dvp=0xcccda100, tvp=0x0,
dirp=0xcc95fd38, cnp=0xcc95fec0, newdirbp=0x0)
    at /usr/src/sys/ufs/ufs/ufs_lookup.c:934
#20 0xc0234841 in ufs_rename (ap=0xcc95fe68) at
/usr/src/sys/ufs/ufs/ufs_vnops.c:1105
#21 0xc0235f59 in ufs_vnoperate (ap=0xcc95fe68) at
/usr/src/sys/ufs/ufs/ufs_vnops.c:2422
#22 0xc018c2e3 in rename (p=0xcc877be0, uap=0xcc95ff80) at
vnode_if.h:645
#23 0xc026e7a9 in syscall2 (frame={tf_fs = 47, tf_es = 47, tf_ds = 47,
tf_edi = 961113600, tf_esi = -1077937620, tf_ebp = -1077937364,
      tf_isp = -862584876, tf_ebx = -1077937492, tf_edx = 672426264,
tf_ecx = 134811648, tf_eax = 128, tf_trapno = 0, tf_err = 2,
      tf_eip = 672036076, tf_cs = 31, tf_eflags = 647, tf_esp
= -1077938032, tf_ss = 47}) at /usr/src/sys/i386/i386/trap.c:1167
#24 0xc025fb05 in Xint0x80_syscall ()
#25 0x8050f7f in ?? ()
#26 0x8048da9 in ?? ()
(kgdb) up 9
#9  0xc019241c in spec_strategy (ap=0xcc95fbc8) at
/usr/src/sys/miscfs/specfs/spec_vnops.c:479
479             BUF_STRATEGY(bp, 0);
(kgdb) p bp
$1 = (struct buf *) 0x0
(kgdb) q

----------

OK - I don't understand much of this - but I do see that the problem
occured in the same place both times.  I assume that must be a small
glimmer of good news???  I'm also curious about the lines #5, #6 and #7
before the trap... Why are there no details there?

Anyway - I hope someone more intelligent will be able to make something
of this.

Regards,
Patrick O'Reilly.
    ___        _            __
   / _ )__ __ (_)_ __ ___ _/ /____ __
  / __/ -_) _) /  ~  ) -_), ,-/ -_) _)
 /_/  \__/_//_/_/~/_/\__/ \__/\__/_/
    http://www.perimeter.co.za



To Unsubscribe: send mail to majordomo@FreeBSD.org
with "unsubscribe freebsd-questions" in the body of the message




Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?02be01c249cd$856139a0$b50d030a>