Date: Mon, 15 Aug 2011 15:56:27 +0100 From: "Steven Hartland" <killing@multiplay.co.uk> To: "Andriy Gapon" <avg@FreeBSD.org> Cc: freebsd-stable@FreeBSD.org Subject: Re: debugging frequent kernel panics on 8.2-RELEASE Message-ID: <570C5495A5E242F7946E806CA7AC5D68@multiplay.co.uk> References: <47F0D04ADF034695BC8B0AC166553371@multiplay.co.uk><A71C3ACF01EC4D36871E49805C1A5321@multiplay.co.uk><4E4380C0.7070908@FreeBSD.org><EBC06A239BAB4B3293C28D793329F9CA@multiplay.co.uk> <4E43E272.1060204@FreeBSD.org> <62BF25D0ED914876BEE75E2ADF28DDF7@multiplay.co.uk> <4E440865.1040500@FreeBSD.org> <6F08A8DE780545ADB9FA93B0A8AA4DA1@multiplay.co.uk> <4E441314.6060606@FreeBSD.org> <2C4B0D05C8924F24A73B56EA652FA4B0@multiplay.co.uk> <4E48D967.9060804@FreeBSD.org> <9D034F992B064E8092E5D1D249B3E959@multiplay.co.uk> <4E490DAF.1080009@FreeBSD.org> <796FD5A096DE4558B57338A8FA1E125B@multiplay.co.uk> <4E491D01.1090902@FreeBSD.org>
next in thread | previous in thread | raw e-mail | index | archive | help
----- Original Message -----
From: "Andriy Gapon" <avg@FreeBSD.org>
To: "Steven Hartland" <killing@multiplay.co.uk>
Cc: <freebsd-stable@FreeBSD.org>
Sent: Monday, August 15, 2011 2:20 PM
Subject: Re: debugging frequent kernel panics on 8.2-RELEASE
> on 15/08/2011 15:51 Steven Hartland said the following:
>> ----- Original Message ----- From: "Andriy Gapon" <avg@FreeBSD.org>
>>
>>
>>> on 15/08/2011 13:34 Steven Hartland said the following:
>>>> (kgdb) list *0xffffffff8053b691
>>>> 0xffffffff8053b691 is in vm_fault (/usr/src/sys/vm/vm_fault.c:239).
>>>> 234 /*
>>>> 235 * Find the backing store object and offset into it to begin the
>>>> 236 * search.
>>>> 237 */
>>>> 238 fs.map = map;
>>>> 239 result = vm_map_lookup(&fs.map, vaddr, fault_type, &fs.entry,
>>>> 240 &fs.first_object, &fs.first_pindex, &prot, &wired);
>>>> 241 if (result != KERN_SUCCESS) {
>>>> 242 if (result != KERN_PROTECTION_FAILURE ||
>>>> 243 (fault_flags & VM_FAULT_WIRE_MASK) !=
>>>> VM_FAULT_USER_WIRE) {
>>>>
>>>
>>> Interesting... thanks!
>>> Can you please also additionally provide (lengthy) output of x/512a
>>> 0xffffff8d8f356fb0 ?
>>
>> Sorry I'm not sure I follow your their?
>
> It seems that you got me correctly :)
>
>> Do you mean any of the following:-
>> (kgdb) x/512a
>> 0xffffff8d8f35b000: Cannot access memory at address 0xffffff8d8f35b000
>>
>> (kgdb) list *0xffffff8d8f356fb0
>> No source file for address 0xffffff8d8f356fb0.
>>
>> or:
>> (kgdb) x/512a 0xffffff8d8f356fb0
>> 0xffffff8d8f356fb0: Cannot access memory at address 0xffffff8d8f356fb0
>
> Can you please try this (the last command) with 0xffffff8d8f357210 instead?
(kgdb) x/512a 0xffffff8d8f357210
0xffffff8d8f357210: 0xffffff8d8f357280 0xffffffff805807d3 <trap_pfault+307>
0xffffff8d8f357220: 0x0 0xffffff8d8f357370
0xffffff8d8f357230: 0xffffff06b7f9c000 0x30
0xffffff8d8f357240: 0x100000000 0x0
0xffffff8d8f357250: 0x0 0x9
0xffffff8d8f357260: 0xc 0xffffff8d8f357370
0xffffff8d8f357270: 0xffffff06b7f9c000 0x0
0xffffff8d8f357280: 0xffffff8d8f357360 0xffffffff80580e0f <trap+991>
0xffffff8d8f357290: 0x0 0x0
0xffffff8d8f3572a0: 0x80074e49e 0x2
0xffffff8d8f3572b0: 0x80071cba0 0x80071cdc0
0xffffff8d8f3572c0: 0x80071c9a0 0x0
0xffffff8d8f3572d0: 0x0 0x0
0xffffff8d8f3572e0: 0x0 0x0
0xffffff8d8f3572f0: 0x0 0x0
0xffffff8d8f357300: 0x80074e49e 0x1
0xffffff8d8f357310: 0x80071cba0 0x80071cdc0
0xffffff8d8f357320: 0x80071c9a0 0x0
0xffffff8d8f357330: 0x0 0x4
0xffffff8d8f357340: 0xffffff070b5a48c0 0xffffff06b7f9c000
0xffffff8d8f357350: 0x0 0xffffffff8083e920 <vmspace0>
0xffffff8d8f357360: 0xffffff8d8f357430 0xffffffff80568f04 <calltrap+8>
0xffffff8d8f357370: 0xffffff070b5a48c0 0x3
0xffffff8d8f357380: 0xffffff8d8f357440 0x0
0xffffff8d8f357390: 0xffffff8d8f357440 0x30
0xffffff8d8f3573a0: 0xffffff06b7f9c000 0x4
0xffffff8d8f3573b0: 0xffffff8d8f357430 0xffffffff8083e920 <vmspace0>
0xffffff8d8f3573c0: 0xffffff06b7f9c000 0xffffff070b5a48c0
0xffffff8d8f3573d0: 0xffffff06b7f9c000 0x0
0xffffff8d8f3573e0: 0xffffffff8083e920 <vmspace0> 0x1b00130000000c
0xffffff8d8f3573f0: 0x30 0x3b003b00000001
0xffffff8d8f357400: 0x0 0xffffffff80384632 <lim_rlimit+18>
0xffffff8d8f357410: 0x20 0x10206
0xffffff8d8f357420: 0xffffff8d8f357430 0x28
0xffffff8d8f357430: 0xffffff8d8f357450 0xffffffff80384681 <lim_cur+17>
0xffffff8d8f357440: 0x4 0xffffff070b5a48c0
0xffffff8d8f357450: 0xffffff8d8f357500 0xffffffff80543ffd <vm_map_growstack+93>
0xffffff8d8f357460: 0xffffff8d8f357470 0xffffff8d8f3576d8
0xffffff8d8f357470: 0xffffff8d8f357500 0xffffffff80544ef8 <vm_map_lookup+808>
0xffffff8d8f357480: 0xffffff070b5a49b8 0x0
0xffffff8d8f357490: 0x8 0xffffff06b7f9c000
0xffffff8d8f3574a0: 0xffffff06b7f9c000 0xffffff8d8f3576d8
0xffffff8d8f3574b0: 0xffffff8d8f3576d0 0xffffff8d8f3576e8
0xffffff8d8f3574c0: 0x0 0xffffff8d8f3576e0
0xffffff8d8f3574d0: 0x100000001 0x1
0xffffff8d8f3574e0: 0xffffff06b7f9c000 0x1
0xffffff8d8f3574f0: 0x0 0xffffffff8083e920 <vmspace0>
0xffffff8d8f357500: 0xffffff8d8f357770 0xffffffff8053c723 <vm_fault+4355>
0xffffff8d8f357510: 0xffffff8d8f35773f 0xffffff8d8f357738
0xffffff8d8f357520: 0x80085e4f9 0x80085e4f8
0xffffff8d8f357530: 0xffffff06b7f9c000 0xffffff8d8f3576e0
0xffffff8d8f357540: 0xffffff8d8f3576e8 0xffffff8d8f3576d0
0xffffff8d8f357550: 0xffffff8d8f3576d8 0x80085e4f9
0xffffff8d8f357560: 0x80085e4f9 0x80085e4f9
0xffffff8d8f357570: 0x80085e4f9 0x80085e4f9
0xffffff8d8f357580: 0x80085e4f9 0x80085e4f9
0xffffff8d8f357590: 0x80085e4f9 0x80085e4f9
0xffffff8d8f3575a0: 0x80085e4f9 0x734210
0xffffff8d8f3575b0: 0x10000000001 0x80073ada0
0xffffff8d8f3575c0: 0x0 0xffffffff8083e920 <vmspace0>
0xffffff8d8f3575d0: 0x80073aec0 0x1
0xffffff8d8f3575e0: 0x6967614d00000000 0x454e4f4e
0xffffff8d8f3575f0: 0x0 0x0
0xffffff8d8f357600: 0x0 0x0
0xffffff8d8f357610: 0x0 0xfffd
0xffffff8d8f357620: 0x200 0x200
0xffffff8d8f357630: 0x200 0x200
0xffffff8d8f357640: 0x200 0x200
0xffffff8d8f357650: 0x200 0x200
0xffffff8d8f357660: 0x200 0x24200
0xffffff8d8f357670: 0x4200 0x4200
0xffffff8d8f357680: 0x4200 0x4200
0xffffff8d8f357690: 0x200 0x200
0xffffff8d8f3576a0: 0x200 0x200
0xffffff8d8f3576b0: 0x200 0x200
0xffffff8d8f3576c0: 0x200 0x200
0xffffff8d8f3576d0: 0x200 0x200
0xffffff8d8f3576e0: 0xffffffff8083e920 <vmspace0> 0xffffffff8083e920 <vmspace0>
0xffffff8d8f3576f0: 0x200 0x0
0xffffff8d8f357700: 0x0 0x200
0xffffff8d8f357710: 0x200 0x200
0xffffff8d8f357720: 0x64000 0x42800
0xffffff8d8f357730: 0x42800 0x42800
0xffffff8d8f357740: 0x42800 0xffffff070b5a48c0
0xffffff8d8f357750: 0xffffff06b7f9c000 0x4
0xffffff8d8f357760: 0x0 0xffffffff8083e920 <vmspace0>
0xffffff8d8f357770: 0xffffff8d8f3577e0 0xffffffff805807d3 <trap_pfault+307>
0xffffff8d8f357780: 0x42800 0xffffff8d8f3578d0
0xffffff8d8f357790: 0xffffff06b7f9c000 0x30
0xffffff8d8f3577a0: 0x100050c00 0x50c01
0xffffff8d8f3577b0: 0x50c02 0x9
0xffffff8d8f3577c0: 0xc 0xffffff8d8f3578d0
0xffffff8d8f3577d0: 0xffffff06b7f9c000 0x0
0xffffff8d8f3577e0: 0xffffff8d8f3578c0 0xffffffff80580e0f <trap+991>
0xffffff8d8f3577f0: 0x42800 0x42800
0xffffff8d8f357800: 0x42800 0x42800
0xffffff8d8f357810: 0x42800 0x42800
0xffffff8d8f357820: 0x42800 0x5890a
0xffffff8d8f357830: 0x5890b 0x5890c
0xffffff8d8f357840: 0x5890d 0x5890e
0xffffff8d8f357850: 0x5890f 0x48900
0xffffff8d8f357860: 0x48900 0x48900
0xffffff8d8f357870: 0x48900 0x48900
0xffffff8d8f357880: 0x48900 0x48900
0xffffff8d8f357890: 0x48900 0x4
0xffffff8d8f3578a0: 0xffffff070b5a48c0 0xffffff06b7f9c000
0xffffff8d8f3578b0: 0x0 0xffffffff8083e920 <vmspace0>
0xffffff8d8f3578c0: 0xffffff8d8f357990 0xffffffff80568f04 <calltrap+8>
0xffffff8d8f3578d0: 0xffffff070b5a48c0 0x3
0xffffff8d8f3578e0: 0xffffff8d8f3579a0 0x0
0xffffff8d8f3578f0: 0xffffff8d8f3579a0 0x30
0xffffff8d8f357900: 0xffffff06b7f9c000 0x4
0xffffff8d8f357910: 0xffffff8d8f357990 0xffffffff8083e920 <vmspace0>
0xffffff8d8f357920: 0xffffff06b7f9c000 0xffffff070b5a48c0
0xffffff8d8f357930: 0xffffff06b7f9c000 0x0
0xffffff8d8f357940: 0xffffffff8083e920 <vmspace0> 0x1b00130000000c
0xffffff8d8f357950: 0x30 0x3b003b00000001
0xffffff8d8f357960: 0x0 0xffffffff80384632 <lim_rlimit+18>
0xffffff8d8f357970: 0x20 0x10206
0xffffff8d8f357980: 0xffffff8d8f357990 0x28
0xffffff8d8f357990: 0xffffff8d8f3579b0 0xffffffff80384681 <lim_cur+17>
0xffffff8d8f3579a0: 0x4 0xffffff070b5a48c0
0xffffff8d8f3579b0: 0xffffff8d8f357a60 0xffffffff80543ffd <vm_map_growstack+93>
0xffffff8d8f3579c0: 0xffffff8d8f3579d0 0xffffff8d8f357c38
0xffffff8d8f3579d0: 0xffffff8d8f357a60 0xffffffff80544ef8 <vm_map_lookup+808>
0xffffff8d8f3579e0: 0xffffff070b5a49b8 0x0
0xffffff8d8f3579f0: 0x41900 0xffffff06b7f9c000
0xffffff8d8f357a00: 0xffffff06b7f9c000 0xffffff8d8f357c38
0xffffff8d8f357a10: 0xffffff8d8f357c30 0xffffff8d8f357c48
0xffffff8d8f357a20: 0x0 0xffffff8d8f357c40
0xffffff8d8f357a30: 0x0 0x1
0xffffff8d8f357a40: 0xffffff06b7f9c000 0x1
0xffffff8d8f357a50: 0x0 0xffffffff8083e920 <vmspace0>
0xffffff8d8f357a60: 0xffffff8d8f357cd0 0xffffffff8053c723 <vm_fault+4355>
0xffffff8d8f357a70: 0xffffff8d8f357c9f 0xffffff8d8f357c98
0xffffff8d8f357a80: 0x0 0x0
0xffffff8d8f357a90: 0xffffff06b7f9c000 0xffffff8d8f357c40
0xffffff8d8f357aa0: 0xffffff8d8f357c48 0xffffff8d8f357c30
0xffffff8d8f357ab0: 0xffffff8d8f357c38 0x0
0xffffff8d8f357ac0: 0x0 0x0
0xffffff8d8f357ad0: 0x0 0x0
0xffffff8d8f357ae0: 0x0 0x0
0xffffff8d8f357af0: 0x0 0x0
0xffffff8d8f357b00: 0x0 0x0
0xffffff8d8f357b10: 0x1 0x0
0xffffff8d8f357b20: 0x0 0xffffffff8083e920 <vmspace0>
0xffffff8d8f357b30: 0x0 0x1
0xffffff8d8f357b40: 0x0 0x0
0xffffff8d8f357b50: 0x0 0x0
0xffffff8d8f357b60: 0x0 0x0
0xffffff8d8f357b70: 0x0 0x0
0xffffff8d8f357b80: 0x0 0x0
0xffffff8d8f357b90: 0x0 0x0
0xffffff8d8f357ba0: 0x0 0x0
0xffffff8d8f357bb0: 0x0 0x0
0xffffff8d8f357bc0: 0x0 0x0
0xffffff8d8f357bd0: 0x0 0x0
0xffffff8d8f357be0: 0x0 0x0
0xffffff8d8f357bf0: 0x0 0x0
0xffffff8d8f357c00: 0x0 0x0
0xffffff8d8f357c10: 0x0 0x0
0xffffff8d8f357c20: 0x0 0x0
0xffffff8d8f357c30: 0x0 0x0
0xffffff8d8f357c40: 0xffffffff8083e920 <vmspace0> 0xffffffff8083e920 <vmspace0>
0xffffff8d8f357c50: 0x0 0x0
0xffffff8d8f357c60: 0x0 0x0
0xffffff8d8f357c70: 0x0 0x0
0xffffff8d8f357c80: 0x0 0x0
0xffffff8d8f357c90: 0x0 0x0
0xffffff8d8f357ca0: 0x0 0xffffff070b5a48c0
0xffffff8d8f357cb0: 0xffffff06b7f9c000 0x4
0xffffff8d8f357cc0: 0x0 0xffffffff8083e920 <vmspace0>
0xffffff8d8f357cd0: 0xffffff8d8f357d40 0xffffffff805807d3 <trap_pfault+307>
0xffffff8d8f357ce0: 0x0 0xffffff8d8f357e30
0xffffff8d8f357cf0: 0xffffff06b7f9c000 0x30
0xffffff8d8f357d00: 0x100000000 0x0
0xffffff8d8f357d10: 0x0 0x9
0xffffff8d8f357d20: 0xc 0xffffff8d8f357e30
0xffffff8d8f357d30: 0xffffff06b7f9c000 0x0
0xffffff8d8f357d40: 0xffffff8d8f357e20 0xffffffff80580e0f <trap+991>
0xffffff8d8f357d50: 0x0 0x0
0xffffff8d8f357d60: 0x0 0x0
0xffffff8d8f357d70: 0x0 0x0
0xffffff8d8f357d80: 0x0 0x0
0xffffff8d8f357d90: 0x0 0x0
0xffffff8d8f357da0: 0x0 0x0
0xffffff8d8f357db0: 0x0 0x0
0xffffff8d8f357dc0: 0x0 0x0
0xffffff8d8f357dd0: 0x0 0x0
0xffffff8d8f357de0: 0x0 0x0
0xffffff8d8f357df0: 0x0 0x4
0xffffff8d8f357e00: 0xffffff070b5a48c0 0xffffff06b7f9c000
0xffffff8d8f357e10: 0x0 0xffffffff8083e920 <vmspace0>
0xffffff8d8f357e20: 0xffffff8d8f357ef0 0xffffffff80568f04 <calltrap+8>
0xffffff8d8f357e30: 0xffffff070b5a48c0 0x3
0xffffff8d8f357e40: 0xffffff8d8f357f00 0x0
0xffffff8d8f357e50: 0xffffff8d8f357f00 0x30
0xffffff8d8f357e60: 0xffffff06b7f9c000 0x4
0xffffff8d8f357e70: 0xffffff8d8f357ef0 0xffffffff8083e920 <vmspace0>
0xffffff8d8f357e80: 0xffffff06b7f9c000 0xffffff070b5a48c0
0xffffff8d8f357e90: 0xffffff06b7f9c000 0x0
0xffffff8d8f357ea0: 0xffffffff8083e920 <vmspace0> 0x1b00130000000c
0xffffff8d8f357eb0: 0x30 0x3b003b00000001
0xffffff8d8f357ec0: 0x0 0xffffffff80384632 <lim_rlimit+18>
0xffffff8d8f357ed0: 0x20 0x10206
0xffffff8d8f357ee0: 0xffffff8d8f357ef0 0x28
0xffffff8d8f357ef0: 0xffffff8d8f357f10 0xffffffff80384681 <lim_cur+17>
0xffffff8d8f357f00: 0x4 0xffffff070b5a48c0
0xffffff8d8f357f10: 0xffffff8d8f357fc0 0xffffffff80543ffd <vm_map_growstack+93>
0xffffff8d8f357f20: 0xffffff8d8f357f30 0xffffff8d8f358198
0xffffff8d8f357f30: 0xffffff8d8f357fc0 0xffffffff80544ef8 <vm_map_lookup+808>
0xffffff8d8f357f40: 0xffffff070b5a49b8 0x0
0xffffff8d8f357f50: 0x6c 0xffffff06b7f9c000
0xffffff8d8f357f60: 0xffffff06b7f9c000 0xffffff8d8f358198
0xffffff8d8f357f70: 0xffffff8d8f358190 0xffffff8d8f3581a8
0xffffff8d8f357f80: 0x0 0xffffff8d8f3581a0
0xffffff8d8f357f90: 0x5d0000005c 0x1
0xffffff8d8f357fa0: 0xffffff06b7f9c000 0x1
0xffffff8d8f357fb0: 0x0 0xffffffff8083e920 <vmspace0>
0xffffff8d8f357fc0: 0xffffff8d8f358230 0xffffffff8053c723 <vm_fault+4355>
0xffffff8d8f357fd0: 0xffffff8d8f3581ff 0xffffff8d8f3581f8
0xffffff8d8f357fe0: 0x7100000070 0x7300000072
0xffffff8d8f357ff0: 0xffffff06b7f9c000 0xffffff8d8f3581a0
0xffffff8d8f358000: 0xffffff8d8f3581a8 0xffffff8d8f358190
0xffffff8d8f358010: 0xffffff8d8f358198 0x7f0000007e
0xffffff8d8f358020: 0x8100000080 0x8300000082
0xffffff8d8f358030: 0x8500000084 0x8700000086
0xffffff8d8f358040: 0x8900000088 0x8b0000008a
0xffffff8d8f358050: 0x8d0000008c 0x8f0000008e
0xffffff8d8f358060: 0x9100000090 0x92
0xffffff8d8f358070: 0x9500000001 0x9700000096
0xffffff8d8f358080: 0x0 0xffffffff8083e920 <vmspace0>
0xffffff8d8f358090: 0x9d0000009c 0x1
0xffffff8d8f3580a0: 0xa100000000 0xa3000000a2
0xffffff8d8f3580b0: 0xa5000000a4 0xa7000000a6
0xffffff8d8f3580c0: 0xa9000000a8 0xab000000aa
0xffffff8d8f3580d0: 0xad000000ac 0xaf000000ae
0xffffff8d8f3580e0: 0xb1000000b0 0xb2
0xffffff8d8f3580f0: 0xb5000000b4 0xb7000000b6
0xffffff8d8f358100: 0xb9000000b8 0xbb000000ba
0xffffff8d8f358110: 0xbd000000bc 0xbf000000be
0xffffff8d8f358120: 0xc1000000c0 0xc3000000c2
0xffffff8d8f358130: 0xc5000000c4 0xc7000000c6
0xffffff8d8f358140: 0xc9000000c8 0xcb000000ca
0xffffff8d8f358150: 0xcd000000cc 0xcf000000ce
0xffffff8d8f358160: 0xd1000000d0 0xd3000000d2
0xffffff8d8f358170: 0xd5000000d4 0xd7000000d6
0xffffff8d8f358180: 0xd9000000d8 0xdb000000da
0xffffff8d8f358190: 0xdd000000dc 0xdf000000de
0xffffff8d8f3581a0: 0xffffffff8083e920 <vmspace0> 0xffffffff8083e920 <vmspace0>
0xffffff8d8f3581b0: 0xe5000000e4 0x0
0xffffff8d8f3581c0: 0xe900000000 0xeb000000ea
0xffffff8d8f3581d0: 0xed000000ec 0xef000000ee
0xffffff8d8f3581e0: 0xf1000000f0 0xf3000000f2
0xffffff8d8f3581f0: 0xf5000000f4 0xf7000000f6
0xffffff8d8f358200: 0xf9000000f8 0xffffff070b5a48c0
(kgdb)
Regards
Steve
================================================
This e.mail is private and confidential between Multiplay (UK) Ltd. and the person or entity to whom it is addressed. In the event of misdirection, the recipient is prohibited from using, copying, printing or otherwise disseminating it or any information contained in it.
In the event of misdirection, illegible or incomplete transmission please telephone +44 845 868 1337
or return the E.mail to postmaster@multiplay.co.uk.
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?570C5495A5E242F7946E806CA7AC5D68>