From owner-freebsd-ppc@freebsd.org  Fri Jun 23 10:05:33 2017
Return-Path: <owner-freebsd-ppc@freebsd.org>
Delivered-To: freebsd-ppc@mailman.ysv.freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org
 [IPv6:2001:1900:2254:206a::19:1])
 by mailman.ysv.freebsd.org (Postfix) with ESMTP id 62780DA10C7
 for <freebsd-ppc@mailman.ysv.freebsd.org>;
 Fri, 23 Jun 2017 10:05:33 +0000 (UTC)
 (envelope-from markmi@dsl-only.net)
Received: from asp.reflexion.net (outbound-mail-210-43.reflexion.net
 [208.70.210.43])
 (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits))
 (Client did not present a certificate)
 by mx1.freebsd.org (Postfix) with ESMTPS id 1FCFF7FA43
 for <freebsd-ppc@freebsd.org>; Fri, 23 Jun 2017 10:05:32 +0000 (UTC)
 (envelope-from markmi@dsl-only.net)
Received: (qmail 28826 invoked from network); 23 Jun 2017 10:02:59 -0000
Received: from unknown (HELO rtc-sm-01.app.dca.reflexion.local) (10.81.150.1)
 by 0 (rfx-qmail) with SMTP; 23 Jun 2017 10:02:59 -0000
Received: by rtc-sm-01.app.dca.reflexion.local
 (Reflexion email security v8.40.1) with SMTP;
 Fri, 23 Jun 2017 05:58:51 -0400 (EDT)
Received: (qmail 29917 invoked from network); 23 Jun 2017 09:58:50 -0000
Received: from unknown (HELO iron2.pdx.net) (69.64.224.71)
 by 0 (rfx-qmail) with (AES256-SHA encrypted) SMTP; 23 Jun 2017 09:58:50 -0000
Received: from [192.168.1.114] (c-76-115-7-162.hsd1.or.comcast.net
 [76.115.7.162])
 by iron2.pdx.net (Postfix) with ESMTPSA id 471BAEC86D9;
 Fri, 23 Jun 2017 02:58:50 -0700 (PDT)
From: Mark Millard <markmi@dsl-only.net>
Content-Type: text/plain; charset=us-ascii
Content-Transfer-Encoding: quoted-printable
Mime-Version: 1.0 (Mac OS X Mail 10.3 \(3273\))
Subject: Example head -r317820 manual backtrace that jumps to non-code (from a
 vmcore inspection); eventually kernel-thread stack overflowed
Message-Id: <0CB80542-64A3-4A5C-93A5-67F32104549B@dsl-only.net>
Date: Fri, 23 Jun 2017 02:58:49 -0700
To: FreeBSD PowerPC ML <freebsd-ppc@freebsd.org>, freebsd-hackers@freebsd.org
X-Mailer: Apple Mail (2.3273)
X-BeenThere: freebsd-ppc@freebsd.org
X-Mailman-Version: 2.1.23
Precedence: list
List-Id: Porting FreeBSD to the PowerPC <freebsd-ppc.freebsd.org>
List-Unsubscribe: <https://lists.freebsd.org/mailman/options/freebsd-ppc>,
 <mailto:freebsd-ppc-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-ppc/>
List-Post: <mailto:freebsd-ppc@freebsd.org>
List-Help: <mailto:freebsd-ppc-request@freebsd.org?subject=help>
List-Subscribe: <https://lists.freebsd.org/mailman/listinfo/freebsd-ppc>,
 <mailto:freebsd-ppc-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Fri, 23 Jun 2017 10:05:33 -0000

[For this memory layout the old PowerMac G5
so-called "Quad Core" running 32-bit
powerpc FreeBSD ran for over 10 days, 8 hours
before it finally had an example panic.]

This is from pid 960 tid 100110 "powerpd" with=20
stack 0xd24da000-0xd24ddfff (virtual).

Note: physical address in kgdb =3D vmcore_offset - 0x1000

Look for      sched_userret 's    call and what happens after.
And later for pvo_tree_RB_FIND 's call and what happens after.


Working from high stack physical memory to low:

<vmcore
 offset>              [    lr   ]
06b2da80  ff ff dc a0 00 10 08 f8  00 00 00 ca ff ff dc a0  =
|................|

(kgdb listing around lr)
0x1008ec <k_trap+280>:	isync
0x1008f0 <trapagain>:	addi    r3,r1,8
0x1008f4 <trapagain+4>:	bl      0x8e7c64 <powerpc_interrupt>
0x1008f8 <trapexit>:	mfmsr   r3
0x1008fc <trapexit+4>:	andi.   r3,r3,32767

          [stkbckptr] [    lr   ]
06b2da50  d2 4d da 80 00 8e 7e 08  00 10 08 f8 00 00 90 32  =
|.M....~........2|

0x8e7df0 <powerpc_interrupt+396>:	mfmsr   r0
0x8e7df4 <powerpc_interrupt+400>:	or      r0,r0,r9
0x8e7df8 <powerpc_interrupt+404>:	mtmsr   r0
0x8e7dfc <powerpc_interrupt+408>:	isync
0x8e7e00 <powerpc_interrupt+412>:	mr      r3,r25
0x8e7e04 <powerpc_interrupt+416>:	bl      0x8f231c <trap>
0x8e7e08 <powerpc_interrupt+420>:	lwz     r11,0(r1)
0x8e7e0c <powerpc_interrupt+424>:	lwz     r0,4(r11)
0x8e7e10 <powerpc_interrupt+428>:	mtlr    r0

          [stkbckptr] [   lr#0  ]
06b2d990  d2 4d da 50 00 10 08 f8  00 00 0c 00 d2 4d da 50  =
|.M.P.........M.P|
06b2d9a0  05 ad e0 00 00 00 00 00  d2 4d da 88 00 00 0c 00  =
|.........M......|
06b2d9b0  ff ff dc d8 00 00 00 00  00 00 00 00 00 f6 58 00  =
|..............X.|
06b2d9c0  00 00 00 00 41 9b 13 ac  01 81 00 00 00 00 00 00  =
|....A...........|
06b2d9d0  00 00 00 01 00 00 00 02  43 1b de 83 01 81 33 68  =
|........C.....3h|
06b2d9e0  01 81 00 00 01 81 00 00  00 00 00 00 ff ff dd f0  =
|................|
06b2d9f0  00 00 04 e2 ff ff dd 70  00 00 00 50 d2 4d da 88  =
|.......p...P.M..|
06b2da00  05 ad e0 00 01 81 33 60  41 a1 e5 68 0a 00 00 00  =
|......3`A..h....|
06b2da10  00 d2 7e 68 d2 4d da 50  00 8e 7e 00 20 00 f0 34  =
|..~h.M.P..~. ..4|
                                   [   lr#1  ]

06b2da20  00 00 00 00 00 00 00 00  00 00 00 00 00 08 10 32  =
|...............2|

          [exception]
06b2da30  00 00 07 00 41 a1 e5 68  0a 00 00 00 01 81 00 00  =
|....A..h........|
06b2da40  41 9d e5 d4 42 00 00 00  00 d2 7e 68 d2 4d da 50  =
|A...B.....~h.M.P|

lr#0:
0x1008ec <k_trap+280>:	isync
0x1008f0 <trapagain>:	addi    r3,r1,8
0x1008f4 <trapagain+4>:	bl      0x8e7c64 <powerpc_interrupt>
0x1008f8 <trapexit>:	mfmsr   r3
0x1008fc <trapexit+4>:	andi.   r3,r3,32767

lr#1:
0x8e7df0 <powerpc_interrupt+396>:	mfmsr   r0
0x8e7df4 <powerpc_interrupt+400>:	or      r0,r0,r9
0x8e7df8 <powerpc_interrupt+404>:	mtmsr   r0
0x8e7dfc <powerpc_interrupt+408>:	isync
0x8e7e00 <powerpc_interrupt+412>:	mr      r3,r25
0x8e7e04 <powerpc_interrupt+416>:	bl      0x8f231c <trap>
0x8e7e08 <powerpc_interrupt+420>:	lwz     r11,0(r1)

(I will not repeat the #0 and #1 labels below for this
very repetitive structure.)

          [stkbckptr] [    lr   ]
06b2d960  d2 4d d9 90 00 8a b4 a8  d2 4d d9 70 d2 4d d9 70  =
|.M.......M.p.M.p|

0x8ab470 <handleevents+1192>:	lwz     r9,-32720(r30)
0x8ab474 <handleevents+1196>:	lwz     r9,0(r9)
0x8ab478 <handleevents+1200>:	mtctr   r9
0x8ab47c <handleevents+1204>:	mr      r3,r4
0x8ab480 <handleevents+1208>:	mr      r4,r29
0x8ab484 <handleevents+1212>:	li      r5,0
0x8ab488 <handleevents+1216>:	li      r6,0
0x8ab48c <handleevents+1220>:	li      r7,0
0x8ab490 <handleevents+1224>:	li      r8,0
0x8ab494 <handleevents+1228>:	bctrl
0x8ab498 <handleevents+1232>:	sync   =20
0x8ab49c <handleevents+1236>:	li      r0,4
0x8ab4a0 <handleevents+1240>:	stw     r0,16(r29)
0x8ab4a4 <handleevents+1244>:	bl      0x8ea4e8 <spinlock_exit>
0x8ab4a8 <handleevents+1248>:	b       0x8ab518 <handleevents+1360>
0x8ab4ac <handleevents+1252>:	lwz     r11,-32748(r30)

          [stkbckptr] [    lr   ]
06b2d8a0  d2 4d d9 60 00 10 08 f8  00 00 07 00 d2 4d d9 60  =
|.M.`.........M.`|
06b2d8b0  05 ad e0 00 00 00 00 00  d2 4d d9 98 00 00 07 00  =
|.........M......|
06b2d8c0  ff ff dc d8 00 00 00 00  00 00 00 00 00 f6 58 00  =
|..............X.|
06b2d8d0  00 00 00 00 41 9b 13 ac  01 81 00 00 00 00 00 00  =
|....A...........|
06b2d8e0  00 00 00 01 00 00 00 02  43 1b de 83 01 81 33 68  =
|........C.....3h|
06b2d8f0  01 81 00 00 01 81 00 00  00 00 00 00 ff ff dd f0  =
|................|
06b2d900  00 00 04 e2 ff ff dd 70  00 00 00 50 d2 4d d9 98  =
|.......p...P.M..|
06b2d910  05 ad e0 00 01 81 33 60  41 a1 e5 68 0a 00 00 00  =
|......3`A..h....|
06b2d920  00 d2 7e 68 d2 4d d9 60  00 8e 7e 00 20 08 10 34  =
|..~h.M.`..~. ..4|
                                   [   lr    ]

06b2d930  00 00 00 00 00 00 00 00  00 00 00 00 00 08 10 32  =
|...............2|

          [exception]
06b2d940  00 00 07 00 41 a1 e5 68  0a 00 00 00 00 0d 00 56  =
|....A..h.......V|
06b2d950  52 66 54 bf df 5d 0d 00  00 d2 6b 18 d2 4d d9 60  =
|RfT..]....k..M.`|

0x1008ec <k_trap+280>:	isync
0x1008f0 <trapagain>:	addi    r3,r1,8
0x1008f4 <trapagain+4>:	bl      0x8e7c64 <powerpc_interrupt>
0x1008f8 <trapexit>:	mfmsr   r3
0x1008fc <trapexit+4>:	andi.   r3,r3,32767

0x8e7df0 <powerpc_interrupt+396>:	mfmsr   r0
0x8e7df4 <powerpc_interrupt+400>:	or      r0,r0,r9
0x8e7df8 <powerpc_interrupt+404>:	mtmsr   r0
0x8e7dfc <powerpc_interrupt+408>:	isync
0x8e7e00 <powerpc_interrupt+412>:	mr      r3,r25
0x8e7e04 <powerpc_interrupt+416>:	bl      0x8f231c <trap>
0x8e7e08 <powerpc_interrupt+420>:	lwz     r11,0(r1)


          [stkbckptr] [    lr   ]
06b2d870  d2 4d d8 a0 00 56 e7 68  00 d1 d5 cc d2 4d d8 80  =
|.M...V.h.....M..|

0x56e75c <userret+176>:	bl      0x55c3cc <addupc_task>
0x56e760 <userret+180>:	mr      r3,r28
0x56e764 <userret+184>:	bl      0x534744 <sched_userret>
0x56e768 <userret+188>:	lwz     r9,-32756(r30)

          [stkbckptr] [    lr   ]
06b2d7b0  d2 4d d8 70 00 10 08 f8  00 00 07 00 d2 4d d8 70  =
|.M.p.........M.p|
06b2d7c0  05 ad e0 00 00 00 00 00  d2 4d d8 a8 00 00 07 00  =
|.........M......|
06b2d7d0  ff ff dc d8 00 00 00 00  00 00 00 00 00 f6 58 00  =
|..............X.|
06b2d7e0  00 00 00 00 41 9b 13 ac  01 81 00 00 00 00 00 00  =
|....A...........|
06b2d7f0  00 00 00 01 00 00 00 02  43 1b de 83 01 81 33 68  =
|........C.....3h|
06b2d800  01 81 00 00 01 81 00 00  00 00 00 00 ff ff dd f0  =
|................|
06b2d810  00 00 04 e2 ff ff dd 70  00 00 00 50 d2 4d d8 a8  =
|.......p...P.M..|
06b2d820  05 ad e0 00 01 81 33 60  41 a1 e5 68 0a 00 00 00  =
|......3`A..h....|
06b2d830  00 d2 7e 68 d2 4d d8 70  00 8e 7e 00 20 08 10 34  =
|..~h.M.p..~. ..4|
                                   [   lr    ]

06b2d840  00 00 00 00 00 00 00 00  00 00 00 00 00 08 10 32  =
|...............2|

          [exception]
06b2d850  00 00 07 00 41 a1 e5 68  0a 00 00 00 05 ad e0 00  =
|....A..h........|
06b2d860  d2 4d d8 88 05 f5 1a 50  00 d1 e7 24 d2 4d d8 70  =
|.M.....P...$.M.p|

0x1008ec <k_trap+280>:	isync
0x1008f0 <trapagain>:	addi    r3,r1,8
0x1008f4 <trapagain+4>:	bl      0x8e7c64 <powerpc_interrupt>
0x1008f8 <trapexit>:	mfmsr   r3
0x1008fc <trapexit+4>:	andi.   r3,r3,32767

0x8e7df0 <powerpc_interrupt+396>:	mfmsr   r0
0x8e7df4 <powerpc_interrupt+400>:	or      r0,r0,r9
0x8e7df8 <powerpc_interrupt+404>:	mtmsr   r0
0x8e7dfc <powerpc_interrupt+408>:	isync
0x8e7e00 <powerpc_interrupt+412>:	mr      r3,r25
0x8e7e04 <powerpc_interrupt+416>:	bl      0x8f231c <trap>
0x8e7e08 <powerpc_interrupt+420>:	lwz     r11,0(r1)


          [stkbckptr] [    lr   ]
06b2d780  d2 4d d7 b0 00 00 00 02  00 d2 81 c8 d2 4d d7 90  =
|.M...........M..|

0x2:	.long 0x0
0x6:	.long 0x0
0xa:	.long 0x0
0xe:	.long 0x0
0x12:	.long 0xffa3
0x16:	rlwnm.  r16,r18,r31,30,17
0x1a:	rlwnm   r8,r23,r0,0,0
0x1e:	.long 0x0
0x22:	.long 0x0
0x26:	.long 0x0
0x2a:	.long 0x0
0x2e:	.long 0x0

          [stkbckptr] [    lr   ]
06b2d6c0  d2 4d d7 80 00 10 08 f8  00 00 07 00 d2 4d d7 80  =
|.M...........M..|
06b2d6d0  05 ad e0 00 00 00 00 00  d2 4d d7 b8 00 00 07 00  =
|.........M......|
06b2d6e0  ff ff dc d8 00 00 00 00  00 00 00 00 00 f6 58 00  =
|..............X.|
06b2d6f0  00 00 00 00 41 9b 13 ac  01 81 00 00 00 00 00 00  =
|....A...........|
06b2d700  00 00 00 01 00 00 00 02  43 1b de 83 01 81 33 68  =
|........C.....3h|
06b2d710  01 81 00 00 01 81 00 00  00 00 00 00 ff ff dd f0  =
|................|
06b2d720  00 00 04 e2 ff ff dd 70  00 00 00 50 d2 4d d7 b8  =
|.......p...P.M..|
06b2d730  05 ad e0 00 01 81 33 60  41 a1 e5 68 0a 00 00 00  =
|......3`A..h....|
06b2d740  00 d2 7e 68 d2 4d d7 80  00 8e 7e 00 20 08 10 34  =
|..~h.M....~. ..4|
                                   [   lr    ]

06b2d750  00 00 00 00 00 00 00 00  00 00 00 00 00 08 10 32  =
|...............2|

          [exception]
06b2d760  00 00 07 00 41 a1 e5 68  0a 00 00 00 05 ad e0 00  =
|....A..h........|
06b2d770  d2 4d d7 90 00 00 00 00  d2 4d d7 50 05 ad e0 00  =
|.M.......M.P....|

0x1008ec <k_trap+280>:	isync
0x1008f0 <trapagain>:	addi    r3,r1,8
0x1008f4 <trapagain+4>:	bl      0x8e7c64 <powerpc_interrupt>
0x1008f8 <trapexit>:	mfmsr   r3
0x1008fc <trapexit+4>:	andi.   r3,r3,32767

0x8e7df0 <powerpc_interrupt+396>:	mfmsr   r0
0x8e7df4 <powerpc_interrupt+400>:	or      r0,r0,r9
0x8e7df8 <powerpc_interrupt+404>:	mtmsr   r0
0x8e7dfc <powerpc_interrupt+408>:	isync
0x8e7e00 <powerpc_interrupt+412>:	mr      r3,r25
0x8e7e04 <powerpc_interrupt+416>:	bl      0x8f231c <trap>
0x8e7e08 <powerpc_interrupt+420>:	lwz     r11,0(r1)


          [stkbckptr] [    lr   ]
06b2d690  d2 4d d6 c0 00 00 00 00  d2 4d d8 88 00 00 00 00  =
|.M.......M......|

0x0:	.long 0x0
0x4:	.long 0x0
0x8:	.long 0x0
0xc:	.long 0x0
0x10:	.long 0x0
0x14:	.long 0xffa35e50
0x18:	.long 0xffa35ee8
0x1c:	.long 0x0

          [stkbckptr] [    lr   ]
06b2d5d0  d2 4d d6 90 00 10 08 f8  00 00 07 00 d2 4d d6 90  =
|.M...........M..|
06b2d5e0  05 ad e0 00 00 00 00 00  d2 4d d6 c8 00 00 07 00  =
|.........M......|
06b2d5f0  ff ff dc d8 00 00 00 00  00 00 00 00 00 f6 58 00  =
|..............X.|
06b2d600  00 00 00 00 41 9b 13 ac  01 81 00 00 00 00 00 00  =
|....A...........|
06b2d610  00 00 00 01 00 00 00 02  43 1b de 83 01 81 33 68  =
|........C.....3h|
06b2d620  01 81 00 00 01 81 00 00  00 00 00 00 ff ff dd f0  =
|................|
06b2d630  00 00 04 e2 ff ff dd 70  00 00 00 50 d2 4d d6 c8  =
|.......p...P.M..|
06b2d640  05 ad e0 00 01 81 33 60  41 a1 e5 68 0a 00 00 00  =
|......3`A..h....|
06b2d650  00 d2 7e 68 d2 4d d6 90  00 8e 7e 00 20 08 10 34  =
|..~h.M....~. ..4|
                                   [   lr    ]

06b2d660  00 00 00 00 00 00 00 00  00 00 00 00 00 08 10 32  =
|...............2|

          [exception]
06b2d670  00 00 07 00 41 a1 e5 68  0a 00 00 00 00 00 00 02  =
|....A..h........|
06b2d680  d2 4d d6 b0 00 e8 7d 3c  00 f3 77 70 ff ff dd 70  =
|.M....}<..wp...p|

0x1008ec <k_trap+280>:	isync
0x1008f0 <trapagain>:	addi    r3,r1,8
0x1008f4 <trapagain+4>:	bl      0x8e7c64 <powerpc_interrupt>
0x1008f8 <trapexit>:	mfmsr   r3
0x1008fc <trapexit+4>:	andi.   r3,r3,32767

0x8e7df0 <powerpc_interrupt+396>:	mfmsr   r0
0x8e7df4 <powerpc_interrupt+400>:	or      r0,r0,r9
0x8e7df8 <powerpc_interrupt+404>:	mtmsr   r0
0x8e7dfc <powerpc_interrupt+408>:	isync
0x8e7e00 <powerpc_interrupt+412>:	mr      r3,r25
0x8e7e04 <powerpc_interrupt+416>:	bl      0x8f231c <trap>
0x8e7e08 <powerpc_interrupt+420>:	lwz     r11,0(r1)


          [stkbckptr] [    lr   ]
06b2d5a0  d2 4d d5 d0 05 ad e0 00  00 d1 e5 3c d2 4d d5 b0  =
|.M.........<.M..|

0x5addff4:	dozi    r19,r0,-26304
0x5addff8:	dozi    r18,r12,1536
0x5addffc:	dozi    r18,r12,1472
0x5ade000:	.long 0xebb800
0x5ade004:	.long 0x5f51a50
0x5ade008:	.long 0x0
0x5ade00c:	.long 0x5f51a58

          [stkbckptr] [    lr   ]
06b2d4e0  d2 4d d5 a0 00 10 08 f8  00 00 07 00 d2 4d d5 a0  =
|.M...........M..|
06b2d4f0  05 ad e0 00 00 00 00 00  d2 4d d5 d8 00 00 07 00  =
|.........M......|
06b2d500  ff ff dc d8 00 00 00 00  00 00 00 00 00 f6 58 00  =
|..............X.|
06b2d510  00 00 00 00 41 9b 13 ac  01 81 00 00 00 00 00 00  =
|....A...........|
06b2d520  00 00 00 01 00 00 00 02  43 1b de 83 01 81 33 68  =
|........C.....3h|
06b2d530  01 81 00 00 01 81 00 00  00 00 00 00 ff ff dd f0  =
|................|
06b2d540  00 00 04 e2 ff ff dd 70  00 00 00 50 d2 4d d5 d8  =
|.......p...P.M..|
06b2d550  05 ad e0 00 01 81 33 60  41 a1 e5 68 0a 00 00 00  =
|......3`A..h....|
06b2d560  00 d2 7e 68 d2 4d d5 a0  00 8e 7e 00 20 08 10 34  =
|..~h.M....~. ..4|
                                   [   lr    ]

06b2d570  00 00 00 00 00 00 00 00  00 00 00 00 00 08 10 32  =
|...............2|

          [exception]
06b2d580  00 00 07 00 41 a1 e5 68  0a 00 00 00 d2 4d d5 90  =
|....A..h.....M..|
06b2d590  d2 4d d5 b0 00 56 4e 38  00 cf 51 80 05 fd 3c d0  =
|.M...VN8..Q...<.|

0x1008ec <k_trap+280>:	isync
0x1008f0 <trapagain>:	addi    r3,r1,8
0x1008f4 <trapagain+4>:	bl      0x8e7c64 <powerpc_interrupt>
0x1008f8 <trapexit>:	mfmsr   r3
0x1008fc <trapexit+4>:	andi.   r3,r3,32767

0x8e7df0 <powerpc_interrupt+396>:	mfmsr   r0
0x8e7df4 <powerpc_interrupt+400>:	or      r0,r0,r9
0x8e7df8 <powerpc_interrupt+404>:	mtmsr   r0
0x8e7dfc <powerpc_interrupt+408>:	isync
0x8e7e00 <powerpc_interrupt+412>:	mr      r3,r25
0x8e7e04 <powerpc_interrupt+416>:	bl      0x8f231c <trap>
0x8e7e08 <powerpc_interrupt+420>:	lwz     r11,0(r1)


          [stkbckptr] [    lr   ]
06b2d4b0  d2 4d d4 e0 00 55 28 b4  d2 4d d4 c0 d2 4d d4 c0  =
|.M...U(..M...M..|

0x552884 <kobj_lookup_method>:	stwu    r1,-32(r1)
0x552888 <kobj_lookup_method+4>:	mflr    r0
0x55288c <kobj_lookup_method+8>:	stw     r28,16(r1)
0x552890 <kobj_lookup_method+12>:	stw     r29,20(r1)
0x552894 <kobj_lookup_method+16>:	stw     r30,24(r1)
0x552898 <kobj_lookup_method+20>:	stw     r31,28(r1)
0x55289c <kobj_lookup_method+24>:	stw     r0,36(r1)
0x5528a0 <kobj_lookup_method+28>:	mr      r31,r1
0x5528a4 <kobj_lookup_method+32>:	mr      r28,r4
0x5528a8 <kobj_lookup_method+36>:	mr      r29,r5
0x5528ac <kobj_lookup_method+40>:	mr      r4,r5
0x5528b0 <kobj_lookup_method+44>:	bl      0x5527ac =
<kobj_lookup_method_mi>
0x5528b4 <kobj_lookup_method+48>:	cmpwi   r3,0

          [stkbckptr] [    lr   ]
06b2d3f0  d2 4d d4 b0 00 10 08 f8  00 00 07 00 d2 4d d4 b0  =
|.M...........M..|
06b2d400  05 ad e0 00 00 00 00 00  d2 4d d4 e8 00 00 07 00  =
|.........M......|
06b2d410  ff ff dc d8 00 00 00 00  00 00 00 00 00 f6 58 00  =
|..............X.|
06b2d420  00 00 00 00 41 9b 13 ac  01 81 00 00 00 00 00 00  =
|....A...........|
06b2d430  00 00 00 01 00 00 00 02  43 1b de 83 01 81 33 68  =
|........C.....3h|
06b2d440  01 81 00 00 01 81 00 00  00 00 00 00 ff ff dd f0  =
|................|
06b2d450  00 00 04 e2 ff ff dd 70  00 00 00 50 d2 4d d4 e8  =
|.......p...P.M..|
06b2d460  05 ad e0 00 01 81 33 60  41 a1 e5 68 0a 00 00 00  =
|......3`A..h....|
06b2d470  00 d2 7e 68 d2 4d d4 b0  00 8e 7e 00 20 08 10 34  =
|..~h.M....~. ..4|
                                   [   lr    ]

06b2d480  00 00 00 00 00 00 00 00  00 00 00 00 00 08 10 32  =
|...............2|

          [exception]
06b2d490  00 00 07 00 41 a1 e5 68  0a 00 00 00 d2 4d d4 a0  =
|....A..h.....M..|
06b2d4a0  00 fc f9 dc 00 ce 0f 8c  00 d2 80 6c d2 4d d4 b0  =
|...........l.M..|

0x1008ec <k_trap+280>:	isync
0x1008f0 <trapagain>:	addi    r3,r1,8
0x1008f4 <trapagain+4>:	bl      0x8e7c64 <powerpc_interrupt>
0x1008f8 <trapexit>:	mfmsr   r3
0x1008fc <trapexit+4>:	andi.   r3,r3,32767

0x8e7df0 <powerpc_interrupt+396>:	mfmsr   r0
0x8e7df4 <powerpc_interrupt+400>:	or      r0,r0,r9
0x8e7df8 <powerpc_interrupt+404>:	mtmsr   r0
0x8e7dfc <powerpc_interrupt+408>:	isync
0x8e7e00 <powerpc_interrupt+412>:	mr      r3,r25
0x8e7e04 <powerpc_interrupt+416>:	bl      0x8f231c <trap>
0x8e7e08 <powerpc_interrupt+420>:	lwz     r11,0(r1)


. . . lots omitted . . .

          [stkbckptr] [    lr   ]
06b2cc40  d2 4d cc 70 00 ce 0f f8  d2 4d cc 50 d2 4d cc 50  =
|.M.p.....M.P.M.P|

0xce0fec <mmu_unmapdev_desc>:	.long 0x0
0xce0ff0 <mmu_unmapdev_desc+4>:	.long 0xce0fec
0xce0ff4 <mmu_unmapdev_desc+8>:	.long 0x552698
0xce0ff8 <mmu_kextract_desc>:	.long 0x0
0xce0ffc <mmu_kextract_desc+4>:	.long 0xce0ff8
0xce1000 <mmu_kextract_desc+8>:	.long 0x552698

FYI: mmu_kextract should be tied to moea_kextract
     and moea_kextract starts at 0x008b107c .

FYI:

0x552698 <kobj_error_method>:	stwu    r1,-32(r1)
0x55269c <kobj_error_method+4>:	stw     r31,24(r1)
0x5526a0 <kobj_error_method+8>:	mr      r31,r1
0x5526a4 <kobj_error_method+12>:	li      r3,6
0x5526a8 <kobj_error_method+16>:	lwz     r11,0(r1)
0x5526ac <kobj_error_method+20>:	lwz     r31,-8(r11)
0x5526b0 <kobj_error_method+24>:	mr      r1,r11
0x5526b4 <kobj_error_method+28>:	blr
0x5526b8 <kobj_error_method+32>:	.long 0x7cba74


          [stkbckptr] [    lr   ]
06b2cb80  d2 4d cc 40 00 10 08 f8  00 00 07 00 d2 4d cc 40  =
|.M.@.........M.@|
06b2cb90  05 ad e0 00 00 00 00 00  d2 4d cc 78 00 00 07 00  =
|.........M.x....|
06b2cba0  ff ff dc d8 00 00 00 00  00 00 00 00 00 f6 58 00  =
|..............X.|
06b2cbb0  00 00 00 00 41 9b 13 ac  01 81 00 00 00 00 00 00  =
|....A...........|
06b2cbc0  00 00 00 01 00 00 00 02  43 1b de 83 01 81 33 68  =
|........C.....3h|
06b2cbd0  01 81 00 00 01 81 00 00  00 00 00 00 ff ff dd f0  =
|................|
06b2cbe0  00 00 04 e2 ff ff dd 70  00 00 00 50 d2 4d cc 78  =
|.......p...P.M.x|
06b2cbf0  05 ad e0 00 01 81 33 60  41 a1 e5 68 0a 00 00 00  =
|......3`A..h....|
06b2cc00  00 d2 7e 68 d2 4d cc 40  00 8e 7e 00 20 08 10 34  =
|..~h.M.@..~. ..4|
                                   [   lr    ]

06b2cc10  00 00 00 00 00 00 00 00  00 00 00 00 00 08 10 32  =
|...............2|

          [exception]
06b2cc20  00 00 07 00 41 a1 e5 68  0a 00 00 00 d2 4d cc 30  =
|....A..h.....M.0|
06b2cc30  e0 be 40 00 00 d4 db 94  7f ff ff ff 00 d4 db 80  =
|..@.............|

0x1008ec <k_trap+280>:	isync
0x1008f0 <trapagain>:	addi    r3,r1,8
0x1008f4 <trapagain+4>:	bl      0x8e7c64 <powerpc_interrupt>
0x1008f8 <trapexit>:	mfmsr   r3
0x1008fc <trapexit+4>:	andi.   r3,r3,32767

0x8e7df0 <powerpc_interrupt+396>:	mfmsr   r0
0x8e7df4 <powerpc_interrupt+400>:	or      r0,r0,r9
0x8e7df8 <powerpc_interrupt+404>:	mtmsr   r0
0x8e7dfc <powerpc_interrupt+408>:	isync
0x8e7e00 <powerpc_interrupt+412>:	mr      r3,r25
0x8e7e04 <powerpc_interrupt+416>:	bl      0x8f231c <trap>
0x8e7e08 <powerpc_interrupt+420>:	lwz     r11,0(r1)


          [stkbckptr] [    lr   ]
06b2cb50  d2 4d cb 80 00 8b 63 3c  00 d2 6b c0 d2 4d cb 60  =
|.M....c<..k..M.`|

0x8b6334 <moea64_pvo_find_va+32>:	addi    r4,r31,24
0x8b6338 <moea64_pvo_find_va+36>:	bl      0x8ed944 =
<pvo_tree_RB_FIND>
0x8b633c <moea64_pvo_find_va+40>:	lwz     r11,0(r1)

          [stkbckptr] [    lr   ]
06b2ca90  d2 4d cb 50 00 10 08 f8  00 00 07 00 d2 4d cb 50  =
|.M.P.........M.P|
06b2caa0  05 ad e0 00 00 00 00 00  d2 4d cb 88 00 00 07 00  =
|.........M......|
06b2cab0  ff ff dc d8 00 00 00 00  00 00 00 00 00 f6 58 00  =
|..............X.|
06b2cac0  00 00 00 00 41 9b 13 ac  01 81 00 00 00 00 00 00  =
|....A...........|
06b2cad0  00 00 00 01 00 00 00 02  43 1b de 83 01 81 33 68  =
|........C.....3h|
06b2cae0  01 81 00 00 01 81 00 00  00 00 00 00 ff ff dd f0  =
|................|
06b2caf0  00 00 04 e2 ff ff dd 70  00 00 00 50 d2 4d cb 88  =
|.......p...P.M..|
06b2cb00  05 ad e0 00 01 81 33 60  41 a1 e5 68 0a 00 00 00  =
|......3`A..h....|
06b2cb10  00 d2 7e 68 d2 4d cb 50  00 8e 7e 00 20 08 10 34  =
|..~h.M.P..~. ..4|
                                   [   lr    ]

06b2cb20  00 00 00 00 00 00 00 00  00 00 00 00 00 08 10 32  =
|...............2|

          [exception]
06b2cc20  00 00 07 00 41 a1 e5 68  0a 00 00 00 d2 4d cc 30  =
|....A..h.....M.0|
06b2cb30  00 00 07 00 41 a1 e5 68  0a 00 00 00 fa 50 05 af  =
|....A..h.....P..|
06b2cb40  e0 be 10 00 00 fc fd e0  00 d2 6d 9c d2 4d cb 50  =
|..........m..M.P|

0x1008ec <k_trap+280>:	isync
0x1008f0 <trapagain>:	addi    r3,r1,8
0x1008f4 <trapagain+4>:	bl      0x8e7c64 <powerpc_interrupt>
0x1008f8 <trapexit>:	mfmsr   r3
0x1008fc <trapexit+4>:	andi.   r3,r3,32767

0x8e7df0 <powerpc_interrupt+396>:	mfmsr   r0
0x8e7df4 <powerpc_interrupt+400>:	or      r0,r0,r9
0x8e7df8 <powerpc_interrupt+404>:	mtmsr   r0
0x8e7dfc <powerpc_interrupt+408>:	isync
0x8e7e00 <powerpc_interrupt+412>:	mr      r3,r25
0x8e7e04 <powerpc_interrupt+416>:	bl      0x8f231c <trap>
0x8e7e08 <powerpc_interrupt+420>:	lwz     r11,0(r1)


          [stkbckptr] [    lr   ]
06b2ca60  d2 4d ca 90 fa 50 05 af  fa 50 05 af fa 50 05 af  =
|.M...P...P...P..|

(Unknown virtual to physical for 0xfa5005af -> ?)
This repeats after a matching trap frame as the
stack use grows and grows.

          [stkbckptr] [    lr   ]
06b2c9a0  d2 4d ca 60 00 10 08 f8  00 00 07 00 d2 4d ca 60  =
|.M.`.........M.`|
06b2c9b0  05 ad e0 00 00 00 00 00  d2 4d ca 98 00 00 07 00  =
|.........M......|
06b2c9c0  ff ff dc d8 00 00 00 00  00 00 00 00 00 f6 58 00  =
|..............X.|
06b2c9d0  00 00 00 00 41 9b 13 ac  01 81 00 00 00 00 00 00  =
|....A...........|
06b2c9e0  00 00 00 01 00 00 00 02  43 1b de 83 01 81 33 68  =
|........C.....3h|
06b2c9f0  01 81 00 00 01 81 00 00  00 00 00 00 ff ff dd f0  =
|................|
06b2ca00  00 00 04 e2 ff ff dd 70  00 00 00 50 d2 4d ca 98  =
|.......p...P.M..|
06b2ca10  05 ad e0 00 01 81 33 60  41 a1 e5 68 0a 00 00 00  =
|......3`A..h....|
06b2ca20  00 d2 7e 68 d2 4d ca 60  00 8e 7e 00 20 08 10 34  =
|..~h.M.`..~. ..4|
                                   [   lr    ]

06b2ca30  00 00 00 00 00 00 00 00  00 00 00 00 00 08 10 32  =
|...............2|

          [exception]
06b2ca40  00 00 07 00 41 a1 e5 68  0a 00 00 00 fa 50 05 af  =
|....A..h.....P..|
06b2ca50  fa 50 05 af fa 50 05 af  fa 50 05 af fa 50 05 af  =
|.P...P...P...P..|

0x1008ec <k_trap+280>:	isync
0x1008f0 <trapagain>:	addi    r3,r1,8
0x1008f4 <trapagain+4>:	bl      0x8e7c64 <powerpc_interrupt>
0x1008f8 <trapexit>:	mfmsr   r3
0x1008fc <trapexit+4>:	andi.   r3,r3,32767

0x8e7df0 <powerpc_interrupt+396>:	mfmsr   r0
0x8e7df4 <powerpc_interrupt+400>:	or      r0,r0,r9
0x8e7df8 <powerpc_interrupt+404>:	mtmsr   r0
0x8e7dfc <powerpc_interrupt+408>:	isync
0x8e7e00 <powerpc_interrupt+412>:	mr      r3,r25
0x8e7e04 <powerpc_interrupt+416>:	bl      0x8f231c <trap>
0x8e7e08 <powerpc_interrupt+420>:	lwz     r11,0(r1)


. . . lots omitted repeating the lr being: fa 50 05 af
      then powerpc_interrupt being used via trapagain . . .

          [stkbckptr] [    lr   ]
06b2a120  d2 4d a1 50 fa 50 05 af  fa 50 05 af fa 50 05 af  =
|.M.P.P...P...P..|

(Unknown virtual to physical for 0xf15005af -> ?)

          [stkbckptr] [    lr   ]
06b2a060  d2 4d a1 20 00 10 08 f8  00 00 07 00 d2 4d a1 20  |.M. =
.........M. |
06b2a070  05 ad e0 00 00 00 00 00  d2 4d a1 58 00 00 07 00  =
|.........M.X....|
06b2a080  ff ff dc d8 00 00 00 00  00 00 00 00 00 f6 58 00  =
|..............X.|
06b2a090  00 00 00 00 41 9b 13 ac  01 81 00 00 00 00 00 00  =
|....A...........|
06b2a0a0  00 00 00 01 00 00 00 02  43 1b de 83 01 81 33 68  =
|........C.....3h|
06b2a0b0  01 81 00 00 01 81 00 00  00 00 00 00 ff ff dd f0  =
|................|
06b2a0c0  00 00 04 e2 ff ff dd 70  00 00 00 50 d2 4d a1 58  =
|.......p...P.M.X|
06b2a0d0  05 ad e0 00 01 81 33 60  41 a1 e5 68 0a 00 00 00  =
|......3`A..h....|
06b2a0e0  00 d2 7e 68 d2 4d a1 20  00 8e 7e 00 20 08 10 34  |..~h.M. =
..~. ..4|
                                   [   lr    ]

06b2a0f0  00 00 00 00 00 00 00 00  00 00 00 00 00 08 10 32  =
|...............2|

          [exception]
06b2a100  00 00 07 00 41 a1 e5 68  0a 00 00 00 fa 50 05 af  =
|....A..h.....P..|
06b2a110  fa 50 05 af fa 50 05 af  fa 50 05 af fa 50 05 af  =
|.P...P...P...P..|

0x1008ec <k_trap+280>:	isync
0x1008f0 <trapagain>:	addi    r3,r1,8
0x1008f4 <trapagain+4>:	bl      0x8e7c64 <powerpc_interrupt>
0x1008f8 <trapexit>:	mfmsr   r3
0x1008fc <trapexit+4>:	andi.   r3,r3,32767

0x8e7df0 <powerpc_interrupt+396>:	mfmsr   r0
0x8e7df4 <powerpc_interrupt+400>:	or      r0,r0,r9
0x8e7df8 <powerpc_interrupt+404>:	mtmsr   r0
0x8e7dfc <powerpc_interrupt+408>:	isync
0x8e7e00 <powerpc_interrupt+412>:	mr      r3,r25
0x8e7e04 <powerpc_interrupt+416>:	bl      0x8f231c <trap>
0x8e7e08 <powerpc_interrupt+420>:	lwz     r11,0(r1)


          [stkbckptr] [    lr   ]
06b2a030  d2 4d a0 60 fa 50 05 af  fa 50 05 af fa 50 05 af  =
|.M.`.P...P...P..|

(Unknown virtual to physical for 0xf15005af -> ?)

Then tmpstk ends up with:

          [stkbckptr] [    lr   ]
00c78f40  d2 4d a0 30 00 10 0c 54  00 00 07 00 d2 4d a0 30  =
|.M.0...T.....M.0|
00c78f50  05 ad e0 00 00 00 00 00  d2 4d a0 68 00 00 07 00  =
|.........M.h....|
00c78f60  ff ff dc d8 00 00 00 00  00 00 00 00 00 f6 58 00  =
|..............X.|
00c78f70  00 00 00 00 41 9b 13 ac  01 81 00 00 00 00 00 00  =
|....A...........|
00c78f80  00 00 00 01 00 00 00 02  43 1b de 83 01 81 33 68  =
|........C.....3h|
00c78f90  01 81 00 00 01 81 00 00  00 00 00 00 ff ff dd f0  =
|................|
00c78fa0  00 00 04 e2 ff ff dd 70  00 00 00 50 d2 4d a0 68  =
|.......p...P.M.h|
00c78fb0  05 ad e0 00 01 81 33 60  00 8e 7e 00 20 08 10 34  =
|......3`..~. ..4|
00c78fc0  00 00 10 32 d2 4d a0 30  00 8e 7e 00 00 08 10 32  =
|...2.M.0..~....2|
                                   [   lr    ]

00c78fd0  00 00 00 00 00 00 00 00  00 10 07 fc 00 00 10 32  =
|...............2|

          [exception]
00c78fe0  00 00 03 00 d2 4d 9f 70  42 00 00 00 01 c4 4f 00  =
|.....M.pB.....O.|
00c78ff0  00 00 00 00 00 10 01 40  00 00 00 00 00 00 00 00  =
|.......@........|

0x100c20 <dbtrap+240>:	mfxer   r3
0x100c24 <dbtrap+244>:	mfctr   r4
0x100c28 <dbtrap+248>:	mfsprg  r5,3
0x100c2c <dbtrap+252>:	stw     r3,144(r1)
0x100c30 <dbtrap+256>:	stw     r4,148(r1)
0x100c34 <dbtrap+260>:	stw     r5,160(r1)
0x100c38 <dbtrap+264>:	stw     r28,164(r1)
0x100c3c <dbtrap+268>:	stw     r29,168(r1)
0x100c40 <dbtrap+272>:	stw     r30,152(r1)
0x100c44 <dbtrap+276>:	stw     r31,156(r1)
0x100c48 <dbtrap+280>:	lwz     r2,0(r2)
0x100c4c <dbtrap+284>:	addi    r3,r1,8
0x100c50 <dbtrap+288>:	bl      0x8f1cdc <db_trap_glue>
0x100c54 <dbtrap+292>:	mr.     r3,r3
0x100c58 <dbtrap+296>:	bne-    0x100e3c <dbleave>
0x100c5c <dbtrap+300>:	lwz     r3,160(r1)

0x8e7df0 <powerpc_interrupt+396>:	mfmsr   r0
0x8e7df4 <powerpc_interrupt+400>:	or      r0,r0,r9
0x8e7df8 <powerpc_interrupt+404>:	mtmsr   r0
0x8e7dfc <powerpc_interrupt+408>:	isync
0x8e7e00 <powerpc_interrupt+412>:	mr      r3,r25
0x8e7e04 <powerpc_interrupt+416>:	bl      0x8f231c <trap>
0x8e7e08 <powerpc_interrupt+420>:	lwz     r11,0(r1)


Before the db> prompt it reports:

[ thread pid 960 tid 100110 ]
Stopped at k_trap+0x28: stuw r31,-0xc0(r1)

where (0x28=3D40 decimal):

0x001007d4 <k_trap+0>:	mfsprg  r31,0
0x001007d8 <k_trap+4>:	mfsrr0  r30
0x001007dc <k_trap+8>:	stw     r30,168(r31)
0x001007e0 <k_trap+12>:	mfsrr1  r30
0x001007e4 <k_trap+16>:	stw     r30,172(r31)
0x001007e8 <k_trap+20>:	mfmsr   r30
0x001007ec <k_trap+24>:	ori     r30,r30,50
0x001007f0 <k_trap+28>:	mtmsr   r30
0x001007f4 <k_trap+32>:	isync
0x001007f8 <k_trap+36>:	mfsprg  r31,1
0x001007fc <k_trap+40>:	stwu    r31,-192(r1)
0x00100800 <k_trap+44>:	stw     r0,8(r1)
0x00100804 <k_trap+48>:	stw     r31,12(r1)

(-192 decimal =3D -0xc0)

r1 reported as:  0xd24da030 .

dar reported as: 0xd24d9f70 .
(0xd24da030 - 0xc0 =3D0xd24d9f70)
So out of range for the thread's stack:
pid 960 tid 100110 "powerpd" with=20
stack 0xd24da000-0xd24ddfff (virtual).


=3D=3D=3D
Mark Millard
markmi at dsl-only.net