Skip site navigation (1)Skip section navigation (2)
Date:      Tue, 28 Jan 2014 14:55:20 +0100
From:      Ralf Wenk <iz-rpi03@hs-karlsruhe.de>
To:        Andrew Turner <andrew@fubar.geek.nz>
Cc:        freebsd-arm@freebsd.org
Subject:   Re: RaspberryPi panic with CURRENT r261183 (was: r260558)
Message-ID:  <E1W898M-0065FQ-3w@smtp.hs-karlsruhe.de>
In-Reply-To: <20140125113854.083d5f30@bender.Home>
References:  <E1W6gx2-006Gys-Pp@smtp.hs-karlsruhe.de>  <20140125113854.083d5f30@bender.Home>

next in thread | previous in thread | raw e-mail | index | archive | help
Andrew Turner <andrew@fubar.geek.nz> wrote:
>
> Can you try updating to at least r261137. There was a bug where
> backtrace may not work correctly when it passes through exception_exit.
> This won't fix your problem, but it may help track it down.

I have updated world and system to r261183w ith activated INVARIANTS and
INVARIANTS_SUPPORT. Repeated the whole cycle of NFS-mount, rsync(1)-ing,
fetching the INDEX-file and calling portversion.

Some ours later the system panics. I fsck(8)ed the filesystems without using
the journal, repeated it and and it panics again in the same process after
some hours.

Rebooting, fsck(8)ing and updating ruby form source, which involves the same
local filesystems and devices does not lead to a panic. Until now, the system
survived more ours after this than with the rsync(1) update.

This is what I get on the serial console:

# mmcsd0: Error indicated: 1 Timeout
g_vfs_done():mmcsd0s2a[READ(offset=268386304, length=4096)]error = 5
mmcsd0: Error indicated: 1 Timeout
g_vfs_done():mmcsd0s2a[READ(offset=292880384, length=4096)]error = 5
mmcsd0: Error indicated: 1 Timeout
g_vfs_done():mmcsd0s2a[READ(offset=268402688, length=4096)]error = 5
mmcsd0: Error indicated: 1 Timeout
g_vfs_done():mmcsd0s2a[READ(offset=268406784, length=4096)]error = 5
mmcsd0: Error indicated: 1 Timeout
g_vfs_done():mmcsd0s2a[READ(offset=268414976, length=4096)]error = 5
mmcsd0: Error indicated: 1 Timeout
g_vfs_done():mmcsd0s2a[WRITE(offset=284360704, length=8192)]error = 5
mmcsd0: Error indicated: 1 Timeout
g_vfs_done():mmcsd0s2a[WRITE(offset=284360704, length=8192)]error = 5
mmcsd0: Error indicated: 1 Timeout
g_vfs_done():mmcsd0s2a[WRITE(offset=284360704, length=8192)]error = 5
mmcsd0: Error indicated: 1 Timeout
g_vfs_done():mmcsd0s2a[WRITE(offset=284360704, length=8192)]error = 5
mmcsd0: Error indicated: 1 Timeout
g_vfs_done():mmcsd0s2a[WRITE(offset=284360704, length=8192)]error = 5
mmcsd0: Error indicated: 1 Timeout
g_vfs_done():mmcsd0s2a[WRITE(offset=284360704, length=8192)]error = 5
mmcsd0: Error indicated: 1 Timeout
g_vfs_done():mmcsd0s2a[WRITE(offset=284360704, length=8192)]error = 5
mmcsd0: Error indicated: 1 Timeout
g_vfs_done():mmcsd0s2a[WRITE(offset=284360704, length=8192)]error = 5
mmcsd0: Error indicated: 1 Timeout
g_vfs_done():mmcsd0s2a[WRITE(offset=284360704, length=8192)]error = 5
mmcsd0: Error indicated: 1 Timeout
g_vfs_done():mmcsd0s2a[WRITE(offset=284360704, length=8192)]error = 5
mmcsd0: Error indicated: 1 Timeout
g_vfs_done():mmcsd0s2a[WRITE(offset=284360704, length=8192)]error = 5
mmcsd0: Error indicated: 1 Timeout
g_vfs_done():mmcsd0s2a[WRITE(offset=284360704, length=8192)]error = 5
mmcsd0: Error indicated: 1 Timeout
g_vfs_done():mmcsd0s2a[WRITE(offset=8439296, length=512)]error = 5
panic: brelse: inappropriate B_PAGING or B_CLUSTER bp 0xccab63f0
KDB: enter: panic
[ thread pid 625 tid 100063 ]
Stopped at      $d:     ldrb    r15, [r15, r15, ror r15]!
db> bt
Tracing pid 625 tid 100063 td 0xc26bbc80
db_trace_self() at db_trace_self
         pc = 0xc041183c  lr = 0xc012e754 (db_stack_trace+0xf4)
         sp = 0xddcb77a0  fp = 0xddcb77b8
        r10 = 0xc04f8f70
db_stack_trace() at db_stack_trace+0xf4
         pc = 0xc012e754  lr = 0xc012e0c0 (db_command+0x264)
         sp = 0xddcb77c0  fp = 0xddcb7860
         r4 = 0x00000000  r5 = 0x00000000
         r6 = 0xc046b23a
db_command() at db_command+0x264
         pc = 0xc012e0c0  lr = 0xc012de30 (db_command_loop+0x60)
         sp = 0xddcb7868  fp = 0xddcb7878
         r4 = 0xc044a88c  r5 = 0xc0464c08
         r6 = 0xc05419fc  r7 = 0xddcb7a48
         r8 = 0xc26bbc80  r9 = 0xc0538424
        r10 = 0xc04f91e0
db_command_loop() at db_command_loop+0x60
         pc = 0xc012de30  lr = 0xc0130830 (db_trap+0xdc)
         sp = 0xddcb7880  fp = 0xddcb79a0
         r4 = 0x00000000  r5 = 0xddcb7888
         r6 = 0xc0538450
db_trap() at db_trap+0xdc
         pc = 0xc0130830  lr = 0xc027d894 (kdb_trap+0xd4)
         sp = 0xddcb79a8  fp = 0xddcb79c8
         r4 = 0x00000000  r5 = 0x00000001
         r6 = 0xc0538450  r7 = 0xddcb7a48
kdb_trap() at kdb_trap+0xd4
         pc = 0xc027d894  lr = 0xc042468c (undefinedinstruction+0x2b0)
         sp = 0xddcb79d0  fp = 0xddcb7a40
         r4 = 0x00000000  r5 = 0xc0424338
         r6 = 0x00000000  r7 = 0xe7ffffff
         r8 = 0xc26bbc80  r9 = 0xddcb7a48
        r10 = 0xc027d144
undefinedinstruction() at undefinedinstruction+0x2b0
         pc = 0xc042468c  lr = 0xc041364c (exception_exit)
         sp = 0xddcb7a48  fp = 0xddcb7aa0
         r4 = 0xc0464c62  r5 = 0xddcb7af4
         r6 = 0xc0470730  r7 = 0xc052a960
         r8 = 0xc26bbc80  r9 = 0xc052a7c0
        r10 = 0xc0543480
exception_exit() at exception_exit
         pc = 0xc041364c  lr = 0xc027d138 (kdb_enter+0x40)
         sp = 0xddcb7a98  fp = 0xddcb7aa0
         r0 = 0xc0538434  r1 = 0x00000000
         r2 = 0xc046855b  r3 = 0x000000ab
         r4 = 0xc0464c62  r5 = 0xddcb7af4
         r6 = 0xc0470730  r7 = 0xc052a960
         r8 = 0xc26bbc80  r9 = 0xc052a7c0
        r10 = 0xc0543480 r12 = 0x00000000
$a() at $a
         pc = 0xc027d148  lr = 0xc024713c (vpanic+0xb8)
         sp = 0xddcb7aa8  fp = 0xddcb7ac8
         r4 = 0x00000100
vpanic() at vpanic+0xb8
         pc = 0xc024713c  lr = 0xc0247074 ($d)
         sp = 0xddcb7ad0  fp = 0xddcb7ae8
         r4 = 0xc052a860  r5 = 0xc0470730
         r6 = 0xddcb7af4  r7 = 0xc052a7c0
         r8 = 0x00000000  r9 = 0x05000040
        r10 = 0xc274ed00
$d() at $d
         pc = 0xc0247074  lr = 0xc02cb6e0 (brelse+0x1f8)
         sp = 0xddcb7b00  fp = 0xddcb7b68
         r4 = 0xccab63f0  r5 = 0x00000005
         r6 = 0x00000000  r7 = 0xccab63f0
brelse() at brelse+0x1f8
         pc = 0xc02cb6e0  lr = 0xc02c9670 (bufwrite+0x2e8)
         sp = 0xddcb7b70  fp = 0xddcb7ba8
         r4 = 0xccab63f0  r5 = 0x00000005
         r6 = 0x00000000  r7 = 0xc05437ec
         r8 = 0x00000000  r9 = 0x05000040
        r10 = 0xc274ed00
bufwrite() at bufwrite+0x2e8
         pc = 0xc02c9670  lr = 0xc03c70c4 (ffs_bufwrite+0x14c)
         sp = 0xddcb7bb0  fp = 0xddcb7bd0
         r4 = 0xccab63f0  r5 = 0xccab63f0
         r6 = 0xc26dea00  r7 = 0xd0260020
         r8 = 0x00000000  r9 = 0xc27092b0
        r10 = 0xc274ed00
ffs_bufwrite() at ffs_bufwrite+0x14c
         pc = 0xc03c70c4  lr = 0xc03bdcb0 ($a+0x2a0)
         sp = 0xddcb7bd8  fp = 0xddcb7c58
         r4 = 0xc26dea00  r5 = 0xccab63f0
         r6 = 0xc26dea00
$a() at $a+0x2a0
         pc = 0xc03bdcb0  lr = 0xc03b30b8 ($a+0x84)
         sp = 0xddcb7c60  fp = 0xddcb7c80
         r4 = 0xc3eae600  r5 = 0x00000001
         r6 = 0x00000001  r7 = 0xc26dea00
         r8 = 0xddcb7cb8  r9 = 0x00007ceb
        r10 = 0xc27092b0
$a() at $a+0x84
         pc = 0xc03b30b8  lr = 0xc03bd274 (flush_deplist+0xc8)
         sp = 0xddcb7c88  fp = 0xddcb7ca0
         r4 = 0xc29b4c80  r5 = 0x00000002
flush_deplist() at flush_deplist+0xc8
         pc = 0xc03bd274  lr = 0xc03b9cd4 (softdep_sync_metadata+0x220)
         sp = 0xddcb7ca8  fp = 0xddcb7cd8
         r4 = 0xc298cc00  r5 = 0xc0481b81
         r6 = 0x00000002  r7 = 0xddcb7cb8
         r8 = 0xc26bbc80
softdep_sync_metadata() at softdep_sync_metadata+0x220
         pc = 0xc03b9cd4  lr = 0xc03c90dc (ffs_syncvnode+0x54)
         sp = 0xddcb7ce0  fp = 0xddcb7d30
         r4 = 0xc277cd80  r5 = 0xc2985480
         r6 = 0x00000000  r7 = 0xc2985480
         r8 = 0xc26bbc80  r9 = 0xc2972320
        r10 = 0x00000000
ffs_syncvnode() at ffs_syncvnode+0x54
         pc = 0xc03c90dc  lr = 0xc03c8434 (ffs_fsync+0x20)
         sp = 0xddcb7d38  fp = 0xddcb7d48
         r4 = 0xddcb7d90  r5 = 0xc2985480
         r6 = 0x00000000  r7 = 0xc04747ff
         r8 = 0xc26bbc80  r9 = 0xc2972320
        r10 = 0x1ffffffc
ffs_fsync() at ffs_fsync+0x20
         pc = 0xc03c8434  lr = 0xc042ff94 (VOP_FSYNC_APV+0xd0)
         sp = 0xddcb7d50  fp = 0xddcb7d60
         r4 = 0xddcb7d90  r5 = 0xc051d240
         r6 = 0x00000000  r7 = 0xc04747ff
VOP_FSYNC_APV() at VOP_FSYNC_APV+0xd0
         pc = 0xc042ff94  lr = 0xc02f05e0 (sys_fsync+0x150)
         sp = 0xddcb7d68  fp = 0xddcb7db8
         r4 = 0xc26bbc80  r5 = 0xc27387c0
         r6 = 0xc2985480
sys_fsync() at sys_fsync+0x150
         pc = 0xc02f05e0  lr = 0xc0423b50 (swi_handler+0x284)
         sp = 0xddcb7dc0  fp = 0xddcb7e58
         r4 = 0xc26bbc80  r5 = 0x00000000
         r6 = 0x00000000  r7 = 0x00000000
         r8 = 0xddcb7e10
swi_handler() at swi_handler+0x284
         pc = 0xc0423b50  lr = 0xc0413470 (swi_entry+0x2c)
         sp = 0xddcb7e60  fp = 0xbfffee30
         r4 = 0x2084ba00  r5 = 0x0000006a
         r6 = 0x00000000  r7 = 0x0000005f
         r8 = 0xbfffe483  r9 = 0x00000000
swi_entry() at swi_entry+0x2c
         pc = 0xc0413470  lr = 0xc0413470 (swi_entry+0x2c)
         sp = 0xddcb7e60  fp = 0xbfffee30
Unable to unwind further
db> sh proc 625
Process 625 (syslogd) at 0xc2972320:
 state: NORMAL
 uid: 0  gids: 0
 parent: pid 1 at 0xc253b640
 ABI: FreeBSD ELF32
 arguments: /usr/sbin/syslogd
 threads: 1
100063                   Run     CPU 0               syslogd
db> sh thread 100063
Thread 100063 at 0xc26bbc80:
 proc (pid 625): 0xc2972320
 name: syslogd
 stack: 0xddcb6000-0xddcb7fff
 flags: 0x1000004  pflags: 0
 state: RUNNING (CPU 0)
 priority: 92
 container lock: sched lock (0xc0543680)
db> 


Ralf




Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?E1W898M-0065FQ-3w>