From owner-freebsd-arm@FreeBSD.ORG Tue Jan 28 13:55:30 2014 Return-Path: Delivered-To: freebsd-arm@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id A0FFCE7C for ; Tue, 28 Jan 2014 13:55:30 +0000 (UTC) Received: from smtp.hs-karlsruhe.de (smtp.HS-Karlsruhe.DE [193.196.64.25]) (using TLSv1 with cipher ECDHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 6387B1FAF for ; Tue, 28 Jan 2014 13:55:29 +0000 (UTC) Received: from iz-wera01.hs-karlsruhe.de ([193.196.65.46]) by smtp.hs-karlsruhe.de with esmtp (Exim 4.80.1) (envelope-from ) id 1W898M-0065FQ-3w; Tue, 28 Jan 2014 14:55:22 +0100 X-Mailer: exmh version 2.8.0 04/21/2012 with nmh-1.5 From: Ralf Wenk To: Andrew Turner Subject: Re: RaspberryPi panic with CURRENT r261183 (was: r260558) In-reply-to: <20140125113854.083d5f30@bender.Home> References: <20140125113854.083d5f30@bender.Home> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Date: Tue, 28 Jan 2014 14:55:20 +0100 Message-Id: Cc: freebsd-arm@freebsd.org X-BeenThere: freebsd-arm@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Porting FreeBSD to ARM processors." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 28 Jan 2014 13:55:30 -0000 Andrew Turner wrote: > > Can you try updating to at least r261137. There was a bug where > backtrace may not work correctly when it passes through exception_exit. > This won't fix your problem, but it may help track it down. I have updated world and system to r261183w ith activated INVARIANTS and INVARIANTS_SUPPORT. Repeated the whole cycle of NFS-mount, rsync(1)-ing, fetching the INDEX-file and calling portversion. Some ours later the system panics. I fsck(8)ed the filesystems without using the journal, repeated it and and it panics again in the same process after some hours. Rebooting, fsck(8)ing and updating ruby form source, which involves the same local filesystems and devices does not lead to a panic. Until now, the system survived more ours after this than with the rsync(1) update. This is what I get on the serial console: # mmcsd0: Error indicated: 1 Timeout g_vfs_done():mmcsd0s2a[READ(offset=268386304, length=4096)]error = 5 mmcsd0: Error indicated: 1 Timeout g_vfs_done():mmcsd0s2a[READ(offset=292880384, length=4096)]error = 5 mmcsd0: Error indicated: 1 Timeout g_vfs_done():mmcsd0s2a[READ(offset=268402688, length=4096)]error = 5 mmcsd0: Error indicated: 1 Timeout g_vfs_done():mmcsd0s2a[READ(offset=268406784, length=4096)]error = 5 mmcsd0: Error indicated: 1 Timeout g_vfs_done():mmcsd0s2a[READ(offset=268414976, length=4096)]error = 5 mmcsd0: Error indicated: 1 Timeout g_vfs_done():mmcsd0s2a[WRITE(offset=284360704, length=8192)]error = 5 mmcsd0: Error indicated: 1 Timeout g_vfs_done():mmcsd0s2a[WRITE(offset=284360704, length=8192)]error = 5 mmcsd0: Error indicated: 1 Timeout g_vfs_done():mmcsd0s2a[WRITE(offset=284360704, length=8192)]error = 5 mmcsd0: Error indicated: 1 Timeout g_vfs_done():mmcsd0s2a[WRITE(offset=284360704, length=8192)]error = 5 mmcsd0: Error indicated: 1 Timeout g_vfs_done():mmcsd0s2a[WRITE(offset=284360704, length=8192)]error = 5 mmcsd0: Error indicated: 1 Timeout g_vfs_done():mmcsd0s2a[WRITE(offset=284360704, length=8192)]error = 5 mmcsd0: Error indicated: 1 Timeout g_vfs_done():mmcsd0s2a[WRITE(offset=284360704, length=8192)]error = 5 mmcsd0: Error indicated: 1 Timeout g_vfs_done():mmcsd0s2a[WRITE(offset=284360704, length=8192)]error = 5 mmcsd0: Error indicated: 1 Timeout g_vfs_done():mmcsd0s2a[WRITE(offset=284360704, length=8192)]error = 5 mmcsd0: Error indicated: 1 Timeout g_vfs_done():mmcsd0s2a[WRITE(offset=284360704, length=8192)]error = 5 mmcsd0: Error indicated: 1 Timeout g_vfs_done():mmcsd0s2a[WRITE(offset=284360704, length=8192)]error = 5 mmcsd0: Error indicated: 1 Timeout g_vfs_done():mmcsd0s2a[WRITE(offset=284360704, length=8192)]error = 5 mmcsd0: Error indicated: 1 Timeout g_vfs_done():mmcsd0s2a[WRITE(offset=8439296, length=512)]error = 5 panic: brelse: inappropriate B_PAGING or B_CLUSTER bp 0xccab63f0 KDB: enter: panic [ thread pid 625 tid 100063 ] Stopped at $d: ldrb r15, [r15, r15, ror r15]! db> bt Tracing pid 625 tid 100063 td 0xc26bbc80 db_trace_self() at db_trace_self pc = 0xc041183c lr = 0xc012e754 (db_stack_trace+0xf4) sp = 0xddcb77a0 fp = 0xddcb77b8 r10 = 0xc04f8f70 db_stack_trace() at db_stack_trace+0xf4 pc = 0xc012e754 lr = 0xc012e0c0 (db_command+0x264) sp = 0xddcb77c0 fp = 0xddcb7860 r4 = 0x00000000 r5 = 0x00000000 r6 = 0xc046b23a db_command() at db_command+0x264 pc = 0xc012e0c0 lr = 0xc012de30 (db_command_loop+0x60) sp = 0xddcb7868 fp = 0xddcb7878 r4 = 0xc044a88c r5 = 0xc0464c08 r6 = 0xc05419fc r7 = 0xddcb7a48 r8 = 0xc26bbc80 r9 = 0xc0538424 r10 = 0xc04f91e0 db_command_loop() at db_command_loop+0x60 pc = 0xc012de30 lr = 0xc0130830 (db_trap+0xdc) sp = 0xddcb7880 fp = 0xddcb79a0 r4 = 0x00000000 r5 = 0xddcb7888 r6 = 0xc0538450 db_trap() at db_trap+0xdc pc = 0xc0130830 lr = 0xc027d894 (kdb_trap+0xd4) sp = 0xddcb79a8 fp = 0xddcb79c8 r4 = 0x00000000 r5 = 0x00000001 r6 = 0xc0538450 r7 = 0xddcb7a48 kdb_trap() at kdb_trap+0xd4 pc = 0xc027d894 lr = 0xc042468c (undefinedinstruction+0x2b0) sp = 0xddcb79d0 fp = 0xddcb7a40 r4 = 0x00000000 r5 = 0xc0424338 r6 = 0x00000000 r7 = 0xe7ffffff r8 = 0xc26bbc80 r9 = 0xddcb7a48 r10 = 0xc027d144 undefinedinstruction() at undefinedinstruction+0x2b0 pc = 0xc042468c lr = 0xc041364c (exception_exit) sp = 0xddcb7a48 fp = 0xddcb7aa0 r4 = 0xc0464c62 r5 = 0xddcb7af4 r6 = 0xc0470730 r7 = 0xc052a960 r8 = 0xc26bbc80 r9 = 0xc052a7c0 r10 = 0xc0543480 exception_exit() at exception_exit pc = 0xc041364c lr = 0xc027d138 (kdb_enter+0x40) sp = 0xddcb7a98 fp = 0xddcb7aa0 r0 = 0xc0538434 r1 = 0x00000000 r2 = 0xc046855b r3 = 0x000000ab r4 = 0xc0464c62 r5 = 0xddcb7af4 r6 = 0xc0470730 r7 = 0xc052a960 r8 = 0xc26bbc80 r9 = 0xc052a7c0 r10 = 0xc0543480 r12 = 0x00000000 $a() at $a pc = 0xc027d148 lr = 0xc024713c (vpanic+0xb8) sp = 0xddcb7aa8 fp = 0xddcb7ac8 r4 = 0x00000100 vpanic() at vpanic+0xb8 pc = 0xc024713c lr = 0xc0247074 ($d) sp = 0xddcb7ad0 fp = 0xddcb7ae8 r4 = 0xc052a860 r5 = 0xc0470730 r6 = 0xddcb7af4 r7 = 0xc052a7c0 r8 = 0x00000000 r9 = 0x05000040 r10 = 0xc274ed00 $d() at $d pc = 0xc0247074 lr = 0xc02cb6e0 (brelse+0x1f8) sp = 0xddcb7b00 fp = 0xddcb7b68 r4 = 0xccab63f0 r5 = 0x00000005 r6 = 0x00000000 r7 = 0xccab63f0 brelse() at brelse+0x1f8 pc = 0xc02cb6e0 lr = 0xc02c9670 (bufwrite+0x2e8) sp = 0xddcb7b70 fp = 0xddcb7ba8 r4 = 0xccab63f0 r5 = 0x00000005 r6 = 0x00000000 r7 = 0xc05437ec r8 = 0x00000000 r9 = 0x05000040 r10 = 0xc274ed00 bufwrite() at bufwrite+0x2e8 pc = 0xc02c9670 lr = 0xc03c70c4 (ffs_bufwrite+0x14c) sp = 0xddcb7bb0 fp = 0xddcb7bd0 r4 = 0xccab63f0 r5 = 0xccab63f0 r6 = 0xc26dea00 r7 = 0xd0260020 r8 = 0x00000000 r9 = 0xc27092b0 r10 = 0xc274ed00 ffs_bufwrite() at ffs_bufwrite+0x14c pc = 0xc03c70c4 lr = 0xc03bdcb0 ($a+0x2a0) sp = 0xddcb7bd8 fp = 0xddcb7c58 r4 = 0xc26dea00 r5 = 0xccab63f0 r6 = 0xc26dea00 $a() at $a+0x2a0 pc = 0xc03bdcb0 lr = 0xc03b30b8 ($a+0x84) sp = 0xddcb7c60 fp = 0xddcb7c80 r4 = 0xc3eae600 r5 = 0x00000001 r6 = 0x00000001 r7 = 0xc26dea00 r8 = 0xddcb7cb8 r9 = 0x00007ceb r10 = 0xc27092b0 $a() at $a+0x84 pc = 0xc03b30b8 lr = 0xc03bd274 (flush_deplist+0xc8) sp = 0xddcb7c88 fp = 0xddcb7ca0 r4 = 0xc29b4c80 r5 = 0x00000002 flush_deplist() at flush_deplist+0xc8 pc = 0xc03bd274 lr = 0xc03b9cd4 (softdep_sync_metadata+0x220) sp = 0xddcb7ca8 fp = 0xddcb7cd8 r4 = 0xc298cc00 r5 = 0xc0481b81 r6 = 0x00000002 r7 = 0xddcb7cb8 r8 = 0xc26bbc80 softdep_sync_metadata() at softdep_sync_metadata+0x220 pc = 0xc03b9cd4 lr = 0xc03c90dc (ffs_syncvnode+0x54) sp = 0xddcb7ce0 fp = 0xddcb7d30 r4 = 0xc277cd80 r5 = 0xc2985480 r6 = 0x00000000 r7 = 0xc2985480 r8 = 0xc26bbc80 r9 = 0xc2972320 r10 = 0x00000000 ffs_syncvnode() at ffs_syncvnode+0x54 pc = 0xc03c90dc lr = 0xc03c8434 (ffs_fsync+0x20) sp = 0xddcb7d38 fp = 0xddcb7d48 r4 = 0xddcb7d90 r5 = 0xc2985480 r6 = 0x00000000 r7 = 0xc04747ff r8 = 0xc26bbc80 r9 = 0xc2972320 r10 = 0x1ffffffc ffs_fsync() at ffs_fsync+0x20 pc = 0xc03c8434 lr = 0xc042ff94 (VOP_FSYNC_APV+0xd0) sp = 0xddcb7d50 fp = 0xddcb7d60 r4 = 0xddcb7d90 r5 = 0xc051d240 r6 = 0x00000000 r7 = 0xc04747ff VOP_FSYNC_APV() at VOP_FSYNC_APV+0xd0 pc = 0xc042ff94 lr = 0xc02f05e0 (sys_fsync+0x150) sp = 0xddcb7d68 fp = 0xddcb7db8 r4 = 0xc26bbc80 r5 = 0xc27387c0 r6 = 0xc2985480 sys_fsync() at sys_fsync+0x150 pc = 0xc02f05e0 lr = 0xc0423b50 (swi_handler+0x284) sp = 0xddcb7dc0 fp = 0xddcb7e58 r4 = 0xc26bbc80 r5 = 0x00000000 r6 = 0x00000000 r7 = 0x00000000 r8 = 0xddcb7e10 swi_handler() at swi_handler+0x284 pc = 0xc0423b50 lr = 0xc0413470 (swi_entry+0x2c) sp = 0xddcb7e60 fp = 0xbfffee30 r4 = 0x2084ba00 r5 = 0x0000006a r6 = 0x00000000 r7 = 0x0000005f r8 = 0xbfffe483 r9 = 0x00000000 swi_entry() at swi_entry+0x2c pc = 0xc0413470 lr = 0xc0413470 (swi_entry+0x2c) sp = 0xddcb7e60 fp = 0xbfffee30 Unable to unwind further db> sh proc 625 Process 625 (syslogd) at 0xc2972320: state: NORMAL uid: 0 gids: 0 parent: pid 1 at 0xc253b640 ABI: FreeBSD ELF32 arguments: /usr/sbin/syslogd threads: 1 100063 Run CPU 0 syslogd db> sh thread 100063 Thread 100063 at 0xc26bbc80: proc (pid 625): 0xc2972320 name: syslogd stack: 0xddcb6000-0xddcb7fff flags: 0x1000004 pflags: 0 state: RUNNING (CPU 0) priority: 92 container lock: sched lock (0xc0543680) db> Ralf