From owner-freebsd-arm@freebsd.org Sun Aug 30 02:52:50 2015 Return-Path: Delivered-To: freebsd-arm@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 63ABC9C5D4F for ; Sun, 30 Aug 2015 02:52:50 +0000 (UTC) (envelope-from fbsd@www.zefox.net) Received: from www.zefox.net (www.zefox.net [69.239.235.194]) (using TLSv1 with cipher DHE-RSA-CAMELLIA256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id CD2C7C0F for ; Sun, 30 Aug 2015 02:52:49 +0000 (UTC) (envelope-from fbsd@www.zefox.net) Received: from www.zefox.net (localhost [127.0.0.1]) by www.zefox.net (8.14.9/8.14.5) with ESMTP id t7U2qh2G030046; Sat, 29 Aug 2015 19:52:43 -0700 (PDT) (envelope-from fbsd@www.zefox.net) Received: (from fbsd@localhost) by www.zefox.net (8.14.9/8.14.5/Submit) id t7U2qhBl030045; Sat, 29 Aug 2015 19:52:43 -0700 (PDT) (envelope-from fbsd) Date: Sat, 29 Aug 2015 19:52:43 -0700 From: bob prohaska To: freebsd-arm@freebsd.org Subject: Another RPI2 installworld crash with backtrace and logfile Message-ID: <20150830025243.GL53136@www.zefox.net> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline User-Agent: Mutt/1.4.2.3i X-BeenThere: freebsd-arm@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: "Porting FreeBSD to ARM processors." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 30 Aug 2015 02:52:50 -0000 Here's another RPI2 crash during installworld. Uname -a reports FreeBSD www.zefox.org 11.0-CURRENT FreeBSD 11.0-CURRENT #46 r287241M: Fri Aug 28 12:30:06 PDT 2015 bob@www.zefox.org:/usr/obj/usr/src/sys/RPI2 arm This time world and kernel were in sync. Still no output visible from sysctl hw.mmc.debug=1 sysctl hw.sdhci.debug=1 The smsc0 warnings started yesterday while playing with /usr/ports/sysutils/stress. The machine sent a couple of emails complaining about unlink: saved-entropy.8: No such file or directory mv: saved-entropy.5: No such file or directory mv: saved-entropy.4: No such file or directory mv: saved-entropy.2: No such file or directory while stress was running, but nothing else happened. Since it wouldn't crash, svnlite update /usr/src was run and the build commenced. It very slowly worked through buildworld, buildkernel and crashed during installworldworld, installworld's last words were: install -o root -g wheel -m 444 verify_krb5_conf.8.gz /usr/share/man/man8 ===> kerberos5/usr.sbin (install) --- _sub.realinstall --- ===> kerberos5/usr.sbin/iprop-log (install) --- _proginstall --- --- _maninstall --- --- _proginstall --- install -s -o root -g wheel -m 555 iprop-log /usr/sbin/iprop-log --- _maninstall --- install -o root -g wheel -m 444 iprop-log.8.gz /usr/share/man/man8 The console output and backtrace follow. smsc0: warning: MII is busy smsc0: warning: Failed to write register 0x114 smsc0: warning: Failed to read register 0x114 smsc0: warning: MII is busy sdhci_bcm0-slot0: Controller timeout sdhci_bcm0-slot0: ============== REGISTER DUMP ============== sdhci_bcm0-slot0: Sys addr: 0x02012c00 | Version: 0x00009902 sdhci_bcm0-slot0: Blk size: 0x00000200 | Blk cnt: 0x00000099 sdhci_bcm0-slot0: Argument: 0x00173000 | Trn mode: 0x0000193a sdhci_bcm0-slot0: Present: 0x01ff0506 | Host ctl: 0x00000003 sdhci_bcm0-slot0: Power: 0x0000000f | Blk gap: 0x00000000 sdhci_bcm0-slot0: Wake-up: 0x00000000 | Clock: 0x00000307 sdhci_bcm0-slot0: Timeout: 0x0000000e | Int stat: 0x00000010 sdhci_bcm0-slot0: Int enab: 0x01ff00fb | Sig enab: 0x01ff00fb sdhci_bcm0-slot0: AC12 err: 0x00000000 | Slot int: 0x00000001 sdhci_bcm0-slot0: Caps: 0x00000000 | Max curr: 0x00000001 sdhci_bcm0-slot0: =========================================== mmc0: CMD25 RESULT: 1 mmcsd0: Error indicated: 1 Timeout g_vfs_done():mmcsd0s2a[WRITE(offset=725549056, length=131072)]error = 5 mmc0: CMD25 RESULT: 1 mmcsd0: Error indicated: 1 Timeout mmc0: CMD25 RESULT: 1 mmcsd0: Error indicated: 1 Timeout mmc0: CMD25 RESULT: 1 mmcsd0: Error indicated: 1 Timeout mmc0: CMD25 RESULT: 1 mmcsd0: Error indicated: 1 Timeout mmc0: CMD25 RESULT: 1 mmc0: CMD25 RESULT: 1 mmc0: CMD25 RESULT: 1 mmc0: CMD25 RESULT: 1 mmc0: CMD25 RESULT: 1 mmc0: CMD25 RESULT: 1 mmc0: CMD25 RESULT: 1 mmc0: CMD25 RESULT: 1 mmc0: CMD25 RESULT: 1 mmc0: CMD25 RESULT: 1 mmc0: CMD25 RESULT: 1 mmc0: CMD24 RESULT: 1 mmc0: CMD24 RESULT: 1 mmc0: CMD25 RESULT: 1 g_vfs_done():mmcsd0s2a[WRITE(offset=725680128, length=131072)]error = 5 g_vfs_done():mmcsd0s2a[WRITE(offset=725811200, length=131072)]error = 5 g_vfs_done():mmcsd0s2a[WRITE(offset=725942272, length=131072)]error = 5 g_vfs_done():mmcsd0s2a[WRITE(offset=726073344, length=131072)]error = 5 g_vfs_done():mmcsd0s2a[WRITE(offset=726204416, length=131072)]error = 5 g_vfs_done():mmcsd0s2a[WRITE(offset=726335488, length=131072)]error = 5 g_vfs_done():mmcsd0s2a[WRITE(offset=726466560, length=131072)]error = 5 g_vfs_done():mmcsd0s2a[WRITE(offset=726597632, length=131072)]error = 5 g_vfs_done():mmcsd0s2a[WRITE(offset=726728704, length=131072)]error = 5 g_vfs_done():mmcsd0s2a[WRITE(offset=726859776, length=131072)]error = 5 g_vfs_done():mmcsd0s2a[WRITE(offset=726990848, length=131072)]error = 5 g_vfs_done():mmcsd0s2a[WRITE(offset=727121920, length=131072)]error = 5 g_vfs_done():mmcsd0s2a[WRITE(offset=727252992, length=131072)]error = 5 g_vfs_done():mmcsd0s2a[WRITE(offset=20925952, length=2048)]error = 5 panic: brelse: inappropriate B_PAGING or B_CLUSTER bp 0xd75cdb88 cpuid = 0 KDB: enter: panic [ thread pid 12 tid 100014 ] Stopped at $d.7: ldrb r15, [r15, r15, ror r15]! db> bt Tracing pid 12 tid 100014 td 0xc39fd360 db_trace_self() at db_trace_self pc = 0xc05439ac lr = 0xc0141038 (db_stack_trace+0x108) sp = 0xd69e19d8 fp = 0xd69e19f0 r10 = 0xc07885f8 db_stack_trace() at db_stack_trace+0x108 pc = 0xc0141038 lr = 0xc0140a84 (db_command+0x388) sp = 0xd69e19f8 fp = 0xd69e1a98 r4 = 0x00000000 r5 = 0x00000000 r6 = 0x00000000 r10 = 0xc07885f8 db_command() at db_command+0x388 pc = 0xc0140a84 lr = 0xc01406ec (db_command_loop+0x74) sp = 0xd69e1aa0 fp = 0xd69e1ab0 r4 = 0xc05aa958 r5 = 0xc05cba03 r6 = 0xc07885e4 r7 = 0xd69e1c80 r8 = 0xc077d620 r9 = 0xc0693ea4 r10 = 0xc077d624 db_command_loop() at db_command_loop+0x74 pc = 0xc01406ec lr = 0xc014321c (db_trap+0x108) sp = 0xd69e1ab8 fp = 0xd69e1bd0 r4 = 0x00000000 r5 = 0xc07885f0 r6 = 0xc077d648 r10 = 0xc077d624 db_trap() at db_trap+0x108 pc = 0xc014321c lr = 0xc02eb6ec (kdb_trap+0x184) sp = 0xd69e1bd8 fp = 0xd69e1c00 r4 = 0x00000000 r5 = 0x00000001 r6 = 0xc077d648 r7 = 0xd69e1c80 kdb_trap() at kdb_trap+0x184 pc = 0xc02eb6ec lr = 0xc055ba9c (undefinedinstruction+0x344) sp = 0xd69e1c08 fp = 0xd69e1c78 r4 = 0x00000000 r5 = 0x00000000 r6 = 0xc055b6a8 r7 = 0xe7ffffff r8 = 0xc39fd360 r9 = 0xc02eae44 r10 = 0xd69e1c80 undefinedinstruction() at undefinedinstruction+0x344 pc = 0xc055ba9c lr = 0xc0545034 (exception_exit) sp = 0xd69e1c80 fp = 0xd69e1d18 r4 = 0xc05cba58 r5 = 0x00000001 r6 = 0xc076e0e0 r7 = 0xc076e278 r8 = 0xd69e1d6c r9 = 0xc078a3a0 r10 = 0xc39fd360 exception_exit() at exception_exit pc = 0xc0545034 lr = 0xc02eae34 (kdb_enter+0x48) sp = 0xd69e1d10 fp = 0xd69e1d18 r0 = 0xc077d634 r1 = 0x00000000 r2 = 0xd69e1c44 r3 = 0xc05cfb1d r4 = 0xc05cba58 r5 = 0x00000001 r6 = 0xc076e0e0 r7 = 0xc076e278 r8 = 0xd69e1d6c r9 = 0xc078a3a0 r10 = 0xc39fd360 r12 = 0xc06aec58 $a.8() at $a.8 pc = 0xc02eae48 lr = 0xc02adfb0 (vpanic+0x164) sp = 0xd69e1d20 fp = 0xd69e1d40 r4 = 0x00000100 r10 = 0xc39fd360 vpanic() at vpanic+0x164 pc = 0xc02adfb0 lr = 0xc02ade4c (vpanic) sp = 0xd69e1d48 fp = 0xd69e1d60 r4 = 0xc076e178 r5 = 0xc05d8170 r6 = 0xd69e1d6c r7 = 0xc076e0e0 r8 = 0xc078979c r9 = 0xc05bd467 r10 = 0x00000000 vpanic() at vpanic pc = 0xc02ade4c lr = 0xc033bd5c (brelse+0x6f0) sp = 0xd69e1d68 fp = 0xd69e1dd8 r4 = 0xc02ade4c r5 = 0xc541a1f8 r6 = 0xd69e1d6c r7 = 0xd75cdb88 r8 = 0xc42c73d4 r9 = 0xd75cdb88 r10 = 0xc076c184 brelse() at brelse+0x6f0 pc = 0xc033bd5c lr = 0xc033f5c0 (bufdone+0x58) sp = 0xd69e1de0 fp = 0xd69e1de8 r4 = 0xd75cdb88 r5 = 0xc42c73d4 r6 = 0xc076c140 r7 = 0xc076c184 r8 = 0xc078979c r9 = 0xc05bd467 r10 = 0x00000000 bufdone() at bufdone+0x58 pc = 0xc033f5c0 lr = 0xc023cc34 (g_io_schedule_up+0xe4) sp = 0xd69e1df0 fp = 0xd69e1e20 r4 = 0xc05bf7ad r5 = 0xc541a1f8 g_io_schedule_up() at g_io_schedule_up+0xe4 pc = 0xc023cc34 lr = 0xc023d35c (g_up_procbody+0x78) sp = 0xd69e1e28 fp = 0xd69e1e30 r4 = 0xc05bfbcf r5 = 0xc076c1ac r6 = 0xc023d2e4 r7 = 0x00000000 r8 = 0xd69e1e58 r9 = 0x00000000 r10 = 0x00000000 g_up_procbody() at g_up_procbody+0x78 pc = 0xc023d35c lr = 0xc027b144 (fork_exit+0xa0) sp = 0xd69e1e38 fp = 0xd69e1e50 r4 = 0xc39fd360 r5 = 0xc3958000 fork_exit() at fork_exit+0xa0 pc = 0xc027b144 lr = 0xc0544fc4 (swi_exit) sp = 0xd69e1e58 fp = 0x00000000 r4 = 0xc023d2e4 r5 = 0x00000000 r6 = 0x00000000 r7 = 0x00000000 r8 = 0x00000000 r10 = 0x00000000 swi_exit() at swi_exit pc = 0xc0544fc4 lr = 0xc0544fc4 (swi_exit) sp = 0xd69e1e58 fp = 0x00000000 db> In case it's useful, here is the transcript of the recovery. It's a little odd that fsck needs to be re-run individually for da0p1 and da0p4 on the hard disk. They appear in /etc/fstab thus: /dev/mmcsd0s1 /boot/msdos msdosfs rw,noatime 0 0 /dev/mmcsd0s2a / ufs rw,noatime 1 1 #md /tmp mfs rw,noatime,-s50m 0 0 #md /var/log mfs rw,noatime,-s15m 0 0 #md /var/tmp mfs rw,noatime,-s5m 0 0 /dev/da0p4 /tmp ufs rw,noatime 0 0 /dev/da0p3 /usr ufs rw,noatime,late,failok 1 2 /dev/da0p2 none swap sw 0 0 /dev/da0p1 /var ufs rw,noatime 0 0 Enter full pathname of shell or RETURN for /bin/sh: # fsck -y ** /dev/mmcsd0s2a USE JOURNAL? yes ** SU+J Recovering /dev/mmcsd0s2a ** Reading 4194304 byte journal from inode 4. RECOVER? yes ** Building recovery table. ** Resolving unreferenced inode list. ** Processing journal entries. WRITE CHANGES? yes ** 115 journal records in 5632 bytes for 65.34% utilization ** Freed 16 inodes (0 dirs) 203 blocks, and 46 frags. ***** FILE SYSTEM MARKED CLEAN ***** ** /dev/da0p3 ** Last Mounted on /usr ** Phase 1 - Check Blocks and Sizes INCORRECT BLOCK COUNT I=2332336 (8 should be 0) CORRECT? yes INCORRECT BLOCK COUNT I=3049740 (48 should be 0) CORRECT? yes ** Phase 2 - Check Pathnames ** Phase 3 - Check Connectivity ** Phase 4 - Check Reference Counts UNREF FILE I=2086739 OWNER=root MODE=100555 SIZE=3629 MTIME=Aug 29 18:35 2015 RECONNECT? yes UNREF FILE I=2086744 OWNER=root MODE=100555 SIZE=9508 MTIME=Aug 29 18:35 2015 RECONNECT? yes UNREF FILE I=2086858 OWNER=root MODE=100555 SIZE=12652 MTIME=Aug 29 18:36 2015 RECONNECT? yes UNREF FILE I=2086968 OWNER=root MODE=100555 SIZE=8148 MTIME=Aug 29 18:36 2015 RECONNECT? yes UNREF FILE I=2086969 OWNER=root MODE=100555 SIZE=16168 MTIME=Aug 29 18:36 2015 RECONNECT? yes UNREF FILE I=2175928 OWNER=root MODE=100555 SIZE=24104 MTIME=Aug 28 12:36 2015 CLEAR? yes UNREF FILE I=2254598 OWNER=root MODE=100444 SIZE=34080 MTIME=Aug 28 12:34 2015 CLEAR? yes UNREF FILE I=2254639 OWNER=root MODE=100444 SIZE=5256 MTIME=Aug 28 12:34 2015 CLEAR? yes UNREF FILE I=2254655 OWNER=root MODE=100444 SIZE=6884 MTIME=Aug 28 12:34 2015 CLEAR? yes UNREF FILE I=2254658 OWNER=root MODE=100444 SIZE=5520 MTIME=Aug 28 12:34 2015 CLEAR? yes UNREF FILE I=2254737 OWNER=root MODE=100444 SIZE=32472 MTIME=Aug 28 12:35 2015 CLEAR? yes UNREF FILE I=2254799 OWNER=root MODE=100444 SIZE=268356 MTIME=Aug 28 12:38 2015 CLEAR? yes UNREF FILE I=2254811 OWNER=root MODE=100444 SIZE=16988 MTIME=Aug 28 12:35 2015 CLEAR? yes UNREF FILE I=2254855 OWNER=root MODE=100444 SIZE=558440 MTIME=Aug 28 12:38 2015 CLEAR? yes UNREF FILE I=2254856 OWNER=root MODE=100444 SIZE=107312 MTIME=Aug 28 12:38 2015 CLEAR? yes UNREF FILE I=2254872 OWNER=root MODE=100444 SIZE=49404 MTIME=Aug 28 12:38 2015 CLEAR? yes UNREF FILE I=2254880 OWNER=root MODE=100444 SIZE=425320 MTIME=Aug 28 12:38 2015 CLEAR? yes UNREF FILE I=2254931 OWNER=root MODE=100444 SIZE=64756 MTIME=Aug 28 12:38 2015 CLEAR? yes UNREF FILE I=2255025 OWNER=root MODE=100444 SIZE=159880 MTIME=Aug 28 12:38 2015 CLEAR? yes UNREF FILE I=2255033 OWNER=root MODE=100444 SIZE=11340 MTIME=Aug 28 12:38 2015 CLEAR? yes UNREF FILE I=2255042 OWNER=root MODE=100444 SIZE=7464 MTIME=Aug 28 12:38 2015 CLEAR? yes UNREF FILE I=2255174 OWNER=root MODE=100444 SIZE=319376 MTIME=Aug 28 12:34 2015 CLEAR? yes UNREF FILE I=2255480 OWNER=root MODE=100444 SIZE=106344 MTIME=Aug 28 12:34 2015 CLEAR? yes UNREF FILE I=2255501 OWNER=root MODE=100444 SIZE=5600 MTIME=Aug 28 12:34 2015 CLEAR? yes UNREF FILE I=2255562 OWNER=root MODE=100444 SIZE=33624 MTIME=Aug 28 12:34 2015 CLEAR? yes UNREF FILE I=2255573 OWNER=root MODE=100444 SIZE=4568 MTIME=Aug 28 12:35 2015 CLEAR? yes UNREF FILE I=2255581 OWNER=root MODE=100444 SIZE=6156 MTIME=Aug 28 12:35 2015 CLEAR? yes UNREF FILE I=2255583 OWNER=root MODE=100444 SIZE=7892 MTIME=Aug 28 12:35 2015 CLEAR? yes UNREF FILE I=2255585 OWNER=root MODE=100444 SIZE=4860 MTIME=Aug 28 12:35 2015 CLEAR? yes UNREF FILE I=2255587 OWNER=root MODE=100444 SIZE=4816 MTIME=Aug 28 12:35 2015 CLEAR? yes UNREF FILE I=2255589 OWNER=root MODE=100444 SIZE=4212 MTIME=Aug 28 12:35 2015 CLEAR? yes UNREF FILE I=2255593 OWNER=root MODE=100444 SIZE=3620 MTIME=Aug 28 12:35 2015 CLEAR? yes UNREF FILE I=2255599 OWNER=root MODE=100444 SIZE=3716 MTIME=Aug 28 12:35 2015 CLEAR? yes UNREF FILE I=2255601 OWNER=root MODE=100444 SIZE=4200 MTIME=Aug 28 12:35 2015 CLEAR? yes UNREF FILE I=2255603 OWNER=root MODE=100444 SIZE=3912 MTIME=Aug 28 12:35 2015 CLEAR? yes UNREF FILE I=2255609 OWNER=root MODE=100444 SIZE=11108 MTIME=Aug 28 12:35 2015 CLEAR? yes UNREF FILE I=2255612 OWNER=root MODE=100444 SIZE=47424 MTIME=Aug 28 12:35 2015 CLEAR? yes UNREF FILE I=2328435 OWNER=root MODE=100444 SIZE=0 MTIME=Aug 29 18:36 2015 RECONNECT? yes UNREF FILE I=2328436 OWNER=root MODE=100444 SIZE=0 MTIME=Aug 29 18:36 2015 RECONNECT? yes UNREF FILE I=2328445 OWNER=root MODE=100444 SIZE=0 MTIME=Aug 29 18:36 2015 RECONNECT? yes UNREF FILE I=3049744 OWNER=root MODE=100555 SIZE=0 MTIME=Aug 29 18:36 2015 RECONNECT? yes UNREF FILE I=3049758 OWNER=root MODE=100555 SIZE=0 MTIME=Aug 29 18:36 2015 RECONNECT? yes UNREF FILE I=3049759 OWNER=root MODE=100555 SIZE=0 MTIME=Aug 29 18:36 2015 RECONNECT? yes ** Phase 5 - Check Cyl groups FREE BLK COUNT(S) WRONG IN SUPERBLK SALVAGE? yes SUMMARY INFORMATION BAD SALVAGE? yes BLK(S) MISSING IN BIT MAPS SALVAGE? yes 871400 files, 3358352 used, 4002263 free (37559 frags, 495588 blocks, 0.5% fragmentation) ***** FILE SYSTEM STILL DIRTY ***** ***** FILE SYSTEM WAS MODIFIED ***** ***** PLEASE RERUN FSCK ***** # random: unblocking device. # fsck -y ** /dev/mmcsd0s2a USE JOURNAL? yes ** SU+J Recovering /dev/mmcsd0s2a Journal timestamp does not match fs mount time ** Skipping journal, falling through to full fsck ** Last Mounted on / ** Root file system ** Phase 1 - Check Blocks and Sizes ** Phase 2 - Check Pathnames ** Phase 3 - Check Connectivity ** Phase 4 - Check Reference Counts ** Phase 5 - Check Cyl groups FREE BLK COUNT(S) WRONG IN SUPERBLK SALVAGE? yes SUMMARY INFORMATION BAD SALVAGE? yes BLK(S) MISSING IN BIT MAPS SALVAGE? yes 116380 files, 596620 used, 1161195 free (33275 frags, 140990 blocks, 1.9% fragmentation) ***** FILE SYSTEM IS CLEAN ***** ***** FILE SYSTEM WAS MODIFIED ***** ** /dev/da0p3 ** Last Mounted on /usr ** Phase 1 - Check Blocks and Sizes ** Phase 2 - Check Pathnames ** Phase 3 - Check Connectivity ** Phase 4 - Check Reference Counts ** Phase 5 - Check Cyl groups 871400 files, 3358352 used, 4002263 free (37559 frags, 495588 blocks, 0.5% fragmentation) ***** FILE SYSTEM MARKED CLEAN ***** # boot -sh: boot: not found # exit Setting hostuuid: d8fda880-104e-11e5-b1cd-b827eb18f842. Setting hostid: 0x908fd2cc. Fast boot: skipping disk checks. Mounting local file systems:mount: /dev/da0p4: R/W mount of /tmp denied. Filesystem is not clean - run fsck. Forced mount will invalidate journal contents: Operation not permitted mount: /dev/da0p1: R/W mount of /var denied. Filesystem is not clean - run fsck. Forced mount will invalidate journal contents: Operation not permitted . Mounting /etc/fstab filesystems failed, startup aborted ERROR: ABORTING BOOT (sending SIGTERM to parent)! Aug 29 18:24:33 init: /bin/sh on /etc/rc terminated abnormally, going to single user mode Enter full pathname of shell or RETURN for /bin/sh: # fsck -y da0p1 ** /dev/da0p1 USE JOURNAL? yes ** SU+J Recovering /dev/da0p1 ** Reading 33554432 byte journal from inode 4. RECOVER? yes ** Building recovery table. ** Resolving unreferenced inode list. ** Processing journal entries. WRITE CHANGES? yes ** 11 journal records in 1024 bytes for 34.38% utilization ** Freed 0 inodes (0 dirs) 0 blocks, and 0 frags. ***** FILE SYSTEM MARKED CLEAN ***** # fsck -y da0p4 ** /dev/da0p4 USE JOURNAL? yes ** SU+J Recovering /dev/da0p4 ** Reading 10584064 byte journal from inode 4. RECOVER? yes ** Building recovery table. ** Resolving unreferenced inode list. ** Processing journal entries. WRITE CHANGES? yes ** 4 journal records in 1536 bytes for 8.33% utilization ** Freed 4 inodes (0 dirs) 0 blocks, and 5 frags. ***** FILE SYSTEM MARKED CLEAN ***** # exit Setting hostuuid: d8fda880-104e-11e5-b1cd-b827eb18f842. Setting hostid: 0x908fd2cc. Fast boot: skipping disk checks. Mounting local file systems:. Setting hostname: www.zefox.org. Feeding entropy:. smsc0: chip 0xec00, rev. 0002 ue0: link state changed to DOWN ue0: link state changed to UP Starting Network: lo0 ue0. lo0: flags=8049 metric 0 mtu 16384 options=600003 inet6 ::1 prefixlen 128 inet6 fe80::1%lo0 prefixlen 64 scopeid 0x1 inet 127.0.0.1 netmask 0xff000000 groups: lo nd6 options=21 ue0: flags=8843 metric 0 mtu 1500 options=80001 ether b8:27:eb:18:f8:42 inet 192.168.1.3 netmask 0xffffff00 broadcast 192.168.1.255 media: Ethernet autoselect (100baseTX ) status: active nd6 options=29 ELF ldconfig path: /lib /usr/lib /usr/lib/compat Starting devd. ums0: on usbus0 ums0: 3 buttons and [XYZ] coordinates ID=0 Starting ums0 moused. add net default: gateway 192.168.1.254 add net fe80::: gateway ::1 add net ff02::: gateway ::1 add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 Creating and/or trimming log files. Starting syslogd. Setting date via ntp. 29 Aug 19:07:25 ntpdate[452]: step time server 131.107.13.100 offset 2418.723369 sec No core dumps found. Starting casperd. Clearing /tmp (X related). Updating motd:. Mounting late file systems:. Starting powerd. Configuring vt: blanktime. Performing sanity check on sshd configuration. Starting sshd. Starting sendmail. Starting sendmail_msp_queue. Starting cron. Starting background file system checks in 60 seconds. Sat Aug 29 19:07:31 PDT 2015 FreeBSD/arm (www.zefox.org) (ttyu0) login: I'll try to complete the build and proceed as before. If there's a way to get more/better debugging output please give me a hint. Thanks for reading, bob prohaska