From owner-freebsd-current@FreeBSD.ORG Sun Dec 25 13:39:10 2011 Return-Path: Delivered-To: current@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id E45021065670 for ; Sun, 25 Dec 2011 13:39:10 +0000 (UTC) (envelope-from randy@psg.com) Received: from ran.psg.com (ran.psg.com [IPv6:2001:418:1::36]) by mx1.freebsd.org (Postfix) with ESMTP id C4BEE8FC0C for ; Sun, 25 Dec 2011 13:39:10 +0000 (UTC) Received: from localhost ([127.0.0.1] helo=rair.psg.com.psg.com) by ran.psg.com with esmtp (Exim 4.76 (FreeBSD)) (envelope-from ) id 1ReoI9-000297-0W; Sun, 25 Dec 2011 13:39:10 +0000 Date: Sun, 25 Dec 2011 08:39:02 -0500 Message-ID: From: Randy Bush To: FreeBSD current mailing list User-Agent: Wanderlust/2.15.9 (Almost Unreal) Emacs/22.3 Mule/5.0 (SAKAKI) MIME-Version: 1.0 (generated by SEMI 1.14.6 - "Maruoka") Content-Type: text/plain; charset=US-ASCII Cc: Subject: lost inode, no backup X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 25 Dec 2011 13:39:11 -0000 FreeBSD ran.psg.com 10.0-CURRENT FreeBSD 10.0-CURRENT #4: Sat Dec 24 12:33:51 UTC 2011 root@ran.psg.com:/usr/obj/usr/src/sys/RAN amd64 so doing all the wonderful holiday security upgrades and hit an ugly. these two problems may not be related. ---- problem one on reboot, /usr/home was empty, as iff the inode had been lost. but no lost+found and fsck found no problem. # df -H Filesystem Size Used Avail Capacity Mounted on /dev/da0s1a 5.2G 1.6G 3.1G 34% / devfs 1.0k 1.0k 0B 100% /dev /dev/da0s1d 2.1G 356M 1.6G 19% /var /dev/da0s1e 2.1G 1.8M 1.9G 0% /var/spool /dev/da0s1f 138G 111G 15G 88% /usr /dev/md0 259M 36k 238M 0% /tmp and we know /usr/home was fine before the reboot as i was running out of it, backup ran out of it, ... ---- problem two so i go for the local raid which is the target of the ever faithful backup job, the essence of which is # 4 - /usr /sbin/dump 0Luaf - /dev/da0s1f | $SSH $USYS "/bin/cat > $DDIR/usr" and which had run quite happily a few hours before DUMP: Date of this level 0 dump: Sat Dec 24 00:47:42 2011 DUMP: Date of last level 0 dump: the epoch DUMP: Dumping snapshot of /dev/da0s1f (/usr) to standard output DUMP: mapping (Pass I) [regular files] DUMP: mapping (Pass II) [directories] DUMP: estimated 56969906 tape blocks. DUMP: dumping (Pass III) [directories] DUMP: dumping (Pass IV) [regular files] DUMP: 0.78% done, finished in 10:36 at Sat Dec 24 11:29:34 2011 DUMP: 1.52% done, finished in 10:47 at Sat Dec 24 11:45:15 2011 ... DUMP: 97.88% done, finished in 0:05 at Sat Dec 24 05:13:38 2011 DUMP: DUMP: 56980137 tape blocks DUMP: finished in 15750 seconds, throughput 3617 KBytes/sec DUMP: level 0 dump on Sat Dec 24 00:47:42 2011 DUMP: DUMP IS DONE except that on all backups since the system moved to 10-current, home is empty in the usr file!!! all other directories there are good. and we know /usr/home was good, see above. the bleeping dump user has its directory there. ---- luckily i had other means of restoring. but wtf? randy