From owner-freebsd-bugs@FreeBSD.ORG Mon Nov 19 13:30:01 2012 Return-Path: Delivered-To: freebsd-bugs@smarthost.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 9467998B for ; Mon, 19 Nov 2012 13:30:01 +0000 (UTC) (envelope-from gnats@FreeBSD.org) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2001:1900:2254:206c::16:87]) by mx1.freebsd.org (Postfix) with ESMTP id 69C5D8FC1C for ; Mon, 19 Nov 2012 13:30:01 +0000 (UTC) Received: from freefall.freebsd.org (localhost [127.0.0.1]) by freefall.freebsd.org (8.14.5/8.14.5) with ESMTP id qAJDU14Y024570 for ; Mon, 19 Nov 2012 13:30:01 GMT (envelope-from gnats@freefall.freebsd.org) Received: (from gnats@localhost) by freefall.freebsd.org (8.14.5/8.14.5/Submit) id qAJDU1Vu024569; Mon, 19 Nov 2012 13:30:01 GMT (envelope-from gnats) Resent-Date: Mon, 19 Nov 2012 13:30:01 GMT Resent-Message-Id: <201211191330.qAJDU1Vu024569@freefall.freebsd.org> Resent-From: FreeBSD-gnats-submit@FreeBSD.org (GNATS Filer) Resent-To: freebsd-bugs@FreeBSD.org Resent-Reply-To: FreeBSD-gnats-submit@FreeBSD.org, Brian Gold Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 0505851F for ; Mon, 19 Nov 2012 13:27:06 +0000 (UTC) (envelope-from nobody@FreeBSD.org) Received: from red.freebsd.org (red.freebsd.org [IPv6:2001:4f8:fff6::22]) by mx1.freebsd.org (Postfix) with ESMTP id C72CF8FC16 for ; Mon, 19 Nov 2012 13:27:05 +0000 (UTC) Received: from red.freebsd.org (localhost [127.0.0.1]) by red.freebsd.org (8.14.5/8.14.5) with ESMTP id qAJDR58H094249 for ; Mon, 19 Nov 2012 13:27:05 GMT (envelope-from nobody@red.freebsd.org) Received: (from nobody@localhost) by red.freebsd.org (8.14.5/8.14.5/Submit) id qAJDR5TJ094248; Mon, 19 Nov 2012 13:27:05 GMT (envelope-from nobody) Message-Id: <201211191327.qAJDR5TJ094248@red.freebsd.org> Date: Mon, 19 Nov 2012 13:27:05 GMT From: Brian Gold To: freebsd-gnats-submit@FreeBSD.org X-Send-Pr-Version: www-3.1 Subject: misc/173718: phantom directory in zraid2 pool X-BeenThere: freebsd-bugs@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Bug reports List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 19 Nov 2012 13:30:01 -0000 >Number: 173718 >Category: misc >Synopsis: phantom directory in zraid2 pool >Confidential: no >Severity: non-critical >Priority: low >Responsible: freebsd-bugs >State: open >Quarter: >Keywords: >Date-Required: >Class: sw-bug >Submitter-Id: current-users >Arrival-Date: Mon Nov 19 13:30:00 UTC 2012 >Closed-Date: >Last-Modified: >Originator: Brian Gold >Release: 9.0-RELEASE >Organization: Bard College at Simon's Rock >Environment: FreeBSD phoenix2.simons-rock.edu 9.0-RELEASE FreeBSD 9.0-RELEASE #0: Tue Jan 3 07:46:30 UTC 2012 root@farrell.cse.buffalo.edu:/usr/obj/usr/src/sys/GENERIC amd64 >Description: I am running a zraid2 pool (v28) on 6 sata drives which are passed through a Dell SAS 6/iR running in TI mode for pass-through. This FreeBSD server functions as backup storage for our site. All of our servers are rsynced over to this server each night for backup. Recently, I've noticed that I will get messages like the following in my rsync log: file has vanished: "/backup/ldap1/etc/pki" Now, usually when I get a file has vanished error during an RSYNC run, it indicates that the source file/directory on the system that is sending the rsync backup has been deleted or moved before rsync got a chance to actually send it. That doesn't appear to be the case here. "/backup/ldap1/etc/pki" is the destination directory on my Freebsd/ZFS server. I take a look in "/backup/ldap1/etc" on my Freebsd server and the "pki" subdirectory is no longer listed. Ok, so I run "mkdir /backup/ldap1/etc/pki" and get the following error: "mkdir: /backup/ldap1/etc/pki: File exists". Odd Just to double check, I run "ls -la /backup/ldap1/etc/pki" and get the following: "ls: /backup/ldap1/etc/pki: No such file or directory" I then run a simple ls on the directory: "ls /backup/ldap1/etc" and the pki subdirectory shows up just fine. >How-To-Repeat: I have no idea how to cause this issue on another system unfortunately. I did however locate a few postings on the forums of other users who experienced similar issues. http://lists.freebsd.org/pipermail/freebsd-current/2011-October/027902.html >Fix: Eventually, I decide to manually delete the entire "/backup/ldap1" directory and all of its contents. Everything deletes just fine, except for the directories that were erroring in my rsync logs. I then re-run my rsync job and those directories are populated without issue. Now however, I am getting different directories erroring during the nightly rsync: "/backup/ldap1/var/lib/yum/yumdb/i/8b1b1eb729e16ac4c3d877718de59d12b2ee7c2a-iso-codes-3.16-2.el6-noarch" failed: No such file or directory (2)" And from my daily security email output: Checking setuid files and devices: find: /backup/ldap1/var/lib/yum/yumdb/c/1e68056c53f1cd6b5ddf78fc18e8fcada22d89d9-cdparanoia-libs-10.2-5.1.el6-x86_64/from_repo_revision: No such file or directory find: /backup/ldap1/var/lib/yum/yumdb/i/8b1b1eb729e16ac4c3d877718de59d12b2ee7c2a-iso-codes-3.16-2.el6-noarch: No such file or directory >Release-Note: >Audit-Trail: >Unformatted: