From owner-freebsd-fs@freebsd.org Fri Sep 2 19:42:02 2016 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 6D585BCDF55 for ; Fri, 2 Sep 2016 19:42:02 +0000 (UTC) (envelope-from lkateley@kateley.com) Received: from mail-it0-x235.google.com (mail-it0-x235.google.com [IPv6:2607:f8b0:4001:c0b::235]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 353A838A for ; Fri, 2 Sep 2016 19:42:02 +0000 (UTC) (envelope-from lkateley@kateley.com) Received: by mail-it0-x235.google.com with SMTP id c198so57347066ith.1 for ; Fri, 02 Sep 2016 12:42:02 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=kateley-com.20150623.gappssmtp.com; s=20150623; h=reply-to:subject:references:to:from:organization:message-id:date :user-agent:mime-version:in-reply-to:content-transfer-encoding; bh=NqP+XuS21ielDDIt5U4a75zaiYTRPZJ+E9t7rCm+Pqo=; b=cGPHNNu8IeM1wSXOribNS3oq/v43GCDUId8nF6I/5aHD5BjpTA52L109CFdA7r+VCm E87GVdVC0BKOs1S1g21di8gpoLxec4+p8q33PWl+OwaLM43xAlBdonV2OWSMq5xcVbB8 dZnrDSzurEChTbAoX4d/Z13tS6zhR65TiTN+inuprQJfIeByoGwMB599EujEbkGkWbs5 FwpH/KoJOOwPsnB3qCx5WWBAqLa3rDGX2T432rjoNNGTA49sd7F7M2SoWjTf+Q4szRec vy8Tt64TnyWPpY42Q3h1OszP+01b+s4tnZTB6SXL2AaGfK3wk/D9eDxMMr+/jjQsX4wz JIFA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:reply-to:subject:references:to:from:organization :message-id:date:user-agent:mime-version:in-reply-to :content-transfer-encoding; bh=NqP+XuS21ielDDIt5U4a75zaiYTRPZJ+E9t7rCm+Pqo=; b=ihB7qDUeedt7H7gigz1qjzzMmjwc2fQjkasATw8mLEBQvy2A5Qyeg2bzvPia5RUuy7 vv2p3+5JxXjAuaaI4S729/3UL87Pfk2Gj1DBiRKnIRw5h5DYQBmcmjgaIvWwo/rsc5aj ZMXQtnPjc2G+qggAwJI3/MS5qWwukVKJ4hSJmDI+IlGFVN+ZS/NV7/SsS0miuWw6pMon tcgs0LR7xHw1D0eGthSfi/IygPsYp7Uywb3qpN23Onm4O0lGXR19KDGAUAqn3LMtWY0e bqhrWCjjMDkdsWw30Lq2E8vuTTUgm6MJ0SqnFPE8LmeuY7M6OWhzvWqBt2xI8Fc+AJn3 umTQ== X-Gm-Message-State: AE9vXwPVV7udEWtQRencfn045z89X2Hj91fr/WH9+lEoB7VN1ft9Oy78cDkk0mIpKeDD6A== X-Received: by 10.36.189.68 with SMTP id x65mr6524773ite.97.1472845320291; Fri, 02 Sep 2016 12:42:00 -0700 (PDT) Received: from [192.168.0.19] (67-4-134-32.mpls.qwest.net. [67.4.134.32]) by smtp.googlemail.com with ESMTPSA id v7sm3128865ita.9.2016.09.02.12.41.59 for (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Fri, 02 Sep 2016 12:41:59 -0700 (PDT) Reply-To: linda@kateley.com Subject: Re: phantom snapshots References: <58816ff0-3ab2-cbae-3d50-c4d5e89d9773@kateley.com> <57C9D1FB.6040904@b1t.name> To: freebsd-fs@freebsd.org From: Linda Kateley Organization: Kateley Company Message-ID: Date: Fri, 2 Sep 2016 14:41:58 -0500 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.10; rv:45.0) Gecko/20100101 Thunderbird/45.2.0 MIME-Version: 1.0 In-Reply-To: <57C9D1FB.6040904@b1t.name> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 02 Sep 2016 19:42:02 -0000 On 9/2/16 2:24 PM, Volodymyr Kostyrko wrote: > Linda Kateley wrote: >> So I think I have isolated this to a phantom snapshot. At the end of >> this zpool status although the names change everytime I run scrub, it >> show unrecoverable error of files in a snapshot that doesn't exit. >> >> It also has in that zfs dataset it has a .zfs directory with a name of >> old snaps. >> >> Anyone know how to view or clear these phantom snaps? I tried to remove >> the files in the snapshot directory, but it is read-only. > > This looks like pointers to files that were already deleted/purged. I > once faced this errors but that was on bad controller, I don't think > this can be caused by bad memory/errors. When that happened I scrubbed > pool, removed all files noted, cleaned zpool errors (they are > persistent, even the file was removed and snapshots doen't exist they > are still shown) and scrubbed the pool again. How did you remove the files in the snapshot? I keep trying but it is read-only? Can I remount it read-write? > >> >> Ideas? >> >> Linda >> >> >> pool: pool >> state: ONLINE >> status: One or more devices is currently being resilvered. The pool >> will >> continue to function, possibly in a degraded state. >> action: Wait for the resilver to complete. >> scan: resilver in progress since Fri Sep 2 10:42:48 2016 >> 46.8T scanned out of 144T at 2.48G/s, 11h11m to go >> 46.5G resilvered, 32.40% done >> config: >> >> NAME STATE READ >> WRITE CKSUM >> pool ONLINE 0 >> 0 12 >> raidz3-0 ONLINE 0 >> 0 0 >> gptid/ac108605-265c-11e5-9a02-0cc47a599098 ONLINE 0 >> 0 0 >> gptid/ac591d4e-265c-11e5-9a02-0cc47a599098 ONLINE 0 >> 0 0 >> gptid/ac92fd0d-265c-11e5-9a02-0cc47a599098 ONLINE 0 >> 0 0 >> gptid/accd3076-265c-11e5-9a02-0cc47a599098 ONLINE 0 >> 0 0 >> gptid/ad067e97-265c-11e5-9a02-0cc47a599098 ONLINE 0 >> 0 0 >> gptid/ad46cbee-265c-11e5-9a02-0cc47a599098 ONLINE 0 >> 0 0 >> gptid/ad91ba17-265c-11e5-9a02-0cc47a599098 ONLINE 0 >> 0 0 >> gptid/adcbdd0a-265c-11e5-9a02-0cc47a599098 ONLINE 0 >> 0 0 >> gptid/ae07dc0d-265c-11e5-9a02-0cc47a599098 ONLINE 0 >> 0 0 >> gptid/ae494d10-265c-11e5-9a02-0cc47a599098 ONLINE 0 >> 0 0 >> gptid/ae93a3a5-265c-11e5-9a02-0cc47a599098 ONLINE 0 >> 0 0 >> raidz3-1 ONLINE 0 >> 0 0 >> gptid/12f6a4c5-c929-11e5-8075-0cc47a599098 ONLINE 0 >> 0 0 >> gptid/511ea1f9-1932-11e6-9b1e-0cc47a599098 ONLINE 0 >> 0 0 >> gptid/14436fcf-c929-11e5-8075-0cc47a599098 ONLINE 0 >> 0 0 >> gptid/14f50aa3-c929-11e5-8075-0cc47a599098 ONLINE 0 >> 0 0 >> gptid/159b5654-c929-11e5-8075-0cc47a599098 ONLINE 0 >> 0 0 >> gptid/163d682b-c929-11e5-8075-0cc47a599098 ONLINE 0 >> 0 0 >> gptid/16ee624e-c929-11e5-8075-0cc47a599098 ONLINE 0 >> 0 0 >> gptid/1799dde3-c929-11e5-8075-0cc47a599098 ONLINE 0 >> 0 0 >> gptid/184c2ea4-c929-11e5-8075-0cc47a599098 ONLINE 0 >> 0 0 >> gptid/18f51c30-c929-11e5-8075-0cc47a599098 ONLINE 0 >> 0 0 >> gptid/19a861ea-c929-11e5-8075-0cc47a599098 ONLINE 0 >> 0 0 >> raidz3-2 ONLINE 0 >> 0 24 >> gptid/5f80fc42-4e00-11e6-b7cf-0cc47a599098 ONLINE 0 >> 0 0 >> gptid/60369e0f-4e00-11e6-b7cf-0cc47a599098 ONLINE 0 >> 0 0 >> gptid/60e8234a-4e00-11e6-b7cf-0cc47a599098 ONLINE 0 >> 0 0 >> gptid/61a235f2-4e00-11e6-b7cf-0cc47a599098 ONLINE 0 >> 0 0 >> gptid/62580471-4e00-11e6-b7cf-0cc47a599098 ONLINE 0 >> 0 0 >> gptid/6316a38a-4e00-11e6-b7cf-0cc47a599098 ONLINE 0 >> 0 0 >> gptid/63d4bce8-4e00-11e6-b7cf-0cc47a599098 ONLINE 0 >> 0 0 >> gptid/ebfc2b99-6893-11e6-9b09-0cc47a599098 ONLINE 0 0 0 >> (resilvering) >> gptid/654f143a-4e00-11e6-b7cf-0cc47a599098 ONLINE 0 >> 0 0 >> gptid/66236b33-4e00-11e6-b7cf-0cc47a599098 ONLINE 0 >> 0 0 >> gptid/66eda3f6-4e00-11e6-b7cf-0cc47a599098 ONLINE 0 >> 0 0 >> raidz3-3 ONLINE 0 >> 0 24 >> gptid/c77a9da9-4e02-11e6-b7cf-0cc47a599098 ONLINE 0 >> 0 0 >> gptid/c83e100e-4e02-11e6-b7cf-0cc47a599098 ONLINE 0 >> 0 0 >> gptid/c8fd9ced-4e02-11e6-b7cf-0cc47a599098 ONLINE 0 >> 0 0 >> gptid/c9bb21ba-4e02-11e6-b7cf-0cc47a599098 ONLINE 0 >> 0 0 >> gptid/ca7a48db-4e02-11e6-b7cf-0cc47a599098 ONLINE 0 >> 0 0 >> gptid/cb422329-4e02-11e6-b7cf-0cc47a599098 ONLINE 0 >> 0 0 >> gptid/cbfe4c21-4e02-11e6-b7cf-0cc47a599098 ONLINE 0 >> 0 0 >> gptid/ccc43528-4e02-11e6-b7cf-0cc47a599098 ONLINE 0 >> 0 0 >> gptid/cd93a34c-4e02-11e6-b7cf-0cc47a599098 ONLINE 0 >> 0 0 >> gptid/ce622f51-4e02-11e6-b7cf-0cc47a599098 ONLINE 0 >> 0 0 >> gptid/cf2591d3-4e02-11e6-b7cf-0cc47a599098 ONLINE 0 >> 0 0 >> cache >> gptid/aedd3872-265c-11e5-9a02-0cc47a599098 ONLINE 0 >> 0 0 >> gptid/af559c10-265c-11e5-9a02-0cc47a599098 ONLINE 0 >> 0 0 >> >> errors: Permanent errors have been detected in the following files: >> >> <0x597>:<0x1246> >> <0x597>:<0x1249> >> <0x597>:<0x125e> >> <0x597>:<0x1261> >> <0x597>:<0x127d> >> <0x597>:<0x1280> >> <0x599>:<0xe2c> >> <0x599>:<0xe2f> >> <0x599>:<0xe40> >> <0x599>:<0xe43> >> <0x599>:<0xe59> >> <0x599>:<0xe62> >> <0x5bc>:<0x2ad06> >> <0x5bc>:<0x2aef3> >> <0x5bc>:<0x2aef6> >> pool/.system@auto-20160720.2300-2d:<0x0> >> <0x5dc>:<0x397411> >> <0x5dc>:<0x397414> >> <0x5dc>:<0x38ee26> >> <0x5dc>:<0x38ee29> >> <0x5dc>:<0x38ee2c> >> <0x5dc>:<0x45b2e> >> <0x5dc>:<0x38ee2f> >> <0x5dc>:<0x38ee32> >> <0x5dc>:<0x394e58> >> <0x5dc>:<0x394e5b> >> <0x5dc>:<0x394e5e> >> <0x5dc>:<0x394e61> >> <0x5dc>:<0x394e64> >> <0x5dc>:<0x394e67> >> <0x5dc>:<0x394e6a> >> <0x5dc>:<0x397285> >> >> _______________________________________________ >> freebsd-fs@freebsd.org mailing list >> https://lists.freebsd.org/mailman/listinfo/freebsd-fs >> To unsubscribe, send any mail to "freebsd-fs-unsubscribe@freebsd.org" > >