From owner-freebsd-fs@FreeBSD.ORG Wed Nov 26 11:24:26 2008 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id BEA4C1065674 for ; Wed, 26 Nov 2008 11:24:26 +0000 (UTC) (envelope-from glz@hidden-powers.com) Received: from mail.hidden-powers.com (mail.hidden-powers.com [213.242.135.162]) by mx1.freebsd.org (Postfix) with ESMTP id 196E28FC1B for ; Wed, 26 Nov 2008 11:24:25 +0000 (UTC) (envelope-from glz@hidden-powers.com) Received: from mail.hidden-powers.com (localhost [127.0.0.1]) by dkim.hidden-powers.com (Postfix) with ESMTP id 5B0826D5C7; Wed, 26 Nov 2008 12:24:24 +0100 (CET) DKIM-Signature: v=1; a=rsa-sha1; c=relaxed; d=hidden-powers.com; h=date :from:to:subject:message-id:in-reply-to:references:mime-version :content-type:content-transfer-encoding; s=selector1; bh=NIEWzTY 1kjeoUv4tXscJtTu4jMQ=; b=y45aDK7zHm1fJvVkcVOMdl/TkCZzIHJ4H/xmFpd RZnqXB+AkGyLHWh9IWsN9donTWGfbN45f1Zux0ZEM1Soj2pj2bGFwV79zQGi9KNb WPcs3SPBY4wx9c8Ypcu8d09dkMrNGDcFcNZRglxl64AlNMUlIJgOr2+apcZZH+4Y 83r0= Received: from [172.16.2.158] (gw01.ismobile.com [212.73.186.202]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mail.hidden-powers.com (Postfix) with ESMTPSA id 50E746D5C5; Wed, 26 Nov 2008 12:24:23 +0100 (CET) Date: Wed, 26 Nov 2008 12:24:22 +0100 From: Goran Lowkrantz To: Andriy Gapon , freebsd-fs@freebsd.org Message-ID: In-Reply-To: <492D2122.4050203@icyb.net.ua> References: <492D2122.4050203@icyb.net.ua> X-Mailer: Mulberry/4.0.8 (Mac OS X) MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii; format=flowed Content-Transfer-Encoding: 7bit Content-Disposition: inline Cc: Subject: Re: endless zpool scrub? X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 26 Nov 2008 11:24:26 -0000 --On November 26, 2008 12:12:50 +0200 Andriy Gapon wrote: > > I noticed that zpool scrub on a certain pool runs "like forever". > I decided to monitor its progress using periodic zpool status command, > once in 10 seconds. > Here's a snippet from the capture around an interesting point. > Please notice two highlighted reports ('oops'). > This is stable/7. > Thank you in advance for insights/comments. > > > pool: tank > state: ONLINE > scrub: scrub in progress, 78.87% done, 0h31m to go > config: > > NAME STATE READ WRITE CKSUM > tank ONLINE 0 0 0 > ad6s2d ONLINE 0 0 0 > > errors: No known data errors > pool: tank > state: ONLINE > scrub: scrub in progress, 78.94% done, 0h31m to go > config: > > NAME STATE READ WRITE CKSUM > tank ONLINE 0 0 0 > ad6s2d ONLINE 0 0 0 > > errors: No known data errors > pool: tank > state: ONLINE > scrub: scrub in progress, 78.97% done, 0h31m to go > config: > > NAME STATE READ WRITE CKSUM > tank ONLINE 0 0 0 > ad6s2d ONLINE 0 0 0 > > errors: No known data errors > pool: tank > state: ONLINE > scrub: scrub in progress, 0.00% done, 233h25m to go > config: > > NAME STATE READ WRITE CKSUM > tank ONLINE 0 0 0 > ad6s2d ONLINE 0 0 0 > ****oops, went back to 0%**** > > errors: No known data errors > pool: tank > state: ONLINE > scrub: scrub in progress, 0.00% done, 259h47m to go > config: > > NAME STATE READ WRITE CKSUM > tank ONLINE 0 0 0 > ad6s2d ONLINE 0 0 0 > > errors: No known data errors > pool: tank > state: ONLINE > scrub: scrub in progress, 0.00% done, 186h50m to go > config: > > NAME STATE READ WRITE CKSUM > tank ONLINE 0 0 0 > ad6s2d ONLINE 0 0 0 > > errors: No known data errors > pool: tank > state: ONLINE > scrub: scrub in progress, 0.00% done, 186h45m to go > config: > > NAME STATE READ WRITE CKSUM > tank ONLINE 0 0 0 > ad6s2d ONLINE 0 0 0 > > errors: No known data errors > pool: tank > state: ONLINE > scrub: scrub in progress, 0.00% done, 306h30m to go > config: > > NAME STATE READ WRITE CKSUM > tank ONLINE 0 0 0 > ad6s2d ONLINE 0 0 0 > > errors: No known data errors > pool: tank > state: ONLINE > scrub: scrub in progress, 0.00% done, 292h19m to go > config: > > NAME STATE READ WRITE CKSUM > tank ONLINE 0 0 0 > ad6s2d ONLINE 0 0 0 > > errors: No known data errors > pool: tank > state: ONLINE > scrub: scrub in progress, 0.00% done, 231h16m to go > config: > > NAME STATE READ WRITE CKSUM > tank ONLINE 0 0 0 > ad6s2d ONLINE 0 0 0 > > errors: No known data errors > pool: tank > state: ONLINE > scrub: scrub in progress, 0.00% done, 283h55m to go > config: > > NAME STATE READ WRITE CKSUM > tank ONLINE 0 0 0 > ad6s2d ONLINE 0 0 0 > > errors: No known data errors > pool: tank > state: ONLINE > scrub: scrub in progress, 0.00% done, 232h8m to go > config: > > NAME STATE READ WRITE CKSUM > tank ONLINE 0 0 0 > ad6s2d ONLINE 0 0 0 > > errors: No known data errors > pool: tank > state: ONLINE > scrub: scrub in progress, 0.00% done, 164h37m to go > config: > > NAME STATE READ WRITE CKSUM > tank ONLINE 0 0 0 > ad6s2d ONLINE 0 0 0 > > errors: No known data errors > pool: tank > state: ONLINE > scrub: scrub in progress, 0.00% done, 183h40m to go > config: > > NAME STATE READ WRITE CKSUM > tank ONLINE 0 0 0 > ad6s2d ONLINE 0 0 0 > > errors: No known data errors > pool: tank > state: ONLINE > scrub: scrub in progress, 0.00% done, 166h21m to go > config: > > NAME STATE READ WRITE CKSUM > tank ONLINE 0 0 0 > ad6s2d ONLINE 0 0 0 > > errors: No known data errors > pool: tank > state: ONLINE > scrub: scrub stopped with 0 errors on Wed Nov 26 12:02:02 2008 > config: > > NAME STATE READ WRITE CKSUM > tank ONLINE 0 0 0 > ad6s2d ONLINE 0 0 0 > ****oops, scrub is reported as stopped**** > > errors: No known data errors > pool: tank > state: ONLINE > scrub: scrub in progress, 0.00% done, 127h29m to go > config: > > NAME STATE READ WRITE CKSUM > tank ONLINE 0 0 0 > ad6s2d ONLINE 0 0 0 > > errors: No known data errors > Do you have a script or something that creates snapshots running? I used sysutils/zfs-snapshot-mgmt and did see the same as you, as a running scrub is reset by a snapshot creation. If you are using this script, we have tested a modified version that suspends snapshot creation on a pool that is scrubbing. /glz --- "There is hopeful symbolism in the fact that flags do not wave in a vacuum." -- Arthur C. Clarke