Date: Fri, 6 May 2011 07:56:48 -0700 From: Artem Belevich <art@freebsd.org> To: Holger Kipp <Holger.Kipp@alogis.com> Cc: "stable@freebsd.org" <stable@freebsd.org> Subject: Re: resilvering takes ages on 8.2 (amd64 from 18.04.2011) Message-ID: <BANLkTint=FqaFE7yzM7k-zS22kHvt=QHdQ@mail.gmail.com> In-Reply-To: <814C9E9472FDCC40AAC3FC95A2D67E3B0BD7BB81@msx3.exchange.alogis.com> References: <814C9E9472FDCC40AAC3FC95A2D67E3B0BD7BB81@msx3.exchange.alogis.com>
next in thread | previous in thread | raw e-mail | index | archive | help
On Fri, May 6, 2011 at 5:43 AM, Holger Kipp <Holger.Kipp@alogis.com> wrote: > Resilvering a disk in raidz2 ZFS is taking ages. Any ideas? I had replaced a different disk this morning (da7) and it took only about 1 hour alltogether. Any ideas? Or did I do something very wrong (tm)? Don't believe everything you see. On my pool I often see scrub time estimates of few hundred hours even though it always takes about 6 hours. Once ZFS is done thrashing disks while it scrubs metadata and starts doing bulk data transfer, estimates would eventually converge to a sensible value. > Disks da0 da1 da2 da3 da4 da5 da6 328004 wire > KB/t 0.67 4.92 4.68 4.46 4.53 4.66 4.91 84728 act > tps 151 138 150 151 146 149 140 39788 inact > MB/s 0.10 0.66 0.69 0.66 0.65 0.68 0.67 1520 cache > %busy 101 41 44 42 41 40 39 7647296 free Yup. It does look like your pool is in "thrashing" stage -- lots of seeking. --Artem > > Best regards, > Holger > > -------------------- > > 8.2-STABLE FreeBSD 8.2-STABLE #12: Mon Apr 18 12:48:56 CEST 2011 > > # zpool status > pool: tank > state: DEGRADED > status: One or more devices is currently being resilvered. The pool will > continue to function, possibly in a degraded state. > action: Wait for the resilver to complete. > scrub: resilver in progress for 0h21m, 1.10% done, 32h19m to go > config: > > NAME STATE READ WRITE CKSUM > tank DEGRADED 0 0 0 > raidz2 DEGRADED 0 0 0 > replacing DEGRADED 0 0 0 > da0/old OFFLINE 0 0 0 > da0 ONLINE 0 0 0 158M resilvered > da1 ONLINE 0 0 0 > da2 ONLINE 0 0 0 > da7 ONLINE 0 0 0 > da3 ONLINE 0 0 0 > da4 ONLINE 0 0 0 > da5 ONLINE 0 0 0 > da6 ONLINE 0 0 0 > > errors: No known data errors > > > > ----------------- > 1 users Load 0.00 0.00 0.00 May 6 14:37 > > Mem:KB REAL VIRTUAL VN PAGER SWAP PAGER > Tot Share Tot Share Free in out in out > Act 119320 18980 1362144 25756 7648824 count > All 344920 23296 1075218k 57012 pages > Proc: Interrupts > r p d s w Csw Trp Sys Int Sof Flt cow 4765 total > 76 9171 11 130 766 952 zfod atkbd0 1 > ozfod ata0 irq14 > 0.7%Sys 0.3%Intr 0.0%User 0.0%Nice 99.0%Idle %ozfod 1 uhci0 16 > | | | | | | | | | | | daefr uhci1 17 > prcfr 1 twe0 irq24 > 7 dtbuf 1106 totfr 1999 cpu0: time > Namei Name-cache Dir-cache 206492 desvn react 763 isp0 256 > Calls hits % hits % 3598 numvn pdwak 2 em0 irq257 > 12 11 92 1382 frevn pdpgs 1999 cpu1: time > intrn > Disks da0 da1 da2 da3 da4 da5 da6 328004 wire > KB/t 0.67 4.92 4.68 4.46 4.53 4.66 4.91 84728 act > tps 151 138 150 151 146 149 140 39788 inact > MB/s 0.10 0.66 0.69 0.66 0.65 0.68 0.67 1520 cache > %busy 101 41 44 42 41 40 39 7647296 free > 60464 buf > > > -- > > > Holger Kipp > Diplom-Mathematiker > Senior Consultant > > > [alogis] > > Tel. : +49 30 436 58 114 > Fax : +49 30 436 58 214 > Mobil : +49 178 36 58 114 > > E-Mail : holger.kipp@alogis.com > alogis AG > Alt-Moabit 90 B > D- 10559 Berlin > > Web: www.alogis.com<http://www.alogis.com>; > > > > alogis AG > Sitz/Registergericht: Berlin/AG Charlottenburg, HRB 71484 > Vorstand: Arne Friedrichs, Joern Samuelson > Aufsichtsratsvorsitzender: Reinhard Mielke > > > _______________________________________________ > freebsd-stable@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-stable > To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.org" >
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?BANLkTint=FqaFE7yzM7k-zS22kHvt=QHdQ>