Date: Tue, 20 Oct 2015 21:46:15 -0700 From: Jason Matthews <jason@broken.net> To: zfs@lists.illumos.org, "zfs-discuss@list.zfsonlinux.org" <zfs-discuss@list.zfsonlinux.org>, developer <developer@open-zfs.org>, freebsd-fs <freebsd-fs@freebsd.org>, zfs-discuss <zfs-discuss@zfsonlinux.org>, "developer@lists.illumos.org" <developer@lists.illumos.org>, "zfs-devel@freebsd.org" <zfs-devel@freebsd.org> Subject: Re: [zfs] RE: granularity of performance penalty from resilvering Message-ID: <56271897.4030209@broken.net> In-Reply-To: <A5A6EA4AE9DCC44F8E7FCB4D6317B1D202B43A690EE3@SH-MAIL.ISSI.COM> References: <CAJjvXiG7-MeUvGv4r=80nPfmr2qdhTwx_NtgFw5MpQ-CjkSLbA@mail.gmail.com> <A5A6EA4AE9DCC44F8E7FCB4D6317B1D202B43A690DF9@SH-MAIL.ISSI.COM> <5626E4B3.2020904@broken.net> <A5A6EA4AE9DCC44F8E7FCB4D6317B1D202B43A690EC1@SH-MAIL.ISSI.COM> <5626EFF1.9020208@broken.net> <A5A6EA4AE9DCC44F8E7FCB4D6317B1D202B43A690ED1@SH-MAIL.ISSI.COM> <5626F196.5080606@broken.net> <A5A6EA4AE9DCC44F8E7FCB4D6317B1D202B43A690EE3@SH-MAIL.ISSI.COM>
next in thread | previous in thread | raw e-mail | index | archive | help
I am not sure we are communicating. Instead of prioritizing resilvering, de-prioritize resilvering using those tunables. j. On 10/20/2015 7:14 PM, Fred Liu wrote: > Yeah, that is a trade-off. Prioritize resilvering high will shorten the time window. > That means brake your application "temporarily??". Even in current situation, the resilvering > eats almost all the IOs. > >> -----Original Message----- >> From: owner-zfs-devel@freebsd.org [mailto:owner-zfs-devel@freebsd.org] >> On Behalf Of Jason Matthews >> Sent: 星期三, 十月 21, 2015 10:00 >> To: zfs@lists.illumos.org; zfs-discuss@list.zfsonlinux.org; developer; >> freebsd-fs; zfs-discuss; developer@lists.illumos.org; zfs- >> devel@freebsd.org >> Subject: Re: [zfs] RE: granularity of performance penalty from >> resilvering >> >> >> >> i just sent you the tunables. turn the knobs in the other direction. >> >> j. >> >> On 10/20/2015 6:58 PM, Fred Liu wrote: >>> This feature is really needed. Even in some low-end RAID controllers, >>> the rebuilding penalty is tunable more than the high-end enterprise >> storage.... >>>> -----Original Message----- >>>> From: owner-freebsd-fs@freebsd.org >>>> [mailto:owner-freebsd-fs@freebsd.org] >>>> On Behalf Of Jason Matthews >>>> Sent: 星期三, 十月 21, 2015 9:53 >>>> To: zfs@lists.illumos.org; zfs-discuss@list.zfsonlinux.org; >>>> developer; freebsd-fs; zfs-discuss; developer@lists.illumos.org >>>> Subject: Re: [zfs] RE: granularity of performance penalty from >>>> resilvering >>>> >>>> >>>> That is the only way to fly... >>>> >>>> j. >>>> >>>> On 10/20/2015 6:35 PM, Fred Liu wrote: >>>>> Yeah. I want to go the other way. Plus, these settings are only >>>>> applicable in illumos. >>>>> >>>>> Therefore I decide to give up the hybrid( ssd+sata) solution to >>>>> underpin applications which need decent RAS. >>>>> >>>>> I am gonna go all-flash array. >>>>> >>>>> Thanks. >>>>> >>>>> Fred >>>>> >>>>> *From:*Jason Matthews [mailto:jason@broken.net] >>>>> *Sent:* 星期三, 十月21, 2015 9:05 >>>>> *To:* zfs@lists.illumos.org; Fred Liu; >>>>> zfs-discuss@list.zfsonlinux.org; developer; freebsd-fs; zfs-discuss >>>>> *Subject:* Re: [zfs] RE: granularity of performance penalty from >>>>> resilvering >>>>> >>>>> >>>>> >>>>> you could look at these tunables (not the settings themselves)... >>>>> >>>>> these settings actually make resilvers have a higher priority. You >>>>> obviously would want to go the other way. >>>>> >>>>> j. >>>>> >>>>> |* Prioritize resilvering by setting the delay to zero| set >>>>> |zfs:zfs_resilver_delay = 0 | >>>>> >>>>> * Prioritize scrubs by setting the delay to zero set >>>>> zfs:zfs_scrub_delay = 0 >>>>> >>>>> |* resilver for five seconds per TXG| set >>>>> |zfs:zfs_resilver_min_time_ms = 5000| >>>>> >>>>> >>>>> |echo zfs_resilver_delay/w0 | mdb -kw| echo zfs_scrub_delay/w0 |mdb >>>>> |-kw| echo zfs_top_maxinflight/w7f |mdb -kw| echo >>>>> |zfs_resilver_min_time_ms/w1388 |mdb -kw| >>>>> >>>>> On 10/19/2015 11:49 PM, Fred Liu wrote: >>>>> >>>>> Yes, “zpool scrub –s” can stop the resilvering. >>>>> >>>>> *From:*Fred Liu >>>>> *Sent:* 星 期二, 十月20, 2015 12:15 >>>>> *To:* 'zfs-discuss@list.zfsonlinux.org >>>>> <mailto:zfs-discuss@list.zfsonlinux.org>'; developer; illumos- >> zfs; >>>>> freebsd-fs; zfs-discuss >>>>> *Subject:* granularity of performance penalty from resilvering >>>>> >>>>> Sorry if is a duplicate thread. >>>>> >>>>> The last suffering has been lasted for two weeks for we >>>>> replaced >>>> a >>>>> 6TB HDD. >>>>> >>>>> There should be some IO throttle measure from ZFS software >> stack. >>>>> At least, we can try to stop resilvering like scrubbing >>>>> >>>>> if the realization is quiet complicated. >>>>> >>>>> Besides that, will nice zil/cache be relief? >>>>> >>>>> Thanks. >>>>> >>>>> Fred >>>>> >>>>> *illumos-zfs* | Archives >>>>> <https://www.listbox.com/member/archive/182191/=now>; >>>>> <https://www.listbox.com/member/archive/rss/182191/22567878- >> 8480fd5f >>>>> | Modify >>>>> >>>> <https://www.listbox.com/member/?&; >>>> f5b912c9> >>>>> Your Subscription [Powered by Listbox] <http://www.listbox.com>; >>>>> >>>> _______________________________________________ >>>> freebsd-fs@freebsd.org mailing list >>>> https://lists.freebsd.org/mailman/listinfo/freebsd-fs >>>> To unsubscribe, send any mail to "freebsd-fs- >> unsubscribe@freebsd.org" >>> ------------------------------------------- >>> illumos-zfs >>> Archives: https://www.listbox.com/member/archive/182191/=now >>> RSS Feed: >>> https://www.listbox.com/member/archive/rss/182191/22567878-8480fd5f >>> Modify Your Subscription: >>> >> https://www.listbox.com/member/?&; >>> f5b912c9 Powered by Listbox: http://www.listbox.com >> _______________________________________________ >> zfs-devel@freebsd.org mailing list >> https://lists.freebsd.org/mailman/listinfo/zfs-devel >> To unsubscribe, send any mail to "zfs-devel-unsubscribe@freebsd.org" > > ------------------------------------------- > illumos-zfs > Archives: https://www.listbox.com/member/archive/182191/=now > RSS Feed: https://www.listbox.com/member/archive/rss/182191/22567878-8480fd5f > Modify Your Subscription: https://www.listbox.com/member/?member_id=22567878&id_secret=22567878-f5b912c9 > Powered by Listbox: http://www.listbox.com
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?56271897.4030209>