From owner-freebsd-stable@freebsd.org Thu May 9 12:56:25 2019 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 43E6D15A8CE1 for ; Thu, 9 May 2019 12:56:25 +0000 (UTC) (envelope-from asomers@gmail.com) Received: from mail-lj1-f173.google.com (mail-lj1-f173.google.com [209.85.208.173]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 046198DF21; Thu, 9 May 2019 12:56:23 +0000 (UTC) (envelope-from asomers@gmail.com) Received: by mail-lj1-f173.google.com with SMTP id k8so1906514lja.8; Thu, 09 May 2019 05:56:23 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc:content-transfer-encoding; bh=vyjRYILfzc7hyNOQgWlqG09zVjG7et4fASUpb65BNkc=; b=E5RVqeS4TdziTXZRqxz6M5plIPq9DtDlZdndBzRI3V1DoZjD6tFFOu+g5dNe0gvpBn 1H75A+nOn6UyYuXMqo/10YYrYMP/P+qyrTARSN096C0QMk+hMiuaxLBwDZ9kdF6xw3Ae HtcDo9ew38M8LsAKK9wg+23w51UmrfszbXlAoqcDvO66XAa5TAFfwUXosNeIPto/GRg+ 0mwGA2T2P05glXbTFaAcMeTcArvbebJZ/RJ8Xab/t60yL11ZOmZx4Dshucd1vy5pfSW/ CEFlHBx+EmXSmnG218C4WhtfwwYYyqH2+DayEk+S/eZx1wjr9l/SN2VftY58dBEk2vDh mdtQ== X-Gm-Message-State: APjAAAWGwSVnb1RLDsgFDc6/LDef1nUsXCdcat3OddIalmDfuDJQD1um CqDvnbFzK7xdKS3gu86Qa2yOU1Q16YTlINhCPHg= X-Google-Smtp-Source: APXvYqzkW1StO0qOdoWqVq9bdDtgC5qjGFf7EZ3uNvizMv4AzxCBz6Wr2SAEYZyDAj2DofTWIKNhuyEbUe0YxpKeTRQ= X-Received: by 2002:a2e:1654:: with SMTP id 20mr2220939ljw.53.1557406222162; Thu, 09 May 2019 05:50:22 -0700 (PDT) MIME-Version: 1.0 References: <30506b3d-64fb-b327-94ae-d9da522f3a48@sorbs.net> <5ED8BADE-7B2C-4B73-93BC-70739911C5E3@sorbs.net> <2e4941bf-999a-7f16-f4fe-1a520f2187c0@sorbs.net> <20190430102024.E84286@mulder.mintsol.com> <41FA461B-40AE-4D34-B280-214B5C5868B5@punkt.de> <20190506080804.Y87441@mulder.mintsol.com> <08E46EBF-154F-4670-B411-482DCE6F395D@sorbs.net> <33D7EFC4-5C15-4FE0-970B-E6034EF80BEF@gromit.dlib.vt.edu> <7D18A234-E7BF-4855-BD51-4AE2253DB1E4@sorbs.net> <805ee7f1-83f6-c59e-8107-4851ca9fce6e@quip.cz> <5de7f3d3-b34c-0382-b7d4-b7e38339649b@quip.cz> In-Reply-To: <5de7f3d3-b34c-0382-b7d4-b7e38339649b@quip.cz> From: Alan Somers Date: Thu, 9 May 2019 06:50:10 -0600 Message-ID: Subject: Re: ZFS... To: Miroslav Lachman <000.fbsd@quip.cz> Cc: Dimitry Andric , FreeBSD-STABLE Mailing List Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Rspamd-Queue-Id: 046198DF21 X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; spf=pass (mx1.freebsd.org: domain of asomers@gmail.com designates 209.85.208.173 as permitted sender) smtp.mailfrom=asomers@gmail.com X-Spamd-Result: default: False [-3.63 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-0.997,0]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; R_SPF_ALLOW(-0.20)[+ip4:209.85.128.0/17]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; RCVD_TLS_LAST(0.00)[]; DMARC_NA(0.00)[freebsd.org]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; MX_GOOD(-0.01)[cached: alt3.gmail-smtp-in.l.google.com]; NEURAL_HAM_SHORT(-0.76)[-0.758,0]; RCVD_IN_DNSWL_NONE(0.00)[173.208.85.209.list.dnswl.org : 127.0.5.0]; SUBJ_ALL_CAPS(0.45)[6]; IP_SCORE(-1.31)[ip: (-0.53), ipnet: 209.85.128.0/17(-3.71), asn: 15169(-2.26), country: US(-0.06)]; FORGED_SENDER(0.30)[asomers@freebsd.org,asomers@gmail.com]; MIME_TRACE(0.00)[0:+]; R_DKIM_NA(0.00)[]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:209.85.128.0/17, country:US]; FROM_NEQ_ENVFROM(0.00)[asomers@freebsd.org,asomers@gmail.com]; RCVD_COUNT_TWO(0.00)[2] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 09 May 2019 12:56:25 -0000 On Thu, May 9, 2019 at 5:37 AM Miroslav Lachman <000.fbsd@quip.cz> wrote: > > Dimitry Andric wrote on 2019/05/09 13:02: > > On 9 May 2019, at 10:32, Miroslav Lachman <000.fbsd@quip.cz> wrote: > > [...] > > >> Disks are OK, monitored by smartmontools. There is nothing odd, just t= he long long scrubs. This machine was started with 4x 1TB (now 4x 4TB) and = scrub was slow with 1TB disks too. This machine - HP ML110 G8) was my first= machine with ZFS. If I remember it well it was FreeBSD 7.0, now running 11= .2. Scrub was / is always about one week. (I tried some sysctl tuning witho= ut much gain) > > > > Unfortunately https://svnweb.freebsd.org/changeset/base/339034, which > > greatly speeds up scrubs and resilvers, was not in 11.2 (since it was > > cut at r334458). > > > > If you could update to a more recent snapshot, or try the upcoming 11.3 > > prereleases, you will hopefully see much shorter scrub times. > > Thank you. I will try 11-STABLE / 11.3-PRERELEASE soon and let you know > about the difference. > > Kind regards > Miroslav Lachman On 11.3 and even much older releases, you can greatly speed up scrub and resilver by tweaking some sysctls. If you have spinning rust, raise vfs.zfs.top_maxinflight so they'll do fewer seeks. I used to set it to 8192 on machines with 32GB of RAM. Raising vfs.zfs.resilver_min_time_ms to 5000 helps a little, too. -Alan