From owner-freebsd-fs@freebsd.org Thu Mar 25 08:55:23 2021 Return-Path: Delivered-To: freebsd-fs@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id D23935B4B94 for ; Thu, 25 Mar 2021 08:55:23 +0000 (UTC) (envelope-from matt.churchyard@userve.net) Received: from smtp-a.userve.net (smtp-outbound.userve.net [217.196.1.22]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "*.userve.net", Issuer "Sectigo RSA Domain Validation Secure Server CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4F5f7t5tVQz4lHP for ; Thu, 25 Mar 2021 08:55:22 +0000 (UTC) (envelope-from matt.churchyard@userve.net) Received: from owa.usd-group.com (owa.usd-group.com [217.196.1.2]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-SHA384 (256/256 bits)) (No client certificate requested) by smtp-a.userve.net (Postfix) with ESMTPS id D088923842B; Thu, 25 Mar 2021 08:55:13 +0000 (GMT) DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=userve.net; s=uk1; t=1616662513; bh=0U+egdwVKNMYHvN1EylhMriiIHzetRJOsUpmRdGM8wQ=; h=From:To:CC:Subject:Date:References:In-Reply-To; b=YvCFu7o09IcuzAGhuufWwU/1k3XG8+WPFvDjkDs/JXdxAgaJd9Ga/Iap4cDlN1fRf hXSWCamzmvfGFZilFpqeBNfCGVk8pBoq8dheo+18yij05h/cNHNg01xbfFCfKNreCU lZ4y2gYZNhV1H7HcE/5ioAm788HC2ZwHYf4vh6wA= Received: from SERVER.ad.usd-group.com (192.168.0.1) by SERVER.ad.usd-group.com (192.168.0.1) with Microsoft SMTP Server (TLS) id 15.0.1497.2; Thu, 25 Mar 2021 08:55:13 +0000 Received: from SERVER.ad.usd-group.com ([fe80::b19d:892a:6fc7:1c9]) by SERVER.ad.usd-group.com ([fe80::b19d:892a:6fc7:1c9%12]) with mapi id 15.00.1497.012; Thu, 25 Mar 2021 08:55:13 +0000 From: Matt Churchyard To: Mathieu Chouquet-Stringer CC: "freebsd-fs@freebsd.org" Subject: RE: Scrub incredibly slow with 13.0-RC3 (as well as RC1 & 2) Thread-Topic: Scrub incredibly slow with 13.0-RC3 (as well as RC1 & 2) Thread-Index: AQHXHwShBASzm+41FEaFBtPr0Iszi6qQHmJQgAAGqYCAAJNmAIAAmgKAgAHCrO+AAAe4AIABSsvg Date: Thu, 25 Mar 2021 08:55:12 +0000 Message-ID: <33eb78e2de404a77b271880dbee4c22e@SERVER.ad.usd-group.com> References: <202103221515.12MFFHRK015188@higson.cam.lispworks.com> <202103241230.12OCUqur030001@higson.cam.lispworks.com> In-Reply-To: Accept-Language: en-GB, en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-ms-exchange-transport-fromentityheader: Hosted x-originating-ip: [192.168.0.10] Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-Rspamd-Queue-Id: 4F5f7t5tVQz4lHP X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=pass header.d=userve.net header.s=uk1 header.b=YvCFu7o0; dmarc=none; spf=pass (mx1.freebsd.org: domain of matt.churchyard@userve.net designates 217.196.1.22 as permitted sender) smtp.mailfrom=matt.churchyard@userve.net X-Spamd-Result: default: False [-1.50 / 15.00]; TO_DN_EQ_ADDR_SOME(0.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[217.196.1.22:from]; R_DKIM_ALLOW(-0.20)[userve.net:s=uk1]; HAS_XOIP(0.00)[]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:217.196.1.0/24]; NEURAL_HAM_LONG(-1.00)[-1.000]; TAGGED_RCPT(0.00)[freebsd]; MIME_GOOD(-0.10)[text/plain]; ARC_NA(0.00)[]; NEURAL_SPAM_MEDIUM(1.00)[1.000]; DMARC_NA(0.00)[userve.net]; SPAMHAUS_ZRD(0.00)[217.196.1.22:from:127.0.2.255]; RCVD_COUNT_THREE(0.00)[4]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[userve.net:+]; RCPT_COUNT_TWO(0.00)[2]; NEURAL_HAM_SHORT(-1.00)[-1.000]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:20652, ipnet:217.196.0.0/20, country:GB]; MAILMAN_DEST(0.00)[freebsd-fs] X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 25 Mar 2021 08:55:23 -0000 -----Original Message----- From: owner-freebsd-fs@freebsd.org On Behalf= Of Mathieu Chouquet-Stringer Sent: 24 March 2021 12:59 To: Martin Simmons Cc: freebsd-fs@freebsd.org Subject: Re: Scrub incredibly slow with 13.0-RC3 (as well as RC1 & 2) On Wed, Mar 24, 2021 at 12:30:52PM +0000, Martin Simmons wrote: > FWIW, I think the new scrub algorithm was added in 2018. You're right, git says Wed Nov 15 20:27:01 2017 -0500 > You could try to profile it: >=20 > https://wiki.freebsd.org/DTrace/Tutorial#Lesson_9._Profile_On-CPU_Kernel_= Stacks > dtrace, hello old friend... :-) > That's the next step... Just an a aside, I did post a message a few weeks ago with a similar proble= m on 13 (as well as snapshot issues). Scrub seemed ok for a short while, bu= t then ground to a halt. It would take 10+ minutes to go 0.01%, with everyt= hing appearing fairly idle. I finally gave up and stopped it after about 20= hours. Moving to 12.2 and rebuilding the pool, the system scrubbed the sam= e data in an hour, and I've just scrubbed the same system after a month of = use with about 4 times the data in 3 hours 20. As far as I'm aware, both sh= ould be using effectively the same "new" scrub code. Will be interesting if you find a cause as I didn't get any response to wha= t for me was a complete showstopper for moving to 13. Matt --=20 Mathieu Chouquet-Stringer The sun itself sees not till heaven clears. -- William Shakespeare -- _______________________________________________ freebsd-fs@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-fs To unsubscribe, send any mail to "freebsd-fs-unsubscribe@freebsd.org"