From owner-freebsd-fs@FreeBSD.ORG Sat Oct 20 22:02:59 2012 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id D8CABABF; Sat, 20 Oct 2012 22:02:59 +0000 (UTC) (envelope-from dwimsey@rtsz.com) Received: from smtp.rtsz.com (rrcs-24-199-159-90.midsouth.biz.rr.com [24.199.159.90]) by mx1.freebsd.org (Postfix) with ESMTP id 9F2A68FC08; Sat, 20 Oct 2012 22:02:59 +0000 (UTC) Received: from [10.27.1.242] (cpe-107-015-155-065.nc.res.rr.com [107.15.155.65]) (using TLSv1 with cipher AES128-SHA (128/128 bits)) (No client certificate requested) by smtp.rtsz.com (Postfix) with ESMTP id B0A2C1CEBD; Sat, 20 Oct 2012 18:01:33 -0400 (EDT) Content-Type: text/plain; charset=iso-8859-1 Mime-Version: 1.0 (Mac OS X Mail 6.2 \(1499\)) Subject: Re: gptzfsboot very slow From: David Wimsey In-Reply-To: <5082D202.9010701@FreeBSD.org> Date: Sat, 20 Oct 2012 18:02:55 -0400 Content-Transfer-Encoding: quoted-printable Message-Id: <211EBAB0-5105-4106-A3CF-30E4D08301DF@rtsz.com> References: <5082D202.9010701@FreeBSD.org> To: "Andrey V. Elsukov" X-Mailer: Apple Mail (2.1499) X-RTS-MailScanner-Information: Please contact the System Administrator for more information X-RTS-MailScanner: Found to be clean X-RTS-MailScanner-MCPCheck: X-Spam-Flag: not spam (whitelisted), SpamAssassin (not cached, score=0, required 4, autolearn=not spam) X-RTS-MailScanner-From: dwimsey@rtsz.com Cc: "freebsd-fs@freebsd.org" X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 20 Oct 2012 22:03:00 -0000 On Oct 20, 2012, at 12:32 PM, "Andrey V. Elsukov" = wrote: > On 20.10.2012 12:50, David Wimsey wrote: >> My file server is configured with zfs root based on >> http://wiki.freebsd.org/RootOnZFS/GPTZFSBoot/Mirror >>=20 >> When booting, after it gets past the BIOS drive C: is disk0 (one line >> for each of the 6 drives as expected) part, drops to a new line and >> the rotating twiddle starts its bit. At first it moves a long at a >> almost normal looking speed, then it starts only ticking away slowly, >> maybe once or twice a minute. >>=20 >> It appears that its scanning the entire drive or something odd. Its >> hard to tell if its doing it on all the drives as half of them are on >> a RocketRAID card (configured as JBOD) which doesn't have a LED >> indicator attached to it for showing activity. >>=20 >> There are a total of 6 drives in the machine. >>=20 >> 2 drives are SSDs which are sliced up to provide the root mirror >> vdev, a mirrored vdev for the zip if the main pool on the machine and >> each provide a slice L2ARC. Some of the remaining space is in a >> small pool 3 of the HDDs are part of a raidz vdev for my main pool.=20= >> The remaining HDD is a hot spare. >>=20 >> If I remove the HDDs from the system and just let the SSDs handle the >> boot, its faster but still far longer than it should be, so when I'm >> in a hurry I unplug the 4 HDDs, boot, wait for it to get to the >> FreeBSD boot menu, plug the HDDs back in and send it on its marry >> way. >>=20 >> This can not be expected behavior in my mind. Why is it doing so >> much disk thrashing when the pools are all perfectly clean. >=20 > Hi, David. >=20 > These lines are not from gptzfsboot, but from the loader. You can try > the loader(8) from the FreeBSD 10-CURRENT, you may take it from = recent > snapshot: > = https://pub.allbsd.org/FreeBSD-snapshots/amd64-amd64/10.0-HEAD-20121006-JP= SNAP/stage/trees/boot/zfsloader >=20 > --=20 > WBR, Andrey V. Elsukov >=20 > --=20 > WBR, Andrey V. Elsukov >=20 Ding! We have a winner! The new zfsloader fixed the problem, the twiddle keeps spinning fast = and only takes a few seconds before jumping to the boot menu. Thanks! Just out of curiosity, do you know what change fixed it or what exactly = the old loader was doing?=