From nobody Wed Apr 27 08:20:59 2022 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 713CE19914F2 for ; Wed, 27 Apr 2022 08:21:05 +0000 (UTC) (envelope-from se@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [IPv6:2610:1c1:1:606c::24b:4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4KpBXd2dmVz3FG9; Wed, 27 Apr 2022 08:21:05 +0000 (UTC) (envelope-from se@FreeBSD.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1651047665; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=bg7Ekn5lIXzFSvGOTru3H27/gdPfd3yYWRUEJvOZbo8=; b=fm6/PNiQI8JMPFacA8qGY/Ddp68jmwbpM3xhZ1ONqi+7StRjl+7N+qir8U6IyemyNfe4Fe vbJ00fSmYo7dqUAewrTk/E1w6ZEtdx3lOzSy6UCPk7R17cwuCQyRE1iH2FhO5Qw/e1Vfal DsXImleRDDPy4yDQy0BKPhX5AqO5tJmpH/JzvJbsv99mENExT182Jv25zZkuVN2ipZ7cS4 yA7cqvteY+NgSG29GFS5KgmfJ74ubS3YvAgpK0IG4yNFYtNaw3C6c4Y30JsP6cG3gM8ZCE tOaEBMnxFeGmvWHpe3+TQhJJIzk6BN0wSFj3D9jkuyGWkoY6insGB+qA0AH8Dg== Received: from [IPV6:2003:cd:5f05:c200:7555:8c17:9728:90a9] (p200300cd5f05c20075558c17972890a9.dip0.t-ipconnect.de [IPv6:2003:cd:5f05:c200:7555:8c17:9728:90a9]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) (Authenticated sender: se/mail) by smtp.freebsd.org (Postfix) with ESMTPSA id C82FC60DF; Wed, 27 Apr 2022 08:21:04 +0000 (UTC) (envelope-from se@FreeBSD.org) Message-ID: Date: Wed, 27 Apr 2022 10:20:59 +0200 List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:91.0) Gecko/20100101 Thunderbird/91.8.1 Subject: Re: FreeBSD boot from root pool larger than 1Tb/cannot read MOS/all block copies unavailable Content-Language: en-US To: Charles Sprickman Cc: freebsd-stable@freebsd.org References: <2c2d774c-3677-c3b7-d099-71318743a434@zhegan.in> <23BB62D2-CF27-4730-A19B-A110F3D9970E@bway.net> From: Stefan Esser In-Reply-To: <23BB62D2-CF27-4730-A19B-A110F3D9970E@bway.net> Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="------------7518wSGt3d20nZc99Rxgz0w0" ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1651047665; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=bg7Ekn5lIXzFSvGOTru3H27/gdPfd3yYWRUEJvOZbo8=; b=Dyhp8GGmuwDAF33v5XoDLXR2KawMIACjMgWzH85eOc+n74UIKiYPWP2FZFZE7Ln3wlaqGU UhH4qhIiK6mj8ClULQpCTYs/+GTOSBSjcm3lusEfog0xdJfDaMPZUvWc4yTp5gZYsOz8in sfXh5NaLGHymY9toUrbPi2gIAabsUgbA8WRFZDKsRCvAdTVM7d0L605ezd2yosTegnsSEn vI6AJE1si24fVB4DVtW4eCUIyCORh4fSaKGiiUIwsp+pmtcRhmtzT3nja/LBLzaX6hUmxX 6uz1qi9A32QrX7eIlwdvES5kWlIQnJQAXBfqOhs7r5nm8jJViwA9h3oXfPELvg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1651047665; a=rsa-sha256; cv=none; b=nBJ1i2sEwaf1gOUOGNp8ah9CSHRo9MEpDM19ylX+24vTmk5y7KRVVPiFUEhqXowc7Jljl/ 6nIi1F8PaLai//lgp1cSIENrklrIfRttNCLRPLx4z4lnef0B3KTAiqDWutP5k0DkHB7OKk yiiUwbJvz1WkG3DmqEkvzxcZFksN544/GBD6izuN29neAXuX3+RSqD5QBCpB7OxfGJmQGU C0n3vFZ0Hf/1+MzbR9mwuut85tD1LkyR6rs1GVyEmfreh5zm7dxqaUk2MDYc8nLeZHOJny OpoZTF0VbS1vIG7a4Ox9bmyMAE+JaSDUjKzaoX3MWrQUxr9KWOUMAGh31bhBSg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --------------7518wSGt3d20nZc99Rxgz0w0 Content-Type: multipart/mixed; boundary="------------Pv1ZITXSJPckA40iWhNOZLgv"; protected-headers="v1" From: Stefan Esser To: Charles Sprickman Cc: freebsd-stable@freebsd.org Message-ID: Subject: Re: FreeBSD boot from root pool larger than 1Tb/cannot read MOS/all block copies unavailable References: <2c2d774c-3677-c3b7-d099-71318743a434@zhegan.in> <23BB62D2-CF27-4730-A19B-A110F3D9970E@bway.net> In-Reply-To: <23BB62D2-CF27-4730-A19B-A110F3D9970E@bway.net> --------------Pv1ZITXSJPckA40iWhNOZLgv Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Am 27.04.22 um 02:10 schrieb Charles Sprickman:>> On Apr 26, 2022, at 10:= 10 AM, Eugene M. Zheganin wrote: >> >> Hello, >> >> recently I found another server that was running 12.x and became unboo= table because of the famous "cannot read MOS/all block copies unavailable= /etc" gptzfsboot message which can be randomly displayed when boot blocks= migrate beyond 1st Tb on a large root pool. >=20 > Is this documented somewhere? I=E2=80=99m pretty sure I have a number o= f servers that fit this description. How do boot blocks =E2=80=9Cmigrate=E2= =80=9D? Boot blocks on PCs are traditionally stored in the first few sectors of the boot disk. But those are only used to load a loader that knows about the actual file system format used, and the loader still relies on BIOS functions to access the boot file system where the kernel resides. BIOS limits have hurt PC users over the years, and those limits have always been only slightly increased, just enough to support common disk sizes at the respective point time: https://tldp.org/HOWTO/Large-Disk-HOWTO-4.html With UFS the kernel was typically loaded from the "a" partition, which commonly was small and placed first on the disk. With ZFS you can have a small boot pool (or base system pool) in a partition completely within the range covered by the BIOS to create a somewhat similar layout. Else ZFS may place parts of the kernel anywhere on a pool that may be much larger than the BIOS call can address. This is not a FreeBSD limit, it is a limit of the technology provided by the PC platform and the functionality provided by the PC BIOS. Regards, STefan --------------Pv1ZITXSJPckA40iWhNOZLgv-- --------------7518wSGt3d20nZc99Rxgz0w0 Content-Type: application/pgp-signature; name="OpenPGP_signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="OpenPGP_signature" -----BEGIN PGP SIGNATURE----- wsB5BAABCAAjFiEEo3HqZZwL7MgrcVMTR+u171r99UQFAmJo/OsFAwAAAAAACgkQR+u171r99UQ7 nwgAhNl7sK4z1h4OVbsaB2DQbKZqunqsxkRsy0B8L8A0cA1hsCwxZ+jPbes4+QquXNsoHoEQzbQH +qIiGCevfkQ5r6gqBgmDZMhhX0GU5qg/oLCvwzOnqodfan0qY9727fkCowa9X2lj5LR2NZ0Wmz62 daxVP/pxdBovMDCLf+X9QtueJKuTBZp23I3GeniRzXIRWJllSMIzpM59uYhKynhAPdwrZU8068Pp DpvexkYbtghzy9cnh0QwBDA3pT2JMR/OSlhQCTFshFRnaEiQiMqUCMX+ZQ82oluz1GGY9pVSpBiS rc05APhZkkvl7V9NjyUARILmQyKuunyktvPXgziLXg== =h5Wc -----END PGP SIGNATURE----- --------------7518wSGt3d20nZc99Rxgz0w0--