From owner-freebsd-current@freebsd.org Thu Jun 21 06:00:53 2018 Return-Path: Delivered-To: freebsd-current@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 52465100A01A for ; Thu, 21 Jun 2018 06:00:53 +0000 (UTC) (envelope-from kiri@kx.openedu.org) Received: from kx.openedu.org (flets-sg1027.kamome.or.jp [202.216.24.27]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id A069A8BDC6; Thu, 21 Jun 2018 06:00:51 +0000 (UTC) (envelope-from kiri@kx.openedu.org) Received: from kx.openedu.org (kx.openedu.org [202.216.24.27]) by kx.openedu.org (8.14.5/8.14.5) with ESMTP id w5L60mYn079435; Thu, 21 Jun 2018 15:00:49 +0900 (JST) (envelope-from kiri@kx.openedu.org) Message-Id: <201806210600.w5L60mYn079435@kx.openedu.org> Date: Thu, 21 Jun 2018 15:00:48 +0900 From: KIRIYAMA Kazuhiko To: Allan Jude Cc: freebsd-current@freebsd.org Subject: Re: ZFS: I/O error - blocks larger than 16777216 are not supported In-Reply-To: <21493592-4eb2-59c5-1b0d-e1d08217a96b@freebsd.org> References: <201806210136.w5L1a5Nv074194@kx.openedu.org> <21493592-4eb2-59c5-1b0d-e1d08217a96b@freebsd.org> User-Agent: Wanderlust/2.14.0 (Africa) SEMI/1.14.6 (Maruoka) FLIM/1.14.9 (=?ISO-8859-4?Q?Goj=F2?=) APEL/10.6 MULE XEmacs/21.4 (patch 22) (Instant Classic) (amd64--freebsd) MIME-Version: 1.0 (generated by SEMI 1.14.6 - "Maruoka") Content-Type: text/plain; charset=US-ASCII X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.26 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 21 Jun 2018 06:00:53 -0000 At Wed, 20 Jun 2018 23:34:48 -0400, Allan Jude wrote: > > On 2018-06-20 21:36, KIRIYAMA Kazuhiko wrote: > > Hi all, > > > > I've been reported ZFS boot disable problem [1], and found > > that this issue occers form RAID configuration [2]. So I > > rebuit with RAID5 and re-installed 12.0-CURRENT > > (r333982). But failed to boot with: > > > > ZFS: i/o error - all block copies unavailable > > ZFS: can't read MOS of pool zroot > > gptzfsboot: failed to mount default pool zroot > > > > FreeBSD/x86 boot > > ZFS: I/O error - blocks larger than 16777216 are not supported > > ZFS: can't find dataset u > > Default: zroot/<0x0>: > > > > In this case, the reason is "blocks larger than 16777216 are > > not supported" and I guess this means datasets that have > > recordsize greater than 8GB is NOT supported by the > > FreeBSD boot loader(zpool-features(7)). Is that true ? > > > > My zpool featues are as follows: > > > > # kldload zfs > > # zpool import > > pool: zroot > > id: 13407092850382881815 > > state: ONLINE > > status: The pool was last accessed by another system. > > action: The pool can be imported using its name or numeric identifier and > > the '-f' flag. > > see: http://illumos.org/msg/ZFS-8000-EY > > config: > > > > zroot ONLINE > > mfid0p3 ONLINE > > # zpool import -fR /mnt zroot > > # zpool list > > NAME SIZE ALLOC FREE EXPANDSZ FRAG CAP DEDUP HEALTH ALTROOT > > zroot 19.9T 129G 19.7T - 0% 0% 1.00x ONLINE /mnt > > # zpool get all zroot > > NAME PROPERTY VALUE SOURCE > > zroot size 19.9T - > > zroot capacity 0% - > > zroot altroot /mnt local > > zroot health ONLINE - > > zroot guid 13407092850382881815 default > > zroot version - default > > zroot bootfs zroot/ROOT/default local > > zroot delegation on default > > zroot autoreplace off default > > zroot cachefile none local > > zroot failmode wait default > > zroot listsnapshots off default > > zroot autoexpand off default > > zroot dedupditto 0 default > > zroot dedupratio 1.00x - > > zroot free 19.7T - > > zroot allocated 129G - > > zroot readonly off - > > zroot comment - default > > zroot expandsize - - > > zroot freeing 0 default > > zroot fragmentation 0% - > > zroot leaked 0 default > > zroot feature@async_destroy enabled local > > zroot feature@empty_bpobj active local > > zroot feature@lz4_compress active local > > zroot feature@multi_vdev_crash_dump enabled local > > zroot feature@spacemap_histogram active local > > zroot feature@enabled_txg active local > > zroot feature@hole_birth active local > > zroot feature@extensible_dataset enabled local > > zroot feature@embedded_data active local > > zroot feature@bookmarks enabled local > > zroot feature@filesystem_limits enabled local > > zroot feature@large_blocks enabled local > > zroot feature@sha512 enabled local > > zroot feature@skein enabled local > > zroot unsupported@com.delphix:device_removal inactive local > > zroot unsupported@com.delphix:obsolete_counts inactive local > > zroot unsupported@com.delphix:zpool_checkpoint inactive local > > # > > > > Regards > > > > [1] https://lists.freebsd.org/pipermail/freebsd-current/2018-March/068886.html > > [2] https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=151910 > > > > --- > > KIRIYAMA Kazuhiko > > _______________________________________________ > > freebsd-current@freebsd.org mailing list > > https://lists.freebsd.org/mailman/listinfo/freebsd-current > > To unsubscribe, send any mail to "freebsd-current-unsubscribe@freebsd.org" > > > > I am guessing it means something is corrupt, as 16MB is the maximum size > of a record in ZFS. Also, the 'large_blocks' feature is 'enabled', not > 'active', so this suggest you do not have any records larger than 128kb > on your pool. As I mentioned above, [2] says ZFS on RAID disks have any serious bugs except for mirror. Anyway I gave up to use ZFS on RAID{5,6}* until Bug 151910 [2] fixed. > > -- > Allan Jude > --- KIRIYAMA Kazuhiko