From owner-freebsd-current@FreeBSD.ORG Tue Sep 8 15:00:39 2009 Return-Path: Delivered-To: freebsd-current@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id A25FA106566C for ; Tue, 8 Sep 2009 15:00:39 +0000 (UTC) (envelope-from paul@fletchermoorland.co.uk) Received: from hydra.fletchermoorland.co.uk (hydra.fletchermoorland.co.uk [78.33.209.59]) by mx1.freebsd.org (Postfix) with ESMTP id CE5D58FC0A for ; Tue, 8 Sep 2009 15:00:38 +0000 (UTC) Received: from demophon.fletchermoorland.co.uk (demophon.fletchermoorland.co.uk [192.168.0.154]) by hydra.fletchermoorland.co.uk (8.14.3/8.14.3) with ESMTP id n88F0UGD073234; Tue, 8 Sep 2009 16:00:31 +0100 (BST) (envelope-from paul@fletchermoorland.co.uk) Message-ID: <4AA67F6B.20800@fletchermoorland.co.uk> Date: Tue, 08 Sep 2009 15:59:39 +0000 From: Paul Wootton User-Agent: Thunderbird 2.0.0.23 (X11/20090825) MIME-Version: 1.0 To: oliver@namp.de References: <24905.1252413921@namp.de> In-Reply-To: <24905.1252413921@namp.de> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit Content-Disposition: inline X-Scanned-By: MIMEDefang 2.64 on 192.168.0.1 X-Spam-Status: No, score=-4.4 required=10.0 tests=ALL_TRUSTED,BAYES_00 autolearn=ham version=3.2.5 X-Spam-Checker-Version: SpamAssassin 3.2.5 (2008-06-10) on hydra.fletchermoorland.co.uk Cc: freebsd-current@freebsd.org Subject: Re: boot from raidz X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 08 Sep 2009 15:00:39 -0000 Oliver Fakler wrote: > On Mon 07/09/09 20:22 , Paul Wootton wrote:Oliver Fakler wrote: > > On Mon 07/09/09 13:40 , Bernhard Schmidt wrote: > > Am 07.09.2009 um 11:13 schrieb Oliver Fakler: > > > > > > BODY { font-family:Arial, Helvetica, sans-serif;font-size:12px; > } > > > > > > On Mon 07/09/09 10:07 , Bernhard Schmidt > > > wrote: > > > > > > > > > Am 06.09.2009 um 21:45 schrieb Oliver Fakler: > > > > > > > > > > > > > > > Hi all, > > > > > > > > i installed a 8.0 beta 3 amd64 based testsystem. > > > > > > > > i tried with a root on a raidz, but i have a problem after > the > > first > > > > reboot, there is a error message: > > > > > > > > can't load kernel > > > > I found something that boot root from raidz is not supported, > > but > > > > maybe there is a solution?? > > > > Hope some can help me > > > > > > > > > There are patches from Doug Rabson which add support for > booting > > from > > > raidz/raidz2. > > > > > > > > > http://lists.freebsd.org/pipermail/freebsd-fs/2008-December/005498.html > [1]" > target="_blank">http://lists.freebsd.org/pipermail/freebsd-fs/2008-December/005498.html > > [2]" > > > target="_blank">http://lists.freebsd.org/pipermail/freebsd-fs/2008-December/005498.html > [2]" > target="_blank">http://lists.freebsd.org/pipermail/freebsd-fs/2008-December/005498.html > > > > > " > > > target="_blank">http://lists.freebsd.org/pipermail/freebsd-fs/2008-December/005498.html > [3]" > target="_blank">http://lists.freebsd.org/pipermail/freebsd-fs/2008-December/005498.html > > [3]" > > > target="_blank">http://lists.freebsd.org/pipermail/freebsd-fs/2008-December/005498.html > [4]" > target="_blank">http://lists.freebsd.org/pipermail/freebsd-fs/2008-December/005498.html > > Seems that patch made it already into the tree (r192194). > > > > > > > > > I tried it, but after a make obj && make depend the make failed > > with > > > different errors like undeclared and has no member named. > > > > > > I used patch raidzboot-14052009.diff started patching from > > /usr/src/ > > > sys/ , i'm not sure if this was the right way. > > > > > > I'm also not sure if the way of installation was the right one, > > > > here's the way i go: > > > > > > > > > gpart create -s GPT da0 > > > gpart add -b 34 -s 128 -t freebsd-boot da0 > > > gpart add -b 162 -s 5242880 -t freebsd-swap da0 > > > gpart add -b 5243042 -s 11534141 -t freebsd-zfs da0 > > > gpart bootcode -b /mnt2/boot/pmbr -p /mnt2/boot/gptzfsboot -i 1 > > da0 > > > gpart bootcode -b /mnt2/boot/pmbr -p /mnt2/boot/gptzfsboot -i 1 > > da1 > > > gpart bootcode -b /mnt2/boot/pmbr -p /mnt2/boot/gptzfsboot -i 1 > > da2 > > > > > Can you try zfsboot instead of gptzfsboot? > > > > > http://unix.derkeiler.com/Mailing-Lists/FreeBSD/stable/2009-05/msg00689.html > [5]" > target="_blank">http://unix.derkeiler.com/Mailing-Lists/FreeBSD/stable/2009-05/msg00689.html > > [4]" > > > target="_blank">http://unix.derkeiler.com/Mailing-Lists/FreeBSD/stable/2009-05/msg00689.html > [6]" > target="_blank">http://unix.derkeiler.com/Mailing-Lists/FreeBSD/stable/2009-05/msg00689.html > > > > at the end of the mail. > > > > > > > > > kldload /mnt2/boot/kernel/opensolaris.ko > > > kldload /mnt2/boot/kernel/zfs.ko > > > > > > zpool create tank raidz da0p3 da1p1 d2p1 > > > > > > zfs create tank/tmp > > > zfs create tank/usr > > > zfs create tank/var > > > > > > cd /dist/8.0-BETA3/base > > > export DESTDIR=/tank > > > ./install.sh > > > You are about to extract the base distribution into /tank - are > > you > > > SURE > > > you want to do this over your installed system (y/n)? y > > > cd ../kernels > > > ./install.sh generic > > > cd /tank/boot > > > cp -Rp GENERIC/* kernel/ > > > > > > cd /dist/8.0-BETA3/src > > > ./install.sh all > > > Extracting sources into /usr/src... > > > Extracting source component: base > > > Extracting source component: bin > > > Extracting source component: cddl > > > Extracting source component: contrib > > > Extracting source component: crypto > > > Extracting source component: etc > > > Extracting source component: games > > > Extracting source component: gnu > > > Extracting source component: include > > > Extracting source component: krb5 > > > Extracting source component: lib > > > Extracting source component: libexec > > > Extracting source component: release > > > Extracting source component: rescue > > > Extracting source component: sbin > > > Extracting source component: secure > > > Extracting source component: share > > > Extracting source component: sys > > > Extracting source component: tools > > > Extracting source component: ubin > > > Extracting source component: usbin > > > Done extracting sources. > > > Done extracting sources. > > > cd ../manpages > > > ./install.sh > > > > > > echo 'zfs_enable="YES"' > /tank/etc/rc.conf > > > echo 'LOADER_ZFS_SUPPORT="YES"' > /tank/etc/src.conf > > > echo 'zfs_load="YES"' > /tank/boot/loader.conf > > > echo 'vfs.root.mountfrom="zfs:tank"' >> /tank/boot/loader.conf > > > echo ´/dev/da0p2 none swap sw 0 0´>> > /tank/etc/fstab > > > > > > mkdir /boot/zfs > > > zpool export tank && zpool import tank > > > cp /boot/zfs/zpool.cache /tank/boot/zfs/ > > > > > > chroot /tank > > > mount -t devfs devfs /dev > > > unset DESTDIR > > > cd /usr/src/sys/boot/ > > > make obj > > > make depend > > > make > > > cd i386/loader > > > make install > > > umount /dev > > > touch /etc/fstab > > > exit > > > > > > export LD_LIBRARY_PATH=/mnt2/lib > > > zfs set mountpoint=legacy tank > > > zfs set mountpoint=/tmp tank/tmp > > > zfs set mountpoint=/var tank/var > > > zfs set mountpoint=/usr tank/usr > > > zpool set bootfs=tank tank > > > > > Seems correct at first glance. > > -- > > Bernhard > > testet with zfsboot instead of gptzfsboot but it was not > successfull > > :-( > > > > Links: > > ------ > > [2] http://mail.kuehlbox.de/parse.php%3Fredirect%3D%26lt%3Ba [7]" > target="_blank">http://mail.kuehlbox.de/parse.php?redirect= [3] > http://mail.kuehlbox.de/parse.php%3Fredirect%3D%26lt%3Ba [8]" > target="_blank">http://mail.kuehlbox.de/parse.php?redirect= [4] > http://mail.kuehlbox.de/parse.php%3Fredirect%3D%26lt%3Ba [9]" > target="_blank">http://mail.kuehlbox.de/parse.php?redirect= > _______________________________________________ > > mailing list > > http://lists.freebsd.org/mailman/listinfo/freebsd-current [11]" > target="_blank">http://lists.freebsd.org/mailman/listinfo/freebsd-current > > To unsubscribe, send any mail to " > I have a fully running GPT ZFS RaidZ setup using what was at the > time 8-HEAD > I cant remember the exact steps I took, but one thing I have > different > is I have a root filesystem within my zpool > [ /usr/home/paul]$ gpart show > => 34 976773101 ada1 GPT (466G) > 34 256 1 freebsd-boot (128K) > 290 8388608 2 freebsd-swap (4.0G) > 8388898 147912557 3 freebsd-zfs (71G) > 156301455 820471680 - free - (391G) > => 34 488394988 ada2 GPT (233G) > 34 256 1 freebsd-boot (128K) > 290 8388608 2 freebsd-swap (4.0G) > 8388898 147912557 3 freebsd-zfs (71G) > 156301455 332093567 - free - (158G) > => 34 156301421 ada3 GPT (75G) > 34 256 1 freebsd-boot (128K) > 290 8388608 2 freebsd-swap (4.0G) > 8388898 147912557 3 freebsd-zfs (71G) > [ /usr/home/paul]$ zpool status > pool: zboot > state: ONLINE > scrub: none requested > config: > NAME STATE READ WRITE CKSUM > zboot ONLINE 0 0 0 > ada1p3 ONLINE 0 0 0 > ada2p3 ONLINE 0 0 0 > ada3p3 ONLINE 0 0 0 > errors: No known data errors > [ /usr/home/paul]$ zfs list > NAME USED AVAIL REFER MOUNTPOINT > zboot 33.5G 175G 18K none > zboot/root 12.4G 175G 12.2G none > zboot/tmp 82.9M 175G 82.6M none > zboot/usr 20.8G 175G 16.5G none > zboot/var 216M 175G 123M none > Im also using fstabs to mount my ZFS filesystems > [ /usr/home/paul]$ more /etc/fstab > # Device Mountpoint FStype Options Dump > > Pass# > zboot/root / zfs rw 0 > 0 > zboot/usr /usr zfs rw 0 > 0 > zboot/var /var zfs rw 0 > 0 > zboot/tmp /tmp zfs rw,noatime 0 > 0 > proc /proc procfs rw 0 > 0 > I remember speak to someone a while back, and I *think* we came to > the > conclusion that using the zpool as your root will not work correctly > and > you should really create a root filesystem inside the zpool > Lets me know how this works out for you > Paul > > ----------------------------------------------------------------------------------- > Fletcher Moorland Limited is a company registered in England and > Wales. > Registration number: 2984467. > Registered office: Elenora Street, Stoke on Trent, Staffordshire, > ST4 1QG. > VAT Registration number: 478730606 > Telephone: 01782 411021 | Fax: 01782 744470 | > http://www.fletchermoorland.co.uk [17]" > target="_blank">http://www.fletchermoorland.co.uk > _______________________________________________ > mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-current [19]" > target="_blank">http://lists.freebsd.org/mailman/listinfo/freebsd-current > To unsubscribe, send any mail to "" > your pool is just a stripe, no raidz > > i testet it with striping, and it was successfull, but i need a > raidz > > there are some new errors on Beta4 > > can'tfind root filesystem > > maybe you're right with your idea of an extra root folder, but i > think if he can't find root filesystem, he also can't read fstab. > maybe more ideas? :-) > cheers > Oliver > > Links: > ------ > [1] http://mail.kuehlbox.de/parse.php?redirect= [2] http://mail.kuehlbox.de/parse.php?redirect= [3] http://mail.kuehlbox.de/parse.php?redirect= [4] http://mail.kuehlbox.de/parse.php?redirect= [5] http://mail.kuehlbox.de/parse.php?redirect= [6] http://mail.kuehlbox.de/parse.php?redirect= [7] http://mail.kuehlbox.de/parse.php?redirect= [8] http://mail.kuehlbox.de/parse.php?redirect= [9] http://mail.kuehlbox.de/parse.php?redirect= [11] http://mail.kuehlbox.de/parse.php?redirect= [17] http://mail.kuehlbox.de/parse.php?redirect= [19] http://mail.kuehlbox.de/parse.php?redirect= _______________________________________________ > freebsd-current@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-current > To unsubscribe, send any mail to "freebsd-current-unsubscribe@freebsd.org" > Ok, so now I feel like a fool... You're right... It's not a raidz, but it *should* have been one. I had tried MANY things and it was getting late (or early depending onm how you look at it) that night when I finally got the system up... So, i'll take my system off line in the next few days and try rebuilding with a raidz... I thought it was too good to be true Paul ----------------------------------------------------------------------------------- Fletcher Moorland Limited is a company registered in England and Wales. Registration number: 2984467. Registered office: Elenora Street, Stoke on Trent, Staffordshire, ST4 1QG. VAT Registration number: 478730606 Telephone: 01782 411021 | Fax: 01782 744470 | http://www.fletchermoorland.co.uk