Date: Wed, 18 Oct 2023 14:30:09 +0000 From: "azathanai@icloud.com" <azathanai@icloud.com> To: Miroslav Lachman <000.fbsd@quip.cz> Cc: "freebsd-hackers@FreeBSD.org" <freebsd-hackers@FreeBSD.org> Subject: Re: Question of installing over SAS controller and USB flash Message-ID: <AM6PR02MB44715B177C56DDBB0CC4CD4AA5D5A@AM6PR02MB4471.eurprd02.prod.outlook.com> In-Reply-To: <AM6PR02MB4471AD796A475A88421738B9A5D1A@AM6PR02MB4471.eurprd02.prod.outlook.com> References: <AM6PR02MB4471B8EABD99C690DE9B9F49A5CDA@AM6PR02MB4471.eurprd02.prod.outlook.com> <CANCZdfrz1KZGavcCCpSUjpWUVN2Vem5XBWEzOii6yd=dUxTNJw@mail.gmail.com> <AM6PR02MB4471FE504225A2FBAF35DDA4A5CCA@AM6PR02MB4471.eurprd02.prod.outlook.com> <84c06802-a6d9-fa5d-8dab-9ebe18074321@quip.cz> <AM6PR02MB4471AD796A475A88421738B9A5D1A@AM6PR02MB4471.eurprd02.prod.outlook.com>
next in thread | previous in thread | raw e-mail | index | archive | help
--_000_AM6PR02MB44715B177C56DDBB0CC4CD4AA5D5AAM6PR02MB4471eurp_ Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable OK. I've flashed the card with the mini-memstick and now it boots and starts th= e installation for FreeBSD, which is fine. However when it goes on partitio= ning of the drives, I'm not sure what to do. 1. I can mark all drives on the sas controller for auto-zfs, but if the = flash card is not "included" then the machine will reboot to the installati= on again. 2. I can include the flash card in the installation of auto-zfs, but tha= t means to have the card as root space and will not be able to use the big = drives. 3. I need to manually setup the partitions, having the efi and /boot on = the flash card and eventually mirrored on all other drives and have the / o= n the SAS drives, but doesn't have a clue how to do that. Is 3 the correct way to proceed and is any help on that possible? Cyberly yours, Nikolay Balov ________________________________ From: owner-freebsd-hackers@freebsd.org <owner-freebsd-hackers@freebsd.org>= on behalf of azathanai@icloud.com <azathanai@icloud.com> Sent: Wednesday, October 18, 2023 09:14 To: Miroslav Lachman <000.fbsd@quip.cz> Cc: freebsd-hackers@FreeBSD.org <freebsd-hackers@FreeBSD.org> Subject: Re: Question of installing over SAS controller and USB flash Hey Miroslav, thank you for the help. I've tried with the first part of your suggestion - gpart bootcode, but tha= t was not enough. I suppose I do need the /boot on the flash card, as I've = installed Linux and put the /boot "folder" on the flash and everything was = working flawlessly. I'll try your suggestion with the memstick. Just a question there. Do I need to make the "gpart bootcode" part if I'm creating the memstick, o= r the memstick has everything needed to boot from it, i.e. it has the bootc= odes? Thanks again for your help and willingness to waste your time on a noob que= stions! Cyberly yours, Nikolay Balov ________________________________ From: owner-freebsd-hackers@freebsd.org <owner-freebsd-hackers@freebsd.org>= on behalf of Miroslav Lachman <000.fbsd@quip.cz> Sent: Wednesday, October 11, 2023 16:49 To: azathanai@icloud.com <azathanai@icloud.com>; Warner Losh <imp@bsdimp.co= m> Cc: freebsd-hackers@FreeBSD.org <freebsd-hackers@FreeBSD.org> Subject: Re: Question of installing over SAS controller and USB flash On 11/10/2023 14:02, azathanai@icloud.com wrote: > Hey Warner, > the box is very featureLESS (an old Xyratex HS-1235T box, as far as I > researched it). > T2029_QR v1.3.ai (hackspace.org.uk) > <https://wiki.london.hackspace.org.uk/w/images/b/b2/HS-1235T-ATX_Quick_Re= ference_Sheet.pdf> > (5) Xyratex 0944037-03 Motherboard Mystery SOLVED : homelab (reddit.com) > <https://www.reddit.com/r/homelab/comments/8loge6/xyratex_094403703_mothe= rboard_mystery_solved/> > > Through the POST process and the BIOS there is no option to get into the > SAS controller and enable its BIOS. I would love to install FreeBSD > directly on the drives and not to deal with the flash card, but I > suppose the lack of controller BIOS is the reason the box comes with > reader and card directly. [..] This depends on at what stage the computer starts to see the disk behind the SAS controller. I had an old HP server that only saw one disk out of four in the BIOS, so it couldn't boot from RAIDZ, but it was enough to make a 10GB partition on each disk as a 4 way ZFS mirror, boot from that and use the rest of each disk for the main RAIDZ storage (4x 8TB). Maybe it would have been enough to use a USB flash drive for the freebsd-boot partition in GPT scheme and then continue boot from the disks on the SAS controller. gpart create -s GPT da0 gpart bootcode -b /boot/pmbr da0 gpart add -b 40 -s 512 -t freebsd-boot da0 gpart bootcode -p /boot/zfsgptboot -i 1 da0 As long as the computer boots from the installer CD, FreeBSD with RAIDZ can be installed on the disks behind the SAS controller without any modification, only the USB flash drive must provide the boot. If the USB flash drive must also contain a UFS /boot partition, then copy an image that can be downloaded from the web as a "mini-memstick" to the USB flash drive https://www.freebsd.org/releases/13.2R/announce/ (use dd according to the instructions) Or again, create a complete installation from the FreeBSD installer on the USB flash drive. But the installation to big drives with RAIDZ should be done normally from the FreeBSD installer. No modifications needed. Kind regards Miroslav Lachman --_000_AM6PR02MB44715B177C56DDBB0CC4CD4AA5D5AAM6PR02MB4471eurp_ Content-Type: text/html; charset="us-ascii" Content-Transfer-Encoding: quoted-printable <html> <head> <meta http-equiv=3D"Content-Type" content=3D"text/html; charset=3Dus-ascii"= > <style type=3D"text/css" style=3D"display:none;"> P {margin-top:0;margin-bo= ttom:0;} </style> </head> <body dir=3D"ltr"> <div class=3D"elementToProof" style=3D"font-family: Aptos, Aptos_EmbeddedFo= nt, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 12pt; c= olor: rgb(0, 0, 0);"> OK.</div> <div class=3D"elementToProof" style=3D"font-family: Aptos, Aptos_EmbeddedFo= nt, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 12pt; c= olor: rgb(0, 0, 0);"> I've flashed the card with the mini-memstick and now it boots and starts th= e installation for FreeBSD, which is fine. However when it goes on par= titioning of the drives, I'm not sure what to do.</div> <ol start=3D"1" data-editing-info=3D"{"orderedStyleType":1,"= unorderedStyleType":1}" style=3D"list-style-type: decimal;" data-listc= hain=3D"__List_Chain_153"> <li style=3D"font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, C= alibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);"> <span style=3D"font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService,= Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">I c= an mark all drives on the sas controller for auto-zfs, but if the flash car= d is not "included" then the machine will reboot to the installation again. <br> </span></li><li style=3D"font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFo= ntService, Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0= , 0);"> <span style=3D"font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService,= Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">I c= an include the flash card in the installation of auto-zfs, but that means t= o have the card as root space and will not be able to use the big drives.</span></li><li style=3D"font-famil= y: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans= -serif; font-size: 12pt; color: rgb(0, 0, 0);"> <span style=3D"font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService,= Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">I n= eed to manually setup the partitions, having the efi and /boot on the flash= card and eventually mirrored on all other drives and have the / on the SAS drives, but doesn't have a clue how= to do that.</span></li></ol> <div class=3D"elementToProof"><span style=3D"font-family: Aptos, Aptos_Embe= ddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 1= 2pt; color: rgb(0, 0, 0);">Is 3 the correct way to proceed and is any help = on that possible?</span></div> <div class=3D"elementToProof"><span style=3D"font-family: Aptos, Aptos_Embe= ddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 1= 2pt; color: rgb(0, 0, 0);"><br> </span></div> <div class=3D"elementToProof"><span style=3D"font-family: Aptos, Aptos_Embe= ddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 1= 2pt; color: rgb(0, 0, 0);"><br> </span></div> <div class=3D"elementToProof"><span style=3D"font-family: Aptos, Aptos_Embe= ddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 1= 2pt; color: rgb(0, 0, 0);">Cyberly yours,</span></div> <div class=3D"elementToProof"><span style=3D"font-family: Aptos, Aptos_Embe= ddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 1= 2pt; color: rgb(0, 0, 0);">Nikolay Balov</span></div> <div id=3D"appendonsend"></div> <hr style=3D"display:inline-block;width:98%" tabindex=3D"-1"> <div id=3D"divRplyFwdMsg" dir=3D"ltr"><font face=3D"Calibri, sans-serif" st= yle=3D"font-size:11pt" color=3D"#000000"><b>From:</b> owner-freebsd-hackers= @freebsd.org <owner-freebsd-hackers@freebsd.org> on behalf of azathan= ai@icloud.com <azathanai@icloud.com><br> <b>Sent:</b> Wednesday, October 18, 2023 09:14<br> <b>To:</b> Miroslav Lachman <000.fbsd@quip.cz><br> <b>Cc:</b> freebsd-hackers@FreeBSD.org <freebsd-hackers@FreeBSD.org><= br> <b>Subject:</b> Re: Question of installing over SAS controller and USB flas= h</font> <div> </div> </div> <style type=3D"text/css" style=3D"display:none"> <!-- p {margin-top:0; margin-bottom:0} --> </style> <div dir=3D"ltr"> <div class=3D"x_elementToProof" style=3D"font-family:Aptos,Aptos_EmbeddedFo= nt,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt; color:= rgb(0,0,0)"> Hey Miroslav,</div> <div class=3D"x_elementToProof" style=3D"font-family:Aptos,Aptos_EmbeddedFo= nt,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt; color:= rgb(0,0,0)"> thank you for the help.</div> <div class=3D"x_elementToProof" style=3D"font-family:Aptos,Aptos_EmbeddedFo= nt,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt; color:= rgb(0,0,0)"> I've tried with the first part of your suggestion - gpart bootcode, but tha= t was not enough. I suppose I do need the /boot on the flash card, as I've = installed Linux and put the /boot "folder" on the flash and every= thing was working flawlessly.</div> <div class=3D"x_elementToProof" style=3D"font-family:Aptos,Aptos_EmbeddedFo= nt,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt; color:= rgb(0,0,0)"> I'll try your suggestion with the memstick. Just a question there.</div> <div class=3D"x_elementToProof" style=3D"font-family:Aptos,Aptos_EmbeddedFo= nt,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt; color:= rgb(0,0,0)"> Do I need to make the "gpart bootcode" part if I'm creating the m= emstick, or the memstick has everything needed to boot from it, i.e. it has= the bootcodes?</div> <div class=3D"x_elementToProof" style=3D"font-family:Aptos,Aptos_EmbeddedFo= nt,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt; color:= rgb(0,0,0)"> <br> </div> <div class=3D"x_elementToProof" style=3D"font-family:Aptos,Aptos_EmbeddedFo= nt,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt; color:= rgb(0,0,0)"> Thanks again for your help and willingness to waste your tim= e on a noob questions!</div> <div class=3D"x_elementToProof" style=3D"font-family:Aptos,Aptos_EmbeddedFo= nt,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt; color:= rgb(0,0,0)"> <br> </div> <div class=3D"x_elementToProof" style=3D"font-family:Aptos,Aptos_EmbeddedFo= nt,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt; color:= rgb(0,0,0)"> Cyberly yours,</div> <div class=3D"x_elementToProof" style=3D"font-family:Aptos,Aptos_EmbeddedFo= nt,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt; color:= rgb(0,0,0)"> Nikolay Balov</div> <div class=3D"x_elementToProof" style=3D"font-family:Aptos,Aptos_EmbeddedFo= nt,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt; color:= rgb(0,0,0)"> <br> </div> <div class=3D"x_elementToProof" style=3D"font-family:Aptos,Aptos_EmbeddedFo= nt,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt; color:= rgb(0,0,0)"> <br> </div> <div id=3D"x_appendonsend"></div> <hr style=3D"display:inline-block; width:98%"> <div id=3D"x_divRplyFwdMsg" dir=3D"ltr"><span style=3D"font-family:Calibri,= sans-serif; font-size:11pt; color:rgb(0,0,0)"><b>From:</b> owner-freeb= sd-hackers@freebsd.org <owner-freebsd-hackers@freebsd.org> on behalf = of Miroslav Lachman <000.fbsd@quip.cz><br> <b>Sent:</b> Wednesday, October 11, 2023 16:49<br> <b>To:</b> azathanai@icloud.com <azathanai@icloud.com>; Warner L= osh <imp@bsdimp.com><br> <b>Cc:</b> freebsd-hackers@FreeBSD.org <freebsd-hackers@FreeBSD.org= ><br> <b>Subject:</b> Re: Question of installing over SAS controller and USB= flash</span> <div> </div> </div> <div><span style=3D"font-size:11pt">On 11/10/2023 14:02, azathanai@icloud.c= om wrote:<br> > Hey Warner,<br> > the box is very featureLESS (an old Xyratex HS-1235T box, as far as I<= br> > researched it).<br> > T2029_QR v1.3.ai (hackspace.org.uk)<br> > <<a href=3D"https://wiki.london.hackspace.org.uk/w/images/b/b2/HS-1= 235T-ATX_Quick_Reference_Sheet.pdf" id=3D"OWA353898de-3136-59ab-767b-14bd09= 65b8b8" class=3D"x_OWAAutoLink" data-auth=3D"NotApplicable">https://wiki.lo= ndon.hackspace.org.uk/w/images/b/b2/HS-1235T-ATX_Quick_Reference_Sheet.pdf<= /a>><br> > (5) Xyratex 0944037-03 Motherboard Mystery SOLVED : homelab (reddit.co= m)<br> > <<a href=3D"https://www.reddit.com/r/homelab/comments/8loge6/xyrate= x_094403703_motherboard_mystery_solved/" id=3D"OWA79dcf916-65d6-820c-7f38-8= 7144d697a9e" class=3D"x_OWAAutoLink" data-auth=3D"NotApplicable">https://ww= w.reddit.com/r/homelab/comments/8loge6/xyratex_094403703_motherboard_myster= y_solved/</a>><br> ><br> > Through the POST process and the BIOS there is no option to get into t= he<br> > SAS controller and enable its BIOS. I would love to install FreeBSD<br= > > directly on the drives and not to deal with the flash card, but I<br> > suppose the lack of controller BIOS is the reason the box comes with<b= r> > reader and card directly.<br> <br> [..]<br> <br> This depends on at what stage the computer starts to see the disk behind<br= > the SAS controller. I had an old HP server that only saw one disk out of<br= > four in the BIOS, so it couldn't boot from RAIDZ, but it was enough to<br> make a 10GB partition on each disk as a 4 way ZFS mirror, boot from that<br= > and use the rest of each disk for the main RAIDZ storage (4x 8TB).<br> <br> Maybe it would have been enough to use a USB flash drive for the<br> freebsd-boot partition in GPT scheme and then continue boot from the<br> disks on the SAS controller.<br> <br> gpart create -s GPT da0<br> gpart bootcode -b /boot/pmbr da0<br> gpart add -b 40 -s 512 -t freebsd-boot da0<br> gpart bootcode -p /boot/zfsgptboot -i 1 da0<br> <br> As long as the computer boots from the installer CD, FreeBSD with RAIDZ<br> can be installed on the disks behind the SAS controller without any<br> modification, only the USB flash drive must provide the boot.<br> <br> If the USB flash drive must also contain a UFS /boot partition, then<br> copy an image that can be downloaded from the web as a "mini-memstick&= quot;<br> to the USB flash drive<br> <a href=3D"https://www.freebsd.org/releases/13.2R/announce/" id=3D"OWAb2a4e= b33-c96e-4f63-1bc5-840dd9b54a72" class=3D"x_OWAAutoLink" data-auth=3D"NotAp= plicable">https://www.freebsd.org/releases/13.2R/announce/</a> (use dd= according to<br> the instructions)<br> Or again, create a complete installation from the FreeBSD installer on<br> the USB flash drive.<br> <br> But the installation to big drives with RAIDZ should be done normally<br> from the FreeBSD installer. No modifications needed.<br> <br> Kind regards<br> Miroslav Lachman<br> <br> <br> </span></div> </div> </body> </html> --_000_AM6PR02MB44715B177C56DDBB0CC4CD4AA5D5AAM6PR02MB4471eurp_--
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?AM6PR02MB44715B177C56DDBB0CC4CD4AA5D5A>