Date: Mon, 16 Nov 2015 13:19:55 -0800 From: Freddie Cash <fjwcash@gmail.com> To: Slawa Olhovchenkov <slw@zxy.spb.ru> Cc: Kevin Oberman <rkoberman@gmail.com>, freebsd-scsi@freebsd.org, Royce Williams <royce@tycho.org>, freebsd-stable <freebsd-stable@freebsd.org>, Borja Marcos <borjam@sarenet.es>, Kai Gallasch <k@free.de> Subject: Re: LSI SAS2008 mps driver preferred firmware version Message-ID: <CAOjFWZ49A8b6g=mQL3jzJaNX-Lf%2BuDCvmscyB6F4tr7Ax=HMbg@mail.gmail.com> In-Reply-To: <20151116205734.GM48728@zxy.spb.ru> References: <5644FF09.9090200@free.de> <CA%2BE3k93QrUFA3BvhoswkVDXh2bR2aLYG6Z0TOrisVvNL=%2BMZVA@mail.gmail.com> <56472686.5030301@free.de> <20151114143104.GA41119@in-addr.com> <7710CBCC-E68F-4454-9E29-E50ED1C6B511@sarenet.es> <CAN6yY1sH0PnnF_AGwDsA75i_Z6ptOr4J0c_Gqrt%2BRFO6eZsW-Q@mail.gmail.com> <CAOjFWZ4Js65gQZc6rbT9SKg-jZozziTa=JGpJys6HyejdgWP%2Bg@mail.gmail.com> <20151116205734.GM48728@zxy.spb.ru>
next in thread | previous in thread | raw e-mail | index | archive | help
On Mon, Nov 16, 2015 at 12:57 PM, Slawa Olhovchenkov <slw@zxy.spb.ru> wrote= : > On Mon, Nov 16, 2015 at 11:40:12AM -0800, Freddie Cash wrote: > > > On Mon, Nov 16, 2015 at 11:36 AM, Kevin Oberman <rkoberman@gmail.com> > wrote: > > > As already mentioned, unless you are using zfs, use gpart to label yo= u > file > > > systems/disks. Then use the /dev/gpt/LABEL as the mount device in > fstab. > > > > > > > =E2=80=8BEven if you are using ZFS, labelling the drives with the locat= ion of the > > disk in the system (enclosure, column, row, whatever) makes things so > much > > easier to work with when there are disk-related issues. > > > > Just create a single partition that covers the whole disk, label it, an= d > > use the label to create the vdevs in the pool.=E2=80=8B > > Bad idea. > Re-placed disk in different bay don't relabel automaticly. > =E2=80=8BDid the original disk get labelled automatically? No, you had to = do that when you first started using it. So, why would you expect a replaced disk to get labelled automatically? Offline the dead/dying disk. Physically remove the disk. Insert the new disk. Partition / label the new disk. "zfs replace" using the new label to get it into the pool.=E2=80=8B > Other issuse where disk placed in bay some remotely hands in data > center -- I am relay don't know how disk distributed by bays. > =E2=80=8BYou label the disks as they are added to the system the first time= . That way, you always know where each disk is located, and you only deal with the labels. Then, when you need to replace a disk (or ask someone in a remote location to replace it) it's a simple matter: the label on the disk itself tells you where the disk is physically located. And it doesn't change if the controller decides to change the direction it enumerates devices. Which is easier to tell someone in a remote location: Replace disk enc0a6 (meaning enclosure 0, column A, row 6)? or Replace the disk called da36?=E2=80=8B =E2=80=8Bor Find the disk with serial number XXXXXXXX? or Replace the disk where the light is (hopefully) flashing (but I can't tell you which enclosure, front or back, or anything else like that)? The first one lets you know exactly where the disk is located physically. The second one just tells you the name of the device as determined by the OS, but doesn't tell you anything about where it is located. And it can change with a kernel update, driver update, or firmware update! The third requires you to pull every disk in turn to read the serial number off the drive itself. In order for the second or third option to work, you'd have to write down the device names and/or serial numbers and stick that onto the drive bay itself.=E2=80=8B > Best way for identify disk -- uses enclouse services. > =E2=80=8BOnly if your enclosure services are actually working (or even enab= led). I've yet to work on a box where that actually works (we custom-build our storage boxes using OTS hardware). Best way, IMO, is to use the physical location of the device as the actual device name itself. That way, there's never any ambiguity at the physical layer, the driver layer, the OS layer, or the ZFS pool layer.=E2=80=8B > I have many sites with ZFS on whole disk and some sites with ZFS on > GPT partition. ZFS on GPT more heavy for administration. > =E2=80=8BIt's 1 extra step: partition the drive, supplying the location of= the drive as the label for the partition. Everything else works exactly the same. I used to do everything with whole drives and no labels. Did that for about a month, until 2 separate drives on separate controllers died (in a 24-bay setup) and I couldn't figure out where they were located as a BIOS upgrade changed which controller loaded first. And then I had to work on a server that someone else configured with direct-attach bays (24 cables) that were connected almost at random. Then I used glabel(8) to label the entire disk, and things were much better. But that didn't always play well with 4K drives, and replacing drives that were the same size didn't always work as the number of sectors in each disk was different (ZFS plays better with this now). Then I started to GPT partition things, and life has been so much simpler. All the partitions are aligned to 1 MB, and I can manually set the size of the partition to work around different physical sector counts. All the partitions are labelled using the physical location of the disk (originally just row/column naming like a spreadsheet, but now I'm adding enclosure name as well as we expand to multiple enclosures per system). It's so much simpler now, ESPECIALLY when I have to get someone to do something remotely. :) =E2=80=8BEveryone has their own way to manage things. I just haven't seen = any better setup than labelling the drives themselves using their physical location.=E2=80=8B --=20 Freddie Cash fjwcash@gmail.com
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?CAOjFWZ49A8b6g=mQL3jzJaNX-Lf%2BuDCvmscyB6F4tr7Ax=HMbg>