From owner-freebsd-stable@freebsd.org Sat Jan 19 20:09:43 2019 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id B35BC1491A71 for ; Sat, 19 Jan 2019 20:09:43 +0000 (UTC) (envelope-from deischen@freebsd.org) Received: from mail.netplex.net (mail.netplex.net [204.213.176.9]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "*.netplex.net", Issuer "RapidSSL RSA CA 2018" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 0CB376C3D0 for ; Sat, 19 Jan 2019 20:09:42 +0000 (UTC) (envelope-from deischen@freebsd.org) Received: from [10.0.0.54] (ip-414b102e.ct.fixed.ntplx.com [65.75.16.46]) (authenticated bits=0) by mail.netplex.net (8.15.1/8.15.1/NETPLEX) with ESMTPSA id x0JJw31J034225 (version=TLSv1.2 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Sat, 19 Jan 2019 14:58:03 -0500 X-Virus-Scanned: by AMaViS and Clam AntiVirus (mail.netplex.net) X-Greylist: Sender succeeded SMTP AUTH, not delayed by milter-greylist-4.4.3 (mail.netplex.net [204.213.176.9]); Sat, 19 Jan 2019 14:58:04 -0500 (EST) Content-Type: text/plain; charset=utf-8 Mime-Version: 1.0 (1.0) Subject: Re: zfs on hardware raid array From: Daniel Eischen X-Mailer: iPhone Mail (16C101) In-Reply-To: <5108B64F-2DB8-41F7-A7EC-FEAF007ECB16@orbdesigns.com> Date: Sat, 19 Jan 2019 14:58:03 -0500 Content-Transfer-Encoding: quoted-printable Message-Id: <713C7A3D-93A2-4542-8221-24DDFA0C533E@freebsd.org> References: <2021985079.63423.1547910450967.JavaMail.zimbra@gausus.net> <5108B64F-2DB8-41F7-A7EC-FEAF007ECB16@orbdesigns.com> To: freebsd-stable X-Rspamd-Queue-Id: 0CB376C3D0 X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org X-Spamd-Result: default: False [-2.98 / 15.00]; local_wl_from(0.00)[freebsd.org]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; NEURAL_HAM_SHORT(-0.98)[-0.980,0]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; ASN(0.00)[asn:6062, ipnet:204.213.176.0/20, country:US] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 19 Jan 2019 20:09:43 -0000 > On Jan 19, 2019, at 2:31 PM, Brian Bilbrey wr= ote: >=20 > (Bcc=E2=80=99d to the OP) >=20 > You *could* do what I=E2=80=99ve done in the past - make each disk into a s= ingle disk volume presented by the array, then use the presented volumes to m= ake your mirrors, z2s, etc=E2=80=A6 I=E2=80=99m not running that anymore, bu= t it was fine and reliable for years. A failed disk could be replaced in the= array, then re-presented to the OS for rebuild. I actually kept a presented= volume back to use as a warm spare in those circumstances.=20 >=20 > A reasonably inexpensive alternative is to replace the controller with one= that permits JBOD. [ BCC'd to the poster above ] We have some Oracle X5 servers that are also unable to configure the SAS dis= ks as JBOD. We do the same thing, each disk is a separate volume, and we ju= st use ZFS mirrors on the individual volumes. We thought it strange that Oracle would spec hardware (I think it's an LSI c= ontroller) that didn't allow JBOD when they themselves recommend not using h= ardware RAID for ZFS, and also don't support booting from anything other tha= n ZFS (starting with Solaris 11). -- DE=