From owner-freebsd-fs@freebsd.org Sat Jan 19 20:08:45 2019 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id D1E5C1491951 for ; Sat, 19 Jan 2019 20:08:44 +0000 (UTC) (envelope-from rincebrain@gmail.com) Received: from mail-lj1-x22f.google.com (mail-lj1-x22f.google.com [IPv6:2a00:1450:4864:20::22f]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 2DA8F6C2DE for ; Sat, 19 Jan 2019 20:08:43 +0000 (UTC) (envelope-from rincebrain@gmail.com) Received: by mail-lj1-x22f.google.com with SMTP id n18-v6so14398559lji.7 for ; Sat, 19 Jan 2019 12:08:43 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=CSFDy1/jOEmRbXWOJBwj8EZNiqLZ947YyqOUYhXQe9M=; b=jtCkmaexbBYoNOaSeKvUCANomlKA2K2DGzjciYBZCGA6OM8Mjt0YEuT1MT8rsSuP96 q2DsgWRS2rTSlV0oeiZD946KoY5RTI4rvs7l4qM25ulXs2EUv1Z7bA74dY3MXJL7DoMN uN/WtPSbKei5cfA8Hoo3fuwr6aTihd/q5nTlYfhMfm04gNYTkXFWkL0+sTQlNr4noEhE Gp396W1mWuvI627fXAYvQoczHD+J1w5zAAR+Ard7lvvghieXL9xoUGSeh78qKVl4NmXP GkuBhrlOUhCJXjN82deiUPyPqS4YwVI3lKAKwxe/Z70dT/fqnWax3o8OKosV3XrACEaA hCHw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=CSFDy1/jOEmRbXWOJBwj8EZNiqLZ947YyqOUYhXQe9M=; b=s2Xbd/Y8Ph/E67ah0RmrSakaXA6DMG9X8/XHZi+pRBpZrN0iFs5NDdPUxzuxey8TcV 9H3HY5uHUsXwR+iYZhr1/Yk3lvPK3AP5LDy5etPRbq3Hn6sqN1iKS/Bpmp+CN4ZyDeFj gYCgfOwwsXTSJFu+sOzOPFqVp9bj+sYbdwBIZosKSFLZL42gimrBpxvO0K2CGhM/n0Fu K0s75zgUZYO6iRROq1ER6KW8d0lE6nVr5UaaESWvqcDat8ks8CU5KSg9+tc/SX/RbqG6 poiZ+cL4LTm3psY9xdYrQgAIpCau43McD3RgTC7Y0AzELxqPrk58BMWYSv3F5gvITaQP 1dgA== X-Gm-Message-State: AJcUukf4SXzD+qaHKNgQdzVB8hCQgIA1TPQ7zbIw6LUmGqC4ysae34yd gmehHrkM6Agv4fqczsQsrYMWMY9b1+ZqOpmzpgQ5OQ== X-Google-Smtp-Source: ALg8bN5aTE4uYWOXjhGQviD7aSDWRWvZUN4ZVI7K+Eth5eqM/0qVb1Ne99KGhS7d29boztih9OyweNbmA65+E4WIVKQ= X-Received: by 2002:a2e:880a:: with SMTP id x10-v6mr15993950ljh.174.1547928521385; Sat, 19 Jan 2019 12:08:41 -0800 (PST) MIME-Version: 1.0 References: <1180280695.63420.1547910313494.JavaMail.zimbra@gausus.net> <92646202.63422.1547910433715.JavaMail.zimbra@gausus.net> In-Reply-To: <92646202.63422.1547910433715.JavaMail.zimbra@gausus.net> From: Rich Date: Sat, 19 Jan 2019 15:08:29 -0500 Message-ID: Subject: Re: ZFS on Hardware RAID To: Maciej Jan Broniarz Cc: freebsd-fs Content-Type: text/plain; charset="UTF-8" X-Rspamd-Queue-Id: 2DA8F6C2DE X-Spamd-Bar: ------ Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=jtCkmaex; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of rincebrain@gmail.com designates 2a00:1450:4864:20::22f as permitted sender) smtp.mailfrom=rincebrain@gmail.com X-Spamd-Result: default: False [-6.57 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36]; FREEMAIL_FROM(0.00)[gmail.com]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; NEURAL_HAM_SHORT(-0.86)[-0.863,0]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; MX_GOOD(-0.01)[cached: alt3.gmail-smtp-in.l.google.com]; RCVD_TLS_LAST(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[f.2.2.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.5.4.1.0.0.a.2.list.dnswl.org : 127.0.5.0]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; RCVD_COUNT_TWO(0.00)[2]; IP_SCORE(-2.69)[ip: (-9.44), ipnet: 2a00:1450::/32(-2.11), asn: 15169(-1.83), country: US(-0.08)]; DWL_DNSWL_NONE(0.00)[gmail.com.dwl.dnswl.org : 127.0.5.0] X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 19 Jan 2019 20:08:45 -0000 The two caveats I'd offer are: - RAID controllers add an opaque complexity layer if you have problems - e.g. if you're using single-disk RAID0s to make a RAID controller pretend to be an HBA, if the disk starts misbehaving, you have an additional layer of behavior (how the RAID controller interprets drives misbehaving and shows that to the OS) to figure out whether the drive is bad, the connection is loose, the controller is bad, ... - abstracting the redundancy away from ZFS means that ZFS can't recover if it knows there's a problem but the underlying RAID controller doesn't - that is, say you made a RAID-6, and ZFS sees some block fail checksum. There's not a way to say "hey that block was wrong, try that read again with different disks" to the controller, so you're just sad at data loss on your nominally "redundant" array. - Rich On Sat, Jan 19, 2019 at 11:44 AM Maciej Jan Broniarz wrote: > > Hi, > > I want to use ZFS on a hardware-raid array. I have no option of making it JBOD. I know it is best to use ZFS on JBOD, but > that possible in that particular case. My question is - how bad of an idea is it. I have read very different opinions on that subject, but none of them seems conclusive. > > Any comments and especially case studies are most welcome. > All best, > mjb > _______________________________________________ > freebsd-fs@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-fs > To unsubscribe, send any mail to "freebsd-fs-unsubscribe@freebsd.org"