From owner-freebsd-fs@freebsd.org Sat Jan 19 19:29:44 2019 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 9A84614900FB for ; Sat, 19 Jan 2019 19:29:44 +0000 (UTC) (envelope-from jdelisle@gmail.com) Received: from mail-lj1-x22b.google.com (mail-lj1-x22b.google.com [IPv6:2a00:1450:4864:20::22b]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 74BB16A8D5 for ; Sat, 19 Jan 2019 19:29:43 +0000 (UTC) (envelope-from jdelisle@gmail.com) Received: by mail-lj1-x22b.google.com with SMTP id t18-v6so14375679ljd.4 for ; Sat, 19 Jan 2019 11:29:43 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=VAL5zjUA+35eiEegGf9IcEuDlKWxGClIybLaJ1yxL9g=; b=JRIYEfIIPtqzT05NntzAGrS6hUZ7plB30HEh/gyH0ZulxJlOTbhYoeAxuIRVxB8cHT M+0jG7oMpQt6gl0YbumMKHXIrDEUyUaDEEuVApensj1hrjuAgeCoEmU1Ylkv/NgawKEx V91rlqcgH+mPf0EyAT5kZzpbPYYkTp6wifcdgQhSZdv064asYbdgJ1AdCj541471lwjD y+DcNt5XkYHS3WHkti6QqXb6UAa3qqDvN7ypF7sw7OLYxxrUAJAHbdd14BlXg8O5pWF9 COUEaVz4pn6UazFZgqXlU/zDsFG2VwmLy2gotpIfTooXEktM9zg8IFnJfaMU57dMiEt5 Ym7Q== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=VAL5zjUA+35eiEegGf9IcEuDlKWxGClIybLaJ1yxL9g=; b=mh7xTtqi/kuw8rf64iqS4tDFfYhlTjOeClPShFTSeph6Jsk8B81SDHfCCH0jxwuB6S dmhl3X6X6j5MQ7/0asf2VkA4HMEMDhWhdCGOYJsi0skzZKkGJ9ufkCLpKm8wG/zqfs6Q wNJrV7OJ9mxqVm6eNY6jeiAEQko1jRwh5KaNJL8a+mlbH3uM1GMJDwNoUuowwqmlbIiU YkaeqU0AYZ7MYk2m6/V5SeHGdrlD6NZMCfJUmAyf6g1n7+0LNYl1ImTcBFKjpiZc58VQ Btiu9p/IBNaGAKOYLKM7LRSpoj4xnLJFtVpjHLrOREgqcT0FdTZkvanYc6OaabEbF1Gk JxLw== X-Gm-Message-State: AJcUukceqA5oQY67opiiuzbWaqfNC7hXlKUS4/vYS/5wJgiUVHpiP42X rJSddPemdAodjJ/mTHLRnk5BiEBz3KCRUuUFk/lw4Q== X-Google-Smtp-Source: ALg8bN6oq4coQbPPmm0Y5TTd35IEUXposg3goFzLgokF364fja45NGk0gp8JolP0LEyWjLeKVXogBFZo+rNm0tNCKm4= X-Received: by 2002:a2e:1b47:: with SMTP id b68-v6mr12875904ljb.104.1547926181303; Sat, 19 Jan 2019 11:29:41 -0800 (PST) MIME-Version: 1.0 References: <1180280695.63420.1547910313494.JavaMail.zimbra@gausus.net> <92646202.63422.1547910433715.JavaMail.zimbra@gausus.net> In-Reply-To: <92646202.63422.1547910433715.JavaMail.zimbra@gausus.net> From: jdelisle Date: Sat, 19 Jan 2019 13:29:29 -0600 Message-ID: Subject: Re: ZFS on Hardware RAID To: Maciej Jan Broniarz Cc: freebsd-fs@freebsd.org X-Rspamd-Queue-Id: 74BB16A8D5 X-Spamd-Bar: ------ Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=JRIYEfII; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of jdelisle@gmail.com designates 2a00:1450:4864:20::22b as permitted sender) smtp.mailfrom=jdelisle@gmail.com X-Spamd-Result: default: False [-6.12 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36]; FREEMAIL_FROM(0.00)[gmail.com]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; NEURAL_HAM_SHORT(-0.50)[-0.502,0]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; MX_GOOD(-0.01)[cached: alt3.gmail-smtp-in.l.google.com]; RCVD_TLS_LAST(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[b.2.2.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.5.4.1.0.0.a.2.list.dnswl.org : 127.0.5.0]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; RCVD_COUNT_TWO(0.00)[2]; IP_SCORE(-2.60)[ip: (-9.00), ipnet: 2a00:1450::/32(-2.11), asn: 15169(-1.83), country: US(-0.08)]; DWL_DNSWL_NONE(0.00)[gmail.com.dwl.dnswl.org : 127.0.5.0] Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 19 Jan 2019 19:29:44 -0000 You'll find a lot of strong opinions on this topic over at the FreeNAS forums. I too am wish an authoritative, knowledgeable SME would answer and thoroughly explain the inner workings and the risks involved. Most of the FreeNAS forum posts on this topic devolve into hand-waving and blurry incomplete explanations that end in statements like "trust me, don't do it". I'd love to understand why not. I'm curious and eager to learn more. >From my anecdotal non-expert experience, I ran FreeNAS on 14x 1TB HGST drives as individual RAID0 devices via a SAS HBA that did not support JBOD/ IT mode. This worked very well for me, though I didn't experience drive or controller failure so I can't speak to what would have happened. I created a script that would interrogate the drives' SMART data, and send me a monthly report so I could see trends in their stats. FreeNAS did not support interrogating them for SMART data due to the RAID adapter, but with the correct parameters, smartctl was easily able to so for me. Even though the FreeNAS forum explanations feel incomplete and unsatisfying (to me), I'd suggest following their advice for a production system. For all I know, they may thoroughly understand these inner workings, and just don't feel like (or are bad at) explaining it to the community. Better to be safe than sorry with production data. In my example above, it was just my home lab, and I had very good backups.