From owner-freebsd-fs@freebsd.org Sun Jan 20 15:41:11 2019 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 420D81495E47 for ; Sun, 20 Jan 2019 15:41:11 +0000 (UTC) (envelope-from ben.rubson@gmail.com) Received: from mail-wm1-x334.google.com (mail-wm1-x334.google.com [IPv6:2a00:1450:4864:20::334]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 0922B6CDF6 for ; Sun, 20 Jan 2019 15:41:10 +0000 (UTC) (envelope-from ben.rubson@gmail.com) Received: by mail-wm1-x334.google.com with SMTP id f188so8526203wmf.5 for ; Sun, 20 Jan 2019 07:41:09 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=from:content-transfer-encoding:mime-version:subject:date:references :to:in-reply-to:message-id; bh=0RkZSAJMYfTIAQiAT40qRJWJauJfw3gjWMB22ReYk3I=; b=LadcRY4OBBBQAgsSa2UvokSf/jUjWwjFHzKICgX6y5Qdcvma1Hv6url3/uFk4XoERh 8WKYDdHLOOanWLmwmQ60gV4dAbbDV/NCWttEGOSrSEbXdYTri0sgzqykSkGjttKu5nTA KmqDdbC7GBSXGujTtMM9ZEQoiSlm2YtfEqklWhrj1RiNamGehRIsGNKzopMQWwvzu8Gc vroVZhtDmUQNVzTsxJ5e+oJF5Q4o8Pm6dtIutc97DK6reSRr79hBlCrNXO9NHw2Lrc88 9yoo6Rnnl/hgCX1ez47P2hkD96E1u7ea4+l0CRAq/sV9SHb1Yl2mN5RDciG1wi0AOuQf t86Q== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:content-transfer-encoding:mime-version :subject:date:references:to:in-reply-to:message-id; bh=0RkZSAJMYfTIAQiAT40qRJWJauJfw3gjWMB22ReYk3I=; b=erTjX2qPTir/gCkKJqCxNmRW/6xJdKmb4qM2tmczo73EFP9kZAY45Cn/IfyfJokkhX zOadHyEsWI7b/rEVqaQhwU2Jz9ZMjZnq7hcpo9OXLQtQN+ARQewC6OXbTPKFur7Qu47t 0Vwbt4MsqtdSjeIzCWnwwXdqusUt/HWQvSRpYIZ4O5U4iyc147rSoD3xLQYfrSiCf/uY j2GorTTHwyWC2GR5EWw2Hq4SO2R/EaVOup+ZgWomsv7cAq0JVlZ3j3DMfNN2HhM0px3x A6gf4TW96frrt5/T0HwPhg7ljloTjADJbos4daWim5h4B5NJvUpGxXmxJiz85nUp/CQe jaxQ== X-Gm-Message-State: AJcUukcxOucOHuYP0T+TqKbQAz9Sh58CZoJcuaXBZzP+p8YA8/WKr3IO 1dDWilycHXl+BItz+8Oz2Tc+einE X-Google-Smtp-Source: ALg8bN42AAZ7n/7TdbnxL5zl9XHQlyZ7q+dw2Tm9xbjt6b/j49rphWTQ/yX59xAZGo3ac79jpEbQiw== X-Received: by 2002:a1c:ad45:: with SMTP id w66mr21584029wme.60.1547998868473; Sun, 20 Jan 2019 07:41:08 -0800 (PST) Received: from bens-mac.local (lfbn-mar-1-552-220.w90-118.abo.wanadoo.fr. [90.118.133.220]) by smtp.gmail.com with ESMTPSA id x1sm6282791wru.34.2019.01.20.07.41.07 for (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Sun, 20 Jan 2019 07:41:07 -0800 (PST) From: Ben RUBSON Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable Mime-Version: 1.0 (Mac OS X Mail 12.2 \(3445.102.3\)) Subject: Re: ZFS on Hardware RAID Date: Sun, 20 Jan 2019 16:41:07 +0100 References: <1180280695.63420.1547910313494.JavaMail.zimbra@gausus.net> <92646202.63422.1547910433715.JavaMail.zimbra@gausus.net> <1691666278.63816.1547976245836.JavaMail.zimbra@gausus.net> To: freebsd-fs In-Reply-To: Message-Id: <7C7F0DBB-C751-433A-BCB7-4EBE71BB821D@gmail.com> X-Mailer: Apple Mail (2.3445.102.3) X-Rspamd-Queue-Id: 0922B6CDF6 X-Spamd-Bar: ------ Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=LadcRY4O; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of benrubson@gmail.com designates 2a00:1450:4864:20::334 as permitted sender) smtp.mailfrom=benrubson@gmail.com X-Spamd-Result: default: False [-6.09 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; FREEMAIL_FROM(0.00)[gmail.com]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36]; MV_CASE(0.50)[]; RCVD_COUNT_THREE(0.00)[3]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; MX_GOOD(-0.01)[cached: alt3.gmail-smtp-in.l.google.com]; NEURAL_HAM_SHORT(-0.97)[-0.965,0]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; TAGGED_FROM(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com.dwl.dnswl.org : 127.0.5.0]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; MID_RHS_MATCH_FROM(0.00)[]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; IP_SCORE(-2.61)[ip: (-9.02), ipnet: 2a00:1450::/32(-2.13), asn: 15169(-1.84), country: US(-0.08)]; RCVD_IN_DNSWL_NONE(0.00)[4.3.3.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.5.4.1.0.0.a.2.list.dnswl.org : 127.0.5.0] X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 20 Jan 2019 15:41:11 -0000 The only thing I would try with a HW RAID card is to configure one = volume per physical disk, so that ZFS can operate as intended. Well, more or less, as there will still be some components in the path = which should not be expected, such as the RAID card cache (you have ZFS = ZIL & ARC / LARC2, upcoming allocation classes). Thus, an IT-mode HBA, for some dozens of dollars / euros, is really = worth the price ! ZFS does not really make sense with only one disk (what's the checksum = benefit once it has failed ?), you could go with any other FS... Regarding cache, be sure you can rely on your disks, as some = (budget-ones ?) may lie answering data is on disk whereas it has only = reached their write cache. You can toggle write cache depending on your disks. camcontrol mode /dev/ -m8 | grep WCE Regarding CPU usage, I'm pretty sure all checksum operations are well = hardware-supported, CPU should not be a bottleneck here (disks will = first be). Ben