From owner-freebsd-stable@freebsd.org Fri May 3 07:09:43 2019 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id DD5A21586CD9; Fri, 3 May 2019 07:09:42 +0000 (UTC) (envelope-from borjam@sarenet.es) Received: from cu01176b.smtpx.saremail.com (cu01176b.smtpx.saremail.com [195.16.151.151]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 8316D8AFDB; Fri, 3 May 2019 07:09:41 +0000 (UTC) (envelope-from borjam@sarenet.es) Received: from [172.16.8.250] (unknown [192.148.167.11]) by proxypop01.sare.net (Postfix) with ESMTPA id 48F6C9DD34F; Fri, 3 May 2019 09:09:31 +0200 (CEST) Content-Type: text/plain; charset=utf-8 Mime-Version: 1.0 (Mac OS X Mail 12.4 \(3445.104.8\)) Subject: Re: ZFS... From: Borja Marcos In-Reply-To: Date: Fri, 3 May 2019 09:09:29 +0200 Cc: Xin LI , owner-freebsd-stable@freebsd.org, Andrea Venturoli , freebsd-stable , rainer@ultra-secure.de Content-Transfer-Encoding: quoted-printable Message-Id: <58DA896C-5312-47BC-8887-7680941A9AF2@sarenet.es> References: <30506b3d-64fb-b327-94ae-d9da522f3a48@sorbs.net> <56833732-2945-4BD3-95A6-7AF55AB87674@sorbs.net> <3d0f6436-f3d7-6fee-ed81-a24d44223f2f@netfence.it> <17B373DA-4AFC-4D25-B776-0D0DED98B320@sorbs.net> <70fac2fe3f23f85dd442d93ffea368e1@ultra-secure.de> <70C87D93-D1F9-458E-9723-19F9777E6F12@sorbs.net> To: Michelle Sullivan X-Mailer: Apple Mail (2.3445.104.8) X-Rspamd-Queue-Id: 8316D8AFDB X-Spamd-Bar: ----- X-Spamd-Result: default: False [-5.44 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:195.16.151.0/24]; MV_CASE(0.50)[]; MIME_GOOD(-0.10)[text/plain]; RCVD_TLS_LAST(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; RCPT_COUNT_FIVE(0.00)[6]; TO_MATCH_ENVRCPT_SOME(0.00)[]; MX_GOOD(-0.01)[smtp.sarenet.es,smtp.sarenet.es,smtp.sarenet.es]; DMARC_POLICY_ALLOW(-0.50)[sarenet.es,reject]; RCVD_IN_DNSWL_NONE(0.00)[151.151.16.195.list.dnswl.org : 127.0.10.0]; SUBJ_ALL_CAPS(0.45)[6]; IP_SCORE(-2.65)[ip: (-7.33), ipnet: 195.16.128.0/19(-3.42), asn: 3262(-2.54), country: ES(0.04)]; NEURAL_HAM_SHORT(-0.93)[-0.928,0]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:3262, ipnet:195.16.128.0/19, country:ES]; FREEMAIL_CC(0.00)[gmail.com]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_COUNT_TWO(0.00)[2] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 03 May 2019 07:09:43 -0000 > On 1 May 2019, at 04:26, Michelle Sullivan wrote: >=20 > mfid8 ONLINE 0 0 0 Anyway I think this is a mistake (mfid). I know, HBA makers have been = insisting on having their firmware getting in the middle, which is a bad thing. The right way to use disks is to give ZFS access to the plain CAM = devices, not thorugh some so-called JBOD on a RAID controller which, at least for a long time, has been a *logical* = =E2=80=9CRAID0=E2=80=9D volume on a single disk. That additional layer = can=20 completely break the semantics of transaction writes and cache flushes.=20= With some older cards it can be tricky to achieve, from patching source = drivers to enabling a sysctl tunable or even flashing the card to turn it into a plain HBA with no RAID features (or = minimal ones). If your drives are not called /dev/daX or /dev/adaX you are likely to be = in trouble. Unless something has really changed recently you don=E2=80=99t want =E2=80=9Cmfid=E2=80=9D or =E2=80=9Cmfisyspd=E2=80=9D= . I have suffered hidden data corruption due to a faulty HBA and failures = of old disks, and in all cases ZFS has survived brilianty. And actually ZFS works on somewhat unreliable hardware. The problem is = not non-perfect hardware, but *evil* hardware with=20 firmware based on some assumptions that won=E2=80=99t work with ZFS.=20 But I agree, non-ECC memory can be a problem. In my case all of the = servers had ECC. Borja.=