From nobody Thu Mar 21 17:08:18 2024 X-Original-To: questions@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4V0sNq5Ymlz5F4g3 for ; Thu, 21 Mar 2024 17:08:27 +0000 (UTC) (envelope-from danm@prime.gushi.org) Received: from prime.gushi.org (prime.gushi.org [IPv6:2620:137:6000:10::142]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "prime.gushi.org", Issuer "RapidSSL TLS RSA CA G1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4V0sNp0TnDz4tcH for ; Thu, 21 Mar 2024 17:08:25 +0000 (UTC) (envelope-from danm@prime.gushi.org) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gushi.org header.s=prime2014 header.b=BvP5SJt0; dmarc=pass (policy=none) header.from=gushi.org; spf=pass (mx1.freebsd.org: domain of danm@prime.gushi.org designates 2620:137:6000:10::142 as permitted sender) smtp.mailfrom=danm@prime.gushi.org Received: from prime.gushi.org (localhost [127.0.0.1]) by prime.gushi.org (8.17.2/8.17.2) with ESMTPS id 42LH8IY2053597 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NOT) for ; Thu, 21 Mar 2024 17:08:20 GMT (envelope-from danm@prime.gushi.org) DKIM-Filter: OpenDKIM Filter v2.10.3 prime.gushi.org 42LH8IY2053597 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gushi.org; s=prime2014; t=1711040900; bh=opCpQfVAtc3OV+wS29Asp3sf3uCn6PHKwOVUi5zu6Rg=; h=Date:From:To:Subject:In-Reply-To:References; z=Date:=20Thu,=2021=20Mar=202024=2017:08:18=20+0000=20(UTC)|From:=2 0"Dan=20Mahoney=20(Ports)"=20|To:=20questions=2 0|Subject:=20Re:=20Dell=20perc=20card=20cor rupted=20by=20FreeBSD=20driver?|In-Reply-To:=20<360F0169-B132-4F5B -B261-E50661911CDC@gushi.org>|References:=20<360F0169-B132-4F5B-B2 61-E50661911CDC@gushi.org>; b=BvP5SJt0yxa+tYAiI+Df+89Uaz4LcF3uraPYAGeEbX982yw9dCwO4K5fmhexYFH2y GkiylvxLQq0o30TM/anxvKCPrcuQG6hO/i8SzsTX/GqWXZJZDi96ThXeLjbW8Okbui X2OH0FJ7dWWhqavsxEWHD1Wp2NvO4lyc/zYXR2gqozzfWjMB77SYkrbJBMtptY0m46 EIwMUSDbIag6kcDS6BhWQYmjCXEcOd1/UKp1M4aKHiKgk7K6H9VMpF6ynVnWRc7Kvm y8zi5gl5FIa+og2eR1MkpnnrGOUOtKJqH1ACeN4BdArZNHm2k8Vws4xh9iu/e7BVwM Qg7J5uFSTvKxA== Received: (from danm@localhost) by prime.gushi.org (8.17.2/8.17.2/Submit) id 42LH8Iqg053596; Thu, 21 Mar 2024 17:08:18 GMT (envelope-from danm) Date: Thu, 21 Mar 2024 17:08:18 +0000 (UTC) From: "Dan Mahoney (Ports)" To: questions Subject: Re: Dell perc card corrupted by FreeBSD driver? In-Reply-To: <360F0169-B132-4F5B-B261-E50661911CDC@gushi.org> Message-ID: <544cd874-2a76-07f2-e532-43532319b848@gushi.org> References: <360F0169-B132-4F5B-B261-E50661911CDC@gushi.org> X-OpenPGP-Key-ID: 0x624BB249 List-Id: User questions List-Archive: https://lists.freebsd.org/archives/freebsd-questions List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-questions@freebsd.org X-BeenThere: freebsd-questions@freebsd.org MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="33658924-470708021-1711040898=:96768" X-Greylist: Sender passed SPF test, not delayed by milter-greylist-4.6.4 (prime.gushi.org [0.0.0.0]); Thu, 21 Mar 2024 17:08:20 +0000 (UTC) X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.40 / 15.00]; DWL_DNSWL_MED(-2.00)[gushi.org:dkim]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; SUBJECT_ENDS_QUESTION(1.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; CTYPE_MIXED_BOGUS(1.00)[]; NEURAL_HAM_SHORT(-1.00)[-0.999]; DMARC_POLICY_ALLOW(-0.50)[gushi.org,none]; RCVD_DKIM_ARC_DNSWL_MED(-0.50)[]; FORGED_SENDER(0.30)[freebsd@gushi.org,danm@prime.gushi.org]; R_DKIM_ALLOW(-0.20)[gushi.org:s=prime2014]; R_SPF_ALLOW(-0.20)[+a]; RCVD_IN_DNSWL_MED(-0.20)[2620:137:6000:10::142:from]; MIME_GOOD(-0.10)[multipart/mixed,text/plain]; ARC_NA(0.00)[]; FROM_NEQ_ENVFROM(0.00)[freebsd@gushi.org,danm@prime.gushi.org]; MID_RHS_MATCH_FROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+]; RCPT_COUNT_ONE(0.00)[1]; RCVD_TLS_LAST(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MLMMJ_DEST(0.00)[questions@freebsd.org]; MISSING_XM_UA(0.00)[]; ASN(0.00)[asn:393507, ipnet:2620:137:6000::/44, country:US]; TO_DN_ALL(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[questions@freebsd.org]; RCVD_COUNT_TWO(0.00)[2]; DKIM_TRACE(0.00)[gushi.org:+]; FROM_HAS_DN(0.00)[] X-Rspamd-Queue-Id: 4V0sNp0TnDz4tcH This message is in MIME format. The first part should be readable text, while the remaining parts are likely unreadable without MIME-aware tools. --33658924-470708021-1711040898=:96768 Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: QUOTED-PRINTABLE On Thu, 21 Mar 2024, Dan Mahoney (Ports) wrote: > All, > > We have a Dell Perc h330 mini that we=E2=80=99ve been using with the olde= r =E2=80=9Cmfi=E2=80=9D driver, not the newer mrsas. Recently, it started = giving us an error on boot claiming that it was "Disabling writes to flash = as the flash part has gone bad" > > In the Dell Forums, a dell staffer very suspiciously saw this error and s= aid =E2=80=9Care you running FreeBSD?=E2=80=9D (https://www.dell.com/commun= ity/en/conversations/rack-servers/disabling-writes-to-flash-as-the-flash-pa= rt-has-gone-bad/647f9010f4ccf8a8de13d06e) > > Is there something about the driver we use that=E2=80=99s known to cause = breakage? Is there a known firmware that fixes this? Is there a better pl= ace to ask this than the general =E2=80=9Cquestions=E2=80=9D list? > > This system is out of warranty, but as we have a lot of Dell machines out= in the field doing Important DNS Things, I may open a generic case with a = system that *is* under warranty to ask more about this. In the meantime, i= f anyone who maintains the driver knows something, I=E2=80=99d love to hear= from you. Replying to myself, I've heard back from Dell and am posting their=20 response here. (The TLDR? If you're not using mrsas, you've got a=20 ticking time bomb). They reported a bug in 2020 and nobody's been willing to look at it. :( Perhaps the correct answer here would be to make mrsas the default. This= =20 almost feels like something that is worthy of an errata notification. =3D=3D=3D Greetings from Dell EMC Server Support team! This is with reference to the= =20 recent issue reported : "disabling writes to flash as the flash part has=20 gone bad". The root cause is inbox MFI driver. The Raid map sync method in MFI driver= =20 is causing a sync loop with PERC firmware resulting upto 128 writes per=20 second into PERC internal flash storage space, thereby wearing it out.=20 PERC would need to be replaced when such errors are encountered. Dell and Broadcom have reported this issue to FreeBSD in Bugzilla. FreeBSD= =20 have provided a patch that removes Raid map sync functionality from mfi=20 driver. Since you have already engaged FreeBSD support, please check on below=20 link. =C2=A0https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D248352 FreeBSD is an unsupported Operating System. Dell has no engineering or=20 sustaining relationship with FreeBSD. MRSAS driver does not have this issue. =3D=3D=3D I'm going to go poke that bug. -Dan --=20 "No mowore webooting!!!" -Paul, 10-16-99, 10 PM --------Dan Mahoney-------- Techie, Sysadmin, WebGeek Gushi on efnet/undernet IRC FB: fb.com/DanielMahoneyIV LI: linkedin.com/in/gushi Site: http://www.gushi.org --------------------------- --33658924-470708021-1711040898=:96768--