From nobody Tue Nov 26 19:58:14 2024 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4XyYKg2PsQz5dwTQ for ; Tue, 26 Nov 2024 19:58:31 +0000 (UTC) (envelope-from soren.schmidt@gmail.com) Received: from mail-wm1-x32c.google.com (mail-wm1-x32c.google.com [IPv6:2a00:1450:4864:20::32c]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "WR4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4XyYKf2NBkz41l3 for ; Tue, 26 Nov 2024 19:58:30 +0000 (UTC) (envelope-from soren.schmidt@gmail.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20230601 header.b=SE7Opm1M; spf=pass (mx1.freebsd.org: domain of soren.schmidt@gmail.com designates 2a00:1450:4864:20::32c as permitted sender) smtp.mailfrom=soren.schmidt@gmail.com; dmarc=pass (policy=none) header.from=gmail.com Received: by mail-wm1-x32c.google.com with SMTP id 5b1f17b1804b1-434a736518eso10670455e9.1 for ; Tue, 26 Nov 2024 11:58:30 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1732651107; x=1733255907; darn=freebsd.org; h=to:references:message-id:content-transfer-encoding:cc:date :in-reply-to:from:subject:mime-version:from:to:cc:subject:date :message-id:reply-to; bh=N9K2lFcNJBlWiOvA211xuAco6BLvHNTNk54+UiualdU=; b=SE7Opm1Mo1F34fIL7SFbgePPJGYFvfd5Ch4AE72v6YL84ySPCXAQrZkIcBvXDC6cqm VHxqtQfKeY9UFwmd14eBIdNgPu+RBiHvoNfjyXIQwaB/JML+AH4BhUOFES+ZqIGQq53u 6uIn+ninD3olODtha/0e3M6UV9EfoUl90uoSWWs3Ytd8Cu6G4Q6/MfqFFC50PUrUmemx kg7b2et5eWwdoodFohcwTVya/Iu+0+bi+QKNuUbzEZuBQOT70p6TUa8fUXRYmbr/+s9K sCUw5YRE5k2cBq91VKIc581Uw592tJe+XLRjG/Zg/2zCVEmyJP3JbR8CNtvt8bohDw28 HGqg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1732651107; x=1733255907; h=to:references:message-id:content-transfer-encoding:cc:date :in-reply-to:from:subject:mime-version:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=N9K2lFcNJBlWiOvA211xuAco6BLvHNTNk54+UiualdU=; b=hqex+4a3fOfyH9vDbgeHbvX8ssFizHJHliamK7eX9Ou7X7Pwc/SfEMc211jfIEk3Os wQNgSGQserrfHcTKIJO3IdJWrDuMQokAlp9HW2VemhDJ3rFGLfkSFkrsO7vQKsNt4WLQ 0OtZ+HjTJkvrsq0VNSMp0hc+wFO+OLotbo2yscvw1fQx4JKrBRvdRM4iWQRkHimKqb1X C+ksjYa1MtFmW1Z9h3IKQYrOsuKKMMQZRVjl3cibbwuFRXrBtKS4lusPvlMc9gQcbq+d IoqpjXeIOCbEXQ21bjQ8P68AVf0PdRTG6TLZSm4v/brCz0/zuY9hv2eE2DBSCZWiQkcU hruA== X-Gm-Message-State: AOJu0YwLxm+4ykhEO7btSqp/GzvHI+sN65rxYrlrX32wg4XQKwXoRKXF 8LJw1rIwgGXhqMi/V2FeqfVAp2LjoprWfxzbnEKVQi+TjGCmtvqUn1xApw== X-Gm-Gg: ASbGncusYlg2e2CXLp+cDLHcPabCYops/pe2eB1/NHYDAJZ2dkHeyXu908BBoohuwJ+ C2+q8kWk0g8s5vEdt+UV7gtb6GwuH2pASfUcZt4u/Rw3Q1ViT9cvmRdcMJscKbY/wmsAERVT0wS NqoSKJsALHB4cauWHcnNYg4fyDM5dZlK1etGDQn0k2EHJxKeBAYP01eXkT4dwXENUOkyt69XaaC onbF2/VWvJ7UQTIPlYsmprNQ4bo/kOTssvuX3jKH8DDFQUOrXq58pyCeGOYMB2xPOoT04qVlQ== X-Google-Smtp-Source: AGHT+IFiUeImqpuayD+M8/JjKORuqxZURA4+Jnw9CClTso5pnhQowQZx7WhF3S7wlPRt5YLl43jMfw== X-Received: by 2002:a05:6000:701:b0:382:440e:4e88 with SMTP id ffacd0b85a97d-385c6eb783dmr261170f8f.16.1732651106503; Tue, 26 Nov 2024 11:58:26 -0800 (PST) Received: from smtpclient.apple (s61.dk. [85.27.186.9]) by smtp.gmail.com with ESMTPSA id ffacd0b85a97d-3825fb27386sm14224377f8f.51.2024.11.26.11.58.25 (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Tue, 26 Nov 2024 11:58:26 -0800 (PST) Content-Type: text/plain; charset=utf-8 List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@FreeBSD.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.700.6.1.2\)) Subject: Re: IBM ServeRAID M5110e and other mfi/mrsas users - call for testing / request for information From: =?utf-8?Q?S=C3=B8ren_Schmidt?= In-Reply-To: <9f572320-bc01-41c2-9820-74844b6ec9f1@gmail.com> Date: Tue, 26 Nov 2024 20:58:14 +0100 Cc: Johan Hendriks Content-Transfer-Encoding: quoted-printable Message-Id: <6FCA01E4-FEFB-447B-9034-4D3BC0D0C335@gmail.com> References: <9f572320-bc01-41c2-9820-74844b6ec9f1@gmail.com> To: FreeBSD Current X-Mailer: Apple Mail (2.3731.700.6.1.2) X-Spamd-Result: default: False [-3.50 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-1.000]; MV_CASE(0.50)[]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20230601]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36]; MIME_GOOD(-0.10)[text/plain]; TO_DN_ALL(0.00)[]; RCVD_TLS_LAST(0.00)[]; TAGGED_FROM(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; ARC_NA(0.00)[]; FREEMAIL_ENVFROM(0.00)[gmail.com]; FREEMAIL_CC(0.00)[gmail.com]; FREEMAIL_FROM(0.00)[gmail.com]; MIME_TRACE(0.00)[0:+]; FROM_HAS_DN(0.00)[]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_COUNT_TWO(0.00)[2]; FROM_EQ_ENVFROM(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; PREVIOUSLY_DELIVERED(0.00)[freebsd-current@freebsd.org]; MID_RHS_MATCH_FROM(0.00)[]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org]; RCVD_VIA_SMTP_AUTH(0.00)[]; TAGGED_RCPT(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[2a00:1450:4864:20::32c:from] X-Rspamd-Queue-Id: 4XyYKf2NBkz41l3 X-Spamd-Bar: --- > On 26 Nov 2024, at 13.31, Johan Hendriks = wrote: >>=20 >> To test, set the loader tunable hw.mfi.mrsas_enable=3D1 in >> /boot/loader.conf. Confirm that mrsas is being used, and that the >> system functions properly. >>=20 > I use Dell servers and i set the loader tuneable = hw.mfi.mrsasa_enable=3D1 on these machines. I use ZFS, so no raid = functionality off the card itself. This works fine for me. I have not = have any issues. I use this setting as mrsas give me way nicer device = names, i do remember having boot issues with the mfi default. But that = is a long time ago. I have several Dell servers (R640/R740) running 14-stable using mrsas = and RAID10 volumes, UFS on FreeBSD, and I have experienced corrupted = filesystems on reboot on 3 out of 14 servers so its not consistent, its = the same servers that always fail though :)=20 However for our purposes we have set cache policy to write-through = instead of write-back (default) and that seems to have solved the issue. There is no real performance penalty at least with our workload. Would be nice to have this fixed though, seems like the cache is not = written to disk on reboot but if you force it through it works. Its just like when the backup battery on the controller dies, then a = reboot also messes up the disk :) -S=C3=B8ren