From owner-freebsd-current@freebsd.org Tue Jul 14 00:39:25 2020 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 1804B376730 for ; Tue, 14 Jul 2020 00:39:25 +0000 (UTC) (envelope-from wjw@digiware.nl) Received: from smtp.digiware.nl (smtp.digiware.nl [176.74.240.9]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4B5M8q6GXhz3VVk for ; Tue, 14 Jul 2020 00:39:23 +0000 (UTC) (envelope-from wjw@digiware.nl) Received: from router.digiware.nl (localhost.digiware.nl [127.0.0.1]) by smtp.digiware.nl (Postfix) with ESMTP id 7DC007124E; Tue, 14 Jul 2020 02:39:21 +0200 (CEST) X-Virus-Scanned: amavisd-new at digiware.com Received: from smtp.digiware.nl ([127.0.0.1]) by router.digiware.nl (router.digiware.nl [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id bXYFjPE9QQPY; Tue, 14 Jul 2020 02:39:20 +0200 (CEST) Received: from [192.168.10.9] (vaio [192.168.10.9]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by smtp.digiware.nl (Postfix) with ESMTPSA id 9AB067124B; Tue, 14 Jul 2020 02:39:20 +0200 (CEST) Subject: Re: Current panics on connecting disks to a LSI-3108 controller To: Yuri Pankov , freebsd current References: <1406943a-6028-26ae-012f-e83903f2b299@digiware.nl> <266ce56a-0d95-b61a-4757-4ccdc2533ae2@yuripv.dev> From: Willem Jan Withagen Message-ID: <80510d48-adfe-3f9c-a7cd-81a7e88d9d71@digiware.nl> Date: Tue, 14 Jul 2020 02:39:19 +0200 User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:68.0) Gecko/20100101 Firefox/68.0 Thunderbird/68.9.0 MIME-Version: 1.0 In-Reply-To: <266ce56a-0d95-b61a-4757-4ccdc2533ae2@yuripv.dev> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 8bit Content-Language: nl X-Rspamd-Queue-Id: 4B5M8q6GXhz3VVk X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of wjw@digiware.nl designates 176.74.240.9 as permitted sender) smtp.mailfrom=wjw@digiware.nl X-Spamd-Result: default: False [-2.65 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-0.998]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+ptr]; NEURAL_HAM_LONG(-1.00)[-1.004]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[digiware.nl]; RCVD_COUNT_THREE(0.00)[4]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; RCVD_IN_DNSWL_MED(-0.20)[176.74.240.9:from]; RCPT_COUNT_TWO(0.00)[2]; NEURAL_HAM_SHORT(-0.15)[-0.148]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:28878, ipnet:176.74.224.0/19, country:NL]; RCVD_TLS_LAST(0.00)[]; MID_RHS_MATCH_FROM(0.00)[] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 14 Jul 2020 00:39:25 -0000 On 14-7-2020 00:47, Yuri Pankov wrote: > Willem Jan Withagen wrote: >> Hi, >> >> I have this Supermicro SUPERSERVER®2028TP >> Which hold four nodes each with a X10DRT-PT motherboard >> and a LSI-3108 SAS controller connecting to 6 disks. >> >> Trying to run the most recent current snapshot on it. >> # uname -a >> FreeBSD quadbox-d.digiware.nl 13.0-CURRENT FreeBSD 13.0-CURRENT #0 >> r363032: Thu Jul  9 04:13:17 UTC 2020 >> root@releng1.nyi.freebsd.org:/usr/obj/usr/src/amd64.amd64/sys/GENERIC >> amd64 >> >> I have installed the OS on a SATA flash DOM. >> Booting works fine as long as there are no disks connected to >> LSI-3108 controller. >> Booting with SAS disks connected results in a panic. >> Attaching a SAS disk to the LSI-3108 controller give a panic as well. >> >> >> >> AVAGO MegaRAID SAS FreeBSD mrsas driver version: 07.709.04.00-fbsd >> mfi0: port 0x6000-0x60ff mem >> 0xc7300000-0xc730ffff,0xc7200000-0xc72fffff irq 26 at device >> 0.0 numa-domain 0 on pci3 >> mfi0: Using MSI >> mfi0: Megaraid SAS driver Ver 4.23 >> mfi0: FW MaxCmds = 928, limiting to 128 >> mfi0: MaxCmd = 928, Drv MaxCmd = 128, MaxSgl = 70, state = 0xb73c03a0 >> ..... >> mfi0: 54944 (boot + 6s/0x0020/info) - Firmware initialization started >> (PCI ID 005d/1000/0809/15d9) >> pcib4: mfi0: 54945 (boot + 6s/0x0020/info) - >> Firmware version 4.290.00-4536 >> >> >> I have posted screenshots of the panic at: >>      www.tegenbosch28.nl/FreeBSD/Crash-LSI3108 >> >> But basically it crashes in >>      mfi_tbolt_send_frame() +0x132 >> >> So is there anybody out there that can help me with analyzing and >> fixing this panic? > > I guess it's not the answer you are looking for, but you could try the > mrsas driver and check if it's behaves better for you, by setting 'set > hw.mfi.mrsas_enable=1' from loader prompt. That was a great suggestion. And what I read from the manual page, mrsas plays even nicer with CAM which is a plus. I guess that there are reason not to do this by default. So one gets mrsas unless it does not attach to that specific card in the system? --WjW