Skip site navigation (1)Skip section navigation (2)
Date:      Mon, 28 Feb 2022 15:03:39 -0500
From:      mike tancsa <mike@sentex.net>
To:        Navdeep Parhar <np@FreeBSD.org>, FreeBSD-STABLE Mailing List <freebsd-stable@freebsd.org>
Subject:   Re: cxgbe firmware error on latest RELENG_13
Message-ID:  <3c4c4cef-e737-5b09-92b3-d7d74d8690bb@sentex.net>
In-Reply-To: <b1d4252f-4677-e095-41fa-a83e86e062ea@FreeBSD.org>
References:  <49736514-6500-4c7d-889d-15697d934f04@sentex.net> <8f3a6c6a-8d4c-7802-49a8-f0b8a6635723@FreeBSD.org> <0c37c656-3eeb-006f-118b-e06067affe81@sentex.net> <b1d4252f-4677-e095-41fa-a83e86e062ea@FreeBSD.org>

next in thread | previous in thread | raw e-mail | index | archive | help
On 2/28/2022 2:51 PM, Navdeep Parhar wrote:
> On 2/28/22 11:48 AM, mike tancsa wrote:
>> On 2/28/2022 2:43 PM, Navdeep Parhar wrote:
>>> On 2/28/22 11:36 AM, mike tancsa wrote:
>>>> Hi Navdeep,
>>>>
>>>>      I updated a pair of releng13 boxes today as I saw there are 
>>>> new drivers/firmware. However, the firmware seems to fail on both 
>>>> in different ways
>>>>
>>>> t5nex0: <Chelsio T540-CR> mem 
>>>> 0x91300000-0x9137ffff,0x90000000-0x90ffffff,0x91984000-0x91985fff 
>>>> irq 17 at device 0.4 on pci2
>>>> t5nex0: failed to load firmware module: 2. cfg 0, fw 0
>>>> t5nex0: firmware on card (1.25.0.40) is older than the version 
>>>> bundled with this driver, but the driver cannot take corrective 
>>>> action because it is unable to load the firmware module.
>>>
>>> It looks like the firmware KLD isn't available even though you have 
>>> t5fw_cfg_load="yes" in loader.conf.
>>>
>>> Can you try removing the cxgbe lines from loader.conf temporarily 
>>> and kldload if_cxgbe manually after boot?  It should be able to find 
>>> the KLD with the firmware and update the card.  Then restore the 
>>> lines in loader.conf and see if it comes up properly.
>>>
>> Hi,
>>
>>      It worked on the 4 port but not the 2 port unit
>>
>> root@coldstorage1:~ # kldload if_cxgbe
>> t5nex0: <Chelsio T520-LL-CR> mem 
>> 0xb2300000-0xb237ffff,0xb1000000-0xb1ffffff,0xb28a0000-0xb28a1fff irq 
>> 16 at device 0.4 on pci1
>> t5nex0: failed to connect to the firmware: 6, 0.  PCIE_FW 0x80000000
>> t5nex0: error during attach, adapter is now in recovery mode.
>> root@coldstorage1:~ #
>
> Try a manual firmware upgrade while it's in recovery mode.  The 
> firmwares are the sys/dev/cxgbe/firmware/*.bin files in the src tree.
>
> # cxgbetool t5nex0 loadfw .../t5fw-1.26.6.0.bin
>
> Then reboot the system.
>

it seems to load it ok, but no luck after a soft reboot

root@coldstorage1:/usr/src/sys/dev/cxgbe/firmware # cxgbetool t5nex0 
loadfw t5fw-1.26.6.0.bin
root@coldstorage1:/usr/src/sys/dev/cxgbe/firmware # md5 t5fw-1.26.6.0.bin
MD5 (t5fw-1.26.6.0.bin) = 2a11a3d808b37d31e9caf19f75976e5b
root@coldstorage1:/usr/src/sys/dev/cxgbe/firmware #

But I did a full power cycle and it seemed to work after that!

root@coldstorage1:~ # kldload if_cxgbe
t5nex0: <Chelsio T520-LL-CR> mem 
0xb2300000-0xb237ffff,0xb1000000-0xb1ffffff,0xb28a0000-0xb28a1fff irq 16 
at device 0.4 on pci1
t5nex0: PCIe gen3 x8, 2 ports, 14 MSI-X interrupts, 30 eq, 13 iq
cxl0: <port 0> on t5nex0
cxl0: 4 txq, 4 rxq (NIC); 4 txq (TOE), 2 rxq (TOE)
cxl1: <port 1> on t5nex0
cxl1: 4 txq, 4 rxq (NIC); 4 txq (TOE), 2 rxq (TOE)
root@coldstorage1:~ #

Thank you very much for your quick help to get me back up and running

     ---Mike





Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?3c4c4cef-e737-5b09-92b3-d7d74d8690bb>