Date: Mon, 11 Oct 2010 00:56:55 -0400 From: Bill Desjardins <bill@ethernext.com> To: freebsd-net@freebsd.org Subject: [cxgb] Chelsio T304 quad gig pcie adapter TSO disabled Message-ID: <AANLkTikxaf9Sv=NtJ8YDQ-c82vP67YR-pNBVN%2BfFtrpF@mail.gmail.com>
next in thread | raw e-mail | index | archive | help
Hi All,
I have a couple Chelsio T304 quad gigabit nics that are going into
iscsi servers. I got these for the TOE capabilities, but I found in
the cxgb driver code that it is explicitly disabled for > 2 port nics
(line 1036 : /usr/src/sys/dev/cxgb/cxgb_main.c) . The current cxgb
driver is based on the chelsio 7.8.0 firmware (11/25/09), but chelsio
is up to 7.11.0 (07/20/10). I had updated the firmware using cxgbtool
to 7.11, but received complaints from the driver to 'upgrade' to
7.8.0, which I did.
my question is, is if the cxgb driver is being worked on to update to
latest chelsio firmware and/or fix TSO for the quad port cards? I
don't have the programming skill's to assist with that side of things,
but I can easily provide a remote spare machine with a serial console
for development and testing if its helpful.
Some info:
uname
-----------------------
FreeBSD sas.ethernap.net 8.1-STABLE FreeBSD 8.1-STABLE #1: Sun Oct 10
05:29:41 EDT 2010 sas@sas:/usr/obj/usr/src/sys/GENERIC amd64
kernel boot (2 adapters)
-----------------------
cxgbc0: <Chelsio T304, 4 ports> mem
0xc8201000-0xc8201fff,0xc8800000-0xc8ffffff,0xc8200000-0xc8200fff irq
11 at device 0.0 on pci2
cxgbc0: Insufficient clusters and/or jumbo buffers.
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^????
cxgbc0: using MSI-X interrupts (9 vectors)
cxgb0: <Port 0 10/100/1000BASE-T> on cxgbc0
cxgb0: Ethernet address: 00:07:43:05:83:16
cxgb1: <Port 1 10/100/1000BASE-T> on cxgbc0
cxgb1: Ethernet address: 00:07:43:05:83:17
cxgb2: <Port 2 10/100/1000BASE-T> on cxgbc0
cxgb2: Ethernet address: 00:07:43:05:83:18
cxgb3: <Port 3 10/100/1000BASE-T> on cxgbc0
cxgb3: Ethernet address: 00:07:43:05:83:19
cxgbc0: Firmware Version 7.8.0
cxgbc1: <Chelsio T304, 4 ports> mem
0xc9101000-0xc9101fff,0xc9800000-0xc9ffffff,0xc9100000-0xc9100fff irq
11 at device 0.0 on pci8
cxgbc1: Insufficient clusters and/or jumbo buffers.
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^????
cxgbc1: using MSI-X interrupts (9 vectors)
cxgb4: <Port 0 10/100/1000BASE-T> on cxgbc1
cxgb4: Ethernet address: 00:07:43:05:a3:7d
cxgb5: <Port 1 10/100/1000BASE-T> on cxgbc1
cxgb5: Ethernet address: 00:07:43:05:a3:7e
cxgb6: <Port 2 10/100/1000BASE-T> on cxgbc1
cxgb6: Ethernet address: 00:07:43:05:a3:7f
cxgb7: <Port 3 10/100/1000BASE-T> on cxgbc1
cxgb7: Ethernet address: 00:07:43:05:a3:80
cxgbc1: Firmware Version 7.8.0
lspci -vvv
------------------------------------------
02:00.0 Ethernet controller: Chelsio Communications Inc T304 1GbE Quad
Port Adapter
Subsystem: Chelsio Communications Inc Device 0001
Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop-
ParErr+ Stepping- SERR+ FastB2B- DisINTx-
Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort-
<TAbort- <MAbort- >SERR- <PERR- INTx-
Latency: 0, Cache Line Size: 64 bytes
Interrupt: pin A routed to IRQ 11
Region 0: Memory at c8201000 (64-bit, non-prefetchable)
Region 2: Memory at c8800000 (64-bit, non-prefetchable)
Region 4: Memory at c8200000 (64-bit, non-prefetchable)
Capabilities: [40] Power Management version 3
Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA
PME(D0+,D1-,D2-,D3hot+,D3cold-)
Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=0 PME-
Capabilities: [48] MSI: Enable- Count=1/32 Maskable- 64bit+
Address: 0000000000000000 Data: 0000
Capabilities: [58] Express (v2) Endpoint, MSI 00
DevCap: MaxPayload 4096 bytes, PhantFunc 0, Latency
L0s <64ns, L1 <1us
ExtTag+ AttnBtn- AttnInd- PwrInd- RBE+ FLReset-
DevCtl: Report errors: Correctable- Non-Fatal- Fatal-
Unsupported-
RlxdOrd+ ExtTag- PhantFunc- AuxPwr- NoSnoop+
MaxPayload 128 bytes, MaxReadReq 4096 bytes
DevSta: CorrErr+ UncorrErr- FatalErr- UnsuppReq+
AuxPwr- TransPend-
LnkCap: Port #0, Speed 2.5GT/s, Width x4, ASPM L0s L1,
Latency L0 unlimited, L1 unlimited
ClockPM- Surprise- LLActRep- BwNot-
LnkCtl: ASPM Disabled; RCB 64 bytes Disabled- Retrain- CommClk-
ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
LnkSta: Speed 2.5GT/s, Width x4, TrErr- Train-
SlotClk+ DLActive- BWMgmt- ABWMgmt-
DevCap2: Completion Timeout: Range ABC, TimeoutDis-
DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis-
LnkCtl2: Target Link Speed: 2.5GT/s, EnterCompliance-
SpeedDis-, Selectable De-emphasis: -6dB
Transmit Margin: Normal Operating Range,
EnterModifiedCompliance- ComplianceSOS-
Compliance De-emphasis: -6dB
LnkSta2: Current De-emphasis Level: -6dB
Capabilities: [94] Vital Product Data
Not readable
Capabilities: [9c] MSI-X: Enable+ Count=32 Masked-
Vector table: BAR=4 offset=00000000
PBA: BAR=4 offset=00000800
08:00.0 Ethernet controller: Chelsio Communications Inc T304 1GbE Quad
Port Adapter
Subsystem: Chelsio Communications Inc Device 0001
Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop-
ParErr+ Stepping- SERR+ FastB2B- DisINTx-
Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort-
<TAbort- <MAbort- >SERR- <PERR- INTx-
Latency: 0, Cache Line Size: 64 bytes
Interrupt: pin A routed to IRQ 11
Region 0: Memory at c9101000 (64-bit, non-prefetchable)
Region 2: Memory at c9800000 (64-bit, non-prefetchable)
Region 4: Memory at c9100000 (64-bit, non-prefetchable)
Capabilities: [40] Power Management version 3
Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA
PME(D0+,D1-,D2-,D3hot+,D3cold-)
Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=0 PME-
Capabilities: [48] MSI: Enable- Count=1/32 Maskable- 64bit+
Address: 0000000000000000 Data: 0000
Capabilities: [58] Express (v2) Endpoint, MSI 00
DevCap: MaxPayload 4096 bytes, PhantFunc 0, Latency
L0s <64ns, L1 <1us
ExtTag+ AttnBtn- AttnInd- PwrInd- RBE+ FLReset-
DevCtl: Report errors: Correctable- Non-Fatal- Fatal-
Unsupported-
RlxdOrd+ ExtTag- PhantFunc- AuxPwr- NoSnoop+
MaxPayload 128 bytes, MaxReadReq 4096 bytes
DevSta: CorrErr+ UncorrErr- FatalErr- UnsuppReq+
AuxPwr- TransPend-
LnkCap: Port #0, Speed 2.5GT/s, Width x4, ASPM L0s L1,
Latency L0 unlimited, L1 unlimited
ClockPM- Surprise- LLActRep- BwNot-
LnkCtl: ASPM Disabled; RCB 64 bytes Disabled- Retrain- CommClk-
ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
LnkSta: Speed 2.5GT/s, Width x4, TrErr- Train-
SlotClk+ DLActive- BWMgmt- ABWMgmt-
DevCap2: Completion Timeout: Range ABC, TimeoutDis-
DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis-
LnkCtl2: Target Link Speed: 2.5GT/s, EnterCompliance-
SpeedDis-, Selectable De-emphasis: -6dB
Transmit Margin: Normal Operating Range,
EnterModifiedCompliance- ComplianceSOS-
Compliance De-emphasis: -6dB
LnkSta2: Current De-emphasis Level: -6dB
Capabilities: [94] Vital Product Data
Not readable
Capabilities: [9c] MSI-X: Enable+ Count=32 Masked-
Vector table: BAR=4 offset=00000000
PBA: BAR=4 offset=00000800
If you need more info, please let me know what you need and how I can
assist with this.
Thank you,
Bill
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?AANLkTikxaf9Sv=NtJ8YDQ-c82vP67YR-pNBVN%2BfFtrpF>