Skip site navigation (1)Skip section navigation (2)
Date:      Sun, 22 Mar 2020 13:35:11 -0400
From:      "Dan Langille" <dan@langille.org>
To:        "Pieper, Jeffrey E" <jeffrey.e.pieper@intel.com>, "freebsd-net@freebsd.org" <freebsd-net@freebsd.org>
Subject:   Re: SFP+ on PRO/10GbE
Message-ID:  <e93467c5-d6bd-4db0-b4a4-a382adad7289@www.fastmail.com>
In-Reply-To: <2A35EA60C3C77D438915767F458D6568B90935EC@ORSMSX111.amr.corp.intel.com>
References:  <cb8f9df8-4a97-4823-bbcd-560a95e9df19@www.fastmail.com> <2A35EA60C3C77D438915767F458D6568B90935EC@ORSMSX111.amr.corp.intel.com>

next in thread | previous in thread | raw e-mail | index | archive | help
Hello Jeff,

Partial success.  The card is now able to use an SFP+ optic.  It warns me
when the optic is installed:

Mar 22 16:49:45 r720-01 kernel: WARNING: Intel (R) Network Connections are quality tested using Intel (R) Ethernet Optics. Using untested modules is not supported and may cause unstable operation or damage to the module or the adapter. Intel Corporation is not responsible for any harm caused by using untested modules.

I cannot use an SFP+ optic at the switch.  The connection just does not happen.

If I go back to the original SFP optic, the connection occurs, as expected at 1G.

On the switch side, I've tried a known good optic from an existing connection.

I could install an PRO/10GbE instead, that has a built-in transceiver. I have
two of those in use now, both working on 10G.

Ideas?

Thank you.

On Sat, Mar 21, 2020, at 7:20 PM, Pieper, Jeffrey E wrote:
> Hi Dan,
> 
> Intel(R) Ethernet Server Adapter X520-2 only supports Intel-branded 
> optics, however you can bypass that check in the driver by adding the 
> following to /boot/loader.conf:
> 
> hw.ix.unsupported_sfp=1
> 
> I hope this helps,
> Jeff
> 
> -----Original Message-----
> From: owner-freebsd-net@freebsd.org <owner-freebsd-net@freebsd.org> On 
> Behalf Of Dan Langille
> Sent: Saturday, March 21, 2020 3:25 PM
> To: freebsd-net@freebsd.org
> Subject: SFP+ on PRO/10GbE
> 
> Hello,
> 
> I have an PRO/10GbE in a Dell R720, running FreeBSD 12.1, connected to 
> a Unifi US-16-X switch. At present it is using an SFP transceiver. I 
> wanted to move to SFP+.
> 
> I am not sure which card this is.  The iDRAC tells me:
> 
> * Integrated NIC 1 - Intel(R) 2P X520/2P I350 rNDC
> * the service tag claims this R720 was configured with a Intel X520 DP 
> 10Gb DA/SFP+
>   with part number C63DV. Looking that up, the images I found are 
> consistent with
>   what I have in the box. The NIC has room for two transceivers and two 
> ethernet cables.
> 
> When the SFP+ transceiver is inserted, this message appears:
> 
>   kernel: ix0: Unsupported SFP+ module type was detected.
> 
> I don't know if this is:
> 
> * the wrong transceiver - I've tried two [1]
> * the card firmware rejects anything not on a whitelist [2]
> * the transceiver is in the wrong slot [3]
> * only does DAC on 10G [4]
> 
> Ideas and suggestions please. Thank you.
> 
> $ dmesg|grep ix0|head -n 1
> ix0: <Intel(R) PRO/10GbE PCI-Express Network Driver> port 0xfcc0-0xfcdf 
> mem 0xd8d00000-0xd8dfffff,0xd8ff8000-0xd8ffbfff irq 36 at device 0.0 
> numa-domain 0 on pci1
> 
> pciconf -lcbv provides this:
> 
> ix0@pci0:1:0:0: class=0x020000 card=0x1f721028 chip=0x10fb8086 rev=0x01 
> hdr=0x00
>     vendor     = 'Intel Corporation'
>     device     = '82599ES 10-Gigabit SFI/SFP+ Network Connection'
>     class      = network
>     subclass   = ethernet
>     bar   [10] = type Memory, range 64, base 0xd8d00000, size 1048576, 
> enabled
>     bar   [18] = type I/O Port, range 32, base 0xfcc0, size 32, enabled
>     bar   [20] = type Memory, range 64, base 0xd8ff8000, size 16384, 
> enabled
>     cap 01[40] = powerspec 3  supports D0 D3  current D0
>     cap 05[50] = MSI supports 1 message, 64 bit, vector masks 
>     cap 11[70] = MSI-X supports 64 messages, enabled
>                  Table in map 0x20[0x0], PBA in map 0x20[0x2000]
>     cap 10[a0] = PCI-Express 2 endpoint max data 256(512) FLR RO NS
>                  link x8(x8) speed 5.0(5.0) ASPM disabled(L0s)
>     cap 03[e0] = VPD
>     ecap 0001[100] = AER 1 0 fatal 0 non-fatal 1 corrected
>     ecap 0003[140] = Serial 1 ecf4bbffffc0bda0
>     ecap 000e[150] = ARI 1
>     ecap 0010[160] = SR-IOV 1 IOV disabled, Memory Space disabled, ARI 
> disabled
>                      0 VFs configured out of 64 supported
>                      First VF RID Offset 0x0180, VF RID Stride 0x0002
>                      VF Device ID 0x10ed
>                      Page Sizes: 4096 (enabled), 8192, 65536, 262144, 
> 1048576, 4194304
> 
> 
> 
> [1] - The working 1G SFP is a Fiberstore SFP1G-SX-85. I have tried a 
> Fiberstore SFP-10GSR-85
>       and a Avago AFBR-703SDZ
> 
> [2] - 
> https://forums.servethehome.com/index.php?threads/patching-intel-x520-eeprom-to-unlock-all-sfp-transceivers.24634/
> 
> [3] - there are two slots for transceiver in this unit - I thought I 
> read something
>       about one being different from the other, but I cannot locate 
> that now.
>       I tried inserting a second SFP+ into the second slot, but nothing 
> seemed to change.
>       I suspect it is just for lagg.
> 
> [4] - https://forums.freebsd.org/threads/intel-x520-da2-or-x520-sr2.72173/
> 
> -- 
>   Dan Langille
>   dan@langille.org
> _______________________________________________
> freebsd-net@freebsd.org mailing list
> https://lists.freebsd.org/mailman/listinfo/freebsd-net
> To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org"
>

-- 
  Dan Langille
  dan@langille.org



Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?e93467c5-d6bd-4db0-b4a4-a382adad7289>