From owner-freebsd-net@freebsd.org Sat Mar 21 22:25:18 2020 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 3D27626E55B for ; Sat, 21 Mar 2020 22:25:18 +0000 (UTC) (envelope-from dan@langille.org) Received: from out5-smtp.messagingengine.com (out5-smtp.messagingengine.com [66.111.4.29]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 48lFZj0YZqz3HMv for ; Sat, 21 Mar 2020 22:25:16 +0000 (UTC) (envelope-from dan@langille.org) Received: from compute2.internal (compute2.nyi.internal [10.202.2.42]) by mailout.nyi.internal (Postfix) with ESMTP id 5684F5C01A4 for ; Sat, 21 Mar 2020 18:25:16 -0400 (EDT) Received: from imap36 ([10.202.2.86]) by compute2.internal (MEProxy); Sat, 21 Mar 2020 18:25:16 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=langille.org; h= mime-version:message-id:date:from:to:subject:content-type; s= fm3; bh=9cXV4asBfOVdnYMnOIauXG+rY8C1GxpoLO46JHoUlK0=; b=HIpeQLr5 X4FM5GoENKZHjKkd/f2THoTNSyJ7yq7yk8c1pzN2AavM6c1DgNp7ieyKBA/TJ3Pu Awpra7/I3hHmoDZBXtXsCsdbVgLBmpTra400PWpfojaHbbM7c44HMKnoTj3fmeik plnqcCFt2UwxXoLd6wEB7QPY2MXZNZOxz15qBjj1P1MFq6yC5o4vZ7HlLDpvqP1R lzQQC8+DMtzYienQL+I9k9ewhP91UeY3ndtUk7xc/fk2pOsJZHcqlOEY0V6pA1yI n7qVhtwAS4xOY9KZxXeFiRRJVuAOqy75uOGOuO/6CbPoe6+y0cB0TccxvZnROEZV 0VfYviRJmmIgjg== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=content-type:date:from:message-id :mime-version:subject:to:x-me-proxy:x-me-proxy:x-me-sender :x-me-sender:x-sasl-enc; s=fm2; bh=9cXV4asBfOVdnYMnOIauXG+rY8C1G xpoLO46JHoUlK0=; b=100bYuKvocAYvI+pNsa3guZuzpgxezUIXrim5c/gIpBOM hoB3tNjE1ITD2KSszywcIhTbrbourXpJ0XFsG+USvodJ0/9yFlhjV/NjKw3HUiFM vp5pABz/jG81f6XR7mTjV5I/Vtb9Aj34T3qYulDNkaLOJ7PkcBCM9jRkJaFWCzBy Vg1n5WImtlahT/SuIyHnPEGPPYqmvI6Z/NJ28fCUGBuLMF/DEBkIIK8yPJL9aCFD gArS1XfsvnZD8wmAp0qc2z+5atSy5tL9hEdX50ce40hqVkElnATh7fxuQF9Mt8Ku avQ2ndEpnWb3Z+90N4pHdCg6diSm6bmxfj3pvC8qg== X-ME-Sender: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgedugedrudegfedgudeivdcutefuodetggdotefrod ftvfcurfhrohhfihhlvgemucfhrghsthforghilhdpqfgfvfdpuffrtefokffrpgfnqfgh necuuegrihhlohhuthemuceftddtnecunecujfgurhepofgfggfkfffhvffutgesthdtre dtreertdenucfhrhhomhepfdffrghnucfnrghnghhilhhlvgdfuceouggrnheslhgrnhhg ihhllhgvrdhorhhgqeenucffohhmrghinhepshgvrhhvvghthhgvhhhomhgvrdgtohhmpd hfrhgvvggsshgurdhorhhgnecuvehluhhsthgvrhfuihiivgeptdenucfrrghrrghmpehm rghilhhfrhhomhepuggrnheslhgrnhhgihhllhgvrdhorhhg X-ME-Proxy: Received: by mailuser.nyi.internal (Postfix, from userid 501) id 175FE1880062; Sat, 21 Mar 2020 18:25:16 -0400 (EDT) X-Mailer: MessagingEngine.com Webmail Interface User-Agent: Cyrus-JMAP/3.1.7-1021-g152deaf-fmstable-20200319v1 Mime-Version: 1.0 Message-Id: Date: Sat, 21 Mar 2020 18:24:55 -0400 From: "Dan Langille" To: freebsd-net@freebsd.org Subject: SFP+ on PRO/10GbE Content-Type: text/plain X-Rspamd-Queue-Id: 48lFZj0YZqz3HMv X-Spamd-Bar: ----- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=langille.org header.s=fm3 header.b=HIpeQLr5; dkim=pass header.d=messagingengine.com header.s=fm2 header.b=100bYuKv; dmarc=pass (policy=none) header.from=langille.org; spf=pass (mx1.freebsd.org: domain of dan@langille.org designates 66.111.4.29 as permitted sender) smtp.mailfrom=dan@langille.org X-Spamd-Result: default: False [-5.58 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-0.995,0]; R_DKIM_ALLOW(-0.20)[langille.org:s=fm3,messagingengine.com:s=fm2]; XM_UA_NO_VERSION(0.01)[]; URIBL_BLOCKED(0.00)[messagingengine.com.multi.uribl.com,servethehome.com.multi.uribl.com,langille.org.multi.uribl.com]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:66.111.4.29]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-net@freebsd.org]; TO_DN_NONE(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; RCVD_COUNT_THREE(0.00)[4]; IP_SCORE(-3.49)[ip: (-9.85), ipnet: 66.111.4.0/24(-4.89), asn: 11403(-2.69), country: US(-0.05)]; MV_CASE(0.50)[]; DKIM_TRACE(0.00)[langille.org:+,messagingengine.com:+]; DMARC_POLICY_ALLOW(-0.50)[langille.org,none]; RCVD_IN_DNSWL_LOW(-0.10)[29.4.111.66.list.dnswl.org : 127.0.5.1]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:11403, ipnet:66.111.4.0/24, country:US]; RCVD_TLS_LAST(0.00)[]; MID_RHS_WWW(0.50)[] X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 21 Mar 2020 22:25:18 -0000 Hello, I have an PRO/10GbE in a Dell R720, running FreeBSD 12.1, connected to a Unifi US-16-X switch. At present it is using an SFP transceiver. I wanted to move to SFP+. I am not sure which card this is. The iDRAC tells me: * Integrated NIC 1 - Intel(R) 2P X520/2P I350 rNDC * the service tag claims this R720 was configured with a Intel X520 DP 10Gb DA/SFP+ with part number C63DV. Looking that up, the images I found are consistent with what I have in the box. The NIC has room for two transceivers and two ethernet cables. When the SFP+ transceiver is inserted, this message appears: kernel: ix0: Unsupported SFP+ module type was detected. I don't know if this is: * the wrong transceiver - I've tried two [1] * the card firmware rejects anything not on a whitelist [2] * the transceiver is in the wrong slot [3] * only does DAC on 10G [4] Ideas and suggestions please. Thank you. $ dmesg|grep ix0|head -n 1 ix0: port 0xfcc0-0xfcdf mem 0xd8d00000-0xd8dfffff,0xd8ff8000-0xd8ffbfff irq 36 at device 0.0 numa-domain 0 on pci1 pciconf -lcbv provides this: ix0@pci0:1:0:0: class=0x020000 card=0x1f721028 chip=0x10fb8086 rev=0x01 hdr=0x00 vendor = 'Intel Corporation' device = '82599ES 10-Gigabit SFI/SFP+ Network Connection' class = network subclass = ethernet bar [10] = type Memory, range 64, base 0xd8d00000, size 1048576, enabled bar [18] = type I/O Port, range 32, base 0xfcc0, size 32, enabled bar [20] = type Memory, range 64, base 0xd8ff8000, size 16384, enabled cap 01[40] = powerspec 3 supports D0 D3 current D0 cap 05[50] = MSI supports 1 message, 64 bit, vector masks cap 11[70] = MSI-X supports 64 messages, enabled Table in map 0x20[0x0], PBA in map 0x20[0x2000] cap 10[a0] = PCI-Express 2 endpoint max data 256(512) FLR RO NS link x8(x8) speed 5.0(5.0) ASPM disabled(L0s) cap 03[e0] = VPD ecap 0001[100] = AER 1 0 fatal 0 non-fatal 1 corrected ecap 0003[140] = Serial 1 ecf4bbffffc0bda0 ecap 000e[150] = ARI 1 ecap 0010[160] = SR-IOV 1 IOV disabled, Memory Space disabled, ARI disabled 0 VFs configured out of 64 supported First VF RID Offset 0x0180, VF RID Stride 0x0002 VF Device ID 0x10ed Page Sizes: 4096 (enabled), 8192, 65536, 262144, 1048576, 4194304 [1] - The working 1G SFP is a Fiberstore SFP1G-SX-85. I have tried a Fiberstore SFP-10GSR-85 and a Avago AFBR-703SDZ [2] - https://forums.servethehome.com/index.php?threads/patching-intel-x520-eeprom-to-unlock-all-sfp-transceivers.24634/ [3] - there are two slots for transceiver in this unit - I thought I read something about one being different from the other, but I cannot locate that now. I tried inserting a second SFP+ into the second slot, but nothing seemed to change. I suspect it is just for lagg. [4] - https://forums.freebsd.org/threads/intel-x520-da2-or-x520-sr2.72173/ -- Dan Langille dan@langille.org