From owner-freebsd-net@freebsd.org Tue Mar 24 21:30:34 2020 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id D71C826B2C5 for ; Tue, 24 Mar 2020 21:30:34 +0000 (UTC) (envelope-from jeffrey.e.pieper@intel.com) Received: from mga12.intel.com (mga12.intel.com [192.55.52.136]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "fmsmga106.fm.intel.com", Issuer "Sectigo RSA Organization Validation Secure Server CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 48n4Cn4STRz4Wbn; Tue, 24 Mar 2020 21:30:12 +0000 (UTC) (envelope-from jeffrey.e.pieper@intel.com) IronPort-SDR: 1xCd5ouokHJpL7NNsSCGt9O6suB4Z0cUtGfYZMN899W6b5WjqN6ar4/1gbmb/IFMQ8YHc6IZu6 2g5uaXS3kboA== X-Amp-Result: SKIPPED(no attachment in message) X-Amp-File-Uploaded: False Received: from fmsmga002.fm.intel.com ([10.253.24.26]) by fmsmga106.fm.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 24 Mar 2020 14:30:05 -0700 IronPort-SDR: KdxlQPE9uGAx1t1pE1ZPPDGIFkfGZq7rxcw7nRmQSfQMJ3LetE3PNpQpeA7oA7Zo5bQxd8lEpH p+RKODZxIIuw== X-ExtLoop1: 1 X-IronPort-AV: E=Sophos;i="5.72,301,1580803200"; d="scan'208";a="281943471" Received: from orsmsx103.amr.corp.intel.com ([10.22.225.130]) by fmsmga002.fm.intel.com with ESMTP; 24 Mar 2020 14:30:04 -0700 Received: from orsmsx159.amr.corp.intel.com (10.22.240.24) by ORSMSX103.amr.corp.intel.com (10.22.225.130) with Microsoft SMTP Server (TLS) id 14.3.439.0; Tue, 24 Mar 2020 14:30:04 -0700 Received: from orsmsx111.amr.corp.intel.com ([169.254.12.226]) by ORSMSX159.amr.corp.intel.com ([169.254.11.47]) with mapi id 14.03.0439.000; Tue, 24 Mar 2020 14:30:03 -0700 From: "Pieper, Jeffrey E" To: Dan Langille , Gary Palmer CC: sthaug , "freebsd-net@freebsd.org" Subject: RE: SFP+ on PRO/10GbE Thread-Topic: SFP+ on PRO/10GbE Thread-Index: AQHV/8+iW1/7kfU5G02OZndwRC+br6hTrbfAgAGofICAADS7gIAAB6kAgAAfYYCAAAWxgIADAumA//+K+WA= Date: Tue, 24 Mar 2020 21:30:02 +0000 Message-ID: <2A35EA60C3C77D438915767F458D6568B9094CED@ORSMSX111.amr.corp.intel.com> References: <2A35EA60C3C77D438915767F458D6568B90935EC@ORSMSX111.amr.corp.intel.com> <20200322.214355.415142200.sthaug@nethelp.no> <20200322230339.GB5808@in-addr.com> <8141b371-5cdf-4f82-8959-5fa1071aa6dd@www.fastmail.com> In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: dlp-product: dlpe-windows dlp-version: 11.2.0.6 dlp-reaction: no-action x-originating-ip: [10.22.254.138] Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-Rspamd-Queue-Id: 48n4Cn4STRz4Wbn X-Spamd-Bar: --------- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=pass (policy=none) header.from=intel.com; spf=pass (mx1.freebsd.org: domain of jeffrey.e.pieper@intel.com designates 192.55.52.136 as permitted sender) smtp.mailfrom=jeffrey.e.pieper@intel.com X-Spamd-Result: default: False [-9.78 / 15.00]; ARC_NA(0.00)[]; TO_DN_EQ_ADDR_SOME(0.00)[]; RCVD_COUNT_FIVE(0.00)[5]; HAS_XOIP(0.00)[]; URIBL_BLOCKED(0.00)[imgur.com.multi.uribl.com]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:192.55.52.136/32]; RCPT_COUNT_THREE(0.00)[4]; MIME_GOOD(-0.10)[text/plain]; IP_SCORE(-3.78)[ip: (-9.91), ipnet: 192.55.52.0/24(-4.96), asn: 4983(-3.96), country: US(-0.05)]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; TO_DN_SOME(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_MED(-0.20)[136.52.55.192.list.dnswl.org : 127.0.9.2]; DMARC_POLICY_ALLOW(-0.50)[intel.com,none]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:4983, ipnet:192.55.52.0/24, country:US]; RCVD_TLS_LAST(0.00)[]; WHITELIST_SPF_DKIM(-3.00)[intel.com:s:+] X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 24 Mar 2020 21:30:35 -0000 You cannot force speed with ix, only force autoneg. You need to use the adv= ertise_speed sysctl for this: sysctl -d dev.ix.0.advertise_speed dev.ix.0.advertise_speed: Control advertised link speed using these flags: 0x1 - advertise 100M 0x2 - advertise 1G 0x4 - advertise 10G 0x8 - advertise 10M 100M and 10M are only supported on certain adapters. Jeff -----Original Message----- From: Dan Langille =20 Sent: Tuesday, March 24, 2020 2:23 PM To: Gary Palmer Cc: sthaug ; Pieper, Jeffrey E ; freebsd-net@freebsd.org Subject: Re: SFP+ on PRO/10GbE On Sun, Mar 22, 2020, at 7:24 PM, Dan Langille wrote: > On Sun, Mar 22, 2020, at 7:03 PM, Gary Palmer wrote: > > On Sun, Mar 22, 2020 at 05:11:20PM -0400, Dan Langille wrote: > > > On Sun, Mar 22, 2020, at 4:43 PM, sthaug@nethelp.no wrote: > > > > > Partial success. The card is now able to use an SFP+ optic. =20 > > > > > It warns me when the optic is installed: > > > > >=20 > > > > > Mar 22 16:49:45 r720-01 kernel: WARNING: Intel (R) Network Connec= tions are quality tested using Intel (R) Ethernet Optics. Using untested mo= dules is not supported and may cause unstable operation or damage to the mo= dule or the adapter. Intel Corporation is not responsible for any harm caus= ed by using untested modules. > > > > >=20 > > > > > I cannot use an SFP+ optic at the switch. The connection just do= es not happen. > > > > >=20 > > > > > If I go back to the original SFP optic, the connection occurs, as= expected at 1G. > > > > >=20 > > > > > On the switch side, I've tried a known good optic from an existin= g connection. > > > > >=20 > > > > > I could install an PRO/10GbE instead, that has a built-in=20 > > > > > transceiver. I have two of those in use now, both working on 10G. > > > >=20 > > > > Have you tried connected it to something other than the Unifi switc= h? > > >=20 > > > The only SFP+ capable switches I have are Unifi. > > >=20 > > > I just tried the other switch (US-48) which had one SFP+ port free. = Same issues there. > >=20 > > Did the Unifi switch see the SFP+ optics on the switch end? >=20 > That port never lit up on the switch. I didn't check anything else,=20 > switch-related. I just inserted a 10G transceiver into port 8. It shows up as a 10GBase-SR Screen shots at https://imgur.com/a/SSEgyxN At the same time, on the server side, ifconfig indicates: status: no carrier supported media: media autoselect media 10Gbase-SR nd6 options=3D23 plugged: SFP/SFP+/SFP28 10G Base-SR (LC) vendor: AVAGO PN: AFBR-703SDZ SN: AD0946A00YB DATE: 2009-11-10 module temperature: 36.75 C Voltage: 3.32 Volts RX: 0.67 mW (-1.72 dBm) TX: 0.56 mW (-2.46 dBm) I have not yet tried moving from auto-negotiate on both ends. -- Dan Langille dan@langille.org