From owner-svn-src-stable-11@freebsd.org Fri Jun 2 21:17:12 2017 Return-Path: Delivered-To: svn-src-stable-11@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id AEAA7AFB9D0 for ; Fri, 2 Jun 2017 21:17:12 +0000 (UTC) (envelope-from mike@sentex.net) Received: from smarthost2.sentex.ca (smarthost2.sentex.ca [205.211.164.50]) (using TLSv1 with cipher DHE-RSA-CAMELLIA256-SHA (256/256 bits)) (Client CN "smarthost.sentex.ca", Issuer "smarthost.sentex.ca" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 7D9E277A23; Fri, 2 Jun 2017 21:17:11 +0000 (UTC) (envelope-from mike@sentex.net) Received: from lava.sentex.ca (lava.sentex.ca [IPv6:2607:f3e0:0:5::11]) by smarthost2.sentex.ca (8.15.2/8.15.2) with ESMTPS id v52LGxqL014702 (version=TLSv1 cipher=DHE-RSA-CAMELLIA256-SHA bits=256 verify=NO); Fri, 2 Jun 2017 17:17:00 -0400 (EDT) (envelope-from mike@sentex.net) Received: from [192.168.43.26] (saphire3.sentex.net [192.168.43.26]) by lava.sentex.ca (8.15.2/8.15.2) with ESMTP id v52LGvUU007288; Fri, 2 Jun 2017 17:16:57 -0400 (EDT) (envelope-from mike@sentex.net) Subject: Re: svn commit: r319269 - in stable/11/sys: conf dev/cxgbe/firmware modules/cxgbe/t4_firmware modules/cxgbe/t5_firmware modules/cxgbe/t6_firmware To: Navdeep Parhar , "pholes@sentex.net" , svn-src-stable-11@freebsd.org References: <201705310016.v4V0G5n7012861@repo.freebsd.org> From: Mike Tancsa Organization: Sentex Communications Message-ID: Date: Fri, 2 Jun 2017 17:16:55 -0400 User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:52.0) Gecko/20100101 Thunderbird/52.1.1 MIME-Version: 1.0 In-Reply-To: <201705310016.v4V0G5n7012861@repo.freebsd.org> Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: 8bit X-Scanned-By: MIMEDefang 2.78 X-BeenThere: svn-src-stable-11@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: SVN commit messages for only the 11-stable src tree List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 02 Jun 2017 21:17:12 -0000 Hi, Not sure if its the firmware for sure, but a number of DAC cables I have been using without issue all of a sudden are failing. On the switch port side, the link does not go down, but on the NIC side, the link is bouncing up and down once a bit of traffic is place on it. I swapped out the DAC cable for a plain old fiber SFP+ and its OK. The same DAC cable works fine prior to this update Jun 2 17:07:26 intels12004u kernel: cxl1: link state changed to DOWN Jun 2 17:07:27 intels12004u kernel: cxl1: link state changed to UP Jun 2 17:08:50 intels12004u kernel: cxl1: link state changed to DOWN Jun 2 17:08:50 intels12004u kernel: cxl1: link state changed to UP Jun 2 17:09:08 intels12004u kernel: cxl1: link state changed to DOWN Jun 2 17:09:08 intels12004u kernel: cxl1: link state changed to UP Jun 2 17:10:52 intels12004u kernel: cxl1: link state changed to DOWN Jun 2 17:10:53 intels12004u kernel: cxl1: link state changed to UP Jun 2 17:12:15 intels12004u kernel: cxl1: link state changed to DOWN Jun 2 17:12:15 intels12004u kernel: cxl1: link state changed to UP 0(intels12004u)# ifconfig cxl1 cxl1: flags=8843 metric 0 mtu 1500 options=ec07bb ether 00:07:43:28:95:28 hwaddr 00:07:43:28:95:28 inet 3.3.3.1 netmask 0xffffff00 broadcast 3.3.3.255 nd6 options=29 media: Ethernet 10Gbase-SR status: active plugged: SFP/SFP+/SFP28 10G Base-SR (LC) vendor: SOURCEPHOTONICS PN: SPP10ESRCDFB SN: G0611090002 DATE: 2010-09-19 module temperature: 20.35 C Voltage: 3.37 Volts RX: 0.00 mW (-40.00 dBm) TX: 6.55 mW (8.16 dBm) 0(intels12004u)# it for whatever reason shows it as fibre, but its twinax 0(intels12004u)# cxgbetool t5nex0 modinfo 1 ID: SFP/SFP+/SFP28 Vendor SOURCEPHOTONICS SN G0611090002 PN SPP10ESRCDFB Rev 10 Temp: +4C Vcc 3.353600V TX Bias 2.432000uA TX Power 6.528000mW RX Power 0.000000mW 0(intels12004u)# the switch shows the other end of the cable as HP-E6600ml-24G-4XG# show int transceiver 26 detail Transceiver in 26 Interface Index : 50 Type : SFP+SR Model : J9150A Connector Type : LC Wavelength : 850nm Transfer Distance : 80m (50um), 30m (62.5um), 300m (50um OM3), Diagnostic Support : DOM Serial Number : G0611090002 Status Temperature : 19.726C Voltage : 3.3320V Tx Bias : 9.874mA Tx Power : 6.5524mW, 8.164dBm Rx Power : 0.0001mW, -39.999dBm Recent Alarms : Temp high alarm Vcc low alarm Tx bias low alarm Rx power low alarm Temp high warning Vcc low warning Tx bias low warning Rx power low warning Recent Errors : Rx loss of signal Tx fault Time Stamp : Fri Jun 2 21:15:25 2017 On 5/30/2017 8:16 PM, Navdeep Parhar wrote: > Author: np > Date: Wed May 31 00:16:05 2017 > New Revision: 319269 > URL: https://svnweb.freebsd.org/changeset/base/319269 > > Log: > MFC r318762: > > cxgbe(4): Update the T4, T5, and T6 firmwares to 1.16.45.0. > > The latest firmware has a number of link related fixes, support for a > new custom card, and the fix for a bug that affected rate limiting on > FreeBSD. > > Relnotes: Yes > Sponsored by: Chelsio Communications > > Added: > stable/11/sys/dev/cxgbe/firmware/t4fw-1.16.45.0.bin.uu > - copied unchanged from r318762, head/sys/dev/cxgbe/firmware/t4fw-1.16.45.0.bin.uu > stable/11/sys/dev/cxgbe/firmware/t5fw-1.16.45.0.bin.uu > - copied unchanged from r318762, head/sys/dev/cxgbe/firmware/t5fw-1.16.45.0.bin.uu > stable/11/sys/dev/cxgbe/firmware/t6fw-1.16.45.0.bin.uu > - copied unchanged from r318762, head/sys/dev/cxgbe/firmware/t6fw-1.16.45.0.bin.uu > Deleted: > stable/11/sys/dev/cxgbe/firmware/t4fw-1.16.26.0.bin.uu > stable/11/sys/dev/cxgbe/firmware/t5fw-1.16.26.0.bin.uu > stable/11/sys/dev/cxgbe/firmware/t6fw-1.16.26.0.bin.uu > Modified: > stable/11/sys/conf/files > stable/11/sys/dev/cxgbe/firmware/t4fw_cfg_uwire.txt > stable/11/sys/dev/cxgbe/firmware/t4fw_interface.h > stable/11/sys/dev/cxgbe/firmware/t5fw_cfg_uwire.txt > stable/11/sys/dev/cxgbe/firmware/t6fw_cfg_uwire.txt > stable/11/sys/modules/cxgbe/t4_firmware/Makefile > stable/11/sys/modules/cxgbe/t5_firmware/Makefile > stable/11/sys/modules/cxgbe/t6_firmware/Makefile > Directory Properties: > stable/11/ (props changed) -- ------------------- Mike Tancsa, tel +1 519 651 3400 Sentex Communications, mike@sentex.net Providing Internet services since 1994 www.sentex.net Cambridge, Ontario Canada http://www.tancsa.com/