From owner-freebsd-bugs@freebsd.org Thu Sep 6 08:35:56 2018 Return-Path: Delivered-To: freebsd-bugs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 6C3ECFF3960 for ; Thu, 6 Sep 2018 08:35:56 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id E6ABE8CFC7 for ; Thu, 6 Sep 2018 08:35:55 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.ysv.freebsd.org (Postfix) id AB759FF395F; Thu, 6 Sep 2018 08:35:55 +0000 (UTC) Delivered-To: bugs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 9A239FF395D for ; Thu, 6 Sep 2018 08:35:55 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 255288CFC6 for ; Thu, 6 Sep 2018 08:35:55 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id 70CB42362E for ; Thu, 6 Sep 2018 08:35:54 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id w868ZsT9046210 for ; Thu, 6 Sep 2018 08:35:54 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id w868Zsm3046209 for bugs@FreeBSD.org; Thu, 6 Sep 2018 08:35:54 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: bugs@FreeBSD.org Subject: [Bug 231192] cxl: nic does not work after reboot Date: Thu, 06 Sep 2018 08:35:54 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: new X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.2-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: marius.halden@modirum.com X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: bugs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_id short_desc product version rep_platform op_sys bug_status bug_severity priority component assigned_to reporter Message-ID: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-bugs@freebsd.org X-Mailman-Version: 2.1.27 Precedence: list List-Id: Bug reports List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 06 Sep 2018 08:35:56 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D231192 Bug ID: 231192 Summary: cxl: nic does not work after reboot Product: Base System Version: 11.2-RELEASE Hardware: Any OS: Any Status: New Severity: Affects Only Me Priority: --- Component: kern Assignee: bugs@FreeBSD.org Reporter: marius.halden@modirum.com Hi, We use some Chelsio T540-CR NICs and after upgrading to 11.2 from 11.1 we h= ave run into an issue where the NICs don't forward any traffic after rebooting them. If we unplug the SFPs and then reinsert them everything will start working. Looking at ifconfig everything looks normal and ifconfig down/up d= oes not help. The SFPs we are experiencing the issue with are 1Gbit CWDM optics, our 10Gbit DAC cables are working correctly. I'm unable to find anything specific in the log about what is happening, but interface frame counters s= ay we are sending packets, but nothing is received at the other end and we are= not receiving any thing at all according to the same counters. Looking at the hw.t5nex.0.misc.devlog I noticed a line containing "hw_mac_init_port[0], =E2=80=A6" is always logged when it works, but never = when it doesn't work. Otherwise the there is not anything obvious to me in that log. (Full log can be found in the original email thread[1].) After downgrading the firmware from 1.19.1.0 to 1.16.45.0 and disabling automatic upgrade in loader.conf everything works as expected, even on 11.2. [1]: https://lists.freebsd.org/pipermail/freebsd-net/2018-August/051420.html --=20 You are receiving this mail because: You are the assignee for the bug.=