From owner-freebsd-net@freebsd.org Thu Aug 30 22:44:45 2018 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 1A9BAEFB128 for ; Thu, 30 Aug 2018 22:44:45 +0000 (UTC) (envelope-from marius.h@lden.org) Received: from out1-smtp.messagingengine.com (out1-smtp.messagingengine.com [66.111.4.25]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id BCB0F75EE9; Thu, 30 Aug 2018 22:44:44 +0000 (UTC) (envelope-from marius.h@lden.org) Received: from compute7.internal (compute7.nyi.internal [10.202.2.47]) by mailout.nyi.internal (Postfix) with ESMTP id 5276021FAC; Thu, 30 Aug 2018 18:44:44 -0400 (EDT) Received: from web3 ([10.202.2.213]) by compute7.internal (MEProxy); Thu, 30 Aug 2018 18:44:44 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=lden.org; h= content-transfer-encoding:content-type:date:from:in-reply-to :message-id:mime-version:references:subject:to:x-me-sender :x-me-sender:x-sasl-enc; s=fm3; bh=Rrwr2PKFzt0bBAR9TDTY2C0+T2BIq TXJpb5R0jl2Qnw=; b=nD5NUKgGcUXvME8o39dhq6zBZ5A7KSVdrQOGF9TWqW5Hr 7WL6ByHGuH75Hbb21N5GPgl1sh6p3bp7yG2p4RX8I3xJxfJKgw9Hi3DxdyapXuSP lUWG1xkLxVwxnpy/6vbQKkr+kGw4kUg9iiK02kKJqcjcabceFJIZCuID9mcOYeta cHsV4cMNiyRwH3hAe8yC383t8ZjAl8i2n/C6B9r7cze6BFvmwZAP98luhdBNXVnq D24luO671WDNkvdTTTnx4B6PSiTlVpUCWPqjRxf4crkcZR6GXqt5WYB2g6nQxRVy 3TOb7l5ITTCn9Jg0e7uIFGTaJn6O4xnhbE/w6y53A== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=content-transfer-encoding:content-type :date:from:in-reply-to:message-id:mime-version:references :subject:to:x-me-sender:x-me-sender:x-sasl-enc; s=fm3; bh=Rrwr2P KFzt0bBAR9TDTY2C0+T2BIqTXJpb5R0jl2Qnw=; b=pLdepXfGSr95d2nJlyq7M6 z2GWTdUhUTUfYdtZwceCYY8g6ldUtwqBX4NyIS+5/YQd6yvG6lI8w0XFOsSmr506 mpQg+IzbbE+WfAlj/V8hUuDJHOZFmh//4bRDCJZ9yjqxa3OU9ZDIMSe+yJQ8wMjc bFCDETLVr8bKlImZHhSD83Rt7VYV54H8wp/Xi9gAdvz0fTDfhcEO6hjm2ql2U5zJ wmU2aoJjX4CNH8cf4MT/kTtPyNZVX+LuHUilLI4PbJRFMyGAsUwDB0M57D4vZh25 zGib0tW3JWehobV/klMeT/r7UNnRav7gxMLyDqiJ1VIikuo1KIZqm0Yy+rJrzLXQ == X-ME-Proxy: X-ME-Sender: Received: by mailuser.nyi.internal (Postfix, from userid 99) id 072CF9E508; Thu, 30 Aug 2018 18:44:43 -0400 (EDT) Message-Id: <1535669083.3143114.1491917856.4E6CB55F@webmail.messagingengine.com> From: Marius Halden To: Navdeep Parhar , freebsd-net@freebsd.org MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset="utf-8" X-Mailer: MessagingEngine.com Webmail Interface - ajax-7b72137a In-Reply-To: <1abe3063-3a2f-2eac-2246-f8dea30867e5@FreeBSD.org> Subject: Re: cxl nic not working after reboot Date: Fri, 31 Aug 2018 00:44:43 +0200 References: <1535379569.2132387.1487489784.45227861@webmail.messagingengine.com> <20180827151302.GA10167@ox> <1535395530.234212.1487804896.64257978@webmail.messagingengine.com> <1535448912.3229649.1488521184.1EE83C33@webmail.messagingengine.com> <20180829062843.GA25476@ox> <1535538153.459716.1489861176.29777B66@webmail.messagingengine.com> <1535628110.3034153.1491191792.12397BCF@webmail.messagingengine.com> <8bb881ef-a701-1c94-3598-79a2724fa648@FreeBSD.org> <1535665888.3128528.1491873424.5CEF9F3A@webmail.messagingengine.com> <1abe3063-3a2f-2eac-2246-f8dea30867e5@FreeBSD.org> X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.27 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 30 Aug 2018 22:44:45 -0000 On Fri, Aug 31, 2018, at 00:35, Navdeep Parhar wrote: > On 8/30/18 3:14 PM, Navdeep Parhar wrote: > > On 8/30/18 2:51 PM, Marius Halden wrote: > >> On Thu, Aug 30, 2018, at 19:27, Navdeep Parhar wrote: > >>> On 8/30/18 4:21 AM, Marius Halden wrote: > >>>> I tried to downgrade to a the previous bsdrp version we were running= based on 11.1-RELEASE-p10, but it did not start working again. ifconfig ou= tput and t5nex0 devlog follows (non-working state), but it all looks fine t= o me (media has always been reported wrong). I did notice though that "hw_m= ac_init_port[0], =E2=80=A6" will always be logged when it works but not whe= n when it doesn't work. I confirmed this on a box still running the old ver= sion which functions as intended. > >>>> > >>>> The ones not working has a newer firmware version than the ones work= ing. > >>>> > >>>> Non-working: > >>>> # sysctl dev.t5nex.0.firmware_version > >>>> dev.t5nex.0.firmware_version: 1.19.1.0 > >>>> > >>>> > >>>> Working: > >>>> # sysctl dev.t5nex.0.firmware_version > >>>> dev.t5nex.0.firmware_version: 1.16.45.0 > >>>> > >>>> Any other ideas? > >>>> > >>> > >>> I'm still looking into it. The current working theory is that the pe= er > >>> is trying to autonegotiate when it shouldn't (it's 1Gbps optics). If > >>> you know how to disable AN on the peer this should be easy to test. > >> > >> Thanks. Unfortunately we don't have access to the peer as that's our I= SPs router. According to the sysctl autonegotiate is not supported on our s= ide. > >> > >=20 > > I'll get a couple of 1G optics in a day or so and then I'll be able to > > try some things for myself. Wait for that or try a 1G TWINAX (copper) > > SFP+ cable in case you have one -- that should be able to link up (if >=20 > Sorry, this won't work either. At 1G, AN is done only for -BT (RJ45) > copper cables, not for SFP+ TWINAX copper. Come to think of it, we're using CWDM optics if that is relevant. --=20 Marius Halden