From owner-freebsd-net@freebsd.org Thu Aug 30 22:35:01 2018 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id EF5B2EFABFE for ; Thu, 30 Aug 2018 22:35:00 +0000 (UTC) (envelope-from marius.h@lden.org) Received: from out1-smtp.messagingengine.com (out1-smtp.messagingengine.com [66.111.4.25]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 9CE567579D; Thu, 30 Aug 2018 22:35:00 +0000 (UTC) (envelope-from marius.h@lden.org) Received: from compute7.internal (compute7.nyi.internal [10.202.2.47]) by mailout.nyi.internal (Postfix) with ESMTP id EF6B921FAD; Thu, 30 Aug 2018 18:34:59 -0400 (EDT) Received: from web3 ([10.202.2.213]) by compute7.internal (MEProxy); Thu, 30 Aug 2018 18:34:59 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=lden.org; h= content-transfer-encoding:content-type:date:from:in-reply-to :message-id:mime-version:references:subject:to:x-me-sender :x-me-sender:x-sasl-enc; s=fm3; bh=dyFhyqrt5UJrNPyi121Nn7fydpIe5 GKG1mv2pkXqxno=; b=tu0Rj72+Hy+f+du7N+tCY1XWD7DQqZXHrDMbOKWtzv/wD +xBjxm87WJJuSn+Gq/+sEzMuGgILFJD/cAe1CqxY3jxiJNr+mCxiqyKyi+lY1nfv TGWQAtReQIcL+1bw+SZWlqRy5zQY6LFgF05jB3H3Qb6JkOrbiiH703JQAokv9Uka 4jhmfxeUUYtFKrs6dTTo0lwby7Mjx9q54MRhv1ouUb8lZ9/62HxrIx90PlVvtbci 6FM/6DAayMKb/0ckpS0QlD7h3wE6/uixunCdLg3GYZwUukRLCr26xQHw9s/LWwlG 0nt8LtPgUcD6cDvkd2XbBMOss02OE8TRho783fzmw== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=content-transfer-encoding:content-type :date:from:in-reply-to:message-id:mime-version:references :subject:to:x-me-sender:x-me-sender:x-sasl-enc; s=fm3; bh=dyFhyq rt5UJrNPyi121Nn7fydpIe5GKG1mv2pkXqxno=; b=pw5DMfTacU1mZZeW2P6T1v 4NmGmL75PJlPAFE0LpzGvVZuuSKkpI4GJdY/A4ASoGEptJ8e6MruwZujRUVzGVLJ +w7h3Q8eiV5Fsei0oP+Ya/TEfxWJ6viWWgdaTk47n1tij2ZSki+SEthPYODhgdFC M+oXdIlaRzBbqfCCC6uR/qaDzz1hH12GaTMFLZExFs8Q1CBgit/vnl7go+rlPai0 tMspcbgFVw9mlY/icz+Ne0jX03R9ZoEuR28UKwypk4iQbbEdjrEHSX5YZVCMusuF gVbGKPT76GaltKt7DWvlTXJN/N1fF3nhAUEQOfGndLJ/qnoLX97mH4sgitdZQOPw == X-ME-Proxy: X-ME-Sender: Received: by mailuser.nyi.internal (Postfix, from userid 99) id 627299E4AA; Thu, 30 Aug 2018 18:34:58 -0400 (EDT) Message-Id: <1535668498.3140032.1491908992.2BCDD0B7@webmail.messagingengine.com> From: Marius Halden To: Navdeep Parhar , freebsd-net@freebsd.org MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset="utf-8" X-Mailer: MessagingEngine.com Webmail Interface - ajax-7b72137a Date: Fri, 31 Aug 2018 00:34:58 +0200 In-Reply-To: References: <1535379569.2132387.1487489784.45227861@webmail.messagingengine.com> <20180827151302.GA10167@ox> <1535395530.234212.1487804896.64257978@webmail.messagingengine.com> <1535448912.3229649.1488521184.1EE83C33@webmail.messagingengine.com> <20180829062843.GA25476@ox> <1535538153.459716.1489861176.29777B66@webmail.messagingengine.com> <1535628110.3034153.1491191792.12397BCF@webmail.messagingengine.com> <8bb881ef-a701-1c94-3598-79a2724fa648@FreeBSD.org> <1535665888.3128528.1491873424.5CEF9F3A@webmail.messagingengine.com> Subject: Re: cxl nic not working after reboot X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.27 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 30 Aug 2018 22:35:01 -0000 On Fri, Aug 31, 2018, at 00:14, Navdeep Parhar wrote: > On 8/30/18 2:51 PM, Marius Halden wrote: > > On Thu, Aug 30, 2018, at 19:27, Navdeep Parhar wrote: > >> On 8/30/18 4:21 AM, Marius Halden wrote: > >>> I tried to downgrade to a the previous bsdrp version we were running = based on 11.1-RELEASE-p10, but it did not start working again. ifconfig out= put and t5nex0 devlog follows (non-working state), but it all looks fine to= me (media has always been reported wrong). I did notice though that "hw_ma= c_init_port[0], =E2=80=A6" will always be logged when it works but not when= when it doesn't work. I confirmed this on a box still running the old vers= ion which functions as intended. > >>> > >>> The ones not working has a newer firmware version than the ones worki= ng. > >>> > >>> Non-working: > >>> # sysctl dev.t5nex.0.firmware_version > >>> dev.t5nex.0.firmware_version: 1.19.1.0 > >>> > >>> > >>> Working: > >>> # sysctl dev.t5nex.0.firmware_version > >>> dev.t5nex.0.firmware_version: 1.16.45.0 > >>> > >>> Any other ideas? > >>> > >> > >> I'm still looking into it. The current working theory is that the peer > >> is trying to autonegotiate when it shouldn't (it's 1Gbps optics). If > >> you know how to disable AN on the peer this should be easy to test. > >=20 > > Thanks. Unfortunately we don't have access to the peer as that's our IS= Ps router. According to the sysctl autonegotiate is not supported on our si= de. > >=20 >=20 > I'll get a couple of 1G optics in a day or so and then I'll be able to > try some things for myself. Wait for that or try a 1G TWINAX (copper) > SFP+ cable in case you have one -- that should be able to link up (if > it's really autonegotiation that's causing problems). We have some 10G TWINAX between our routers which has worked perfectly fine= regardless of firmware version on either side. I don't have access to any = 1G TWINAX cables to test with. --=20 Marius Halden