From owner-freebsd-net@freebsd.org Thu Aug 30 17:27:04 2018 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 5D646EA8065 for ; Thu, 30 Aug 2018 17:27:04 +0000 (UTC) (envelope-from nparhar@gmail.com) Received: from mail-pl1-x62f.google.com (mail-pl1-x62f.google.com [IPv6:2607:f8b0:4864:20::62f]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id CE4A28B815 for ; Thu, 30 Aug 2018 17:27:03 +0000 (UTC) (envelope-from nparhar@gmail.com) Received: by mail-pl1-x62f.google.com with SMTP id w14-v6so4140751plp.6 for ; Thu, 30 Aug 2018 10:27:03 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=sender:subject:to:references:from:openpgp:autocrypt:message-id:date :user-agent:mime-version:in-reply-to:content-language :content-transfer-encoding; bh=saiTlQGhV56/ovXva4y4nvyHyAFwLQj/pakDwrV2ER8=; b=ok9BXfl9+XiXfNlybCBQyqzg/IVbJ/GyUA2Pp7PUOgsD7mL/0yrZ5tn+43rkBiUrfx 0hdpqadZxFzIGPpsepulWZJ0PHB5AtiMRD29xjbV8jZNSttucm5103oYMkXHCsVVy83T aQwQ3mLwEMXXbQmP+SGxlwQQlx1sn0kYZT/DwbKDiArvTo3s7COV3ea0YmLKqqmfP3/1 Bx8JA7PIQ9luAg2WX+mnUxabIJuP868Vflosq331S9NxsQdLoX6lIuRDY6S+L1wOR9k8 UdBOTQsomFi3mQjEqxHFm2DNhAlyjWR+n6YtBnVo58Q5WesIdOdJtQk99SGakQs3bMjJ yFFg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:sender:subject:to:references:from:openpgp :autocrypt:message-id:date:user-agent:mime-version:in-reply-to :content-language:content-transfer-encoding; bh=saiTlQGhV56/ovXva4y4nvyHyAFwLQj/pakDwrV2ER8=; b=ilDYARr45ZACzGMwFuwm7zbUWkMHTH+sQfT/R/gvXn7k4k5N8o22cJcnEvr5YdDUe8 5DNFII2m6HkI5cd12uLOwzWRsN+pW5FyQhCr0dFUgBDhOD5ZQxMGCV9fv+4NNHuo5rdb 55npp1eOwlYEP60JSx4gLmnnuqDfNf1c6ttaC8PKwg2XtQ+MVBt7rg6JXTRoXP3CpYkQ 0/X+k6LsYk0YeZvJQQMB5+EMCmbPzunS58y13XBIr1krb5xVOSfT0nO8zrpQq+4STy2R O1XEQA+eljFZ9nUYxZogf65vE5W9dipLwxRe5cIRJlMRgnU5iieS/SdtLb/hYXjHJ6D/ uaSA== X-Gm-Message-State: APzg51B7k9iMzsPpFWxPXsrNBiZ7C0TOL2CJkb8QbEGv+CPgJUOa0DOJ fDI4qRzBUJRghL75nekeV6uhpey+ X-Google-Smtp-Source: ANB0VdaUXcwj3oiESFYWvpdqCpb4pCSAbDT7FImn+tu1f1kxTiEqjO25dtb4FMX8k6yB9WUaNlT4iQ== X-Received: by 2002:a17:902:b20d:: with SMTP id t13-v6mr11422192plr.107.1535650022502; Thu, 30 Aug 2018 10:27:02 -0700 (PDT) Received: from [10.192.166.0] (stargate.chelsio.com. [12.32.117.8]) by smtp.googlemail.com with ESMTPSA id b14-v6sm17444489pfc.178.2018.08.30.10.27.01 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Thu, 30 Aug 2018 10:27:01 -0700 (PDT) Sender: Navdeep Parhar Subject: Re: cxl nic not working after reboot To: Marius Halden , freebsd-net@freebsd.org References: <1535379569.2132387.1487489784.45227861@webmail.messagingengine.com> <20180827151302.GA10167@ox> <1535395530.234212.1487804896.64257978@webmail.messagingengine.com> <1535448912.3229649.1488521184.1EE83C33@webmail.messagingengine.com> <20180829062843.GA25476@ox> <1535538153.459716.1489861176.29777B66@webmail.messagingengine.com> <1535628110.3034153.1491191792.12397BCF@webmail.messagingengine.com> From: Navdeep Parhar Openpgp: preference=signencrypt Autocrypt: addr=np@FreeBSD.org; prefer-encrypt=mutual; keydata= xsDiBEosaGcRBACOXnXquGEW53BjpMt2jViod/TUf1xgjMekcbDxqOODPeX7eYfrwJ8G6BCN OpGjBmWDu/JcNj4Z+gmTilJ6WLZQ7ecFZfEeO91pt6ys0cyWh0xfO+/mT83D7W81S/kqrJBk QbBIdV6LumevdErHo272r8RcMELC4Ru87eRtX3hmEwCgnnGNJMpQFUfYTt5XE7nY0yQoeV8D /0OcWmJbEZWxX9O7AuliCe3zd2Dw0B4LB9SZ2Dis7+gpVd3xVgYnt5wRE9kM+ThgrMA/wqr8 07qmEG6bcfUsfwwGN9YUtNF3xAN07cXTs026sCIFNZK816PrThBzCgkwR7pDpkMzGWIBr8Wi XXy0eB+JlQ6UV4PEiXuZ5ulzP0b1A/9CZm3wJfrNC0r1gMyrfVedg4zwKU997bmPLGcYs+rW XDTI9CvMseOUYn4CoDZQCp/9zxuHK+VU7Y/w0c/hVE5ERACSn4SjN2unEDstK9njZBMHEPVk Ae/YvSG5cmc97SHlVE+eu/bbLKcvFb6rRLPOaVFQJMJA2VJEGWtYhvP7Zc0fTmF2ZGVlcCBQ YXJoYXIgPG5wQEZyZWVCU0Qub3JnPsJgBBMRAgAgBQJKLGhnAhsDBgsJCAcDAgQVAggDBBYC AwECHgECF4AACgkQyrIrk6yriBL0MQCfUJOiS2PbJFDeiav1ylcXXwfpggAAoJRoS7GDENGy M4BzjJ4b0ptZqTLRzsFNBEosaGcQCACFCWs47SL4DQA6bNDlVJu4w8wLf8uVOyatuGmdXX8Y /OTVQJgA3vS+ODNVJCxhKVlvhcn7bhBdGdWKS9K+lr8+eEvr4hf2bQpesoHC+uFgKyILkCBN L8raixbhysyq0pfZWWDJMyn+G42BG1yJJi+bykygdpYnbIVA8dYHmBibI8mkPKOHSohjXT1S RfGGn+l1w54OO4NlJhCXMkjTA/Z9Bt4XeaiR85uJi0UUfV8FGZHhgSvT+/P1xIvz+nytuehS P/QLXl13CtAG/nKVkAcZnsT/3NrJ4Z2r45k+c50Wrf210scAaBogrrV5eIHfNGgOANApN8+8 vj+aXO4pXRuXAAMFB/44ea8rd+P5N3OMrfuM8i91Qe1bJ+BIoroKPOr8jvCry0h3QpdfLKUN IgaqbS3JZeBJ8HHnWSGCF+o6H5gzRe1hvylPEclLPDCuPe7T746h9Mzejf2hNDJvOg+BuweD ZW4KhovVbdS+syJEvpGF4bO8qgHT2CKgruXSHbFetdQWbkM0rfMmTuo0GcR2BEVrPb/SPFv6 4ZZyAZzmnGO4vT1bzClnTzJixrDpH74M3vSEYegMB4KdbLYBi8Jx4QUKgVEhJHjJubKWX4et yU/uuehOC3xYrmr1UXvsom3U8r36Dvdo77Yr3dgDVXa7bolNx0TIhdWxZI+R4z9E75QY+/wg wkkEGBECAAkFAkosaGcCGwwACgkQyrIrk6yriBI+JQCfUxgyqGtzZvLh5Al7gsTmRc11PLwA niD3NfWGRcO2+9uxSSQqRH1ywC4n Message-ID: <8bb881ef-a701-1c94-3598-79a2724fa648@FreeBSD.org> Date: Thu, 30 Aug 2018 10:27:00 -0700 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:60.0) Gecko/20100101 Thunderbird/60.0 MIME-Version: 1.0 In-Reply-To: <1535628110.3034153.1491191792.12397BCF@webmail.messagingengine.com> Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: quoted-printable X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.27 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 30 Aug 2018 17:27:04 -0000 On 8/30/18 4:21 AM, Marius Halden wrote: > On Wed, Aug 29, 2018, at 12:22, Marius Halden wrote: >> On Wed, Aug 29, 2018, at 08:28, Navdeep Parhar wrote: >>>>>> Provide the output of these commands when the link isn't up: >>>>>> # ifconfig -mvvv >>>>>> # sysctl -n dev.t5nex.0.misc.devlog >>> >>> Can you provide the output from when the port is working? >> >> Sure, the output from when it works follows. >=20 > I tried to downgrade to a the previous bsdrp version we were running ba= sed on 11.1-RELEASE-p10, but it did not start working again. ifconfig out= put and t5nex0 devlog follows (non-working state), but it all looks fine = to me (media has always been reported wrong). I did notice though that "h= w_mac_init_port[0], =E2=80=A6" will always be logged when it works but no= t when when it doesn't work. I confirmed this on a box still running the = old version which functions as intended. >=20 > The ones not working has a newer firmware version than the ones working= =2E >=20 > Non-working: > # sysctl dev.t5nex.0.firmware_version > dev.t5nex.0.firmware_version: 1.19.1.0 >=20 >=20 > Working: > # sysctl dev.t5nex.0.firmware_version > dev.t5nex.0.firmware_version: 1.16.45.0 >=20 > Any other ideas? >=20 I'm still looking into it. The current working theory is that the peer is trying to autonegotiate when it shouldn't (it's 1Gbps optics). If you know how to disable AN on the peer this should be easy to test. Regards, Navdeep