From owner-freebsd-net@freebsd.org Thu Aug 30 22:35:10 2018 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 4E91DEFAC15 for ; Thu, 30 Aug 2018 22:35:10 +0000 (UTC) (envelope-from nparhar@gmail.com) Received: from mail-wr1-x433.google.com (mail-wr1-x433.google.com [IPv6:2a00:1450:4864:20::433]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id C21FB757C4 for ; Thu, 30 Aug 2018 22:35:09 +0000 (UTC) (envelope-from nparhar@gmail.com) Received: by mail-wr1-x433.google.com with SMTP id n2-v6so9443318wrw.7 for ; Thu, 30 Aug 2018 15:35:09 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=sender:subject:from:to:references:message-id:date:user-agent :mime-version:in-reply-to:content-language:content-transfer-encoding; bh=pl6BSkR9OyVe5KSipQPIFwJX9TvmnJpH3NVY8kV5ttY=; b=aIIfZEiUC+4f5IRi7M41uAwaRTCODYaH5GUmFySGfLxcHSXBC+2rua7jfS5TR/zdVY /Be9JCmy0x+tEusGisGt41NJ1SY5MQA3FHAklffNztlSQhjq5aUE+VQGb2/ywrix8bDy 1sfJcqcebY5AesDrJ97cPi9DD+eQfAQ6HT2hiAoH6aWszyVgVmZuWGivsIV0bKDuGAdT l2/tXNiZiK//9VU8Jv7u0ZVJkkfFDl6L7c/zeARtyXSqgqJk6cfs2lcAYaSkVuXReU4/ 0wgOKxf7a8+cxiiRigVZn/hez8GsoWNYg8v7IRB9dr6JEX9ex11TgpQXnH6V8K0r1YHU t6Yg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:sender:subject:from:to:references:message-id :date:user-agent:mime-version:in-reply-to:content-language :content-transfer-encoding; bh=pl6BSkR9OyVe5KSipQPIFwJX9TvmnJpH3NVY8kV5ttY=; b=niw4SSITHW3uArkUidqRu6gmy7dIau6CdP2SeujZ5dbDq7Dg5ITjiVW7yh4gVvAdnj 3MXNEFt7KyZ6UioibuAUx+K3RGkIQK+EQNJszuYjYvojngdCUzNBqTB/sLG+kP/v7Ajo fJe/zTCPOsctbKXyV/UclWftzmOucmIWkXQpq8rkbMnpOI/7/kQjWRULPcsgf6Q3riCV TsqtMwLUkHyBCUrqLWPVItywzVGcta79CB0eAXL1gqohFkwvHiZzHVCc3wCwyYRST8k+ gi21wD+a88JfBWILXVEEPbwMAQ8GvQ4VQyFcS3GGEq31pw9KQke60eU+phTz/xZWq+4X ra9w== X-Gm-Message-State: APzg51BBhfjHIIDszF57iJjgWMpi1gdaLEpcrTxe5pkyoIvZufsRSFIP /r3UZY6nATTwdPnEfA34H5uHc4fx X-Google-Smtp-Source: ANB0Vdb67EaUGnPgffSszkY5GnBndZCYQyhzZtIY6bEe+c/n8sJQ6a3DU9c6p0uEV3xm+g9XScmfvQ== X-Received: by 2002:adf:f0c8:: with SMTP id x8-v6mr9653217wro.49.1535668508594; Thu, 30 Aug 2018 15:35:08 -0700 (PDT) Received: from [10.192.166.0] (stargate.chelsio.com. [12.32.117.8]) by smtp.googlemail.com with ESMTPSA id o14-v6sm5221046wmd.35.2018.08.30.15.35.07 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Thu, 30 Aug 2018 15:35:07 -0700 (PDT) Sender: Navdeep Parhar Subject: Re: cxl nic not working after reboot From: Navdeep Parhar To: Marius Halden , freebsd-net@freebsd.org References: <1535379569.2132387.1487489784.45227861@webmail.messagingengine.com> <20180827151302.GA10167@ox> <1535395530.234212.1487804896.64257978@webmail.messagingengine.com> <1535448912.3229649.1488521184.1EE83C33@webmail.messagingengine.com> <20180829062843.GA25476@ox> <1535538153.459716.1489861176.29777B66@webmail.messagingengine.com> <1535628110.3034153.1491191792.12397BCF@webmail.messagingengine.com> <8bb881ef-a701-1c94-3598-79a2724fa648@FreeBSD.org> <1535665888.3128528.1491873424.5CEF9F3A@webmail.messagingengine.com> Message-ID: <1abe3063-3a2f-2eac-2246-f8dea30867e5@FreeBSD.org> Date: Thu, 30 Aug 2018 15:35:05 -0700 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:60.0) Gecko/20100101 Thunderbird/60.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: quoted-printable X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.27 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 30 Aug 2018 22:35:10 -0000 On 8/30/18 3:14 PM, Navdeep Parhar wrote: > On 8/30/18 2:51 PM, Marius Halden wrote: >> On Thu, Aug 30, 2018, at 19:27, Navdeep Parhar wrote: >>> On 8/30/18 4:21 AM, Marius Halden wrote: >>>> I tried to downgrade to a the previous bsdrp version we were running= based on 11.1-RELEASE-p10, but it did not start working again. ifconfig = output and t5nex0 devlog follows (non-working state), but it all looks fi= ne to me (media has always been reported wrong). I did notice though that= "hw_mac_init_port[0], =E2=80=A6" will always be logged when it works but= not when when it doesn't work. I confirmed this on a box still running t= he old version which functions as intended. >>>> >>>> The ones not working has a newer firmware version than the ones work= ing. >>>> >>>> Non-working: >>>> # sysctl dev.t5nex.0.firmware_version >>>> dev.t5nex.0.firmware_version: 1.19.1.0 >>>> >>>> >>>> Working: >>>> # sysctl dev.t5nex.0.firmware_version >>>> dev.t5nex.0.firmware_version: 1.16.45.0 >>>> >>>> Any other ideas? >>>> >>> >>> I'm still looking into it. The current working theory is that the pe= er >>> is trying to autonegotiate when it shouldn't (it's 1Gbps optics). If= >>> you know how to disable AN on the peer this should be easy to test. >> >> Thanks. Unfortunately we don't have access to the peer as that's our I= SPs router. According to the sysctl autonegotiate is not supported on our= side. >> >=20 > I'll get a couple of 1G optics in a day or so and then I'll be able to > try some things for myself. Wait for that or try a 1G TWINAX (copper) > SFP+ cable in case you have one -- that should be able to link up (if Sorry, this won't work either. At 1G, AN is done only for -BT (RJ45) copper cables, not for SFP+ TWINAX copper. Regards, Navdeep