From owner-freebsd-net@freebsd.org Tue Aug 28 19:34:15 2018 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 5B3C510965EF for ; Tue, 28 Aug 2018 19:34:15 +0000 (UTC) (envelope-from nparhar@gmail.com) Received: from mail-pg1-x529.google.com (mail-pg1-x529.google.com [IPv6:2607:f8b0:4864:20::529]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id C333D93CAD for ; Tue, 28 Aug 2018 19:34:14 +0000 (UTC) (envelope-from nparhar@gmail.com) Received: by mail-pg1-x529.google.com with SMTP id m4-v6so1183158pgv.12 for ; Tue, 28 Aug 2018 12:34:14 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=sender:subject:to:cc:references:from:openpgp:autocrypt:message-id :date:user-agent:mime-version:in-reply-to:content-language :content-transfer-encoding; bh=36OStL6IZTWgbreci68iITFsiC8OjkHzA2soXJ1SQUw=; b=G5thdfYRS5egmShrOU4zI3iVK3vUfhov0TdF8AWV5t8/Tx1pYaE7XpKiDZTQ0hiftn ztGx03SDLJwM8mc3xldzZQK0PbsqYbkrRFW0BEfdQXhd7VH9d37jL3gwwecWJrctPqX6 EPK6ETtRf8qldY+6ydG2DXNLvtDi8l87caWlngEbKVnAiGD6NLs02fg59JiuLqyakVZB 8zpD+uk2d23i7PGSjS04hDInDODdxe6jLsbGTwI25psTRyQlomdyOR0K8pDphyU+/xSX xb54up1FQjYDYXhKnygSBZ2hl/g0M4ET5dVCYL2Kfcym/huc6wiZBUPmFaLmcz95hhKQ 2Nww== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:sender:subject:to:cc:references:from:openpgp :autocrypt:message-id:date:user-agent:mime-version:in-reply-to :content-language:content-transfer-encoding; bh=36OStL6IZTWgbreci68iITFsiC8OjkHzA2soXJ1SQUw=; b=twlpe1qhCinS2Bhmdvvgbw6DdJYeTbb/WAuKlcDd1tyl8jM/k6WtqyPnPCeTvAGcP5 /kybcFmoONO/TahexuP50utNoxfi2cbsIZfNyeKW11geqlZ1+qdBZ9u0wKzS2ex50fGP woM8s8Rj4ldZa4FOdgG2RSBJC/civd6u4802t3C7QxQ95SQdA3TYvDjLJfbnASDWIXEo WaBcNTSkEPS5Xo7XMUsLm3er0ibKcKgI8YgBNZVXaoctt9j7T7IZdjr658/00L17kLlF QXt5B03s1zGteUXqZO0CzWVmzAUU+EdIApklikYsUXpkhsUqxkf1gD4fRalv5renzsD9 3B3w== X-Gm-Message-State: APzg51D+IQdGLOWczxIvPTaHWZhiYA3pzSLFqCQZ5FbBawrjH9716ora uy84+uZjKdVMSKMwkF0Hdip4Uoof X-Google-Smtp-Source: ANB0VdZzdMnFegTGFrGAhR4LSNnDmgbbfLf5gE6SqQnAOGyz82/qD+RcTFt4poevcFiyX7BmY/UmOA== X-Received: by 2002:a63:7d7:: with SMTP id 206-v6mr2861672pgh.17.1535484853553; Tue, 28 Aug 2018 12:34:13 -0700 (PDT) Received: from [10.192.166.0] (stargate.chelsio.com. [12.32.117.8]) by smtp.googlemail.com with ESMTPSA id s16-v6sm2607713pfm.114.2018.08.28.12.34.12 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Tue, 28 Aug 2018 12:34:12 -0700 (PDT) Sender: Navdeep Parhar Subject: Re: cxl nic not working after reboot To: Marius Halden Cc: freebsd-net@freebsd.org References: <1535379569.2132387.1487489784.45227861@webmail.messagingengine.com> <20180827151302.GA10167@ox> <1535395530.234212.1487804896.64257978@webmail.messagingengine.com> <1535448912.3229649.1488521184.1EE83C33@webmail.messagingengine.com> <3bdfa15a-1b9f-e8cd-00a5-f5fdaaa5d15e@FreeBSD.org> <1535480853.1508751.1489107768.35E0F6F1@webmail.messagingengine.com> <72e8b5b8-631b-35b3-b378-804e69dd3250@FreeBSD.org> <1535484638.1530345.1489178328.3374515B@webmail.messagingengine.com> From: Navdeep Parhar Openpgp: preference=signencrypt Autocrypt: addr=np@FreeBSD.org; prefer-encrypt=mutual; keydata= xsDiBEosaGcRBACOXnXquGEW53BjpMt2jViod/TUf1xgjMekcbDxqOODPeX7eYfrwJ8G6BCN OpGjBmWDu/JcNj4Z+gmTilJ6WLZQ7ecFZfEeO91pt6ys0cyWh0xfO+/mT83D7W81S/kqrJBk QbBIdV6LumevdErHo272r8RcMELC4Ru87eRtX3hmEwCgnnGNJMpQFUfYTt5XE7nY0yQoeV8D /0OcWmJbEZWxX9O7AuliCe3zd2Dw0B4LB9SZ2Dis7+gpVd3xVgYnt5wRE9kM+ThgrMA/wqr8 07qmEG6bcfUsfwwGN9YUtNF3xAN07cXTs026sCIFNZK816PrThBzCgkwR7pDpkMzGWIBr8Wi XXy0eB+JlQ6UV4PEiXuZ5ulzP0b1A/9CZm3wJfrNC0r1gMyrfVedg4zwKU997bmPLGcYs+rW XDTI9CvMseOUYn4CoDZQCp/9zxuHK+VU7Y/w0c/hVE5ERACSn4SjN2unEDstK9njZBMHEPVk Ae/YvSG5cmc97SHlVE+eu/bbLKcvFb6rRLPOaVFQJMJA2VJEGWtYhvP7Zc0fTmF2ZGVlcCBQ YXJoYXIgPG5wQEZyZWVCU0Qub3JnPsJgBBMRAgAgBQJKLGhnAhsDBgsJCAcDAgQVAggDBBYC AwECHgECF4AACgkQyrIrk6yriBL0MQCfUJOiS2PbJFDeiav1ylcXXwfpggAAoJRoS7GDENGy M4BzjJ4b0ptZqTLRzsFNBEosaGcQCACFCWs47SL4DQA6bNDlVJu4w8wLf8uVOyatuGmdXX8Y /OTVQJgA3vS+ODNVJCxhKVlvhcn7bhBdGdWKS9K+lr8+eEvr4hf2bQpesoHC+uFgKyILkCBN L8raixbhysyq0pfZWWDJMyn+G42BG1yJJi+bykygdpYnbIVA8dYHmBibI8mkPKOHSohjXT1S RfGGn+l1w54OO4NlJhCXMkjTA/Z9Bt4XeaiR85uJi0UUfV8FGZHhgSvT+/P1xIvz+nytuehS P/QLXl13CtAG/nKVkAcZnsT/3NrJ4Z2r45k+c50Wrf210scAaBogrrV5eIHfNGgOANApN8+8 vj+aXO4pXRuXAAMFB/44ea8rd+P5N3OMrfuM8i91Qe1bJ+BIoroKPOr8jvCry0h3QpdfLKUN IgaqbS3JZeBJ8HHnWSGCF+o6H5gzRe1hvylPEclLPDCuPe7T746h9Mzejf2hNDJvOg+BuweD ZW4KhovVbdS+syJEvpGF4bO8qgHT2CKgruXSHbFetdQWbkM0rfMmTuo0GcR2BEVrPb/SPFv6 4ZZyAZzmnGO4vT1bzClnTzJixrDpH74M3vSEYegMB4KdbLYBi8Jx4QUKgVEhJHjJubKWX4et yU/uuehOC3xYrmr1UXvsom3U8r36Dvdo77Yr3dgDVXa7bolNx0TIhdWxZI+R4z9E75QY+/wg wkkEGBECAAkFAkosaGcCGwwACgkQyrIrk6yriBI+JQCfUxgyqGtzZvLh5Al7gsTmRc11PLwA niD3NfWGRcO2+9uxSSQqRH1ywC4n Message-ID: <32fc6737-87f8-7156-17f0-8e17b65a0812@FreeBSD.org> Date: Tue, 28 Aug 2018 12:34:11 -0700 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:60.0) Gecko/20100101 Thunderbird/60.0 MIME-Version: 1.0 In-Reply-To: <1535484638.1530345.1489178328.3374515B@webmail.messagingengine.com> Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.27 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 28 Aug 2018 19:34:15 -0000 On 8/28/18 12:30 PM, Marius Halden wrote: > On Tue, Aug 28, 2018, at 20:32, Navdeep Parhar wrote: >> On 8/28/18 11:27 AM, Marius Halden wrote: >>> On Tue, Aug 28, 2018, at 20:06, Navdeep Parhar wrote: >>>> On 8/28/18 2:35 AM, Marius Halden wrote: >>>>> ... >>>>> media: Ethernet 1000baseSX >>>>> status: active >>>>> supported media: >>>>> media 1000baseSX mediaopt full-duplex,rxpause,txpause >>>>> media 1000baseSX mediaopt full-duplex,rxpause >>>>> media 1000baseSX mediaopt full-duplex,txpause >>>>> media 1000baseSX mediaopt full-duplex >>>>> plugged: SFP/SFP+/SFP28 1000BASE-LX (LC) >>>> >>>> This shows that the SFP+ is recognized properly and the link is up >>>> (active). Can you please provide the outputs of ifconfig and sysctl >>>> from when the system is in the problem state, when the link doesn't come up? >>> >>> This is from when it's in the problem state. According to ifconfig there is link and everything looks fine to me, but it doesn't seem to pass any traffic through the interface at all. >>> >> >> Try passing some network traffic through the interface and look at >> before/after state of the MAC counters in sysctl dev.cxl.0.stats. Do >> you see the tx_frames/rx_frames counter move at all? > > tx_frames does move, rx_frames is stuck at zero. The following counters are non-zero and does increase when traffic is sent through the interface, all other are stuck at zero: > > dev.cxl.0.stats.tx_frames_65_127: 26083 > dev.cxl.0.stats.tx_frames_64: 4084 > dev.cxl.0.stats.tx_mcast_frames: 26083 > dev.cxl.0.stats.tx_bcast_frames: 4084 > dev.cxl.0.stats.tx_frames: 30167 > dev.cxl.0.stats.tx_octets: 2608846 > > Anything else I should look at? > What is on the other side of the link? Look at the peer's rx stats and see if it received the frames that cxl0 claims it has transmitted or not. Regards, Navdeep