From owner-freebsd-stable@FreeBSD.ORG  Tue Oct 21 06:14:26 2008
Return-Path: <owner-freebsd-stable@FreeBSD.ORG>
Delivered-To: freebsd-stable@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34])
	by hub.freebsd.org (Postfix) with ESMTP id 5C2EB106569E
	for <freebsd-stable@freebsd.org>; Tue, 21 Oct 2008 06:14:26 +0000 (UTC)
	(envelope-from pyunyh@gmail.com)
Received: from rv-out-0506.google.com (rv-out-0506.google.com [209.85.198.230])
	by mx1.freebsd.org (Postfix) with ESMTP id 206298FC1C
	for <freebsd-stable@freebsd.org>; Tue, 21 Oct 2008 06:14:26 +0000 (UTC)
	(envelope-from pyunyh@gmail.com)
Received: by rv-out-0506.google.com with SMTP id b25so1959661rvf.43
	for <freebsd-stable@freebsd.org>; Mon, 20 Oct 2008 23:14:25 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma;
	h=domainkey-signature:received:received:received:received:date:from
	:to:cc:subject:message-id:reply-to:references:mime-version
	:content-type:content-disposition:in-reply-to:user-agent;
	bh=Ug7wpZbQEsLSzs6iFEXi5KmbOuz/jD/gK7YtU1eSCs4=;
	b=QkLNMaqFNofqNKcLTi6KhFvqTG/lTxlsX2S/k0X8Ap/iYNcj8sW1xbgKdS7wgPTqsi
	q1iAebwpubnMbHIdYyCrs3c+jhHmrI/T56uYBNqwfoBvv7o4UchSYpMqcMuWoY7bbzDM
	QQo7JQmGhA+Ls9NoLR+4w4lNBhSQp6d0Z6Du4=
DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma;
	h=date:from:to:cc:subject:message-id:reply-to:references:mime-version
	:content-type:content-disposition:in-reply-to:user-agent;
	b=p3kGrsQc5eKz+KOLwTOwGP/viKEmpO5o0eC66Lce+xPaLJo3SxmIqv/U6Ocn+xO/W/
	GR497tG2ALU9kYUGX9zw9lg01e/16cGPDjOwsbcrvruKxYO7hIrlGYgSXSGdh1OkI7jV
	znMMg/TOw/SiRerc9+HDG0V/odsbq14IpBOhE=
Received: by 10.141.210.13 with SMTP id m13mr5450857rvq.25.1224569665788;
	Mon, 20 Oct 2008 23:14:25 -0700 (PDT)
Received: from michelle.cdnetworks.co.kr ([211.53.35.84])
	by mx.google.com with ESMTPS id l31sm2792901rvb.2.2008.10.20.23.14.21
	(version=TLSv1/SSLv3 cipher=RC4-MD5);
	Mon, 20 Oct 2008 23:14:23 -0700 (PDT)
Received: from michelle.cdnetworks.co.kr (localhost.cdnetworks.co.kr
	[127.0.0.1])
	by michelle.cdnetworks.co.kr (8.13.5/8.13.5) with ESMTP id
	m9L6CMfm044300
	(version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO);
	Tue, 21 Oct 2008 15:12:22 +0900 (KST)
	(envelope-from pyunyh@gmail.com)
Received: (from yongari@localhost)
	by michelle.cdnetworks.co.kr (8.13.5/8.13.5/Submit) id m9L6CLXZ044299; 
	Tue, 21 Oct 2008 15:12:21 +0900 (KST)
	(envelope-from pyunyh@gmail.com)
Date: Tue, 21 Oct 2008 15:12:21 +0900
From: Pyun YongHyeon <pyunyh@gmail.com>
To: Andriy Gapon <avg@icyb.net.ua>
Message-ID: <20081021061221.GI43039@cdnetworks.co.kr>
References: <47A3041D.5050402@icyb.net.ua>
	<20080201123603.GA14050@cdnetworks.co.kr>
	<47A321BB.1060708@icyb.net.ua> <47A32501.7080703@icyb.net.ua>
	<20080204035242.GA28554@cdnetworks.co.kr>
	<47C2BC50.5040702@icyb.net.ua> <47C2DBEF.301@icyb.net.ua>
	<20080226073633.GC47750@cdnetworks.co.kr>
	<486D440F.1090601@icyb.net.ua> <48FC7E8D.2000506@icyb.net.ua>
Mime-Version: 1.0
Content-Type: text/plain; charset=us-ascii
Content-Disposition: inline
In-Reply-To: <48FC7E8D.2000506@icyb.net.ua>
User-Agent: Mutt/1.4.2.1i
Cc: freebsd-stable@freebsd.org, yongari@freebsd.org
Subject: Re: 6.3 nfe: dead after system reset
X-BeenThere: freebsd-stable@freebsd.org
X-Mailman-Version: 2.1.5
Precedence: list
Reply-To: pyunyh@gmail.com
List-Id: Production branch of FreeBSD source code <freebsd-stable.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-stable>, 
	<mailto:freebsd-stable-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-stable>
List-Post: <mailto:freebsd-stable@freebsd.org>
List-Help: <mailto:freebsd-stable-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-stable>,
	<mailto:freebsd-stable-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Tue, 21 Oct 2008 06:14:26 -0000

On Mon, Oct 20, 2008 at 03:50:21PM +0300, Andriy Gapon wrote:
 > 
 > Pyun,
 > 
 > something new about this issue.
 > Today I got another instance of it, but with a new twist.
 > In addition to all the usual symptoms I got a lot of messages like the
 > following in console:
 > 
 > nfe0: discard frame w/o leading ethernet header (len 0 pkt len 0)
 > and even couple like this:
 > 
 > nfe0: discard frame w/o leading ethernet header (len 4294967295 pkt len
 > 4294967295)
 > nfe0: discard frame w/o leading ethernet header (len 3 pkt len 3)
 > 
 > Maybe these messages could give a hint about what was going wrong in nfe.
 > 

It looks like there is a bug in Rx handling or hardware
initialization issue. Recently I've implemented hardware MAC
counters of MCP controller and these counters would provide
valuable information to analyze what's going on in controller.
See commit log of SVN r183561.
There is a WIP version to workaround CRC issues of MCP65. Though it
may not be directly related with your issue the patch at the 
fowllowing URL has a fix for MAC reset register. So give it try and
let me know how it goes.

http://people.freebsd.org/~yongari/nfe/nfe.rx.patch.20081021

 > on 04/07/2008 00:26 Andriy Gapon said the following:
 > > 
 > > As they say - long time, no see :-)
 > > I am back with some more details, but still with no insights.
 > > 
 > > Let me refresh an essence of the issue.
 > > The issue: after 'abrupt' reset/reboot of a system my nfe interface is
 > > dead.
 > > That is, if I do a graceful reboot (e.g. via shutdown -r) everything is
 > > ok, ditto if I do power-down (whether graceful or not) and the power-up.
 > > The problem happens only if I press reset button and then boot up.
 > > 
 > > Details.
 > > The issue can not be reproduced with nve driver.
 > > Moreover, when I reproduce the problem with nfe, then kldunload nfe
 > > driver, kldload nve driver - nve interface is alive. Then kldunload nve,
 > > kldload nfe - nfe interface is dead again.
 > > 
 > > Specification of dead.
 > > There are no errors. ifconfig shows the same output (active, media, up,
 > > etc) as in normal case. But I can not ping any host on local network
 > > (connected to the same switch), ping outputs "Host is down". tcpdump
 > > also doesn't show any incoming traffic.
 > > 
 > > More details.
 > > I was able to verify that packets do actually go through the interface.
 > > When I try to ping some machine I see (on the other host) arp requests
 > > for its ethernet address. All address in arp packets are correct
 > > (ethernet and ip). So the interface works for outgoing packets, but
 > > somehow loses incoming arp replies. Not sure if thap happens in the NIC
 > > or in the driver itself (see the above nve/nfe live replacement
 > > experiment).
 > > 
 > > So, there are some facts, but still no clues.
 > > 
 > 
 > 
 > -- 
 > Andriy Gapon

-- 
Regards,
Pyun YongHyeon