From owner-freebsd-stable@FreeBSD.ORG  Thu Jul  3 21:50:37 2008
Return-Path: <owner-freebsd-stable@FreeBSD.ORG>
Delivered-To: freebsd-stable@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34])
	by hub.freebsd.org (Postfix) with ESMTP id BF3181065676;
	Thu,  3 Jul 2008 21:50:37 +0000 (UTC)
	(envelope-from luigi@onelab2.iet.unipi.it)
Received: from onelab2.iet.unipi.it (onelab2.iet.unipi.it [131.114.9.129])
	by mx1.freebsd.org (Postfix) with ESMTP id 8A0C58FC15;
	Thu,  3 Jul 2008 21:50:37 +0000 (UTC)
	(envelope-from luigi@onelab2.iet.unipi.it)
Received: by onelab2.iet.unipi.it (Postfix, from userid 275)
	id 99E8A73087; Thu,  3 Jul 2008 23:35:17 +0200 (CEST)
Date: Thu, 3 Jul 2008 23:35:17 +0200
From: Luigi Rizzo <rizzo@iet.unipi.it>
To: Andriy Gapon <avg@icyb.net.ua>
Message-ID: <20080703213517.GA76155@onelab2.iet.unipi.it>
References: <47A3041D.5050402@icyb.net.ua>
	<20080201123603.GA14050@cdnetworks.co.kr>
	<47A321BB.1060708@icyb.net.ua> <47A32501.7080703@icyb.net.ua>
	<20080204035242.GA28554@cdnetworks.co.kr>
	<47C2BC50.5040702@icyb.net.ua> <47C2DBEF.301@icyb.net.ua>
	<20080226073633.GC47750@cdnetworks.co.kr>
	<486D440F.1090601@icyb.net.ua>
Mime-Version: 1.0
Content-Type: text/plain; charset=us-ascii
Content-Disposition: inline
In-Reply-To: <486D440F.1090601@icyb.net.ua>
User-Agent: Mutt/1.4.2.3i
Cc: pyunyh@gmail.com, freebsd-stable@freebsd.org, yongari@freebsd.org
Subject: Re: 6.3 nfe: dead after system reset
X-BeenThere: freebsd-stable@freebsd.org
X-Mailman-Version: 2.1.5
Precedence: list
List-Id: Production branch of FreeBSD source code <freebsd-stable.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-stable>, 
	<mailto:freebsd-stable-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-stable>
List-Post: <mailto:freebsd-stable@freebsd.org>
List-Help: <mailto:freebsd-stable-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-stable>,
	<mailto:freebsd-stable-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Thu, 03 Jul 2008 21:50:37 -0000

On Fri, Jul 04, 2008 at 12:26:39AM +0300, Andriy Gapon wrote:
> 
> As they say - long time, no see :-)
> I am back with some more details, but still with no insights.
> 
> Let me refresh an essence of the issue.
> The issue: after 'abrupt' reset/reboot of a system my nfe interface is dead.
> That is, if I do a graceful reboot (e.g. via shutdown -r) everything is 
> ok, ditto if I do power-down (whether graceful or not) and the power-up.
> The problem happens only if I press reset button and then boot up.
> 
> Details.
> The issue can not be reproduced with nve driver.
> Moreover, when I reproduce the problem with nfe, then kldunload nfe 
> driver, kldload nve driver - nve interface is alive. Then kldunload nve, 
> kldload nfe - nfe interface is dead again.
> 
> Specification of dead.
> There are no errors. ifconfig shows the same output (active, media, up, 
> etc) as in normal case. But I can not ping any host on local network 
> (connected to the same switch), ping outputs "Host is down". tcpdump 
> also doesn't show any incoming traffic.
> 
> More details.
> I was able to verify that packets do actually go through the interface. 
> When I try to ping some machine I see (on the other host) arp requests 
> for its ethernet address. All address in arp packets are correct 
> (ethernet and ip). So the interface works for outgoing packets, but 
> somehow loses incoming arp replies. Not sure if thap happens in the NIC 
> or in the driver itself (see the above nve/nfe live replacement experiment).

these symptoms (outgoing traffic is ok, incoming not received)
are similar to what i see in other conditions on my machine, see

http://www.mavetju.org/mail/view_message.php?list=freebsd-net&id=2730309

it is interesting that if_nve works ok, maybe we can compare the
two drivers and see if they initialize the device in different
ways (or test for receive interrupts in different ways)

cheers
luigi