From owner-freebsd-net@FreeBSD.ORG  Fri Oct 28 21:14:17 2005
Return-Path: <owner-freebsd-net@FreeBSD.ORG>
X-Original-To: freebsd-net@freebsd.org
Delivered-To: freebsd-net@freebsd.org
Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125])
	by hub.freebsd.org (Postfix) with ESMTP id 449B416A41F
	for <freebsd-net@freebsd.org>; Fri, 28 Oct 2005 21:14:17 +0000 (GMT)
	(envelope-from craig@olyun.gank.org)
Received: from ion.gank.org (ion.gank.org [69.55.238.164])
	by mx1.FreeBSD.org (Postfix) with ESMTP id 0EA0F43D45
	for <freebsd-net@freebsd.org>; Fri, 28 Oct 2005 21:14:16 +0000 (GMT)
	(envelope-from craig@olyun.gank.org)
Received: by ion.gank.org (mail, from userid 1001)
	id 9212A2D060; Fri, 28 Oct 2005 16:14:16 -0500 (CDT)
Date: Fri, 28 Oct 2005 16:14:16 -0500
From: Craig Boston <craig@olyun.gank.org>
To: SUZUKI Shinsuke <suz@kame.net>
Message-ID: <20051028211416.GA59989@nowhere>
References: <20051028012957.GA50419@nowhere> <x7wtjynvlm.wl%suz@alaxala.net>
	<20051028040901.GA47012@nowhere>
	<x7u0f2nm7q.wl%suz@alaxala.net> <x7r7a5of6y.wl%suz@alaxala.net>
Mime-Version: 1.0
Content-Type: text/plain; charset=us-ascii
Content-Disposition: inline
In-Reply-To: <x7r7a5of6y.wl%suz@alaxala.net>
User-Agent: Mutt/1.4.2.1i
Cc: freebsd-net@freebsd.org
Subject: Re: 6.0-RC1 IPv6 losing local subnet route
X-BeenThere: freebsd-net@freebsd.org
X-Mailman-Version: 2.1.5
Precedence: list
List-Id: Networking and TCP/IP with FreeBSD <freebsd-net.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-net>,
	<mailto:freebsd-net-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-net>
List-Post: <mailto:freebsd-net@freebsd.org>
List-Help: <mailto:freebsd-net-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-net>,
	<mailto:freebsd-net-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Fri, 28 Oct 2005 21:14:17 -0000

On Sat, Oct 29, 2005 at 12:04:53AM +0900, SUZUKI Shinsuke wrote:
> I tried the same test using my PC with fxp drivers, but your phenomena
> did not happen in my environment (at least for five hours).
> 
> Maybe the configured prefix was regarded as off-link by some reason.
> (it is theoretically possible in IPv6, but I'm not sure whether it
> really happens in your case)

I don't think this is the case, ndp looks normal:

2002:abcd:ef01:5555::/64 if=em1
flags=LO vltime=infinity, pltime=infinity, expire=Never, ref=0
  No advertising router
[ followed by a whole bunch of link local addresses from all my vlans on
a different interface ]

However, I think I've isolated the trigger.  I noticed that on bootup,
the route was _always_ missing.  There was also duplicate ifconfig
output -- once from rc.d/netif and once from devd upon getting "link
up".

Knowing that, I can cause it to happen on command by manually
re-configuring an interface with an address it already has:

With em1 up but not configured yet:

# ifconfig em1 inet6 2002:abcd:ef01:5555::20
(routes are all normal)

# ifconfig em1 inet6 2002:abcd:ef01:5555::20
(prefix route disappears)

It's also been a lot more stable today than yesterday.  However
yesterday I was moving some cables around so there were lots of link
down / up events.  My guess is that devd was dutifully reconfiguring the
interface on link up and causing the random drops.

There is a slight delay between the second ifconfig and the route
disappearing -- less than 0.5s.  During that window I managed to capture
the following seemingly inconsistent output fron ndp -p:

2002:abcd:ef01:5555::/64 if=em1
flags=LO vltime=infinity, pltime=infinity, expired, ref=0
  No advertising router

-- Craig