From owner-freebsd-net@FreeBSD.ORG Wed Mar 5 02:19:01 2014 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 39E3DB06 for ; Wed, 5 Mar 2014 02:19:01 +0000 (UTC) Received: from mho-02-ewr.mailhop.org (mho-02-ewr.mailhop.org [204.13.248.72]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id EC83BD98 for ; Wed, 5 Mar 2014 02:19:00 +0000 (UTC) Received: from pool-71-174-185-176.bstnma.east.verizon.net ([71.174.185.176] helo=homobox.opal.com) by mho-02-ewr.mailhop.org with esmtpsa (TLSv1:AES256-SHA:256) (Exim 4.72) (envelope-from ) id 1WL1QB-000KUP-Gd for freebsd-net@freebsd.org; Wed, 05 Mar 2014 02:18:59 +0000 Received: from shibato (shibato.opal.com [IPv6:2001:470:8cb8:4:221:63ff:fe5a:c9a7]) (authenticated bits=0) by homobox.opal.com (8.14.7/8.14.7) with ESMTP id s252Itiw003062 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES128-SHA bits=128 verify=NO) for ; Tue, 4 Mar 2014 21:18:55 -0500 (EST) (envelope-from fbsd@opal.com) X-Mail-Handler: Dyn Standard SMTP by Dyn X-Originating-IP: 71.174.185.176 X-Report-Abuse-To: abuse@dyndns.com (see http://www.dyndns.com/services/sendlabs/outbound_abuse.html for abuse reporting information) X-MHO-User: U2FsdGVkX1+vNYyLhy87p9b1UDGjZXXK Date: Tue, 4 Mar 2014 21:18:55 -0500 From: "J.R. Oldroyd" To: freebsd-net@freebsd.org Subject: Link DOWN/UP on RealTek 8169SC/8110SC <-> 8168/8111 Message-ID: <20140304211855.539990f9@shibato> X-Mailer: Claws Mail 3.9.3 (GTK+ 2.24.22; amd64-portbld-freebsd9.1) MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit X-Greylist: Sender succeeded SMTP AUTH, not delayed by milter-greylist-4.4.3 (homobox.opal.com [IPv6:2001:470:8cb8:4::1]); Tue, 04 Mar 2014 21:18:55 -0500 (EST) X-Spam-Status: No, score=-0.1 required=5.0 tests=ALL_TRUSTED,AWL,BAYES_50, RP_MATCHES_RCVD shortcircuit=no autolearn=no version=3.3.2 X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on homobox.opal.com X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 05 Mar 2014 02:19:01 -0000 I'm having the "link state changed to DOWN/UP" problem on a GigE link between two FreeBSD re(4) devices. Both systems are releng/10.0. It is flapping a lot... as much as several times a minute. The link is down for 3 seconds, when it comes up dhclient takes a bit longer to re-init the IP. It is pretty much unusable most of the time! One end is a 8169SC/8110SC (RL_HWREV_8169_8110SC), the other end is a 8168/8111 (RL_HWREV_8168D). dmesg, devinfo and ifconfig for both ends follows. I've tried adding the RL_FLAG_PHYWAKE_PM flag on the 8169SC/8110SC device as was suggested before in similar discussions. No help. I don't have the technical docs (they require an NDA to download) so it was a guess anyway. Any suggestions for how to fix? They work just fine at 100baseTX. Thanks, -jr # dmesg | grep re1 re1: port 0xe800-0xe8ff mem 0xfebffc00-0xfebffcff irq 18 at device 4.0 on pci4 re1: Chip rev. 0x18000000 re1: MAC rev. 0x00000000 miibus1: on re1 re1: Ethernet address: 00:30:18:a5:5e:6c re1: link state changed to DOWN re1: link state changed to UP re1: link state changed to DOWN re1: link state changed to UP re1: link state changed to DOWN re1: link state changed to UP re1: watchdog timeout re1: link state changed to DOWN re1: link state changed to UP re1: link state changed to DOWN re1: link state changed to UP re1: link state changed to DOWN re1: link state changed to UP re1: link state changed to DOWN re1: link state changed to UP # devinfo -rv | grep re1 re1 pnpinfo vendor=0x10ec device=0x8167 subvendor=0x10ec subdevice=0x8167 class=0x020000 at slot=4 function=0 # devinfo -rv | grep rgephy1 rgephy1 pnpinfo oui=0xe04c model=0x11 rev=0x2 at phyno=1 # ifconfig re1 re1: flags=8843 metric 0 mtu 7418 options=8209b ether 00:30:18:a5:5e:6c inet 192.168.1.1 netmask 0xffffff00 broadcast 192.168.1.255 inet6 fe80::230:18ff:fea5:5e6c%re1 prefixlen 64 scopeid 0x3 inet6 2001:xxx:xxxx:1:230:18ff:fea5:5e6c prefixlen 64 inet6 2001:xxx:xxxx:1::1 prefixlen 64 nd6 options=21 media: Ethernet autoselect (1000baseT ) status: active # dmesg | grep re0 re0: port 0xe800-0xe8ff mem 0xfdfff000-0xfdffffff,0xfdff8000-0xfdffbfff irq 18 at device 0.0 on pci4 re0: Using 1 MSI-X message re0: Chip rev. 0x28000000 re0: MAC rev. 0x00300000 miibus0: on re0 re0: Ethernet address: e0:cb:4e:5b:27:b6 re0: link state changed to DOWN re0: link state changed to UP re0: link state changed to DOWN re0: link state changed to UP re0: link state changed to DOWN re0: link state changed to UP re0: link state changed to DOWN re0: link state changed to UP re0: link state changed to DOWN re0: link state changed to UP re0: link state changed to DOWN re0: link state changed to UP re0: link state changed to DOWN re0: link state changed to UP # devinfo -rv | grep re0 re0 pnpinfo vendor=0x10ec device=0x8168 subvendor=0x1043 subdevice=0x83a3 class=0x020000 a # devinfo -rv | grep rgephy0 rgephy0 pnpinfo oui=0xe04c model=0x11 rev=0x2 at phyno=1 # ifconfig re0 re0: flags=8843 metric 0 mtu 7418 options=82098 ether e0:cb:4e:5b:27:b6 inet6 fe80::e2cb:4eff:fe5b:27b6%re0 prefixlen 64 scopeid 0x1 inet6 2001:xxx:xxxx:1:e2cb:4eff:fe5b:27b6 prefixlen 64 autoconf inet 192.168.1.2 netmask 0xffffff00 broadcast 192.168.1.255 nd6 options=23 media: Ethernet autoselect (1000baseT ) status: active