From owner-freebsd-net@freebsd.org Mon Sep 14 18:53:06 2015 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 0FE1EA04748 for ; Mon, 14 Sep 2015 18:53:06 +0000 (UTC) (envelope-from gondim@bsdinfo.com.br) Received: from mail.bsdinfo.com.br (mail.bsdinfo.com.br [191.243.120.163]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id ACF671892 for ; Mon, 14 Sep 2015 18:53:05 +0000 (UTC) (envelope-from gondim@bsdinfo.com.br) Received: from mail.bsdinfo.com.br (mail.bsdinfo.com.br [127.0.0.1]) by mail.bsdinfo.com.br (Postfix) with ESMTP id AC96430FCAF for ; Mon, 14 Sep 2015 15:51:57 -0300 (BRT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=bsdinfo.com.br; h=content-transfer-encoding:content-type:content-type :in-reply-to:references:subject:subject:to:mime-version :user-agent:from:from:date:date:message-id; s=dkim; t= 1442256716; x=1443120717; bh=+nOIH0aQhnyZAjsZUwtSij4IHcRdAuW43aE ZpYFaj7I=; b=LD8uf/hn5TMaPMIgv4qYp4CFmyOvatRb+umM1yI96Ntz7D1C2vt 5qRNbV38GQ3ZMzaYzvAXjDo/sJJWBPiKewhycTff0W7P2JJHL5ve0htDw3T6CgqW CmEtdwegRTzDKb2lrKKexV3PYy6Qf7Y+HIYLTGWtGEB+5TmV38OASGwM= X-Virus-Scanned: amavisd-new at mail.bsdinfo.com.br Received: from mail.bsdinfo.com.br ([127.0.0.1]) by mail.bsdinfo.com.br (mail.bsdinfo.com.br [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id ZGHi1IcD9cPx for ; Mon, 14 Sep 2015 15:51:56 -0300 (BRT) Received: from [192.168.88.29] (unknown [10.255.0.12]) by mail.bsdinfo.com.br (Postfix) with ESMTPSA id 8125030FCB0 for ; Mon, 14 Sep 2015 15:51:56 -0300 (BRT) Message-ID: <55F71710.4010001@bsdinfo.com.br> Date: Mon, 14 Sep 2015 15:50:56 -0300 From: Marcelo Gondim User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Icedove/31.8.0 MIME-Version: 1.0 To: FreeBSD Net Subject: Re: Possible LACP problem with FreeBSD 10.2-RELEASE and Juniper MX5 References: <55F1A095.6010001@bsdinfo.com.br> <55F2005A.1020904@bsdinfo.com.br> In-Reply-To: <55F2005A.1020904@bsdinfo.com.br> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 14 Sep 2015 18:53:06 -0000 On 10-09-2015 19:12, Marcelo Gondim wrote: > On 10-09-2015 12:24, Marcelo Gondim wrote: >> Hi All, >> >> We have a router configured with 2 LACP (lagg0 and lagg1): >> >> lagg0: flags=8843 metric 0 >> mtu 1500 >> options=403bb >> >> ether 00:1b:21:7b:ee:98 >> inet6 fe80::21b:21ff:fe7b:ee98%lagg0 prefixlen 64 scopeid 0x12 >> nd6 options=21 >> media: Ethernet autoselect >> status: active >> laggproto lacp lagghash l2,l3,l4 >> laggport: igb6 flags=1c >> laggport: igb7 flags=1c >> >> lagg1: flags=8843 metric 0 >> mtu 1500 >> options=403bb >> >> ether 00:1b:21:7b:ee:6c >> inet 189.xxx.xxx.34 netmask 0xfffffffc broadcast 189.113.78.35 >> inet6 fe80::21b:21ff:fe7b:ee6c%lagg1 prefixlen 64 scopeid 0xf >> inet6 2804:56c:0:8::2 prefixlen 64 >> nd6 options=21 >> media: Ethernet autoselect >> status: active >> laggproto lacp lagghash l2,l3,l4 >> laggport: igb4 flags=1c >> laggport: igb5 flags=1c >> >> When my Internet traffic is high at night, my BGP session in lagg1 is >> giving up and down 4 in 4 minutes. >> After upgraded to FreeBSD 2.10-RELEASE-p2, this problem started. >> Before we were using the FreeBSD 10.1-STABLE r281235 without any >> problem. >> >> The log have the following messages: >> >> /var/log/messages:Sep 9 19:21:43 rt01 kernel: igb5: Interface >> stopped DISTRIBUTING, possible flapping >> /var/log/messages:Sep 9 19:21:44 rt01 kernel: igb4: Interface >> stopped DISTRIBUTING, possible flapping >> /var/log/messages:Sep 9 19:27:01 rt01 kernel: igb5: Interface >> stopped DISTRIBUTING, possible flapping >> /var/log/messages:Sep 9 19:27:01 rt01 kernel: igb4: Interface >> stopped DISTRIBUTING, possible flapping >> /var/log/messages:Sep 9 19:29:13 rt01 kernel: igb5: Interface >> stopped DISTRIBUTING, possible flapping >> /var/log/messages:Sep 9 19:29:14 rt01 kernel: igb4: Interface >> stopped DISTRIBUTING, possible flapping >> /var/log/messages:Sep 9 19:46:10 rt01 kernel: igb5: Interface >> stopped DISTRIBUTING, possible flapping >> /var/log/messages:Sep 9 19:46:11 rt01 kernel: igb4: Interface >> stopped DISTRIBUTING, possible flapping >> /var/log/messages:Sep 9 20:01:02 rt01 kernel: igb4: Interface >> stopped DISTRIBUTING, possible flapping >> /var/log/messages:Sep 9 20:01:03 rt01 kernel: igb5: Interface >> stopped DISTRIBUTING, possible flapping >> /var/log/messages:Sep 9 20:02:08 rt01 kernel: igb5: Interface >> stopped DISTRIBUTING, possible flapping >> /var/log/messages:Sep 9 20:02:09 rt01 kernel: igb4: Interface >> stopped DISTRIBUTING, possible flapping >> /var/log/messages:Sep 9 20:03:54 rt01 kernel: igb5: Interface >> stopped DISTRIBUTING, possible flapping >> /var/log/messages:Sep 9 20:03:57 rt01 kernel: igb4: Interface >> stopped DISTRIBUTING, possible flapping >> /var/log/messages:Sep 9 20:07:05 rt01 kernel: igb5: Interface >> stopped DISTRIBUTING, possible flapping >> /var/log/messages:Sep 9 20:07:06 rt01 kernel: igb4: Interface >> stopped DISTRIBUTING, possible flapping >> /var/log/messages:Sep 9 20:20:49 rt01 kernel: igb5: Interface >> stopped DISTRIBUTING, possible flapping >> /var/log/messages:Sep 9 20:20:50 rt01 kernel: igb4: Interface >> stopped DISTRIBUTING, possible flapping >> /var/log/messages:Sep 9 20:25:39 rt01 kernel: igb4: Interface >> stopped DISTRIBUTING, possible flapping >> /var/log/messages:Sep 9 20:25:40 rt01 kernel: igb5: Interface >> stopped DISTRIBUTING, possible flapping >> /var/log/messages:Sep 9 20:28:55 rt01 kernel: igb5: Interface >> stopped DISTRIBUTING, possible flapping >> /var/log/messages:Sep 9 20:28:56 rt01 kernel: igb4: Interface >> stopped DISTRIBUTING, possible flapping >> /var/log/messages:Sep 9 20:31:39 rt01 kernel: igb5: Interface >> stopped DISTRIBUTING, possible flapping >> /var/log/messages:Sep 9 20:31:39 rt01 kernel: igb4: Interface >> stopped DISTRIBUTING, possible flapping >> /var/log/messages:Sep 9 20:33:29 rt01 kernel: igb4: Interface >> stopped DISTRIBUTING, possible flapping >> /var/log/messages:Sep 9 20:33:30 rt01 kernel: igb5: Interface >> stopped DISTRIBUTING, possible flapping >> /var/log/messages:Sep 9 21:03:38 rt01 kernel: igb5: Interface >> stopped DISTRIBUTING, possible flapping >> /var/log/messages:Sep 9 21:03:38 rt01 kernel: igb4: Interface >> stopped DISTRIBUTING, possible flapping >> /var/log/messages:Sep 9 21:09:39 rt01 kernel: igb5: Interface >> stopped DISTRIBUTING, possible flapping >> /var/log/messages:Sep 9 21:09:39 rt01 kernel: igb4: Interface >> stopped DISTRIBUTING, possible flapping >> /var/log/messages:Sep 9 21:20:51 rt01 kernel: igb5: Interface >> stopped DISTRIBUTING, possible flapping >> /var/log/messages:Sep 9 21:20:52 rt01 kernel: igb4: Interface >> stopped DISTRIBUTING, possible flapping >> /var/log/messages:Sep 9 21:25:24 rt01 kernel: igb5: Interface >> stopped DISTRIBUTING, possible flapping >> /var/log/messages:Sep 9 21:25:25 rt01 kernel: igb4: Interface >> stopped DISTRIBUTING, possible flapping >> /var/log/messages:Sep 9 21:36:22 rt01 kernel: igb5: Interface >> stopped DISTRIBUTING, possible flapping >> /var/log/messages:Sep 9 21:36:23 rt01 kernel: igb4: Interface >> stopped DISTRIBUTING, possible flapping >> /var/log/messages:Sep 9 21:39:26 rt01 kernel: igb5: Interface >> stopped DISTRIBUTING, possible flapping >> /var/log/messages:Sep 9 21:39:27 rt01 kernel: igb4: Interface >> stopped DISTRIBUTING, possible flapping >> /var/log/messages:Sep 9 21:47:40 rt01 kernel: igb5: Interface >> stopped DISTRIBUTING, possible flapping >> /var/log/messages:Sep 9 21:47:40 rt01 kernel: igb4: Interface >> stopped DISTRIBUTING, possible flapping >> /var/log/messages:Sep 9 21:52:19 rt01 kernel: igb5: Interface >> stopped DISTRIBUTING, possible flapping >> /var/log/messages:Sep 9 21:52:19 rt01 kernel: igb4: Interface >> stopped DISTRIBUTING, possible flapping >> /var/log/messages:Sep 9 21:53:01 rt01 kernel: igb5: Interface >> stopped DISTRIBUTING, possible flapping >> /var/log/messages:Sep 9 21:53:01 rt01 kernel: igb4: Interface >> stopped DISTRIBUTING, possible flapping >> /var/log/messages:Sep 9 21:58:53 rt01 kernel: igb5: Interface >> stopped DISTRIBUTING, possible flapping >> /var/log/messages:Sep 9 21:58:53 rt01 kernel: igb4: Interface >> stopped DISTRIBUTING, possible flapping >> >> Has there been any change in the LACP, during this period, which >> could be causing this problem? >> I'm doing a downgrade in our system to see if this problem happen >> tonight. > Confirmed. I did downgrade the system to 10.1-STABLE r281235 and the > problem stopped happening. > Some change occurred between 10.1-STABLE r281235 and 10.2-RELEASE-p2 > causing this problem in the system. > In about seven days, I will be putting Intel X520-SR2 interfaces on my system and will no longer be necessary to use lagg. Not be able to patch test any more. Below the PR open: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=203031 Thanks and best regards,