From owner-freebsd-net@FreeBSD.ORG Fri Apr 4 09:51:33 2014 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id AE5C51B6 for ; Fri, 4 Apr 2014 09:51:33 +0000 (UTC) Received: from mail-la0-f50.google.com (mail-la0-f50.google.com [209.85.215.50]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 24B877BA for ; Fri, 4 Apr 2014 09:51:32 +0000 (UTC) Received: by mail-la0-f50.google.com with SMTP id pv20so2333656lab.9 for ; Fri, 04 Apr 2014 02:51:24 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:content-type:mime-version:subject:from :in-reply-to:date:cc:content-transfer-encoding:message-id:references :to; bh=VOicdCnivV4ZwFLYV8uThhyaISgOqO4eBp6Q7wMMp3o=; b=OnyEQ8UfEOH8sf5QOs37d8XqvGMJGyl6bBlSqIqmSxEfO9bOktrUwXmMA1PamQXKn9 8YBdtc+yOxE+nrzNd5PRlSqY/tHqy58HtfJTpVUvgYWWmwlEzK2S5k1VSJV7fmd96ZS7 syZ2pQ1sWOCHSO+H0k1lc3dmXJpFU7u2myusgDwZ/PYaRWeXJZb30TsB5Az/UeKMHBXK bSAQjAKljsAawkp3+jB27uP9cjiTKlLNhbqpLV2fWIcWGk9I3WeGHqe9lwnLBf3B8rRv wU13+Vsgu07bT18o64mxPj/1BaUqzgoyHheFRnYk9Di10sinnltomXCF6XjogfeexPrN logg== X-Gm-Message-State: ALoCoQnU5qlVI0egLeiJjRMoB5NKN5lr784oIQjg6jcn9y+MYBPYC3BABqfBk+fTEeXq/qhKn27p X-Received: by 10.152.18.229 with SMTP id z5mr7962493lad.27.1396605084090; Fri, 04 Apr 2014 02:51:24 -0700 (PDT) Received: from grey.office.se.prisjakt.nu ([212.16.170.194]) by mx.google.com with ESMTPSA id j2sm7410456lag.12.2014.04.04.02.51.22 for (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Fri, 04 Apr 2014 02:51:23 -0700 (PDT) Content-Type: text/plain; charset=windows-1252 Mime-Version: 1.0 (Mac OS X Mail 7.2 \(1874\)) Subject: Re: LACP lagg and CARP - ENETDOWN (was: FreeBSD 10-STABLE and CARP states) From: mxb In-Reply-To: <1E20234E-4F81-4BA1-BA57-FADD80F782F4@alumni.chalmers.se> Date: Fri, 4 Apr 2014 11:51:28 +0200 Content-Transfer-Encoding: quoted-printable Message-Id: References: <4A818132-757F-4BAD-8137-CDB1F6F0681C@alumni.chalmers.se> <1E20234E-4F81-4BA1-BA57-FADD80F782F4@alumni.chalmers.se> To: freebsd-net@freebsd.org X-Mailer: Apple Mail (2.1874) Cc: freebsd-pf@freebsd.org X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 04 Apr 2014 09:51:33 -0000 According my own research around this problem ip_output() at line 839 of ip_carp.c returns ENETDOWN then lagg is = configured in LACP mode. On 2 apr 2014, at 15:13, mxb wrote: >=20 > OK, thanks everyone whom replayed. E.g. NONE. >=20 > The problem seems to be related to LACP trunking. > Disabling LACP and configuring trunk in =91loadbalance=92 mode puts = all in desired state (even after reboot). >=20 > lagg0: flags=3D8943 = metric 0 mtu 9000 > = options=3D8407bb > ether 00:25:90:e3:71:f2 > inet 172.16.0.234 netmask 0xfffff800 broadcast 172.16.7.255 > inet6 fe80::225:90ff:fee3:71f2%lagg0 prefixlen 64 scopeid 0x5 > inet 172.16.0.231 netmask 0xfffff800 broadcast 172.16.7.255 vhid = 201 > inet 172.16.0.233 netmask 0xfffff800 broadcast 172.16.7.255 vhid = 202 > nd6 options=3D29 > media: Ethernet autoselect > status: active > carp: MASTER vhid 201 advbase 1 advskew 1 > carp: BACKUP vhid 202 advbase 5 advskew 100 > laggproto loadbalance lagghash l2,l3,l4 > laggport: ix1 flags=3D4 > laggport: ix0 flags=3D4 > vlan2: flags=3D8943 = metric 0 mtu 9000 > options=3D303 > ether 00:25:90:e3:71:f2 > inet 10.11.11.201 netmask 0xffffff00 broadcast 10.11.11.255 > inet6 fe80::225:90ff:fee3:71f2%vlan2 prefixlen 64 scopeid 0x6 > inet 10.11.12.203 netmask 0xffffff00 broadcast 10.11.12.255 vhid = 12 > nd6 options=3D29 > media: Ethernet autoselect > status: active > vlan: 2 parent interface: lagg0 > carp: BACKUP vhid 12 advbase 1 advskew 100 >=20 > //mxb >=20 > On 2 apr 2014, at 09:35, mxb wrote: >=20 >>=20 >> Moving this to freebsd-pf. >>=20 >> On 31 mar 2014, at 22:21, mxb wrote: >>=20 >>>=20 >>> Manually setting net.inet.carp.demotion brought BOTH VHIDs in = desired state. >>> pfsync bulk update seems to not put everything back as it should. >>>=20 >>> lagg0: flags=3D8943 = metric 0 mtu 9000 >>> = options=3D8407bb >>> ether 00:25:90:e3:71:f2 >>> inet 172.16.0.234 netmask 0xfffff800 broadcast 172.16.7.255 >>> inet6 fe80::225:90ff:fee3:71f2%lagg0 prefixlen 64 scopeid 0x5 >>> inet 172.16.0.231 netmask 0xfffff800 broadcast 172.16.7.255 vhid = 201 >>> inet 172.16.0.233 netmask 0xfffff800 broadcast 172.16.7.255 vhid = 202 >>> nd6 options=3D29 >>> media: Ethernet autoselect >>> status: active >>> carp: MASTER vhid 201 advbase 1 advskew 1 >>> carp: BACKUP vhid 202 advbase 5 advskew 100 >>> laggproto lacp lagghash l2,l3,l4 >>> laggport: ix1 flags=3D1c >>> laggport: ix0 flags=3D1c >>>=20 >>>=20 >>> On 31 mar 2014, at 20:42, mxb wrote: >>>=20 >>>>=20 >>>> Hi list, >>>>=20 >>>> hopefully this is the right place to have my question regarding = CARP on 10-STABLE. >>>>=20 >>>> I have two nodes with following setup(node1): >>>>=20 >>>> lagg0: flags=3D8943 = metric 0 mtu 9000 >>>> = options=3D8407bb >>>> ether 00:25:90:e3:71:f2 >>>> inet 172.16.0.234 netmask 0xfffff800 broadcast 172.16.7.255 >>>> inet6 fe80::225:90ff:fee3:71f2%lagg0 prefixlen 64 scopeid 0x5 >>>> inet 172.16.0.231 netmask 0xfffff800 broadcast 172.16.7.255 vhid = 201 >>>> inet 172.16.0.233 netmask 0xfffff800 broadcast 172.16.7.255 vhid = 202 >>>> nd6 options=3D29 >>>> media: Ethernet autoselect >>>> status: active >>>> carp: BACKUP vhid 201 advbase 1 advskew 1 >>>> carp: BACKUP vhid 202 advbase 5 advskew 100 >>>> laggproto lacp lagghash l2,l3,l4 >>>> laggport: ix1 flags=3D1c >>>> laggport: ix0 flags=3D1c >>>>=20 >>>> net.inet.carp.preempt=3D1 on both nodes. as well as PSYNC as this: >>>>=20 >>>> pfsync0: flags=3D41 metric 0 mtu 1500 >>>> pfsync: syncdev: vlan22 syncpeer: 10.22.22.2 maxupd: 128 defer: = off >>>>=20 >>>> The problem is (if it is not clear from the ifconfig-output for the = lagg0) the state of VHID 201. >>>> Node2 with advskew of 100 is currently MASTER, but it SHOULD NOT as = of setup. >>>>=20 >>>> Am I hitting a bug or doing something wrong? >>>>=20 >>>> I also have noted that after the pfsync bulk update the demotion = counter never setts to 0, but stays on 480, >>>> thus preventing node1 become a MASTER 201(?). Or is this a normal = behavior? >>>>=20 >>>> Regards, >>>> mxb >>>>=20 >>>>=20 >>>=20 >>=20 >=20