Skip site navigation (1)Skip section navigation (2)
Date:      Wed, 14 Mar 2018 08:09:28 +0700
From:      Eugene Grosbein <eugen@grosbein.net>
To:        Rob Hutton <justlikeef@gmail.com>, freebsd-net@freebsd.org
Subject:   Re: Cisco shows LACP not enabled on 11.1U2, BCM 57810S-t, 2960X IOS 15.2
Message-ID:  <5AA87648.5060604@grosbein.net>
In-Reply-To: <CAGWgwrOUx2eE1k6THCZ8hoeb3U=fPd5U1SL7G5bpfBUCQQH4BA@mail.gmail.com>
References:  <CAGWgwrOUx2eE1k6THCZ8hoeb3U=fPd5U1SL7G5bpfBUCQQH4BA@mail.gmail.com>

next in thread | previous in thread | raw e-mail | index | archive | help
14.03.2018 1:28, Rob Hutton wrote:

> Trying to get to a LACP Trunk config working on FreeNAS, but I'm not sure
> if this is an upstream issue.  First step is just LACP bundle in edge mode
> (no vlans) and bundle will not form.  The FreeNAS side shows it as being
> active.  The switch is reporting that LACP is not enabled on the individual
> ports.  We have tried multiple versions of IOS from 15.0 to 15.2(6)E1.  I
> have about 10 windows servers with the same NICs on the same switch that
> are negotiating LACP successfully as well as tagging vlans, so the hardware
> pieces seem to be OK.  I have tried configuring from both the GUI and the
> CL with the same result.
> 
> Cisco 2960X
> 
> switch config:
> interface Port-channel10
> switchport access vlan 1900
> switchport mode access
> !
> interface GigabitEthernet1/0/27
> switchport access vlan 1900
> switchport mode access
> channel-group 10 mode active
> !
> interface GigabitEthernet1/0/28
> switchport access vlan 1900
> switchport mode access
> channel-group 10 mode active
> 
> logs from switch:
> Mar 13 17:38:09.626: %LINK-3-UPDOWN: Interface GigabitEthernet1/0/27,
> changed state to up
> Mar 13 17:38:09.665: %LINK-3-UPDOWN: Interface GigabitEthernet1/0/28,
> changed state to up
> Mar 13 17:38:15.753: %EC-5-L3DONTBNDL2: Gi1/0/28 suspended: LACP currently
> not enabled on the remote port.
> Mar 13 17:38:16.005: %EC-5-L3DONTBNDL2: Gi1/0/27 suspended: LACP currently
> not enabled on the remote port.
> 
> Switch#sh etherc summ
> Flags:  D - down P - bundled in port-channel
> I - stand-alone s - suspended
> H - Hot-standby (LACP only)
> R - Layer3   S - Layer2
> U - in use   N - not in use, no aggregation
> f - failed to allocate aggregator
> 
> M - not in use, minimum links not met
> m - not in use, port not aggregated due to minimum links not met
> u - unsuitable for bundling
> w - waiting to be aggregated
> d - default port
> 
> A - formed by Auto LAG
> 
> 
> Number of channel-groups in use: 1
> Number of aggregators:    1
> 
> Group  Port-channel  Protocol Ports
> ------+-------------+-----------+-----------------------------------------------
> 10  Po10(SD) LACP   Gi1/0/27(w) Gi1/0/28(w)
> 
> Switch#sh int gi1/0/27
> GigabitEthernet1/0/27 is up, line protocol is down (notconnect)
> 
> Switch#sh int gi1/0/28
> GigabitEthernet1/0/28 is up, line protocol is down (notconnect)
> 
> 
> FreeNAS
> ifconfig
> 
> bxe0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
>    options=527bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSU
> M,TSO4,TSO6,LRO,WOL_MAGIC,VLAN_HWFILTER,VLAN_HWTSO>
>    ether 00:0e:1e:86:7c:70
>    hwaddr 00:0e:1e:86:7c:70
>    nd6 options=9<PERFORMNUD,IFDISABLED>
>    media: Ethernet autoselect (10Gbase-T <full-duplex>)
>    status: active
> 
> bxe1: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
>    options=527bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSU
> M,TSO4,TSO6,LRO,WOL_MAGIC,VLAN_HWFILTER,VLAN_HWTSO>
>    ether 00:0e:1e:86:7c:70
>    hwaddr 00:0e:1e:86:7c:72
>    nd6 options=9<PERFORMNUD,IFDISABLED>
>    media: Ethernet autoselect (10Gbase-T <full-duplex>)
>    status: active
> 
> lagg0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
>    options=527bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSU
> M,TSO4,TSO6,LRO,WOL_MAGIC,VLAN_HWFILTER,VLAN_HWTSO>
>    ether 00:0e:1e:86:7c:70
>    nd6 options=9<PERFORMNUD,IFDISABLED>
>    media: Ethernet autoselect
>    status: active
>    groups: lagg
>    laggproto lacp lagghash l2,l3,l4
>    laggport: bxe0 flags=0<>
>    laggport: bxe1 flags=0<>
> 
> Last edited: 12 minutes ago

See also: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=213606

In short: bxe(4) driver fails to setup hardware so it would receive incoming
multicast LACP frames unless switched to promisc. mode.

For now, replace the NIC with one from distinct manufacturer (Intel etc.)




Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?5AA87648.5060604>