Skip site navigation (1)Skip section navigation (2)
Date:      Fri, 26 Jun 2015 17:25:44 +0530
From:      Pushkar Kothavade <pushkar.kothavade@msystechnologies.com>
To:        freebsd-net@freebsd.org
Cc:        flewis@panasas.com, rtopannavar@panasas.com, sreen@panasas.com,  rpokala@panasas.com, lakshmi.n@msystechnologies.com,  "sr >> Tallam, Sreen" <sreen@panasas.com>, rpokala@panasas.com
Subject:   Re: Lagg-LACP is not working with Intel Fortville NIC on FreeBSD HOL (11.0 Current)
Message-ID:  <558D3DC0.8020703@msystechnologies.com>
In-Reply-To: <5582659F.6060900@msystechnologies.com>
References:  <557FD197.1020805@msystechnologies.com> <5582659F.6060900@msystechnologies.com>

next in thread | previous in thread | raw e-mail | index | archive | help
Dear Members,

To further narrow down the problem, I am evaluating single ixl link 
(Intel Fortville NIC) on FreeBSD platform.
Single ixl link is _NOT_ a part of Lagg.

*Issue*

Change in MAC address on a ixl (Intel Fortville NIC) link does not 
reflect on NIC.
Ping stops working after change in MAC address. Ping works, if PROMISC 
mode is set.

*Steps to reproduce the problem*

_/*# ifconfig ixl1*/_

ixl1: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 9000

options=6407bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,LRO,VLAN_HWTSO,RXCSUM_IPV6,TXCSUM_IPV6>

ether 68:05:ca:35:97:29

nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>

media: Ethernet autoselect (10Gbase-Twinax <full-duplex>)

status: active

_# ping XYZ/*/*
*/*/_Ping Works_/*/*
*/*/_
_/*# ifconfig ixl1 ether 58:04:89:12:34:56
*/_Assign new MAC to the link.

_# ping XYZ/*/*
*/*/_Ping does _NOT_ Work

*Bug Analysis*

While working on this issue, I found bug in the code.
Refer 'ixl_init_locked(struct ixl_pf *pf) function' present in 
'dev/ixl/if_ixl.c' file.

  1080         /* Get the latest mac address... User might use a LAA */
  1081         bcopy(IF_LLADDR(vsi->ifp), tmpaddr,
  1082               I40E_ETH_LENGTH_OF_ADDRESS);
* 1083         if (!cmp_etheraddr(hw->mac.addr, tmpaddr) && **
** 1084             i40e_validate_mac_addr(tmpaddr)) {*
  1085                 bcopy(tmpaddr, hw->mac.addr,
  1086                     I40E_ETH_LENGTH_OF_ADDRESS);
  1087                 ret = i40e_aq_mac_address_write(hw,
  1088                     I40E_AQC_WRITE_TYPE_LAA_ONLY,
  1089                     hw->mac.addr, NULL);
  1090                 if (ret) {
  1091                         device_printf(dev, "LLA address"
  1092                          "change failed!!\n");
  1093                         return;
  1094                 }
  1095         }

Refer lines 1083 & 1084 - '*i40e_validate_mac_addr(tmpaddr)*' function 
returns 0 on success.
Therefore 'i40e_aq_mac_address_write()' function is not getting called.

Bug Fix is as Follows -

         if (!cmp_etheraddr(hw->mac.addr, tmpaddr) &&
             i40e_validate_mac_addr(tmpaddr) *== I40E_SUCCESS*)

After this fix,  'i40e_aq_mac_address_write()' function is getting called.

*Conclusion*

This 'bug fix' could not resolve the Ping issue.

Appreciate your views on this matter.

Thanks,
Pushkar Kothavade



On Thursday 18 June 2015 12:00 PM, Pushkar Kothavade wrote:
> Dear Members,
>
> I am part of Panasas. I am evaluating 'Lagg-LACP performance and 
> robustness' over Intel Fortville NIC (IXL) on Intel Taylor Pass 
> platform with FreeBSD-HOL [11-CURRENT] installed. Lagg-LACP feature 
> works fine (with satisfactory performance) when Promiscuous mode is 
> enabled on the Lagg.
> If Promiscuous mode is disabled, in that case even basic Lagg 
> functionality does not work.
>
> *Setup Information : *
>
> - Machine (Intel Taylor Pass) is running FreeBSD-HOL (11 current)
> - Machine has 'Intel Fortville NIC (Intel Ethernet Controller XL710)' 
> installed with special firmware to support four 10Gbps ports with 
> breakout cable
> - Breakout cable is used with one of the 40GB ports which creates four 
> 10GB ports
> - All four 10Gbps ports are connected to Dell Force 10 Switch
> - Lagg-LACP has been configured on all four 10GB ports of the Machine 
> and on Switch ports as well
>
> *Problem Statement :*
>
> # When machine sends an Arp-request then interface does not receive 
> Arp-reply
>    - Arp request sent by the machine is successful
>    - Switch is able to get Arp broadcast request sent by the machine
>    - Switch sends back unicast Arp-reply to machine
>    - But still driver does not receive Arp-reply
>
> # Even after adding static Arp entry in machine's Arp table, ping fails
>
> # Configured same MAC address on all 4 interfaces which are part of 
> Lagg, still ping fails
>     Is there any problem with MAC filtering ?
>
> *Workaround : *
>
> - After putting Lagg interface in promiscuous mode, network interface 
> seems to work properly.
>
> *Platform Information :*
>
> Machine - Intel Taylor Pass server board
> OS - FreeBSD HOL (11.0 Current)
> NIC - Intel Fortville NIC (Intel Ethernet Controller XL710) - Find 
> more information as below
> Switch - Dell Force 10 Switch
>
> <Snip>
> ixl0: <Intel(R) Ethernet Connection XL710 Driver, Version - 1.4.1> mem 
> 0x383ffe800000-0x383ffeffffff,0x383fff818000-0x383fff81ffff irq 42 at 
> device 0.0 on pci4
> ixl0: Using MSIX interrupts with 13 vectors
> ixl0: f4.33 a1.2 n04.42 e80001935
> ixl0: Ethernet address: 68:05:ca:35:97:28
> ixl0: PCI Express Bus: Speed 8.0GT/s Width x8
> ixl1: <Intel(R) Ethernet Connection XL710 Driver, Version - 1.4.1> mem 
> 0x383ffe000000-0x383ffe7fffff,0x383fff810000-0x383fff817fff irq 42 at 
> device 0.1 on pci4
> ixl1: Using MSIX interrupts with 13 vectors
> ixl1: f4.33 a1.2 n04.42 e80001935
> ixl1: Ethernet address: 68:05:ca:35:97:29
> ixl1: PCI Express Bus: Speed 8.0GT/s Width x8
> ixl2: <Intel(R) Ethernet Connection XL710 Driver, Version - 1.4.1> mem 
> 0x383ffd800000-0x383ffdffffff,0x383fff808000-0x383fff80ffff irq 42 at 
> device 0.2 on pci4
> ixl2: Using MSIX interrupts with 13 vectors
> ixl2: f4.33 a1.2 n04.42 e80001935
> ixl2: Ethernet address: 68:05:ca:35:97:2a
> ixl2: PCI Express Bus: Speed 8.0GT/s Width x8
> ixl3: <Intel(R) Ethernet Connection XL710 Driver, Version - 1.4.1> mem 
> 0x383ffd000000-0x383ffd7fffff,0x383fff800000-0x383fff807fff irq 42 at 
> device 0.3 on pci4
> ixl3: Using MSIX interrupts with 13 vectors
> ixl3: f4.33 a1.2 n04.42 e80001935
> ixl3: Ethernet address: 68:05:ca:35:97:2b
> ixl3: PCI Express Bus: Speed 8.0GT/s Width x8
> acpi0: Power Button (fixed)
> ixl0: <Intel(R) Ethernet Connection XL710 Driver, Version - 1.4.1> mem 
> 0x383ffe800000-0x383ffeffffff,0x383fff818000-0x383fff81ffff irq 42 at 
> device 0.0 on pci4
> ixl0: Using MSIX interrupts with 13 vectors
> ixl0: f4.33 a1.2 n04.42 e80001935
> ixl0: Ethernet address: 68:05:ca:35:97:28
> ixl0: PCI Express Bus: Speed 8.0GT/s Width x8
> ixl1: <Intel(R) Ethernet Connection XL710 Driver, Version - 1.4.1> mem 
> 0x383ffe000000-0x383ffe7fffff,0x383fff810000-0x383fff817fff irq 42 at 
> device 0.1 on pci4
> ixl1: Using MSIX interrupts with 13 vectors
> ixl1: f4.33 a1.2 n04.42 e80001935
> ixl1: Ethernet address: 68:05:ca:35:97:29
> ixl1: PCI Express Bus: Speed 8.0GT/s Width x8
> ixl2: <Intel(R) Ethernet Connection XL710 Driver, Version - 1.4.1> mem 
> 0x383ffd800000-0x383ffdffffff,0x383fff808000-0x383fff80ffff irq 42 at 
> device 0.2 on pci4
> ixl2: Using MSIX interrupts with 13 vectors
> ixl2: f4.33 a1.2 n04.42 e80001935
> ixl2: Ethernet address: 68:05:ca:35:97:2a
> ixl2: PCI Express Bus: Speed 8.0GT/s Width x8
> ixl3: <Intel(R) Ethernet Connection XL710 Driver, Version - 1.4.1> mem 
> 0x383ffd000000-0x383ffd7fffff,0x383fff800000-0x383fff807fff irq 42 at 
> device 0.3 on pci4
> ixl3: Using MSIX interrupts with 13 vectors
> ixl3: f4.33 a1.2 n04.42 e80001935
> ixl3: Ethernet address: 68:05:ca:35:97:2b
> ixl3: PCI Express Bus: Speed 8.0GT/s Width x8
> <Snip>
>
> Thanks,
> Pushkar Kothavade
>
>
>




Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?558D3DC0.8020703>