From owner-freebsd-net@FreeBSD.ORG Thu Jun 18 06:31:07 2015 Return-Path: Delivered-To: freebsd-net@hub.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 1A9FA477 for ; Thu, 18 Jun 2015 06:31:07 +0000 (UTC) (envelope-from pushkar.kothavade@msystechnologies.com) Received: from mail-pa0-f51.google.com (mail-pa0-f51.google.com [209.85.220.51]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id E22537D4 for ; Thu, 18 Jun 2015 06:31:06 +0000 (UTC) (envelope-from pushkar.kothavade@msystechnologies.com) Received: by paceq1 with SMTP id eq1so29713080pac.3 for ; Wed, 17 Jun 2015 23:31:00 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:message-id:date:from:user-agent:mime-version:to :cc:subject:references:in-reply-to:content-type; bh=7T17JTNrCJmY+/2zbWe4/FDR7j6p0yLCWbjiNNjnBoY=; b=JOReHI0mA7G3o+dq6b7GuxOnlQ4EXfird+zbb3T7MPNDL55SRvA8vmslKntuaGOLqO EM9ZU/jK/i1bhKjpG7J5h52N8SbMaHR+ad3JZBfPWYU9/+g3p088MsVU5H87aEQaVdEQ Mr77j4glpkzMHPhhO0YNvD5yB0ZSTP1yaxf783e3d4ae2EWwNJc6mQoRTIKh/+DKz+lk MCQ7+JHFhQ9Lfo8TJet46JMh8fRphNlhptETSCNHg5w25nitBCALX9xVtbVWRS48iHU/ qFmWl/TBvOOBAK9qHX2WTYPfUJeKdlRRLNKgz04nxWypJYg2z/ILIDmdkCU2YjZ8EIcK d00Q== X-Gm-Message-State: ALoCoQnbSxUBxlUslHH9QPMroSCgPr/5XX2Yx9swBtgTIU9biHbeSl8KKOnkQxZ9J9A/izedAPh+ X-Received: by 10.69.18.6 with SMTP id gi6mr18522089pbd.44.1434609059933; Wed, 17 Jun 2015 23:30:59 -0700 (PDT) Received: from [172.30.33.149] ([113.193.28.226]) by mx.google.com with ESMTPSA id ss3sm6841845pab.43.2015.06.17.23.30.56 (version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Wed, 17 Jun 2015 23:30:58 -0700 (PDT) Message-ID: <5582659F.6060900@msystechnologies.com> Date: Thu, 18 Jun 2015 12:00:55 +0530 From: Pushkar Kothavade User-Agent: Mozilla/5.0 (X11; Linux i686; rv:31.0) Gecko/20100101 Thunderbird/31.1.2 MIME-Version: 1.0 To: freebsd-net@freebsd.org CC: "fred >> Lewis, Fred" , lakshmi.n@msystechnologies.com, "sr >> Tallam, Sreen" , rpokala@panasas.com Subject: Lagg-LACP is not working with Intel Fortville NIC on FreeBSD HOL (11.0 Current) References: <557FD197.1020805@msystechnologies.com> In-Reply-To: <557FD197.1020805@msystechnologies.com> X-Forwarded-Message-Id: <557FD197.1020805@msystechnologies.com> Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit X-Content-Filtered-By: Mailman/MimeDel 2.1.20 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 18 Jun 2015 06:31:07 -0000 Dear Members, I am part of Panasas. I am evaluating 'Lagg-LACP performance and robustness' over Intel Fortville NIC (IXL) on Intel Taylor Pass platform with FreeBSD-HOL [11-CURRENT] installed. Lagg-LACP feature works fine (with satisfactory performance) when Promiscuous mode is enabled on the Lagg. If Promiscuous mode is disabled, in that case even basic Lagg functionality does not work. *Setup Information : * - Machine (Intel Taylor Pass) is running FreeBSD-HOL (11 current) - Machine has 'Intel Fortville NIC (Intel Ethernet Controller XL710)' installed with special firmware to support four 10Gbps ports with breakout cable - Breakout cable is used with one of the 40GB ports which creates four 10GB ports - All four 10Gbps ports are connected to Dell Force 10 Switch - Lagg-LACP has been configured on all four 10GB ports of the Machine and on Switch ports as well *Problem Statement :* # When machine sends an Arp-request then interface does not receive Arp-reply - Arp request sent by the machine is successful - Switch is able to get Arp broadcast request sent by the machine - Switch sends back unicast Arp-reply to machine - But still driver does not receive Arp-reply # Even after adding static Arp entry in machine's Arp table, ping fails # Configured same MAC address on all 4 interfaces which are part of Lagg, still ping fails Is there any problem with MAC filtering ? *Workaround : * - After putting Lagg interface in promiscuous mode, network interface seems to work properly. *Platform Information :* Machine - Intel Taylor Pass server board OS - FreeBSD HOL (11.0 Current) NIC - Intel Fortville NIC (Intel Ethernet Controller XL710) - Find more information as below Switch - Dell Force 10 Switch ixl0: mem 0x383ffe800000-0x383ffeffffff,0x383fff818000-0x383fff81ffff irq 42 at device 0.0 on pci4 ixl0: Using MSIX interrupts with 13 vectors ixl0: f4.33 a1.2 n04.42 e80001935 ixl0: Ethernet address: 68:05:ca:35:97:28 ixl0: PCI Express Bus: Speed 8.0GT/s Width x8 ixl1: mem 0x383ffe000000-0x383ffe7fffff,0x383fff810000-0x383fff817fff irq 42 at device 0.1 on pci4 ixl1: Using MSIX interrupts with 13 vectors ixl1: f4.33 a1.2 n04.42 e80001935 ixl1: Ethernet address: 68:05:ca:35:97:29 ixl1: PCI Express Bus: Speed 8.0GT/s Width x8 ixl2: mem 0x383ffd800000-0x383ffdffffff,0x383fff808000-0x383fff80ffff irq 42 at device 0.2 on pci4 ixl2: Using MSIX interrupts with 13 vectors ixl2: f4.33 a1.2 n04.42 e80001935 ixl2: Ethernet address: 68:05:ca:35:97:2a ixl2: PCI Express Bus: Speed 8.0GT/s Width x8 ixl3: mem 0x383ffd000000-0x383ffd7fffff,0x383fff800000-0x383fff807fff irq 42 at device 0.3 on pci4 ixl3: Using MSIX interrupts with 13 vectors ixl3: f4.33 a1.2 n04.42 e80001935 ixl3: Ethernet address: 68:05:ca:35:97:2b ixl3: PCI Express Bus: Speed 8.0GT/s Width x8 acpi0: Power Button (fixed) ixl0: mem 0x383ffe800000-0x383ffeffffff,0x383fff818000-0x383fff81ffff irq 42 at device 0.0 on pci4 ixl0: Using MSIX interrupts with 13 vectors ixl0: f4.33 a1.2 n04.42 e80001935 ixl0: Ethernet address: 68:05:ca:35:97:28 ixl0: PCI Express Bus: Speed 8.0GT/s Width x8 ixl1: mem 0x383ffe000000-0x383ffe7fffff,0x383fff810000-0x383fff817fff irq 42 at device 0.1 on pci4 ixl1: Using MSIX interrupts with 13 vectors ixl1: f4.33 a1.2 n04.42 e80001935 ixl1: Ethernet address: 68:05:ca:35:97:29 ixl1: PCI Express Bus: Speed 8.0GT/s Width x8 ixl2: mem 0x383ffd800000-0x383ffdffffff,0x383fff808000-0x383fff80ffff irq 42 at device 0.2 on pci4 ixl2: Using MSIX interrupts with 13 vectors ixl2: f4.33 a1.2 n04.42 e80001935 ixl2: Ethernet address: 68:05:ca:35:97:2a ixl2: PCI Express Bus: Speed 8.0GT/s Width x8 ixl3: mem 0x383ffd000000-0x383ffd7fffff,0x383fff800000-0x383fff807fff irq 42 at device 0.3 on pci4 ixl3: Using MSIX interrupts with 13 vectors ixl3: f4.33 a1.2 n04.42 e80001935 ixl3: Ethernet address: 68:05:ca:35:97:2b ixl3: PCI Express Bus: Speed 8.0GT/s Width x8 Thanks, Pushkar Kothavade