From owner-freebsd-net@FreeBSD.ORG Fri Aug 2 21:41:57 2013 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTP id 038EF844 for ; Fri, 2 Aug 2013 21:41:57 +0000 (UTC) (envelope-from zbeeble@gmail.com) Received: from mail-vb0-x22d.google.com (mail-vb0-x22d.google.com [IPv6:2607:f8b0:400c:c02::22d]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id B62372C3A for ; Fri, 2 Aug 2013 21:41:56 +0000 (UTC) Received: by mail-vb0-f45.google.com with SMTP id e15so1170911vbg.32 for ; Fri, 02 Aug 2013 14:41:54 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=+MBJ6YOisCuPs8Mql+XaHXv+zm9dr0cm3amJc0hXelM=; b=YEtzSOEyp3v2vHJf/M3oMZ4XFqJ7Ya9YTEduu9KNcUzn0goQ90Aw/8phtoFLuFg6EY Plff8DqMwx7pa8SLMCsqUuP/aalQGGVJibj2lVXtdCmHkB5jua++1wKeWpg5dWsiTpo0 gGtE3MbWAuadGs1DzgTlsVzfOtnUL1lqJIYMozBpGxLmbt7T+plhMbfA7E/AEuWfEXtu Wf5Tn+M0xU1rU8DmM3R8Q3J7mRjLsuCHcgvJSnV4QnpiedzIoNXScUb22FVlnPbprF1W n7LGFqTzL+V08OXnogCXOI6aKcERJpUeSz54T606m26hyNxa935Z7mK3YwkYsjkC1yfB ef5w== MIME-Version: 1.0 X-Received: by 10.221.43.70 with SMTP id ub6mr2554999vcb.86.1375479714699; Fri, 02 Aug 2013 14:41:54 -0700 (PDT) Received: by 10.221.22.199 with HTTP; Fri, 2 Aug 2013 14:41:54 -0700 (PDT) In-Reply-To: References: <51FB617E.2090904@netasq.com> Date: Fri, 2 Aug 2013 17:41:54 -0400 Message-ID: Subject: Re: Intel 4-port ethernet adaptor link aggregation issue From: Zaphod Beeblebrox To: Freddie Cash Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.14 Cc: Steve Read , freebsd-net X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 02 Aug 2013 21:41:57 -0000 On several machines with large numbers of IGBx interfaces, I've found that hw.igb.enable_msix=0 is necessary to ensure proper operation. On Fri, Aug 2, 2013 at 11:49 AM, Freddie Cash wrote: > On Fri, Aug 2, 2013 at 12:36 AM, Steve Read wrote: > > > On 01.08.2013 20:07, Joe Moog wrote: > > > >> We have an iXsystems 1U server (E5) with an Intel 4-port ethernet NIC > >> installed, model I350-T4 (manufactured May of 2013). We're trying to > bind > >> the 4 ports on this NIC together into a single lagg port, connected > LACP to > >> a distribution switch (Cisco 4900-series). We are able to successfully > bind > >> the 2 on-board ethernet ports to a single lagg, however the NIC is not > so > >> cooperative. At first we thought we had a bad NIC, but a replacement has > >> not fixed the issue. We are thinking there may be a driver limitation > with > >> these Intel ethernet NICs when attempting to bind more than 2 ports to a > >> lagg. > >> > >> FreeBSD version: > >> FreeBSD 9.1-PRERELEASE #0 r244125: Wed Dec 12 11:47:47 CST 2012 > >> > >> rc.conf: > >> # LINK AGGREGATION > >> ifconfig_igb2="UP" > >> ifconfig_igb3="UP" > >> ifconfig_igb4="UP" > >> ifconfig_igb5="UP" > >> cloned_interfaces="lagg0" > >> ifconfig_lagg0="laggproto lacp laggport igb2 laggport igb3 laggport igb4 > >> laggport igb5" > >> ifconfig_lagg0="inet 192.168.1.14 netmask 255.255.255.0" > >> > > > > > Am I the only one who noticed that you replaced the value of > > $ifconfig_lagg0 that specifies the proto and the ports with one that > > specifies just the address? > > > > Good catch! > > > > Merge the two ifconfig_lagg0 lines into one, and it will work infinitely > > better, or at least no worse. > > > > ifconfig_lagg0="laggproto lacp laggport igb2 laggport igb3 laggport igb4 > > laggport igb5 inet 192.168.1.14 netmask 255.255.255.0" > > > > Or, if you want to keep them split into two parts (initialise lagg0, then > add IP): > > create_args_lagg0="laggproto lacp laggport igb2 laggport igb3 laggport igb4 > laggport igb5" > > ifconfig_lagg0="inet 192.168.1.14 netmask 255.255.255.0" > > create_args_* are run first, then ifconfig_* are run. I like this setup, > as it separates "create and initialise" from "configure" for cloned/virtual > interfaces like vlans, laggs, etc. > > > -- > Freddie Cash > fjwcash@gmail.com > _______________________________________________ > freebsd-net@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-net > To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org" >