From owner-freebsd-net@freebsd.org Wed Oct 4 22:48:11 2017 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 461C2E0D955 for ; Wed, 4 Oct 2017 22:48:11 +0000 (UTC) (envelope-from dmarquess@gmail.com) Received: from mail-qt0-x22a.google.com (mail-qt0-x22a.google.com [IPv6:2607:f8b0:400d:c0d::22a]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 0A22D75145 for ; Wed, 4 Oct 2017 22:48:10 +0000 (UTC) (envelope-from dmarquess@gmail.com) Received: by mail-qt0-x22a.google.com with SMTP id k1so11250192qti.2 for ; Wed, 04 Oct 2017 15:48:10 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc:content-transfer-encoding; bh=0zbW9F2qaeKTQqvmJhwo6pK6tb+pCKDYIX9PqhZ3Cv0=; b=OhhBQDwp6NTGmQgDqvjgaYFRIZP/DtBeMXlGvWE8ReJy8Odr47Jl1Ks+9W1MGDxgYF JVb+Gd7KerYIFMhVXf1B5/IF3Oc8t/7TJwrbHWknGjj+plbepYiRh35gC7mclHj6MNck 0n9dl4O/xf6GePCuo1ni2h0LIQ1H3pz0KyhEysJa4qnc0uEAcpV1/SA9iPWFuftSRqmm UxvPW3sO8L8MUCeK4QVktuMhV1+tDw0K8lA8aJWPapSXH4urjiDJ+sjHDtWP2hCp9lvE SkDjke/WOfgMNF6E/8e/XCx8NuDGAq8AWam1VlYC3/9ECIRqOJqEIa/i0qKYV89r/Pzk eWAg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc:content-transfer-encoding; bh=0zbW9F2qaeKTQqvmJhwo6pK6tb+pCKDYIX9PqhZ3Cv0=; b=jr6Br8GeeiouS9Z7PVY0tlg6kjGwyTGC6U2dgPLhYaFvjmLjVHiB2Gr0YoKImVdGLb 3HPBTaFo+8va84btP+nT/lNSw8JGhRog1ib4VVAZO3UFcWo6+77Id+xWKx3xojXaphaL P2OHMHbnh637xNG2l64Q9qogBzewkyWy6zEgg1c6AnK91eWD/wFGC/eC3qie/WN0ce8Q NfXCmmrVIjpfJK+qsr9vdn8Df0Q0dpkViQqAQQ7wvrmSblP3L6Xlfu/cbUqIvMRUGt1A 2M4OJjb9ahpIa7bxCWJ2wGd+TGvZQwhSS0eo9D5yWrXtdKoMIu90uiZpclNwXN9119yi HQfQ== X-Gm-Message-State: AMCzsaWmbh2Zi8ss3ydWUBJOAyh1GnWWSBvhEZ+/2VXcPMKf1cfMaw5X Q6zjY7PAEE8DGvaBLN0Fn3rwlo/sKLDc0GBYAiI= X-Google-Smtp-Source: AOwi7QBlFknVuj0NUFDegj1Z//XXPY9fUP9w4OIlcIB/mPORWUJEUA1FZ+n+fAUxmtFFaSMD/vE94x/cBIHKq1mxu6o= X-Received: by 10.129.131.212 with SMTP id t203mr8165436ywf.314.1507157289849; Wed, 04 Oct 2017 15:48:09 -0700 (PDT) MIME-Version: 1.0 Received: by 10.13.218.130 with HTTP; Wed, 4 Oct 2017 15:48:09 -0700 (PDT) In-Reply-To: References: From: Dustin Marquess Date: Wed, 4 Oct 2017 17:48:09 -0500 Message-ID: Subject: Re: lagg interface doesn't work To: Rainer Duffner Cc: freebsd-net@freebsd.org Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 04 Oct 2017 22:48:11 -0000 On Wed, Oct 4, 2017 at 3:25 PM, Rainer Duffner wro= te: > Hi, > > I=E2=80=99m trying to get a lagg(4) setup going. > > This has previously been a linux host, which had to be replace on short n= otice. > > I=E2=80=99ve rarely used lagg(4). > > > Basically, we have two trunk-ports with a bunch of clans that needs to go= over two 10G interface (bxe(4)). > > The switch is a Cisco switch, I don=E2=80=99t know the exact firmware rev= ision - I don=E2=80=99t configure the switches here, this a cut and paste f= rom the admin. > > The previous Linux server used =E2=80=9Epassive=E2=80=9C mode - it seems = FreeBSD does not do that? > > *** > > Cisco IOS Software, IOS-XE Software, Catalyst 4500 L3 Switch Software (ca= t4500e-UNIVERSALK9-M), > > ! > > ! > > interface Port-channel121 > description server-prod.front > switchport > switchport trunk allowed vlan 2000,2002,2004,2007,2012,2014 > switchport mode trunk > mtu 9170 > spanning-tree portfast trunk > end > > ! > > ! > > interface TenGigabitEthernet1/1/15 > description server-prod.front-1.1 > switchport trunk allowed vlan 2000,2002,2004,2007,2012,2014 > switchport mode trunk > mtu 9170 > channel-group 121 mode active > spanning-tree portfast trunk > end > > ! > > interface TenGigabitEthernet2/1/15 > description server-prod.front-2.1 > switchport trunk allowed vlan 2000,2002,2004,2007,2012,2014 > switchport mode trunk > mtu 9170 > channel-group 121 mode active > spanning-tree portfast trunk > end > > > On the FreeBSD-side (11.1-AMD64), I have: > (based on the excellent examples here: https://high5.nl/freebsd-lagg-vlan= -ipfw-mini-howto) > > ifconfig_bxe0=3D"up" > ifconfig_bxe1=3D"up" > cloned_interfaces=3D"lagg0 vlan2012 vlan2007 vlan2002 vlan2004" > #cloned_interfaces=3D"lagg0 vlan2004" > ifconfig_lagg0=3D"up laggproto lacp laggport bxe0 laggport bxe1" > > ifconfig_vlan2004=3D"inet ip1 netmask 255.255.255.192 vlan 2004 vlandev l= agg0" > ifconfig_vlan2012=3D"inet ip2 netmask 255.255.255.192 vlan 2012 vlandev l= agg0 " > ifconfig_vlan2007=3D"inet ip3 netmask 255.255.255.240 vlan 2007 vlandev l= agg0" > ifconfig_vlan2002=3D"inet ip4 netmask 255.255.255.192 vlan 2002 vlandev l= agg0" > > > in sysctl.conf, I added: > net.link.lagg.lacp.default_strict_mode=3D0 > > > Now, this works as long as I put one of the VLAN-interfaces into promiscu= ous mode. > > > When I stop tcpdump, I get messages like > > *** > Interface stopped DISTRIBUTING, possible flapping > *** > > and it really stops doing anything. > > > > Any ideas? You probably want: laggproto loadbalance lagghash l3,l4 Instead of: laggproto lacp It also looks like your switch ports are configured for Jumbo packets and on the FreeBSD side you're not increasing the mtu. -Dustin