From nobody Thu Aug 4 00:18:40 2022 X-Original-To: freebsd-net@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Lyq8X61gzz4YDYq for ; Thu, 4 Aug 2022 00:18:52 +0000 (UTC) (envelope-from dmarquess@gmail.com) Received: from mail-yb1-xb34.google.com (mail-yb1-xb34.google.com [IPv6:2607:f8b0:4864:20::b34]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Lyq8W71Jyz3ltb for ; Thu, 4 Aug 2022 00:18:51 +0000 (UTC) (envelope-from dmarquess@gmail.com) Received: by mail-yb1-xb34.google.com with SMTP id j63so30715611ybb.13 for ; Wed, 03 Aug 2022 17:18:51 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=mime-version:from:date:message-id:subject:to; bh=pNWInv3AgxijZPaeoXRLIMUiOdYlxsOTHVoSBQwqfiQ=; b=kMYYM5CIX/T2w+ScdUDTjLAZGCtBMP8fPVWUbjZtC20u0gkTDzZzek5gIxmhjW7dLK Q2V4WURmGva9tqMc7E5Y5+K3FEqy8hQpcZULWkmy9fDcio6qFsAOCB954oyFgr/oS01o hGNL2kp9ltfyKdUHg86SvqCEd0SOzvLdSJEaAaNcl1PxDoR/LhGlBwm1Ulfa6Z13UG4X 4j7lnF675AcSK9V8XpT5TJBoo4BejDs/mSTy7o32cPuAmiQ7ePDgAhMYxsGFsw3I+1CT OMZD4zM+bTlL0Zs8wILitdbBSI0ytf278/ZTPgfJj9zWBLwXbsYaI2Macbj5oFs1mvW2 xBUQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=pNWInv3AgxijZPaeoXRLIMUiOdYlxsOTHVoSBQwqfiQ=; b=NyjXbBO7akxwowLAkLwqjs7l5PtLHZkWGL6A2TJj+yfc/WXui32P9gtYMsfIKRGJBb vud8VBOWjqlB8WLunaZwpB9q/lJuDvYoaQeoL5MI2SdmBU6s1bFvpWivAKUfiiNBikcF qPNrbp/2y2orNKtarSuPsltaATRjO48xqDsJtuL5idvRc1wWQvaAg2U8ktlLhPo/sgJj Em6TDCXe7ShrT+kelEyWyoMYWo/u+JcJYcjBmIlq+QTFPXgkpXscbM4md2vpVGSLMcZT dqdozgC5EXu7p62Pc4H/z3OZfi6kWNADLKaW3i+0SH7BWbBFzeqxSTuS54e7ayNkP7A7 VTpw== X-Gm-Message-State: ACgBeo2xPtXqbIK763GSVreY699sJ8x3dpXENQsh3zCvNSBV407vypIj 4v6AlbWRNPlCVbTaRl5O5aaxenuXvzZBaCkqpnJBxqmQQFs= X-Google-Smtp-Source: AA6agR44Ppbfl+P70pX14a+MWGsQ/kO66WPNnmXeFwpOtcBL21mEnWX5YoLhc3uNw4YfBDCJ3ml2gcRnKDNhnI2TMNw= X-Received: by 2002:a25:4c8:0:b0:676:c824:c33d with SMTP id 191-20020a2504c8000000b00676c824c33dmr18250765ybe.569.1659572331007; Wed, 03 Aug 2022 17:18:51 -0700 (PDT) List-Id: Networking and TCP/IP with FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-net List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-net@freebsd.org MIME-Version: 1.0 From: Dustin Marquess Date: Wed, 3 Aug 2022 19:18:40 -0500 Message-ID: Subject: igb + lagg + vlan + bridge broken in -CURRENT? To: freebsd-net@freebsd.org Content-Type: text/plain; charset="UTF-8" X-Rspamd-Queue-Id: 4Lyq8W71Jyz3ltb X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20210112 header.b=kMYYM5CI; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of dmarquess@gmail.com designates 2607:f8b0:4864:20::b34 as permitted sender) smtp.mailfrom=dmarquess@gmail.com X-Spamd-Result: default: False [-2.94 / 15.00]; SUBJECT_ENDS_QUESTION(1.00)[]; NEURAL_HAM_SHORT(-1.00)[-0.997]; NEURAL_HAM_LONG(-0.99)[-0.990]; NEURAL_HAM_MEDIUM(-0.95)[-0.953]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20210112]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36:c]; MIME_GOOD(-0.10)[text/plain]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::b34:from]; PREVIOUSLY_DELIVERED(0.00)[freebsd-net@freebsd.org]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; TO_MATCH_ENVRCPT_ALL(0.00)[]; ARC_NA(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; MID_RHS_MATCH_FROMTLD(0.00)[]; TO_DN_NONE(0.00)[]; FREEMAIL_FROM(0.00)[gmail.com]; MLMMJ_DEST(0.00)[freebsd-net@freebsd.org]; DKIM_TRACE(0.00)[gmail.com:+]; RCVD_TLS_LAST(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; FREEMAIL_ENVFROM(0.00)[gmail.com]; MIME_TRACE(0.00)[0:+]; RCVD_COUNT_TWO(0.00)[2] X-ThisMailContainsUnwantedMimeParts: N I have a -CURRENT system where the networking is kind of convoluted. The native networking on the machine itself is across 4 cxl(4) interfaces + lagg(4) + if_bridge(4). The host itself and the few bhyve VMs on that bridge are still working fine. There is also a 2 igb(4) interfaces + lagg(4) + vlan(4) + if_bridge(4) setup that has been working for years up until a few days ago when I did an upgrade. There's a VIMAGE/VNET jail on one bridge on vlan1 and a bhyve VM on another bridge on vlan2. Traffic from both of those is showing up in a tcpdump at the bridge and vlan levels, but NOT at the lagg and igb levels anymore. I've had "-vlanhwfilter -vlanhwtag -lro" in rc.conf for the igb/bridge devices for years. I've ran ifconfig -m and basically disabled all enabled options thinking maybe some new option is on by default, but after turning everything off, it still wasn't working. I finally removed the lagg + vlan part of the config and just ran one VLAN on one NIC and one VLAN on the other NIC, and that's working fine. So something in the layer has stopped working recently. Has anybody else seen anything like this? I'll try adding just vlan and just lagg to see if I can figure out which is causing it (I'm guessing vlan) and then doing a bisect to see where it started. -Dustin