From owner-freebsd-questions@freebsd.org Fri Nov 20 23:18:18 2020 Return-Path: Delivered-To: freebsd-questions@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 708D04705CF for ; Fri, 20 Nov 2020 23:18:18 +0000 (UTC) (envelope-from bmcgover@cisco.com) Received: from alln-iport-3.cisco.com (alln-iport-3.cisco.com [173.37.142.90]) (using TLSv1.2 with cipher DHE-RSA-SEED-SHA (128/128 bits)) (Client CN "iport.cisco.com", Issuer "HydrantID SSL ICA G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4CdCCD1LXkz4l9w for ; Fri, 20 Nov 2020 23:18:15 +0000 (UTC) (envelope-from bmcgover@cisco.com) X-IPAS-Result: =?us-ascii?q?A0B3CADRTLhf/4oNJK1igQmBT4EjLykoB4FNLy6IBgOhb?= =?us-ascii?q?4RwgS6BJQNUCwEBAQ0BAS0CBAEBhEoCgisCJTYHDgIDAQEBAwIDAQEBAQUBA?= =?us-ascii?q?QECAQYEcYVhAQuGCy4BATgRAYEAJwQbGoUDUgUDLgGhZwKBPIhodIE0gwQBA?= =?us-ascii?q?QWFHBiCEAmBOIJzik0bgUE/gVSHTYNIgiyQRopFgUCbcwqCbps9oX2GC41Mo?= =?us-ascii?q?FwCBAIEBQIOAQEFgVsFLoFXcBWDJFAXAg2PRAEIgkOKWHQ3AgYKAQEDCXyNT?= =?us-ascii?q?AEB?= IronPort-PHdr: =?us-ascii?q?9a23=3AocYElhGJkgxmcqKywD78F51GYnJ96bzpIg4Y7I?= =?us-ascii?q?YmgLtSc6Oluo7vJ1Hb+e401Q+bU5/W5vhfh6zRqa+zEWAD4JPUtncEfdQMUh?= =?us-ascii?q?IekswZkkQmB9LNEkz0KvPmLklYVMRPXVNo5Te3ZE5SHsutaUffr3ep4XgVAB?= =?us-ascii?q?qsfQZwL/7+T4jVicn/3uuu+prVNgNPgjf1Yb57IBis6wvLscxDiop5IaF3wR?= =?us-ascii?q?zM8XY=3D?= X-IronPort-Anti-Spam-Filtered: true X-IronPort-AV: E=Sophos;i="5.78,357,1599523200"; d="scan'208,217";a="588516882" Received: from alln-core-5.cisco.com ([173.36.13.138]) by alln-iport-3.cisco.com with ESMTP/TLS/DHE-RSA-SEED-SHA; 20 Nov 2020 23:18:09 +0000 Received: from XCH-ALN-001.cisco.com (xch-aln-001.cisco.com [173.36.7.11]) by alln-core-5.cisco.com (8.15.2/8.15.2) with ESMTPS id 0AKNI8fu001729 (version=TLSv1.2 cipher=AES256-SHA bits=256 verify=FAIL) for ; Fri, 20 Nov 2020 23:18:09 GMT Received: from xhs-aln-003.cisco.com (173.37.135.120) by XCH-ALN-001.cisco.com (173.36.7.11) with Microsoft SMTP Server (TLS) id 15.0.1497.2; Fri, 20 Nov 2020 17:18:08 -0600 Received: from xhs-rcd-003.cisco.com (173.37.227.248) by xhs-aln-003.cisco.com (173.37.135.120) with Microsoft SMTP Server (TLS) id 15.0.1497.2; Fri, 20 Nov 2020 17:18:05 -0600 Received: from NAM10-BN7-obe.outbound.protection.outlook.com (72.163.14.9) by xhs-rcd-003.cisco.com (173.37.227.248) with Microsoft SMTP Server (TLS) id 15.0.1497.2 via Frontend Transport; Fri, 20 Nov 2020 17:18:05 -0600 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=K5tKgyQ3gv4bEJQ0tqBVGR0SacTBl5adkTp+LjfrVNjKspmPlQS4Pqr5YkwkiIIsewrQozcQz2Z9fwC2pkAQaYznF1aGh9Zp0rv85lxqmk6Oa2SOYpT2u9vDRoEJ/pAY2h4bw84akVnQl13WVyQSpnxUI/aZ6mz3CFIJQ8AM8jhClie/vwvQAI7iAM4zZyQuw0Y4N/ajsfqMNon+zBuneUIYIFinckhWsdFIrqM2rjf5N3g4IoEKwNaz8KC5ckLnEu6AMZAyKeFal33UyTdMFGhyJ3lnhszagHN44hHWTLVQLSwd9HFtsxXZhED461QDEZJzRXOlwqZ1s4VZKU666Q== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=Hpvnxj3wQp/rYLM6ZuuxJb1LOCyyCjTrIofAjLMDb1E=; b=h43m8lGPKp3d5E0mzVhC4jf26g/nzu8vR/mBWeLauwnpveXijTkNJR9Y8C6imUizwjCofG7fzT/v1ZspWSh/P7RA0CVkojZ6cFVyhNM7dlMm+YXCScoxGOWRXtWjA8+lc8NYW44B6C/6ux46T3DWZvdKn/b9zks/75sgL0coYEiFIxtK0YyimJOVea7CgZo8/LM96sQ1uqgNhCjjZgeOjg0VSBJMtWWgHJpWiGBaOo6htAHyhgZ3+t9fEk+evaefioovQyZJN97SEyaB1BNoCXT9dqkx/pM0vntsjMXL2xVVJZAzJgNzEXRBRD8RxyPO/NwHe/V02hEKBAX5ZQ1q3w== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=cisco.com; dmarc=pass action=none header.from=cisco.com; dkim=pass header.d=cisco.com; arc=none Received: from BL0PR11MB3442.namprd11.prod.outlook.com (2603:10b6:208:68::19) by BL0PR11MB3444.namprd11.prod.outlook.com (2603:10b6:208:6f::29) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3541.25; Fri, 20 Nov 2020 23:18:04 +0000 Received: from BL0PR11MB3442.namprd11.prod.outlook.com ([fe80::ac5a:bd5e:a76d:9f1a]) by BL0PR11MB3442.namprd11.prod.outlook.com ([fe80::ac5a:bd5e:a76d:9f1a%7]) with mapi id 15.20.3564.032; Fri, 20 Nov 2020 23:18:04 +0000 From: "Brian Mcgovern (bmcgover)" To: "freebsd-questions@freebsd.org" Subject: 12.2 - Issue with lagg not becoming "ACTIVE" Thread-Topic: 12.2 - Issue with lagg not becoming "ACTIVE" Thread-Index: AQHWv47CZmBHIVHOB065oOLxcBRdWQ== Date: Fri, 20 Nov 2020 23:18:03 +0000 Message-ID: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [2601:187:4580:5e70:2830:c21e:94fd:8d1d] x-ms-publictraffictype: Email x-ms-office365-filtering-correlation-id: 66c7a0ba-4ee3-427e-4d47-08d88daa8849 x-ms-traffictypediagnostic: BL0PR11MB3444: x-microsoft-antispam-prvs: x-ms-oob-tlc-oobclassifiers: OLM:7219; x-ms-exchange-senderadcheck: 1 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: 84eDTk8uTiYhU59YhKI1r4BUJ7ZqkfzL0qo/98octHxH9AOZxMrHD63wYxe9gFOwH0HUG5aHBC1nBL3SNusFuQLj2gzI3/rBW2ltbSeu8D8aTmAKpR9wHxBJy6M9VzNzb1NFSXn69U9DRLsvqsE9qfq2nTXOJlUOPbma/DiuRaSBWCgVhmIw0XM/AQnv34tR0M+MsS1Gq5JAuDmseMWg1zkDKmic5iyhy6NAUANW02y5WmF+g70lDdlUm/DpMS7C7zDXnTI6paXZwxlk9eQ+WLCfQhtF05As/qycMuTYxZcv4+hjcsCa7sBe25oUma9tDfjvH6QPjiwKAavHLPopCQ== x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:BL0PR11MB3442.namprd11.prod.outlook.com; PTR:; CAT:NONE; SFS:(346002)(366004)(396003)(136003)(39860400002)(376002)(8676002)(8936002)(478600001)(66446008)(7696005)(64756008)(86362001)(66476007)(83380400001)(55016002)(5660300002)(52536014)(66946007)(186003)(6916009)(19627405001)(316002)(6506007)(2906002)(71200400001)(66556008)(33656002)(76116006)(9686003); DIR:OUT; SFP:1101; x-ms-exchange-antispam-messagedata: =?iso-8859-1?Q?cEA1JSTzu3xD0vV65FnLAEPPZ82e8dZ1LTqkHvATVe5UyjrC1ppcGIFo1E?= =?iso-8859-1?Q?rHS1yu8nHf9Nf1ok9myaiolc8dVggGmjqIDojCczTdFhVvUpS9iaGpWv6Q?= =?iso-8859-1?Q?Gy2c97393U0qwRyLBCuQgztrlDM1/nRQPHhIt9mUtmcLIBLq9QlrVA8kUT?= =?iso-8859-1?Q?0ghjKju+C03bldwmvR/tK5N9FZIeITCuV3pbWc8m+DiiWrUNfCw+fOrnss?= =?iso-8859-1?Q?LYaZIBfkQLdSC1fpzs9/QR1Br8Za5MZfsK6lyOP69pFshdj6kK84l85cp8?= =?iso-8859-1?Q?7BK+IaujM9SNQaqwGGF19Z/QS2fIwpa5CcpwSfjwCrgQu6K4JbjXCW1K61?= =?iso-8859-1?Q?lXTiCGr7BwWQiYVhcOTnv/yL/D+tVQBmHiz+ObfAspDvxR13RxVeQNGSHL?= =?iso-8859-1?Q?VY37CTp95hXckM2D9Gq29lkyBNHwzNqszqdUsan7gxXN7OaeiUbQqqmJU4?= =?iso-8859-1?Q?o+HlscWNWmR7P71ht3Cb7EnK1jvdpad10vrG5gfjzkPKXeLopmR6FNtaDE?= =?iso-8859-1?Q?bSNV8BBhkAVHZB2TBVPpWlJkt6rFGv6Ku8M2rdgPO8VqrSCuFQgvx5yn0e?= =?iso-8859-1?Q?iRDFwMG7SVa0a+FCfGdV/RBku5lwmEm59UOJ2omCP6YyZx6kYme1UPK/Oq?= =?iso-8859-1?Q?yjrd/Upot2GGDGic54WvP8WFu1fERYFm/7MiLEO+XdzhJ4dKzPNASEFtHQ?= =?iso-8859-1?Q?DQsoBcoy/YaF0yVZyLIsdqbylRSrnUjX8+2spw3XB1a4FuB1UOXyiC27JZ?= =?iso-8859-1?Q?4pV42H3kmhuVuji3fkgzb3dhOHmr1Z0RMpgMFiiTMqJicGGaeF52/ZuEjy?= =?iso-8859-1?Q?i0Epn0ytGo9Ddi/bBGEtlxhWlDOr+ko4MGQ70Maiot2ax16WzTW1QmpQd/?= =?iso-8859-1?Q?nK5kAszWZVe6HuzApxcPmiELGsiQLGksnWjd2BZwp2gfK2e4RtQF+uUarX?= =?iso-8859-1?Q?J5I3ndsw8OrEVW2zDKbEvpfi9x4FOR8ST809regEi4nJlV5vX1tNTg=3D?= =?iso-8859-1?Q?=3D?= x-ms-exchange-transport-forked: True MIME-Version: 1.0 X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: BL0PR11MB3442.namprd11.prod.outlook.com X-MS-Exchange-CrossTenant-Network-Message-Id: 66c7a0ba-4ee3-427e-4d47-08d88daa8849 X-MS-Exchange-CrossTenant-originalarrivaltime: 20 Nov 2020 23:18:03.9809 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 5ae1af62-9505-4097-a69a-c1553ef7840e X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: BBiYmBgjReRA41a3HgRXI0qBGqtgvaugWIv52s8cJN8VkRoYyPoiUGJgT2kEbo84wbFk8JospveOeLOlaaF5sw== X-MS-Exchange-Transport-CrossTenantHeadersStamped: BL0PR11MB3444 X-OriginatorOrg: cisco.com X-Outbound-SMTP-Client: 173.36.7.11, xch-aln-001.cisco.com X-Outbound-Node: alln-core-5.cisco.com X-Rspamd-Queue-Id: 4CdCCD1LXkz4l9w X-Spamd-Bar: ------- X-Spamd-Result: default: False [-7.70 / 15.00]; HAS_XOIP(0.00)[]; RWL_MAILSPIKE_GOOD(0.00)[173.37.142.90:from]; R_SPF_ALLOW(-0.20)[+ip4:173.37.142.64/26]; RCVD_DKIM_ARC_DNSWL_MED(-0.50)[]; RCVD_IN_DNSWL_MED(-0.20)[173.37.142.90:from]; DKIM_TRACE(0.00)[cisco.com:+,cisco.onmicrosoft.com:+]; DMARC_POLICY_ALLOW(-0.50)[cisco.com,quarantine]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:109, ipnet:173.37.128.0/19, country:US]; ARC_ALLOW(-1.00)[microsoft.com:s=arcselector9901:i=1]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[cisco.com:s=iport,cisco.onmicrosoft.com:s=selector2-cisco-onmicrosoft-com]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-questions@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; DWL_DNSWL_LOW(-1.00)[cisco.com:dkim]; NEURAL_SPAM_SHORT(1.00)[1.000]; TO_DN_EQ_ADDR_ALL(0.00)[]; WHITELIST_SPF_DKIM(-3.00)[cisco.com:d:+,cisco.com:s:+]; RCVD_COUNT_SEVEN(0.00)[8]; MAILMAN_DEST(0.00)[freebsd-questions] Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.34 X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 20 Nov 2020 23:18:18 -0000 I'm running in to a bit of a weird set of circumstances, and I'm guessing i= ts an issue that someone has likely seen before. So, I have FreeBSD 12.2 running on a Cisco UCS C240 LFF system. In the box,= I have an Intel 4 port 10G card, and an Intel 2 port 40G card. I'm using C= isco optics for everything. The 10G card works fine. Individual interfaces, binding them in to pairs wi= th lagg interfaces, using them for bridges, etc. The 40G card partially works. As an individual interface, it works fine. If= I assign it an IP, or bridge it with the lagg interface on the 10G, it pas= ses traffic fine. However, when I try to lagg the two 40G ports together, I don't get an "ACT= IVE" flag on the lagg interface. I've tried the configuration both with a s= ingle-switch LACP port-channel setup, and with a dual-switch VPC port chann= el. lagg2: flags=3D8943 metric = 0 mtu 1500 options=3De503bb ether 40:a6:b7:16:e2:10 laggproto lacp lagghash l2,l3,l4 laggport: ixl4 flags=3D18 laggport: ixl5 flags=3D0<> groups: lagg media: Ethernet autoselect status: active nd6 options=3D29 And yet, the switch side is showing the port as actively participating in t= he port channel (as port channel 49). Bringing up the second switch (via VP= C) has ixl5 going in to COLLECTING,DISTRIBUTING state, but again, no ACTIVE= flag. ---------------------------------------------------------------------------= ----- Group Port- Type Protocol Member Ports Channel ---------------------------------------------------------------------------= ----- 5 Po5(SU) Eth LACP Eth1/5(P) Eth1/6(P) Eth1/7(P) Eth1/8(P) 49 Po49(SU) Eth LACP Eth1/49(P) 51 Po51(SU) Eth LACP Eth1/51(P) Eth1/52(P) About the only thing I see if interest is that the optics are listed as "Un= known". Otherwise, the flags here match what I'd expect to see. ixl4: flags=3D8943 metric 0= mtu 1500 options=3De503bb ether 40:a6:b7:16:e2:10 media: Ethernet autoselect (Unknown ) status: active nd6 options=3D29 I'm hoping it may be a bug in the interface code, but I figured I'd ask to = see if anyone has any good thoughts and some quick feedback before I start = digging in to the code to figure it out. -Brian