From owner-freebsd-net@freebsd.org Wed May 20 20:55:11 2020 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id D9D082F4C60 for ; Wed, 20 May 2020 20:55:11 +0000 (UTC) (envelope-from prvs=340954d87a=mark.saad@lucera.com) Received: from mx0a-0017d602.pphosted.com (mx0a-0017d602.pphosted.com [148.163.149.125]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "*.pphosted.com", Issuer "Thawte RSA CA 2018" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49S4l23jCcz3XCW for ; Wed, 20 May 2020 20:55:10 +0000 (UTC) (envelope-from prvs=340954d87a=mark.saad@lucera.com) Received: from pps.filterd (m0101311.ppops.net [127.0.0.1]) by mx0b-0017d602.pphosted.com (8.16.0.42/8.16.0.42) with SMTP id 04KKqwAJ000501 for ; Wed, 20 May 2020 16:55:08 -0400 Received: from nam11-co1-obe.outbound.protection.outlook.com (mail-co1nam11lp2168.outbound.protection.outlook.com [104.47.56.168]) by mx0b-0017d602.pphosted.com with ESMTP id 314hbj5j42-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT) for ; Wed, 20 May 2020 16:55:08 -0400 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=RlrS4lNl9AITfP8UAspxwK2tMVDw0klwX54J8riS8/CqMwTwukYGUI7znud4YGNAVVbLqbneP3MaUNHnxxaoM8vFfy7oAmeLec7N6SDgvd83DOOEp6wvoNwOrb8sos5QzMIm9EMQ6XkmoxUmSrZ3EMXHyBOIvb0P2Q+196iyfiv0zIB4XfA4IDlIfhvTr1fo44d0cMIEVaOzGjFbPxzkg13UyBLEVaulp1B+N78uLUkfSB1cuCccxsC1I3xOCOdVi4afdSY2FZzSOd87wToqlYjP7336y4eOsY/38IX7qt8Q+cR6uKRJLCMvMmeu4++//4l95ZuBMtOG2tt4dc2e6g== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=LL9yFzTZ8bz3Jf58TA3uw3yY+SNQW4c2ZBLwXlF6YPE=; b=g/yGYTEF2PtOW7dslKr3jyaArakLIfJJ3a1bL5n5gT2TUFpuhgWf+ukk0m5B60FEnZz40F198UwUH5+qWc6x2kh56R+lFHn62/kN2MNuuSMs3t72a51AB5eV+DhrXHl1pgstXmBn2IkROGBn/sMSUtEMJfTu5r0P4lHvY7310W8B5LCVFSzZbjci1XKDIMG6/ErMaM8ntIJMREBPoMIrr07fFFJE3j5jL0kWFEqKlNmgkf1H5g7AzXBo6RJbw/aNdS03my8+ulGaYZvqXgj1ANoKtjFC8eScUBKx1thEvVxMA447Ug0hXKSmbgxjHp0yNcBqi5aElanAreWVWb/+hA== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=lucera.com; dmarc=pass action=none header.from=lucera.com; dkim=pass header.d=lucera.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=bgccs.onmicrosoft.com; s=selector1-bgccs-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=LL9yFzTZ8bz3Jf58TA3uw3yY+SNQW4c2ZBLwXlF6YPE=; b=SlbUJGtq/9NFGSiI0p5/MjlNb6Ziy5h8u8XyseTJQQzNyHzZ+sZStwxdwf7lX9XACzWGGoL7fJFYFkY66LrqUiL8b5IPDdmOIOltyoU2NFw4mmulV8TkOReSp9hDq4nSXXScozXJWrLSdSW6eAyclvNwmo27D2YVa2AwsTejYPo= Received: from CY4PR12MB1704.namprd12.prod.outlook.com (2603:10b6:903:11d::22) by CY4PR12MB1269.namprd12.prod.outlook.com (2603:10b6:903:40::9) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3000.27; Wed, 20 May 2020 20:55:07 +0000 Received: from CY4PR12MB1704.namprd12.prod.outlook.com ([fe80::c19f:823:48d2:2863]) by CY4PR12MB1704.namprd12.prod.outlook.com ([fe80::c19f:823:48d2:2863%12]) with mapi id 15.20.3021.020; Wed, 20 May 2020 20:55:07 +0000 From: "Saad, Mark" To: "freebsd-net@freebsd.org" Subject: VLAN over LACP Debugging help Thread-Topic: VLAN over LACP Debugging help Thread-Index: AQHWLud6UONUU2HcJ0uJWrrkERsxww== Date: Wed, 20 May 2020 20:55:06 +0000 Message-ID: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [69.123.99.190] x-ms-publictraffictype: Email x-ms-office365-filtering-correlation-id: 5093b5ba-d2bc-4d0f-f0b1-08d7fd0013cc x-ms-traffictypediagnostic: CY4PR12MB1269: x-microsoft-antispam-prvs: x-ms-oob-tlc-oobclassifiers: OLM:8273; x-forefront-prvs: 04097B7F7F x-ms-exchange-senderadcheck: 1 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: lmeJPbklyF2E8K0IXWTYfx47VTF10rtzu46etbGO1KNTkV0ULXKBJrwITUabzkXwMy1wa2IUQPQbfGin51wboGDFGSnLOCFZTYwLc6DoPA3FQ9fYqCdxpucvV51BT15hCBPfQoG6cIjw6g/sYip9jqSOLivoz0Tn5VWMBcNU5tRCMZKnsbD0+LUblxT9+czyN8hTPvQ8wSdzwLX4jA4lLS8dlROzCcZOywKQvXAzHTo3bLGOghati0+oCnifujKgEWXsxFB0XYvveiI2lkLveG+UL1s/JBmr4mX1HNp8PkSdw+p7y8m16DFpK8MxqGXQN4F6SjG0GFsZc/misiGaMAgbAAaMh8KnkEiGRgZqxtgXlIvnGGHwtsYnJ3Uvva0kMkgDtvr9Zll+/+kHqDp725k/k5YYxTDj7wEZNS1zAvAlHj3lWX2Ok15zFTmXH4M8SYsy5uceujlyILINLUJX97gNxaIe8LYT//JLu2g/uPrI6Z0weFj5Dlgra6HACUIPX4CaLMlgzTBW/vOf/vCx0g== x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:CY4PR12MB1704.namprd12.prod.outlook.com; PTR:; CAT:NONE; SFTY:; SFS:(4636009)(376002)(396003)(136003)(39860400002)(346002)(366004)(186003)(86362001)(8676002)(6916009)(26005)(33656002)(5660300002)(966005)(316002)(478600001)(2906002)(8936002)(4743002)(7696005)(4744005)(6506007)(71200400001)(66446008)(9686003)(66946007)(55016002)(66556008)(52536014)(76116006)(66476007)(64756008); DIR:OUT; SFP:1101; x-ms-exchange-antispam-messagedata: PnatDVT8dY924X9YQYfXMFfw9nlsInUS1CVuVPhu6AAVJ4GrOGcp/wcouRt05dXV+uBNYxFXzKkTADwIRnSQEBNkw6eCHHuJNjENmoym+KNvGMc9Ej+8aeYNDjwquojd1Z41sArXus28uma6ZY5+GgkBmqYP5+rDrqhwLU1CVXJrb+Y7koyi0Y6trat+7DCNe/YhlR+o2iOe48Ocu3iAy0k1l5i/fWG11BmTaMCXNsJdmr7E0a5BVTPTMlCM118XelVXlnagy7U4ViW21yFiWO9ypqqow6jSH+48B46wCd2IQlihNfzZL1ha0EjaWIXtLvmhkvTFDhjnTkxNeiGI0WolmrnzqeTl2D6i38W5ejzmoxDOisnjMXKYsgHHw/fIzSvRFwDauVneBj8+CXgBSTMCVi9lLhddcL1zLNpWH8Fr1jrlFf+rum8VT/uQkS7bput5dp+EhThIf54oZdmWq5OYMCc9pe/UQ/oXcMNzut8= x-ms-exchange-transport-forked: True Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-OriginatorOrg: lucera.com X-MS-Exchange-CrossTenant-Network-Message-Id: 5093b5ba-d2bc-4d0f-f0b1-08d7fd0013cc X-MS-Exchange-CrossTenant-originalarrivaltime: 20 May 2020 20:55:06.8990 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: cfeb5f5e-839a-44b8-ab46-47157d8f1241 X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: MN5upxT72+7Hcbfgo/alf17GfRfalSuq7iFujYCL9bSvmJpMJSmBpxX46i5HzaRMocLPNoUby5iyBCGks8HhSw== X-MS-Exchange-Transport-CrossTenantHeadersStamped: CY4PR12MB1269 X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10434:6.0.216, 18.0.676 definitions=2020-05-20_16:2020-05-20, 2020-05-20 signatures=0 X-Proofpoint-Spam-Details: rule=outbound_notspam policy=outbound score=0 adultscore=0 phishscore=0 lowpriorityscore=0 bulkscore=0 mlxscore=0 mlxlogscore=293 malwarescore=0 suspectscore=0 spamscore=0 clxscore=1011 cotscore=-2147483648 impostorscore=0 priorityscore=1501 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.12.0-2004280000 definitions=main-2005200166 X-Rspamd-Queue-Id: 49S4l23jCcz3XCW X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=bgccs.onmicrosoft.com header.s=selector1-bgccs-onmicrosoft-com header.b=SlbUJGtq; dmarc=none; spf=pass (mx1.freebsd.org: domain of prvs=340954d87a=mark.saad@lucera.com designates 148.163.149.125 as permitted sender) smtp.mailfrom=prvs=340954d87a=mark.saad@lucera.com X-Spamd-Result: default: False [-4.62 / 15.00]; HAS_XOIP(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:148.163.149.125]; DKIM_TRACE(0.00)[bgccs.onmicrosoft.com:+]; NEURAL_HAM_SHORT(-1.50)[-1.502]; RCVD_IN_DNSWL_LOW(-0.10)[148.163.149.125:from]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; ARC_ALLOW(-1.00)[microsoft.com:s=arcselector9901:i=1]; ASN(0.00)[asn:26211, ipnet:148.163.148.0/22, country:US]; FROM_NEQ_ENVFROM(0.00)[Mark.Saad@lucera.com,prvs=340954d87a=mark.saad@lucera.com]; NEURAL_HAM_MEDIUM(-1.01)[-1.013]; SUBJECT_ENDS_SPACES(0.50)[]; RCVD_COUNT_FIVE(0.00)[5]; R_DKIM_ALLOW(-0.20)[bgccs.onmicrosoft.com:s=selector1-bgccs-onmicrosoft-com]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.004]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-net@freebsd.org]; DMARC_NA(0.00)[lucera.com]; FORGED_SENDER_VERP_SRS(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; TO_DN_EQ_ADDR_ALL(0.00)[]; RWL_MAILSPIKE_POSSIBLE(0.00)[148.163.149.125:from] X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 20 May 2020 20:55:11 -0000 All=0A= I was looking into an issue I am seeing sporadically where I see LCAP link= state changes for no obvious reasons.=0A= This is on 12.1-STABLE r354698 amd64 using Solarflare nics ( 7K and 8K card= s). There are two ports in a LACP lagg with a few ( 10 - 30 ) =0A= vlans on top of it. As what appear to be random moments the LACP linkstate= flaps between the server and the switch.=0A= It will flap for about 20 to 30 seconds and then resolve itself. =0A= =0A= I read this post from Oliver C about how net.link.ifqmaxlen can effect LACP= and LAGG but I dont understand how. =0A= https://www.mail-archive.com/freebsd-net@freebsd.org/msg61904.html=0A= =0A= I feel like I am missing something obvious . =0A= =0A= =0A= =0A= =0A= Mark Saad=0A= mark.saad@lucera.com=0A=