Skip site navigation (1)Skip section navigation (2)
Date:      Tue, 16 Jun 2020 21:48:19 +0000
From:      "Saad, Mark" <Mark.Saad@lucera.com>
To:        "Foster, Greg" <gfoster@panasas.com>, Navdeep Parhar <np@FreeBSD.org>
Cc:        "freebsd-net@freebsd.org" <freebsd-net@freebsd.org>
Subject:   Re: How to Increase TX Queue Priority for LACP Packets
Message-ID:  <CY4PR12MB1704E7FA436170900F38E23C959D0@CY4PR12MB1704.namprd12.prod.outlook.com>
In-Reply-To: <BYAPR08MB6038CF94610AFAD28719BDD3B49D0@BYAPR08MB6038.namprd08.prod.outlook.com>
References:  <BYAPR08MB6038FF630C3C8EEC4F11862BB4810@BYAPR08MB6038.namprd08.prod.outlook.com> <20200613025031.GA34653@x270>, <BYAPR08MB6038CF94610AFAD28719BDD3B49D0@BYAPR08MB6038.namprd08.prod.outlook.com>

next in thread | previous in thread | raw e-mail | index | archive | help
All
 Is there any way to make this change on other nic's like Intel ix and Sola=
rflare sfxge ? I have seen similar issues on both with 12.1
mainly with solarflare nics.

---
Mark Saad
mark.saad@lucera.com


________________________________________
From: owner-freebsd-net@freebsd.org <owner-freebsd-net@freebsd.org> on beha=
lf of Foster, Greg <gfoster@panasas.com>
Sent: Tuesday, June 16, 2020 3:56 PM
To: Navdeep Parhar
Cc: freebsd-net@freebsd.org
Subject: RE: How to Increase TX Queue Priority for LACP Packets

HI Navdeep,

Thanks for the information!  I've integrated the changes and will be testin=
g more today.

We have seen the LACP port flapping under different scenarios, most we beli=
eve are
traffic/load based.

I did see the flapping unexpectedly when I just enabled LACP debug
(e.g., sysctl net.link.lagg.lacp.debug=3D1).     Is this a known problem?

Thanks
Greg

-----Original Message-----
From: Navdeep Parhar <nparhar@gmail.com> On Behalf Of Navdeep Parhar
Sent: Friday, June 12, 2020 7:51 PM
To: Foster, Greg <gfoster@panasas.com>
Cc: freebsd-net@freebsd.org
Subject: Re: How to Increase TX Queue Priority for LACP Packets

On Fri, Jun 12, 2020 at 11:47:41PM +0000, Foster, Greg wrote:
> FreeBSD Networkers,
>
> We are seeing LACP port flapping on our FreeBSD 10.4/12.1 systems
> under different conditions.
>
> Can someone explain or point me to the information on how to queue the
> LACP packets to a higher priority queue ?
>
> We are using the Chelsio T580-LP-CR adapter/cxgbe driver.  The Cheslio
> NICs have 8 TX/RX queues each, but I don't know how to explicitly put
> the LACP packets in the higher priority TX queue.
>
> I've read about PF/ALTQ and think this may be overkill our needs, and
> was wondering if there was a simpler method.

This is cxgbe specific but that's what you're using so it'll do.

Add "hw.cxgbe.rsrv_noflowq=3D1" to your /boot/loader.conf.  That reserves o=
ne tx queue for non-RSS traffic (like ARP, LACP).  You might also want to i=
ncrease the number of tx queues to compensate for the one that's now reserv=
ed.  Use "hw.cxgbe.ntxq=3D9" for that.  The ntxq knob might be different on=
 10.4 but the man page matching the driver should have its exact name.

Regards,
Navdeep

_______________________________________________
freebsd-net@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-net
To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org"




Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?CY4PR12MB1704E7FA436170900F38E23C959D0>