Date: Tue, 16 Jun 2020 17:43:51 -0700 From: Navdeep Parhar <np@freebsd.org> To: "Saad, Mark" <Mark.Saad@lucera.com> Cc: "Foster, Greg" <gfoster@panasas.com>, "freebsd-net@freebsd.org" <freebsd-net@freebsd.org> Subject: Re: How to Increase TX Queue Priority for LACP Packets Message-ID: <20200617004351.GC80914@x270> In-Reply-To: <CFA7E255-0D0B-469E-8A0F-28F96861979D@lucera.com> References: <BYAPR08MB6038FF630C3C8EEC4F11862BB4810@BYAPR08MB6038.namprd08.prod.outlook.com> <20200613025031.GA34653@x270> <BYAPR08MB6038CF94610AFAD28719BDD3B49D0@BYAPR08MB6038.namprd08.prod.outlook.com> <CY4PR12MB1704E7FA436170900F38E23C959D0@CY4PR12MB1704.namprd12.prod.outlook.com> <20200617001315.GB80914@x270> <CFA7E255-0D0B-469E-8A0F-28F96861979D@lucera.com>
next in thread | previous in thread | raw e-mail | index | archive | help
No, it just enables some printf's in the LACP code and has no effect on anything else. Regards, Navdeep On Wed, Jun 17, 2020 at 12:31:33AM +0000, Saad, Mark wrote: > Navdeep > Thanks for getting back ; I’ll do some digging. Back to the > question about running with LACP debug on . Does this put the nics > into promiscuous mode ? > --- > Mark Saad | mark.saad@lucera.com > > > On Jun 16, 2020, at 8:13 PM, Navdeep Parhar <np@freebsd.org> wrote: > > > > We could have a global knob that tells all NIC drivers to use a reserved > > queue for non-RSS traffic, but that would be advisory at best because > > the tx queue selection takes place inside the driver's (or iflib's) > > transmit routine. The meat of the change is going to be in iflib and > > all non-iflib drivers' if_transmit. > > > > Regards, > > Navdeep > > > >> On Tue, Jun 16, 2020 at 09:48:19PM +0000, Saad, Mark wrote: > >> All > >> Is there any way to make this change on other nic's like Intel ix and > >> Solarflare sfxge ? I have seen similar issues on both with 12.1 > >> mainly with solarflare nics. > >> > >> --- > >> Mark Saad > >> mark.saad@lucera.com > >> > >> > >> ________________________________________ > >> From: owner-freebsd-net@freebsd.org <owner-freebsd-net@freebsd.org> on behalf of Foster, Greg <gfoster@panasas.com> > >> Sent: Tuesday, June 16, 2020 3:56 PM > >> To: Navdeep Parhar > >> Cc: freebsd-net@freebsd.org > >> Subject: RE: How to Increase TX Queue Priority for LACP Packets > >> > >> HI Navdeep, > >> > >> Thanks for the information! I've integrated the changes and will be > >> testing more today. > >> > >> We have seen the LACP port flapping under different scenarios, most we > >> believe are traffic/load based. > >> > >> I did see the flapping unexpectedly when I just enabled LACP debug > >> (e.g., sysctl net.link.lagg.lacp.debug=1). Is this a known > >> problem? > >> > >> Thanks > >> Greg > >> > >> -----Original Message----- > >> From: Navdeep Parhar <nparhar@gmail.com> On Behalf Of Navdeep Parhar > >> Sent: Friday, June 12, 2020 7:51 PM > >> To: Foster, Greg <gfoster@panasas.com> > >> Cc: freebsd-net@freebsd.org > >> Subject: Re: How to Increase TX Queue Priority for LACP Packets > >> > >>> On Fri, Jun 12, 2020 at 11:47:41PM +0000, Foster, Greg wrote: > >>> FreeBSD Networkers, > >>> > >>> We are seeing LACP port flapping on our FreeBSD 10.4/12.1 systems > >>> under different conditions. > >>> > >>> Can someone explain or point me to the information on how to queue > >>> the LACP packets to a higher priority queue ? > >>> > >>> We are using the Chelsio T580-LP-CR adapter/cxgbe driver. The > >>> Cheslio NICs have 8 TX/RX queues each, but I don't know how to > >>> explicitly put the LACP packets in the higher priority TX queue. > >>> > >>> I've read about PF/ALTQ and think this may be overkill our needs, > >>> and was wondering if there was a simpler method. > >> > >> This is cxgbe specific but that's what you're using so it'll do. > >> > >> Add "hw.cxgbe.rsrv_noflowq=1" to your /boot/loader.conf. That > >> reserves one tx queue for non-RSS traffic (like ARP, LACP). You might > >> also want to increase the number of tx queues to compensate for the > >> one that's now reserved. Use "hw.cxgbe.ntxq=9" for that. The ntxq > >> knob might be different on 10.4 but the man page matching the driver > >> should have its exact name. > >> > >> Regards, > >> Navdeep > >> > >> _______________________________________________ > >> freebsd-net@freebsd.org mailing list > >> https://lists.freebsd.org/mailman/listinfo/freebsd-net > >> To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org" > >> > >
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?20200617004351.GC80914>