Skip site navigation (1)Skip section navigation (2)
Date:      Wed, 17 Jun 2020 00:31:33 +0000
From:      "Saad, Mark" <Mark.Saad@lucera.com>
To:        Navdeep Parhar <np@freebsd.org>
Cc:        "Foster, Greg" <gfoster@panasas.com>, "freebsd-net@freebsd.org" <freebsd-net@freebsd.org>
Subject:   Re: How to Increase TX Queue Priority for LACP Packets
Message-ID:  <CFA7E255-0D0B-469E-8A0F-28F96861979D@lucera.com>
In-Reply-To: <20200617001315.GB80914@x270>
References:  <BYAPR08MB6038FF630C3C8EEC4F11862BB4810@BYAPR08MB6038.namprd08.prod.outlook.com> <20200613025031.GA34653@x270> <BYAPR08MB6038CF94610AFAD28719BDD3B49D0@BYAPR08MB6038.namprd08.prod.outlook.com> <CY4PR12MB1704E7FA436170900F38E23C959D0@CY4PR12MB1704.namprd12.prod.outlook.com>, <20200617001315.GB80914@x270>

next in thread | previous in thread | raw e-mail | index | archive | help

Navdeep
   Thanks for getting back ; I’ll do some digging. Back to the question about running with LACP debug on . Does this put the nics into promiscuous mode ? 
---
Mark Saad | mark.saad@lucera.com 

> On Jun 16, 2020, at 8:13 PM, Navdeep Parhar <np@freebsd.org> wrote:
> 
> We could have a global knob that tells all NIC drivers to use a reserved
> queue for non-RSS traffic, but that would be advisory at best because
> the tx queue selection takes place inside the driver's (or iflib's)
> transmit routine.  The meat of the change is going to be in iflib and
> all non-iflib drivers' if_transmit.
> 
> Regards,
> Navdeep
> 
>> On Tue, Jun 16, 2020 at 09:48:19PM +0000, Saad, Mark wrote:
>> All
>> Is there any way to make this change on other nic's like Intel ix and
>> Solarflare sfxge ? I have seen similar issues on both with 12.1
>> mainly with solarflare nics.
>> 
>> ---
>> Mark Saad
>> mark.saad@lucera.com
>> 
>> 
>> ________________________________________
>> From: owner-freebsd-net@freebsd.org <owner-freebsd-net@freebsd.org> on behalf of Foster, Greg <gfoster@panasas.com>
>> Sent: Tuesday, June 16, 2020 3:56 PM
>> To: Navdeep Parhar
>> Cc: freebsd-net@freebsd.org
>> Subject: RE: How to Increase TX Queue Priority for LACP Packets
>> 
>> HI Navdeep,
>> 
>> Thanks for the information!  I've integrated the changes and will be
>> testing more today.
>> 
>> We have seen the LACP port flapping under different scenarios, most we
>> believe are traffic/load based.
>> 
>> I did see the flapping unexpectedly when I just enabled LACP debug
>> (e.g., sysctl net.link.lagg.lacp.debug=1).     Is this a known
>> problem?
>> 
>> Thanks
>> Greg
>> 
>> -----Original Message-----
>> From: Navdeep Parhar <nparhar@gmail.com> On Behalf Of Navdeep Parhar
>> Sent: Friday, June 12, 2020 7:51 PM
>> To: Foster, Greg <gfoster@panasas.com>
>> Cc: freebsd-net@freebsd.org
>> Subject: Re: How to Increase TX Queue Priority for LACP Packets
>> 
>>> On Fri, Jun 12, 2020 at 11:47:41PM +0000, Foster, Greg wrote:
>>> FreeBSD Networkers,
>>> 
>>> We are seeing LACP port flapping on our FreeBSD 10.4/12.1 systems
>>> under different conditions.
>>> 
>>> Can someone explain or point me to the information on how to queue
>>> the LACP packets to a higher priority queue ?
>>> 
>>> We are using the Chelsio T580-LP-CR adapter/cxgbe driver.  The
>>> Cheslio NICs have 8 TX/RX queues each, but I don't know how to
>>> explicitly put the LACP packets in the higher priority TX queue.
>>> 
>>> I've read about PF/ALTQ and think this may be overkill our needs,
>>> and was wondering if there was a simpler method.
>> 
>> This is cxgbe specific but that's what you're using so it'll do.
>> 
>> Add "hw.cxgbe.rsrv_noflowq=1" to your /boot/loader.conf.  That
>> reserves one tx queue for non-RSS traffic (like ARP, LACP).  You might
>> also want to increase the number of tx queues to compensate for the
>> one that's now reserved.  Use "hw.cxgbe.ntxq=9" for that.  The ntxq
>> knob might be different on 10.4 but the man page matching the driver
>> should have its exact name.
>> 
>> Regards,
>> Navdeep
>> 
>> _______________________________________________
>> freebsd-net@freebsd.org mailing list
>> https://lists.freebsd.org/mailman/listinfo/freebsd-net
>> To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org"
>> 
> 


Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?CFA7E255-0D0B-469E-8A0F-28F96861979D>