Date: Thu, 3 Nov 2022 14:20:54 -0400 From: mike tancsa <mike@sentex.net> To: Navdeep Parhar <nparhar@gmail.com>, Freebsd performance <freebsd-performance@freebsd.org> Subject: Re: Chelsio Forwarding performance and RELENG_13 vs RELENG_12 (solved) Message-ID: <63424978-a10f-a88b-2b3e-eb80d0f29f51@sentex.net> In-Reply-To: <39ca9375-e742-618e-5020-dda5fa24ac0a@sentex.net> References: <7b86e3fe-62e4-7b3e-f4bf-30e4894db9db@sentex.net> <92cdf4b8-2209-ec44-8151-a59b9e8f1504@gmail.com> <b741dd17-f6eb-66c3-82f6-52b87475704f@sentex.net> <fa98a400-75b4-6453-0b40-ae098ac3ab59@gmail.com> <ceff6a91-929d-a3f9-e99e-03952b125ae2@sentex.net> <8166abfe-a796-2cf0-ade2-de08df8eecd2@gmail.com> <39ca9375-e742-618e-5020-dda5fa24ac0a@sentex.net>
next in thread | previous in thread | raw e-mail | index | archive | help
On 10/21/2022 2:45 PM, mike tancsa wrote: > On 10/21/2022 2:30 PM, Navdeep Parhar wrote: >> On 10/21/22 11:15 AM, mike tancsa wrote: >>> On 10/21/2022 2:13 PM, Navdeep Parhar wrote: >>>> >>>>>> hw.cxgbe.ntxq=4 >>>>>> hw.cxgbe.nrxq=4 >>>>>> >>>>> Thanks Navdeep! >>>>> >>>>> Unfortunately, still the odd dropped packet :( >>>> >>>> Can you try increasing the size of the queues? >>>> >>>> hw.cxgbe.qsize_txq=2048 >>>> hw.cxgbe.qsize_rxq=2048 >>>> >>>> The stats show that you are using MTU 1500. If you were using MTU >>>> 9000 I'd also have suggested setting largest_rx_cluster to 4K. >>>> >>>> hw.cxgbe.largest_rx_cluster=4096 >>>> >>> Thanks again, just 1500 MTU. Shall I keep nt and nrxq at 4 still ? >> >> Yes, I think 4 queues are enough for 10G. >> > Sadly, no luck. Still about the same rate of overflows :( > > FYI, I worked around the issue by using two 520-CR NICs instead of the one 540-CR NIC and performance is solid again with no dropped packets ---Mike
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?63424978-a10f-a88b-2b3e-eb80d0f29f51>