Date: Tue, 7 Mar 2017 18:08:48 -0800 From: Navdeep Parhar <nparhar@gmail.com> To: Mike Tancsa <mike@sentex.net> Cc: "freebsd-net@freebsd.org" <freebsd-net@freebsd.org> Subject: Re: Chelsio netmap support ? (RELENG_11) Message-ID: <CAPFoGT8pfNE2vNbSuytv0K_4GpYyO6UYTqPp4R-yLVFOfavbug@mail.gmail.com> In-Reply-To: <901224a7-f3ed-84a4-5402-3542cd0e865b@sentex.net> References: <93e10699-ecc7-c062-bf85-a26de0de9633@sentex.net> <CAPFoGT9u4Ctw0cMtXeEC=6xP--sSW8rEbdSwGwcXZOpRtYp=EQ@mail.gmail.com> <CAPFoGT8iQg9on9xi%2ByNkZJF-knmHE7b58G1u18SvJyVAJa7MPA@mail.gmail.com> <CAPFoGT_CYSPLrB6h742U%2BTS5qqKeLdrF2tnPGGw%2BiyBwPjmDWw@mail.gmail.com> <c7f36da2-ce4d-4377-c3d5-509c9ba692a5@sentex.net> <CAPFoGT-oxsVCNAm05porR0cJi7o_4GTrw-O8V9zZTpRu9_q82Q@mail.gmail.com> <901224a7-f3ed-84a4-5402-3542cd0e865b@sentex.net>
next in thread | previous in thread | raw e-mail | index | archive | help
On Tue, Mar 7, 2017 at 5:46 PM, Mike Tancsa <mike@sentex.net> wrote: > > # dmesg | grep netm > netmap: loaded module > vcxl0: netmap queues/slots: TX 2/1023, RX 2/1024 > vcxl0: 1 txq, 1 rxq (NIC); 1 txq, 1 rxq (TOE); 2 txq, 2 rxq (netmap) > vcxl1: netmap queues/slots: TX 2/1023, RX 2/1024 > vcxl1: 1 txq, 1 rxq (NIC); 1 txq, 1 rxq (TOE); 2 txq, 2 rxq (netmap) > igb0: netmap queues/slots: TX 4/1024, RX 4/1024 > igb1: netmap queues/slots: TX 4/1024, RX 4/1024 > > It maxes out at about 800Kpps with and without netmap. Is there a way Are you actually using a netmap based application that acts as a packet router or is this just the vcxl interface running as a normal ifnet? > to increase the queues for the Chelsio nic, like the onboard igb ? If you're not running a netmap based router get rid of the num_vis=2 and simply try with the cxl0/cxl1 interfaces. They should each have 4 rxq/4 txq on your system. In case you want to increase the number of queues, use this: # cxl0/cxl1 etc. hw.cxgbe.nrxq10g=8 hw.cxgbe.ntxq10g=8 # vcxl0/vcxl1's "normal" queues hw.cxgbe.nrxq_vi=8 hw.cxgbe.ntxq_vi=8 # vcxl0/vcxl1's netmap queues hw.cxgbe.nnmrxq_vi=8 hw.cxgbe.nnmtxq_vi=8 Check in dmesg after you reboot with your new settings > vcxl0: 1 txq, 1 rxq (NIC); 1 txq, 1 rxq (TOE); 2 txq, 2 rxq (netmap) The "NIC" queues are the normal tx/rx queues, the "netmap" queues are active when the interface is in netmap mode. Does netsend generate a single flow or multiple flows? If it's a single flow it will use a single queue only. Regards, Navdeep
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?CAPFoGT8pfNE2vNbSuytv0K_4GpYyO6UYTqPp4R-yLVFOfavbug>