Date: Fri, 15 Sep 2017 11:26:03 -0700 From: Navdeep Parhar <nparhar@gmail.com> To: "Caraballo-Vega, Jordan A. (GSFC-6062)[COMPUTER SCIENCE CORP]" <jordancaraballo87@gmail.com> Cc: "freebsd-net@freebsd.org" <freebsd-net@freebsd.org> Subject: Re: packets per second routing tests: mismatch between switch (~4M pps) and netstat (~10M pps) scores Message-ID: <CAPFoGT9MycU9bLEV1vftFYe6e3kMbV5_g4b2aAgL6T4qvU=Vow@mail.gmail.com> In-Reply-To: <8bc1eb83-b56e-69e4-544f-1d64e9c44cb7@gmail.com> References: <8bc1eb83-b56e-69e4-544f-1d64e9c44cb7@gmail.com>
next in thread | previous in thread | raw e-mail | index | archive | help
The tx errors/drops are almost always due to software queue overflow. There isn't much that can go wrong once the frame has successfully been submitted to the hw for tx. Do you have a lot of PAUSE coming in during the tests where you see just 31Kpps tx? You can monitor the incoming PAUSE frames with this: # sysctl dev.cc | grep rx_pause # sysctl dev.cc.<n>.stats has a lot of stats straight from the hardware. The hardware's tx_ stats should be clean even though netstat reports a lot of errors/drops as long as the drops are in the software. Regards, Navdeep On Fri, Sep 15, 2017 at 8:18 AM, Caraballo-Vega, Jordan A. (GSFC-6062)[COMPUTER SCIENCE CORP] <jordancaraballo87@gmail.com> wrote: > Hi all, > > We are currently running udp 1500 bytes pps tests through a Dell PE R530 > and two Chelsio T62100-LP-CR NICs acting as a router. At the switch we > are seeing ~4M pps, while with "netstat -w1 -d -h" we are seeing ~10M > pps or ~31k in the same test. Any idea of why scores are so different? > It could be a misconfiguration of my network interfaces? Where should I > look at? > > Scores from the switch are as follow: > > 2017-09-15 10:57:57: duration=360, nodes=24, streams=85ea/2040agg, > frame_size=1500, pps=1499977, Mbps=17999: Zone-1(in:57%, out:0%) > Zone-2(in:0%, out:14%) > > Scores from netstat are as follow: > > input (Total) output > packets errs idrops bytes packets errs bytes colls drops > 17M 0 0 23G 10M 0 14G 0 0 > 17M 0 0 23G 10M 0 14G 0 0 > 17M 0 0 23G 10M 0 14G 0 0 > 17M 0 0 23G 10M 0 14G 0 0 > 17M 0 0 24G 31k 7.8M 1.9M 0 7.8M > 17M 0 0 24G 31k 7.8M 1.9M 0 7.8M > 17M 0 0 24G 31k 7.8M 1.9M 0 7.8M > 17M 0 0 24G 31k 7.8M 1.9M 0 7.8M > > Interfaces are bonded as follow (/etc/rc.conf): > > ifconfig_cc0="-tso -lro mtu 9000 up" > ifconfig_cc1="-tso -lro mtu 9000 up" > ifconfig_cc2="-tso -lro mtu 9000 up" > ifconfig_cc3="-tso -lro mtu 9000 up" > cloned_interfaces="lagg0 lagg1 vlan0 vlan1" > ifconfig_lagg0="laggproto lacp laggport cc0 laggport cc1" > ifconfig_lagg1="laggproto lacp laggport cc2 laggport cc3" > ifconfig_vlan0="inet 172.16.2.1/24 vlan 20 vlandev lagg0" > ifconfig_vlan1="inet 172.16.1.1/24 vlan 10 vlandev lagg1" > > Thanks in advance, > > - Jordan > > > _______________________________________________ > freebsd-net@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-net > To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org"
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?CAPFoGT9MycU9bLEV1vftFYe6e3kMbV5_g4b2aAgL6T4qvU=Vow>