Date: Tue, 14 Jan 2020 17:54:43 +0300 From: Slawa Olhovchenkov <slw@zxy.spb.ru> To: freebsd-net@freebsd.org Subject: Intel ix staled under heavy load Message-ID: <20200114145443.GG38096@zxy.spb.ru>
next in thread | raw e-mail | index | archive | help
I am see strange behavior of Intel ix card (82599ES 10-Gigabit
SFI/SFP+ Network Connection).
Under heavy load in NETMAP mode NIC is lost input traffic, i.e. all
packets counted as `dev.ix.1.mac_stats.rx_missed_packets`,
netstat show high traffic rate:
# netstat -nbI ix1 1
input ix1 output
packets errs idrops bytes packets errs bytes colls
14204463 0 0 965903486 2 0 414 0
14204467 0 0 965903756 0 0 0 0
14204478 0 0 965904512 2 0 193 0
14204470 0 0 965903962 0 0 0 0
my program don't get any input packets, all input netmap rings staled (cur/head/tail):
ix1#0 640/640/640
ix1#1 52/52/52
ix1#2 1012/1012/1012
ix1#3 631/631/631
Hardware rings also staled:
dev.ix.1.queue3.rxd_tail: 631
dev.ix.1.queue3.rxd_head: 631
dev.ix.1.queue2.rxd_tail: 1011
dev.ix.1.queue2.rxd_head: 1012
dev.ix.1.queue1.rxd_tail: 51
dev.ix.1.queue1.rxd_head: 52
dev.ix.1.queue0.rxd_tail: 639
dev.ix.1.queue0.rxd_head: 640
iflib rings also staled:
dev.ix.1.iflib.rxq3.rxq_fl0.credits: 0
dev.ix.1.iflib.rxq3.rxq_fl0.cidx: 631
dev.ix.1.iflib.rxq3.rxq_fl0.pidx: 0
dev.ix.1.iflib.rxq2.rxq_fl0.credits: 0
dev.ix.1.iflib.rxq2.rxq_fl0.cidx: 1012
dev.ix.1.iflib.rxq2.rxq_fl0.pidx: 0
dev.ix.1.iflib.rxq1.rxq_fl0.credits: 0
dev.ix.1.iflib.rxq1.rxq_fl0.cidx: 52
dev.ix.1.iflib.rxq1.rxq_fl0.pidx: 0
dev.ix.1.iflib.rxq0.rxq_fl0.credits: 0
dev.ix.1.iflib.rxq0.rxq_fl0.cidx: 640
dev.ix.1.iflib.rxq0.rxq_fl0.pidx: 0
Interraupt's mostly don't generated:
# sysctl dev.ix.1 | grep irq ; sleep 10 ; sysctl dev.ix.1 | grep irq
dev.ix.1.queue3.irqs: 4375622959
dev.ix.1.queue2.irqs: 4282320604
dev.ix.1.queue1.irqs: 4196905785
dev.ix.1.queue0.irqs: 4195682690
dev.ix.1.link_irq: 314
dev.ix.1.queue3.irqs: 4375622959
dev.ix.1.queue2.irqs: 4282320610
dev.ix.1.queue1.irqs: 4196905785
dev.ix.1.queue0.irqs: 4195682690
What is problem? How to resolve this?
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?20200114145443.GG38096>