Date: Thu, 28 May 2015 23:32:02 +0430 From: Babak Farrokhi <babak@farrokhi.net> To: Guy Helmer <guy.helmer@gmail.com> Cc: freebsd-net@freebsd.org Subject: Re: FreeBSD 9.3 - Intel X520-SR2 stops passing packets Message-ID: <5567662A.9060406@farrokhi.net> In-Reply-To: <51002FF3-06BF-4CDB-9D78-A25EA15DF263@gmail.com> References: <C8B78CF4-184C-4BFE-B848-37A91A3B696B@gmail.com> <5560C395.8020807@farrokhi.net> <51002FF3-06BF-4CDB-9D78-A25EA15DF263@gmail.com>
next in thread | previous in thread | raw e-mail | index | archive | help
If you are having high interrupt rate, it will be same on latest 10-STABLE. Are you using an unsupported SFP? > Guy Helmer <mailto:guy.helmer@gmail.com> > May 28, 2015 at 6:24 PM >> On May 23, 2015, at 1:14 PM, Babak Farrokhi <babak@farrokhi.net> wrote: >> >> Look at the interrupts per queue. 500,000 is the maximum and it is the reason your interface is not accepting new packets. > > Thanks for the insight. Is there any possible mitigation for this issue? > > Regards, > Guy > >>> Guy Helmer <mailto:guy.helmer@gmail.com> May 21, 2015 at 6:03 PM >>> I’ve noticed that there have been reports of problems with Intel X520-SR2 network interfaces stopping working. I think I’m seeing a similar issue where the 10Gb interfaces stop receiving traffic (they’re being used in promiscuous mode to sniff traffic from a tap). ifconfig shows the interfaces are still active and the links are OK. ifconfig down/up restores activity. I’ve changed hw.intr_storm_threshold=8000 but I couldn’t tell if the interrupt storm threshold had been triggered at the time the interfaces stopped passing traffic. >>> >>> Output from sysctl: >>> >>> # sysctl dev.ix.0 >>> dev.ix.0.%desc: Intel(R) PRO/10GbE PCI-Express Network Driver, Version - 2.5.15 >>> dev.ix.0.%driver: ix >>> dev.ix.0.%location: slot=0 function=0 >>> dev.ix.0.%pnpinfo: vendor=0x8086 device=0x10fb subvendor=0x8086 subdevice=0x0003 class=0x020000 >>> dev.ix.0.%parent: pci4 >>> dev.ix.0.fc: 0 >>> dev.ix.0.enable_aim: 1 >>> dev.ix.0.advertise_speed: 0 >>> dev.ix.0.dropped: 0 >>> dev.ix.0.mbuf_defrag_failed: 0 >>> dev.ix.0.watchdog_events: 0 >>> dev.ix.0.link_irq: 3 >>> dev.ix.0.queue0.interrupt_rate: 500000 >>> dev.ix.0.queue0.irqs: 454449470 >>> dev.ix.0.queue0.txd_head: 0 >>> dev.ix.0.queue0.txd_tail: 0 >>> dev.ix.0.queue0.tso_tx: 0 >>> dev.ix.0.queue0.no_tx_dma_setup: 0 >>> dev.ix.0.queue0.no_desc_avail: 0 >>> dev.ix.0.queue0.tx_packets: 0 >>> dev.ix.0.queue0.rxd_head: 1437 >>> dev.ix.0.queue0.rxd_tail: 1436 >>> dev.ix.0.queue0.rx_packets: 547499168 >>> dev.ix.0.queue0.rx_bytes: 87201112584 >>> dev.ix.0.queue0.rx_copies: 7934870 >>> dev.ix.0.queue0.lro_queued: 0 >>> dev.ix.0.queue0.lro_flushed: 0 >>> dev.ix.0.queue1.interrupt_rate: 500000 >>> dev.ix.0.queue1.irqs: 466235043 >>> dev.ix.0.queue1.txd_head: 0 >>> dev.ix.0.queue1.txd_tail: 0 >>> dev.ix.0.queue1.tso_tx: 0 >>> dev.ix.0.queue1.no_tx_dma_setup: 0 >>> dev.ix.0.queue1.no_desc_avail: 0 >>> dev.ix.0.queue1.tx_packets: 0 >>> dev.ix.0.queue1.rxd_head: 277 >>> dev.ix.0.queue1.rxd_tail: 276 >>> dev.ix.0.queue1.rx_packets: 547668680 >>> dev.ix.0.queue1.rx_bytes: 86205679601 >>> dev.ix.0.queue1.rx_copies: 7846653 >>> dev.ix.0.queue1.lro_queued: 0 >>> dev.ix.0.queue1.lro_flushed: 0 >>> dev.ix.0.queue2.interrupt_rate: 500000 >>> dev.ix.0.queue2.irqs: 473958473 >>> dev.ix.0.queue2.txd_head: 0 >>> dev.ix.0.queue2.txd_tail: 0 >>> dev.ix.0.queue2.tso_tx: 0 >>> dev.ix.0.queue2.no_tx_dma_setup: 0 >>> dev.ix.0.queue2.no_desc_avail: 0 >>> dev.ix.0.queue2.tx_packets: 0 >>> dev.ix.0.queue2.rxd_head: 576 >>> dev.ix.0.queue2.rxd_tail: 575 >>> dev.ix.0.queue2.rx_packets: 555704840 >>> dev.ix.0.queue2.rx_bytes: 87294164455 >>> dev.ix.0.queue2.rx_copies: 8297211 >>> dev.ix.0.queue2.lro_queued: 0 >>> dev.ix.0.queue2.lro_flushed: 0 >>> dev.ix.0.queue3.interrupt_rate: 500000 >>> dev.ix.0.queue3.irqs: 477587504 >>> dev.ix.0.queue3.txd_head: 0 >>> dev.ix.0.queue3.txd_tail: 0 >>> dev.ix.0.queue3.tso_tx: 0 >>> dev.ix.0.queue3.no_tx_dma_setup: 0 >>> dev.ix.0.queue3.no_desc_avail: 0 >>> dev.ix.0.queue3.tx_packets: 0 >>> dev.ix.0.queue3.rxd_head: 267 >>> dev.ix.0.queue3.rxd_tail: 266 >>> dev.ix.0.queue3.rx_packets: 559921557 >>> dev.ix.0.queue3.rx_bytes: 86832161258 >>> dev.ix.0.queue3.rx_copies: 7918011 >>> dev.ix.0.queue3.lro_queued: 0 >>> dev.ix.0.queue3.lro_flushed: 0 >>> dev.ix.0.queue4.interrupt_rate: 500000 >>> dev.ix.0.queue4.irqs: 558339677 >>> dev.ix.0.queue4.txd_head: 0 >>> dev.ix.0.queue4.txd_tail: 0 >>> dev.ix.0.queue4.tso_tx: 0 >>> dev.ix.0.queue4.no_tx_dma_setup: 0 >>> dev.ix.0.queue4.no_desc_avail: 0 >>> dev.ix.0.queue4.tx_packets: 0 >>> dev.ix.0.queue4.rxd_head: 1240 >>> dev.ix.0.queue4.rxd_tail: 1239 >>> dev.ix.0.queue4.rx_packets: 646909190 >>> dev.ix.0.queue4.rx_bytes: 87117307815 >>> dev.ix.0.queue4.rx_copies: 7944848 >>> dev.ix.0.queue4.lro_queued: 0 >>> dev.ix.0.queue4.lro_flushed: 0 >>> dev.ix.0.queue5.interrupt_rate: 500000 >>> dev.ix.0.queue5.irqs: 467836647 >>> dev.ix.0.queue5.txd_head: 0 >>> dev.ix.0.queue5.txd_tail: 0 >>> dev.ix.0.queue5.tso_tx: 0 >>> dev.ix.0.queue5.no_tx_dma_setup: 0 >>> dev.ix.0.queue5.no_desc_avail: 0 >>> dev.ix.0.queue5.tx_packets: 0 >>> dev.ix.0.queue5.rxd_head: 1411 >>> dev.ix.0.queue5.rxd_tail: 1410 >>> dev.ix.0.queue5.rx_packets: 549666835 >>> dev.ix.0.queue5.rx_bytes: 84671540121 >>> dev.ix.0.queue5.rx_copies: 8258025 >>> dev.ix.0.queue5.lro_queued: 0 >>> dev.ix.0.queue5.lro_flushed: 0 >>> dev.ix.0.queue6.interrupt_rate: 500000 >>> dev.ix.0.queue6.irqs: 490798561 >>> dev.ix.0.queue6.txd_head: 0 >>> dev.ix.0.queue6.txd_tail: 0 >>> dev.ix.0.queue6.tso_tx: 0 >>> dev.ix.0.queue6.no_tx_dma_setup: 0 >>> dev.ix.0.queue6.no_desc_avail: 0 >>> dev.ix.0.queue6.tx_packets: 0 >>> dev.ix.0.queue6.rxd_head: 160 >>> dev.ix.0.queue6.rxd_tail: 159 >>> dev.ix.0.queue6.rx_packets: 590187606 >>> dev.ix.0.queue6.rx_bytes: 92115960421 >>> dev.ix.0.queue6.rx_copies: 8262802 >>> dev.ix.0.queue6.lro_queued: 0 >>> dev.ix.0.queue6.lro_flushed: 0 >>> dev.ix.0.queue7.interrupt_rate: 500000 >>> dev.ix.0.queue7.irqs: 471051540 >>> dev.ix.0.queue7.txd_head: 0 >>> dev.ix.0.queue7.txd_tail: 0 >>> dev.ix.0.queue7.tso_tx: 0 >>> dev.ix.0.queue7.no_tx_dma_setup: 0 >>> dev.ix.0.queue7.no_desc_avail: 0 >>> dev.ix.0.queue7.tx_packets: 0 >>> dev.ix.0.queue7.rxd_head: 640 >>> dev.ix.0.queue7.rxd_tail: 639 >>> dev.ix.0.queue7.rx_packets: 553362982 >>> dev.ix.0.queue7.rx_bytes: 84470102891 >>> dev.ix.0.queue7.rx_copies: 7954102 >>> dev.ix.0.queue7.lro_queued: 0 >>> dev.ix.0.queue7.lro_flushed: 0 >>> dev.ix.0.mac_stats.crc_errs: 2091 >>> dev.ix.0.mac_stats.ill_errs: 26 >>> dev.ix.0.mac_stats.byte_errs: 140 >>> dev.ix.0.mac_stats.short_discards: 0 >>> dev.ix.0.mac_stats.local_faults: 0 >>> dev.ix.0.mac_stats.remote_faults: 0 >>> dev.ix.0.mac_stats.rec_len_errs: 0 >>> dev.ix.0.mac_stats.xon_txd: 0 >>> dev.ix.0.mac_stats.xon_recvd: 0 >>> dev.ix.0.mac_stats.xoff_txd: 0 >>> dev.ix.0.mac_stats.xoff_recvd: 0 >>> dev.ix.0.mac_stats.total_octets_rcvd: 17956217280225 >>> dev.ix.0.mac_stats.good_octets_rcvd: 17945313085409 >>> dev.ix.0.mac_stats.total_pkts_rcvd: 15243381335 >>> dev.ix.0.mac_stats.good_pkts_rcvd: 4550864350 >>> dev.ix.0.mac_stats.mcast_pkts_rcvd: 0 >>> dev.ix.0.mac_stats.bcast_pkts_rcvd: 0 >>> dev.ix.0.mac_stats.rx_frames_64: 721599526 >>> dev.ix.0.mac_stats.rx_frames_65_127: 950131946 >>> dev.ix.0.mac_stats.rx_frames_128_255: 918463009 >>> dev.ix.0.mac_stats.rx_frames_256_511: 291858186 >>> dev.ix.0.mac_stats.rx_frames_512_1023: 237479208 >>> dev.ix.0.mac_stats.rx_frames_1024_1522: 12114578925 >>> dev.ix.0.mac_stats.recv_undersized: 0 >>> dev.ix.0.mac_stats.recv_fragmented: 0 >>> dev.ix.0.mac_stats.recv_oversized: 0 >>> dev.ix.0.mac_stats.recv_jabberd: 5 >>> dev.ix.0.mac_stats.management_pkts_rcvd: 0 >>> dev.ix.0.mac_stats.management_pkts_drpd: 0 >>> dev.ix.0.mac_stats.checksum_errs: 4379061 >>> dev.ix.0.mac_stats.good_octets_txd: 0 >>> dev.ix.0.mac_stats.total_pkts_txd: 0 >>> dev.ix.0.mac_stats.good_pkts_txd: 0 >>> dev.ix.0.mac_stats.bcast_pkts_txd: 0 >>> dev.ix.0.mac_stats.mcast_pkts_txd: 0 >>> dev.ix.0.mac_stats.management_pkts_txd: 0 >>> dev.ix.0.mac_stats.tx_frames_64: 0 >>> dev.ix.0.mac_stats.tx_frames_65_127: 0 >>> dev.ix.0.mac_stats.tx_frames_128_255: 0 >>> dev.ix.0.mac_stats.tx_frames_256_511: 0 >>> dev.ix.0.mac_stats.tx_frames_512_1023: 0 >>> dev.ix.0.mac_stats.tx_frames_1024_1522: 0 >>> >>> # sysctl dev.ix.1 >>> dev.ix.1.%desc: Intel(R) PRO/10GbE PCI-Express Network Driver, Version - 2.5.15 >>> dev.ix.1.%driver: ix >>> dev.ix.1.%location: slot=0 function=1 >>> dev.ix.1.%pnpinfo: vendor=0x8086 device=0x10fb subvendor=0x8086 subdevice=0x0003 class=0x020000 >>> dev.ix.1.%parent: pci4 >>> dev.ix.1.fc: 0 >>> dev.ix.1.enable_aim: 1 >>> dev.ix.1.advertise_speed: 0 >>> dev.ix.1.dropped: 0 >>> dev.ix.1.mbuf_defrag_failed: 0 >>> dev.ix.1.watchdog_events: 0 >>> dev.ix.1.link_irq: 3 >>> dev.ix.1.queue0.interrupt_rate: 500000 >>> dev.ix.1.queue0.irqs: 537134504 >>> dev.ix.1.queue0.txd_head: 0 >>> dev.ix.1.queue0.txd_tail: 0 >>> dev.ix.1.queue0.tso_tx: 0 >>> dev.ix.1.queue0.no_tx_dma_setup: 0 >>> dev.ix.1.queue0.no_desc_avail: 0 >>> dev.ix.1.queue0.tx_packets: 0 >>> dev.ix.1.queue0.rxd_head: 1757 >>> dev.ix.1.queue0.rxd_tail: 1756 >>> dev.ix.1.queue0.rx_packets: 565486932 >>> dev.ix.1.queue0.rx_bytes: 7763122874 >>> dev.ix.1.queue0.rx_copies: 40953968 >>> dev.ix.1.queue0.lro_queued: 0 >>> dev.ix.1.queue0.lro_flushed: 0 >>> dev.ix.1.queue1.interrupt_rate: 500000 >>> dev.ix.1.queue1.irqs: 561383741 >>> dev.ix.1.queue1.txd_head: 0 >>> dev.ix.1.queue1.txd_tail: 0 >>> dev.ix.1.queue1.tso_tx: 0 >>> dev.ix.1.queue1.no_tx_dma_setup: 0 >>> dev.ix.1.queue1.no_desc_avail: 0 >>> dev.ix.1.queue1.tx_packets: 0 >>> dev.ix.1.queue1.rxd_head: 138 >>> dev.ix.1.queue1.rxd_tail: 137 >>> dev.ix.1.queue1.rx_packets: 577262064 >>> dev.ix.1.queue1.rx_bytes: 8709306631 >>> dev.ix.1.queue1.rx_copies: 40844466 >>> dev.ix.1.queue1.lro_queued: 0 >>> dev.ix.1.queue1.lro_flushed: 0 >>> dev.ix.1.queue2.interrupt_rate: 500000 >>> dev.ix.1.queue2.irqs: 547852317 >>> dev.ix.1.queue2.txd_head: 0 >>> dev.ix.1.queue2.txd_tail: 0 >>> dev.ix.1.queue2.tso_tx: 0 >>> dev.ix.1.queue2.no_tx_dma_setup: 0 >>> dev.ix.1.queue2.no_desc_avail: 0 >>> dev.ix.1.queue2.tx_packets: 0 >>> dev.ix.1.queue2.rxd_head: 386 >>> dev.ix.1.queue2.rxd_tail: 385 >>> dev.ix.1.queue2.rx_packets: 562301518 >>> dev.ix.1.queue2.rx_bytes: 6698895889 >>> dev.ix.1.queue2.rx_copies: 40867897 >>> dev.ix.1.queue2.lro_queued: 0 >>> dev.ix.1.queue2.lro_flushed: 0 >>> dev.ix.1.queue3.interrupt_rate: 500000 >>> dev.ix.1.queue3.irqs: 551254360 >>> dev.ix.1.queue3.txd_head: 0 >>> dev.ix.1.queue3.txd_tail: 0 >>> dev.ix.1.queue3.tso_tx: 0 >>> dev.ix.1.queue3.no_tx_dma_setup: 0 >>> dev.ix.1.queue3.no_desc_avail: 0 >>> dev.ix.1.queue3.tx_packets: 0 >>> dev.ix.1.queue3.rxd_head: 1446 >>> dev.ix.1.queue3.rxd_tail: 1445 >>> dev.ix.1.queue3.rx_packets: 566052657 >>> dev.ix.1.queue3.rx_bytes: 8010009389 >>> dev.ix.1.queue3.rx_copies: 41116971 >>> dev.ix.1.queue3.lro_queued: 0 >>> dev.ix.1.queue3.lro_flushed: 0 >>> dev.ix.1.queue4.interrupt_rate: 500000 >>> dev.ix.1.queue4.irqs: 546581703 >>> dev.ix.1.queue4.txd_head: 0 >>> dev.ix.1.queue4.txd_tail: 0 >>> dev.ix.1.queue4.tso_tx: 0 >>> dev.ix.1.queue4.no_tx_dma_setup: 0 >>> dev.ix.1.queue4.no_desc_avail: 0 >>> dev.ix.1.queue4.tx_packets: 0 >>> dev.ix.1.queue4.rxd_head: 965 >>> dev.ix.1.queue4.rxd_tail: 964 >>> dev.ix.1.queue4.rx_packets: 561519824 >>> dev.ix.1.queue4.rx_bytes: 7656671816 >>> dev.ix.1.queue4.rx_copies: 41183608 >>> dev.ix.1.queue4.lro_queued: 0 >>> dev.ix.1.queue4.lro_flushed: 0 >>> dev.ix.1.queue5.interrupt_rate: 500000 >>> dev.ix.1.queue5.irqs: 557099892 >>> dev.ix.1.queue5.txd_head: 0 >>> dev.ix.1.queue5.txd_tail: 0 >>> dev.ix.1.queue5.tso_tx: 0 >>> dev.ix.1.queue5.no_tx_dma_setup: 0 >>> dev.ix.1.queue5.no_desc_avail: 0 >>> dev.ix.1.queue5.tx_packets: 0 >>> dev.ix.1.queue5.rxd_head: 1788 >>> dev.ix.1.queue5.rxd_tail: 1787 >>> dev.ix.1.queue5.rx_packets: 572588639 >>> dev.ix.1.queue5.rx_bytes: 7259699024 >>> dev.ix.1.queue5.rx_copies: 43207640 >>> dev.ix.1.queue5.lro_queued: 0 >>> dev.ix.1.queue5.lro_flushed: 0 >>> dev.ix.1.queue6.interrupt_rate: 500000 >>> dev.ix.1.queue6.irqs: 574139280 >>> dev.ix.1.queue6.txd_head: 0 >>> dev.ix.1.queue6.txd_tail: 0 >>> dev.ix.1.queue6.tso_tx: 0 >>> dev.ix.1.queue6.no_tx_dma_setup: 0 >>> dev.ix.1.queue6.no_desc_avail: 0 >>> dev.ix.1.queue6.tx_packets: 0 >>> dev.ix.1.queue6.rxd_head: 45 >>> dev.ix.1.queue6.rxd_tail: 44 >>> dev.ix.1.queue6.rx_packets: 589160795 >>> dev.ix.1.queue6.rx_bytes: 7475849844 >>> dev.ix.1.queue6.rx_copies: 40589940 >>> dev.ix.1.queue6.lro_queued: 0 >>> dev.ix.1.queue6.lro_flushed: 0 >>> dev.ix.1.queue7.interrupt_rate: 500000 >>> dev.ix.1.queue7.irqs: 552769977 >>> dev.ix.1.queue7.txd_head: 0 >>> dev.ix.1.queue7.txd_tail: 0 >>> dev.ix.1.queue7.tso_tx: 0 >>> dev.ix.1.queue7.no_tx_dma_setup: 0 >>> dev.ix.1.queue7.no_desc_avail: 0 >>> dev.ix.1.queue7.tx_packets: 0 >>> dev.ix.1.queue7.rxd_head: 1050 >>> dev.ix.1.queue7.rxd_tail: 1049 >>> dev.ix.1.queue7.rx_packets: 567580543 >>> dev.ix.1.queue7.rx_bytes: 7210216689 >>> dev.ix.1.queue7.rx_copies: 41856967 >>> dev.ix.1.queue7.lro_queued: 0 >>> dev.ix.1.queue7.lro_flushed: 0 >>> dev.ix.1.mac_stats.crc_errs: 40044743 >>> dev.ix.1.mac_stats.ill_errs: 4347098 >>> dev.ix.1.mac_stats.byte_errs: 7192103 >>> dev.ix.1.mac_stats.short_discards: 49169 >>> dev.ix.1.mac_stats.local_faults: 0 >>> dev.ix.1.mac_stats.remote_faults: 0 >>> dev.ix.1.mac_stats.rec_len_errs: 41772 >>> dev.ix.1.mac_stats.xon_txd: 0 >>> dev.ix.1.mac_stats.xon_recvd: 0 >>> dev.ix.1.mac_stats.xoff_txd: 0 >>> dev.ix.1.mac_stats.xoff_recvd: 0 >>> dev.ix.1.mac_stats.total_octets_rcvd: 1741353301146 >>> dev.ix.1.mac_stats.good_octets_rcvd: 1704100700961 >>> dev.ix.1.mac_stats.total_pkts_rcvd: 9354020520 >>> dev.ix.1.mac_stats.good_pkts_rcvd: 4561867527 >>> dev.ix.1.mac_stats.mcast_pkts_rcvd: 139746 >>> dev.ix.1.mac_stats.bcast_pkts_rcvd: 0 >>> dev.ix.1.mac_stats.rx_frames_64: 3314959123 >>> dev.ix.1.mac_stats.rx_frames_65_127: 4610233544 >>> dev.ix.1.mac_stats.rx_frames_128_255: 256517169 >>> dev.ix.1.mac_stats.rx_frames_256_511: 304326606 >>> dev.ix.1.mac_stats.rx_frames_512_1023: 223999237 >>> dev.ix.1.mac_stats.rx_frames_1024_1522: 591102680 >>> dev.ix.1.mac_stats.recv_undersized: 0 >>> dev.ix.1.mac_stats.recv_fragmented: 0 >>> dev.ix.1.mac_stats.recv_oversized: 0 >>> dev.ix.1.mac_stats.recv_jabberd: 71008 >>> dev.ix.1.mac_stats.management_pkts_rcvd: 0 >>> dev.ix.1.mac_stats.management_pkts_drpd: 0 >>> dev.ix.1.mac_stats.checksum_errs: 3901883 >>> dev.ix.1.mac_stats.good_octets_txd: 0 >>> dev.ix.1.mac_stats.total_pkts_txd: 0 >>> dev.ix.1.mac_stats.good_pkts_txd: 0 >>> dev.ix.1.mac_stats.bcast_pkts_txd: 0 >>> dev.ix.1.mac_stats.mcast_pkts_txd: 0 >>> dev.ix.1.mac_stats.management_pkts_txd: 0 >>> dev.ix.1.mac_stats.tx_frames_64: 0 >>> dev.ix.1.mac_stats.tx_frames_65_127: 0 >>> dev.ix.1.mac_stats.tx_frames_128_255: 0 >>> dev.ix.1.mac_stats.tx_frames_256_511: 0 >>> dev.ix.1.mac_stats.tx_frames_512_1023: 0 >>> dev.ix.1.mac_stats.tx_frames_1024_1522: 0 >>> _______________________________________________ >>> freebsd-net@freebsd.org <mailto:freebsd-net@freebsd.org> mailing list >>> http://lists.freebsd.org/mailman/listinfo/freebsd-net <http://lists.freebsd.org/mailman/listinfo/freebsd-net>; >>> To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org" <mailto:freebsd-net-unsubscribe@freebsd.org> >> -- >> Babak Farrokhi >> > > _______________________________________________ > freebsd-net@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-net > To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org" > Babak Farrokhi <mailto:babak@farrokhi.net> > May 23, 2015 at 10:44 PM > Look at the interrupts per queue. 500,000 is the maximum and it is the > reason your interface is not accepting new packets. > > > > Guy Helmer <mailto:guy.helmer@gmail.com> > May 21, 2015 at 6:03 PM > I’ve noticed that there have been reports of problems with Intel > X520-SR2 network interfaces stopping working. I think I’m seeing a > similar issue where the 10Gb interfaces stop receiving traffic > (they’re being used in promiscuous mode to sniff traffic from a tap). > ifconfig shows the interfaces are still active and the links are OK. > ifconfig down/up restores activity. I’ve changed > hw.intr_storm_threshold=8000 but I couldn’t tell if the interrupt > storm threshold had been triggered at the time the interfaces stopped > passing traffic. > > Output from sysctl: > > # sysctl dev.ix.0 > dev.ix.0.%desc: Intel(R) PRO/10GbE PCI-Express Network Driver, Version > - 2.5.15 > dev.ix.0.%driver: ix > dev.ix.0.%location: slot=0 function=0 > dev.ix.0.%pnpinfo: vendor=0x8086 device=0x10fb subvendor=0x8086 > subdevice=0x0003 class=0x020000 > dev.ix.0.%parent: pci4 > dev.ix.0.fc: 0 > dev.ix.0.enable_aim: 1 > dev.ix.0.advertise_speed: 0 > dev.ix.0.dropped: 0 > dev.ix.0.mbuf_defrag_failed: 0 > dev.ix.0.watchdog_events: 0 > dev.ix.0.link_irq: 3 > dev.ix.0.queue0.interrupt_rate: 500000 > dev.ix.0.queue0.irqs: 454449470 > dev.ix.0.queue0.txd_head: 0 > dev.ix.0.queue0.txd_tail: 0 > dev.ix.0.queue0.tso_tx: 0 > dev.ix.0.queue0.no_tx_dma_setup: 0 > dev.ix.0.queue0.no_desc_avail: 0 > dev.ix.0.queue0.tx_packets: 0 > dev.ix.0.queue0.rxd_head: 1437 > dev.ix.0.queue0.rxd_tail: 1436 > dev.ix.0.queue0.rx_packets: 547499168 > dev.ix.0.queue0.rx_bytes: 87201112584 > dev.ix.0.queue0.rx_copies: 7934870 > dev.ix.0.queue0.lro_queued: 0 > dev.ix.0.queue0.lro_flushed: 0 > dev.ix.0.queue1.interrupt_rate: 500000 > dev.ix.0.queue1.irqs: 466235043 > dev.ix.0.queue1.txd_head: 0 > dev.ix.0.queue1.txd_tail: 0 > dev.ix.0.queue1.tso_tx: 0 > dev.ix.0.queue1.no_tx_dma_setup: 0 > dev.ix.0.queue1.no_desc_avail: 0 > dev.ix.0.queue1.tx_packets: 0 > dev.ix.0.queue1.rxd_head: 277 > dev.ix.0.queue1.rxd_tail: 276 > dev.ix.0.queue1.rx_packets: 547668680 > dev.ix.0.queue1.rx_bytes: 86205679601 > dev.ix.0.queue1.rx_copies: 7846653 > dev.ix.0.queue1.lro_queued: 0 > dev.ix.0.queue1.lro_flushed: 0 > dev.ix.0.queue2.interrupt_rate: 500000 > dev.ix.0.queue2.irqs: 473958473 > dev.ix.0.queue2.txd_head: 0 > dev.ix.0.queue2.txd_tail: 0 > dev.ix.0.queue2.tso_tx: 0 > dev.ix.0.queue2.no_tx_dma_setup: 0 > dev.ix.0.queue2.no_desc_avail: 0 > dev.ix.0.queue2.tx_packets: 0 > dev.ix.0.queue2.rxd_head: 576 > dev.ix.0.queue2.rxd_tail: 575 > dev.ix.0.queue2.rx_packets: 555704840 > dev.ix.0.queue2.rx_bytes: 87294164455 > dev.ix.0.queue2.rx_copies: 8297211 > dev.ix.0.queue2.lro_queued: 0 > dev.ix.0.queue2.lro_flushed: 0 > dev.ix.0.queue3.interrupt_rate: 500000 > dev.ix.0.queue3.irqs: 477587504 > dev.ix.0.queue3.txd_head: 0 > dev.ix.0.queue3.txd_tail: 0 > dev.ix.0.queue3.tso_tx: 0 > dev.ix.0.queue3.no_tx_dma_setup: 0 > dev.ix.0.queue3.no_desc_avail: 0 > dev.ix.0.queue3.tx_packets: 0 > dev.ix.0.queue3.rxd_head: 267 > dev.ix.0.queue3.rxd_tail: 266 > dev.ix.0.queue3.rx_packets: 559921557 > dev.ix.0.queue3.rx_bytes: 86832161258 > dev.ix.0.queue3.rx_copies: 7918011 > dev.ix.0.queue3.lro_queued: 0 > dev.ix.0.queue3.lro_flushed: 0 > dev.ix.0.queue4.interrupt_rate: 500000 > dev.ix.0.queue4.irqs: 558339677 > dev.ix.0.queue4.txd_head: 0 > dev.ix.0.queue4.txd_tail: 0 > dev.ix.0.queue4.tso_tx: 0 > dev.ix.0.queue4.no_tx_dma_setup: 0 > dev.ix.0.queue4.no_desc_avail: 0 > dev.ix.0.queue4.tx_packets: 0 > dev.ix.0.queue4.rxd_head: 1240 > dev.ix.0.queue4.rxd_tail: 1239 > dev.ix.0.queue4.rx_packets: 646909190 > dev.ix.0.queue4.rx_bytes: 87117307815 > dev.ix.0.queue4.rx_copies: 7944848 > dev.ix.0.queue4.lro_queued: 0 > dev.ix.0.queue4.lro_flushed: 0 > dev.ix.0.queue5.interrupt_rate: 500000 > dev.ix.0.queue5.irqs: 467836647 > dev.ix.0.queue5.txd_head: 0 > dev.ix.0.queue5.txd_tail: 0 > dev.ix.0.queue5.tso_tx: 0 > dev.ix.0.queue5.no_tx_dma_setup: 0 > dev.ix.0.queue5.no_desc_avail: 0 > dev.ix.0.queue5.tx_packets: 0 > dev.ix.0.queue5.rxd_head: 1411 > dev.ix.0.queue5.rxd_tail: 1410 > dev.ix.0.queue5.rx_packets: 549666835 > dev.ix.0.queue5.rx_bytes: 84671540121 > dev.ix.0.queue5.rx_copies: 8258025 > dev.ix.0.queue5.lro_queued: 0 > dev.ix.0.queue5.lro_flushed: 0 > dev.ix.0.queue6.interrupt_rate: 500000 > dev.ix.0.queue6.irqs: 490798561 > dev.ix.0.queue6.txd_head: 0 > dev.ix.0.queue6.txd_tail: 0 > dev.ix.0.queue6.tso_tx: 0 > dev.ix.0.queue6.no_tx_dma_setup: 0 > dev.ix.0.queue6.no_desc_avail: 0 > dev.ix.0.queue6.tx_packets: 0 > dev.ix.0.queue6.rxd_head: 160 > dev.ix.0.queue6.rxd_tail: 159 > dev.ix.0.queue6.rx_packets: 590187606 > dev.ix.0.queue6.rx_bytes: 92115960421 > dev.ix.0.queue6.rx_copies: 8262802 > dev.ix.0.queue6.lro_queued: 0 > dev.ix.0.queue6.lro_flushed: 0 > dev.ix.0.queue7.interrupt_rate: 500000 > dev.ix.0.queue7.irqs: 471051540 > dev.ix.0.queue7.txd_head: 0 > dev.ix.0.queue7.txd_tail: 0 > dev.ix.0.queue7.tso_tx: 0 > dev.ix.0.queue7.no_tx_dma_setup: 0 > dev.ix.0.queue7.no_desc_avail: 0 > dev.ix.0.queue7.tx_packets: 0 > dev.ix.0.queue7.rxd_head: 640 > dev.ix.0.queue7.rxd_tail: 639 > dev.ix.0.queue7.rx_packets: 553362982 > dev.ix.0.queue7.rx_bytes: 84470102891 > dev.ix.0.queue7.rx_copies: 7954102 > dev.ix.0.queue7.lro_queued: 0 > dev.ix.0.queue7.lro_flushed: 0 > dev.ix.0.mac_stats.crc_errs: 2091 > dev.ix.0.mac_stats.ill_errs: 26 > dev.ix.0.mac_stats.byte_errs: 140 > dev.ix.0.mac_stats.short_discards: 0 > dev.ix.0.mac_stats.local_faults: 0 > dev.ix.0.mac_stats.remote_faults: 0 > dev.ix.0.mac_stats.rec_len_errs: 0 > dev.ix.0.mac_stats.xon_txd: 0 > dev.ix.0.mac_stats.xon_recvd: 0 > dev.ix.0.mac_stats.xoff_txd: 0 > dev.ix.0.mac_stats.xoff_recvd: 0 > dev.ix.0.mac_stats.total_octets_rcvd: 17956217280225 > dev.ix.0.mac_stats.good_octets_rcvd: 17945313085409 > dev.ix.0.mac_stats.total_pkts_rcvd: 15243381335 > dev.ix.0.mac_stats.good_pkts_rcvd: 4550864350 > dev.ix.0.mac_stats.mcast_pkts_rcvd: 0 > dev.ix.0.mac_stats.bcast_pkts_rcvd: 0 > dev.ix.0.mac_stats.rx_frames_64: 721599526 > dev.ix.0.mac_stats.rx_frames_65_127: 950131946 > dev.ix.0.mac_stats.rx_frames_128_255: 918463009 > dev.ix.0.mac_stats.rx_frames_256_511: 291858186 > dev.ix.0.mac_stats.rx_frames_512_1023: 237479208 > dev.ix.0.mac_stats.rx_frames_1024_1522: 12114578925 > dev.ix.0.mac_stats.recv_undersized: 0 > dev.ix.0.mac_stats.recv_fragmented: 0 > dev.ix.0.mac_stats.recv_oversized: 0 > dev.ix.0.mac_stats.recv_jabberd: 5 > dev.ix.0.mac_stats.management_pkts_rcvd: 0 > dev.ix.0.mac_stats.management_pkts_drpd: 0 > dev.ix.0.mac_stats.checksum_errs: 4379061 > dev.ix.0.mac_stats.good_octets_txd: 0 > dev.ix.0.mac_stats.total_pkts_txd: 0 > dev.ix.0.mac_stats.good_pkts_txd: 0 > dev.ix.0.mac_stats.bcast_pkts_txd: 0 > dev.ix.0.mac_stats.mcast_pkts_txd: 0 > dev.ix.0.mac_stats.management_pkts_txd: 0 > dev.ix.0.mac_stats.tx_frames_64: 0 > dev.ix.0.mac_stats.tx_frames_65_127: 0 > dev.ix.0.mac_stats.tx_frames_128_255: 0 > dev.ix.0.mac_stats.tx_frames_256_511: 0 > dev.ix.0.mac_stats.tx_frames_512_1023: 0 > dev.ix.0.mac_stats.tx_frames_1024_1522: 0 > > # sysctl dev.ix.1 > dev.ix.1.%desc: Intel(R) PRO/10GbE PCI-Express Network Driver, Version > - 2.5.15 > dev.ix.1.%driver: ix > dev.ix.1.%location: slot=0 function=1 > dev.ix.1.%pnpinfo: vendor=0x8086 device=0x10fb subvendor=0x8086 > subdevice=0x0003 class=0x020000 > dev.ix.1.%parent: pci4 > dev.ix.1.fc: 0 > dev.ix.1.enable_aim: 1 > dev.ix.1.advertise_speed: 0 > dev.ix.1.dropped: 0 > dev.ix.1.mbuf_defrag_failed: 0 > dev.ix.1.watchdog_events: 0 > dev.ix.1.link_irq: 3 > dev.ix.1.queue0.interrupt_rate: 500000 > dev.ix.1.queue0.irqs: 537134504 > dev.ix.1.queue0.txd_head: 0 > dev.ix.1.queue0.txd_tail: 0 > dev.ix.1.queue0.tso_tx: 0 > dev.ix.1.queue0.no_tx_dma_setup: 0 > dev.ix.1.queue0.no_desc_avail: 0 > dev.ix.1.queue0.tx_packets: 0 > dev.ix.1.queue0.rxd_head: 1757 > dev.ix.1.queue0.rxd_tail: 1756 > dev.ix.1.queue0.rx_packets: 565486932 > dev.ix.1.queue0.rx_bytes: 7763122874 > dev.ix.1.queue0.rx_copies: 40953968 > dev.ix.1.queue0.lro_queued: 0 > dev.ix.1.queue0.lro_flushed: 0 > dev.ix.1.queue1.interrupt_rate: 500000 > dev.ix.1.queue1.irqs: 561383741 > dev.ix.1.queue1.txd_head: 0 > dev.ix.1.queue1.txd_tail: 0 > dev.ix.1.queue1.tso_tx: 0 > dev.ix.1.queue1.no_tx_dma_setup: 0 > dev.ix.1.queue1.no_desc_avail: 0 > dev.ix.1.queue1.tx_packets: 0 > dev.ix.1.queue1.rxd_head: 138 > dev.ix.1.queue1.rxd_tail: 137 > dev.ix.1.queue1.rx_packets: 577262064 > dev.ix.1.queue1.rx_bytes: 8709306631 > dev.ix.1.queue1.rx_copies: 40844466 > dev.ix.1.queue1.lro_queued: 0 > dev.ix.1.queue1.lro_flushed: 0 > dev.ix.1.queue2.interrupt_rate: 500000 > dev.ix.1.queue2.irqs: 547852317 > dev.ix.1.queue2.txd_head: 0 > dev.ix.1.queue2.txd_tail: 0 > dev.ix.1.queue2.tso_tx: 0 > dev.ix.1.queue2.no_tx_dma_setup: 0 > dev.ix.1.queue2.no_desc_avail: 0 > dev.ix.1.queue2.tx_packets: 0 > dev.ix.1.queue2.rxd_head: 386 > dev.ix.1.queue2.rxd_tail: 385 > dev.ix.1.queue2.rx_packets: 562301518 > dev.ix.1.queue2.rx_bytes: 6698895889 > dev.ix.1.queue2.rx_copies: 40867897 > dev.ix.1.queue2.lro_queued: 0 > dev.ix.1.queue2.lro_flushed: 0 > dev.ix.1.queue3.interrupt_rate: 500000 > dev.ix.1.queue3.irqs: 551254360 > dev.ix.1.queue3.txd_head: 0 > dev.ix.1.queue3.txd_tail: 0 > dev.ix.1.queue3.tso_tx: 0 > dev.ix.1.queue3.no_tx_dma_setup: 0 > dev.ix.1.queue3.no_desc_avail: 0 > dev.ix.1.queue3.tx_packets: 0 > dev.ix.1.queue3.rxd_head: 1446 > dev.ix.1.queue3.rxd_tail: 1445 > dev.ix.1.queue3.rx_packets: 566052657 > dev.ix.1.queue3.rx_bytes: 8010009389 > dev.ix.1.queue3.rx_copies: 41116971 > dev.ix.1.queue3.lro_queued: 0 > dev.ix.1.queue3.lro_flushed: 0 > dev.ix.1.queue4.interrupt_rate: 500000 > dev.ix.1.queue4.irqs: 546581703 > dev.ix.1.queue4.txd_head: 0 > dev.ix.1.queue4.txd_tail: 0 > dev.ix.1.queue4.tso_tx: 0 > dev.ix.1.queue4.no_tx_dma_setup: 0 > dev.ix.1.queue4.no_desc_avail: 0 > dev.ix.1.queue4.tx_packets: 0 > dev.ix.1.queue4.rxd_head: 965 > dev.ix.1.queue4.rxd_tail: 964 > dev.ix.1.queue4.rx_packets: 561519824 > dev.ix.1.queue4.rx_bytes: 7656671816 > dev.ix.1.queue4.rx_copies: 41183608 > dev.ix.1.queue4.lro_queued: 0 > dev.ix.1.queue4.lro_flushed: 0 > dev.ix.1.queue5.interrupt_rate: 500000 > dev.ix.1.queue5.irqs: 557099892 > dev.ix.1.queue5.txd_head: 0 > dev.ix.1.queue5.txd_tail: 0 > dev.ix.1.queue5.tso_tx: 0 > dev.ix.1.queue5.no_tx_dma_setup: 0 > dev.ix.1.queue5.no_desc_avail: 0 > dev.ix.1.queue5.tx_packets: 0 > dev.ix.1.queue5.rxd_head: 1788 > dev.ix.1.queue5.rxd_tail: 1787 > dev.ix.1.queue5.rx_packets: 572588639 > dev.ix.1.queue5.rx_bytes: 7259699024 > dev.ix.1.queue5.rx_copies: 43207640 > dev.ix.1.queue5.lro_queued: 0 > dev.ix.1.queue5.lro_flushed: 0 > dev.ix.1.queue6.interrupt_rate: 500000 > dev.ix.1.queue6.irqs: 574139280 > dev.ix.1.queue6.txd_head: 0 > dev.ix.1.queue6.txd_tail: 0 > dev.ix.1.queue6.tso_tx: 0 > dev.ix.1.queue6.no_tx_dma_setup: 0 > dev.ix.1.queue6.no_desc_avail: 0 > dev.ix.1.queue6.tx_packets: 0 > dev.ix.1.queue6.rxd_head: 45 > dev.ix.1.queue6.rxd_tail: 44 > dev.ix.1.queue6.rx_packets: 589160795 > dev.ix.1.queue6.rx_bytes: 7475849844 > dev.ix.1.queue6.rx_copies: 40589940 > dev.ix.1.queue6.lro_queued: 0 > dev.ix.1.queue6.lro_flushed: 0 > dev.ix.1.queue7.interrupt_rate: 500000 > dev.ix.1.queue7.irqs: 552769977 > dev.ix.1.queue7.txd_head: 0 > dev.ix.1.queue7.txd_tail: 0 > dev.ix.1.queue7.tso_tx: 0 > dev.ix.1.queue7.no_tx_dma_setup: 0 > dev.ix.1.queue7.no_desc_avail: 0 > dev.ix.1.queue7.tx_packets: 0 > dev.ix.1.queue7.rxd_head: 1050 > dev.ix.1.queue7.rxd_tail: 1049 > dev.ix.1.queue7.rx_packets: 567580543 > dev.ix.1.queue7.rx_bytes: 7210216689 > dev.ix.1.queue7.rx_copies: 41856967 > dev.ix.1.queue7.lro_queued: 0 > dev.ix.1.queue7.lro_flushed: 0 > dev.ix.1.mac_stats.crc_errs: 40044743 > dev.ix.1.mac_stats.ill_errs: 4347098 > dev.ix.1.mac_stats.byte_errs: 7192103 > dev.ix.1.mac_stats.short_discards: 49169 > dev.ix.1.mac_stats.local_faults: 0 > dev.ix.1.mac_stats.remote_faults: 0 > dev.ix.1.mac_stats.rec_len_errs: 41772 > dev.ix.1.mac_stats.xon_txd: 0 > dev.ix.1.mac_stats.xon_recvd: 0 > dev.ix.1.mac_stats.xoff_txd: 0 > dev.ix.1.mac_stats.xoff_recvd: 0 > dev.ix.1.mac_stats.total_octets_rcvd: 1741353301146 > dev.ix.1.mac_stats.good_octets_rcvd: 1704100700961 > dev.ix.1.mac_stats.total_pkts_rcvd: 9354020520 > dev.ix.1.mac_stats.good_pkts_rcvd: 4561867527 > dev.ix.1.mac_stats.mcast_pkts_rcvd: 139746 > dev.ix.1.mac_stats.bcast_pkts_rcvd: 0 > dev.ix.1.mac_stats.rx_frames_64: 3314959123 > dev.ix.1.mac_stats.rx_frames_65_127: 4610233544 > dev.ix.1.mac_stats.rx_frames_128_255: 256517169 > dev.ix.1.mac_stats.rx_frames_256_511: 304326606 > dev.ix.1.mac_stats.rx_frames_512_1023: 223999237 > dev.ix.1.mac_stats.rx_frames_1024_1522: 591102680 > dev.ix.1.mac_stats.recv_undersized: 0 > dev.ix.1.mac_stats.recv_fragmented: 0 > dev.ix.1.mac_stats.recv_oversized: 0 > dev.ix.1.mac_stats.recv_jabberd: 71008 > dev.ix.1.mac_stats.management_pkts_rcvd: 0 > dev.ix.1.mac_stats.management_pkts_drpd: 0 > dev.ix.1.mac_stats.checksum_errs: 3901883 > dev.ix.1.mac_stats.good_octets_txd: 0 > dev.ix.1.mac_stats.total_pkts_txd: 0 > dev.ix.1.mac_stats.good_pkts_txd: 0 > dev.ix.1.mac_stats.bcast_pkts_txd: 0 > dev.ix.1.mac_stats.mcast_pkts_txd: 0 > dev.ix.1.mac_stats.management_pkts_txd: 0 > dev.ix.1.mac_stats.tx_frames_64: 0 > dev.ix.1.mac_stats.tx_frames_65_127: 0 > dev.ix.1.mac_stats.tx_frames_128_255: 0 > dev.ix.1.mac_stats.tx_frames_256_511: 0 > dev.ix.1.mac_stats.tx_frames_512_1023: 0 > dev.ix.1.mac_stats.tx_frames_1024_1522: 0 > _______________________________________________ > freebsd-net@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-net > To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org" -- Babak Farrokhi
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?5567662A.9060406>