Date: Sat, 23 May 2015 22:44:45 +0430 From: Babak Farrokhi <babak@farrokhi.net> To: Guy Helmer <guy.helmer@gmail.com> Cc: freebsd-net@freebsd.org Subject: Re: FreeBSD 9.3 - Intel X520-SR2 stops passing packets Message-ID: <5560C395.8020807@farrokhi.net> In-Reply-To: <C8B78CF4-184C-4BFE-B848-37A91A3B696B@gmail.com> References: <C8B78CF4-184C-4BFE-B848-37A91A3B696B@gmail.com>
next in thread | previous in thread | raw e-mail | index | archive | help
Look at the interrupts per queue. 500,000 is the maximum and it is the reason your interface is not accepting new packets. > Guy Helmer <mailto:guy.helmer@gmail.com> > May 21, 2015 at 6:03 PM > I’ve noticed that there have been reports of problems with Intel > X520-SR2 network interfaces stopping working. I think I’m seeing a > similar issue where the 10Gb interfaces stop receiving traffic > (they’re being used in promiscuous mode to sniff traffic from a tap). > ifconfig shows the interfaces are still active and the links are OK. > ifconfig down/up restores activity. I’ve changed > hw.intr_storm_threshold=8000 but I couldn’t tell if the interrupt > storm threshold had been triggered at the time the interfaces stopped > passing traffic. > > Output from sysctl: > > # sysctl dev.ix.0 > dev.ix.0.%desc: Intel(R) PRO/10GbE PCI-Express Network Driver, Version > - 2.5.15 > dev.ix.0.%driver: ix > dev.ix.0.%location: slot=0 function=0 > dev.ix.0.%pnpinfo: vendor=0x8086 device=0x10fb subvendor=0x8086 > subdevice=0x0003 class=0x020000 > dev.ix.0.%parent: pci4 > dev.ix.0.fc: 0 > dev.ix.0.enable_aim: 1 > dev.ix.0.advertise_speed: 0 > dev.ix.0.dropped: 0 > dev.ix.0.mbuf_defrag_failed: 0 > dev.ix.0.watchdog_events: 0 > dev.ix.0.link_irq: 3 > dev.ix.0.queue0.interrupt_rate: 500000 > dev.ix.0.queue0.irqs: 454449470 > dev.ix.0.queue0.txd_head: 0 > dev.ix.0.queue0.txd_tail: 0 > dev.ix.0.queue0.tso_tx: 0 > dev.ix.0.queue0.no_tx_dma_setup: 0 > dev.ix.0.queue0.no_desc_avail: 0 > dev.ix.0.queue0.tx_packets: 0 > dev.ix.0.queue0.rxd_head: 1437 > dev.ix.0.queue0.rxd_tail: 1436 > dev.ix.0.queue0.rx_packets: 547499168 > dev.ix.0.queue0.rx_bytes: 87201112584 > dev.ix.0.queue0.rx_copies: 7934870 > dev.ix.0.queue0.lro_queued: 0 > dev.ix.0.queue0.lro_flushed: 0 > dev.ix.0.queue1.interrupt_rate: 500000 > dev.ix.0.queue1.irqs: 466235043 > dev.ix.0.queue1.txd_head: 0 > dev.ix.0.queue1.txd_tail: 0 > dev.ix.0.queue1.tso_tx: 0 > dev.ix.0.queue1.no_tx_dma_setup: 0 > dev.ix.0.queue1.no_desc_avail: 0 > dev.ix.0.queue1.tx_packets: 0 > dev.ix.0.queue1.rxd_head: 277 > dev.ix.0.queue1.rxd_tail: 276 > dev.ix.0.queue1.rx_packets: 547668680 > dev.ix.0.queue1.rx_bytes: 86205679601 > dev.ix.0.queue1.rx_copies: 7846653 > dev.ix.0.queue1.lro_queued: 0 > dev.ix.0.queue1.lro_flushed: 0 > dev.ix.0.queue2.interrupt_rate: 500000 > dev.ix.0.queue2.irqs: 473958473 > dev.ix.0.queue2.txd_head: 0 > dev.ix.0.queue2.txd_tail: 0 > dev.ix.0.queue2.tso_tx: 0 > dev.ix.0.queue2.no_tx_dma_setup: 0 > dev.ix.0.queue2.no_desc_avail: 0 > dev.ix.0.queue2.tx_packets: 0 > dev.ix.0.queue2.rxd_head: 576 > dev.ix.0.queue2.rxd_tail: 575 > dev.ix.0.queue2.rx_packets: 555704840 > dev.ix.0.queue2.rx_bytes: 87294164455 > dev.ix.0.queue2.rx_copies: 8297211 > dev.ix.0.queue2.lro_queued: 0 > dev.ix.0.queue2.lro_flushed: 0 > dev.ix.0.queue3.interrupt_rate: 500000 > dev.ix.0.queue3.irqs: 477587504 > dev.ix.0.queue3.txd_head: 0 > dev.ix.0.queue3.txd_tail: 0 > dev.ix.0.queue3.tso_tx: 0 > dev.ix.0.queue3.no_tx_dma_setup: 0 > dev.ix.0.queue3.no_desc_avail: 0 > dev.ix.0.queue3.tx_packets: 0 > dev.ix.0.queue3.rxd_head: 267 > dev.ix.0.queue3.rxd_tail: 266 > dev.ix.0.queue3.rx_packets: 559921557 > dev.ix.0.queue3.rx_bytes: 86832161258 > dev.ix.0.queue3.rx_copies: 7918011 > dev.ix.0.queue3.lro_queued: 0 > dev.ix.0.queue3.lro_flushed: 0 > dev.ix.0.queue4.interrupt_rate: 500000 > dev.ix.0.queue4.irqs: 558339677 > dev.ix.0.queue4.txd_head: 0 > dev.ix.0.queue4.txd_tail: 0 > dev.ix.0.queue4.tso_tx: 0 > dev.ix.0.queue4.no_tx_dma_setup: 0 > dev.ix.0.queue4.no_desc_avail: 0 > dev.ix.0.queue4.tx_packets: 0 > dev.ix.0.queue4.rxd_head: 1240 > dev.ix.0.queue4.rxd_tail: 1239 > dev.ix.0.queue4.rx_packets: 646909190 > dev.ix.0.queue4.rx_bytes: 87117307815 > dev.ix.0.queue4.rx_copies: 7944848 > dev.ix.0.queue4.lro_queued: 0 > dev.ix.0.queue4.lro_flushed: 0 > dev.ix.0.queue5.interrupt_rate: 500000 > dev.ix.0.queue5.irqs: 467836647 > dev.ix.0.queue5.txd_head: 0 > dev.ix.0.queue5.txd_tail: 0 > dev.ix.0.queue5.tso_tx: 0 > dev.ix.0.queue5.no_tx_dma_setup: 0 > dev.ix.0.queue5.no_desc_avail: 0 > dev.ix.0.queue5.tx_packets: 0 > dev.ix.0.queue5.rxd_head: 1411 > dev.ix.0.queue5.rxd_tail: 1410 > dev.ix.0.queue5.rx_packets: 549666835 > dev.ix.0.queue5.rx_bytes: 84671540121 > dev.ix.0.queue5.rx_copies: 8258025 > dev.ix.0.queue5.lro_queued: 0 > dev.ix.0.queue5.lro_flushed: 0 > dev.ix.0.queue6.interrupt_rate: 500000 > dev.ix.0.queue6.irqs: 490798561 > dev.ix.0.queue6.txd_head: 0 > dev.ix.0.queue6.txd_tail: 0 > dev.ix.0.queue6.tso_tx: 0 > dev.ix.0.queue6.no_tx_dma_setup: 0 > dev.ix.0.queue6.no_desc_avail: 0 > dev.ix.0.queue6.tx_packets: 0 > dev.ix.0.queue6.rxd_head: 160 > dev.ix.0.queue6.rxd_tail: 159 > dev.ix.0.queue6.rx_packets: 590187606 > dev.ix.0.queue6.rx_bytes: 92115960421 > dev.ix.0.queue6.rx_copies: 8262802 > dev.ix.0.queue6.lro_queued: 0 > dev.ix.0.queue6.lro_flushed: 0 > dev.ix.0.queue7.interrupt_rate: 500000 > dev.ix.0.queue7.irqs: 471051540 > dev.ix.0.queue7.txd_head: 0 > dev.ix.0.queue7.txd_tail: 0 > dev.ix.0.queue7.tso_tx: 0 > dev.ix.0.queue7.no_tx_dma_setup: 0 > dev.ix.0.queue7.no_desc_avail: 0 > dev.ix.0.queue7.tx_packets: 0 > dev.ix.0.queue7.rxd_head: 640 > dev.ix.0.queue7.rxd_tail: 639 > dev.ix.0.queue7.rx_packets: 553362982 > dev.ix.0.queue7.rx_bytes: 84470102891 > dev.ix.0.queue7.rx_copies: 7954102 > dev.ix.0.queue7.lro_queued: 0 > dev.ix.0.queue7.lro_flushed: 0 > dev.ix.0.mac_stats.crc_errs: 2091 > dev.ix.0.mac_stats.ill_errs: 26 > dev.ix.0.mac_stats.byte_errs: 140 > dev.ix.0.mac_stats.short_discards: 0 > dev.ix.0.mac_stats.local_faults: 0 > dev.ix.0.mac_stats.remote_faults: 0 > dev.ix.0.mac_stats.rec_len_errs: 0 > dev.ix.0.mac_stats.xon_txd: 0 > dev.ix.0.mac_stats.xon_recvd: 0 > dev.ix.0.mac_stats.xoff_txd: 0 > dev.ix.0.mac_stats.xoff_recvd: 0 > dev.ix.0.mac_stats.total_octets_rcvd: 17956217280225 > dev.ix.0.mac_stats.good_octets_rcvd: 17945313085409 > dev.ix.0.mac_stats.total_pkts_rcvd: 15243381335 > dev.ix.0.mac_stats.good_pkts_rcvd: 4550864350 > dev.ix.0.mac_stats.mcast_pkts_rcvd: 0 > dev.ix.0.mac_stats.bcast_pkts_rcvd: 0 > dev.ix.0.mac_stats.rx_frames_64: 721599526 > dev.ix.0.mac_stats.rx_frames_65_127: 950131946 > dev.ix.0.mac_stats.rx_frames_128_255: 918463009 > dev.ix.0.mac_stats.rx_frames_256_511: 291858186 > dev.ix.0.mac_stats.rx_frames_512_1023: 237479208 > dev.ix.0.mac_stats.rx_frames_1024_1522: 12114578925 > dev.ix.0.mac_stats.recv_undersized: 0 > dev.ix.0.mac_stats.recv_fragmented: 0 > dev.ix.0.mac_stats.recv_oversized: 0 > dev.ix.0.mac_stats.recv_jabberd: 5 > dev.ix.0.mac_stats.management_pkts_rcvd: 0 > dev.ix.0.mac_stats.management_pkts_drpd: 0 > dev.ix.0.mac_stats.checksum_errs: 4379061 > dev.ix.0.mac_stats.good_octets_txd: 0 > dev.ix.0.mac_stats.total_pkts_txd: 0 > dev.ix.0.mac_stats.good_pkts_txd: 0 > dev.ix.0.mac_stats.bcast_pkts_txd: 0 > dev.ix.0.mac_stats.mcast_pkts_txd: 0 > dev.ix.0.mac_stats.management_pkts_txd: 0 > dev.ix.0.mac_stats.tx_frames_64: 0 > dev.ix.0.mac_stats.tx_frames_65_127: 0 > dev.ix.0.mac_stats.tx_frames_128_255: 0 > dev.ix.0.mac_stats.tx_frames_256_511: 0 > dev.ix.0.mac_stats.tx_frames_512_1023: 0 > dev.ix.0.mac_stats.tx_frames_1024_1522: 0 > > # sysctl dev.ix.1 > dev.ix.1.%desc: Intel(R) PRO/10GbE PCI-Express Network Driver, Version > - 2.5.15 > dev.ix.1.%driver: ix > dev.ix.1.%location: slot=0 function=1 > dev.ix.1.%pnpinfo: vendor=0x8086 device=0x10fb subvendor=0x8086 > subdevice=0x0003 class=0x020000 > dev.ix.1.%parent: pci4 > dev.ix.1.fc: 0 > dev.ix.1.enable_aim: 1 > dev.ix.1.advertise_speed: 0 > dev.ix.1.dropped: 0 > dev.ix.1.mbuf_defrag_failed: 0 > dev.ix.1.watchdog_events: 0 > dev.ix.1.link_irq: 3 > dev.ix.1.queue0.interrupt_rate: 500000 > dev.ix.1.queue0.irqs: 537134504 > dev.ix.1.queue0.txd_head: 0 > dev.ix.1.queue0.txd_tail: 0 > dev.ix.1.queue0.tso_tx: 0 > dev.ix.1.queue0.no_tx_dma_setup: 0 > dev.ix.1.queue0.no_desc_avail: 0 > dev.ix.1.queue0.tx_packets: 0 > dev.ix.1.queue0.rxd_head: 1757 > dev.ix.1.queue0.rxd_tail: 1756 > dev.ix.1.queue0.rx_packets: 565486932 > dev.ix.1.queue0.rx_bytes: 7763122874 > dev.ix.1.queue0.rx_copies: 40953968 > dev.ix.1.queue0.lro_queued: 0 > dev.ix.1.queue0.lro_flushed: 0 > dev.ix.1.queue1.interrupt_rate: 500000 > dev.ix.1.queue1.irqs: 561383741 > dev.ix.1.queue1.txd_head: 0 > dev.ix.1.queue1.txd_tail: 0 > dev.ix.1.queue1.tso_tx: 0 > dev.ix.1.queue1.no_tx_dma_setup: 0 > dev.ix.1.queue1.no_desc_avail: 0 > dev.ix.1.queue1.tx_packets: 0 > dev.ix.1.queue1.rxd_head: 138 > dev.ix.1.queue1.rxd_tail: 137 > dev.ix.1.queue1.rx_packets: 577262064 > dev.ix.1.queue1.rx_bytes: 8709306631 > dev.ix.1.queue1.rx_copies: 40844466 > dev.ix.1.queue1.lro_queued: 0 > dev.ix.1.queue1.lro_flushed: 0 > dev.ix.1.queue2.interrupt_rate: 500000 > dev.ix.1.queue2.irqs: 547852317 > dev.ix.1.queue2.txd_head: 0 > dev.ix.1.queue2.txd_tail: 0 > dev.ix.1.queue2.tso_tx: 0 > dev.ix.1.queue2.no_tx_dma_setup: 0 > dev.ix.1.queue2.no_desc_avail: 0 > dev.ix.1.queue2.tx_packets: 0 > dev.ix.1.queue2.rxd_head: 386 > dev.ix.1.queue2.rxd_tail: 385 > dev.ix.1.queue2.rx_packets: 562301518 > dev.ix.1.queue2.rx_bytes: 6698895889 > dev.ix.1.queue2.rx_copies: 40867897 > dev.ix.1.queue2.lro_queued: 0 > dev.ix.1.queue2.lro_flushed: 0 > dev.ix.1.queue3.interrupt_rate: 500000 > dev.ix.1.queue3.irqs: 551254360 > dev.ix.1.queue3.txd_head: 0 > dev.ix.1.queue3.txd_tail: 0 > dev.ix.1.queue3.tso_tx: 0 > dev.ix.1.queue3.no_tx_dma_setup: 0 > dev.ix.1.queue3.no_desc_avail: 0 > dev.ix.1.queue3.tx_packets: 0 > dev.ix.1.queue3.rxd_head: 1446 > dev.ix.1.queue3.rxd_tail: 1445 > dev.ix.1.queue3.rx_packets: 566052657 > dev.ix.1.queue3.rx_bytes: 8010009389 > dev.ix.1.queue3.rx_copies: 41116971 > dev.ix.1.queue3.lro_queued: 0 > dev.ix.1.queue3.lro_flushed: 0 > dev.ix.1.queue4.interrupt_rate: 500000 > dev.ix.1.queue4.irqs: 546581703 > dev.ix.1.queue4.txd_head: 0 > dev.ix.1.queue4.txd_tail: 0 > dev.ix.1.queue4.tso_tx: 0 > dev.ix.1.queue4.no_tx_dma_setup: 0 > dev.ix.1.queue4.no_desc_avail: 0 > dev.ix.1.queue4.tx_packets: 0 > dev.ix.1.queue4.rxd_head: 965 > dev.ix.1.queue4.rxd_tail: 964 > dev.ix.1.queue4.rx_packets: 561519824 > dev.ix.1.queue4.rx_bytes: 7656671816 > dev.ix.1.queue4.rx_copies: 41183608 > dev.ix.1.queue4.lro_queued: 0 > dev.ix.1.queue4.lro_flushed: 0 > dev.ix.1.queue5.interrupt_rate: 500000 > dev.ix.1.queue5.irqs: 557099892 > dev.ix.1.queue5.txd_head: 0 > dev.ix.1.queue5.txd_tail: 0 > dev.ix.1.queue5.tso_tx: 0 > dev.ix.1.queue5.no_tx_dma_setup: 0 > dev.ix.1.queue5.no_desc_avail: 0 > dev.ix.1.queue5.tx_packets: 0 > dev.ix.1.queue5.rxd_head: 1788 > dev.ix.1.queue5.rxd_tail: 1787 > dev.ix.1.queue5.rx_packets: 572588639 > dev.ix.1.queue5.rx_bytes: 7259699024 > dev.ix.1.queue5.rx_copies: 43207640 > dev.ix.1.queue5.lro_queued: 0 > dev.ix.1.queue5.lro_flushed: 0 > dev.ix.1.queue6.interrupt_rate: 500000 > dev.ix.1.queue6.irqs: 574139280 > dev.ix.1.queue6.txd_head: 0 > dev.ix.1.queue6.txd_tail: 0 > dev.ix.1.queue6.tso_tx: 0 > dev.ix.1.queue6.no_tx_dma_setup: 0 > dev.ix.1.queue6.no_desc_avail: 0 > dev.ix.1.queue6.tx_packets: 0 > dev.ix.1.queue6.rxd_head: 45 > dev.ix.1.queue6.rxd_tail: 44 > dev.ix.1.queue6.rx_packets: 589160795 > dev.ix.1.queue6.rx_bytes: 7475849844 > dev.ix.1.queue6.rx_copies: 40589940 > dev.ix.1.queue6.lro_queued: 0 > dev.ix.1.queue6.lro_flushed: 0 > dev.ix.1.queue7.interrupt_rate: 500000 > dev.ix.1.queue7.irqs: 552769977 > dev.ix.1.queue7.txd_head: 0 > dev.ix.1.queue7.txd_tail: 0 > dev.ix.1.queue7.tso_tx: 0 > dev.ix.1.queue7.no_tx_dma_setup: 0 > dev.ix.1.queue7.no_desc_avail: 0 > dev.ix.1.queue7.tx_packets: 0 > dev.ix.1.queue7.rxd_head: 1050 > dev.ix.1.queue7.rxd_tail: 1049 > dev.ix.1.queue7.rx_packets: 567580543 > dev.ix.1.queue7.rx_bytes: 7210216689 > dev.ix.1.queue7.rx_copies: 41856967 > dev.ix.1.queue7.lro_queued: 0 > dev.ix.1.queue7.lro_flushed: 0 > dev.ix.1.mac_stats.crc_errs: 40044743 > dev.ix.1.mac_stats.ill_errs: 4347098 > dev.ix.1.mac_stats.byte_errs: 7192103 > dev.ix.1.mac_stats.short_discards: 49169 > dev.ix.1.mac_stats.local_faults: 0 > dev.ix.1.mac_stats.remote_faults: 0 > dev.ix.1.mac_stats.rec_len_errs: 41772 > dev.ix.1.mac_stats.xon_txd: 0 > dev.ix.1.mac_stats.xon_recvd: 0 > dev.ix.1.mac_stats.xoff_txd: 0 > dev.ix.1.mac_stats.xoff_recvd: 0 > dev.ix.1.mac_stats.total_octets_rcvd: 1741353301146 > dev.ix.1.mac_stats.good_octets_rcvd: 1704100700961 > dev.ix.1.mac_stats.total_pkts_rcvd: 9354020520 > dev.ix.1.mac_stats.good_pkts_rcvd: 4561867527 > dev.ix.1.mac_stats.mcast_pkts_rcvd: 139746 > dev.ix.1.mac_stats.bcast_pkts_rcvd: 0 > dev.ix.1.mac_stats.rx_frames_64: 3314959123 > dev.ix.1.mac_stats.rx_frames_65_127: 4610233544 > dev.ix.1.mac_stats.rx_frames_128_255: 256517169 > dev.ix.1.mac_stats.rx_frames_256_511: 304326606 > dev.ix.1.mac_stats.rx_frames_512_1023: 223999237 > dev.ix.1.mac_stats.rx_frames_1024_1522: 591102680 > dev.ix.1.mac_stats.recv_undersized: 0 > dev.ix.1.mac_stats.recv_fragmented: 0 > dev.ix.1.mac_stats.recv_oversized: 0 > dev.ix.1.mac_stats.recv_jabberd: 71008 > dev.ix.1.mac_stats.management_pkts_rcvd: 0 > dev.ix.1.mac_stats.management_pkts_drpd: 0 > dev.ix.1.mac_stats.checksum_errs: 3901883 > dev.ix.1.mac_stats.good_octets_txd: 0 > dev.ix.1.mac_stats.total_pkts_txd: 0 > dev.ix.1.mac_stats.good_pkts_txd: 0 > dev.ix.1.mac_stats.bcast_pkts_txd: 0 > dev.ix.1.mac_stats.mcast_pkts_txd: 0 > dev.ix.1.mac_stats.management_pkts_txd: 0 > dev.ix.1.mac_stats.tx_frames_64: 0 > dev.ix.1.mac_stats.tx_frames_65_127: 0 > dev.ix.1.mac_stats.tx_frames_128_255: 0 > dev.ix.1.mac_stats.tx_frames_256_511: 0 > dev.ix.1.mac_stats.tx_frames_512_1023: 0 > dev.ix.1.mac_stats.tx_frames_1024_1522: 0 > _______________________________________________ > freebsd-net@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-net > To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org" -- Babak Farrokhi
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?5560C395.8020807>