From owner-freebsd-net@FreeBSD.ORG Thu May 21 13:33:25 2015 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 35DE1F14 for ; Thu, 21 May 2015 13:33:25 +0000 (UTC) Received: from mail-ig0-x233.google.com (mail-ig0-x233.google.com [IPv6:2607:f8b0:4001:c05::233]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id F11191E11 for ; Thu, 21 May 2015 13:33:24 +0000 (UTC) Received: by igbpi8 with SMTP id pi8so10033079igb.0 for ; Thu, 21 May 2015 06:33:24 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=from:content-type:content-transfer-encoding:subject:message-id:date :to:mime-version; bh=QjvrX+561hiWYjb4Yw7Ef+TUXRJOE5j4qCZm7f1N/DQ=; b=tVhzaCTbUd9b+6NDvzEvvdjEzXYusxRRFysvTvffplfcEuOSJNREa3ijXs2CfDT6T1 doY1R1YSNaPTEoK2hxF3Zm/OuNbRov4wzXhvRRKQkX3x47hQLa6OGnD3gxjzG3bQDskD ZsmVnSFkO6/Q52gpVElzKk+NdwjVyeUAVMLYgEpnY7XLEjQmRE5ZmwfirajXHrm3R+Uc gETfUEq1HNhx1m3u2PpKR58RjvmAdmzeACH7RBiVnxuInxjyl+1N9edczQgUZkWpsylP 7yxGvUHlCnDCZZPsOpCZIfq6/uE+2/ncPcf0iQH4QRdspgw9yDJO+6XUD5RLZtxECpVC 8lhw== X-Received: by 10.43.5.74 with SMTP id of10mr3262661icb.67.1432215204407; Thu, 21 May 2015 06:33:24 -0700 (PDT) Received: from [172.22.132.117] ([192.119.231.58]) by mx.google.com with ESMTPSA id h138sm14902915ioe.2.2015.05.21.06.33.22 for (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Thu, 21 May 2015 06:33:23 -0700 (PDT) From: Guy Helmer Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Subject: FreeBSD 9.3 - Intel X520-SR2 stops passing packets Message-Id: Date: Thu, 21 May 2015 08:33:31 -0500 To: freebsd-net@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 8.2 \(2098\)) X-Mailer: Apple Mail (2.2098) X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 21 May 2015 13:33:25 -0000 I=E2=80=99ve noticed that there have been reports of problems with Intel = X520-SR2 network interfaces stopping working. I think I=E2=80=99m seeing = a similar issue where the 10Gb interfaces stop receiving traffic = (they=E2=80=99re being used in promiscuous mode to sniff traffic from a = tap). ifconfig shows the interfaces are still active and the links are = OK. ifconfig down/up restores activity. I=E2=80=99ve changed = hw.intr_storm_threshold=3D8000 but I couldn=E2=80=99t tell if the = interrupt storm threshold had been triggered at the time the interfaces = stopped passing traffic. Output from sysctl: # sysctl dev.ix.0 dev.ix.0.%desc: Intel(R) PRO/10GbE PCI-Express Network Driver, Version - = 2.5.15 dev.ix.0.%driver: ix dev.ix.0.%location: slot=3D0 function=3D0 dev.ix.0.%pnpinfo: vendor=3D0x8086 device=3D0x10fb subvendor=3D0x8086 = subdevice=3D0x0003 class=3D0x020000 dev.ix.0.%parent: pci4 dev.ix.0.fc: 0 dev.ix.0.enable_aim: 1 dev.ix.0.advertise_speed: 0 dev.ix.0.dropped: 0 dev.ix.0.mbuf_defrag_failed: 0 dev.ix.0.watchdog_events: 0 dev.ix.0.link_irq: 3 dev.ix.0.queue0.interrupt_rate: 500000 dev.ix.0.queue0.irqs: 454449470 dev.ix.0.queue0.txd_head: 0 dev.ix.0.queue0.txd_tail: 0 dev.ix.0.queue0.tso_tx: 0 dev.ix.0.queue0.no_tx_dma_setup: 0 dev.ix.0.queue0.no_desc_avail: 0 dev.ix.0.queue0.tx_packets: 0 dev.ix.0.queue0.rxd_head: 1437 dev.ix.0.queue0.rxd_tail: 1436 dev.ix.0.queue0.rx_packets: 547499168 dev.ix.0.queue0.rx_bytes: 87201112584 dev.ix.0.queue0.rx_copies: 7934870 dev.ix.0.queue0.lro_queued: 0 dev.ix.0.queue0.lro_flushed: 0 dev.ix.0.queue1.interrupt_rate: 500000 dev.ix.0.queue1.irqs: 466235043 dev.ix.0.queue1.txd_head: 0 dev.ix.0.queue1.txd_tail: 0 dev.ix.0.queue1.tso_tx: 0 dev.ix.0.queue1.no_tx_dma_setup: 0 dev.ix.0.queue1.no_desc_avail: 0 dev.ix.0.queue1.tx_packets: 0 dev.ix.0.queue1.rxd_head: 277 dev.ix.0.queue1.rxd_tail: 276 dev.ix.0.queue1.rx_packets: 547668680 dev.ix.0.queue1.rx_bytes: 86205679601 dev.ix.0.queue1.rx_copies: 7846653 dev.ix.0.queue1.lro_queued: 0 dev.ix.0.queue1.lro_flushed: 0 dev.ix.0.queue2.interrupt_rate: 500000 dev.ix.0.queue2.irqs: 473958473 dev.ix.0.queue2.txd_head: 0 dev.ix.0.queue2.txd_tail: 0 dev.ix.0.queue2.tso_tx: 0 dev.ix.0.queue2.no_tx_dma_setup: 0 dev.ix.0.queue2.no_desc_avail: 0 dev.ix.0.queue2.tx_packets: 0 dev.ix.0.queue2.rxd_head: 576 dev.ix.0.queue2.rxd_tail: 575 dev.ix.0.queue2.rx_packets: 555704840 dev.ix.0.queue2.rx_bytes: 87294164455 dev.ix.0.queue2.rx_copies: 8297211 dev.ix.0.queue2.lro_queued: 0 dev.ix.0.queue2.lro_flushed: 0 dev.ix.0.queue3.interrupt_rate: 500000 dev.ix.0.queue3.irqs: 477587504 dev.ix.0.queue3.txd_head: 0 dev.ix.0.queue3.txd_tail: 0 dev.ix.0.queue3.tso_tx: 0 dev.ix.0.queue3.no_tx_dma_setup: 0 dev.ix.0.queue3.no_desc_avail: 0 dev.ix.0.queue3.tx_packets: 0 dev.ix.0.queue3.rxd_head: 267 dev.ix.0.queue3.rxd_tail: 266 dev.ix.0.queue3.rx_packets: 559921557 dev.ix.0.queue3.rx_bytes: 86832161258 dev.ix.0.queue3.rx_copies: 7918011 dev.ix.0.queue3.lro_queued: 0 dev.ix.0.queue3.lro_flushed: 0 dev.ix.0.queue4.interrupt_rate: 500000 dev.ix.0.queue4.irqs: 558339677 dev.ix.0.queue4.txd_head: 0 dev.ix.0.queue4.txd_tail: 0 dev.ix.0.queue4.tso_tx: 0 dev.ix.0.queue4.no_tx_dma_setup: 0 dev.ix.0.queue4.no_desc_avail: 0 dev.ix.0.queue4.tx_packets: 0 dev.ix.0.queue4.rxd_head: 1240 dev.ix.0.queue4.rxd_tail: 1239 dev.ix.0.queue4.rx_packets: 646909190 dev.ix.0.queue4.rx_bytes: 87117307815 dev.ix.0.queue4.rx_copies: 7944848 dev.ix.0.queue4.lro_queued: 0 dev.ix.0.queue4.lro_flushed: 0 dev.ix.0.queue5.interrupt_rate: 500000 dev.ix.0.queue5.irqs: 467836647 dev.ix.0.queue5.txd_head: 0 dev.ix.0.queue5.txd_tail: 0 dev.ix.0.queue5.tso_tx: 0 dev.ix.0.queue5.no_tx_dma_setup: 0 dev.ix.0.queue5.no_desc_avail: 0 dev.ix.0.queue5.tx_packets: 0 dev.ix.0.queue5.rxd_head: 1411 dev.ix.0.queue5.rxd_tail: 1410 dev.ix.0.queue5.rx_packets: 549666835 dev.ix.0.queue5.rx_bytes: 84671540121 dev.ix.0.queue5.rx_copies: 8258025 dev.ix.0.queue5.lro_queued: 0 dev.ix.0.queue5.lro_flushed: 0 dev.ix.0.queue6.interrupt_rate: 500000 dev.ix.0.queue6.irqs: 490798561 dev.ix.0.queue6.txd_head: 0 dev.ix.0.queue6.txd_tail: 0 dev.ix.0.queue6.tso_tx: 0 dev.ix.0.queue6.no_tx_dma_setup: 0 dev.ix.0.queue6.no_desc_avail: 0 dev.ix.0.queue6.tx_packets: 0 dev.ix.0.queue6.rxd_head: 160 dev.ix.0.queue6.rxd_tail: 159 dev.ix.0.queue6.rx_packets: 590187606 dev.ix.0.queue6.rx_bytes: 92115960421 dev.ix.0.queue6.rx_copies: 8262802 dev.ix.0.queue6.lro_queued: 0 dev.ix.0.queue6.lro_flushed: 0 dev.ix.0.queue7.interrupt_rate: 500000 dev.ix.0.queue7.irqs: 471051540 dev.ix.0.queue7.txd_head: 0 dev.ix.0.queue7.txd_tail: 0 dev.ix.0.queue7.tso_tx: 0 dev.ix.0.queue7.no_tx_dma_setup: 0 dev.ix.0.queue7.no_desc_avail: 0 dev.ix.0.queue7.tx_packets: 0 dev.ix.0.queue7.rxd_head: 640 dev.ix.0.queue7.rxd_tail: 639 dev.ix.0.queue7.rx_packets: 553362982 dev.ix.0.queue7.rx_bytes: 84470102891 dev.ix.0.queue7.rx_copies: 7954102 dev.ix.0.queue7.lro_queued: 0 dev.ix.0.queue7.lro_flushed: 0 dev.ix.0.mac_stats.crc_errs: 2091 dev.ix.0.mac_stats.ill_errs: 26 dev.ix.0.mac_stats.byte_errs: 140 dev.ix.0.mac_stats.short_discards: 0 dev.ix.0.mac_stats.local_faults: 0 dev.ix.0.mac_stats.remote_faults: 0 dev.ix.0.mac_stats.rec_len_errs: 0 dev.ix.0.mac_stats.xon_txd: 0 dev.ix.0.mac_stats.xon_recvd: 0 dev.ix.0.mac_stats.xoff_txd: 0 dev.ix.0.mac_stats.xoff_recvd: 0 dev.ix.0.mac_stats.total_octets_rcvd: 17956217280225 dev.ix.0.mac_stats.good_octets_rcvd: 17945313085409 dev.ix.0.mac_stats.total_pkts_rcvd: 15243381335 dev.ix.0.mac_stats.good_pkts_rcvd: 4550864350 dev.ix.0.mac_stats.mcast_pkts_rcvd: 0 dev.ix.0.mac_stats.bcast_pkts_rcvd: 0 dev.ix.0.mac_stats.rx_frames_64: 721599526 dev.ix.0.mac_stats.rx_frames_65_127: 950131946 dev.ix.0.mac_stats.rx_frames_128_255: 918463009 dev.ix.0.mac_stats.rx_frames_256_511: 291858186 dev.ix.0.mac_stats.rx_frames_512_1023: 237479208 dev.ix.0.mac_stats.rx_frames_1024_1522: 12114578925 dev.ix.0.mac_stats.recv_undersized: 0 dev.ix.0.mac_stats.recv_fragmented: 0 dev.ix.0.mac_stats.recv_oversized: 0 dev.ix.0.mac_stats.recv_jabberd: 5 dev.ix.0.mac_stats.management_pkts_rcvd: 0 dev.ix.0.mac_stats.management_pkts_drpd: 0 dev.ix.0.mac_stats.checksum_errs: 4379061 dev.ix.0.mac_stats.good_octets_txd: 0 dev.ix.0.mac_stats.total_pkts_txd: 0 dev.ix.0.mac_stats.good_pkts_txd: 0 dev.ix.0.mac_stats.bcast_pkts_txd: 0 dev.ix.0.mac_stats.mcast_pkts_txd: 0 dev.ix.0.mac_stats.management_pkts_txd: 0 dev.ix.0.mac_stats.tx_frames_64: 0 dev.ix.0.mac_stats.tx_frames_65_127: 0 dev.ix.0.mac_stats.tx_frames_128_255: 0 dev.ix.0.mac_stats.tx_frames_256_511: 0 dev.ix.0.mac_stats.tx_frames_512_1023: 0 dev.ix.0.mac_stats.tx_frames_1024_1522: 0 # sysctl dev.ix.1 dev.ix.1.%desc: Intel(R) PRO/10GbE PCI-Express Network Driver, Version - = 2.5.15 dev.ix.1.%driver: ix dev.ix.1.%location: slot=3D0 function=3D1 dev.ix.1.%pnpinfo: vendor=3D0x8086 device=3D0x10fb subvendor=3D0x8086 = subdevice=3D0x0003 class=3D0x020000 dev.ix.1.%parent: pci4 dev.ix.1.fc: 0 dev.ix.1.enable_aim: 1 dev.ix.1.advertise_speed: 0 dev.ix.1.dropped: 0 dev.ix.1.mbuf_defrag_failed: 0 dev.ix.1.watchdog_events: 0 dev.ix.1.link_irq: 3 dev.ix.1.queue0.interrupt_rate: 500000 dev.ix.1.queue0.irqs: 537134504 dev.ix.1.queue0.txd_head: 0 dev.ix.1.queue0.txd_tail: 0 dev.ix.1.queue0.tso_tx: 0 dev.ix.1.queue0.no_tx_dma_setup: 0 dev.ix.1.queue0.no_desc_avail: 0 dev.ix.1.queue0.tx_packets: 0 dev.ix.1.queue0.rxd_head: 1757 dev.ix.1.queue0.rxd_tail: 1756 dev.ix.1.queue0.rx_packets: 565486932 dev.ix.1.queue0.rx_bytes: 7763122874 dev.ix.1.queue0.rx_copies: 40953968 dev.ix.1.queue0.lro_queued: 0 dev.ix.1.queue0.lro_flushed: 0 dev.ix.1.queue1.interrupt_rate: 500000 dev.ix.1.queue1.irqs: 561383741 dev.ix.1.queue1.txd_head: 0 dev.ix.1.queue1.txd_tail: 0 dev.ix.1.queue1.tso_tx: 0 dev.ix.1.queue1.no_tx_dma_setup: 0 dev.ix.1.queue1.no_desc_avail: 0 dev.ix.1.queue1.tx_packets: 0 dev.ix.1.queue1.rxd_head: 138 dev.ix.1.queue1.rxd_tail: 137 dev.ix.1.queue1.rx_packets: 577262064 dev.ix.1.queue1.rx_bytes: 8709306631 dev.ix.1.queue1.rx_copies: 40844466 dev.ix.1.queue1.lro_queued: 0 dev.ix.1.queue1.lro_flushed: 0 dev.ix.1.queue2.interrupt_rate: 500000 dev.ix.1.queue2.irqs: 547852317 dev.ix.1.queue2.txd_head: 0 dev.ix.1.queue2.txd_tail: 0 dev.ix.1.queue2.tso_tx: 0 dev.ix.1.queue2.no_tx_dma_setup: 0 dev.ix.1.queue2.no_desc_avail: 0 dev.ix.1.queue2.tx_packets: 0 dev.ix.1.queue2.rxd_head: 386 dev.ix.1.queue2.rxd_tail: 385 dev.ix.1.queue2.rx_packets: 562301518 dev.ix.1.queue2.rx_bytes: 6698895889 dev.ix.1.queue2.rx_copies: 40867897 dev.ix.1.queue2.lro_queued: 0 dev.ix.1.queue2.lro_flushed: 0 dev.ix.1.queue3.interrupt_rate: 500000 dev.ix.1.queue3.irqs: 551254360 dev.ix.1.queue3.txd_head: 0 dev.ix.1.queue3.txd_tail: 0 dev.ix.1.queue3.tso_tx: 0 dev.ix.1.queue3.no_tx_dma_setup: 0 dev.ix.1.queue3.no_desc_avail: 0 dev.ix.1.queue3.tx_packets: 0 dev.ix.1.queue3.rxd_head: 1446 dev.ix.1.queue3.rxd_tail: 1445 dev.ix.1.queue3.rx_packets: 566052657 dev.ix.1.queue3.rx_bytes: 8010009389 dev.ix.1.queue3.rx_copies: 41116971 dev.ix.1.queue3.lro_queued: 0 dev.ix.1.queue3.lro_flushed: 0 dev.ix.1.queue4.interrupt_rate: 500000 dev.ix.1.queue4.irqs: 546581703 dev.ix.1.queue4.txd_head: 0 dev.ix.1.queue4.txd_tail: 0 dev.ix.1.queue4.tso_tx: 0 dev.ix.1.queue4.no_tx_dma_setup: 0 dev.ix.1.queue4.no_desc_avail: 0 dev.ix.1.queue4.tx_packets: 0 dev.ix.1.queue4.rxd_head: 965 dev.ix.1.queue4.rxd_tail: 964 dev.ix.1.queue4.rx_packets: 561519824 dev.ix.1.queue4.rx_bytes: 7656671816 dev.ix.1.queue4.rx_copies: 41183608 dev.ix.1.queue4.lro_queued: 0 dev.ix.1.queue4.lro_flushed: 0 dev.ix.1.queue5.interrupt_rate: 500000 dev.ix.1.queue5.irqs: 557099892 dev.ix.1.queue5.txd_head: 0 dev.ix.1.queue5.txd_tail: 0 dev.ix.1.queue5.tso_tx: 0 dev.ix.1.queue5.no_tx_dma_setup: 0 dev.ix.1.queue5.no_desc_avail: 0 dev.ix.1.queue5.tx_packets: 0 dev.ix.1.queue5.rxd_head: 1788 dev.ix.1.queue5.rxd_tail: 1787 dev.ix.1.queue5.rx_packets: 572588639 dev.ix.1.queue5.rx_bytes: 7259699024 dev.ix.1.queue5.rx_copies: 43207640 dev.ix.1.queue5.lro_queued: 0 dev.ix.1.queue5.lro_flushed: 0 dev.ix.1.queue6.interrupt_rate: 500000 dev.ix.1.queue6.irqs: 574139280 dev.ix.1.queue6.txd_head: 0 dev.ix.1.queue6.txd_tail: 0 dev.ix.1.queue6.tso_tx: 0 dev.ix.1.queue6.no_tx_dma_setup: 0 dev.ix.1.queue6.no_desc_avail: 0 dev.ix.1.queue6.tx_packets: 0 dev.ix.1.queue6.rxd_head: 45 dev.ix.1.queue6.rxd_tail: 44 dev.ix.1.queue6.rx_packets: 589160795 dev.ix.1.queue6.rx_bytes: 7475849844 dev.ix.1.queue6.rx_copies: 40589940 dev.ix.1.queue6.lro_queued: 0 dev.ix.1.queue6.lro_flushed: 0 dev.ix.1.queue7.interrupt_rate: 500000 dev.ix.1.queue7.irqs: 552769977 dev.ix.1.queue7.txd_head: 0 dev.ix.1.queue7.txd_tail: 0 dev.ix.1.queue7.tso_tx: 0 dev.ix.1.queue7.no_tx_dma_setup: 0 dev.ix.1.queue7.no_desc_avail: 0 dev.ix.1.queue7.tx_packets: 0 dev.ix.1.queue7.rxd_head: 1050 dev.ix.1.queue7.rxd_tail: 1049 dev.ix.1.queue7.rx_packets: 567580543 dev.ix.1.queue7.rx_bytes: 7210216689 dev.ix.1.queue7.rx_copies: 41856967 dev.ix.1.queue7.lro_queued: 0 dev.ix.1.queue7.lro_flushed: 0 dev.ix.1.mac_stats.crc_errs: 40044743 dev.ix.1.mac_stats.ill_errs: 4347098 dev.ix.1.mac_stats.byte_errs: 7192103 dev.ix.1.mac_stats.short_discards: 49169 dev.ix.1.mac_stats.local_faults: 0 dev.ix.1.mac_stats.remote_faults: 0 dev.ix.1.mac_stats.rec_len_errs: 41772 dev.ix.1.mac_stats.xon_txd: 0 dev.ix.1.mac_stats.xon_recvd: 0 dev.ix.1.mac_stats.xoff_txd: 0 dev.ix.1.mac_stats.xoff_recvd: 0 dev.ix.1.mac_stats.total_octets_rcvd: 1741353301146 dev.ix.1.mac_stats.good_octets_rcvd: 1704100700961 dev.ix.1.mac_stats.total_pkts_rcvd: 9354020520 dev.ix.1.mac_stats.good_pkts_rcvd: 4561867527 dev.ix.1.mac_stats.mcast_pkts_rcvd: 139746 dev.ix.1.mac_stats.bcast_pkts_rcvd: 0 dev.ix.1.mac_stats.rx_frames_64: 3314959123 dev.ix.1.mac_stats.rx_frames_65_127: 4610233544 dev.ix.1.mac_stats.rx_frames_128_255: 256517169 dev.ix.1.mac_stats.rx_frames_256_511: 304326606 dev.ix.1.mac_stats.rx_frames_512_1023: 223999237 dev.ix.1.mac_stats.rx_frames_1024_1522: 591102680 dev.ix.1.mac_stats.recv_undersized: 0 dev.ix.1.mac_stats.recv_fragmented: 0 dev.ix.1.mac_stats.recv_oversized: 0 dev.ix.1.mac_stats.recv_jabberd: 71008 dev.ix.1.mac_stats.management_pkts_rcvd: 0 dev.ix.1.mac_stats.management_pkts_drpd: 0 dev.ix.1.mac_stats.checksum_errs: 3901883 dev.ix.1.mac_stats.good_octets_txd: 0 dev.ix.1.mac_stats.total_pkts_txd: 0 dev.ix.1.mac_stats.good_pkts_txd: 0 dev.ix.1.mac_stats.bcast_pkts_txd: 0 dev.ix.1.mac_stats.mcast_pkts_txd: 0 dev.ix.1.mac_stats.management_pkts_txd: 0 dev.ix.1.mac_stats.tx_frames_64: 0 dev.ix.1.mac_stats.tx_frames_65_127: 0 dev.ix.1.mac_stats.tx_frames_128_255: 0 dev.ix.1.mac_stats.tx_frames_256_511: 0 dev.ix.1.mac_stats.tx_frames_512_1023: 0 dev.ix.1.mac_stats.tx_frames_1024_1522: 0=