Date: Tue, 7 Feb 2017 18:37:52 -0700 From: Sean Bruno <sbruno@freebsd.org> To: Alexandre Snarskii <snar@snar.spb.ru>, freebsd-net@freebsd.org Subject: Re: igb (82575EB) not passing traffic out. Message-ID: <a61d3925-b92c-9ecb-5d4d-5c9b3d2ceec1@freebsd.org> In-Reply-To: <20170207173930.GA64097@staff.retn.net> References: <20170207173930.GA64097@staff.retn.net>
next in thread | previous in thread | raw e-mail | index | archive | help
This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --MfFswioWa9GO1dMEjUaXGbLAtQVgUrX6n Content-Type: multipart/mixed; boundary="OJOca76hLJBgbiEwnucXWu0O8NJS7g5Rd"; protected-headers="v1" From: Sean Bruno <sbruno@freebsd.org> To: Alexandre Snarskii <snar@snar.spb.ru>, freebsd-net@freebsd.org Message-ID: <a61d3925-b92c-9ecb-5d4d-5c9b3d2ceec1@freebsd.org> Subject: Re: igb (82575EB) not passing traffic out. References: <20170207173930.GA64097@staff.retn.net> In-Reply-To: <20170207173930.GA64097@staff.retn.net> --OJOca76hLJBgbiEwnucXWu0O8NJS7g5Rd Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: quoted-printable On 02/07/17 10:39, Alexandre Snarskii wrote: >=20 > Hi! >=20 > After upgrading 12-stable from early January 2017 to February 2017 > igb card (onboard dual-port 82575EB) stopped passing outbound traffic. = > It can be seen in tcpdump, but switch reports "no packets received" and= =20 > sysctl counters reports zeros for tx. >=20 I'm hoping to get to this issue sometime this week. There is definitely an issue on this device: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D216734 > Details: >=20 > dmesg: >=20 > FreeBSD 12.0-CURRENT #0 r313342: Tue Feb 7 17:56:16 MSK 2017 >=20 > igb0: <Intel(R) PRO/1000 PCI-Express Network Driver> port 0x2020-0x203f= mem 0xb1f20000-0xb1f3ffff,0xb1f44000-0xb1f47fff irq 40 at device 0.0 on = pci1 > igb0: attach_pre capping queues at 4 > igb0: using 1024 tx descriptors and 1024 rx descriptors > igb0: msix_init qsets capped at 4 > igb0: pxm cpus: 4 queue msgs: 9 admincnt: 1 > igb0: using 4 rx queues 4 tx queues=20 > igb0: Using MSIX interrupts with 5 vectors > igb0: allocated for 4 tx_queues > igb0: allocated for 4 rx_queues > igb0: Ethernet address: 00:15:17:b0:e6:f8 > igb0: netmap queues/slots: TX 4/1024, RX 4/1024 >=20 > pciconf -lv: >=20 > igb0@pci0:1:0:0: class=3D0x020000 card=3D0x34de8086 chip=3D0x10a78086 r= ev=3D0x02 hdr=3D0x00 > vendor =3D 'Intel Corporation' > device =3D '82575EB Gigabit Network Connection' > class =3D network > subclass =3D ethernet >=20 > ifconfig: >=20 > igb0: flags=3D8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu= 1500 > options=3D6525bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_= HWCSUM,TSO4,LRO,WOL_MAGIC,VLAN_HWFILTER,VLAN_HWTSO,RXCSUM_IPV6,TXCSUM_IPV= 6> > ether 00:15:17:b0:e6:f8 > inet 87.245.206.15 netmask 0xffffffc0 broadcast 87.245.206.63=20 > inet6 fe80::215:17ff:feb0:e6f8%igb0 prefixlen 64 scopeid 0x1=20 > inet6 2a02:2d8:0:20ff:232a::3 prefixlen 64=20 > nd6 options=3D21<PERFORMNUD,AUTO_LINKLOCAL> > media: Ethernet autoselect (1000baseT <full-duplex>) > status: active >=20 > (tried to disable all features like lro/tso/csum, no changes). >=20 > sysctl dev.igb.0: note mac_stats.tx_frames_* of zero: >=20 > dev.igb.0.wake: 0 > dev.igb.0.interrupts.rx_overrun: 0 > dev.igb.0.interrupts.rx_desc_min_thresh: 0 > dev.igb.0.interrupts.tx_queue_min_thresh: 0 > dev.igb.0.interrupts.tx_queue_empty: 0 > dev.igb.0.interrupts.tx_abs_timer: 0 > dev.igb.0.interrupts.tx_pkt_timer: 8 > dev.igb.0.interrupts.rx_abs_timer: 9786 > dev.igb.0.interrupts.rx_pkt_timer: 9786 > dev.igb.0.interrupts.asserts: 9682 > dev.igb.0.mac_stats.tso_ctx_fail: 0 > dev.igb.0.mac_stats.tso_txd: 0 > dev.igb.0.mac_stats.tx_frames_1024_1522: 0 > dev.igb.0.mac_stats.tx_frames_512_1023: 0 > dev.igb.0.mac_stats.tx_frames_256_511: 0 > dev.igb.0.mac_stats.tx_frames_128_255: 0 > dev.igb.0.mac_stats.tx_frames_65_127: 0 > dev.igb.0.mac_stats.tx_frames_64: 0 > dev.igb.0.mac_stats.mcast_pkts_txd: 0 > dev.igb.0.mac_stats.bcast_pkts_txd: 0 > dev.igb.0.mac_stats.good_pkts_txd: 0 > dev.igb.0.mac_stats.total_pkts_txd: 0 > dev.igb.0.mac_stats.good_octets_txd: 0 > dev.igb.0.mac_stats.good_octets_recvd: 907217 > dev.igb.0.mac_stats.rx_frames_1024_1522: 0 > dev.igb.0.mac_stats.rx_frames_512_1023: 304 > dev.igb.0.mac_stats.rx_frames_256_511: 258 > dev.igb.0.mac_stats.rx_frames_128_255: 191 > dev.igb.0.mac_stats.rx_frames_65_127: 2817 > dev.igb.0.mac_stats.rx_frames_64: 6216 > dev.igb.0.mac_stats.mcast_pkts_recvd: 2409 > dev.igb.0.mac_stats.bcast_pkts_recvd: 7369 > dev.igb.0.mac_stats.good_pkts_recvd: 9786 > dev.igb.0.mac_stats.total_pkts_recvd: 15480 > dev.igb.0.mac_stats.xoff_txd: 0 > dev.igb.0.mac_stats.xoff_recvd: 0 > dev.igb.0.mac_stats.xon_txd: 0 > dev.igb.0.mac_stats.xon_recvd: 0 > dev.igb.0.mac_stats.coll_ext_errs: 0 > dev.igb.0.mac_stats.alignment_errs: 0 > dev.igb.0.mac_stats.crc_errs: 0 > dev.igb.0.mac_stats.recv_errs: 0 > dev.igb.0.mac_stats.recv_jabber: 0 > dev.igb.0.mac_stats.recv_oversize: 0 > dev.igb.0.mac_stats.recv_fragmented: 0 > dev.igb.0.mac_stats.recv_undersize: 0 > dev.igb.0.mac_stats.recv_no_buff: 0 > dev.igb.0.mac_stats.missed_packets: 0 > dev.igb.0.mac_stats.defer_count: 0 > dev.igb.0.mac_stats.sequence_errors: 0 > dev.igb.0.mac_stats.symbol_errors: 0 > dev.igb.0.mac_stats.collision_count: 0 > dev.igb.0.mac_stats.late_coll: 0 > dev.igb.0.mac_stats.multiple_coll: 0 > dev.igb.0.mac_stats.single_coll: 0 > dev.igb.0.mac_stats.excess_coll: 0 > dev.igb.0.queue_rx_3.rx_irq: 0 > dev.igb.0.queue_rx_3.rxd_tail: 44 > dev.igb.0.queue_rx_3.rxd_head: 46 > dev.igb.0.queue_rx_2.rx_irq: 0 > dev.igb.0.queue_rx_2.rxd_tail: 158 > dev.igb.0.queue_rx_2.rxd_head: 160 > dev.igb.0.queue_rx_1.rx_irq: 0 > dev.igb.0.queue_rx_1.rxd_tail: 60 > dev.igb.0.queue_rx_1.rxd_head: 62 > dev.igb.0.queue_rx_0.rx_irq: 0 > dev.igb.0.queue_rx_0.rxd_tail: 300 > dev.igb.0.queue_rx_0.rxd_head: 302 > dev.igb.0.queue_tx_3.no_desc_avail: 0 > dev.igb.0.queue_tx_3.tx_irq: 0 > dev.igb.0.queue_tx_3.txd_tail: 0 > dev.igb.0.queue_tx_3.txd_head: 0 > dev.igb.0.queue_tx_2.no_desc_avail: 0 > dev.igb.0.queue_tx_2.tx_irq: 0 > dev.igb.0.queue_tx_2.txd_tail: 0 > dev.igb.0.queue_tx_2.txd_head: 0 > dev.igb.0.queue_tx_1.no_desc_avail: 0 > dev.igb.0.queue_tx_1.tx_irq: 0 > dev.igb.0.queue_tx_1.txd_tail: 0 > dev.igb.0.queue_tx_1.txd_head: 0 > dev.igb.0.queue_tx_0.no_desc_avail: 0 > dev.igb.0.queue_tx_0.tx_irq: 0 > dev.igb.0.queue_tx_0.txd_tail: 457 > dev.igb.0.queue_tx_0.txd_head: 1 > dev.igb.0.fc_low_water: 45604 > dev.igb.0.fc_high_water: 47104 > dev.igb.0.rx_control: 67403806 > dev.igb.0.device_control: 1490027073 > dev.igb.0.watchdog_timeouts: 0 > dev.igb.0.rx_overruns: 0 > dev.igb.0.tx_dma_fail: 0 > dev.igb.0.mbuf_defrag_fail: 0 > dev.igb.0.link_irq: 4 > dev.igb.0.dropped: 0 > dev.igb.0.eee_control: 1 > dev.igb.0.rx_processing_limit: 100 > dev.igb.0.itr: 488 > dev.igb.0.tx_abs_int_delay: 66 > dev.igb.0.rx_abs_int_delay: 66 > dev.igb.0.tx_int_delay: 66 > dev.igb.0.rx_int_delay: 0 > dev.igb.0.reg_dump: General Registers > CTRL 58d00241 > STATUS 00080787 > CTRL_EXIT 91180c01 >=20 > Interrupt Registers > ICR 00000000 >=20 > RX Registers > RCTL 0404801e > RDLEN 00004000 > RDH 0000012e > RDT 0000012c > RXDCTL 02040810 > RDBAL 02ec1000 > RDBAH 00000000 >=20 > TX Registers > TCTL b50400fa > TDBAL 02eb1000 > TDBAH 00000000 > TDLEN 00004000 > TDH 00000001 > TDT 000001c9 > TXDCTL 0241011f > TDFH 80001800 > TDFT 00001800 > TDFHS 00001800 > TDFPC 00000000 >=20 >=20 > dev.igb.0.fc: 0 > dev.igb.0.debug: -1 > dev.igb.0.nvm: -1 > dev.igb.0.iflib.rxq3.rxq_fl0.credits: 1023 > dev.igb.0.iflib.rxq3.rxq_fl0.cidx: 46 > dev.igb.0.iflib.rxq3.rxq_fl0.pidx: 45 > dev.igb.0.iflib.rxq2.rxq_fl0.credits: 1023 > dev.igb.0.iflib.rxq2.rxq_fl0.cidx: 160 > dev.igb.0.iflib.rxq2.rxq_fl0.pidx: 159 > dev.igb.0.iflib.rxq1.rxq_fl0.credits: 1023 > dev.igb.0.iflib.rxq1.rxq_fl0.cidx: 62 > dev.igb.0.iflib.rxq1.rxq_fl0.pidx: 61 > dev.igb.0.iflib.rxq0.rxq_fl0.credits: 1023 > dev.igb.0.iflib.rxq0.rxq_fl0.cidx: 302 > dev.igb.0.iflib.rxq0.rxq_fl0.pidx: 301 > dev.igb.0.iflib.txq3.r_abdications: 0 > dev.igb.0.iflib.txq3.r_restarts: 0 > dev.igb.0.iflib.txq3.r_stalls: 0 > dev.igb.0.iflib.txq3.r_starts: 0 > dev.igb.0.iflib.txq3.r_drops: 0 > dev.igb.0.iflib.txq3.r_enqueues: 0 > dev.igb.0.iflib.txq3.ring_state: pidx_head: 0000 pidx_tail: 0000 cidx: = 0000 state: IDLE > dev.igb.0.iflib.txq3.txq_cleaned: 0 > dev.igb.0.iflib.txq3.txq_processed: 0 > dev.igb.0.iflib.txq3.txq_in_use: 0 > dev.igb.0.iflib.txq3.txq_cidx_processed: 0 > dev.igb.0.iflib.txq3.txq_cidx: 0 > dev.igb.0.iflib.txq3.txq_pidx: 0 > dev.igb.0.iflib.txq3.no_tx_dma_setup: 0 > dev.igb.0.iflib.txq3.txd_encap_efbig: 0 > dev.igb.0.iflib.txq3.tx_map_failed: 0 > dev.igb.0.iflib.txq3.no_desc_avail: 0 > dev.igb.0.iflib.txq3.mbuf_defrag_failed: 0 > dev.igb.0.iflib.txq3.m_pullups: 0 > dev.igb.0.iflib.txq3.mbuf_defrag: 0 > dev.igb.0.iflib.txq2.r_abdications: 0 > dev.igb.0.iflib.txq2.r_restarts: 0 > dev.igb.0.iflib.txq2.r_stalls: 0 > dev.igb.0.iflib.txq2.r_starts: 0 > dev.igb.0.iflib.txq2.r_drops: 0 > dev.igb.0.iflib.txq2.r_enqueues: 0 > dev.igb.0.iflib.txq2.ring_state: pidx_head: 0000 pidx_tail: 0000 cidx: = 0000 state: IDLE > dev.igb.0.iflib.txq2.txq_cleaned: 0 > dev.igb.0.iflib.txq2.txq_processed: 0 > dev.igb.0.iflib.txq2.txq_in_use: 0 > dev.igb.0.iflib.txq2.txq_cidx_processed: 0 > dev.igb.0.iflib.txq2.txq_cidx: 0 > dev.igb.0.iflib.txq2.txq_pidx: 0 > dev.igb.0.iflib.txq2.no_tx_dma_setup: 0 > dev.igb.0.iflib.txq2.txd_encap_efbig: 0 > dev.igb.0.iflib.txq2.tx_map_failed: 0 > dev.igb.0.iflib.txq2.no_desc_avail: 0 > dev.igb.0.iflib.txq2.mbuf_defrag_failed: 0 > dev.igb.0.iflib.txq2.m_pullups: 0 > dev.igb.0.iflib.txq2.mbuf_defrag: 0 > dev.igb.0.iflib.txq1.r_abdications: 0 > dev.igb.0.iflib.txq1.r_restarts: 0 > dev.igb.0.iflib.txq1.r_stalls: 0 > dev.igb.0.iflib.txq1.r_starts: 0 > dev.igb.0.iflib.txq1.r_drops: 0 > dev.igb.0.iflib.txq1.r_enqueues: 0 > dev.igb.0.iflib.txq1.ring_state: pidx_head: 0000 pidx_tail: 0000 cidx: = 0000 state: IDLE > dev.igb.0.iflib.txq1.txq_cleaned: 0 > dev.igb.0.iflib.txq1.txq_processed: 0 > dev.igb.0.iflib.txq1.txq_in_use: 0 > dev.igb.0.iflib.txq1.txq_cidx_processed: 0 > dev.igb.0.iflib.txq1.txq_cidx: 0 > dev.igb.0.iflib.txq1.txq_pidx: 0 > dev.igb.0.iflib.txq1.no_tx_dma_setup: 0 > dev.igb.0.iflib.txq1.txd_encap_efbig: 0 > dev.igb.0.iflib.txq1.tx_map_failed: 0 > dev.igb.0.iflib.txq1.no_desc_avail: 0 > dev.igb.0.iflib.txq1.mbuf_defrag_failed: 0 > dev.igb.0.iflib.txq1.m_pullups: 0 > dev.igb.0.iflib.txq1.mbuf_defrag: 0 > dev.igb.0.iflib.txq0.r_abdications: 0 > dev.igb.0.iflib.txq0.r_restarts: 0 > dev.igb.0.iflib.txq0.r_stalls: 0 > dev.igb.0.iflib.txq0.r_starts: 359 > dev.igb.0.iflib.txq0.r_drops: 0 > dev.igb.0.iflib.txq0.r_enqueues: 359 > dev.igb.0.iflib.txq0.ring_state: pidx_head: 0359 pidx_tail: 0359 cidx: = 0359 state: IDLE > dev.igb.0.iflib.txq0.txq_cleaned: 0 > dev.igb.0.iflib.txq0.txq_processed: 1 > dev.igb.0.iflib.txq0.txq_in_use: 457 > dev.igb.0.iflib.txq0.txq_cidx_processed: 1 > dev.igb.0.iflib.txq0.txq_cidx: 0 > dev.igb.0.iflib.txq0.txq_pidx: 457 > dev.igb.0.iflib.txq0.no_tx_dma_setup: 0 > dev.igb.0.iflib.txq0.txd_encap_efbig: 0 > dev.igb.0.iflib.txq0.tx_map_failed: 0 > dev.igb.0.iflib.txq0.no_desc_avail: 0 > dev.igb.0.iflib.txq0.mbuf_defrag_failed: 0 > dev.igb.0.iflib.txq0.m_pullups: 0 > dev.igb.0.iflib.txq0.mbuf_defrag: 0 > dev.igb.0.iflib.override_nrxds: 0 > dev.igb.0.iflib.override_ntxds: 0 > dev.igb.0.iflib.override_qs_enable: 0 > dev.igb.0.iflib.override_nrxqs: 0 > dev.igb.0.iflib.override_ntxqs: 0 > dev.igb.0.iflib.driver_version: 7.6.1-k > dev.igb.0.%parent: pci1 > dev.igb.0.%pnpinfo: vendor=3D0x8086 device=3D0x10a7 subvendor=3D0x8086 = subdevice=3D0x34de class=3D0x020000 > dev.igb.0.%location: slot=3D0 function=3D0 dbsf=3Dpci0:1:0:0 handle=3D\= _SB_.PCI0.MRP1.ZOR1 > dev.igb.0.%driver: igb > dev.igb.0.%desc: Intel(R) PRO/1000 PCI-Express Network Driver >=20 > tcpdump with arp replies (demonstrating that input traffic reaches kern= el ok): >=20 > tcpdump: listening on igb0, link-type EN10MB (Ethernet), capture size 2= 62144 bytes > 18:33:06.929553 00:15:17:b0:e6:f8 > b0:a8:6e:7b:47:c8, ethertype ARP (0= x0806), length 42: Ethernet (len 6), IPv4 (len 4), Reply 87.245.206.15 is= -at 00:15:17:b0:e6:f8, length 28 > 18:33:07.369398 00:15:17:b0:e6:f8 > 5c:5e:ab:0f:2a:80, ethertype 802.1Q= (0x8100), length 46: vlan 490, p 0, ethertype ARP, Ethernet (len 6), IPv= 4 (len 4), Reply 10.31.0.2 is-at 00:15:17:b0:e6:f8, length 28 >=20 > switch output demonstrating that there were no packets from host > in last four hours: >=20 > Last flapped : 2017-02-07 18:09:50 GMT-3 (00:24:09 ago) > Statistics last cleared: 2017-02-07 13:54:55 GMT-3 (04:39:04 ago) > Traffic statistics: > Input bytes : 0 0 bps > Output bytes : 30559996 16160 bps > Input packets: 0 0 pps > Output packets: 273220 20 pps >=20 > _______________________________________________ > freebsd-net@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-net > To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org" >=20 --OJOca76hLJBgbiEwnucXWu0O8NJS7g5Rd-- --MfFswioWa9GO1dMEjUaXGbLAtQVgUrX6n Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- iQGTBAEBCgB9FiEEuq1GMucSHejSCZfdEgHvyh5yfmQFAliadnBfFIAAAAAALgAo aXNzdWVyLWZwckBub3RhdGlvbnMub3BlbnBncC5maWZ0aGhvcnNlbWFuLm5ldEJB QUQ0NjMyRTcxMjFERThEMjA5OTdERDEyMDFFRkNBMUU3MjdFNjQACgkQEgHvyh5y fmSueAf/TA9usS/4lMG1H1W5Cj1MhGkS0AJV0WmwzL5Jsgk6lLOqD1gwRGCQ1Gxe ieCTlpZM8qU2ybwBNtZv1HZvJuII+qwjKIAi8kTCe22jkrHDG6mGI2HCOd2cD0eW iO0oSNaL5mm+9usnCoI3sJ+FleTpV2/DLs+z93tpsQqT6kPrFcp4iYLkV4rSg6RH ghAVz9D09imF3S+TIy8Gwv4j6IL8+EtvjOzbTwJiPXTf6z1E2tIYv/Bn6K8eSyFq VRtyamQ4Ak3M/f2pJ/4bTWDCwe5f57+T//bJdJcqbj6ZRJKcqFPGdxdJq+/V4a5W HqlVUEdAtMc3ZTG0SY6BDA+cqoPspQ== =q8Mf -----END PGP SIGNATURE----- --MfFswioWa9GO1dMEjUaXGbLAtQVgUrX6n--
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?a61d3925-b92c-9ecb-5d4d-5c9b3d2ceec1>