From owner-freebsd-stable@freebsd.org Thu Nov 9 20:17:55 2017 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id D0345E5AB9D; Thu, 9 Nov 2017 20:17:55 +0000 (UTC) (envelope-from lev@FreeBSD.org) Received: from onlyone.not-for.work (onlyone.not-for.work [148.251.9.81]) by mx1.freebsd.org (Postfix) with ESMTP id 6629B76B9D; Thu, 9 Nov 2017 20:17:54 +0000 (UTC) (envelope-from lev@FreeBSD.org) Received: from [192.168.19.110] (unknown [89.113.128.32]) (Authenticated sender: lev@serebryakov.spb.ru) by onlyone.not-for.work (Postfix) with ESMTPSA id 833AA8E1; Thu, 9 Nov 2017 23:17:48 +0300 (MSK) To: "freebsd-net@freebsd.org" , freebsd-stable Reply-To: lev@FreeBSD.org From: Lev Serebryakov Subject: =?UTF-8?Q?Intel_I210_=28igb=29_sometimes_consume_all_CPU_on_not-so-?= =?UTF-8?Q?big_traffic_=e2=80=94_need_help!?= Organization: FreeBSD Message-ID: <8590fa5d-fd06-90c6-8d3e-34c155423720@FreeBSD.org> Date: Thu, 9 Nov 2017 23:17:43 +0300 User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:52.0) Gecko/20100101 Thunderbird/52.4.0 MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha512; protocol="application/pgp-signature"; boundary="5an80dmX23Xem9Cn9rD5b6lv1DxQnFTNJ" X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 09 Nov 2017 20:17:55 -0000 This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --5an80dmX23Xem9Cn9rD5b6lv1DxQnFTNJ Content-Type: multipart/mixed; boundary="lSrC2sueveAJMard5bJ9FL02Uqoib6CAM"; protected-headers="v1" From: Lev Serebryakov Reply-To: lev@FreeBSD.org To: "freebsd-net@freebsd.org" , freebsd-stable Message-ID: <8590fa5d-fd06-90c6-8d3e-34c155423720@FreeBSD.org> Subject: =?UTF-8?Q?Intel_I210_=28igb=29_sometimes_consume_all_CPU_on_not-so-?= =?UTF-8?Q?big_traffic_=e2=80=94_need_help!?= --lSrC2sueveAJMard5bJ9FL02Uqoib6CAM Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: quoted-printable I still have problems with my E-1220v3 server equipped with Intel I210 adapter. It can not be loaded more than 100Mbit/s because it is connection to internet. But sometimes four interrupt threads "intr{irqXXX: igb0:que Y}" consume 100% CPU. Interrupt rate is very modest: % vmstat -i interrupt total rate =2E.. irq276: igb0:que 0 851899713 1193 irq277: igb0:que 1 907338150 1271 irq278: igb0:que 2 907538207 1271 irq279: igb0:que 3 768217584 1076 irq280: igb0:link 2 0 % But CPU consumption is 90-100% per thread: PID USERNAME PRI NICE SIZE RES STATE C TIME WCPU COMMAND 11 root -92 - 0K 544K CPU2 2 146:22 98.30% intr{irq278: igb0:que 2} 11 root -92 - 0K 544K WAIT 0 178:18 81.55% intr{irq276: igb0:que 0} 11 root -92 - 0K 544K WAIT 1 135:34 77.77% intr{irq277: igb0:que 1} 11 root -92 - 0K 544K CPU3 3 138:57 67.50% intr{irq279: igb0:que 3} procstat -ak looks suspicious: % sudo procstat -ak | grep igb0:que 11 100056 intr irq276: igb0:que 0 vm_page_scan_contig vm_phys_scan_contig vm_page_reclaim_contig kmem_alloc_contig mbuf_jumbo_alloc keg_alloc_slab keg_fetch_slab zone_fetch_slab zone_import zone_alloc_item uma_zalloc_arg m_getjcl igb_refresh_mbufs igb_rxeof igb_msix_que intr_event_execute_handlers ithread_loop fork_exit= 11 100058 intr irq277: igb0:que 1 mi_switch ithread_loop fork_exit fork_trampoline 11 100060 intr irq278: igb0:que 2 mi_switch ithread_loop fork_exit fork_trampoline 11 100062 intr irq279: igb0:que 3 mi_switch ithread_loop fork_exit fork_trampoline % --=20 // Lev Serebryakov --lSrC2sueveAJMard5bJ9FL02Uqoib6CAM-- --5an80dmX23Xem9Cn9rD5b6lv1DxQnFTNJ Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- iQKTBAEBCgB9FiEE+W0coLX0MYtnSzMK6rA8WL/cR48FAloEt+dfFIAAAAAALgAo aXNzdWVyLWZwckBub3RhdGlvbnMub3BlbnBncC5maWZ0aGhvcnNlbWFuLm5ldEY5 NkQxQ0EwQjVGNDMxOEI2NzRCMzMwQUVBQjAzQzU4QkZEQzQ3OEYACgkQ6rA8WL/c R48OQhAAldC1+7npWwVeT2eDrZnfO3RP5mcfww5x7RNBj2UR8GPEBN++esw6/jlk 1fVDu0uNcrlZPu6UTdS6Xl+3T99YcFGzolGWOKIYk4ZFvsigDmX2yYE9L+QCNk4a FyEo483MSGDy/o48BU4AcfpeI0vTtEA2lA5VWE8rPJbTVrZ65V0vB34lZQ3++gvT is0ETrU3UbpEdyTtSeygUSARsJ+OXqwO8uMU+KAxe12nCKy9yd2KeDsCSmRu49Kj c1N22VIeQbMEaNVFc+12VC7ZG2YADZPhqbnxFEck4y/u8eeKDp8R0dGuBe/4JwFD eF/vHxF61rIczujd3CiTskW78KR2wmLdIRUgv1YcR61Ud6ZWUTU8mJF1YAIT0vEy QXm9rxvNlAcb+yisG4XXHjdzYyVfGo3AWpIXW5uvWoC5gSh025KTvn8JUv3N7YUT sex+8+1y/ejMWsU/ZWpjh6ooaTKhcUQSAnx7lX3HxesmGFxdJOO40ld+acpowdbk vbnik4ycQODFe8+/KT7fdQngutotJ7ifFKhr2ivFlw9VXqE18X08hrJgA247J3mW fwiTTi9gPzaGy+QjZ29kZKp9/c6QpDjV1cISrdZ6XzzYTpS7s2YB3RnIGvThqOQI 4cTNCOKnZ4qn2Ml6Xq483OiKStFTN3aGd+Pd4GihWg6IozGkpIE= =RYSJ -----END PGP SIGNATURE----- --5an80dmX23Xem9Cn9rD5b6lv1DxQnFTNJ--