From owner-freebsd-net@freebsd.org Thu Nov 9 20:21:34 2017 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id B7C42E5AF1D for ; Thu, 9 Nov 2017 20:21:34 +0000 (UTC) (envelope-from sbruno@freebsd.org) Received: from mail.ignoranthack.me (ignoranthack.me [199.102.79.106]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 86F3776FBA for ; Thu, 9 Nov 2017 20:21:33 +0000 (UTC) (envelope-from sbruno@freebsd.org) Received: from [192.168.0.6] (97-123-7-109.albq.qwest.net [97.123.7.109]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) (Authenticated sender: sbruno@ignoranthack.me) by mail.ignoranthack.me (Postfix) with ESMTPSA id C0E291928B7 for ; Thu, 9 Nov 2017 20:21:26 +0000 (UTC) Subject: =?UTF-8?Q?Re:_Intel_I210_=28igb=29_sometimes_consume_all_CPU_on_not?= =?UTF-8?Q?-so-big_traffic_=e2=80=94_need_help!?= To: freebsd-net@freebsd.org References: <8590fa5d-fd06-90c6-8d3e-34c155423720@FreeBSD.org> From: Sean Bruno Message-ID: <6ea24412-a313-4aa2-e737-eebc02027067@freebsd.org> Date: Thu, 9 Nov 2017 13:21:23 -0700 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:52.0) Gecko/20100101 Thunderbird/52.4.0 MIME-Version: 1.0 In-Reply-To: <8590fa5d-fd06-90c6-8d3e-34c155423720@FreeBSD.org> Content-Type: multipart/signed; micalg=pgp-sha512; protocol="application/pgp-signature"; boundary="IOkxgBNjL6kRMciKFQsskOh36guoxiIs3" X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 09 Nov 2017 20:21:34 -0000 This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --IOkxgBNjL6kRMciKFQsskOh36guoxiIs3 Content-Type: multipart/mixed; boundary="M7djh9LXFlAPEemtGDOHJVK7RUPdtfE3G"; protected-headers="v1" From: Sean Bruno To: freebsd-net@freebsd.org Message-ID: <6ea24412-a313-4aa2-e737-eebc02027067@freebsd.org> Subject: =?UTF-8?Q?Re:_Intel_I210_=28igb=29_sometimes_consume_all_CPU_on_not?= =?UTF-8?Q?-so-big_traffic_=e2=80=94_need_help!?= References: <8590fa5d-fd06-90c6-8d3e-34c155423720@FreeBSD.org> In-Reply-To: <8590fa5d-fd06-90c6-8d3e-34c155423720@FreeBSD.org> --M7djh9LXFlAPEemtGDOHJVK7RUPdtfE3G Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: quoted-printable On 11/09/17 13:17, Lev Serebryakov wrote: >=20 > I still have problems with my E-1220v3 server equipped with Intel I210= > adapter. It can not be loaded more than 100Mbit/s because it is > connection to internet. >=20 > But sometimes four interrupt threads "intr{irqXXX: igb0:que Y}" consum= e > 100% CPU. Interrupt rate is very modest: >=20 > % vmstat -i > interrupt total rate > ... > irq276: igb0:que 0 851899713 1193 > irq277: igb0:que 1 907338150 1271 > irq278: igb0:que 2 907538207 1271 > irq279: igb0:que 3 768217584 1076 > irq280: igb0:link 2 0 > % >=20 > But CPU consumption is 90-100% per thread: >=20 > PID USERNAME PRI NICE SIZE RES STATE C TIME WCPU COMMAND > 11 root -92 - 0K 544K CPU2 2 146:22 98.30% intr{irq278: > igb0:que 2} > 11 root -92 - 0K 544K WAIT 0 178:18 81.55% intr{irq276: > igb0:que 0} > 11 root -92 - 0K 544K WAIT 1 135:34 77.77% intr{irq277: > igb0:que 1} > 11 root -92 - 0K 544K CPU3 3 138:57 67.50% intr{irq279: > igb0:que 3} >=20 > procstat -ak looks suspicious: >=20 > % sudo procstat -ak | grep igb0:que > 11 100056 intr irq276: igb0:que 0 vm_page_scan_contig > vm_phys_scan_contig vm_page_reclaim_contig kmem_alloc_contig > mbuf_jumbo_alloc keg_alloc_slab keg_fetch_slab zone_fetch_slab > zone_import zone_alloc_item uma_zalloc_arg m_getjcl igb_refresh_mbufs > igb_rxeof igb_msix_que intr_event_execute_handlers ithread_loop fork_ex= it > 11 100058 intr irq277: igb0:que 1 mi_switch ithread_loop fork_exi= t > fork_trampoline > 11 100060 intr irq278: igb0:que 2 mi_switch ithread_loop fork_exi= t > fork_trampoline > 11 100062 intr irq279: igb0:que 3 mi_switch ithread_loop fork_exi= t > fork_trampoline > % >=20 Lev: Can you dump the sysctl's for igb(sysctl -a | grep igb)? I assume this is stable/11 sean --M7djh9LXFlAPEemtGDOHJVK7RUPdtfE3G-- --IOkxgBNjL6kRMciKFQsskOh36guoxiIs3 Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- iQGTBAEBCgB9FiEE6MTp+IA1BOHj9Lo0veT1/om1/LYFAloEuMRfFIAAAAAALgAo aXNzdWVyLWZwckBub3RhdGlvbnMub3BlbnBncC5maWZ0aGhvcnNlbWFuLm5ldEU4 QzRFOUY4ODAzNTA0RTFFM0Y0QkEzNEJERTRGNUZFODlCNUZDQjYACgkQveT1/om1 /LaqjAf/ZfnVmNOX75SZqaJdtwBUQph9G4XdclG6DNUgZ/csxN1DcSsM/BgzftGC Bjhge7FYfJ9D05NnUvNmrzQJEAGUbTl9wihK0kuRGnqKaE8Cni9P+H0c/8+K3E19 o31LjwMeMG0bAnsd3Y61AK0M8o1kWjtNhE/aLDDgMhHE0D0SpcwrCnM7rVgpE0cn yK2NZPHs1EFfj/7nOkUue4exWmCDN1RXWS2LIWNUKuBcISHcbIKY2fnjKcWzaefQ 5fXv6lUA8ejh7spr57h2DlzVpvVF/I+x3VdQtScsArWQTRCnO26v5QNkoGKRl+Rf A15Pj9yseEDrOuLn1YAs/9r6andvYA== =B6Ci -----END PGP SIGNATURE----- --IOkxgBNjL6kRMciKFQsskOh36guoxiIs3--