From owner-freebsd-net@freebsd.org Sun Jul 19 16:12:18 2020 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 30B8D362D17 for ; Sun, 19 Jul 2020 16:12:18 +0000 (UTC) (envelope-from slw@zxy.spb.ru) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 4B8qcx5qH6z3VHP for ; Sun, 19 Jul 2020 16:12:17 +0000 (UTC) (envelope-from slw@zxy.spb.ru) Received: by mailman.nyi.freebsd.org (Postfix) id C7C13362BF6; Sun, 19 Jul 2020 16:12:17 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id C7860362E15 for ; Sun, 19 Jul 2020 16:12:17 +0000 (UTC) (envelope-from slw@zxy.spb.ru) Received: from zxy.spb.ru (zxy.spb.ru [195.70.199.98]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4B8qcw0YlYz3VcN for ; Sun, 19 Jul 2020 16:12:15 +0000 (UTC) (envelope-from slw@zxy.spb.ru) Received: from slw by zxy.spb.ru with local (Exim 4.86 (FreeBSD)) (envelope-from ) id 1jxBv5-000GhD-NT for net@freebsd.org; Sun, 19 Jul 2020 19:12:07 +0300 Date: Sun, 19 Jul 2020 19:12:07 +0300 From: Slawa Olhovchenkov To: net@freebsd.org Subject: mlx5 interrupts Message-ID: <20200719161207.GA2033@zxy.spb.ru> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline User-Agent: Mutt/1.5.24 (2015-08-30) X-SA-Exim-Connect-IP: X-SA-Exim-Mail-From: slw@zxy.spb.ru X-SA-Exim-Scanned: No (on zxy.spb.ru); SAEximRunCond expanded to false X-Rspamd-Queue-Id: 4B8qcw0YlYz3VcN X-Spamd-Bar: +++ Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=none (mx1.freebsd.org: domain of slw@zxy.spb.ru has no SPF policy when checking 195.70.199.98) smtp.mailfrom=slw@zxy.spb.ru X-Spamd-Result: default: False [3.51 / 15.00]; RCVD_TLS_LAST(0.00)[]; ARC_NA(0.00)[]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_SPAM_SHORT(1.00)[0.996]; MIME_GOOD(-0.10)[text/plain]; TO_DN_NONE(0.00)[]; DMARC_NA(0.00)[zxy.spb.ru]; AUTH_NA(1.00)[]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_SPAM_MEDIUM(0.69)[0.692]; NEURAL_SPAM_LONG(0.92)[0.922]; R_SPF_NA(0.00)[no SPF record]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:5495, ipnet:195.70.192.0/19, country:RU]; RCVD_COUNT_TWO(0.00)[2]; MID_RHS_MATCH_FROM(0.00)[] X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 19 Jul 2020 16:12:18 -0000 Can anybody explain what purpose of unnamed interrupts of Mellanox ConnectX-5 cards? I am see 19 interrupts per card. I am mean last 16 is RX queue. What about first 3? Also I am see very high rate for irq287/irq306 -- is this good? # vmstat -i | grep -e ^int -e mlx interrupt total rate irq286: mlx5_core0 1 0 irq287: mlx5_core0 5135992 20 irq288: mlx5_core0 1 0 irq289: mlx5_core0 76408 0 irq290: mlx5_core0 43054 0 irq291: mlx5_core0 93826 0 irq292: mlx5_core0 39457 0 irq293: mlx5_core0 36141 0 irq294: mlx5_core0 65526 0 irq295: mlx5_core0 53399 0 irq296: mlx5_core0 120885 0 irq297: mlx5_core0 140690 1 irq298: mlx5_core0 193578 1 irq299: mlx5_core0 178332 1 irq300: mlx5_core0 75334 0 irq301: mlx5_core0 207118 1 irq302: mlx5_core0 108803 0 irq303: mlx5_core0 24356 0 irq304: mlx5_core0 26713 0 irq305: mlx5_core1 1 0 irq306: mlx5_core1 5136296 20 irq307: mlx5_core1 1 0 irq308: mlx5_core1 3634544 14 irq309: mlx5_core1 22860 0 irq310: mlx5_core1 564441 2 irq311: mlx5_core1 30503 0 irq312: mlx5_core1 115549 0 irq313: mlx5_core1 49815 0 irq314: mlx5_core1 10272 0 irq315: mlx5_core1 85875 0 irq316: mlx5_core1 134251 1 irq317: mlx5_core1 25151 0 irq318: mlx5_core1 73376 0 irq319: mlx5_core1 5879 0 irq320: mlx5_core1 39515 0 irq321: mlx5_core1 5390 0 irq322: mlx5_core1 22726 0 irq323: mlx5_core1 60408 0