From owner-freebsd-stable@freebsd.org Mon Feb 22 23:06:51 2021 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 377ED552710 for ; Mon, 22 Feb 2021 23:06:51 +0000 (UTC) (envelope-from eborisch@alumni.stanford.edu) Received: from mail-wm1-x331.google.com (mail-wm1-x331.google.com [IPv6:2a00:1450:4864:20::331]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4DkyVf2T1yz3C6q for ; Mon, 22 Feb 2021 23:06:50 +0000 (UTC) (envelope-from eborisch@alumni.stanford.edu) Received: by mail-wm1-x331.google.com with SMTP id n10so747908wmq.0 for ; Mon, 22 Feb 2021 15:06:50 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:from:date:message-id:subject:to; bh=zYgs1mRDgyf6IF0aiXLzFUfG1jSg4zszgf/DzxrJKx0=; b=iucjpJuoJBjAc+YmMRm0Cy2xNoUvT2Opb4lqdAefef8mSIG8wUwro0ys4y6T2TQtft qejG5ADUmzYKWAduUetyp5LNulCVznyhd1YxNJC7qK3JiN1CRs0Gfiy+Y6k8plGQDQyg ogy0z0AH5X1lIzfEE+qIvSzwZSJd4fy3PIEeTye8sSG0phkKKy3SF0pSFALb/CSJ9ED2 Qwz0A5mdFpYhAIjN5rKGfaRbkPgdq9tv4jfZmVlesVs3tzJlPCxTdUiUHUIDeKDg29q6 0f+JNLVLpLeQJUEwlaUIatODHzgxVwMmFxPLFs/yNBI+OMBKb07mKjZWsVkCoKi29tee LzBw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=zYgs1mRDgyf6IF0aiXLzFUfG1jSg4zszgf/DzxrJKx0=; b=mK8n5cnlamPuQQg0+S3BOxwk6Hm0Ydx0y45CVSohmBsh6AkSCmIGbrhkLOD+ebSiFE CBYojsRmEwbQqf9gKbOUvyR+By7AMITUNx11xdOHT6eGghDNVW1t47fH6SETOxHvnX4H eDlwnTWZLxSkvPalMfzoHHLrRMgs18YUwywEnZ5dVkGuYJR5DJISTfLshk3tFSy2khs8 PNXi/8s2+vcyOFuE0W/xCjU2dJJb3fezXwgfBW1Uzkf0pTVWf/TOVBk+Y4mGf7ONGaTk yCWtAyxFkYuvqGvlYMwmKNeHCQtAQQOXwhEavxQd3S0Hfv4T9ds5YV66qamS74fEwVGe qfYQ== X-Gm-Message-State: AOAM530vDPJv3q24CuBYm50525Kf6w8skwTJjlkCWrJy1xLYzAx25vAu vv/CcCYID6px4+kFleWzf4qqcBl3BHeLeoCPGzoDdS0VThoKDQ== X-Google-Smtp-Source: ABdhPJy6lJ/MKcoI5hJAuDlujhCRtetrGCW+cPLWAZnn3o7BtNYABN7cfL/ahVXdRihR9BdNzc0E8lg46vAN93goGXg= X-Received: by 2002:a7b:c353:: with SMTP id l19mr22461382wmj.147.1614035208438; Mon, 22 Feb 2021 15:06:48 -0800 (PST) MIME-Version: 1.0 From: Eric Borisch Date: Mon, 22 Feb 2021 17:06:37 -0600 Message-ID: Subject: 13.0-beta3: em/igb driver incoming bytes values doubled in netstat To: freebsd-stable@freebsd.org X-Rspamd-Queue-Id: 4DkyVf2T1yz3C6q X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=iucjpJuo; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of eborisch@alumni.stanford.edu designates 2a00:1450:4864:20::331 as permitted sender) smtp.mailfrom=eborisch@alumni.stanford.edu X-Spamd-Result: default: False [-1.70 / 15.00]; FREEMAIL_FROM(0.00)[gmail.com]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36]; TO_DN_NONE(0.00)[]; URI_COUNT_ODD(1.00)[7]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; NEURAL_HAM_SHORT(-1.00)[-1.000]; FORGED_SENDER(0.30)[eborisch@gmail.com,eborisch@alumni.stanford.edu]; MIME_TRACE(0.00)[0:+,1:+,2:~]; RBL_DBL_DONT_QUERY_IPS(0.00)[2a00:1450:4864:20::331:from]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; FROM_NEQ_ENVFROM(0.00)[eborisch@gmail.com,eborisch@alumni.stanford.edu]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; SPAMHAUS_ZRD(0.00)[2a00:1450:4864:20::331:from:127.0.2.255]; RCVD_IN_DNSWL_NONE(0.00)[2a00:1450:4864:20::331:from]; HTTP_TO_IP(1.00)[]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-stable] X-Mailman-Approved-At: Tue, 23 Feb 2021 03:53:27 +0000 Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.34 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 22 Feb 2021 23:06:51 -0000 The incoming bytes on an intel I211 (em/igb) are being counted twice somewhere in the path that is queried by netstat and zabbix_agentd (which definitely uses ifmib.) My 'cable' interface is dev.igb.0; the system is live, so counts are going to keep going up, too. $ sysctl dev.igb.0 | grep octet dev.igb.0.mac_stats.good_octets_txd: 4836948514 dev.igb.0.mac_stats.good_octets_recvd: 17402549118 $ netstat -I cable -b | column -t Name Mtu Network Address Ipkts Ierrs Idrop Ibytes Opkts Oerrs Obytes Coll cable 1500 00:0d:b9:55:70:08 31197172 0 0 34681776974 9401856 0 4793050336 0 cable - 199.48.95.0/2 1500922-static.ro 94275 - - 24989369 106396 - 9906685 - $ zabbix_agentd -t 'net.if.in[cable]' net.if.in[cable] [u|34684619970] Note the octets_txd (which should be a little bigger than obytes) is very close to netstat's Obytes (obytes): 4836948514 ~= 4793050336 But octets_recvd (which should be a little bigger than ibytes) is ~ 1/2 of netstat/zabbix's (ifmib's) ibytes. 17402549118 ~= 34681776974 / 2 I can run known traffic across an interface, and the octets_recvd are hanging with the expected change, while netstat's and zabbix's are at 2x. I'm running a custom kernel, but I was running the same on 12.2, as well, and this only crept up on 13. I don't have 13 running on anything with different hardware to compare, unfortunately. Thanks for any suggestions, - Eric