From nobody Wed Oct 13 23:14:01 2021 X-Original-To: stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 1B93117F4721 for ; Wed, 13 Oct 2021 23:14:21 +0000 (UTC) (envelope-from kob6558@gmail.com) Received: from mail-wr1-x42b.google.com (mail-wr1-x42b.google.com [IPv6:2a00:1450:4864:20::42b]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4HV7dl62Nyz3qG3 for ; Wed, 13 Oct 2021 23:14:19 +0000 (UTC) (envelope-from kob6558@gmail.com) Received: by mail-wr1-x42b.google.com with SMTP id r7so13506105wrc.10 for ; Wed, 13 Oct 2021 16:14:19 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=mime-version:from:date:message-id:subject:to; bh=/bXtTkQRf04OEHMGGd5bOi1bcx3cRX7t8au89jjpDbk=; b=L11ysjuEFWI9FmT33HJ6cQbw9bjllqtrPOCsN8VN/jE4gYi3T+RkpGBLMwbiEsTdkv azl4KqPrmdvhb6O8saIQBWLOMv/Ct39O04e4Bai9Apm4tL1kih9DPrzzgyjlPNKOhI05 0jxsEyJEaimCX1QK4MgMJ4sSWW15GQreQFT/ZxhrbkCUUUM1te4kThNgeD0TeM27olrq dMOHI1tsZA8Esc1aWbZ7xnm3BaFYu4nl2t2V0wbJNhs6jsSFqPe3uGOpwP1f17rZyXQ9 Vv6+jkf9c+EOFctqR7zT86dSL/f+UF2Q26W/jm3+HdLXgsnNC8ZslKiJn3o7jyog6AGT 6ygw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=/bXtTkQRf04OEHMGGd5bOi1bcx3cRX7t8au89jjpDbk=; b=TeY0gny6dYixcNMpmInBNVVVAy5vdhbmUwC+n5CmUtqY+Qr0pLmayQg+w08bUO+5uW w/OYSqL9aCE+c+hKkmqIxBKcu8Sype62zbAmHl0mY3sJ9OGw4BUyUFo0sBpn51aEAHnT 0PXHDBq5M5QONp7K6LZWexqWxgBeD/coyfX50V82bkvkCzjAhvFuy1dOVb5KUMHMfTUP 18ly23a4vz/JfUWXbTTi8zMlylRiXrLsCxDpdJSewsgzZKWTckT2CahpotcBgGD7nZ2u wZi1yymmUevJEpFPbUmLT25Jlj3sf8HlxsbsDp9kmh90pSlUsl+cbpX4lp+8x+6A26Iz EEyA== X-Gm-Message-State: AOAM53213Z50orBk4ohutIVpctEvXE81mJm8JfTF7G9BdutB9inyeDon AHZMAwq9zquxlqHQ/rxz6Jg9pSuQWiRMG/Fz9qLoHTX5o+0= X-Google-Smtp-Source: ABdhPJywk2WnMGwBg+DZV9ni2PnHdYegb2M54v/pEWU7MKVgmvDfDJVY4g0KNHtYYjYZMaC0TfAfZHY+nzK0glb5ljU= X-Received: by 2002:a05:6000:1563:: with SMTP id 3mr2485550wrz.20.1634166857546; Wed, 13 Oct 2021 16:14:17 -0700 (PDT) List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org MIME-Version: 1.0 From: Kevin Oberman Date: Wed, 13 Oct 2021 16:14:01 -0700 Message-ID: Subject: Extremely inconsistent disk performance To: FreeBSD Stable ML Content-Type: multipart/alternative; boundary="0000000000000c3daa05ce441f92" X-Rspamd-Queue-Id: 4HV7dl62Nyz3qG3 X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20210112 header.b=L11ysjuE; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of kob6558@gmail.com designates 2a00:1450:4864:20::42b as permitted sender) smtp.mailfrom=kob6558@gmail.com X-Spamd-Result: default: False [-1.52 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.92)[-0.917]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20210112]; FROM_HAS_DN(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; FREEMAIL_FROM(0.00)[gmail.com]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[stable@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; MID_RHS_MATCH_FROMTLD(0.00)[]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; RCVD_IN_DNSWL_NONE(0.00)[2a00:1450:4864:20::42b:from]; NEURAL_HAM_SHORT(-0.90)[-0.902]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36]; FORGED_SENDER(0.30)[rkoberman@gmail.com,kob6558@gmail.com]; NEURAL_SPAM_LONG(1.00)[1.000]; MIME_TRACE(0.00)[0:+,1:+,2:~]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; FROM_NEQ_ENVFROM(0.00)[rkoberman@gmail.com,kob6558@gmail.com]; RCVD_TLS_ALL(0.00)[]; RCVD_COUNT_TWO(0.00)[2] X-ThisMailContainsUnwantedMimeParts: Y --0000000000000c3daa05ce441f92 Content-Type: text/plain; charset="UTF-8" I have a Lenovo laptop (L15) that is running 13-STABLE. I've been using it for about a year and it has always had strange and often slow disk performance, but I attributed this to the hard drive. Recently I added an SSD to the unit. It is an NVMe PDIe M.2 from Sabrent. Thi did not affect the problem. First, using dd to copy a full partition to an external drive runs at or the speed of the external drive. This would indicate that the issue is not a hardware issue. When I either read in or write out the memory when pausing a VM, I see sudden changes in transfer rate. It may start at 200 MBs and abruptly drop to 20. It usually remains low for anywhere from 15 seconds to several minutes and then jump back to 200. It usually starts at the high speed, but not always. The low speed may be anywhere from 1.5 to 30 MBs. Probably once every 5-10 times, it loads the entire 20 GB without slowdown. Load times range from about 25 seconds to 7 minutes. The low end is pretty consistent but the high end varies quite a bit but is usually under 5 minutes. I have seen similar but less repeatable behavior in other disk heavy operations like packing or unpacking a tar file. Any idea what may be going on? Any tests I can perform? SMART shows no errors or other issues. I have another issue that may be related involving CPU frequency that I will report on separately. -- FreeBSD ptavv 13.0-STABLE FreeBSD 13.0-STABLE #1 stable/13-n246941-20f96f21556: Tue Aug 24 20:48:52 PDT 2021 root@ptavv:/usr/obj/usr/src/amd64.amd64/sys/GENERIC.4BSD amd64 Kevin Oberman, Part time kid herder and retired Network Engineer E-mail: rkoberman@gmail.com PGP Fingerprint: D03FB98AFA78E3B78C1694B318AB39EF1B055683 --0000000000000c3daa05ce441f92-- From nobody Wed Oct 13 23:44:51 2021 X-Original-To: stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 75B941804841 for ; Wed, 13 Oct 2021 23:45:16 +0000 (UTC) (envelope-from kob6558@gmail.com) Received: from mail-wr1-x42a.google.com (mail-wr1-x42a.google.com [IPv6:2a00:1450:4864:20::42a]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4HV8KR4LXWz4XXt for ; Wed, 13 Oct 2021 23:45:15 +0000 (UTC) (envelope-from kob6558@gmail.com) Received: by mail-wr1-x42a.google.com with SMTP id r10so13575793wra.12 for ; Wed, 13 Oct 2021 16:45:15 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=mime-version:from:date:message-id:subject:to; bh=oDp8aSiuvB4/pu1hm/1eekIF1Q82xm+IcSwN9/KQK/0=; b=axj9AThxtRiW7mbuOcD1sWH/qzS2MgZ7earFtElyRK5xPRXK7q8Cbtr3gn+adaxHyK f3lHOqgktTgGSKIg+Qc8kP7neHFyG6K3aUDG4VQeYDOQBqVP0coiqk9f3ayYbOqCwBCa ARekSwqKol9nn0PcHSVL46CcMbiESzN3TGkEJMtQ0lLO3MrccmjYquZTf/EPNF81EKZ+ KEgjEj+Ez9AU6mTxWhvlXpNPX2UlCBmTMZpiFRPo4zFZmD7uipL/PiPyOJ8C4sdv9xep mzvCERg/1EEnX2kL7FSbHQJMiaUuBUqzpb045JZ+1RvTK9fOZ2m2qhvNiNo3jWHBWA+u MT5w== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=oDp8aSiuvB4/pu1hm/1eekIF1Q82xm+IcSwN9/KQK/0=; b=DziaFhYbaD6nqFBD9fAKOEoXrLOd6CXV8N7wpUsYX0DSgY9UCa4K9yTqngm7kwvAI8 IkHSYhCf9Bp1xCd3a0vtGxXjhrfk/A2lTYgvaI2CSrFO+IIUUd5k/c1I+b68aV962Uwh F10dwlXMB59H8sW8zQtUXzVmKA9gDdEAlRgOCYk5YVNKU+Gyq7BPyh80dfoIfnZ2oMdf 5OcbUl3YkLtUHCLVdw8M1V8HooXIML6PJkMfTtUOWVJ+tN2bstlV0FM51Wod7UTz0aUV YgSxibu+QDb7Zix1/A9RJlCvCh37bbwvVO5L3FqODDPNAPhzl58QPgDvBE+AIEnXHVjo HCLw== X-Gm-Message-State: AOAM533yjY7d4CGnLR4ssJb4dED8W+soPWWGzQQDZ9ZtQRMGFFBIzOoz jZ/J0lB/zdf7yG8uHT2/j5LN9ivJebBaYgX5DTAqYlcEqww= X-Google-Smtp-Source: ABdhPJz2fiF0eWEaS2rb0WjGZMpHubwgHZfnKS2XbLBfJkg8RsCLMbsiqzD+ThRbwcJnBx3gofNmXE6Gez9r3ieinl8= X-Received: by 2002:a1c:4d06:: with SMTP id o6mr15753157wmh.137.1634168708256; Wed, 13 Oct 2021 16:45:08 -0700 (PDT) List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org MIME-Version: 1.0 From: Kevin Oberman Date: Wed, 13 Oct 2021 16:44:51 -0700 Message-ID: Subject: Weird processor frequency issues To: FreeBSD Stable ML Content-Type: multipart/alternative; boundary="0000000000005bd51b05ce448d5f" X-Rspamd-Queue-Id: 4HV8KR4LXWz4XXt X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20210112 header.b=axj9AThx; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of kob6558@gmail.com designates 2a00:1450:4864:20::42a as permitted sender) smtp.mailfrom=kob6558@gmail.com X-Spamd-Result: default: False [-1.61 / 15.00]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20210112]; NEURAL_HAM_MEDIUM(-0.96)[-0.962]; FROM_HAS_DN(0.00)[]; FREEMAIL_FROM(0.00)[gmail.com]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[stable@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; MID_RHS_MATCH_FROMTLD(0.00)[]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; RCVD_IN_DNSWL_NONE(0.00)[2a00:1450:4864:20::42a:from]; NEURAL_HAM_SHORT(-0.95)[-0.949]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36]; FORGED_SENDER(0.30)[rkoberman@gmail.com,kob6558@gmail.com]; NEURAL_SPAM_LONG(1.00)[1.000]; MIME_TRACE(0.00)[0:+,1:+,2:~]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; FROM_NEQ_ENVFROM(0.00)[rkoberman@gmail.com,kob6558@gmail.com]; RCVD_TLS_ALL(0.00)[]; RCVD_COUNT_TWO(0.00)[2] X-ThisMailContainsUnwantedMimeParts: Y --0000000000005bd51b05ce448d5f Content-Type: text/plain; charset="UTF-8" I am seeing very strange CPU frequency issues on my Lenovo L15 with a CPU: Intel(R) Core(TM) i5-10210U CPU @ 1.60GHz (2112.13-MHz K8-class CPU) Origin="GenuineIntel" Id=0x806ec Family=0x6 Model=0x8e Stepping=12 eatures=0xbfebfbff eatures2=0x7ffafbbf AMD Features=0x2c100800 AMD Features2=0x121 Structured Extended eatures=0x29c67af + Structured Extended Features3=0xbc000400 XSAVE Features=0xf IA32_ARCH_CAPS=0x2b VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID TSC: P-state invariant, performance statistics The system is running with P-States disabled as this s one of the Lenovo mobile systems that locks up when they are enabled. The reported frequency of all threads is constant. > sysctl dev.cpu | grep freq: dev.cpu.7.freq: 400 dev.cpu.6.freq: 400 dev.cpu.5.freq: 400 dev.cpu.4.freq: 400 dev.cpu.3.freq: 400 dev.cpu.2.freq: 400 dev.cpu.1.freq: 400 dev.cpu.0.freq: 2101 If I do something that runs all 8 threads at near 100% for any length of time, the core temps will increase to over 90C. I will log: coretemp0: critical temperature detected, suggest system shutdown After that is received, the system starts to cool, eventually reaching the low 40s. All CPUs continue to show near 100% utilization. It will then repeat the cycle. All continue to show frequencies as above, CPU 0 at 2101 and the remainder at 400. I have never seen such behavior and am baffled by it. That issue was reported in 248659 and 253288 with P-States seems likely to be related. (BTW, these tickets should be merged as they are reporting the same problem.) Would a bug report be appropriate? The P-State issue was reported over a year ago and is still in the "New" state. It has been widely reported, most recently a few hours ago. -- Kevin Oberman, Part time kid herder and retired Network Engineer E-mail: rkoberman@gmail.com PGP Fingerprint: D03FB98AFA78E3B78C1694B318AB39EF1B055683 --0000000000005bd51b05ce448d5f--