From owner-freebsd-stable@freebsd.org Wed Aug 2 18:07:25 2017 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 4B845DAF434 for ; Wed, 2 Aug 2017 18:07:25 +0000 (UTC) (envelope-from smithi@nimnet.asn.au) Received: from mailman.ysv.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 36CCE6FB7C for ; Wed, 2 Aug 2017 18:07:25 +0000 (UTC) (envelope-from smithi@nimnet.asn.au) Received: by mailman.ysv.freebsd.org (Postfix) id 35EB2DAF432; Wed, 2 Aug 2017 18:07:25 +0000 (UTC) Delivered-To: stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 35736DAF431 for ; Wed, 2 Aug 2017 18:07:25 +0000 (UTC) (envelope-from smithi@nimnet.asn.au) Received: from sola.nimnet.asn.au (paqi.nimnet.asn.au [115.70.110.159]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 7E2F56FB7A for ; Wed, 2 Aug 2017 18:07:23 +0000 (UTC) (envelope-from smithi@nimnet.asn.au) Received: from localhost (localhost [127.0.0.1]) by sola.nimnet.asn.au (8.14.2/8.14.2) with ESMTP id v72I6jon027509; Thu, 3 Aug 2017 04:06:46 +1000 (EST) (envelope-from smithi@nimnet.asn.au) Date: Thu, 3 Aug 2017 04:06:45 +1000 (EST) From: Ian Smith To: Daniel Braniss cc: Kevin Oberman , Karl Denninger , stable@freebsd.org Subject: Re: issues with powerd/freq_levels In-Reply-To: Message-ID: <20170803030735.N22231@sola.nimnet.asn.au> References: <8AEC9DBC-BADD-4FB2-8358-DA43F7EF5E68@cs.huji.ac.il> <20170731201323.A6737@sola.nimnet.asn.au> <20170802004343.T6737@sola.nimnet.asn.au> MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 02 Aug 2017 18:07:25 -0000 On Wed, 2 Aug 2017 13:30:03 +0300, Daniel Braniss wrote: > > On 1 Aug 2017, at 20:45, Ian Smith wrote: > > > > On Mon, 31 Jul 2017 12:03:27 -0700, Kevin Oberman wrote: > >> On Mon, Jul 31, 2017 at 3:48 AM, Ian Smith wrote: > >> > >>> On Mon, 31 Jul 2017 10:09:11 +0300, Daniel Braniss wrote: > >>> > >>>> I am trying out PCengines latest apu2 boards, and I just noticed that > >>> with different Freebsd versions I get > >>>> different freq_levels, and so when idling, each box (have 5) has a > >>> different freq/temperature value, ranging > >>>> from 125/69.1C, 600/59.0C to 75/56.0C > >>>> > >>>> FreeBSD apu-4 11.1-STABLE FreeBSD 11.1-STABLE #5 f565b5a06ab3 (11) tip: > >>> Mon Jul 31 09:36:33 IDT 2017 > >>>> apu-4# sysctl dev.cpu.0.freq_levels > >>>> dev.cpu.0.freq_levels: 1000/980 800/807 600/609 > >>> > >>> That looks about right. Time to cut out lots and summarise a bit, from your dmesgs: apu-3 dmesg that you posted, presumably the same 11.1-STABLE as the apu-4 above, to within a few days, shows only: hwpstate0: on cpu0 random: harvesting attach, 8 bytes (4 bits) from cpufreq0 random: harvesting attach, 8 bytes (4 bits) from hwpstate0 Device configuration finished. Which appears to be what you want - but are you seeing the hwpstate errors from powerd that Karl commented on? > >>> hint.p4tcc.0.disabled=1 > >>> hint.acpi_throttle.0.disabled=1 > >>>> FreeBSD apu-5 11.1-PRERELEASE FreeBSD 11.1-PRERELEASE #0 21e9d1ca9b80 > >>> (11) tip: Tue May 30 11:51:48 IDT 2017 > >>>> apu-5# sysctl dev.cpu.0.freq_levels > >>>> dev.cpu.0.freq_levels: 1000/966 875/845 800/795 700/695 600/600 525/525 > >>> 450/450 375/375 300/300 225/225 150/150 75/75 > >>> > >>> Looks like either p4tcc or acpi_throttle is enabled? See cpufreq(4). hwpstate0: on cpu0 random: harvesting attach, 8 bytes (4 bits) from hwpstate0 acpi_throttle1: on cpu1 acpi_throttle1: failed to attach P_CNT device_attach: acpi_throttle1 attach returned 6 acpi_throttle2: on cpu2 acpi_throttle2: failed to attach P_CNT device_attach: acpi_throttle2 attach returned 6 acpi_throttle3: on cpu3 acpi_throttle3: failed to attach P_CNT device_attach: acpi_throttle3 attach returned 6 Device configuration finished. So it's loaded hwpstate(0) but only apparently successfully attached to cpu0, and failed to attach acpi_throttle to cpus 1-3, yet the cpu0 freq_levels are those of your 3 real freqs (1000, 800, 600) times all x/8 factors. So that one may not have hint.acpi_throttle.0.disabled=1? > >>>> FreeBSD apu-1 10.3-STABLE FreeBSD 10.3-STABLE #4 267788fd852c (10) tip: > >>> Tue Jan 10 09:09:00 IST 2017 > >>>> apu-1# sysctl dev.cpu.0.freq_levels > >>>> dev.cpu.0.freq_levels: 1000/-1 875/-1 750/-1 625/-1 500/-1 375/-1 > >>> 250/-1 125/-1 > >>> > >>> And that looks like est(4) isn't enabled/attaching at all .. see dmesg > >>> on all of these for clues. This is a different board entirely. Different CPU, L2 unified cache, ethernet devices (Realtek vs Intel), less memory (4G vs 4.5G) and 2 vs 4 CPUs (unless HT is off on this and on on the others?), SATA-2 vs SATA-3 on ada0, only USB2 vs some USB3 (XHCI), and a different cpufreq setup again .. no sign of hwpstate and: acpi_throttle0: on cpu0 acpi_throttle0: P_CNT from P_BLK 0x810 acpi_throttle1: on cpu1 acpi_throttle1: failed to attach P_CNT device_attach: acpi_throttle1 attach returned 6 Device configuration finished. Sounds like a bogon must have found its way into your batch? > > Danny, can you put up a verbose boot dmesg.boot of one(?) for a browse? > > Or maybe apu-4 and -1, if not all. I'd expect error msgs on -1 anyway. > they are now available at: > http://www.cs.huji.ac.il/~danny/pcengines/ Thanks, that made it all pretty clear. Not that I know much about lots of this stuff, especially nowadays, but some things stuck out. Kevin wrote: > >> Temperature is a totally separate issue. It is VERY sensitive to external > >> issue like airflow and position of the CPU in relation to other components > >> in the chassis Also, unless you have a lot of cores, you probably should > >> set both economy_cx_lowest and performance_cx_lowest to Cmax. Economy > >> should default to that, but performance will not as that can cause issues > >> on systems with large numbers of cores, so is set to C2. Many such system > >> used to disable deeper sleep modes in BIOS, but I am way behind the times > >> and don't know about the current state of affairs. Certainly for systems > >> with 32 or fewer cores, this should not be an issue. In any case, Cx state > >> can sharply impact temperature. > > > > Indeed. But as these are low-power devices already, it's likely less of > > a concern, but maximising efficiency and minimising stress never hurts. Yes, it might be helpful to see Danny's version of the data Karl showed: $ sysctl -a|grep cpu.0 $ sysctl -a|grep cx on an 11.1-STABLE one at least. In fact Karl's 59.2C temperature (at 1000MHz, perhaps only momentarily as 'sysctl -a' has powerd take my older box to 1133) ~matches Danny's. > > Danny, is powerd running on all these? I doubt it would load on apu-1 > > as it stands. > > it is working on the apu-1! Ok, but using bogus x/8 clock multipliers of 1000MHz. But I expect you'll be wanting to exchange that box for one of the others anyway? Is it working on the others? Does it actually idle at 600MHz? If in doubt, running 'powerd -v' for a while will show you what's happening. Despite being low power, running slower when more or less idle - along with hopefully getting to use C2 state - should cool these down a lot. Perhaps there were hwpstate and/or cpufreq updates between 11.1-PRE and -STABLE? Any deeper out of my depth and I mightn't come up for air! cheers, Ian