Skip site navigation (1)Skip section navigation (2)
Date:      Tue, 1 Aug 2017 13:11:23 -0500
From:      Karl Denninger <karl@denninger.net>
To:        freebsd-stable@freebsd.org
Subject:   Re: issues with powerd/freq_levels
Message-ID:  <56f253a1-4bbe-f3a1-0ffd-a0153d767f3c@denninger.net>
In-Reply-To: <20170802004343.T6737@sola.nimnet.asn.au>
References:  <8AEC9DBC-BADD-4FB2-8358-DA43F7EF5E68@cs.huji.ac.il> <20170731201323.A6737@sola.nimnet.asn.au> <CAN6yY1t5xYXMig0PSGn=Gdr=fOZJUBUYEGtXYxxJ9Q7R=z_kWw@mail.gmail.com> <20170802004343.T6737@sola.nimnet.asn.au>

next in thread | previous in thread | raw e-mail | index | archive | help
This is a cryptographically signed message in MIME format.

--------------ms000804030807090501070604
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable

On 8/1/2017 12:45, Ian Smith wrote:
> On Mon, 31 Jul 2017 12:03:27 -0700, Kevin Oberman wrote:
>  > On Mon, Jul 31, 2017 at 3:48 AM, Ian Smith <smithi@nimnet.asn.au> wr=
ote:
>  >=20
>  > > On Mon, 31 Jul 2017 10:09:11 +0300, Daniel Braniss wrote:
>  > >
>  > >  > I am trying out PCengines latest apu2 boards, and I just notice=
d that
>  > > with different Freebsd versions I get
>  > >  > different freq_levels, and so when idling, each box (have 5) ha=
s a
>  > > different freq/temperature value, ranging
>  > >  > from 125/69.1C, 600/59.0C to 75/56.0C
>  > >  >
>  > >  > FreeBSD apu-4 11.1-STABLE FreeBSD 11.1-STABLE #5 f565b5a06ab3 (=
11) tip:
>  > > Mon Jul 31 09:36:33 IDT 2017
>  > >  > apu-4# sysctl dev.cpu.0.freq_levels
>  > >  > dev.cpu.0.freq_levels: 1000/980 800/807 600/609
>  > >
>  > > That looks about right.  On a Core2Duo (still on 9.3) I get:
>  > > dev.est.1.freq_settings: 2401/35000 2400/35000 1600/15000 800/1200=
0
>  > > dev.est.0.freq_settings: 2401/35000 2400/35000 1600/15000 800/1200=
0
>  > > dev.cpu.0.freq_levels: 2401/35000 2400/35000 1600/15000 800/12000
>  > > dev.cpu.0.freq: 800
>  > >
>  > > But only because I'd added to /boot/loader.conf:
>  > >
>  > > hint.p4tcc.0.disabled=3D1
>  > > hint.acpi_throttle.0.disabled=3D1
>  > >
>  > > which became the defaults sometime, maybe not before 11.0?  Otherw=
ise
>  > > mine would look more similar to the one below, with all 12.5% incr=
ements
>  > > in frequency enabled, which doesn't actually save any power at all=
=2E
>  > >
>  > >  > FreeBSD apu-5 11.1-PRERELEASE FreeBSD 11.1-PRERELEASE #0 21e9d1=
ca9b80
>  > > (11) tip: Tue May 30 11:51:48 IDT 2017
>  > >  > apu-5# sysctl dev.cpu.0.freq_levels
>  > >  > dev.cpu.0.freq_levels: 1000/966 875/845 800/795 700/695 600/600=
 525/525
>  > > 450/450 375/375 300/300 225/225 150/150 75/75
>  > >
>  > > Looks like either p4tcc or acpi_throttle is enabled?  See cpufreq(=
4).
>  > > As above, these don't buy you anything but extra busyness for powe=
rd.
>  > >
>  > > Also noticed that the (nice, low!) milliwatt figures for 1000/800/=
600
>  > > freqs are a bit different to the -stable one.  Slightly Different =
model?
>  > >
>  > >  > FreeBSD apu-1 10.3-STABLE FreeBSD 10.3-STABLE #4 267788fd852c (=
10) tip:
>  > > Tue Jan 10 09:09:00 IST 2017
>  > >  > apu-1# sysctl dev.cpu.0.freq_levels
>  > >  > dev.cpu.0.freq_levels: 1000/-1 875/-1 750/-1 625/-1 500/-1 375/=
-1
>  > > 250/-1 125/-1
>  > >
>  > > And that looks like est(4) isn't enabled/attaching at all .. see d=
mesg
>  > > on all of these for clues.
>  > >
>  > >  > so, any ideas as to what is going on?
>  > >
>  > > Pure guesswork on experience with older versions, I'm not up to da=
te.
>  > >
>  >=20
>  > Very odd. Are all systems running identical CPUs and BIOSes? Identic=
al
>  > loader and sysctl configurations? Look at /var/rn/dmesg.boot for CPU=

>  > information. Is EST being detected? It used to be early in the boot
>  > process, but is now fairly late. (In my case, about 2/3 through the
>  > dmesg.boot file.
>
> Hi Kevin, it's been a while ..
>
> Danny, can you put up a verbose boot dmesg.boot of one(?) for a browse?=
=20
> Or maybe apu-4 and -1, if not all.  I'd expect error msgs on -1 anyway.=

>
>  > I have p4tcc and throttling explicitly turned off (which should now =
be the
>  > default), but my Sandy Bridge Core i5 still shows:
>  > dev.cpu.0.freq_levels: 2501/35000 2500/35000 2000/26426 1800/23233
>  > 1600/20164 1400/17226 1200/14408 1000/11713 800/9140
>
> All truly available I see on more recent processors.  Certainly not 1/8=
=20
> duty-cycle multipliers as p4tcc and maybe? acpi_throttle (not seen here=
)
>
>  > The first is really bogus to indicate "turbo" mode.
>
> Usefully bogus, in that you can flag powerd to (in your case) -M 2500 t=
o=20
> prevent it engaging "turbo" mode, as I do on my old Core2Duo, as advise=
d=20
> by Warner years ago to avoid overheating on buildworlds and such - but =

> more recent incarnations of "turbo" are supposedly far more functional.=

>
> Admittedly a digression .. mostly coming from wondering about data Karl=

> posted in response, indicating different Cx levels available and so use=
d=20
> by the latter 3 AP cores, which was news to me.  I'd like to know more,=
=20
> if only for gratuitous curiosity.  Others can tick their TL;DR box :)
>
>  > Temperature is a totally separate issue. It is VERY sensitive to ext=
ernal
>  > issue like airflow and position of the CPU in relation to other comp=
onents
>  > in the chassis Also, unless you have a lot of cores, you probably sh=
ould
>  > set both economy_cx_lowest and performance_cx_lowest to Cmax. Econom=
y
>  > should default to that, but  performance will not as that can cause =
issues
>  > on systems with large numbers of cores, so is set to C2. Many such s=
ystem
>  > used to disable deeper sleep modes in BIOS, but I am way behind the =
times
>  > and don't know about the current state of affairs. Certainly for sys=
tems
>  > with 32 or fewer cores, this should not be an issue. In any case, Cx=
 state
>  > can sharply impact temperature.
>
> Indeed.  But as these are low-power devices already, it's likely less o=
f=20
> a concern, but maximising efficiency and minimising stress never hurts.=

>
>  > Finally, the last case with power levels of -1 for all frequencies i=
s
>  > probably because the CPU manufacturer (Intel?) has not published thi=
s
>  > information. For a while they were treating this as "proprietary"
>  > information. Very annoying! It's always something that is not readil=
y
>  > available. Thi is one reason I suspect your CPUs are not identical.
>
> Hmm, bought as a batch, that sounds unlikely, though their BIOSes (ono)=
=20
> may vary, and would be worth checking on each - and BIOS settings, too.=

>
> Danny, is powerd running on all these?  I doubt it would load on apu-1 =

> as it stands.  Note these are 'pure' 1/8 factors of 1000, p4tcc-alike, =

> and I think quite likely indicate that cpufreq(4) failed to initialise?=
=20
> debug.cpufreq.verbose=3D1 in /boot/loader.conf might show a clue, with =
a=20
> verbose dmesg.boot anyway.
>
> Later: oops, just reread Karl's message, where I was unfaniliar with=20
> different CPUs showing different C-states, and noticing that despite=20
> cpu0 showing C2(io) available, and cx_lowest as C2, yet it used 100% C1=
=20
> state, which was all that was available to cpu1 to 3.
>
> But then I twigged to Karl's hwpstate errors, so with 'apropos hwpstate=
'=20
> still showing nothing after all these years, along with other cpufreq(4=
)=20
> drivers, I used the list search via duckduckgo to finally find one (1) =

> message, which lead to one detailed thread (that I even bought into!)
>
>  https://lists.freebsd.org/pipermail/freebsd-stable/2012-May/subject.ht=
ml
>  https://lists.freebsd.org/pipermail/freebsd-stable/2012-June/thread.ht=
ml
>
> /hwpstate  Note the May one needs following by Subject, else it splits =

> into 5 separate threads (?)
>
> Which may be interesting to cpufreq nerds, but had me remember that=20
> hwpstate(0) is for AMD not Intel CPUs.  So now I'm totally confused :)
>
> Danny, do your results from Karl's sysctl listings agree with his?
These are not Intel CPUs; they are an embedded AMD 64-bit CPU.

The specs on the one I have are:

  * CPU: AMD Embedded G series GX-412TC, 1 GHz quad Jaguar core with 64
    bit and AES-NI support, 32K data + 32K instruction cache per core,
    shared 2MB L2 cache.
  * DRAM: 2 or 4 GB DDR3-1333 DRAM
  * Storage: Boot from m-SATA SSD, SD card (internal sdhci controller),
    or external USB. 1 SATA + power connector.
  * 12V DC, about 6 to 12W depending on CPU load. Jack =3D 2.5 mm, center=

    positive
  * Connectivity: 2 or 3 Gigabit Ethernet channels (Intel i211AT on
    apu2b2, i210AT on apu2b4)
  * I/O: DB9 serial port, 2 USB 3.0 external + + 2 USB 2.0 internal,
    three front panel LEDs, pushbutton
  * Expansion: 2 miniPCI express (one with SIM socket), LPC bus, GPIO
    header, I2C bus, COM2 (3.3V RXD / TXD)
  * Board size: 6 x 6" (152.4 x 152.4 mm) - same as apu1d, alix2d13 and
    wrap1e.
  * Firmware: coreboot <http://www.coreboot.org/>; (please contact
    support@pcengines.ch for source code if desired).
  * Cooling: Conductive cooling from the CPU to the enclosure using a 3
    mm alu heat spreader (included).


The one I have here is a 2Gb RAM/2 IGB Ethernet interface unit.

They're surprisingly capable for their size, conductive cooling and
(especially) price.  As a firewall/VPN ingress point they perform
nicely.  I boot the one I have here from an SD card in a NanoBSD config
but you can stick a mSATA SSD (laptop-computer style) in the case and
boot from that if you want (I've tried it; the internal BIOS it comes
with boots from it just fine.)

--=20
Karl Denninger
karl@denninger.net <mailto:karl@denninger.net>
/The Market Ticker/
/[S/MIME encrypted email preferred]/

--------------ms000804030807090501070604
Content-Type: application/pkcs7-signature; name="smime.p7s"
Content-Transfer-Encoding: base64
Content-Disposition: attachment; filename="smime.p7s"
Content-Description: S/MIME Cryptographic Signature

MIAGCSqGSIb3DQEHAqCAMIACAQExDzANBglghkgBZQMEAgMFADCABgkqhkiG9w0BBwEAAKCC
BlwwggZYMIIEQKADAgECAgE9MA0GCSqGSIb3DQEBCwUAMIGQMQswCQYDVQQGEwJVUzEQMA4G
A1UECBMHRmxvcmlkYTESMBAGA1UEBxMJTmljZXZpbGxlMRkwFwYDVQQKExBDdWRhIFN5c3Rl
bXMgTExDMRwwGgYDVQQDExNDdWRhIFN5c3RlbXMgTExDIENBMSIwIAYJKoZIhvcNAQkBFhND
dWRhIFN5c3RlbXMgTExDIENBMB4XDTE2MTIxODE5NDUzNVoXDTIxMTIxNzE5NDUzNVowVzEL
MAkGA1UEBhMCVVMxEDAOBgNVBAgTB0Zsb3JpZGExGTAXBgNVBAoTEEN1ZGEgU3lzdGVtcyBM
TEMxGzAZBgNVBAMUEmthcmxAZGVubmluZ2VyLm5ldDCCAiIwDQYJKoZIhvcNAQEBBQADggIP
ADCCAgoCggIBAM2N5maxs7NkoY9g5NMxFWll0TYiO7gXrGZTo3q25ZJgNdPMwrntLz/5ewE9
07TEbwJ3ah/Ep9BfZm7JF9vTtE1HkgKtXNKi0pawNGm1Yn26Dz5AbUr1byby6dFtDJr14E07
trzDCtRRvTkOVSBj6PQPal0fAnDtkIYQBVcuMkXkuMCtyfE95pjm8g4K9l7lAcKii3T1/3rE
hCc1o2nBnb7EN1/XwBeCDGB+I2SN/ftZDbKQqGAF5q9dUn+iXU7Z/CVSfUWmhVh6cVZA4Ftv
TglUqj410OuPx+cUQch3h1kFgsuhQR63HiJc3HbRJllHsV0rihvL1CjeARQkhnA6uY9NLFST
p5I/PfzBzW2MSmtN/tGZvmfKKnmtbfUNgkzbIR1K3lsum+yEL71kB93Xtz/4f1demEx5c8TJ
RBIniDHjDeLGK1aoBu8nfnvXAvgthFNTWBOEoR49AHEPjC3kZj0l8JQml1Y8bTQD5gtC5txl
klO60WV0EufU7Hy9CmynMuFtjiA2v71pm097rXeCdrAKgisdYeEESB+SFrlY65rLiLv4n8o1
PX7DqRfqKkOYIakZ0ug/yHVKcq2EM3RiJxwzls5gT70CoOBlKbrC98O8TA6teON0Jq30M06t
NTI2HhvNbJDLbBH+Awf4h1UKB+0ufENwjVvF5Jfz8Ww/FaSDAgMBAAGjgfQwgfEwNwYIKwYB
BQUHAQEEKzApMCcGCCsGAQUFBzABhhtodHRwOi8vY3VkYXN5c3RlbXMubmV0Ojg4ODgwCQYD
VR0TBAIwADARBglghkgBhvhCAQEEBAMCBaAwCwYDVR0PBAQDAgXgMCwGCWCGSAGG+EIBDQQf
Fh1PcGVuU1NMIEdlbmVyYXRlZCBDZXJ0aWZpY2F0ZTAdBgNVHQ4EFgQUpfAI3y+751pp9A0w
6vJHx8RoR/MwHwYDVR0jBBgwFoAUJHGbnYV9/N3dvbDKkpQDofrTbTUwHQYDVR0RBBYwFIES
a2FybEBkZW5uaW5nZXIubmV0MA0GCSqGSIb3DQEBCwUAA4ICAQBiB6MlugxYJdccD8boZ/u8
d8VxmLkJCtbfyYHRjYdyoABLW5hE3k3xSpYCM9L7vzWyV/UWwDYKi4ZzxHo4g+jG/GQZfKhx
v38BQjL2G9xD0Hn2d+cygOq3UPjVYlbbfQoew6JbyCFXrrZ7/0jvRMLAN2+bRC7ynaFUixPH
Whnj9JSH7ieYdzak8KN+G2coIC2t2iyfXVKehzi5gdNQ0vJ7+ypbGsRm4gE8Mdo9N/WgFPvZ
HPFqR9Dwas7Z+aHwOabpk5r/336SyjOaZsn3MqKJQZL6GqDKusVOCWt+9uFAD8kadg7FetZe
atIoD9I+zbp59oVoMnkMDMx7Hi85faU03csusqMGsjSsAzWSI1N8PJytZlchLiykokLKc3OL
G87QKlErotlou7cfPX2BbEAH5wmkj9oiqZhxIL/wwAUA+PkiTbEmksKBNompSjUq/6UsR8EA
s74gnu17lmijv8mrg2qMlwRirE7qG8pnE8egLtCDxcjd0Of9WMi2NJskn0/ovC7P+J60Napl
m3ZIgPJst1piYSE0Zc1FIat4fFphMfK5v4iLblo1tFSlkdx1UNDGdg/U+LaXkNVXlMp8fyPm
R80V6cIrCAlEWnBJNxG1UyfbbsvNMCCZBM4faGGsR/hhQOiydlruxhjL6P8J2WV8p11DdeGx
KymWoil2s1J5WTGCBRMwggUPAgEBMIGWMIGQMQswCQYDVQQGEwJVUzEQMA4GA1UECBMHRmxv
cmlkYTESMBAGA1UEBxMJTmljZXZpbGxlMRkwFwYDVQQKExBDdWRhIFN5c3RlbXMgTExDMRww
GgYDVQQDExNDdWRhIFN5c3RlbXMgTExDIENBMSIwIAYJKoZIhvcNAQkBFhNDdWRhIFN5c3Rl
bXMgTExDIENBAgE9MA0GCWCGSAFlAwQCAwUAoIICTTAYBgkqhkiG9w0BCQMxCwYJKoZIhvcN
AQcBMBwGCSqGSIb3DQEJBTEPFw0xNzA4MDExODExMjNaME8GCSqGSIb3DQEJBDFCBEAMlw4M
osAabDudme7kkwhxB8CmOvt2pvYFODFg5FPZExxbZrfbhCkfkPWq+D8ISMEl83uiAIg8Nd+G
R7NDOOj2MGwGCSqGSIb3DQEJDzFfMF0wCwYJYIZIAWUDBAEqMAsGCWCGSAFlAwQBAjAKBggq
hkiG9w0DBzAOBggqhkiG9w0DAgICAIAwDQYIKoZIhvcNAwICAUAwBwYFKw4DAgcwDQYIKoZI
hvcNAwICASgwgacGCSsGAQQBgjcQBDGBmTCBljCBkDELMAkGA1UEBhMCVVMxEDAOBgNVBAgT
B0Zsb3JpZGExEjAQBgNVBAcTCU5pY2V2aWxsZTEZMBcGA1UEChMQQ3VkYSBTeXN0ZW1zIExM
QzEcMBoGA1UEAxMTQ3VkYSBTeXN0ZW1zIExMQyBDQTEiMCAGCSqGSIb3DQEJARYTQ3VkYSBT
eXN0ZW1zIExMQyBDQQIBPTCBqQYLKoZIhvcNAQkQAgsxgZmggZYwgZAxCzAJBgNVBAYTAlVT
MRAwDgYDVQQIEwdGbG9yaWRhMRIwEAYDVQQHEwlOaWNldmlsbGUxGTAXBgNVBAoTEEN1ZGEg
U3lzdGVtcyBMTEMxHDAaBgNVBAMTE0N1ZGEgU3lzdGVtcyBMTEMgQ0ExIjAgBgkqhkiG9w0B
CQEWE0N1ZGEgU3lzdGVtcyBMTEMgQ0ECAT0wDQYJKoZIhvcNAQEBBQAEggIAVM7z1REF4TAB
A8p/PKjeuqux4wJc1JU4mFh98f7JOhs870SrZHw0Kq/bEHEebMi/RHqK4cnXMk3ui3nDuW9w
s0cFRd4izJF1EqF+0voct0EPfbwvNzuVN4vC8DcmsfDT5VRPHisIzdQgm7Fw7GweIUfKaW+C
zAsevNhXMr4GJf0ZKkEWfSEYud0Vl3RClkXyRiFx9JxtqXzc4C4Dk69bGIM8ZsaTX8J3JStJ
E+/zsHyOUXjweLxKmd3xzzi1R+tt4bSdgNd6JphBxcoL0EvzQ2qi5ugP3MQFxEkNZUqunjLD
fZ7uVyFKHBPuAFSmY4CcYkZvA706lCIoVuQm2twgGR5UU3B4JwGpUJwGBWzF8gdlr73tdEKo
ZoHcr0vpTWjSRu6dH1kkCiL5BTcxjjosQveK+tgWj/r45hLoKQPVEs028hXBzOmkseTgRNn0
8kV08mWQd8mM0ARRRCxCF87OsCRKb/v8AvbtIkF0ULCSYyNOrk6yYdcVWKHfGKbv8K8iIeqx
ufHkr1FiacsAcjtD+IT416Ztxb9bZkQmRCMHbXhweawMjMMwPwxLwPR1ALbZcwyDkmd9v5CE
cxJgD9kd3LkMS8W0QoI/RhWFKu4DI5LEtl9L4CMKQW1Y6vfqfHTV50fDis/BFASSFYsmo0Kk
HFyYPfXpPkxA1WJxIWQ2NncAAAAAAAA=
--------------ms000804030807090501070604--



Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?56f253a1-4bbe-f3a1-0ffd-a0153d767f3c>