From owner-freebsd-arm@freebsd.org Sun Dec 1 22:05:40 2019 Return-Path: Delivered-To: freebsd-arm@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 36F181BAC70 for ; Sun, 1 Dec 2019 22:05:40 +0000 (UTC) (envelope-from greg@unrelenting.technology) Received: from out.migadu.com (out.migadu.com [91.121.223.63]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "smtp.migadu.com", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 47R2PH1VYhz4KlG for ; Sun, 1 Dec 2019 22:05:39 +0000 (UTC) (envelope-from greg@unrelenting.technology) Received: (Migadu outbound); Sun, 01 Dec 2019 22:05:37 +0000 Received: from wms0-eu-central.migadu.com (wms0-eu-central.migadu.com [139.162.159.86]) by out.migadu.com (Haraka/2.8.16) with ESMTPSA id 5DED345C-84E9-4D6C-BC4D-D55ABA38ACB7.1 envelope-from (authenticated bits=0) (version=TLSv1/SSLv3 cipher=ECDHE-RSA-AES256-GCM-SHA384 verify=FAIL); Sun, 01 Dec 2019 22:05:37 +0000 MIME-Version: 1.0 Date: Sun, 01 Dec 2019 22:05:37 +0000 Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable X-Mailer: RainLoop/1.12.1 From: greg@unrelenting.technology Message-ID: Subject: Re: 64 bit ARM systems with more than four cores To: "John F Carr" , freebsd-arm@freebsd.org In-Reply-To: <94BC4785-B16E-43B2-B222-3D3C8C5DEB50@exchange.mit.edu> References: <94BC4785-B16E-43B2-B222-3D3C8C5DEB50@exchange.mit.edu> DKIM-Signature: v=1; a=rsa-sha256; bh=M1jKrgqD2kxZGPkETteP3WnIcwhCvs3jO4+675kUa6E=; c=relaxed/simple; d=unrelenting.technology; h=from:subject:date:to; s=default; b=LIPJqVhuwsBO7Tng3woYTyCFWfmSaa7//TVDYOwZ4c99R+S4ccbWXYTGAArh7yjw3Vrw498F/OiSkMdOiigkCMwLtTM6gGAPkRruAdIXcydvuFLqQxHcZg65CxjG1zQ3so1wHE205PGabqNKq9mbeWqgkdAk+dAA7DWEvJiUkgs= X-Rspamd-Queue-Id: 47R2PH1VYhz4KlG X-Spamd-Bar: ----- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=unrelenting.technology header.s=default header.b=LIPJqVhu; dmarc=pass (policy=none) header.from=unrelenting.technology; spf=pass (mx1.freebsd.org: domain of greg@unrelenting.technology designates 91.121.223.63 as permitted sender) smtp.mailfrom=greg@unrelenting.technology X-Spamd-Result: default: False [-5.30 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_DKIM_ALLOW(-0.20)[unrelenting.technology:s=default]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:91.121.223.63]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[unrelenting.technology:+]; RCPT_COUNT_TWO(0.00)[2]; RCVD_IN_DNSWL_NONE(0.00)[63.223.121.91.list.dnswl.org : 127.0.10.0]; FROM_NO_DN(0.00)[]; DMARC_POLICY_ALLOW(-0.50)[unrelenting.technology,none]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; IP_SCORE(-2.30)[ip: (-9.85), ipnet: 91.121.0.0/16(-3.46), asn: 16276(1.80), country: FR(-0.00)]; ASN(0.00)[asn:16276, ipnet:91.121.0.0/16, country:FR]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_TLS_ALL(0.00)[]; RCVD_COUNT_TWO(0.00)[2] X-BeenThere: freebsd-arm@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Porting FreeBSD to ARM processors." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 01 Dec 2019 22:05:40 -0000 December 2, 2019 12:37 AM, "John F Carr" wrote:=0A=0A> Two = RK3399 based systems, 2 A-72 + 4 A-53: RockPro64 (http://www.pine64.com) = and ROCK Pi 4=0A> (http://radxa.com). I can't use the RockPro64 due to th= e 1.5 MBps serial port. Apparently it works=0A> or almost works with some= special handling if your serial interface can count to 1,500,000. The=0A= > ROCK Pi 4 is in crochet so it must work... right? Does it have a reason= able console port bit rate?=0A=0ABefore I got my 1.5M capable dongle for = the ROCKPro64, I just had an u-boot command to=0Aswitch to 115200 in the = boot script.=0A=0AI consider 2xA72+4xA53 worse than 4xA72 to be honest.= =0AEspecially since the FreeBSD scheduler is not big.LITTLE aware =E2=80= =94 it loves to schedule=0Ae.g. a big single-threaded linker job onto the= slow cores. So you have to mess with=0Acpuset but apply it carefully to = still utilize all cores on parallel tasks.. argh.=0A=0A> One LX2160A base= d system, 16 A-72 cores: HoneyComb LX2K=0A> (https://www.solid-run.com/nx= p-lx2160a-family/honeycomb-workstation). I see relevant files in=0A> sys/= gnu/dts/arm64/freescale but nothing outside of these files imported from = Linux. It's not=0A> mentioned on https://wiki.freebsd.org/arm64. My guess= is that means FreeBSD does not run. Is it a=0A> little job or a big one?= =0A=0AThere's SBSA-ish ACPI-capable firmware so it should boot, but proba= bly with uhh not a lot of devices.=0AThey've been sort of vaguely promisi= ng that PCIe would work in ACPI..=0Aand recently this commit dropped:=0Ah= ttps://source.codeaurora.org/external/qoriq/qoriq-components/edk2-platfor= ms/commit/?h=3DLX2-UEFI-ACPI-0.2&id=3Dec8deb524171a03448395e6b8acc49978bc= f5ce5=0Aso maybe I shouldn't have doubted them, but I missed the $500 dis= count period waiting for this :(=0A=0A> SC2A11, 24 A-53 cores at 1 GHz: S= ynQuacer (https://www.96boards.org/product/developerbox). I don't=0A> see= any evidence of SC2A11 support in the kernel tree or on https://wiki.fre= ebsd.org/arm64. My=0A> guess is that means FreeBSD does not run.=0A=0AThe= re's SBSA-ish ACPI-capable firmware so it should boot, and PCIe should wo= rk.=0AI guess nobody tried because it's very expensive for something with= A53 cores.=0A=0AI would *not* trade my MACCHIATObin for this because A53= is just so slow.=0A=0A> ThunderX in various forms, rack mount or worksta= tion. Nice specs and apparently supported but the=0A> two American system= builders don't seem interested in selling me one.=0A=0AKeep in mind that= the TX1 cores are slow. It's great at super parallel workloads,=0Abut wh= en you have something single-threaded, it's no better than an A53.=0A=0A= =0A=0ANow, if you have cash but not ThunderX2 levels of cash: Ampere eMAG= is the best option.=0AAvailable in Lenovo HR350A and HR330A boxes, also = from Avantek (idk what's the mainboard there??),=0Aalso rentable in bare-= metal-cloud at Packet (they have the Lenovos).=0A=0ASee https://bugs.free= bsd.org/bugzilla/show_bug.cgi?id=3D237055 for the bringup story :)=0AI th= ink most of the bugfixes required for eMAG are in -CURRENT.