From owner-svn-src-all@freebsd.org  Mon Apr 29 15:23:10 2019
Return-Path: <owner-svn-src-all@freebsd.org>
Delivered-To: svn-src-all@mailman.ysv.freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1])
 by mailman.ysv.freebsd.org (Postfix) with ESMTP id 81F361594052
 for <svn-src-all@mailman.ysv.freebsd.org>;
 Mon, 29 Apr 2019 15:23:10 +0000 (UTC)
 (envelope-from greg@unrelenting.technology)
Received: from out.migadu.com (out.migadu.com [91.121.223.63])
 (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits))
 (Client CN "smtp.migadu.com",
 Issuer "Let's Encrypt Authority X3" (verified OK))
 by mx1.freebsd.org (Postfix) with ESMTPS id 07E5688B7E
 for <svn-src-all@freebsd.org>; Mon, 29 Apr 2019 15:23:09 +0000 (UTC)
 (envelope-from greg@unrelenting.technology)
Received: (Migadu outbound); Mon, 29 Apr 2019 15:21:56 +0000
Received: from [192.168.1.141] ([62.122.208.146])
 by out.migadu.com (Haraka/2.8.16) with ESMTPSA id
 DE48E6A2-35B1-4CA1-BF67-A0AFD6FB875C.1
 envelope-from <greg@unrelenting.technology> (authenticated bits=0)
 (version=TLSv1/SSLv3 cipher=ECDHE-RSA-AES256-GCM-SHA384 verify=FAIL);
 Mon, 29 Apr 2019 15:21:55 +0000
Date: Mon, 29 Apr 2019 18:21:55 +0300
From: Greg V <greg@unrelenting.technology>
Subject: Re: svn commit: r346598 - head/sys/modules
To: Ed Maste <emaste@freebsd.org>
Cc: "Rodney W. Grimes" <rgrimes@freebsd.org>, src-committers
 <src-committers@freebsd.org>, svn-src-all <svn-src-all@freebsd.org>,
 svn-src-head <svn-src-head@freebsd.org>
Message-Id: <1556551315.5165.0@unrelenting.technology>
In-Reply-To: <CAPyFy2BGLhwrRpdB1dNJkaU352Ba9qBZv3=u=A8ttP0f1Nwfqw@mail.gmail.com>
References: <201904231511.x3NFB1tR032938@repo.freebsd.org>
 <201904231725.x3NHPqCt038790@gndrsh.dnsmgr.net>
 <CAPyFy2BGLhwrRpdB1dNJkaU352Ba9qBZv3=u=A8ttP0f1Nwfqw@mail.gmail.com>
X-Mailer: geary/master~gaf931ab3
MIME-Version: 1.0
Content-Type: text/plain; charset=windows-1251; format=flowed
Content-Transfer-Encoding: quoted-printable
DKIM-Signature: v=1; a=rsa-sha256;
 bh=J22WwXPhv8rlcXxrH1Szb1/CQH8VVwWYPFH6M6qtAYY=; c=relaxed/simple;
 d=unrelenting.technology; h=from:subject:date:to; s=default;
 b=cn+HUI5DEB/kYkpuUaKiYWax28cHGSswHWUOXDkIFBhF9JzkbD3p07dL8UOVYa2Lwfpg/swFPcFaQSIoW+0gikLpt02BY4QC2hiG7gII5Tb5Ux4HH4uzyCO9GnhzFH9crJpPi1bpqpcpRXyR1j6MK0yqRZtkOugWeddeKWgaSoM=
X-Rspamd-Queue-Id: 07E5688B7E
X-Spamd-Bar: ------
Authentication-Results: mx1.freebsd.org
X-Spamd-Result: default: False [-6.99 / 15.00];
 NEURAL_HAM_MEDIUM(-1.00)[-1.000,0];
 NEURAL_HAM_SHORT(-0.99)[-0.988,0]; REPLY(-4.00)[];
 NEURAL_HAM_LONG(-1.00)[-1.000,0]
X-BeenThere: svn-src-all@freebsd.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: "SVN commit messages for the entire src tree \(except for &quot;
 user&quot; and &quot; projects&quot; \)" <svn-src-all.freebsd.org>
List-Unsubscribe: <https://lists.freebsd.org/mailman/options/svn-src-all>,
 <mailto:svn-src-all-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/svn-src-all/>
List-Post: <mailto:svn-src-all@freebsd.org>
List-Help: <mailto:svn-src-all-request@freebsd.org?subject=help>
List-Subscribe: <https://lists.freebsd.org/mailman/listinfo/svn-src-all>,
 <mailto:svn-src-all-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Mon, 29 Apr 2019 15:23:10 -0000



On Mon, Apr 29, 2019 at 10:08, Ed Maste <emaste@freebsd.org> wrote:
> On Tue, 23 Apr 2019 at 13:26, Rodney W. Grimes
> <freebsd@gndrsh.dnsmgr.net> wrote:
>>=20
>>  Very cool, now how do I get a PCIe slot into a RPI3!!! lol  :-)
>=20
> I know you're joking but the comment does highlight an issue in the
> AArch64 world - there's a lack of good mid-range developer platforms.
> FreeBSD runs on Cavium/Marvell ThunderX and ThunderX2 and now on
> Ampere eMAG with the WIP discussed in PR 237055. These platforms have
> room for lots of memory, very high core/thread counts (32 to 256), and
> a good complement of PCIe interfaces. The specs go far beyond those of
> a typical desktop software development platform, and the price does
> too. We also run on small embedded boards like the RPi, Pine64, etc.
> just fine, but there's not much in the middle. What we really need is
> something like a Mini-ITX form factor 4 to 8 core system that can take
> 8 to 32GB of RAM, has a PCIe slot or two, and is readily available
> selling for well below $1000 US.

SolidRun/Marvell MACCHIATObin is probably the best option available=20
now, but SolidRun is working on new stuff:

https://www.solid-run.com/nxp-lx2160a-family/clearfog-itx/

NXP LX2160A =97 SoC with 16 Cortex-A72 cores, dual-channel DDR4 (MCbin=20
is single channel), 18 lanes of PCIe Gen 4, and as usual a huge=20
built-in network card we don't have a driver for. Though NXP advertises=20
that it's possible to reconfigure the SFP+ ports to turn them into more=20
PCIe.

They even confirmed that overclocking is possible for both CPU and RAM:

https://www.phoronix.com/forums/forum/hardware/motherboards-chipsets/109010=
2-solidrun-clearfog-a-16-core-arm-itx-workstation-board-aiming-for-500~750-=
usd?p=3D1090905#post1090905

Let's hope they implement ACPI fully and correctly :)

>>  I am hopeing some of that PCIe WIP might include some of the
>>  bits needed or do we already have PCIe slot on RockPro64 code that=20
>> works?
>=20
> I don't think this will do anything for RockPro64, it's just a
> workaround for limitations in our current arm64 PCI code for some
> functionality unused by ThunderX* but required for eMAG.

RK3399 seems to need a custom driver, OpenBSD has one:

https://github.com/openbsd/src/blob/master/sys/dev/fdt/rkpcie.c

And I've heard bad things about the controller, apparently no one has=20
got a GPU working on Linux because the controller doesn't support=20
enough address space or some other features.

=