From owner-freebsd-cloud@freebsd.org Sun Dec 20 18:33:02 2020 Return-Path: Delivered-To: freebsd-cloud@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id A1BC74C86F8 for ; Sun, 20 Dec 2020 18:33:02 +0000 (UTC) (envelope-from 01000176816d1723-d597829f-c214-462e-b79d-1340448cfbc5-000000@amazonses.com) Received: from a8-56.smtp-out.amazonses.com (a8-56.smtp-out.amazonses.com [54.240.8.56]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4CzWSF5jqBz3M15 for ; Sun, 20 Dec 2020 18:33:01 +0000 (UTC) (envelope-from 01000176816d1723-d597829f-c214-462e-b79d-1340448cfbc5-000000@amazonses.com) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/simple; s=ae7m2yrxjw65l2cqdpjxuucyrvy564tn; d=tarsnap.com; t=1608489179; h=To:References:From:Subject:Message-ID:Date:MIME-Version:In-Reply-To:Content-Type:Content-Transfer-Encoding; bh=LcJh+uAAs09C3cr6ZqdxaVEO4/2tysudBbdn3h82Alk=; b=MAhEWF1jyrt9tYdrjEJRpoVgbMCGhl1MRTGWyTF3lZP3yWTvBLrOg2ZNAXHVfufZ sIRcmm0yxhMasEQ1BYek9j6NKX0GWS6XTh3SfpYw0dHkWfK26LLqFPFkF8RSjkZ75ZA B9aK8XMnIvTg4lkEeHXoPR35KJxFntUm1Zp/fmG0= DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/simple; s=224i4yxa5dv7c2xz3womw6peuasteono; d=amazonses.com; t=1608489179; h=To:References:From:Subject:Message-ID:Date:MIME-Version:In-Reply-To:Content-Type:Content-Transfer-Encoding:Feedback-ID; bh=LcJh+uAAs09C3cr6ZqdxaVEO4/2tysudBbdn3h82Alk=; b=CmiNWOrUOnrI0JG5bQJDvnXO6pYp0+kdK5VaA6pw0Y1EWCmSf94UD0JBh9H4zqku bR6dY0rDKMX6slKdNdjlg/3if5VRj9K364MRYdDZ+s7Fu0V9jLNjsRubQyQsLArMS3i mZ5Tuvhc/4xqrRtl0d59j16dQzzFNYYygKDb96+o= To: Rafal Lukawiecki , freebsd-cloud@freebsd.org References: <55467346-CDAE-4F73-80F6-6115C063916D@rafal.net> From: Colin Percival Subject: Re: FreeBSD on AWS Graviton (t4g) Message-ID: <01000176816d1723-d597829f-c214-462e-b79d-1340448cfbc5-000000@email.amazonses.com> Date: Sun, 20 Dec 2020 18:32:58 +0000 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:78.0) Gecko/20100101 Thunderbird/78.5.0 MIME-Version: 1.0 In-Reply-To: <55467346-CDAE-4F73-80F6-6115C063916D@rafal.net> Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: 8bit X-SES-Outgoing: 2020.12.20-54.240.8.56 Feedback-ID: 1.us-east-1.Lv9FVjaNvvR5llaqfLoOVbo2VxOELl7cjN0AOyXnPlk=:AmazonSES X-Rspamd-Queue-Id: 4CzWSF5jqBz3M15 X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=pass header.d=tarsnap.com header.s=ae7m2yrxjw65l2cqdpjxuucyrvy564tn header.b=MAhEWF1j; dkim=pass header.d=amazonses.com header.s=224i4yxa5dv7c2xz3womw6peuasteono header.b=CmiNWOrU; dmarc=pass (policy=none) header.from=tarsnap.com; spf=pass (mx1.freebsd.org: domain of 01000176816d1723-d597829f-c214-462e-b79d-1340448cfbc5-000000@amazonses.com designates 54.240.8.56 as permitted sender) smtp.mailfrom=01000176816d1723-d597829f-c214-462e-b79d-1340448cfbc5-000000@amazonses.com X-Spamd-Result: default: False [-1.20 / 15.00]; FORGED_MUA_THUNDERBIRD_MSGID_UNKNOWN(2.50)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[tarsnap.com:s=ae7m2yrxjw65l2cqdpjxuucyrvy564tn,amazonses.com:s=224i4yxa5dv7c2xz3womw6peuasteono]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:54.240.0.0/18]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; SPAMHAUS_ZRD(0.00)[54.240.8.56:from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[tarsnap.com:+,amazonses.com:+]; RCPT_COUNT_TWO(0.00)[2]; RCVD_IN_DNSWL_NONE(0.00)[54.240.8.56:from]; NEURAL_HAM_SHORT(-1.00)[-1.000]; DMARC_POLICY_ALLOW(-0.50)[tarsnap.com,none]; FORGED_SENDER(0.30)[cperciva@tarsnap.com,01000176816d1723-d597829f-c214-462e-b79d-1340448cfbc5-000000@amazonses.com]; RCVD_COUNT_ZERO(0.00)[0]; RWL_MAILSPIKE_POSSIBLE(0.00)[54.240.8.56:from]; MIME_TRACE(0.00)[0:+]; RBL_DBL_DONT_QUERY_IPS(0.00)[54.240.8.56:from]; ASN(0.00)[asn:14618, ipnet:54.240.8.0/21, country:US]; FROM_NEQ_ENVFROM(0.00)[cperciva@tarsnap.com,01000176816d1723-d597829f-c214-462e-b79d-1340448cfbc5-000000@amazonses.com]; MAILMAN_DEST(0.00)[freebsd-cloud] X-BeenThere: freebsd-cloud@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: "FreeBSD on cloud platforms \(EC2, GCE, Azure, etc.\)" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 20 Dec 2020 18:33:02 -0000 On 12/20/20 10:04 AM, Rafal Lukawiecki via freebsd-cloud wrote: > Has anyone got any experience running FreeBSD 12 on AWS Graviton instances like t4g? I am considering switching from t3 due to what seems like a better sticker price. Any warnings? Things mostly work. The remaining issues are: * The EC2 API "shutdown" / "reboot" message is sent via a pl061 GPIO device and we're dropping it on the floor; consequently "reboot" does nothing at all, while "shutdown" does nothing until EC2 times out and does a hard poweroff (without filesystems being unmounted etc). * Device hotplug doesn't work (ACPI issues?) so you need to manually rescan after attaching new disks. * FreeBSD doesn't boot on "bare metal" Graviton instances, due to missing some drivers. (NetBSD works though -- anyone want to port their code?) Oh, and a generic ARM issue: It's not a Tier 1 platform yet, so freebsd-update doesn't work and packages aren't always as up-to-date as on x86. But I think those are being worked on... -- Colin Percival Security Officer Emeritus, FreeBSD | The power to serve Founder, Tarsnap | www.tarsnap.com | Online backups for the truly paranoid