From owner-freebsd-cloud@freebsd.org Mon Sep 14 22:04:41 2020 Return-Path: Delivered-To: freebsd-cloud@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 803F63E37B9 for ; Mon, 14 Sep 2020 22:04:41 +0000 (UTC) (envelope-from 010001748ea604b7-67a61380-0272-4a14-94e3-e2d80f02c763-000000@amazonses.com) Received: from a8-237.smtp-out.amazonses.com (a8-237.smtp-out.amazonses.com [54.240.8.237]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Br0lD4Nfjz4P59 for ; Mon, 14 Sep 2020 22:04:40 +0000 (UTC) (envelope-from 010001748ea604b7-67a61380-0272-4a14-94e3-e2d80f02c763-000000@amazonses.com) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/simple; s=ae7m2yrxjw65l2cqdpjxuucyrvy564tn; d=tarsnap.com; t=1600121079; h=Subject:To:References:From:Message-ID:Date:MIME-Version:In-Reply-To:Content-Type:Content-Transfer-Encoding; bh=KoO2+qlBqyIGm0bBuGxkVW8HTcj2bLOc7rDBPOx5MOc=; b=mH691y0hsvA74Gn05JOxSQLP8jZSOn6nMCUhfYpbhgzuxgjU8ogY4f1N+5Imxybb i+a78q89QzB15hzsumopZLx1hXWazuOJgr856WIIXJBdOlMz4e6JsnlyLsIkAm4Dz0G R8cjB551gAMpWTmseM1nir0CEeBbkCjveJaayB0A= DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/simple; s=224i4yxa5dv7c2xz3womw6peuasteono; d=amazonses.com; t=1600121079; h=Subject:To:References:From:Message-ID:Date:MIME-Version:In-Reply-To:Content-Type:Content-Transfer-Encoding:Feedback-ID; bh=KoO2+qlBqyIGm0bBuGxkVW8HTcj2bLOc7rDBPOx5MOc=; b=LqQ9KVkzsQ6wd1nxm0WjqNnpkrjRdvG4L/b+Y4PT6HxZdtXG3/3pDEW4L8AplhYh vGcXnLfgUot2ysiButs8O5640T+XeLWWg23GCf6C0b9gyD0UrAHu/8HCYsMnWqD9Xzg 7w1A2if4IjtK70axzmrceC00CStNGA7nnUFB8MCA= Subject: Re: EC2 AMI size of Freebsd 12 (and maybe a feature request) To: Riccardo Lombardi , freebsd-cloud@freebsd.org References: From: Colin Percival Autocrypt: addr=cperciva@tarsnap.com; prefer-encrypt=mutual; keydata= mQGhBElrAAcRBACDfDys4ZtK+ErCJ1HAzYeteKpm3OEsvT/49AjUTLihkF79HhIKrCQU+1KC zv7BwHCMLb6hq30As9L7iFKG7n5QFLFC4Te/VcITUnWHMG/c3ViLOfJGvi+9/nOEHaM1dVJY D6tEp5yM1nHmVQpo9932j4KGuGFR0LhOK5IHXOSfGwCgxSFDPdgxe2OEjWxjGgY+oV3EafcD +JROXCTjlcQiG/OguQH4Vks3mhHfFnEppLxTkDuYgHZQiUtpcT9ssH5khgqoTyMar05OUdAj ZIhNbWDh4LgTj+7ZmvLhXT5Zxw8LX9d7T36aTB8XDQSenDqEtinMWOb0TCBBLbsB8EFG1WTT ESbZci9jJS5yhtktuZoY/eM8uXMD/3k4FWFO80VRRkELSp+XSy/VlSQjyi/rhl2nQq/oOA9F oJbDaB0yq9VNhxP+uFBzBWSqeIX0t1ZWLtNfVFr4TRP5hihI5ICrg/0OpqgisKsU2NFe9xyO hyJLYmfD8ebpDJ/9k30C7Iju9pVrwLm1QgS4S2fqJRcR+U4WbjvP7CgStCVDb2xpbiBQZXJj aXZhbCA8Y3BlcmNpdmFAdGFyc25hcC5jb20+iGEEExECACEFAklrALYCGwMHCwkIBwMCAQQV AggDBBYCAwECHgECF4AACgkQOM7KaQxqam6/igCgn+z2k3V5ggNppmWrZstt1U2lugsAoL7L wS9V9yLtil3oWmHtwpUqYruEuQINBElrAAcQCAD3ZLMIsP4CIDoJORg+YY0lqLVBgcnF7pFb 4Uy2+KvdWofN+DKH61rZLjgXXkNE9M4EQC1B4lGttBP8IY2gs41y3AUogGdyFbidq99rCBz7 LTsgARHwFxZoaHmXyiZLEU1QZuMqwPZV1mCviRhN5E3rRqYNXVcrnXAAuhBpvNyj/ntHvcDN 2/m+ochiuBYueU4kX3lHya7sOj+mTsndcWmQ9soOUyr8O0r/BG088bMn4qqtUw4dl5/pglXk jbl7uOOPinKf0WVd2r6M0wLPJCD4NPHrCWRLLLAjwfjrtoSRvXxDbXhCdgGBa72+K8eYLzVs hgq7tJOoBWzjVK6XRxR7AAMGB/9Mo3iJ2DxqDecd02KCB5BsFDICbJGhPltU7FwrtbC7djSb XUrwsEVLHi4st4cbdGNCWCrp0BRezXZKohKnNAPFOTK++ZfgeKxrV2sJod+Q9RILF86tQ4XF 7A7Yme5hy92t/WgiU4vc/fWbgP8gV/19f8nunaT2E9NSa70mZFjZNu4iuwThoUUO5CV3Wo0Y UISsnRK8XD1+LR3A2qVyLiFRwh/miC1hgLFCTGCQ3GLxZeZzIpYSlGdQJ0L5lixW5ZQD9r1I 8i/8zhE6qRFAM0upUMI3Gt1Oq2w03DiXrZU0Fu/R8Rm8rlnkQKA+95mRTUq1xL5P5NZIi4gJ Z569OPMFiEkEGBECAAkFAklrAAcCGwwACgkQOM7KaQxqam41igCfbaldnFTu5uAdrnrghESv EI3CAo8AoLkNMks1pThl2BJNRm4CtTK9xZeH Message-ID: <010001748ea604b7-67a61380-0272-4a14-94e3-e2d80f02c763-000000@email.amazonses.com> Date: Mon, 14 Sep 2020 22:04:39 +0000 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:68.0) Gecko/20100101 Thunderbird/68.12.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: 7bit X-SES-Outgoing: 2020.09.14-54.240.8.237 Feedback-ID: 1.us-east-1.Lv9FVjaNvvR5llaqfLoOVbo2VxOELl7cjN0AOyXnPlk=:AmazonSES X-Rspamd-Queue-Id: 4Br0lD4Nfjz4P59 X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; dkim=pass header.d=tarsnap.com header.s=ae7m2yrxjw65l2cqdpjxuucyrvy564tn header.b=mH691y0h; dkim=pass header.d=amazonses.com header.s=224i4yxa5dv7c2xz3womw6peuasteono header.b=LqQ9KVkz; dmarc=pass (policy=none) header.from=tarsnap.com; spf=pass (mx1.freebsd.org: domain of 010001748ea604b7-67a61380-0272-4a14-94e3-e2d80f02c763-000000@amazonses.com designates 54.240.8.237 as permitted sender) smtp.mailfrom=010001748ea604b7-67a61380-0272-4a14-94e3-e2d80f02c763-000000@amazonses.com X-Spamd-Result: default: False [-0.54 / 15.00]; FORGED_MUA_THUNDERBIRD_MSGID_UNKNOWN(2.50)[]; FORGED_SENDER(0.30)[cperciva@tarsnap.com,010001748ea604b7-67a61380-0272-4a14-94e3-e2d80f02c763-000000@amazonses.com]; R_DKIM_ALLOW(-0.20)[tarsnap.com:s=ae7m2yrxjw65l2cqdpjxuucyrvy564tn,amazonses.com:s=224i4yxa5dv7c2xz3womw6peuasteono]; ARC_NA(0.00)[]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:54.240.0.0/18:c]; NEURAL_HAM_LONG(-1.00)[-0.999]; TAGGED_RCPT(0.00)[]; MIME_GOOD(-0.10)[text/plain]; NEURAL_HAM_MEDIUM(-0.98)[-0.977]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[tarsnap.com:+,amazonses.com:+]; RCPT_COUNT_TWO(0.00)[2]; RCVD_IN_DNSWL_NONE(0.00)[54.240.8.237:from]; NEURAL_HAM_SHORT(-0.36)[-0.359]; DMARC_POLICY_ALLOW(-0.50)[tarsnap.com,none]; FREEMAIL_TO(0.00)[gmail.com,freebsd.org]; RCVD_COUNT_ZERO(0.00)[0]; RWL_MAILSPIKE_POSSIBLE(0.00)[54.240.8.237:from]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:14618, ipnet:54.240.8.0/21, country:US]; FROM_NEQ_ENVFROM(0.00)[cperciva@tarsnap.com,010001748ea604b7-67a61380-0272-4a14-94e3-e2d80f02c763-000000@amazonses.com]; MAILMAN_DEST(0.00)[freebsd-cloud] X-BeenThere: freebsd-cloud@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: "FreeBSD on cloud platforms \(EC2, GCE, Azure, etc.\)" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 14 Sep 2020 22:04:41 -0000 On 2020-09-14 08:35, Riccardo Lombardi wrote: > First of all, thank you for all your efforts for making FreeBSD usable in > EC2 environments, and sorry for my english. Your English seems fine to me! > I'm mainly a hobby web developer, with limited (end-user) experience in > Unix systems. > I recently switched to FreeBSD for my web server and noticed that the > "out-of-the-box" FreeBSD 12 AMI in AWS uses a lot of disk space (3.8Gb > using the df -h command) in comparison with other Linux distributions, > which usually start with 1-1.5Gb disk space. > I also wanted to point out that the size of the FreeBSD 11 AMI is strangely > quite smaller (2.4G). > The largest directories I could find in FreeBSD 12 are: > /usr/lib/debug: 1.5G > /var/db/freebsd-update: 508M You're seeing two things here: 1. FreeBSD 12 has far more space used for debug symbols than FreeBSD 11 (and FreeBSD 13 has even more -- over 2 GB). 2. When you launched FreeBSD 12 it downloaded updates -- including kernel updates and the associated updated debug symbols. Assuming the FreeBSD 11 you launched was 11.4, it didn't have nearly as many updates to download. > My aim (and I suppose this could be useful for many developers and EC2 > users) was originally to shrink the AMI size by eliminating things that are > not necessary in a production environment (maybe the kernel-debug tools). > Unfortunately I don't think i have enough knowledge to make my own custom > light AMI. > > So, if this could be useful for the community, and I think so, it would be > very nice to see some of the following things / features: > - First of all check it there's some problem with the disk size of the > FreeBSD 12 (compared with the 11, maybe there are old unused libraries from > the update), and eventually publish a new, "clean", AMI > - OR/AND maybe implement a "lightweight" version of the FreeBSD AMI, > without some non essential components. I'm seriously considering providing "minimal" AMIs without debug symbols (and maybe other stuff; I'm not sure if there's anything else worth excluding). Right now this and other "flavoured FreeBSDs" is blocked by Amazon not enabling the SSM Parameter Store for FreeBSD to register AMIs. > - Reduce the minimum EBS volume size from the current 10G to 8 or maybe 5 > (accordingly with the final size of the new AMI) That is already done -- while we have 10 GB as the *default* size, you can launch FreeBSD instances with any size as long as it's large enough for the disk image (between 3-5 GB depending on version). ... with the exception of the AWS Marketplace, because they couldn't figure out how to copy our disk snapshots properly, that is. Nothing I can do to fix them. :-/ -- Colin Percival Security Officer Emeritus, FreeBSD | The power to serve Founder, Tarsnap | www.tarsnap.com | Online backups for the truly paranoid