From owner-freebsd-questions@freebsd.org Sat Jun 24 12:28:15 2017 Return-Path: Delivered-To: freebsd-questions@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 745F9D9DF71 for ; Sat, 24 Jun 2017 12:28:15 +0000 (UTC) (envelope-from stdin@niklaas.eu) Received: from mx.box-hlm-03.niklaas.eu (mx.box-hlm-03.niklaas.eu [IPv6:2a02:2770:15:0:21a:4aff:feaa:e902]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4030567939 for ; Sat, 24 Jun 2017 12:28:15 +0000 (UTC) (envelope-from stdin@niklaas.eu) X-Virus-Scanned: amavisd-new at niklaas.eu DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=niklaas.eu; s=default; t=1498307285; bh=AYUjnUOXyD60+FQzNTqeWSnvZl3vMNoDkJJFD73wpSI=; h=Date:From:To:Subject:References:In-Reply-To; b=f5LrHYMqDOuB8tzhKFVd5jwPYuUKz7Pz8fS9voRfsbAzXjVT1IM+GTeBQRNvv4gnl occxISB28aRkaIey492DAKX1L7UEJPnrBPvILQEHj2jWrk6VfRA8rRRiJYen5JomVc z+QFAmyt6NlwueypCr0xlKlptMqxb0Vc5790KBps= Date: Sat, 24 Jun 2017 14:28:05 +0200 From: Niklaas Baudet von Gersdorff To: freebsd-questions@freebsd.org Subject: Re: Building my own poudriere build system Message-ID: <20170624122804.d5cx7n446zqqs67z@box-hlm-03.niklaas.eu> Mail-Followup-To: freebsd-questions@freebsd.org References: <20170622160501.piqo5hsfwzx7gpvk@box-hlm-03.niklaas.eu> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="p674bpfnuw2tuwwo" Content-Disposition: inline In-Reply-To: X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 24 Jun 2017 12:28:15 -0000 --p674bpfnuw2tuwwo Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Bradley T. Hughes [2017-06-23 08:01 +0200] : > I build in the cloud. Like you, I use an EC2 instance with > poudriere and multiple versions of jails to test > changes/patches. I haven't gone as far as to copy the packages > to S3, though. My builder is running 24/7, and I've been using > spot instances to keep the cost down despite using an > m4.2xlarge. I haven't thought about spot instances yet. They would be great to further reduce costs. Thanks for sharing the idea! > I like your Terraform skeleton. I have often wanted to do > something similar, but never gotten around to it. I am curious > how far you will be able to take it. I would really like to get to the point that the EC2 instance is only up and running (creating costs) when it builds ports. I don't have to create packages that regularly, maybe 2-5 times per month, thus paying for a powerful instance 24/7 really doesn't make sense. The main problem I face at this stage is that creating the ARMv6 jail for crossbuilding already takes 1-2 hours each time I spin up the instance. Each time I deploy the infrastructure the jails I use for building must be created again. I already tried storing the jails on S3 too, but that's not really a time saver... So, my new idea is to attach an additional *permanent* EBS drive that can be re-attached each time a new EC2 instance is deployed. On the EBS there is a ZFS filesystem that stores the jails. This will generate additional costs but should be a huge time saver. > Thanks for sharing! I'm glad I'm not the only one using EC2 for > building ports :) Yes, great to see that I am not alone with that approach too. :-) Feel free to contribute if you find time (in my next commit I'll add a proper license). Niklaas --p674bpfnuw2tuwwo Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQIcBAABCAAGBQJZTlrOAAoJECmqaRXQsC2fIioQAM+igkdZfiXjh/IW63hkZluc lW0cuPJr8VDQ02UCBrRmAEDFXbn4KdiRArRXJtBOZ5lJPy6IJ3K8+g+sH6v0aMJe Xnw2UmFf+UX0nkyd/zsrMT54RBBiRJ3eP667UP0DIXgCI70TtaHwiR+aV5/6/ZF/ Et6cjqVrdZOzb81Fz/rSqk/BibOu831+7onwPOIhytpL9ySIadiQCYInW0//TSLW w/5PeZ77TCuadzstjkGa8h8OD9TkyPbzuGAYih56dPBTSXB3Y3f3HBKlhm9xjM2+ jmNQJwDHG0Pq+AquWAExWNR9fcxcEQK8XxB9FS4iRF5YOLyUekicHe23pcZ8cg8/ xDtRPaaQbMy+Upnh8BwsJ/66/WKeP1bwxyQp1rO+JpN8+Dhfs0T4Z9flougG/VO6 zTZGdTg9Av4V5zIvVj7FurfA5iHoQEtcBn/PmVZBjBA/Er92E6pPDcSwLojAcUlR 3ABg9F30DI2uPEzf/aY4hax3DwK0o/t2SLDPJ6GOC6U5LQFnMSXHTTRcxbS8AfWS OUx5rFFnetAt11AVFAPBehQFTLLyTG8oMWgd1fBQ73y5pCt2P85XQt8HAEbIj0w4 rCQczbXc4bwYmGbDXm1ocIIsfZim7sJu56d8BZgX5Ef1pjtD/WHq1vcaEdF92m9+ FT4HiwGMGXH+SgCfn3yM =Mffz -----END PGP SIGNATURE----- --p674bpfnuw2tuwwo--