From owner-freebsd-cloud@freebsd.org Sat Jan 5 00:05:05 2019 Return-Path: Delivered-To: freebsd-cloud@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id B88F2143F4CF for ; Sat, 5 Jan 2019 00:05:05 +0000 (UTC) (envelope-from bilbo@hobbiton.org) Received: from mail-qt1-x836.google.com (mail-qt1-x836.google.com [IPv6:2607:f8b0:4864:20::836]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 3B4F98AE45 for ; Sat, 5 Jan 2019 00:05:03 +0000 (UTC) (envelope-from bilbo@hobbiton.org) Received: by mail-qt1-x836.google.com with SMTP id v11so42198460qtc.2 for ; Fri, 04 Jan 2019 16:05:03 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=ofwilsoncreek-com.20150623.gappssmtp.com; s=20150623; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=OM0abPyZXm3oXQCUtkwH8nF6gsg/MkIw6cnEk0eDh6g=; b=PSAgNn8bBvS13NjeOJNRKEpn+xsLswd8tmAZ8YWgPmB3PCSfrDSDxri4+suCwTkSCx TOdaHX+05KEcTHlkk7fl7QsmP/qMyrQS7c96BJSWSE4rBAbhgG+sgS/eHeByW9Uiiyec fYhAMYVFN+P0lmgGXBW71CwvWnQky0r4YMlVw1y7g+NwIS0Iqpgw1Z4u6YUZaIiwa67h 22mE/LFUK/H3svULjUeBRW2B4CdgGTTvrg3ZzAKkjtGA7c5ky+nKlK8CyzkbkLvoObzo nHExhEs9zmi0Tm9ndae8pY4b5updY8kW3bQOwxF0+K2QpFzkIex7i5UhZ20PWAG0b2vO hHCg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=OM0abPyZXm3oXQCUtkwH8nF6gsg/MkIw6cnEk0eDh6g=; b=uG36XoyeRAW2aAdYxmd3Pz2SG7Wa8vrS8r+uHNTH3UBExiPre1gRwTOORUDYXdTBPi T9jpbFpzqh8VOSDDgZdq6TWS5iikXE9M9By1mj7hnnf/GbN285yGUqrFD//orwnTSexG DZ/CNmbuGl2y3z8WoiZefZkpGWwdxMIXAQNeFkAI3c7rYRgwr8jPGHqSNnElybPnm065 XHm2mNQaWc51XPUz1gVRRuJH3M/8f35JzBNB8eV6Q3CY/TeY6kHLbQ4aMeWmV3/WrJDe yNVQRkZJc3Sz1jJ+xlgoqZfCmy8ZufA4pDeUaQiUnUH7HqD2J6apzOEognPhh/kLqKb/ 22LQ== X-Gm-Message-State: AA+aEWYP+THOnkE3iplsAzQx5JlUgzXyH5TKNoz0qn6BvAr3ElvdAt8I p1q2O5JSsSiTbZAg5sv2Ew3eL5fp8C0xao6vklDNRQ== X-Google-Smtp-Source: ALg8bN7obtbxcb2z/MpYhZSIefMHCjmK1Qq84mGo3KKhWn7JP4GjjRT4pOI84BDiOrbKNXHnmkkADzgh9fh8+AZQ8yo= X-Received: by 2002:ac8:1941:: with SMTP id g1mr50088190qtk.193.1546646703098; Fri, 04 Jan 2019 16:05:03 -0800 (PST) MIME-Version: 1.0 References: <01000167dd7b16cd-58ee733f-c662-42d5-9c75-2301fbc8377a-000000@email.amazonses.com> <01000167f27b4bf1-86cf2251-ed4f-4f6f-88d7-9f2969338a57-000000@email.amazonses.com> In-Reply-To: From: Leif Pedersen Date: Fri, 4 Jan 2019 18:04:27 -0600 Message-ID: Subject: Re: Any plans for EC2 AMIs with RootOnZFS? To: Jay Edwards Cc: Colin Percival , "freebsd-fs@freebsd.org" , Ben Woods , freebsd-cloud@freebsd.org X-Rspamd-Queue-Id: 3B4F98AE45 X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=ofwilsoncreek-com.20150623.gappssmtp.com header.s=20150623 header.b=PSAgNn8b; spf=pass (mx1.freebsd.org: domain of bilbo@hobbiton.org designates 2607:f8b0:4864:20::836 as permitted sender) smtp.mailfrom=bilbo@hobbiton.org X-Spamd-Result: default: False [-3.84 / 15.00]; TO_DN_EQ_ADDR_SOME(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; URI_COUNT_ODD(1.00)[9]; RCPT_COUNT_FIVE(0.00)[5]; DKIM_TRACE(0.00)[ofwilsoncreek-com.20150623.gappssmtp.com:+]; MX_GOOD(-0.01)[alt1.aspmx.l.google.com,aspmx.l.google.com,aspmx2.googlemail.com,alt2.aspmx.l.google.com,aspmx3.googlemail.com]; NEURAL_HAM_SHORT(-0.98)[-0.984,0]; FORGED_SENDER(0.30)[leif@ofwilsoncreek.com,bilbo@hobbiton.org]; RCVD_TLS_LAST(0.00)[]; SUBJECT_ENDS_QUESTION(1.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; MIME_TRACE(0.00)[0:+,1:+]; FROM_NEQ_ENVFROM(0.00)[leif@ofwilsoncreek.com,bilbo@hobbiton.org]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-0.998,0]; R_DKIM_ALLOW(-0.20)[ofwilsoncreek-com.20150623.gappssmtp.com:s=20150623]; FROM_HAS_DN(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-cloud@freebsd.org]; DMARC_NA(0.00)[ofwilsoncreek.com]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[6.3.8.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.b.8.f.7.0.6.2.list.dnswl.org : 127.0.5.0]; IP_SCORE(-2.65)[ip: (-9.30), ipnet: 2607:f8b0::/32(-2.19), asn: 15169(-1.66), country: US(-0.08)]; RCVD_COUNT_TWO(0.00)[2] Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-cloud@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "FreeBSD on cloud platforms \(EC2, GCE, Azure, etc.\)" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 05 Jan 2019 00:05:06 -0000 I worked out a procedure to convert a UFS filesystem to ZFS, and I've used it successfully many times on AWS and Azure instances. If the disk's data will fit in RAM, it works with a memory disk. Otherwise you can attach a second disk and substitute its device node for $extradisk. It is merely intended as a quick hack to convert after a new installation before putting important data on the machine, so it's not explained or robust. In other words, be sure you understand it before you use it, and very much use it at your own risk. But perhaps one could use the general idea to make a better process. http://devpit.org/wiki/Convert_UFS_to_ZFS Because of `reboot -r`, it works without disturbing the uptime (although it restarts all the services). That's a fun brag if you're into raising eyebrows. ("I changed the boot filesystem without rebooting...can you do that with _your_ favorite OS?") However, I'd suggest rebooting after to test the boot procedure and be sure you don't leave your future self an unpleasant 3 AM surprise. -Leif On Thu, Jan 3, 2019 at 4:38 PM Jay Edwards wrote: > I've got a fairly robust collection of utilities for Google Cloud that: > > 1) Starts up an official FreeBSD image > 2) Mounts a separate drive (the ZFS target) > 3) Installs the release; installs all of the various GCP packages > 4) Configures a bunch of custom stuff applicable to me > 5) Creates an image that is then used as a base for any further custom > images. > > It shouldn't be that difficult to add AWS support. > > Jay Edwards > > > On Thu, Dec 27, 2018 at 8:48 PM Colin Percival > wrote: > > > [Adding freebsd-fs in the hope of finding more ZFS people.] > > > > On 12/23/18 3:51 PM, Colin Percival wrote: > > > On 12/23/18 7:12 AM, Ben Woods wrote: > > >> Is there any plans to provide official FreeBSD AMIs in the AWS > > Marketplace > > >> which use RootOnZFS out of the box? > > > > > > Nothing concrete yet, but it's on my radar. Now that FreeBSD AMIs are > > being > > > published by a separate (release engineering) account, I'm more > > comfortable > > > with working on more "experimental" AMIs. (And if this turns out to be > > widely > > > useful I'll talk to the release engineering team about adding it to the > > set > > > they publish.) > > > > I've created an experimental FreeBSD 12.0 ZFS AMI in the us-east-1 > region: > > ami-0786f5b55d5aa573f > > > > Since I'm basically a ZFS newbie (I run it on my laptop, but only with > the > > default setup from the installer, and I've never used any of the fancy > ZFS > > features) I don't know if I've set everything up properly. So far I have > > one piece of feedback, which is that I should have marked canmount=off > for > > zroot. > > > > Can people please try out this AMI and let me know if there's anything > else > > (ZFS-related) which I should fix? Some time next week I'll fix whatever > > people notice and build AMIs for all the regions. > > > > -- > > Colin Percival > > Security Officer Emeritus, FreeBSD | The power to serve > > Founder, Tarsnap | www.tarsnap.com | Online backups for the truly > paranoid > > _______________________________________________ > > freebsd-cloud@freebsd.org mailing list > > https://lists.freebsd.org/mailman/listinfo/freebsd-cloud > > To unsubscribe, send any mail to "freebsd-cloud-unsubscribe@freebsd.org" > > > _______________________________________________ > freebsd-cloud@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-cloud > To unsubscribe, send any mail to "freebsd-cloud-unsubscribe@freebsd.org" >