From owner-freebsd-fs@freebsd.org Sat Jan 5 00:05:06 2019 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id BC757143F4D0 for ; Sat, 5 Jan 2019 00:05:05 +0000 (UTC) (envelope-from bilbo@hobbiton.org) Received: from mail-qt1-x836.google.com (mail-qt1-x836.google.com [IPv6:2607:f8b0:4864:20::836]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 3B5308AE46 for ; Sat, 5 Jan 2019 00:05:03 +0000 (UTC) (envelope-from bilbo@hobbiton.org) Received: by mail-qt1-x836.google.com with SMTP id t13so42183367qtn.3 for ; Fri, 04 Jan 2019 16:05:03 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=ofwilsoncreek-com.20150623.gappssmtp.com; s=20150623; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=OM0abPyZXm3oXQCUtkwH8nF6gsg/MkIw6cnEk0eDh6g=; b=PSAgNn8bBvS13NjeOJNRKEpn+xsLswd8tmAZ8YWgPmB3PCSfrDSDxri4+suCwTkSCx TOdaHX+05KEcTHlkk7fl7QsmP/qMyrQS7c96BJSWSE4rBAbhgG+sgS/eHeByW9Uiiyec fYhAMYVFN+P0lmgGXBW71CwvWnQky0r4YMlVw1y7g+NwIS0Iqpgw1Z4u6YUZaIiwa67h 22mE/LFUK/H3svULjUeBRW2B4CdgGTTvrg3ZzAKkjtGA7c5ky+nKlK8CyzkbkLvoObzo nHExhEs9zmi0Tm9ndae8pY4b5updY8kW3bQOwxF0+K2QpFzkIex7i5UhZ20PWAG0b2vO hHCg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=OM0abPyZXm3oXQCUtkwH8nF6gsg/MkIw6cnEk0eDh6g=; b=moTAhYDsz04EvyQasBtDY+aA2/+YPoLXwfkvmqKLlf69OnRPqn30oD3W+yOW3kxbk5 xzzMQP6/pJcsgeSMFw9H4Z4PIyNKWLb0IimRa5HEubgZ8ofV2eCHc9pGM9nHgi8n9D28 q50SIVyAiZuFo4C1SEk6wMI5gQ3sF2aZl4EesHx/NFwzEbXgu4A7Zh+xJhWl4kvOEH6b UbmFVQNFfb8Ym0LzmHgU5jrVJfFbxqLSe+SBYmVTCzgxdRGrtG9l72AYzNhAHTI2UoGA 7BsdB0E1XFRhzTcwn6tIlPMij3soW5X7DPz4bHY6NNYbAG/7nNK/vjxQDmOtTgksEBnu UpkA== X-Gm-Message-State: AA+aEWat2qBAmMKOrIhav4prXNBUexFPw4uotJzWGQsZ1uE8t1uODcQy faQgqougm44Lcv5y3GgUNbnbg+dTd5HsNrnGFrlVXh7S X-Google-Smtp-Source: ALg8bN7obtbxcb2z/MpYhZSIefMHCjmK1Qq84mGo3KKhWn7JP4GjjRT4pOI84BDiOrbKNXHnmkkADzgh9fh8+AZQ8yo= X-Received: by 2002:ac8:1941:: with SMTP id g1mr50088190qtk.193.1546646703098; Fri, 04 Jan 2019 16:05:03 -0800 (PST) MIME-Version: 1.0 References: <01000167dd7b16cd-58ee733f-c662-42d5-9c75-2301fbc8377a-000000@email.amazonses.com> <01000167f27b4bf1-86cf2251-ed4f-4f6f-88d7-9f2969338a57-000000@email.amazonses.com> In-Reply-To: From: Leif Pedersen Date: Fri, 4 Jan 2019 18:04:27 -0600 Message-ID: Subject: Re: Any plans for EC2 AMIs with RootOnZFS? To: Jay Edwards Cc: Colin Percival , "freebsd-fs@freebsd.org" , Ben Woods , freebsd-cloud@freebsd.org X-Rspamd-Queue-Id: 3B5308AE46 X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=ofwilsoncreek-com.20150623.gappssmtp.com header.s=20150623 header.b=PSAgNn8b; spf=pass (mx1.freebsd.org: domain of bilbo@hobbiton.org designates 2607:f8b0:4864:20::836 as permitted sender) smtp.mailfrom=bilbo@hobbiton.org X-Spamd-Result: default: False [-3.84 / 15.00]; TO_DN_EQ_ADDR_SOME(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; URI_COUNT_ODD(1.00)[9]; RCPT_COUNT_FIVE(0.00)[5]; DKIM_TRACE(0.00)[ofwilsoncreek-com.20150623.gappssmtp.com:+]; MX_GOOD(-0.01)[alt1.aspmx.l.google.com,aspmx.l.google.com,aspmx2.googlemail.com,alt2.aspmx.l.google.com,aspmx3.googlemail.com]; NEURAL_HAM_SHORT(-0.98)[-0.984,0]; FORGED_SENDER(0.30)[leif@ofwilsoncreek.com,bilbo@hobbiton.org]; RCVD_TLS_LAST(0.00)[]; SUBJECT_ENDS_QUESTION(1.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; MIME_TRACE(0.00)[0:+,1:+]; FROM_NEQ_ENVFROM(0.00)[leif@ofwilsoncreek.com,bilbo@hobbiton.org]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-0.998,0]; R_DKIM_ALLOW(-0.20)[ofwilsoncreek-com.20150623.gappssmtp.com:s=20150623]; FROM_HAS_DN(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; DMARC_NA(0.00)[ofwilsoncreek.com]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[6.3.8.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.b.8.f.7.0.6.2.list.dnswl.org : 127.0.5.0]; IP_SCORE(-2.65)[ip: (-9.30), ipnet: 2607:f8b0::/32(-2.19), asn: 15169(-1.66), country: US(-0.08)]; RCVD_COUNT_TWO(0.00)[2] Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 05 Jan 2019 00:05:06 -0000 I worked out a procedure to convert a UFS filesystem to ZFS, and I've used it successfully many times on AWS and Azure instances. If the disk's data will fit in RAM, it works with a memory disk. Otherwise you can attach a second disk and substitute its device node for $extradisk. It is merely intended as a quick hack to convert after a new installation before putting important data on the machine, so it's not explained or robust. In other words, be sure you understand it before you use it, and very much use it at your own risk. But perhaps one could use the general idea to make a better process. http://devpit.org/wiki/Convert_UFS_to_ZFS Because of `reboot -r`, it works without disturbing the uptime (although it restarts all the services). That's a fun brag if you're into raising eyebrows. ("I changed the boot filesystem without rebooting...can you do that with _your_ favorite OS?") However, I'd suggest rebooting after to test the boot procedure and be sure you don't leave your future self an unpleasant 3 AM surprise. -Leif On Thu, Jan 3, 2019 at 4:38 PM Jay Edwards wrote: > I've got a fairly robust collection of utilities for Google Cloud that: > > 1) Starts up an official FreeBSD image > 2) Mounts a separate drive (the ZFS target) > 3) Installs the release; installs all of the various GCP packages > 4) Configures a bunch of custom stuff applicable to me > 5) Creates an image that is then used as a base for any further custom > images. > > It shouldn't be that difficult to add AWS support. > > Jay Edwards > > > On Thu, Dec 27, 2018 at 8:48 PM Colin Percival > wrote: > > > [Adding freebsd-fs in the hope of finding more ZFS people.] > > > > On 12/23/18 3:51 PM, Colin Percival wrote: > > > On 12/23/18 7:12 AM, Ben Woods wrote: > > >> Is there any plans to provide official FreeBSD AMIs in the AWS > > Marketplace > > >> which use RootOnZFS out of the box? > > > > > > Nothing concrete yet, but it's on my radar. Now that FreeBSD AMIs are > > being > > > published by a separate (release engineering) account, I'm more > > comfortable > > > with working on more "experimental" AMIs. (And if this turns out to be > > widely > > > useful I'll talk to the release engineering team about adding it to the > > set > > > they publish.) > > > > I've created an experimental FreeBSD 12.0 ZFS AMI in the us-east-1 > region: > > ami-0786f5b55d5aa573f > > > > Since I'm basically a ZFS newbie (I run it on my laptop, but only with > the > > default setup from the installer, and I've never used any of the fancy > ZFS > > features) I don't know if I've set everything up properly. So far I have > > one piece of feedback, which is that I should have marked canmount=off > for > > zroot. > > > > Can people please try out this AMI and let me know if there's anything > else > > (ZFS-related) which I should fix? Some time next week I'll fix whatever > > people notice and build AMIs for all the regions. > > > > -- > > Colin Percival > > Security Officer Emeritus, FreeBSD | The power to serve > > Founder, Tarsnap | www.tarsnap.com | Online backups for the truly > paranoid > > _______________________________________________ > > freebsd-cloud@freebsd.org mailing list > > https://lists.freebsd.org/mailman/listinfo/freebsd-cloud > > To unsubscribe, send any mail to "freebsd-cloud-unsubscribe@freebsd.org" > > > _______________________________________________ > freebsd-cloud@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-cloud > To unsubscribe, send any mail to "freebsd-cloud-unsubscribe@freebsd.org" >