From owner-freebsd-fs@freebsd.org Wed Dec 19 07:49:18 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 8CD10134EFB9; Wed, 19 Dec 2018 07:49:18 +0000 (UTC) (envelope-from yaneurabeya@gmail.com) Received: from mail-pf1-x430.google.com (mail-pf1-x430.google.com [IPv6:2607:f8b0:4864:20::430]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4CFB56E3F5; Wed, 19 Dec 2018 07:49:17 +0000 (UTC) (envelope-from yaneurabeya@gmail.com) Received: by mail-pf1-x430.google.com with SMTP id c123so9468163pfb.0; Tue, 18 Dec 2018 23:49:17 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=from:message-id:mime-version:subject:date:in-reply-to:cc:to :references; bh=YxZATs9eih0qlUdDiJN17xxyi6ockrN7+QperSHg7Es=; b=A77ywLzRjUFednjbLZ5Tx90LahEcwkADQtZh2JF6jEffSC3ChK+c1RcsF+hqiDHX7A anvtW00OPKmcz3gVAlVDiZtnfCVlvcmKdP0l7bhi53c5h9k2fvyxOJJfUaUNC3Nzhati kv8jwJWHmNbTOgGsZWuSMk7gBzG4LlL4oKtGrX8rM/UmbtmzYlMfKCvTZcNJSjXAbE/F IPWMuzyUHrKh5E0kolwbmkWkFy5JiWZ9WeN3GLwg5ypD9GTyFL+4K0mN7DcL/AeOocsc saAkiW5HrPaQMTXWeDdTEbwYHKl4kJWjFAzWx8MOakpok0qwuGW64JjfLnEYI0QWSbaG a0uQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:message-id:mime-version:subject:date :in-reply-to:cc:to:references; bh=YxZATs9eih0qlUdDiJN17xxyi6ockrN7+QperSHg7Es=; b=oUXcnnVMDjPAP8inkQcROPGTkBYT5QO37TwBh6UFdBnh0umr+N2GzQiUGdx+287eRW C6mT6L8tp6K3CAmwwwvdmbeeIDRh1XW+g3toRE+qGXh+5/QcH6iHO120blDMC6bQ7U7H KEkAvrtc9V4kHrWuq0Dk9sppMCN+R6Duc8hIb8FFNmpwinezhFACRfJWIrGVHwAqLBSO 0sqlgyG+AxAJfEJToep8LKbOsBGhu7EIGKn7Ge8YSs9j+kUW1Zlj1/M9CuaGrTZsF89b PuE9uN1w6kCaQAMm10MrzCNxzWt15lI0w7A6wYAlau5dGmT5g5JY2ed9gZC3pky9AUx+ y4YQ== X-Gm-Message-State: AA+aEWYLsUp81ovGis+F8JcE5sf598ckjVL1/UuTBqUN3OOh60Z0a+DS H78Js2ELuM4Ttu/oEKT4+Et9ATKw X-Google-Smtp-Source: AFSGD/UNeqrTFV84LIZ7kkpM5G4kt3vl+imi5naYsM94ELRl5MMmZHw5oYF1QNpFu15hqf5ECIKQSQ== X-Received: by 2002:a63:5402:: with SMTP id i2mr17787893pgb.79.1545205755990; Tue, 18 Dec 2018 23:49:15 -0800 (PST) Received: from [192.168.20.7] (c-73-19-52-228.hsd1.wa.comcast.net. [73.19.52.228]) by smtp.gmail.com with ESMTPSA id m20sm18816651pgv.93.2018.12.18.23.49.14 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Tue, 18 Dec 2018 23:49:15 -0800 (PST) From: Enji Cooper Message-Id: <9C23F0C0-DEF7-45A4-ADEF-58A00F9714D8@gmail.com> Content-Type: multipart/signed; boundary="Apple-Mail=_5B9C960B-5159-4A51-ACDD-81A425A795AA"; protocol="application/pgp-signature"; micalg=pgp-sha256 Mime-Version: 1.0 (Mac OS X Mail 11.5 \(3445.9.1\)) Subject: Re: The future of ZFS in FreeBSD Date: Tue, 18 Dec 2018 23:49:13 -0800 In-Reply-To: Cc: freebsd-fs , freebsd-current To: Matthew Macy References: X-Mailer: Apple Mail (2.3445.9.1) X-Rspamd-Queue-Id: 4CFB56E3F5 X-Spamd-Bar: ------ Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=A77ywLzR; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of yaneurabeya@gmail.com designates 2607:f8b0:4864:20::430 as permitted sender) smtp.mailfrom=yaneurabeya@gmail.com X-Spamd-Result: default: False [-6.11 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; MV_CASE(0.50)[]; HAS_ATTACHMENT(0.00)[]; FREEMAIL_FROM(0.00)[gmail.com]; RCVD_COUNT_THREE(0.00)[3]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; MX_GOOD(-0.01)[cached: alt3.gmail-smtp-in.l.google.com]; SIGNED_PGP(-2.00)[]; NEURAL_HAM_SHORT(-0.86)[-0.861,0]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+,1:+]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; MID_RHS_MATCH_FROM(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com.dwl.dnswl.org : 127.0.5.0]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.20)[multipart/signed,text/plain]; IP_SCORE(-0.64)[ipnet: 2607:f8b0::/32(-1.74), asn: 15169(-1.38), country: US(-0.08)]; RCVD_IN_DNSWL_NONE(0.00)[0.3.4.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.b.8.f.7.0.6.2.list.dnswl.org : 127.0.5.0] X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 19 Dec 2018 07:49:18 -0000 --Apple-Mail=_5B9C960B-5159-4A51-ACDD-81A425A795AA Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=utf-8 Hello Matthew, I appreciate the long write up, as someone who still uses FreeBSD ZFS on = my NAS box and knowing some of the history with ZFS on *Solaris, etc. = Something like this was bound to happen with post the Oracle buyout. > On Dec 18, 2018, at 10:49 PM, Matthew Macy wrote: >=20 > The sources for FreeBSD's ZFS support are currently taken directly > from Illumos with local ifdefs to support the peculiarities of FreeBSD > where the Solaris Portability Layer (SPL) shims fall short. FreeBSD > has regularly pulled changes from Illumos and tried to push back any > bug fixes and new features done in the context of FreeBSD. In the past > few years the vast majority of new development in ZFS has taken place > in DelphixOS and zfsonlinux (ZoL). Earlier this year Delphix announced > that they will be moving to ZoL > https://www.delphix.com/blog/kickoff-future-eko-2018 This shift means > that there will be little to no net new development of Illumos. While > working through the git history of ZoL I have also discovered that > many races and locking bugs have been fixed in ZoL and never made it > back to Illumos and thus FreeBSD. This state of affairs has led to a > general agreement among the stakeholders that I have spoken to that it > makes sense to rebase FreeBSD's ZFS on ZoL. Brian Behlendorf > has graciously encouraged me to add FreeBSD support directly to ZoL > https://github.com/zfsonfreebsd/ZoF so that we might all have a single > shared code base. >=20 > A port for ZoF can be found at https://github.com/miwi-fbsd/zof-port > Before it can be committed some additional functionality needs to be > added to the FreeBSD opencrypto framework. These can be found at > https://reviews.freebsd.org/D18520 >=20 > This port will provide FreeBSD users with multi modifier protection, > project quotas, encrypted datasets, allocation classes, vectorized > raidz, vectorized checksums, and various command line improvements. >=20 > Before ZoF can be merged back in to ZoL several steps need to be = taken: > - Integrate FreeBSD support into ZoL CI > - Have most of the ZFS test suite passing > - Complete additional QA testing at iX Can you please describe the testing process that will be employed to = verify the sanity of the ZoL on FreeBSD port? Should other large = companies who use ZFS on FreeBSD (Panzura?) chime in and the ZFS on = FreeBSD community (as a whole) collaborate to better suss out issues = with the ZoL port? > We at iX Systems need to port ZoL's EC2 CI scripts to work with > FreeBSD and make sure that most of the ZFS Test Suite (ZTS) passes. > Being integrated in to their CI will mean that, among other things, > most integration issues will be caught before a PR is merged upstream > rather than many months later when it is MFVed into FreeBSD. I=E2=80=99m= > hoping to submit the PR to ZoL some time in January. Could you please better describe this, in particular provide pointers to = any scripts that might be executed with the ZoL port? > This port will make it easy for end users on a range of releases to > run the latest version of ZFS. Nonetheless, transitioning away from an > Illumos based ZFS is not likely to be entirely seamless. The > stakeholders I=E2=80=99ve spoken to all agree that this is the best = path > forward but some degree of effort needs to be made to accommodate > downstream consumers. The current plan is to import ZoF and unhook the > older Illumos based sources from the build on April 15th or two months > after iX systems QA deems ZoF stable - which ever comes later. The > Illumos based sources will be removed some time later - but well > before 13. This will give users a 3 month period during which both the > port and legacy Illumos based ZFS will be available to users. Pools > should interoperate between ZoF and legacy provided the user does not > enable any features available only in ZoF. We will try to accommodate > any downstream consumers in the event that they need that date pushed > back. We ask that any downstream consumers who are particularly > sensitive to changes start testing the port when it is formally > announced and report back any issues they have. I will do my best to > ensure that this message is communicated to all those who it may > concern. However, I can=E2=80=99t ensure that everyone reads these = lists. That > is the responsibility of -CURRENT users. As a thought: is there a way for the ZoL port to run in parallel with = the non-ZoL port, kind of like in an audit/read-only/verify-only mode? Thanks so much, -Enji --Apple-Mail=_5B9C960B-5159-4A51-ACDD-81A425A795AA Content-Transfer-Encoding: 7bit Content-Disposition: attachment; filename=signature.asc Content-Type: application/pgp-signature; name=signature.asc Content-Description: Message signed with OpenPGP -----BEGIN PGP SIGNATURE----- iQIzBAEBCAAdFiEE5bk3FaGcY5rvqmb79YOpJmkwhhUFAlwZ9/kACgkQ9YOpJmkw hhXeBA//aK5RivUGqkKcORtDQ+P+l/0jXGs0lE42C7Yo89QO3QXnfM2po7PL/ZFV GaZGc8J+LIsiM2T48lx1u9S8qVbFRhdSbOnQKRFgm4ouQVJJUKiSCFLdugP2ADG4 q/EmRaO6tPo5Dc1XeyONahLymH/izPv0E97ua+HHTG2LSpe3uG0Wq4HMVGvqFklS b5Zy1HfNmBD8MxklHe6WDaCAtyns5l/zrNrIH8J3p9votYJ8zjJy3FMcXpu0BqSy 6eohgGykDtG/rL3BjgKaIi1JtSjZ/LBOJtkwM+owagBpnFvBoUHiem7dWxYuzosc 9NoFppsPflnAS3OC+2xwLg9ZtPcsOlDg88y9iChRBZYG/Lit6lBYxbjYC7E8GgFO ceqstQTgjkRTAe3+C4tGD0thI9DcjtUX5a3zoeu0glH8KcNDLAPy+ovqY8UaY4CK k18rVpk/j2pI7lmfPBZssuJop0idcJ6dUW+bicN1XsJZgdrzAIQQpqdrwjON35Ho bmseHWTQbhlit0+I+/HYchM1j1oAwdizuNF2MmMJGWrb/fiDqWp6n55kA1zmnTHV F7/v0qS4zqeyxq0zJrk177wb/ZhA/GcFpi+wAJ8+a4vEKFzkXgeYnmik9BucOplB ecjdqN1CsFR5E+PiVTUSk9dtoP7pUBVqvJjLC+EuYn212AO9syQ= =ypW9 -----END PGP SIGNATURE----- --Apple-Mail=_5B9C960B-5159-4A51-ACDD-81A425A795AA--