From owner-freebsd-fs@freebsd.org Sun Feb 28 09:30:34 2021 Return-Path: Delivered-To: freebsd-fs@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 357B25657FC for ; Sun, 28 Feb 2021 09:30:34 +0000 (UTC) (envelope-from infoomatic@gmx.at) Received: from mout.gmx.net (mout.gmx.net [212.227.15.15]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange ECDHE (P-256) server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "mout.gmx.net", Issuer "TeleSec ServerPass Class 2 CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4DpJ606Pnjz3Lxk for ; Sun, 28 Feb 2021 09:30:31 +0000 (UTC) (envelope-from infoomatic@gmx.at) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=gmx.net; s=badeba3b8450; t=1614504630; bh=0ldrMM86SCGUk0q9VQhWrV89SWAo8LW91tjnSwzftwM=; h=X-UI-Sender-Class:Subject:To:References:From:Date:In-Reply-To; b=LL54no3G2V1eiXBhVa4TFs6dEKFOVERREgauDXKMb4+wJGqxs5GnUgS0rAl1VjxAq IOM6EL106YGS6S9hp9I94T8qH9EGtEQm6+/WgA4xELWWIseNnSi+0ZU6MhZZRteDUE EaUPrjKrOCeZBCkuE0gnsZSQs0EBNk9lV2NrApm4= X-UI-Sender-Class: 01bb95c1-4bf8-414a-932a-4f6e2808ef9c Received: from [192.168.1.2] ([178.114.235.173]) by mail.gmx.net (mrgmx005 [212.227.17.190]) with ESMTPSA (Nemesis) id 1Mnps0-1lZfe344BW-00pO7Z for ; Sun, 28 Feb 2021 10:30:30 +0100 Subject: Re: FreeBSD 13 BETA3 zfs mount failed To: freebsd-fs@freebsd.org References: <92cd2855-8765-234e-3763-3811da269704@gmx.at> <47e949d3-2fc4-f581-e8a8-a707a23406ab@gmx.at> <3ffea3bf-a9f9-dfe5-d835-1874da1141e5@gmx.at> From: Infoomatic Message-ID: Date: Sun, 28 Feb 2021 10:28:52 +0100 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:78.0) Gecko/20100101 Thunderbird/78.8.0 MIME-Version: 1.0 In-Reply-To: <3ffea3bf-a9f9-dfe5-d835-1874da1141e5@gmx.at> Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: quoted-printable Content-Language: en-US X-Provags-ID: V03:K1:fcrs3HqeFIwisglXjWYuO7IPyBl2hjJcHv+vskQ3PEcD8oMZ/BD JUERX4f2YHHkvzr+atH6yzVfbDqWSdo99nbjRfBBAH4QkrEgUQ15xhA3wQ5L2tESdeIsDEl 44B2qX2KJCfurI0GVa3bSEFo/xZWwaiU8rmuMsmOO8OnEXcw9IHVKiyA5+IqHzaJbimmyQJ KJtnhi38O5DR70G3LFgvw== X-Spam-Flag: NO X-UI-Out-Filterresults: notjunk:1;V03:K0:NfV3ctguleg=:1wjmmup9yYlTNmt2kj8SYx lqx+bOQO2Wka4e7Rlxyl4cjKd3SspAxWO02sR8xsh+jXcNtkJR5FfiO6KawK7Cmy3tBj9EjJg JWzJ7r3tQyzMgvqIcylEKVr20AS9dwvsjh/WudGeeBcMFGNXw9nsu9vxEDXetcTqAC1CA+tLb 9j2lI77HNEzCwuF5Ul59yUk9kIQeDSWKvh7YosVN/K5osBBtgIr2ByxyrEcZjOUEHlxLjkdXn On6SUn3eFpfLc19ElLGDHunOvwQrPPLw1NPSVc3mjp1NM8QodV3vCV7Tjkwf3ndxewUMe22CL V3dnK8rKwyxueIkgTUyfhaLJSPSNKtFjNhHAmmLk4W8iL7TCkBFHkq0IrnsyQYzkrUdF06DLS JZtPxyZiiiQ4vo6FrzPIGV5p3RI3UAzAYe6Qr9KSCVGox+jYb9iyCTD6NPdaCinENaPH4+U9r c+O3MeF6jP4ZGMqM2eLVTxvplTtgGlZDFl5CC2gdiIKddbfLvHTY/771sMqXAvwLQ5sDj0RAa Ki5T4gt+nOMu1z6NbCs3hFQmlP764MskXZkkinNmFfAG84mOMzEt+JaQtmo9EyI/AFIpLcunT gpWt+hp/SfRaamuMR9VFF2fxV0wL0PdeXRRFrWnEeVzVFD69yLHupc3TqcoZmYKUeLpCVRHet 6GwwhyU7T5Jaj3nvf39DnmZSHtYroZAthw8gVQvOlBYxy1K8q17ft3o7jNi6Y9U1Teacy5khy aG60PpyNR1+sGfDA+p+frOdqgrB9utSzSZa4M8P9VRRqw58hoehE/vggHscyPOCt/dVtejqWd +5rmHUTXI3980GLXToTLqmQeo8w8nekCvi3q1fp8UKpgDUsbtB7P4PEUNuTypcCDw0dFTZOkb sYtZKvshURbIrMGtpEBg== X-Rspamd-Queue-Id: 4DpJ606Pnjz3Lxk X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmx.net header.s=badeba3b8450 header.b=LL54no3G; dmarc=pass (policy=none) header.from=gmx.at; spf=pass (mx1.freebsd.org: domain of infoomatic@gmx.at designates 212.227.15.15 as permitted sender) smtp.mailfrom=infoomatic@gmx.at X-Spamd-Result: default: False [-4.10 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; FREEMAIL_FROM(0.00)[gmx.at]; R_SPF_ALLOW(-0.20)[+ip4:212.227.15.0/25]; TO_DN_NONE(0.00)[]; DKIM_TRACE(0.00)[gmx.net:+]; DMARC_POLICY_ALLOW(-0.50)[gmx.at,none]; NEURAL_HAM_SHORT(-1.00)[-1.000]; RCVD_IN_DNSWL_LOW(-0.10)[212.227.15.15:from]; FROM_EQ_ENVFROM(0.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[212.227.15.15:from]; FREEMAIL_ENVFROM(0.00)[gmx.at]; MID_RHS_MATCH_FROM(0.00)[]; ASN(0.00)[asn:8560, ipnet:212.227.0.0/16, country:DE]; MIME_TRACE(0.00)[0:+]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[gmx.net:s=badeba3b8450]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; SPAMHAUS_ZRD(0.00)[212.227.15.15:from:127.0.2.255]; RWL_MAILSPIKE_POSSIBLE(0.00)[212.227.15.15:from]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-fs] X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 28 Feb 2021 09:30:34 -0000 Hi again, I did a few tests to further investigate this issue. I used 2 disks for different setups: with one disk I created a pool under Linux called "linux", with one disk I created a pool under FreeBSD 13 BETA3 called "freebsd" (but disabled log_spacemap via "zpool create -o feature@log_spacemap=3Ddisabled -f freebsd gpt/hd003"). I then created a dataset linux/linux under Linux and linux/linuxenc as encrypted dataset under Linux. I did the same with freebsd but with the names freebsd and freebsdenc respectiveliy. I used "zfs create -o encryption=3Daes-128-gcm -o keyformat=3Dpassphrase ZPOOL/DATASET" to creat= e the encrypted dataset. I then did a zfs send|recv to those datasets. So the name of the zpool/dataset informs about the system where it was create= d. After that, I swapped the disks and created more datasets, so on Linux I created the dataset "freebsd/linux"=C2=A0 and the encrypted dataset "/freebsd/linuxenc", furthermore, I did a zfs send|recv to "freebsd/freebsd/linux" and "freebsd/freebsdenc/linux". Equivalent datasets and zfs send|recv were done under the BETA3 system. Summary: under Linux, everything seems to work fine. Under FreeBSD there are are the following issues: zfs load-key does work with all encrypted datasets, but datasets beneath encrypted datasets (it did not matter whether the encrypted dataset was created under BETA3 or Linux) that were written using the Linux system could not be mounted: [root@blackbox ~]# zfs mount -a cannot mount 'linux/linuxenc/linux': Input/output error cannot mount 'linux/freebsdenc/linux': Input/output error [root@blackbox ~]# zfs mount -a cannot mount 'freebsd/freebsdenc/linux': Input/output error cannot mount 'freebsd/linuxenc/linux': Input/output error Should I file a bug? or post this to the openzfs ML? Regards, Robert On 26.02.21 11:40, infoomatic wrote: > On 26.02.21 09:56, infoomatic wrote: >> Another scenario: I did the same setup as in my previous mail on BETA3, >> sent some snapshots to the encrypted dataset on BETA3. I then could >> however import the the pool in Linux as read-only (feature >> com.delphix:log_spacemap was missing), could also load-key and read the >> encrypted dataset. > > interestingly, importing the pool read-only on linux destroyed some > metadata. > > The pool cannot be imported in BETA3 any more: > > [root@blackbox ~]# zpool import > =C2=A0=C2=A0 pool: hd012 > =C2=A0=C2=A0=C2=A0=C2=A0 id: 16225333054044272411 > =C2=A0 state: FAULTED > status: The pool metadata is corrupted. > =C2=A0action: The pool cannot be imported due to damaged devices or dat= a. > =C2=A0=C2=A0 see: https://openzfs.github.io/openzfs-docs/msg/ZFS-8000-7= 2 > =C2=A0config: > > =C2=A0=C2=A0=C2=A0 hd012=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 FAULTED=C2= =A0 corrupted data > =C2=A0=C2=A0=C2=A0 =C2=A0 da0s1=C2=A0=C2=A0=C2=A0=C2=A0 ONLINE > [root@blackbox ~]# zpool import -f hd012 > cannot import 'hd012': one or more devices is currently unavailable > > [root@blackbox ~]# zpool status -v hd012 > cannot open 'hd012': no such pool > > > I will do some more tests and will report here. > > _______________________________________________ > freebsd-fs@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-fs > To unsubscribe, send any mail to "freebsd-fs-unsubscribe@freebsd.org"