From owner-freebsd-fs@freebsd.org Tue Jun 27 17:43:49 2017 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 73F4FD8C257 for ; Tue, 27 Jun 2017 17:43:49 +0000 (UTC) (envelope-from gcorcoran@rcn.com) Received: from smtp.rcn.com (smtp.rcn.com [69.168.97.78]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4135776529 for ; Tue, 27 Jun 2017 17:43:49 +0000 (UTC) (envelope-from gcorcoran@rcn.com) X_CMAE_Category: , , X-CNFS-Analysis: v=2.2 cv=F/IVTepN c=1 sm=1 tr=0 a=jCH78jcaBILaJ1B6H+di6A==:117 a=jCH78jcaBILaJ1B6H+di6A==:17 a=IkcTkHD0fZMA:10 a=C4n8AZmYZaTIiblOuQMA:9 a=QEXdDO2ut3YA:10 X-CM-Score: 0 X-Scanned-by: Cloudmark Authority Engine X-Authed-Username: Z2NvcmNvcmFuQHJjbi5jb20= Authentication-Results: smtp01.rcn.cmh.synacor.com header.from=gcorcoran@rcn.com; sender-id=neutral Authentication-Results: smtp01.rcn.cmh.synacor.com smtp.mail=gcorcoran@rcn.com; spf=neutral; sender-id=neutral Authentication-Results: smtp01.rcn.cmh.synacor.com smtp.user=gcorcoran; auth=pass (PLAIN) Received-SPF: neutral (smtp01.rcn.cmh.synacor.com: 64.121.14.202 is neither permitted nor denied by domain of rcn.com) Received: from [64.121.14.202] ([64.121.14.202:60607] helo=[10.56.78.168]) by smtp.rcn.com (envelope-from ) (ecelerity 3.6.23.54417 r(Core:3.6.23.0)) with ESMTPA id B8/DA-26624-E4992595; Tue, 27 Jun 2017 13:43:42 -0400 To: freebsd-fs@freebsd.org From: Gary Corcoran Subject: Encrypted ZFS boot failure on 11.* Message-ID: <5d0d9bc9-b74a-af78-aef8-786607c68e3b@rcn.com> Date: Tue, 27 Jun 2017 13:35:48 -0400 User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:45.0) Gecko/20100101 Thunderbird/45.8.0 MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 27 Jun 2017 17:43:49 -0000 The below all refer to AMD64 versions. I wanted to create a backup server from a few years old machine, so I bought five drives to create a ZFS raidz1. And naturally wanted to put the latest non-experimental version of FreeBSD on it, 11.*. And I wanted the drives to be encrypted. But every version of FreeBSD 11 I tried, including the latest 11.1-BETA1, has the same bug. Using the "guided Auto ZFS" option in the installer, I chose raidz1, GPT (BIOS) partioning, and encryption on. Installations would proceed without any problem. But then, upon rebooting into the newly installed system, I would get the following error messages (after entering the GELI passphrase): error 1 lba 90728 failed to clear pad 2 area of primary vdev failed to read pad 2 area of primary vdev ZFS: i/o error - all block copies unavailable I was worried that I might have gotten a bad disk drive. But apparently no. For when I did the exact same installation, except no encryption, there were no errors and it successfully booted. From a little bit of googling I understand that the pad2 area has to do with a one-time "nextboot" ZFS feature, and thus the area is cleared after booting. I presume that is true whether or not the disks are encrypted, so having a successful boot without encryption should mean that the pad2 area of the disk(s) was accessed without a problem, as long as those sectors aren't encrypted. Next I tried installing FreeBSD 10.3-Release. Doing the same type of installation, with encryption ON, the system installed and booted without any problems. So in summary, encrypted ZFS works in version 10.3, but is broken in all 11.* versions. I am very surprised that no one else has run into this major problem. I've done so many installs that I am tired of doing them, and since the 10.3 install works, I'm just going to use that. But I thought that, especially since you're in BETA, this should be reported. Gary Retired Software Engineer FreeBSD user since 2.2