From nobody Mon Jun 20 18:35:01 2022 X-Original-To: freebsd-questions@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id E85AC85CB6B for ; Mon, 20 Jun 2022 18:35:14 +0000 (UTC) (envelope-from dpchrist@holgerdanske.com) Received: from holgerdanske.com (holgerdanske.com [184.105.128.27]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange ECDHE (P-256) server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "holgerdanske.com", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4LRdcL08qCz3hD4 for ; Mon, 20 Jun 2022 18:35:13 +0000 (UTC) (envelope-from dpchrist@holgerdanske.com) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=holgerdanske.com; s=nov-20210719-112354; t=1655750102; bh=cgyafBSFOR/8BmTeGxtkFXivdZWIZD1Xl8hD1TQ60cE=; h=Received:Message-ID:Date:MIME-Version:User-Agent:Content-Language: To:From:Subject:Content-Type:Content-Transfer-Encoding; b=DGiNW4HPD/4oqs1US0+NtEVxpoKIHwK10mngKhMB309Jr30TM0O518ikE3IrOFd86 mnA0aQn2FS+BeHv4KoAoJ7ioLji+DUw+mDUT/ib0KRgYi5NBmLv144pxn5tKNdOkgq 9ENKw7OeR4/o8pX367S8bnecwH9pYYOtHgEVCUpCTmAntPpzXv1wYhapd6LRCYgJvP rP8/zP6ZBqJA/UFG8UjZlIzZEVuPLHuBgCtwCznYEa2PY0sOwdi8cwbi2VKR6CeTnv XlrnFF4s2D3Hi2kWlJ3FTwWBBVF8LKbJtut51WwFyik0Fdva1mrFoalxpZrkTeneNi hIGGJ+ffDZDEZniesDHPGzZVRz85F5NjWOujDZazajVY+gigm4x8Qj9zPt5EyC7Y0S QtutOSddM8KpKCIBYbZYgNo4rwNyhdZ+It4crICMyYJ7ZY4o6FXopPAMN5I7lYANWb 9dIx54Ybqm7sNwJp/f7xr6audEDhHN++/ZVh+is4dUiKQqRLGOgUyNDdsvsW39afKr kVHGcppxA5qSMlT2pR0Q6p+azrSjGFeWeO7+MAMG7gCIWo/wYTrCsRV5BeWmjTO814 /W1aBS2erKPuJ4Hogp56vwCHs6X3r65oRMIYjupuMYn3aknhycl4XHeYfrLIiUkYDS REFXBlTnbswYpLbL4i6VEquI= Received: from 99.100.19.101 (99-100-19-101.lightspeed.frokca.sbcglobal.net [99.100.19.101]) by holgerdanske.com with ESMTPSA (TLS_AES_128_GCM_SHA256:TLSv1.3:Kx=any:Au=any:Enc=AESGCM(128):Mac=AEAD) (SMTP-AUTH username dpchrist@holgerdanske.com, mechanism PLAIN) for ; Mon, 20 Jun 2022 11:35:02 -0700 Message-ID: Date: Mon, 20 Jun 2022 11:35:01 -0700 List-Id: User questions List-Archive: https://lists.freebsd.org/archives/freebsd-questions List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-questions@freebsd.org X-BeenThere: freebsd-questions@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:91.0) Gecko/20100101 Thunderbird/91.9.0 Content-Language: en-US To: freebsd-questions@freebsd.org From: David Christensen Subject: BIOS/MBR drive enumeration order, FreeBSD dev nodes, GELI ZFS root, and ZFS boot Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 4LRdcL08qCz3hD4 X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=holgerdanske.com header.s=nov-20210719-112354 header.b=DGiNW4HP; dmarc=pass (policy=none) header.from=holgerdanske.com; spf=pass (mx1.freebsd.org: domain of dpchrist@holgerdanske.com designates 184.105.128.27 as permitted sender) smtp.mailfrom=dpchrist@holgerdanske.com X-Spamd-Result: default: False [-4.00 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[holgerdanske.com:s=nov-20210719-112354]; MID_RHS_MATCH_FROM(0.00)[]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; R_SPF_ALLOW(-0.20)[+a]; MIME_GOOD(-0.10)[text/plain]; TO_DN_NONE(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-questions@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; DKIM_TRACE(0.00)[holgerdanske.com:+]; DMARC_POLICY_ALLOW(-0.50)[holgerdanske.com,none]; NEURAL_HAM_SHORT(-1.00)[-1.000]; MLMMJ_DEST(0.00)[freebsd-questions]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:6939, ipnet:184.104.0.0/15, country:US]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[] X-ThisMailContainsUnwantedMimeParts: N freebsd-questions: I have a desktop computer: Intel DQ67SW motherboard Intel Core i7-2600S processor Corsair CMV8GX3M2A1333C9 2 @ 4 GB memory module kit Intel 520 Series SSD 60 GB EFI is disabled in CMOS Setup. FreeBSD was installed onto the SSD with a USB flash drive containing: FreeBSD-12.3-RELEASE-amd64-memstick.img As follows: FreeBSD - Welcome to FreeBSD Boot Multi user FreeBSD Installer - Welcome Install Keymap Selection Continue with default keymap Set Hostname f4.tracy.holgerdanske.com Distribution Selection Partitioning Auto (ZFS) Pool Type/Disks stripe: 1 disk ada0 INTEL SSDSC2CW060A3 Pool Name f4_zroot Force 4K Sectors YES Encrypt Disks YES Partition Scheme MBR (BIOS) Swap Size 2g Mirror Swap YES Encrypt Swap YES >>> Install Proceed with installation ZFS Configuration Last Chance! YES Enter a strong passphrase ******** Re-enter password ******** Root - New Password ******** Retype New Password ******** Network Configuration em0 Configure IPv4 Yes Use DHCP Yes Configure IPv6 No Search tracy.holgerdanske.com IPv4 DNS #1 192.168.5.1 IPv4 DNS #2 208.67.222.222 CMOS clock set to UTC Yes Time Zone Region America -- North and South Country or region United States of America Zone Pacific Time & Date - month, year, day Time & Data - time Services to start at boot sshd, ntpdate, ntpd, powerd System hardening options Add users No Final configuration Exit Open shell No Complete Reboot On May 29, 2022, I upgraded to: 2022-06-20 10:48:55 toor@f4 ~ # freebsd-version ; uname -a 12.3-RELEASE-p5 FreeBSD f4.tracy.holgerdanske.com 12.3-RELEASE-p5 FreeBSD 12.3-RELEASE-p5 GENERIC amd64 When I boot the machine, I see a prompt: GELI Passphrase: If I enter the correct passphrase, boot succeeds. If I enter an incorrect passphrase, I see another prompt later in boot: Enter passphrase for ada0s1d: Note that "ada0" corresponds to the device node name of the SSD when FreeBSD was installed. If I enter the correct passphrase, boot continues and succeeds. I would now like to use the computer to examine an EIDE HDD. I have installed a HBA: Promise Technology Ultra 133 TX2 Connected the HDD to the HBA: Maxtor 6L200P0 And set the CMOS Setup boot order so that the SSD is before the HDD. When I boot the machine I see the first prompt: GELI Passphrase: No matter what passphrase I enter, I always see the second prompt: Enter passphrase for ada1s1d: Note that "ada1" no longer corresponds to the device node name of the SSD when FreeBSD was installed. (I suspect the HDD is "ada0".) No matter what passphrase I enter at the second prompt, it is always rejected. FreeBSD will not boot. It appears that GELI and/or ZFS for the root partition is tied to the FreeBSD device node name "ada0s1d" (?), which is tied to the BIOS drive numbering. When I insert the HBA, the BIOS drive numbering changes, the root partition device node changes to "ada1s1d", GELI and/or ZFS breaks, and boot fails (?). CMOS Setup does not appear to provide a mechanism for influencing BIOS drive enumeration order. The HBA does not appear to have a POST hotkey/ setup program. I recall encountering this device node name issue when cloning FreeBSD installations between SSD's (device node names "adaN") and USB flash drives (device node names "daN"), and that the work-around was to boot FreeBSD installation media into a rescue shell, mount the boot filesystem, and delete zfs/zpool.cache (?). I would prefer a work-around that involves entering configuration settings during FreeBSD boot. Please advise. TIA, David