From nobody Thu Nov 28 15:46:11 2024 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Xzgdj0KrLz5dtS0 for ; Thu, 28 Nov 2024 15:46:17 +0000 (UTC) (envelope-from dclarke@blastwave.org) Received: from mail.oetec.com (mail.oetec.com [108.160.241.186]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature ECDSA (P-256) client-digest SHA256) (Client CN "mail.oetec.com", Issuer "E6" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Xzgdh5GXVz4Hyv; Thu, 28 Nov 2024 15:46:16 +0000 (UTC) (envelope-from dclarke@blastwave.org) Authentication-Results: mx1.freebsd.org; none Received: from [172.16.35.3] (pool-99-253-118-250.cpe.net.cable.rogers.com [99.253.118.250]) (authenticated bits=0) by mail.oetec.com (8.17.1/8.17.1) with ESMTPSA id 4ASFkBWg030302 (version=TLSv1.3 cipher=TLS_AES_128_GCM_SHA256 bits=128 verify=NOT); Thu, 28 Nov 2024 10:46:13 -0500 (EST) (envelope-from dclarke@blastwave.org) DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=blastwave.org; s=default; t=1732808773; bh=w8FmMOGyf7x8QQMBEzugM5kKktxy9UXYyCV/H6LPQbs=; h=Date:Subject:To:Cc:References:From:In-Reply-To; b=gT9O3CNs5OFPLk3sgH8ZOV4ZNpc1NsE+M+JP8ITqyJFDMiiWP/6PrH+pTjriLBLZL a/fHqHUYtF+pNC9Vfn7CXVRPWVzjDEyNAtjOz1y4SbPADcV+NYt/OrhJ7/vNgGTZuJ D8OE5p3e4wseEAaI2jDRf2x80Kf0XqKiVU4Mw2T2qCIGszEKefYmnHK6dEZWr/WDKA H+Z4PMA8AG4eMAz7wd8jyszbrZTUQ3HDuOZ0Y+lwa11YMWVou88l5D3EFeD8SJ0Syg JzmW7A7JNNyMvjVbXh/riNJxEC6kdCSumppEYqMLvW5hvIG7djE2lyuAiYag0h53iM 232MNl6p3fi4g== Message-ID: <6d5be5e0-ee68-4858-814b-d0886cef3f85@blastwave.org> Date: Thu, 28 Nov 2024 10:46:11 -0500 List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@FreeBSD.org MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Subject: Re: zpools no longer exist after boot Content-Language: en-CA To: Dimitry Andric Cc: Current FreeBSD References: <5798b0db-bc73-476a-908a-dd1f071bfe43@blastwave.org> <5165C4DB-8BA0-4579-A808-F98FBF3B797F@FreeBSD.org> From: Dennis Clarke Organization: GENUNIX In-Reply-To: <5165C4DB-8BA0-4579-A808-F98FBF3B797F@FreeBSD.org> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit X-oetec-MailScanner-Information: Please contact the ISP for more information X-oetec-MailScanner-ID: 4ASFkBWg030302 X-oetec-MailScanner: Found to be clean X-oetec-MailScanner-From: dclarke@blastwave.org X-Spam-Status: No X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:812, ipnet:108.160.240.0/20, country:CA] X-Rspamd-Queue-Id: 4Xzgdh5GXVz4Hyv X-Spamd-Bar: ---- On 11/28/24 10:02, Dimitry Andric wrote: > On 28 Nov 2024, at 14:05, Dennis Clarke wrote: >> >> This is a baffling problem wherein two zpools no longer exist after >> boot. This is : >>... >> titan# camcontrol devlist >> at scbus0 target 0 lun 0 (pass0,ada0) >> at scbus1 target 0 lun 0 (pass1,ada1) >> at scbus2 target 0 lun 0 (ses0,pass2) >> at scbus6 target 0 lun 0 (ses1,pass3) >> at scbus7 target 0 lun 1 (pass4,nda0) >> at scbus8 target 0 lun 0 (da0,pass5) > > It has been my experience that with disks connected to external enclosures, these sometimes take a long time to come up. If they come up only after the kernel initially detects ZFS pools, they will not be shown or imported at all. > > If you look at dmesg or boot logs, are the external disks detected around the same time as the NVMe device? > The only remote device is the iSCSI based unit and it seems to be visible neatly. In fact the zpools, all of them, are now available at boot time thanks to using the correct cachefile name. There may be a need to make some note somewhere in a man page that the zpool cachefile used in the RC script is important. -- -- Dennis Clarke RISC-V/SPARC/PPC/ARM/CISC UNIX and Linux spoken