From owner-freebsd-questions@freebsd.org Wed Jan 10 07:04:20 2018 Return-Path: Delivered-To: freebsd-questions@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 3A9AEE6D859 for ; Wed, 10 Jan 2018 07:04:20 +0000 (UTC) (envelope-from list1@gjunka.com) Received: from msa1.earth.yoonka.com (yoonka.com [88.98.225.149]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "msa1.earth.yoonka.com", Issuer "msa1.earth.yoonka.com" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id CFF5E278F for ; Wed, 10 Jan 2018 07:04:19 +0000 (UTC) (envelope-from list1@gjunka.com) Received: from ultrabook.yoonka.com (x2f7f2f6.dyn.telefonica.de [2.247.242.246]) (authenticated bits=0) by msa1.earth.yoonka.com (8.15.2/8.15.2) with ESMTPSA id w0A749Yo021696 (version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128 verify=NO); Wed, 10 Jan 2018 07:04:10 GMT (envelope-from list1@gjunka.com) X-Authentication-Warning: msa1.earth.yoonka.com: Host x2f7f2f6.dyn.telefonica.de [2.247.242.246] claimed to be ultrabook.yoonka.com Subject: Re: NVMe ZFS mount To: Ben Woods Cc: freebsd-questions@freebsd.org References: <3f89d154-d878-a267-66a5-e898cc2621f5@gjunka.com> From: Grzegorz Junka Message-ID: Date: Wed, 10 Jan 2018 07:04:03 +0000 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:52.0) Gecko/20100101 Thunderbird/52.3.0 MIME-Version: 1.0 In-Reply-To: Content-Language: en-GB-large Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 8bit X-Content-Filtered-By: Mailman/MimeDel 2.1.25 X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 10 Jan 2018 07:04:20 -0000 On 08/01/2018 22:58, Ben Woods wrote: > On Tue, 9 Jan 2018 at 6:47 am, Grzegorz Junka > wrote: > > Hi, > > I've two zfs mirrors, one on two SATA drives and one on two NVMe > drives. > SATA are used to boot the system. I observed that after booting the > system zfs datasets on NVMe drives aren't mounted. The pool is > imported > and I can list the datasets but command mount doesn't show any mounts > apart from the system (SATA) drives. > > Do ZFS datasets on NVMe need any special treatment to be mounted > by the > system automatically, e.g. an entry in /etc/fstab? > > Thanks > > GrzegorzJ > > > I don’t believe NVMe needs any special treatment, but I haven’t used > it. What about the boot order... when you watch it boot, do the NVMe > devices show up before the /etc/rc.d/zfs script is run? > > Check the “canmount” parameter of each of your datasets. > zfs get -r canmount,mountpoint,mounted nvmepool > NVMe devices are enumerated at about the same time as other devices, even slightly before SATA drivers. And much earlier than ZFS tries to mount the root directory. It may not be the same as /etc/rc.d/zfs script. Would this script leave any trace in dmesg? I will check the zfs command you gave when I have access to the system and report back. Thanks GregJ