From owner-freebsd-fs@freebsd.org Sun Nov 29 19:56:05 2020 Return-Path: Delivered-To: freebsd-fs@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id C12CB4AB8D1 for ; Sun, 29 Nov 2020 19:56:05 +0000 (UTC) (envelope-from freebsd@omnilan.de) Received: from mx0.gentlemail.de (mx0.gentlemail.de [IPv6:2a00:e10:2800::a130]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "CN", Issuer "CN" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4CkfHl6FYRz3M6G for ; Sun, 29 Nov 2020 19:56:03 +0000 (UTC) (envelope-from freebsd@omnilan.de) Received: from mh0.gentlemail.de (ezra.dcm1.omnilan.net [78.138.80.135]) by mx0.gentlemail.de (8.15.2/8.15.2) with ESMTP id 0ATJtsHQ014107 for ; Sun, 29 Nov 2020 20:55:55 +0100 (CET) (envelope-from freebsd@omnilan.de) X-Authentication-Warning: mx0.gentlemail.de: Host ezra.dcm1.omnilan.net [78.138.80.135] claimed to be mh0.gentlemail.de Received: from titan.inop.mo1.omnilan.net (s1.omnilan.de [217.91.127.234]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by mh0.gentlemail.de (Postfix) with ESMTPSA id 767BD381 for ; Sun, 29 Nov 2020 20:55:54 +0100 (CET) To: freebsd-fs@freebsd.org From: Harry Schmalzbauer Subject: OpenZFS dropped 'create -u' - not mounting newly created ZFS datasets automatically Organization: OmniLAN Message-ID: Date: Sun, 29 Nov 2020 20:55:50 +0100 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:52.0) Gecko/20100101 Thunderbird/52.7.0 MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit Content-Language: en-US X-Greylist: inspected by milter-greylist-4.6.2 (mx0.gentlemail.de [78.138.80.130]); Sun, 29 Nov 2020 20:55:55 +0100 (CET) for IP:'78.138.80.135' DOMAIN:'ezra.dcm1.omnilan.net' HELO:'mh0.gentlemail.de' FROM:'freebsd@omnilan.de' RCPT:'' X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.6.2 (mx0.gentlemail.de [78.138.80.130]); Sun, 29 Nov 2020 20:55:55 +0100 (CET) X-Rspamd-Queue-Id: 4CkfHl6FYRz3M6G X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of freebsd@omnilan.de designates 2a00:e10:2800::a130 as permitted sender) smtp.mailfrom=freebsd@omnilan.de X-Spamd-Result: default: False [-3.30 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; ARC_NA(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; FROM_HAS_DN(0.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[2a00:e10:2800::a130:from]; TO_MATCH_ENVRCPT_ALL(0.00)[]; R_SPF_ALLOW(-0.20)[+mx]; MIME_GOOD(-0.10)[text/plain]; HAS_XAW(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; HAS_ORG_HEADER(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; TO_DN_NONE(0.00)[]; SPAMHAUS_ZRD(0.00)[2a00:e10:2800::a130:from:127.0.2.255]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-1.000]; DMARC_NA(0.00)[omnilan.de]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:61157, ipnet:2a00:e10:2800::/38, country:DE]; RCVD_TLS_LAST(0.00)[]; MAILMAN_DEST(0.00)[freebsd-fs] X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 29 Nov 2020 19:56:05 -0000 Hello, one of my deployment scripts fails since r364746 (Merge OpenZFS support in to HEAD). The reason is '-u' seems to be dropped for zfs-create(8). I couldn't find an option to create a dataset without automatically mounting it. Am I the only one missing that possibility? Thanks, -harry From owner-freebsd-fs@freebsd.org Mon Nov 30 05:00:34 2020 Return-Path: Delivered-To: freebsd-fs@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 5099946F3A8 for ; Mon, 30 Nov 2020 05:00:34 +0000 (UTC) (envelope-from pascal.guitierrez@gmail.com) Received: from mail-vs1-xe30.google.com (mail-vs1-xe30.google.com [IPv6:2607:f8b0:4864:20::e30]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4CktN14Dt3z4YyG for ; Mon, 30 Nov 2020 05:00:33 +0000 (UTC) (envelope-from pascal.guitierrez@gmail.com) Received: by mail-vs1-xe30.google.com with SMTP id p7so621974vsf.8 for ; Sun, 29 Nov 2020 21:00:33 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:from:date:message-id:subject:to; bh=b6jw1Xby454vQpLtKkM//QtWeP5ikQ0jVWCo2voofNw=; b=BsXcl/Y4+i56mNr5V/AeUPDoDTMuURojHDmpOqpvHIU7fTnrUVCsCZJ4mNx3/6bVGH hgj+L8pmAJoAXYyi4JK/QxllspmByy0eAvDgPifaZ8Vx0cluWY9S12n5MgovR2dZBHDv 6NeNV2D0fzP2Q/mDi54T65Ke4bxL8paM11AXwsaIomxofSV6StIvifxQNCEHwXNazghC 7xNfztl67gBJg7SDqGpiJ5eUqRj2o7u68AsAZd0h6+1TjnML5uChMIU5YgHrKnkZ/nnc mDSO/MJBH7sSEUYq+d6cgrl4s4A3wNZlLDbGApy28Pk6os9T+4Ek8JLV8k9CkCR9fdux l/qQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=b6jw1Xby454vQpLtKkM//QtWeP5ikQ0jVWCo2voofNw=; b=BqGe8Kc64ULDBV/thkgM+hyya4XLOjAiGiQ7K9h88i3dXMH6oQQJBuyi0vfkid4imf IeU0pBfnE0Shznig3UBw+80gp7rYuybxugIW8eKUGeR2vJEUBmm75Ov5khwhZzI/mDlN 9HYT8VJm35lfInVxg0fkXH9+7az4E5MK9UOQIzuoBAizOTffTr/CEgOqMUR83WTe4RWa hFujC9+nMDrOgQQ5ptRAXhCbpygNzu72AqtE+qDl7qH+wKdp8qLF+lIZIn/eT2f92nlv JDJv18Wci1weyp0MO5RYeFDMS3eymX8wCiYZzLxCGiMSK9yNBSTZcH5MnMmlVgW4EwrR nA8g== X-Gm-Message-State: AOAM530I9bSG4EFmUWGaUN40hRuIyKSKBTdjf/Qpm0U+bgmbJ6kBTOkH A/P5cL+HIuieIzU0MSwiJU35iST+qbUylTW5lsHLwOudmZI= X-Google-Smtp-Source: ABdhPJx8k6bfd0+witGAMxT2sQ6X8oLXUY6CQ7Xpx7QV04ydFjUtWCiwQYhypEHl3XEaJIe1H8Mr1rnuiZEk64bpb2Q= X-Received: by 2002:a67:ce1a:: with SMTP id s26mr13854025vsl.0.1606712432478; Sun, 29 Nov 2020 21:00:32 -0800 (PST) MIME-Version: 1.0 From: Pascal Guitierrez Date: Mon, 30 Nov 2020 16:00:21 +1100 Message-ID: Subject: Special allocation classes sizing To: freebsd-fs@freebsd.org X-Rspamd-Queue-Id: 4CktN14Dt3z4YyG X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=BsXcl/Y4; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of pascalguitierrez@gmail.com designates 2607:f8b0:4864:20::e30 as permitted sender) smtp.mailfrom=pascalguitierrez@gmail.com X-Spamd-Result: default: False [-2.02 / 15.00]; FREEMAIL_FROM(0.00)[gmail.com]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; TO_DN_NONE(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; RBL_DBL_DONT_QUERY_IPS(0.00)[2607:f8b0:4864:20::e30:from]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; TAGGED_FROM(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; SPAMHAUS_ZRD(0.00)[2607:f8b0:4864:20::e30:from:127.0.2.255]; NEURAL_SPAM_SHORT(0.98)[0.980]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::e30:from]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-fs] Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.34 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 30 Nov 2020 05:00:34 -0000 Hi there, We are looking at migrating a rather large existing pool of around 400TB onto a new pool, taking advantage of the special allocation classes in 12.2-RELEASE (just using the default special, not dedup or small_blocks). I am about to procure the hardware needed, however I=E2=80=99m not sure how= big to make the special storage layer. Is there a rough estimate calculation or perhaps I can run zdb on the existing pool to get an estimate? Thanks for your time From owner-freebsd-fs@freebsd.org Mon Nov 30 07:35:53 2020 Return-Path: Delivered-To: freebsd-fs@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 1A515472096 for ; Mon, 30 Nov 2020 07:35:53 +0000 (UTC) (envelope-from me@anatoli.ws) Received: from out-mx.anatoli.ws (out-mx.anatoli.ws [177.54.157.124]) (using TLSv1.2 with cipher DHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "out-mx.anatoli.ws", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4CkxqD1NsNz4h3v for ; Mon, 30 Nov 2020 07:35:51 +0000 (UTC) (envelope-from me@anatoli.ws) Received: from [192.168.0.1] (unknown [192.168.0.1]) by out-mx.oprbox.com (Postfix) with ESMTPSA id 9D0291E00BCA for ; Mon, 30 Nov 2020 07:35:41 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=anatoli.ws; s=vnptcm0lqn; t=1606721742; bh=dl4E4t2Aq9UZgIz08cD83+1kQzz/vDt2IOwd2u79CW4=; h=To:From:Subject:Date; b=oz/GMvWDpjWOGVQ6WBgMeFU/DyDVkNu4GiRswlRprTBuJGO+tStjEdGmopD8iwnhZ Ax4tRQUE6jG/o5D98NWkO9ldW9OJej/ZGzdp3xuWLukWL1KqI6xop911mNloTqIdrG O95FMOdDevuc/Eo8EgFv1+VlgOzeXXTtJUfcj47m5cGRdJTGjifMg+pT3XcpvQl2Wd TVUpeCdBwfCXXovQyPFs7NU7bcZFQ3vLDbPHOWsZ45x+zOr00L4cV06JDmCPmad4Gt kMeICu19TelbRmM/lah5Msz/+4XxP3jcieh9JpsaQxuRsNVv18YXX/eXXlj+0E1l2G xEQiv9lxio4xQ== To: freebsd-fs@freebsd.org From: Anatoli Subject: bootable HAST + ZFS Message-ID: <4108cd1f-cdfa-c522-ba96-8c6d29d9ca32@anatoli.ws> Date: Mon, 30 Nov 2020 04:35:40 -0300 Mime-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 4CkxqD1NsNz4h3v X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=anatoli.ws header.s=vnptcm0lqn header.b=oz/GMvWD; dmarc=pass (policy=reject) header.from=anatoli.ws; spf=pass (mx1.freebsd.org: domain of me@anatoli.ws designates 177.54.157.124 as permitted sender) smtp.mailfrom=me@anatoli.ws X-Spamd-Result: default: False [-3.50 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+a:out-mx.anatoli.ws]; TO_DN_NONE(0.00)[]; DKIM_TRACE(0.00)[anatoli.ws:+]; DMARC_POLICY_ALLOW(-0.50)[anatoli.ws,reject]; NEURAL_HAM_SHORT(-1.00)[-1.000]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RBL_DBL_DONT_QUERY_IPS(0.00)[177.54.157.124:from]; ASN(0.00)[asn:262287, ipnet:177.54.157.0/24, country:BR]; MID_RHS_MATCH_FROM(0.00)[]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[anatoli.ws:s=vnptcm0lqn]; FREEFALL_USER(0.00)[me]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; SPAMHAUS_ZRD(0.00)[177.54.157.124:from:127.0.2.255]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-fs] X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 30 Nov 2020 07:35:53 -0000 Hi, I know the recommended way to use HAST with ZFS is to create HAST resources from each disc on each server, then build ZFS pool using the HAST resources. But is there a way to boot from such setup? If not, what's the recommended way to make a bootable setup with HAST & ZFS? Are there any alternatives to HAST for real-time replication? I have only large high-performance disks in each server (and there are no more NVMe slots for additional disks, neither there are SATA/M.2 slots) and I don't want to sacrifice an entire disk just to be able to boot the OS. Thanks, Anatoli From owner-freebsd-fs@freebsd.org Mon Nov 30 18:26:53 2020 Return-Path: Delivered-To: freebsd-fs@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 71E494A4A29 for ; Mon, 30 Nov 2020 18:26:53 +0000 (UTC) (envelope-from ryan@ixsystems.com) Received: from mail-ot1-x333.google.com (mail-ot1-x333.google.com [IPv6:2607:f8b0:4864:20::333]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4ClDGN5XLbz4WDv for ; Mon, 30 Nov 2020 18:26:52 +0000 (UTC) (envelope-from ryan@ixsystems.com) Received: by mail-ot1-x333.google.com with SMTP id e105so236624ote.5 for ; Mon, 30 Nov 2020 10:26:52 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=ixsystems.com; s=google; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=T2mzQA1FUctDnvONEmHpSX0aNmFKKbhTB7E6p4cZt+I=; b=RV7kxmxXKjB0J7oxQjhmHs3k7SfTWiJ0rEwFtVmjHr3bZ4tHjvjL2/LtSo1n28VXOc pUGsblEZXmICEWAf4eA56l7Lr6fckral6rsfMTKHS8YrKzL/ZK8BgyUdjO7Z799F9RMH XO7De/rRa25GWMl+FRfVNf84/jTEKWMKiOwXDplIJyy8JDMUQkL/UZnqF333BC1uY4nS Kn5rlzxqeb9q7tyf7Vk370MaJtOFYDBfS5GW3bpFve0QOvuUYNJhtuJiAokXmyw3QxlY Awmo5gsRqDkvtGfyUuu8Gv9YlPlQkL9BDX2bEIqjrJQwQYRVCqvI642SwdBjQiP1GnAF aVUw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=T2mzQA1FUctDnvONEmHpSX0aNmFKKbhTB7E6p4cZt+I=; b=KEOpQb6Cgee/ijK2+iotRpTWt+ksK+lR67qf/apw4UEeIifOa3LY3TL96+1yKorxDw 5UGxQWTMtz2MldeObRKGKzJSPiXsroCFiO2WebzEFRbfYQMGPla4Q+NBv7KY+0CNhnxC 3jdk9eCKO8d3+7NSD9YuvRLmI9NZhe3MWItYbbo672jr7y8aBwO7/SM/tUNCiQByO1pk ZR0xvhN0ApKu9kS0jbT+obDPYrvSDusAqHarAuEqpSghaNKhXccEt77DdxRqEzSt0JWA cy6xYRj+lUlCBPwrBKZd3TvH8XLuOfCqyXGfONdLdBfNsWYOx+lbUAzRTyY8iaGAAJKN 6KAQ== X-Gm-Message-State: AOAM531z+tbRKaqtcThU1AC774CdYAjuoJ9qJOv5tJEaC/3yYSHGUqK6 ZG5Ho9La/GyPK/mX6nSmpNPOh7mw8GBoQ14oYOQRqQVC2nEPS9Qt X-Google-Smtp-Source: ABdhPJxAEtl3/xdWKAL4brauuIJguaxAUuKjyrQn19cozuK3LlKjHuhoNXSS3kWhNnz224ArZG14xVhCZnPRGxudVLk= X-Received: by 2002:a05:6830:1083:: with SMTP id y3mr17961573oto.213.1606760811505; Mon, 30 Nov 2020 10:26:51 -0800 (PST) MIME-Version: 1.0 References: In-Reply-To: From: Ryan Moeller Date: Mon, 30 Nov 2020 13:26:40 -0500 Message-ID: Subject: Re: OpenZFS dropped 'create -u' - not mounting newly created ZFS datasets automatically To: Harry Schmalzbauer Cc: freebsd-fs Content-Type: text/plain; charset="UTF-8" X-Rspamd-Queue-Id: 4ClDGN5XLbz4WDv X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=ixsystems.com header.s=google header.b=RV7kxmxX; dmarc=pass (policy=none) header.from=ixsystems.com; spf=pass (mx1.freebsd.org: domain of ryan@ixsystems.com designates 2607:f8b0:4864:20::333 as permitted sender) smtp.mailfrom=ryan@ixsystems.com X-Spamd-Result: default: False [-4.00 / 15.00]; RCVD_TLS_ALL(0.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[ixsystems.com:s=google]; FREEFALL_USER(0.00)[ryan]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; SPAMHAUS_ZRD(0.00)[2607:f8b0:4864:20::333:from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[ixsystems.com:+]; RCPT_COUNT_TWO(0.00)[2]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::333:from]; NEURAL_HAM_SHORT(-1.00)[-1.000]; DMARC_POLICY_ALLOW(-0.50)[ixsystems.com,none]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RBL_DBL_DONT_QUERY_IPS(0.00)[2607:f8b0:4864:20::333:from]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[freebsd-fs] X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 30 Nov 2020 18:26:53 -0000 On Sun, Nov 29, 2020 at 2:56 PM Harry Schmalzbauer wrote: > > Hello, > > one of my deployment scripts fails since r364746 (Merge OpenZFS support > in to HEAD). > > The reason is '-u' seems to be dropped for zfs-create(8). > I couldn't find an option to create a dataset without automatically > mounting it. > > Am I the only one missing that possibility? > > Thanks, > > -harry Thanks for reporting this, I've opened a pull request for the missing feature here: https://github.com/openzfs/zfs/pull/11254 -- Ryan Moeller iXsystems, Inc. OS Developer Email: ryan@iXsystems.com From owner-freebsd-fs@freebsd.org Wed Dec 2 08:42:54 2020 Return-Path: Delivered-To: freebsd-fs@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 5F7974750FF for ; Wed, 2 Dec 2020 08:42:54 +0000 (UTC) (envelope-from michaelsprivate@gmail.com) Received: from mail-il1-x131.google.com (mail-il1-x131.google.com [IPv6:2607:f8b0:4864:20::131]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4CmCCd390xz4YD0 for ; Wed, 2 Dec 2020 08:42:53 +0000 (UTC) (envelope-from michaelsprivate@gmail.com) Received: by mail-il1-x131.google.com with SMTP id g1so814799ilk.7 for ; Wed, 02 Dec 2020 00:42:53 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :content-transfer-encoding; bh=HKFyufL4CHZcEnkly5awE/4Jg24OFKkvQ+97MeEJWzQ=; b=lrk5YpwDPE+Sz0NDCiBh6dVQDoPsjd/TGNM50Dp5JviNZuCp55gutobiD81exjdJAG bXLUfy5/vKyDp7E+WIfelw3BYosRskVjPgvZft0fTMHtDRoKixQctg0OuKI2Jq/BBj5G 7vXrjuL/zqxNMs1hlnYKDMKQfC+DkOMqwz44AMm8BCSFtbBhGWPrThi+DxSvwVS6MBEA +QBWRq9OVX6KOpk+0ESn+NM4umUkxfqOj3v8OrRRIOek7g3Cv2I4Hb77RltbEr/6HZ1m 5KYMi4w8dDK8vuqJGppwsYcB1Dno0ryPC56rGUp/hixE5d3YSiinN006Kluu8dJ8sO4i efeA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:content-transfer-encoding; bh=HKFyufL4CHZcEnkly5awE/4Jg24OFKkvQ+97MeEJWzQ=; b=KDZDGDYB16S2flo5HpolE350SPE/S1r05XarnOkrJKBVgoQjONWSNM+CklKo8bGMeL VAO0sTKkrzXJbizx8oRYI5y4TUrpHKtj6y5CwpGhSPAcK3S4GWgcXjblGEZcgEpum2O6 60KBBmZyhQpEu2H94pzuGOiAi0mfPVz2SdtrX7IsBImWYT4VVRpxTheoINdSIBztMkO6 0Zy/f78X7CfSg/68K7HQTYN49K4dYlFF6oVaag7rpQIiKXD//zDqveK+gClMGk4pYW29 AFbUUaDIUUe6MfumoYtYTFqOYZLLULKxq3lNM4/XFiyBMtd2kqeT3u1kpRMia/zxTKj9 m+EA== X-Gm-Message-State: AOAM531ovQWI9dD0kkhSNfdHp7DLRgrd+MwX797ChOeUu/IQShBDVo4C jp+ZM3ksD2kgWbeKLCoU7B5epk30PN1DgT9+66gkbhTWtvc= X-Google-Smtp-Source: ABdhPJyXmbauJdDWTKmRqoo6WOXqZsgwmzVIdCFhTIZhPVYPoUznPZWO7AwGKAhZ0TMJ7jPbDAStTtUonSHPzGimGEQ= X-Received: by 2002:a92:50b:: with SMTP id q11mr1448119ile.49.1606898571787; Wed, 02 Dec 2020 00:42:51 -0800 (PST) MIME-Version: 1.0 References: In-Reply-To: From: Michael Schuster Date: Wed, 2 Dec 2020 09:42:40 +0100 Message-ID: Subject: Re: FreeBSD current: ZFS root mounted readonly at boot To: freebsd-fs@freebsd.org Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Rspamd-Queue-Id: 4CmCCd390xz4YD0 X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=lrk5YpwD; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of michaelsprivate@gmail.com designates 2607:f8b0:4864:20::131 as permitted sender) smtp.mailfrom=michaelsprivate@gmail.com X-Spamd-Result: default: False [-3.32 / 15.00]; FREEMAIL_FROM(0.00)[gmail.com]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; TO_DN_NONE(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; NEURAL_HAM_SHORT(-0.32)[-0.320]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RBL_DBL_DONT_QUERY_IPS(0.00)[2607:f8b0:4864:20::131:from]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; SPAMHAUS_ZRD(0.00)[2607:f8b0:4864:20::131:from:127.0.2.255]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::131:from]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-fs] X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 02 Dec 2020 08:42:54 -0000 Hi, On Sun, Nov 8, 2020 at 8:06 PM Michael Schuster wrote: > > Hi all, > > I have a laptop with 12.2 RELEASE (ghostbsd) where I build CURRENT and in= stall it into a separate boot environment (described in the thread "Recipe = for compiling and installing CURRENT on 12.x RELEASE in a seperate boot env= ?" on questions@). > After initial difficulties, all zfs datasets I want mounted actually are = mounted at boot time, but "/" is mounted read-only, which causes a few erro= r messages in the log(s) and, I suspect, the failure of X to start at boot = (I can log in on a text console and run startx fine). > > What I don't understand (and to which I haven't found anything helpful no= r current despite some effort) is this: > > $ zfs get all $ROOT | grep readonly > $ROOT readonly on = temporary > > (changing this property - either when booted from this BE or from a 12.2 = BE - doesn't change this behaviour at next boot). > > What can I do to change this? This behaviour is not visible in 12.2 > does anybody have a comment/opinion on this? Do I need to supply anything specific? regards Michael --=20 Michael Schuster http://recursiveramblings.wordpress.com/ recursion, n: see 'recursion' From owner-freebsd-fs@freebsd.org Wed Dec 2 11:53:08 2020 Return-Path: Delivered-To: freebsd-fs@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 5B7E5478335 for ; Wed, 2 Dec 2020 11:53:08 +0000 (UTC) (envelope-from prvs=16050d8e15=itanusheff@postbank.bg) Received: from mx.postbank.bg (mx.postbank.bg [195.242.126.253]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mail.postbank.bg", Issuer "Sectigo RSA Organization Validation Secure Server CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4CmHR71HcBz4hv5 for ; Wed, 2 Dec 2020 11:53:06 +0000 (UTC) (envelope-from prvs=16050d8e15=itanusheff@postbank.bg) From: "Ivailo A. Tanusheff" To: Michael Schuster , "freebsd-fs@freebsd.org" Subject: RE: FreeBSD current: ZFS root mounted readonly at boot Thread-Topic: FreeBSD current: ZFS root mounted readonly at boot Thread-Index: AQHWtgJj1GzteTvKHEOOKGWTRfd1x6njgKMAgABWgGA= Date: Wed, 2 Dec 2020 11:53:02 +0000 Message-ID: References: In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [10.1.162.24] Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 x-msw-jemd-newsletter: false DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=postbank.bg; s=mail2; t=1606909983; bh=IGTd89ShBu2jwozqrbSG6570wUWpusIvFZXxT170jnM=; h=From:To:Subject:Thread-Topic:Thread-Index:Date:Message-ID: References:In-Reply-To:Accept-Language:Content-Language: Content-Type:Content-Transfer-Encoding:MIME-Version; b=pGKldLNx0j9k5lO3V0PIQlKqKZeRrkMpbGbL/C6n6nsWIJTVqcGxHPavx3iKXPQIX JGPacbRw17I4yDF/sby6t+CA4mZrjpwRNnr7I9XGxLUh2WMAx7XwMLjiJW8iQ5KlsY ck+FFTnDQWQ4OyrN9EFnj6LTYQXIHB/PV7j2tkCg= X-Rspamd-Queue-Id: 4CmHR71HcBz4hv5 X-Spamd-Bar: ------ Authentication-Results: mx1.freebsd.org; dkim=pass header.d=postbank.bg header.s=mail2 header.b=pGKldLNx; dmarc=pass (policy=none) header.from=postbank.bg; spf=pass (mx1.freebsd.org: domain of prvs=16050d8e15=itanusheff@postbank.bg designates 195.242.126.253 as permitted sender) smtp.mailfrom=prvs=16050d8e15=itanusheff@postbank.bg X-Spamd-Result: default: False [-6.70 / 15.00]; TO_DN_EQ_ADDR_SOME(0.00)[]; HAS_XOIP(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:195.242.126.253/32]; RCVD_DKIM_ARC_DNSWL_MED(-0.50)[]; RCVD_IN_DNSWL_MED(-0.20)[195.242.126.253:from]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[postbank.bg,none]; DKIM_TRACE(0.00)[postbank.bg:+]; FREEMAIL_TO(0.00)[gmail.com,freebsd.org]; RCVD_COUNT_ZERO(0.00)[0]; MIME_TRACE(0.00)[0:+]; NEURAL_HAM_SHORT(-1.00)[-1.000]; ASN(0.00)[asn:41799, ipnet:195.242.126.0/24, country:BG]; MID_RHS_MATCH_FROM(0.00)[]; FROM_NEQ_ENVFROM(0.00)[ITanusheff@postbank.bg,prvs=16050d8e15=itanusheff@postbank.bg]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[postbank.bg:s=mail2]; FROM_HAS_DN(0.00)[]; DWL_DNSWL_MED(-2.00)[postbank.bg:dkim]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; FORGED_SENDER_VERP_SRS(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; MAILMAN_DEST(0.00)[freebsd-fs] X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 02 Dec 2020 11:53:08 -0000 Hi, Can you provide: zpool get all Regards, Ivailo=20 -----Original Message----- From: owner-freebsd-fs@freebsd.org On Behalf= Of Michael Schuster Sent: Wednesday, December 2, 2020 10:43 AM To: freebsd-fs@freebsd.org Subject: Re: FreeBSD current: ZFS root mounted readonly at boot Hi, On Sun, Nov 8, 2020 at 8:06 PM Michael Schuster = wrote: > > Hi all, > > I have a laptop with 12.2 RELEASE (ghostbsd) where I build CURRENT and in= stall it into a separate boot environment (described in the thread "Recipe = for compiling and installing CURRENT on 12.x RELEASE in a seperate boot env= ?" on questions@). > After initial difficulties, all zfs datasets I want mounted actually are = mounted at boot time, but "/" is mounted read-only, which causes a few erro= r messages in the log(s) and, I suspect, the failure of X to start at boot = (I can log in on a text console and run startx fine). > > What I don't understand (and to which I haven't found anything helpful no= r current despite some effort) is this: > > $ zfs get all $ROOT | grep readonly > $ROOT readonly on = temporary > > (changing this property - either when booted from this BE or from a 12.2 = BE - doesn't change this behaviour at next boot). > > What can I do to change this? This behaviour is not visible in 12.2 > does anybody have a comment/opinion on this? Do I need to supply anything s= pecific? regards Michael -- Michael Schuster http://recursiveramblings.wordpress.com/ recursion, n: see 'recursion' _______________________________________________ freebsd-fs@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-fs To unsubscribe, send any mail to "freebsd-fs-unsubscribe@freebsd.org" ********************************************************************** Disclaimer: This communication is confidential. If you are not the intended recipient, = you are hereby notified that any disclosure, copying, distribution or takin= g any action in reliance on the contents of this information is strictly pr= ohibited and may be unlawful. If you have received this communication by mi= stake, please notify us immediately by responding to this email and then de= lete it from your system. Eurobank Bulgaria AD is not responsible for, nor endorses, any opinion, rec= ommendation, conclusion, solicitation, offer or agreement or any informatio= n contained in this communication. Eurobank Bulgaria AD cannot accept any responsibility for the accuracy or c= ompleteness of this message as it has been transmitted over a public networ= k. If you suspect that the message may have been intercepted or amended, pl= ease call the sender. ********************************************************************** From owner-freebsd-fs@freebsd.org Fri Dec 4 18:56:49 2020 Return-Path: Delivered-To: freebsd-fs@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 4466D4A83E4 for ; Fri, 4 Dec 2020 18:56:49 +0000 (UTC) (envelope-from michaelsprivate@gmail.com) Received: from mail-io1-xd2f.google.com (mail-io1-xd2f.google.com [IPv6:2607:f8b0:4864:20::d2f]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Cnhl429kkz3MZZ for ; Fri, 4 Dec 2020 18:56:47 +0000 (UTC) (envelope-from michaelsprivate@gmail.com) Received: by mail-io1-xd2f.google.com with SMTP id j23so6818614iog.6 for ; Fri, 04 Dec 2020 10:56:47 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc:content-transfer-encoding; bh=lmVCT7ZJp36FpiY70gYurqHvc/AT2cRkYUYdpdGkFdA=; b=DlXwFXJYTrF64D4Rvr7TGOXiygRlyduiPbqerj4yzR4sjlLNKq4v+fxe3mlokvXbfk nfSY2ZIvtF3zscyecI/S9iot/vKAqBLxT9rYpqy63UkEydDBn5EBnJFdb8fK3LJGtrry XwgMzWbGoag1eBvSefl7ls4gxUIiMFprj4V6+XmkfyniIasitU5xe9Khpkag1ny+vFeA sVOC91zSs/EYsBAojmLoTa3VL556hbaorR1m2shWDxQy+FkXyAglqTCjvlbs1w9mPz1+ R2sa8GTu5lNHxb0to7BfzPC9IJd1COWCD2bOSCsZ6lseSjcNZvqcSPEbGqIUkR/ABrRq QZcg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc:content-transfer-encoding; bh=lmVCT7ZJp36FpiY70gYurqHvc/AT2cRkYUYdpdGkFdA=; b=pht+HW9J79R7A7m7p9SEzouHkDBpvoIa6Rla40lfOmgotBbW4IEkupwF1NnogSlW6f Fyr43Qz3Hdb2S1AKtgJYnOmT5LJPQ5EtzBE574W+y4k4Y19ZrH2gQb7g5cO4Cnz9Ealp Gk1tt3sixpjVpeDa9e/Z/ylssnheyKUECVwU9ipF29Bfc1+NN/0tagGCl8vUhskSyhCB VoL+gJsRW0rWnENlU1K6NjhE85bUwr1jaeBGOQ6dHMmwbB4PFvRQEYnAvV5Fzlc/Bkpt 7E5J+8gZAvg0TZHQ9W2DiYRP7in173a64IfPmzk6kicDO3LqrtRtAn6H+UAw/xHrK63C KK8A== X-Gm-Message-State: AOAM5309vPK1Uf+y4V7qIb4NL6vOs9zM0PJpOyTiuB4xRTB9URHMMl5t +07cN0Q4WiUXRM457Kmbm6d9E9U3wq9xoPePQUT70xOUNjyjnA== X-Google-Smtp-Source: ABdhPJxOVfxRlukrT/Ta0M1ZC8D6vIh4ThrW+Kw3w1HEJTLwAHFlZdQNm+f2VVNmD/NvNoyBIG1Yq83MSPNwSFFh9aY= X-Received: by 2002:a02:6c50:: with SMTP id w77mr8295779jab.68.1607108206808; Fri, 04 Dec 2020 10:56:46 -0800 (PST) MIME-Version: 1.0 References: In-Reply-To: From: Michael Schuster Date: Fri, 4 Dec 2020 19:56:35 +0100 Message-ID: Subject: solved [Re: FreeBSD current: ZFS root mounted readonly at boot] To: "Ivailo A. Tanusheff" Cc: "freebsd-fs@freebsd.org" Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Rspamd-Queue-Id: 4Cnhl429kkz3MZZ X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=DlXwFXJY; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of michaelsprivate@gmail.com designates 2607:f8b0:4864:20::d2f as permitted sender) smtp.mailfrom=michaelsprivate@gmail.com X-Spamd-Result: default: False [-4.00 / 15.00]; TO_DN_EQ_ADDR_SOME(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36:c]; FREEMAIL_FROM(0.00)[gmail.com]; DKIM_TRACE(0.00)[gmail.com:+]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; NEURAL_HAM_SHORT(-1.00)[-0.999]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RBL_DBL_DONT_QUERY_IPS(0.00)[2607:f8b0:4864:20::d2f:from]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; FROM_HAS_DN(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; SPAMHAUS_ZRD(0.00)[2607:f8b0:4864:20::d2f:from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::d2f:from]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-fs] X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 04 Dec 2020 18:56:49 -0000 On Wed, Dec 2, 2020 at 12:53 PM Ivailo A. Tanusheff wrote: > > Hi, > > Can you provide: > zpool get all > > Regards, > Ivailo > > -----Original Message----- > From: owner-freebsd-fs@freebsd.org On Beha= lf Of Michael Schuster > Sent: Wednesday, December 2, 2020 10:43 AM > To: freebsd-fs@freebsd.org > Subject: Re: FreeBSD current: ZFS root mounted readonly at boot > > Hi, > > On Sun, Nov 8, 2020 at 8:06 PM Michael Schuster wrote: > > > > Hi all, > > > > I have a laptop with 12.2 RELEASE (ghostbsd) where I build CURRENT and = install it into a separate boot environment (described in the thread "Recip= e for compiling and installing CURRENT on 12.x RELEASE in a seperate boot e= nv?" on questions@). > > After initial difficulties, all zfs datasets I want mounted actually ar= e mounted at boot time, but "/" is mounted read-only, which causes a few er= ror messages in the log(s) and, I suspect, the failure of X to start at boo= t (I can log in on a text console and run startx fine). > > > > What I don't understand (and to which I haven't found anything helpful = nor current despite some effort) is this: > > > > $ zfs get all $ROOT | grep readonly > > $ROOT readonly on = temporary > > > > (changing this property - either when booted from this BE or from a 12.= 2 BE - doesn't change this behaviour at next boot). > > > > What can I do to change this? This behaviour is not visible in 12.2 > > > > > does anybody have a comment/opinion on this? Do I need to supply anything= specific? I just realised I sent the reply to Ivailo's question only to him ... sorry, that wasn't my intention. Be that as it may: this turned out to be this setting: root_rw_mount=3D"NO" in /etc/rc.conf, which seems to have been present (and ignored) since I installed this machine w. GhostBSD (12.1, then 12.2) in July, and only with the switch to CURRENT did it take effect, it appears. setting this to "YES" solved the issue immediately, / is now mounted rw. thx to all who pitched in. Michael --=20 Michael Schuster http://recursiveramblings.wordpress.com/ recursion, n: see 'recursion' From owner-freebsd-fs@freebsd.org Sat Dec 5 12:38:59 2020 Return-Path: Delivered-To: freebsd-fs@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 98EDF47A0FE for ; Sat, 5 Dec 2020 12:38:59 +0000 (UTC) (envelope-from tech-lists@zyxst.net) Received: from out3-smtp.messagingengine.com (out3-smtp.messagingengine.com [66.111.4.27]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Cp8Jf3Cf7z3Qtr for ; Sat, 5 Dec 2020 12:38:58 +0000 (UTC) (envelope-from tech-lists@zyxst.net) Received: from compute4.internal (compute4.nyi.internal [10.202.2.44]) by mailout.nyi.internal (Postfix) with ESMTP id A17025C013F for ; Sat, 5 Dec 2020 07:38:57 -0500 (EST) Received: from mailfrontend2 ([10.202.2.163]) by compute4.internal (MEProxy); Sat, 05 Dec 2020 07:38:57 -0500 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=zyxst.net; h= date:from:to:subject:message-id:mime-version:content-type; s= fm1; bh=9J1tuPpNn2dVylofrURVj7dda36SeNoAEu9NY4IhO6A=; b=VSiVd2mG usPB7vqM6esTyVx9vmghU1xmOJ2bMGgPwRZo+kkR5/J+BM7SxshXooT9lQfEfarG hWFhpzgrP3MdbXZzsK/x1Ed512NMFO8x/maYtszh2DiFrouGCA/cnQLGM0bBUEyO o3zHNMfuyDNna9Y1v7HXJCFT++XtJY/1dKmqxlRaXVj1pX5JAlX/bVCtWqtH49Sp krqnBjGRrx+Brf7k00jMkeICChI6ot1JLSMzsRWpa6v6dSZtBiN96la4fP+NyQJL Fkq8zXEJy9VzLKlLebhB9Dvt6aoPrI1kKOoyP5PKcGrhsEXvu99Dq+ZDx191zo2Y aKA1+w/GkUAkOg== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=content-type:date:from:message-id :mime-version:subject:to:x-me-proxy:x-me-proxy:x-me-sender :x-me-sender:x-sasl-enc; s=fm1; bh=9J1tuPpNn2dVylofrURVj7dda36Se NoAEu9NY4IhO6A=; b=o56KnUtO8jeBvwIdOt32dT8nGz3dYFoS64EbqYOz01CkI 0UaEMBLdfOys1GHZsn+FwRa+vn8O2Xo6ABo4IKUlIpGLDBKX1iRdBLIvxB23Aax+ A3wkSnCtra4bhdb1orxZ+uwmjg65i4OJ2b4XF564jm8fX4/7krx5tQhrwByqQJBe Ub+Vn34h68MJaHXsNu6X3oE0R1kgEiqspC4KgFh7qGbJGo+eQg3KF/G0yEVLr09z MpoH+1WlAgB5u3ChQb/W/Td9GxMe1hjZFN1UenD3f+PZ/37ktZWCsf0tp2JTzvcG ikuJ91RmEJBZQoyQxPIr1tYFVhNEDZNMbSje7Yajw== X-ME-Sender: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgedujedrudejtddggeegucetufdoteggodetrfdotf fvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdfqfgfvpdfurfetoffkrfgpnffqhgen uceurghilhhouhhtmecufedttdenucenucfjughrpeffhffvuffkgggtugesghdtreertd dtvdenucfhrhhomhepthgvtghhqdhlihhsthhsuceothgvtghhqdhlihhsthhsseiihiig shhtrdhnvghtqeenucggtffrrghtthgvrhhnpeevgffhffdtfeekleelhedtjeelvdfhvd egieejveffgfduvdfhteegjeeujeeuieenucfkphepkedvrdejtddrledurddutddunecu vehluhhsthgvrhfuihiivgeptdenucfrrghrrghmpehmrghilhhfrhhomhepthgvtghhqd hlihhsthhsseiihiigshhtrdhnvght X-ME-Proxy: Received: from rpi4.local (fws.zyxst.net [82.70.91.101]) by mail.messagingengine.com (Postfix) with ESMTPA id 20F6A1080063 for ; Sat, 5 Dec 2020 07:38:57 -0500 (EST) Date: Sat, 5 Dec 2020 12:38:55 +0000 From: tech-lists To: freebsd-fs@freebsd.org Subject: vdevs with different spindle speeds Message-ID: Mail-Followup-To: freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="1s3KS4sNNxfzCMdE" Content-Disposition: inline X-Rspamd-Queue-Id: 4Cp8Jf3Cf7z3Qtr X-Spamd-Bar: ----- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=zyxst.net header.s=fm1 header.b=VSiVd2mG; dkim=pass header.d=messagingengine.com header.s=fm1 header.b=o56KnUtO; dmarc=none; spf=pass (mx1.freebsd.org: domain of tech-lists@zyxst.net designates 66.111.4.27 as permitted sender) smtp.mailfrom=tech-lists@zyxst.net X-Spamd-Result: default: False [-5.70 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; RWL_MAILSPIKE_GOOD(0.00)[66.111.4.27:from]; R_SPF_ALLOW(-0.20)[+ip4:66.111.4.27]; TO_DN_NONE(0.00)[]; RCVD_COUNT_THREE(0.00)[4]; DKIM_TRACE(0.00)[zyxst.net:+,messagingengine.com:+]; NEURAL_HAM_SHORT(-1.00)[-1.000]; SIGNED_PGP(-2.00)[]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[66.111.4.27:from]; ASN(0.00)[asn:11403, ipnet:66.111.4.0/24, country:US]; MIME_TRACE(0.00)[0:+,1:+,2:~]; RCVD_IN_DNSWL_LOW(-0.10)[66.111.4.27:from]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[zyxst.net:s=fm1,messagingengine.com:s=fm1]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.20)[multipart/signed,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; DMARC_NA(0.00)[zyxst.net]; RCPT_COUNT_ONE(0.00)[1]; SPAMHAUS_ZRD(0.00)[66.111.4.27:from:127.0.2.255]; MAILMAN_DEST(0.00)[freebsd-fs] X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 05 Dec 2020 12:38:59 -0000 --1s3KS4sNNxfzCMdE Content-Type: text/plain; charset=us-ascii; format=flowed Content-Disposition: inline Content-Transfer-Encoding: quoted-printable Hi, = =20 = =20 Normally when making an array, I'd like to use all disks all same speed, = =20 interface, make and model but from different batches. In this case, I've no= =20 choice, so we have multiple 1TB disks some 7.2k some 5.4k. I've not mixed = =20 them like this before. = =20 = =20 What effect would this have on the final array? Slower than if all one or t= he other? =20 No effect? I'm expecting the fastest access will be that of the slowest vde= v. =20 = =20 Similarly some disks block size is 512b logical/512b physical, others are 5= 12b =20 logical/4096 physical, still others are 4096/4096. Any effect of = =20 mixing hardware? I understand zfs sets its own blocksize. = =20 = =20 thanks, = =20 --=20 J. --1s3KS4sNNxfzCMdE Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQIzBAABCAAdFiEE8n3tWhxW11Ccvv9/s8o7QhFzNAUFAl/Lf1UACgkQs8o7QhFz NAW+Yg/+O1LnIJxC23UYx3KrGcc5ifaz2/Cba/4C9QggXw7anNE6Xu/4mqWL+CQa jxZoVHJeYewWeKtBDBXWIpDn4hF3FpDter8VsMAOpbsP7eX1C5JxiBN2aOPFa1J1 ZvJ59hRsaKUBb+MlOV2B0ESqDWcmWi+Y3+gtrYNVfTQEAn9OVyUT31aN2fS0PASr hmjXHHwUSCUhM1sFS0VAgch/wQaJP5YV3YA+/nLyRn6yR8TI9ZA4yF81JA/RLz2/ NuzfTGC4sYNfwoIyq1tI3JWhn5sMN88IVqBKlf4VkyDr8kNAeew2i54ZR1rwLCRT GyL6Uj95xyJuviBeALy6CV3ZCxCqiuNvqlkv0B0P/91jTp3hDLxuOtC2FKd9aWBU K9Muvx38B0nx836NPsXTlTETmAu0rI1EUzT+Hac30Q7CtvfihYOMOHMN8SD1BmZx aiYOEc1q9CvSYcPaJ/fRYdtE2yiFj+sDAsoIOiWHc/R0FXjnfHUefCEG+2csg/JX t4+ObMjgKFR4GOJuNDxrmg3776dp/UiD7/5lRyqleENf1uGtQ3yvTZi6r0TGkbXN 8j8fbJ/G5rjH778Xz+sYuS52luq1GtSFTkX4uo2oGSN5IwYQqiLZXHYArH6BbCbg 1Nb0LRSGbDSKGVBJ8TS6C5y8akUZ/+ud0pML8na9tGimMIvaPEI= =n/qL -----END PGP SIGNATURE----- --1s3KS4sNNxfzCMdE-- From owner-freebsd-fs@freebsd.org Sat Dec 5 13:24:53 2020 Return-Path: Delivered-To: freebsd-fs@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 69FCF47B248 for ; Sat, 5 Dec 2020 13:24:53 +0000 (UTC) (envelope-from list_freebsd@bluerosetech.com) Received: from echo.brtsvcs.net (echo.brtsvcs.net [208.111.40.118]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Cp9Kc41MKz3jMT for ; Sat, 5 Dec 2020 13:24:52 +0000 (UTC) (envelope-from list_freebsd@bluerosetech.com) Received: from chombo.houseloki.net (unknown [IPv6:2602:41:642b:600::6]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "chombo.houseloki.net", Issuer "brtsvcs.net CA" (verified OK)) by echo.brtsvcs.net (Postfix) with ESMTPS id 88F3E38D2A for ; Sat, 5 Dec 2020 13:24:45 +0000 (UTC) Received: from [IPv6:2602:41:642b:630:6179:9c9b:52f6:e0ce] (unknown [IPv6:2602:41:642b:630:6179:9c9b:52f6:e0ce]) by chombo.houseloki.net (Postfix) with ESMTPSA id 7D61F1536 for ; Sat, 5 Dec 2020 05:24:44 -0800 (PST) Subject: Re: vdevs with different spindle speeds To: freebsd-fs@freebsd.org References: From: Mel Pilgrim Message-ID: Date: Sat, 5 Dec 2020 05:24:44 -0800 User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:78.0) Gecko/20100101 Thunderbird/78.5.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=windows-1252; format=flowed Content-Language: en-US Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 4Cp9Kc41MKz3jMT X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of list_freebsd@bluerosetech.com designates 208.111.40.118 as permitted sender) smtp.mailfrom=list_freebsd@bluerosetech.com X-Spamd-Result: default: False [-3.30 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; ARC_NA(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; FROM_HAS_DN(0.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[208.111.40.118:from]; TO_MATCH_ENVRCPT_ALL(0.00)[]; R_SPF_ALLOW(-0.20)[+mx:relay3.brtsvcs.net]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; TO_DN_NONE(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; SPAMHAUS_ZRD(0.00)[208.111.40.118:from:127.0.2.255]; RCVD_COUNT_THREE(0.00)[3]; DMARC_NA(0.00)[bluerosetech.com]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:36236, ipnet:208.111.40.0/24, country:US]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-fs] X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 05 Dec 2020 13:24:53 -0000 On 2020-12-05 4:38, tech-lists wrote: > Normally when making an array, I'd like to use all disks all same speed, > interface, make and model but from different batches. In this case, I've no > choice, so we have multiple 1TB disks some 7.2k some 5.4k. I've not mixed > them like this before. > > What effect would this have on the final array? Slower than if all one or the other? > No effect? I'm expecting the fastest access will be that of the slowest vdev. > > Similarly some disks block size is 512b logical/512b physical, others are 512b > logical/4096 physical, still others are 4096/4096. Any effect of > mixing hardware? I understand zfs sets its own blocksize. Make sure you have ashift=12 for everything and you'll be fine. The marginal increase in latency with the 5400 rpm drives will disappear behind ZFS' heavily-cached, asynchronous operation unless you're hammering the pool with calls for cold data. If you're really worried about it, get a cheap SSD and use it as a cache device. From owner-freebsd-fs@freebsd.org Sat Dec 5 17:22:22 2020 Return-Path: Delivered-To: freebsd-fs@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id AC3BD4A2913 for ; Sat, 5 Dec 2020 17:22:22 +0000 (UTC) (envelope-from spork@bway.net) Received: from smtp1.bway.net (smtp1.bway.net [216.220.96.27]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4CpGbf0jMZz4THN for ; Sat, 5 Dec 2020 17:22:21 +0000 (UTC) (envelope-from spork@bway.net) Received: from gaseousweiner.sporklab.com (pool-74-102-98-114.nwrknj.fios.verizon.net [74.102.98.114]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) (Authenticated sender: spork@bway.net) by smtp1.bway.net (Postfix) with ESMTPSA id 0F8DC95874; Sat, 5 Dec 2020 12:22:20 -0500 (EST) Content-Type: text/plain; charset=utf-8 Mime-Version: 1.0 (Mac OS X Mail 12.4 \(3445.104.17\)) Subject: Re: vdevs with different spindle speeds From: Charles Sprickman In-Reply-To: Date: Sat, 5 Dec 2020 12:22:20 -0500 Cc: freebsd-fs@freebsd.org X-Mao-Original-Outgoing-Id: 628881740.397988-c00dcf199ada2957199f1f0b60afd681 Content-Transfer-Encoding: quoted-printable Message-Id: <56C3DF95-A5F5-4DFB-BD5D-492126D059BB@bway.net> References: To: Mel Pilgrim X-Mailer: Apple Mail (2.3445.104.17) X-Rspamd-Queue-Id: 4CpGbf0jMZz4THN X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.60 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_DN_SOME(0.00)[]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+ip4:216.220.96.27/32]; DKIM_TRACE(0.00)[bway.net:+]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[bway.net,quarantine]; NEURAL_HAM_SHORT(-1.00)[-1.000]; RCVD_IN_DNSWL_LOW(-0.10)[216.220.96.27:from]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RBL_DBL_DONT_QUERY_IPS(0.00)[216.220.96.27:from]; MID_RHS_MATCH_FROM(0.00)[]; DWL_DNSWL_NONE(0.00)[bway.net:dkim]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[bway.net:s=mail]; RECEIVED_SPAMHAUS_PBL(0.00)[74.102.98.114:received]; FROM_HAS_DN(0.00)[]; ASN(0.00)[asn:8059, ipnet:216.220.96.0/19, country:US]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; SPAMHAUS_ZRD(0.00)[216.220.96.27:from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-fs] X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 05 Dec 2020 17:22:22 -0000 > On Dec 5, 2020, at 8:24 AM, Mel Pilgrim = wrote: >=20 > On 2020-12-05 4:38, tech-lists wrote: >> Normally when making an array, I'd like to use all disks all same = speed, >> interface, make and model but from different batches. In this case, = I've no >> choice, so we have multiple 1TB disks some 7.2k some 5.4k. I've not = mixed >> them like this before. >> = What effect = would this have on the final array? Slower than if all one or the other? >> No effect? I'm expecting the fastest access will be that of the = slowest vdev. >> = Similarly some = disks block size is 512b logical/512b physical, others are 512b >> logical/4096 physical, still others are 4096/4096. Any effect of >> mixing hardware? I understand zfs sets its own blocksize. >=20 > Make sure you have ashift=3D12 for everything and you'll be fine. The = marginal increase in latency with the 5400 rpm drives will disappear = behind ZFS' heavily-cached, asynchronous operation unless you're = hammering the pool with calls for cold data. This is interesting, I always considered mixing a =E2=80=9Cno-no=E2=80=9D,= probably due to being told this in the old days of hardware raid with = minimal/dumb caching. I was considering something similar for some cheap servers that are not = terribly critical, but in my case, mixing SSDs. For example, one = standard Samsung EVO and then one of the cheaper Intel datacenter-grade = drives (generally about twice the cost of a standard SSD) in a mirror. I = figured even if I put them in service at the same time, the first = failure should be staggered. But I was not really clear on what affect = this would have or if I=E2=80=99d be confusing zfs with this mix of = drives=E2=80=A6 Any thoughts on this? Charles >=20 > If you're really worried about it, get a cheap SSD and use it as a = cache device. > _______________________________________________ > freebsd-fs@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-fs > To unsubscribe, send any mail to "freebsd-fs-unsubscribe@freebsd.org"