From nobody Thu May 27 18:36:28 2021 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id C4135C7E97A for ; Thu, 27 May 2021 18:36:40 +0000 (UTC) (envelope-from asomers@gmail.com) Received: from mail-ot1-f54.google.com (mail-ot1-f54.google.com [209.85.210.54]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Frc3X57m0z4fRC for ; Thu, 27 May 2021 18:36:40 +0000 (UTC) (envelope-from asomers@gmail.com) Received: by mail-ot1-f54.google.com with SMTP id h24-20020a9d64180000b029036edcf8f9a6so1147110otl.3 for ; Thu, 27 May 2021 11:36:40 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=xZ5EbjfvLseSQDB1ATWcRscKsr2BZJ5j46sqLYNK1RY=; b=DnKoBhEC9eNeEqLOEoW4T4D8mFbILWpetpFMvatW7Qrjen8yeb11RfjC8IpKSihwTx 1jcAiH1CwPRNYbw0HFgFjJ8gCzUhdVmy/k0ygj7P6KSNhDev4kX+b1yuegJjnrvNXiau bDgI4FUKtMyfTNhJTV+dRM4x/BtEvHmaLn71ElJhzAXDK9CnmJhOaR9mHzB69Knb7iyY v6QxZHRjwbylvI640bDH+rpvzD4pWuxRMg4uzTaLSRWiB2XRIzaQisXh83Igy6NzZfFp Gl93hj2Rjzc0U77anzs73dmwWk9czRa3U0TDpQSZN/Zyl++X5RGzf/lAIueG1LkfO/o1 qPEQ== X-Gm-Message-State: AOAM533yv/uwFOh7JPfhR9htysmJPlfT861RCtWSZnDEAV3HMPzNDR72 jxJ2+vjQWj/F0SwRKfJdLZu+DjCDEim5nlIsHr7CJE2rj+E= X-Google-Smtp-Source: ABdhPJwSbgwunR0QR1IkLLvoP8ru7HdRA4xmY1gw7GP3/wPd8cVlCEx6SPKjvSUySiOrt+zfHCa2W+C4qf+dPSYT830= X-Received: by 2002:a05:6830:3115:: with SMTP id b21mr3691398ots.291.1622140599460; Thu, 27 May 2021 11:36:39 -0700 (PDT) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 References: In-Reply-To: From: Alan Somers Date: Thu, 27 May 2021 12:36:28 -0600 Message-ID: Subject: Re: Upsizing a ZFS filesystem - shift question To: joe mcguckin Cc: freebsd-fs Content-Type: multipart/alternative; boundary="00000000000034e94d05c3540a33" X-Rspamd-Queue-Id: 4Frc3X57m0z4fRC X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[] X-ThisMailContainsUnwantedMimeParts: Y --00000000000034e94d05c3540a33 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable ashift affects how the data is laid out on disk, so you can't change it after the drives have been replaced. And you don't want to use ashift=3D9 for the new drives; their performance will suck. Your best bet is to create a new zpool, then send | receive the data from the old pool. -Alan On Thu, May 27, 2021 at 12:33 PM joe mcguckin wrote: > I have an existing 32TB filesystem (2 X 8T vdevs). I want to upgrade each > of the drives to 16TB. I pulled one drive and tried a =E2=80=98zfs replac= e=E2=80=99 comand, > but zfs replied with some message about new drive > optimal ashift doesn=E2=80=99t match the vdev. It suggested Retrying the > =E2=80=98replace=E2=80=99 command with =E2=80=98zfs replace -o ashift=3DN= =E2=80=99 > > Ok, a little investigation shows the existing filesystem has an ashift of > 9. These are older 2T drives with 512 byte sectors. The newer drives are > 4kn sectors. > > Is ashift settable on a drive by drive basis? Can I temporarily set ashif= t > on a drive until all the drives in a vdev have been replaced? Once all > drives have been replaced, how do I set ashift=3D12 for all the drives in= the > vdev? > > After replacing all the drives, will the additional space magicially > appear or is there an additional command or series of steps? > > Thanks, > > Joe > > Joe McGuckin > ViaNet Communications > > joe@via.net > 650-207-0372 cell > 650-213-1302 office > 650-969-2124 fax > > > > --00000000000034e94d05c3540a33--