Skip site navigation (1)Skip section navigation (2)
Date:      Sat, 19 Jan 2019 10:39:03 -0600
From:      jdelisle <jdelisle@gmail.com>
To:        freebsd-fs@freebsd.org
Subject:   Re: "zpool remove" failing
Message-ID:  <CAMdBLfRa9FzYNKSdiBnV6=pygr2o1HEHf7N1mCnjGvHo7kfUbA@mail.gmail.com>
In-Reply-To: <CAMdBLfQ%2BASLVTO1ZeE7=QSp_QXWZw8N6ypBsPEvsohwpy4XLSw@mail.gmail.com>
References:  <CAMdBLfQ%2BASLVTO1ZeE7=QSp_QXWZw8N6ypBsPEvsohwpy4XLSw@mail.gmail.com>

next in thread | previous in thread | raw e-mail | index | archive | help
I'm grasping at straws here, but could this functionality be incomplete in
11.2-RELEASE?  Would connecting my disks to a 12.0-RELEASE system help?

It's easy for me to do that, but is it safe to move them to a 12.0-RELEASE
system, run the "zpool remove", then move them back to my 11.2-RELEASE
system?

Is there any diagnostic output I could share that would help?

I'm still confused by the error I'm getting from "zpool remove".. I'm
attempting to remove a top-level mirror vdev, and they're all the same
sector-size.

On Thu, Jan 17, 2019 at 5:34 PM jdelisle <jdelisle@gmail.com> wrote:

> Hello,
>
> I've run into a problem and I'm hoping the knowledgeable folks here can
> help.
>
> I've accidentally added a mirror vdev to a pool, and would like to remove
> it.  Note "mirror-8" in the output down below, it's what I'd like to remove.
>
> When I attempt to remove it, I get the following message:
>
> [root@omega ~]# zpool remove nebula mirror-8
> cannot remove mirror-8: invalid config; all top-level vdevs must have the
> same sector size and not be raidz.
>
> The disks in my pool are all 512 byte sector disks.
>
> Any idea what I'm doing wrong?
>
> ##### My system's uname -a - it's FreeNAS.
> [root@omega ~]# uname -a
> FreeBSD omega.nebula.pw 11.2-STABLE FreeBSD 11.2-STABLE #0
> r325575+fc3d65faae6(HEAD): Thu Dec 20 16:12:30 EST 2018
>  root@nemesis.tn.ixsystems.com:/freenas-releng-final/freenas/_BE/objs/freenas-releng-final/freenas/_BE/os/sys/FreeNAS.amd64
> amd64
>
> ##### The pool I accidentally added a mirror vdev to (mirror-8):
> [root@omega ~]# zpool status -v nebula
>   pool: nebula
>  state: ONLINE
>   scan: none requested
> config:
>
>         NAME                                            STATE     READ
> WRITE CKSUM
>         nebula                                          ONLINE       0
>  0     0
>           mirror-0                                      ONLINE       0
>  0     0
>             gptid/2fdc125f-15f4-11e9-b1b0-000c29f308bf  ONLINE       0
>  0     0
>             gptid/30816c63-15f4-11e9-b1b0-000c29f308bf  ONLINE       0
>  0     0
>           mirror-1                                      ONLINE       0
>  0     0
>             gptid/31403c46-15f4-11e9-b1b0-000c29f308bf  ONLINE       0
>  0     0
>             gptid/31f1f182-15f4-11e9-b1b0-000c29f308bf  ONLINE       0
>  0     0
>           mirror-2                                      ONLINE       0
>  0     0
>             gptid/32a4cfa3-15f4-11e9-b1b0-000c29f308bf  ONLINE       0
>  0     0
>             gptid/3356fcab-15f4-11e9-b1b0-000c29f308bf  ONLINE       0
>  0     0
>           mirror-3                                      ONLINE       0
>  0     0
>             gptid/341311e6-15f4-11e9-b1b0-000c29f308bf  ONLINE       0
>  0     0
>             gptid/34c9952c-15f4-11e9-b1b0-000c29f308bf  ONLINE       0
>  0     0
>           mirror-4                                      ONLINE       0
>  0     0
>             gptid/3580b3ad-15f4-11e9-b1b0-000c29f308bf  ONLINE       0
>  0     0
>             gptid/364188ba-15f4-11e9-b1b0-000c29f308bf  ONLINE       0
>  0     0
>           mirror-5                                      ONLINE       0
>  0     0
>             gptid/370908e5-15f4-11e9-b1b0-000c29f308bf  ONLINE       0
>  0     0
>             gptid/37cf00a5-15f4-11e9-b1b0-000c29f308bf  ONLINE       0
>  0     0
>           mirror-6                                      ONLINE       0
>  0     0
>             gptid/388e6fef-15f4-11e9-b1b0-000c29f308bf  ONLINE       0
>  0     0
>             gptid/3945fee7-15f4-11e9-b1b0-000c29f308bf  ONLINE       0
>  0     0
>           mirror-7                                      ONLINE       0
>  0     0
>             gptid/3a08fb45-15f4-11e9-b1b0-000c29f308bf  ONLINE       0
>  0     0
>             gptid/3ad7a643-15f4-11e9-b1b0-000c29f308bf  ONLINE       0
>  0     0
>           mirror-8                                      ONLINE       0
>  0     0
>             da33p1                                      ONLINE       0
>  0     0
>             da34p1                                      ONLINE       0
>  0     0
>
> errors: No known data errors
> [root@omega ~]#
>
>
> ##### My ZFS features etc.
> [root@omega ~]# zpool get all nebula
> NAME    PROPERTY                       VALUE
> SOURCE
> nebula  size                           21.8T                          -
> nebula  capacity                       64%                            -
> nebula  altroot                        /mnt                           local
> nebula  health                         ONLINE                         -
> nebula  guid                           9027025247116299332
> default
> nebula  version                        -
> default
> nebula  bootfs                         -
> default
> nebula  delegation                     on
>  default
> nebula  autoreplace                    off
> default
> nebula  cachefile                      /data/zfs/zpool.cache          local
> nebula  failmode                       continue                       local
> nebula  listsnapshots                  off
> default
> nebula  autoexpand                     on                             local
> nebula  dedupditto                     0
> default
> nebula  dedupratio                     1.00x                          -
> nebula  free                           7.76T                          -
> nebula  allocated                      14.0T                          -
> nebula  readonly                       off                            -
> nebula  comment                        -
> default
> nebula  expandsize                     -                              -
> nebula  freeing                        0
> default
> nebula  fragmentation                  2%                             -
> nebula  leaked                         0
> default
> nebula  bootsize                       -
> default
> nebula  checkpoint                     -                              -
> nebula  feature@async_destroy          enabled
> local
> nebula  feature@empty_bpobj            active
>  local
> nebula  feature@lz4_compress           active
>  local
> nebula  feature@multi_vdev_crash_dump  enabled
> local
> nebula  feature@spacemap_histogram     active
>  local
> nebula  feature@enabled_txg            active
>  local
> nebula  feature@hole_birth             active
>  local
> nebula  feature@extensible_dataset     enabled
> local
> nebula  feature@embedded_data          active
>  local
> nebula  feature@bookmarks              enabled
> local
> nebula  feature@filesystem_limits      enabled
> local
> nebula  feature@large_blocks           enabled
> local
> nebula  feature@sha512                 enabled
> local
> nebula  feature@skein                  enabled
> local
> nebula  feature@device_removal         enabled
> local
> nebula  feature@obsolete_counts        enabled
> local
> nebula  feature@zpool_checkpoint       enabled
> local
>
> ###### The two disks in the mirrored vdev I wish to remove:
> [root@omega ~]# diskinfo -v /dev/da33
> /dev/da33
>         512             # sectorsize
>         120034123776    # mediasize in bytes (112G)
>         234441648       # mediasize in sectors
>         4096            # stripesize
>         0               # stripeoffset
>         14593           # Cylinders according to firmware.
>         255             # Heads according to firmware.
>         63              # Sectors according to firmware.
>         ATA INTEL SSDSA2CW12    # Disk descr.
>         CVPR1132000R120LGN      # Disk ident.
>         id1,enc@n50050cc1020371ce/type@0/slot@13        # Physical path
>         Yes             # TRIM/UNMAP support
>         0               # Rotation rate in RPM
>         Not_Zoned       # Zone Mode
>
> [root@omega ~]# diskinfo -v /dev/da34
> /dev/da34
>         512             # sectorsize
>         120034123776    # mediasize in bytes (112G)
>         234441648       # mediasize in sectors
>         4096            # stripesize
>         0               # stripeoffset
>         14593           # Cylinders according to firmware.
>         255             # Heads according to firmware.
>         63              # Sectors according to firmware.
>         ATA INTEL SSDSA2CW12    # Disk descr.
>         CVPR119300D5120LGN      # Disk ident.
>         id1,enc@n50050cc1020371ce/type@0/slot@7 # Physical path
>         Yes             # TRIM/UNMAP support
>         0               # Rotation rate in RPM
>         Not_Zoned       # Zone Mode
>
> [root@omega ~]#
>
>
> ##### This is an example of one of the many disks in my mirrored pairs.
> They're all the same make/ model of disk, and are 512 byte sectors just
> like the SSDs above.
> [root@omega ~]# diskinfo -v /dev/da10
> /dev/da10
>         512             # sectorsize
>         3000592982016   # mediasize in bytes (2.7T)
>         5860533168      # mediasize in sectors
>         0               # stripesize
>         0               # stripeoffset
>         364801          # Cylinders according to firmware.
>         255             # Heads according to firmware.
>         63              # Sectors according to firmware.
>         HITACHI HUS72303CLAR3000        # Disk descr.
>         YHJEXGHD                # Disk ident.
>         id1,enc@n50050cc1020371ce/type@0/slot@f # Physical path
>         No              # TRIM/UNMAP support
>         7200            # Rotation rate in RPM
>         Not_Zoned       # Zone Mode
>
> [root@omega ~]#
>



Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?CAMdBLfRa9FzYNKSdiBnV6=pygr2o1HEHf7N1mCnjGvHo7kfUbA>