Skip site navigation (1)Skip section navigation (2)
Date:      Tue, 12 May 2015 15:58:50 +0200
From:      Kai Gallasch <k@free.de>
To:        freebsd-fs@freebsd.org
Subject:   ZFS RAID 10 capacity expansion and uneven data distribution
Message-ID:  <5552071A.40709@free.de>

next in thread | raw e-mail | index | archive | help
This is an OpenPGP/MIME signed message (RFC 4880 and 3156)
--qtCRT52dH8X4w17M3JFjea7R0G8MGTsqd
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable

Hello list.

What is the preferred way to expand a mirrored or RAID 10 zpool with
additional mirror pairs?

On one server I am currently using a four disk RAID 10 zpool:

	zpool              ONLINE       0     0     0
	  mirror-0         ONLINE       0     0     0
	    gpt/zpool-da2  ONLINE       0     0     0
	    gpt/zpool-da3  ONLINE       0     0     0
	  mirror-1         ONLINE       0     0     0
	    gpt/zpool-da4  ONLINE       0     0     0
	    gpt/zpool-da5  ONLINE       0     0     0

Originally the pool consisted of only one mirror (zpool-da2 and zpool-da3=
)

I then used "zpool add" to add mirror-1 to the pool

Directly afer adding the new mirror I had all old data physically
sitting on the old mirror and no data on the new disks.

So there is much imbalance in the data distribution across the RAID 10.
The effect is now, that the IOPS are not evently distributed about all
devs of the pool and e.g. "gstat -p" when the server is very busy
showed, that the old mirror pair can max out at 100% I/O usage while the
other one is almost idle.

Also: I also noted that the old mirror-pair had a FRAG about 50%, while
the new one only has 3%.

So is it generally not a good idea to expand a mirrored pool or RAID 10
pool with new mirror pairs?

Or by which procedure can the existing data in the pool be evenly
distributed about all devices inside the pool?

Any hint appreciated.

Regards,
Kai.

--=20
PGP-KeyID =3D 0x70654D7C4FB1F588
Der Techniker ist informiert.




--qtCRT52dH8X4w17M3JFjea7R0G8MGTsqd
Content-Type: application/pgp-signature; name="signature.asc"
Content-Description: OpenPGP digital signature
Content-Disposition: attachment; filename="signature.asc"

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1

iQIcBAEBCgAGBQJVUgcaAAoJEHBlTXxPsfWIiMUP/0r48VZDm39vSPQ5l8EtYKqA
eJ+M7qc4Qg7Y/Y3kz378/8TOgJr1TPExQmywVmsFdsS3wBE8N53YRj9NW6ux7tOt
97yOtTUXF8uCGZJvDkTgxh4IVFXHYVut7YrBhD25Z237fJj9QAlauDL5ky1b3Ch7
T/iEMiNbzEs6JA016wePXWQjmwf21XDiCS++KOmeK9lGO7Xr7D/M2fuRQwLo8KzF
T2YRL+DVEAwd5rItTaPBkkp3gbnkCu0uGLr1DEiSGyh28CvuMXS5f/DuIe4b0QtH
7gRnpn36+jIE2CNjMA5C3ET7JtmW8e/ZLgHVRHw92u5nzrsXA/YEsjObxbRxArmZ
m/QsIxpm+cosasLUa9SjpKn5vyW7z1hEezF5SHlckmnkBYT/xKO0t2kAFVh8Xo+Q
7DaGSiLLMQpcZbGwRotwJQI1V9No9fTZNoPGqdnBsx3MCJDpPVH4cNz5iGuNSVJo
IsEiDNiTkSmHNpcQ9euku7+sqRpzqQc3KzGFOrKapYAgXFo/9oFH8AP1Ha9RS6Xb
zvDNIxH9AEOQ9O2ECBUHHWom5UhioHEol42GVWmLT1BAsB3DMh4BUG8gqNoXIcqj
GrOE7scq7hrKpznY0tb7aJrvP3Mv4g9FKhyGRYUIU8z+NxgDg+BKziKLBHKxRZwi
bTu6BXUvCKvwFOatOSJ5
=mb50
-----END PGP SIGNATURE-----

--qtCRT52dH8X4w17M3JFjea7R0G8MGTsqd--



Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?5552071A.40709>