From owner-freebsd-stable@FreeBSD.ORG Mon Aug 3 21:47:47 2009 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id E3D0F106566C for ; Mon, 3 Aug 2009 21:47:47 +0000 (UTC) (envelope-from gabor.radnai@gmail.com) Received: from mail-bw0-f206.google.com (mail-bw0-f206.google.com [209.85.218.206]) by mx1.freebsd.org (Postfix) with ESMTP id 5D0BD8FC16 for ; Mon, 3 Aug 2009 21:47:46 +0000 (UTC) (envelope-from gabor.radnai@gmail.com) Received: by bwz2 with SMTP id 2so2576914bwz.43 for ; Mon, 03 Aug 2009 14:47:46 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:received:from:date:message-id :subject:to:content-type; bh=GMZPATgQImlxcmxXYvMNC9QMi4qn8a7jnG9b1YPpLMc=; b=v/umsIZxcYJL/cgZyyuUqPb9nTkzxxnctJhiYStUy9O5ws6EcJG6nsKNVe1FVCtvrg QmfU3s5ZmIDfzXbbypCTEUF0xCy8VQJuVy8oMQAJs9iJD7jYEVW71uRGAtmYsPjTULPH eDZy9WQTtoPkArPB4O/KdxaJtYoCyzHeOmKl8= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:from:date:message-id:subject:to:content-type; b=pMH21YKGyIzjUnFanREUfIUj1QHAd4iz/e/eDksxfmpQHMe0ieUjDLvpgwtqUFanLw eGXsv1vxFbH11Ob9cCaC2mFzcHeVch3rEQEBUUkuheK02DR+o3M+KY9F6cN3qdkiwctK FFA21faotnHR4BpzZ9H/7howfSNlOFyuVaudw= MIME-Version: 1.0 Received: by 10.223.107.9 with SMTP id z9mr2842740fao.1.1249334730090; Mon, 03 Aug 2009 14:25:30 -0700 (PDT) From: Gabor Radnai Date: Mon, 3 Aug 2009 23:25:15 +0200 Message-ID: To: freebsd-stable@freebsd.org Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Subject: ZFS: drive replacement performance X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 03 Aug 2009 21:47:48 -0000 > On Tue, Jul 7, 2009 at 3:26 PM, Mahlon E. Smith > wrote: *> > On Tue, Jul 07, 2009, Freddie Cash wrote: *> >* > *> >* > This is why we've started using glabel(8) to label our drives, and then *> >* add *> >* > the labels to the pool: *> >* > # zpool create store raidz1 label/disk01 label/disk02 label/disk03 *> >* > *> >* > That way, it does matter where the kernel detects the drives or what the *> >* > physical device node is called, GEOM picks up the label, and ZFS uses the *> >* > label. *> >* *> >* Ah, slick. I'll definitely be doing that moving forward. Wonder if I *> >* could do it piecemeal now via a shell game, labeling and replacing each *> >* individual drive? Will put that on my "try it" list. *> >* * > Yes, this can be done piecemeal, after the fact, on an already configured > pool. That's how I did it on one of our servers. It was originally > configured using the device node names (da0, da1, etc). Then I set up the > second server, but used labels. Then I went back to the first server, > labelled the drives, and did "zpool replace storage da0 label/disk01" for > each drive. Doesn't take long to resilver, as it knows that it's the same > device. It seems a very good practice but how did you do actually on your first already configured server? I am struggling with the followings: 1. on online disk, member of configured raidz pool, "glabel label" fails with error message "operation not permitted". 2. if I make disk offline, glabel succeed, but making disk back to online clears label. 3. if I make disk offline, glabel succeed, but "zpool replace