From owner-freebsd-current@FreeBSD.ORG Mon Sep 24 04:09:15 2012 Return-Path: Delivered-To: freebsd-current@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id F2375106566B for ; Mon, 24 Sep 2012 04:09:14 +0000 (UTC) (envelope-from fjwcash@gmail.com) Received: from mail-lb0-f182.google.com (mail-lb0-f182.google.com [209.85.217.182]) by mx1.freebsd.org (Postfix) with ESMTP id 298F18FC08 for ; Mon, 24 Sep 2012 04:09:13 +0000 (UTC) Received: by lbbgg13 with SMTP id gg13so7505717lbb.13 for ; Sun, 23 Sep 2012 21:09:12 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=6r+YgU/Jx4Lo28ucGSzvHCJ1UzQBmRsKTnrCR8AaynY=; b=JlKcitgdtBymdM/EPMxcH5VkTNWRosmc4/+SBModkXGjCuMcZSYuSrv6aDoxe3kAWb O8wejIT8tnmygVIOQolmwDRbkZ7Fedj3RYluS41HCydp1JoX5pootAOK9Rt0f/iG6onb KWm4stqTCKylkQW7YODxfv75UbRonOpo36LREFnCWYTYUWHJhLTUB+pCtJLFcDS7ZNYO 8LPAc6oc3ya4AXaYRdIe7fdYQPaMvpzBPTx4XNMPEJSACv05M1cNeIe2LedfoMQXHPCn V3aXnud66vQNJzsZoQrhRFc2tH6JzdXSwC5AyFtuq+uYzkFeJK7wd1uryZXXKscDOMzX 6JPA== MIME-Version: 1.0 Received: by 10.152.103.146 with SMTP id fw18mr9495861lab.30.1348459752515; Sun, 23 Sep 2012 21:09:12 -0700 (PDT) Received: by 10.114.23.230 with HTTP; Sun, 23 Sep 2012 21:09:12 -0700 (PDT) Received: by 10.114.23.230 with HTTP; Sun, 23 Sep 2012 21:09:12 -0700 (PDT) In-Reply-To: <007d01cd9a02$20fd3690$62f7a3b0$@lajni.com> References: <991027C2-2424-4BDD-8183-FD6E37DFF447@lajni.com> <004101cd99c5$16212390$42636ab0$@compufutura.com> <007d01cd9a02$20fd3690$62f7a3b0$@lajni.com> Date: Sun, 23 Sep 2012 21:09:12 -0700 Message-ID: From: Freddie Cash To: "Jose A. Lombera" Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Cc: freebsd-current@freebsd.org Subject: RE: zpool can't bring online disk2 X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 24 Sep 2012 04:09:15 -0000 Sorry, can't help beyond that. I haven't played with HAST since it first hit the tree (back in 7-stable?). On Sep 23, 2012 8:10 PM, "Jose A. Lombera" wrote: > Freddie,**** > > ** ** > > Thanks for your great help, now makes so much sense.**** > > I still have a small problem, and I'm not sure if it is because hastd is > running.**** > > I can't initialize (hastctl create disk2) disk2**** > > ** ** > > This is what I did.**** > > ** ** > > 1.. zpool offline tank /dev/dsk/hast/disk2**** > > 2. zpool status -x**** > > [root@san /usr/home/jose]# zpool status -x**** > > pool: tank**** > > state: DEGRADED**** > > status: One or more devices has been taken offline by the administrator.*= * > ** > > Sufficient replicas exist for the pool to continue functioning in= a > **** > > degraded state.**** > > action: Online the device using 'zpool online' or replace the device with= * > *** > > 'zpool replace'.**** > > scan: scrub repaired 0 in 12h4m with 0 errors on Sun Sep 23 19:14:19 2012= * > *** > > config:**** > > ** ** > > NAME STATE READ WRITE CKSUM**** > > tank DEGRADED 0 0 0**** > > raidz1-0 DEGRADED 0 0 0**** > > hast/disk1 ONLINE 0 0 0**** > > 11919832608590631234 OFFLINE 0 0 0 was > /dev/dsk/hast/disk2**** > > hast/disk3 ONLINE 0 0 0**** > > hast/disk4 ONLINE 0 0 0**** > > hast/disk5 ONLINE 0 0 0**** > > hast/disk6 ONLINE 0 0 0**** > > hast/disk7 ONLINE 0 0 0**** > > hast/disk8 ONLINE 0 0 0**** > > hast/disk9 ONLINE 0 0 0**** > > hast/disk10 ONLINE 0 0 0**** > > ** ** > > errors: No known data errors**** > > ** ** > > 3. removed disk / insert a new one.**** > > 4. initialize**** > > Hastctl role init disk2**** > > [root@san /usr/home/jose]# hastctl status disk2**** > > disk2:**** > > role: init**** > > provname: disk2**** > > localpath: /dev/mfid2**** > > extentsize: 0 (0B)**** > > keepdirty: 0**** > > remoteaddr: san1**** > > replication: fullsync**** > > dirty: 0 (0B)**** > > statistics:**** > > reads: 0**** > > writes: 0**** > > deletes: 0**** > > flushes: 0**** > > activemap updates: 0**** > > [root@san /usr/home/jose]# **** > > [root@san /usr/home/jose]# **** > > [root@san /usr/home/jose]# hastctl create disk2**** > > [ERROR] [disk2] Unable to write metadata: Input/output error.**** > > ** ** > > ** ** > > ** ** > > I don't want to stop hastd since it will shut down the connection to my > san.**** > > ** ** > > Do you have any suggestion?**** > > ** ** > > Thanks**** > > ** ** > > ** ** > > --jose**** > > ** ** > > ** ** > > -----Original Message----- > From: owner-freebsd-current@freebsd.org [mailto: > owner-freebsd-current@freebsd.org] On Behalf Of Freddie Cash > Sent: Sunday, September 23, 2012 6:30 PM > To: compufutura -the computer of the future > Cc: yanegomi@gmail.com; freebsd-current@freebsd.org > Subject: RE: zpool can't bring online disk2 > > ** ** > > Since it's a HAST device, you have to initialise the disk via hastctl. > Once that is done, the /dev/hast/disk2 GEOM device node will be created.*= * > ** > > ** ** > > Then you can 'zpool replace' it.**** > > ** ** > > One step at a time. :) And you've skipped a few.**** > > ** ** > > 1. 'zpool offline' the defective disk**** > > 2. Physically remove the defective disk**** > > 3. Physically insert the new disk**** > > 4. Initialise it as a HAST resource via 'hastctl'**** > > 5. 'zpool replace' it using the /dev/hast node 6. Wait for the pool (and > HAST) to resilver it 7. Carry on as per normal On Sep 23, 2012 2:28 PM, > "compufutura -the computer of the future" < jose@compufutura.com> wrote:*= * > ** > > ** ** > > > Yanegomi,**** > > >** ** > > >** ** > > >** ** > > > I tried that, as you can see below, freebsd doesn=E2=80=99t have cfgadm= **** > > >** ** > > > Utility to un configure the device, according to, **** > > > http://docs.oracle.com/cd/E19253-01/819-5461/gbcet/index.html, I **** > > > looked to ports but there is no utility like that.**** > > >** ** > > >** ** > > >** ** > > > Pardon me, my knowledge is little.**** > > >** ** > > >** ** > > >** ** > > > Can you please type the command I will need, or if I need cfgadm do I *= * > ** > > > have to look for that and install it in my freebsd box?**** > > >** ** > > >** ** > > >** ** > > > Thanks.**** > > >** ** > > >** ** > > >** ** > > >** ** > > >** ** > > > [root@san1 /usr/home/jose]# zpool offline tank hast/disk2**** > > >** ** > > > [root@san1 /usr/home/jose]#**** > > >** ** > > > [root@san1 /usr/home/jose]#**** > > >** ** > > > [root@san1 /usr/home/jose]# zpool status -x**** > > >** ** > > > pool: tank**** > > >** ** > > > state: DEGRADED**** > > >** ** > > > status: One or more devices has been taken offline by the administrator= . > **** > > >** ** > > > Sufficient replicas exist for the pool to continue functioning = * > *** > > > in a**** > > >** ** > > > degraded state.**** > > >** ** > > > action: Online the device using 'zpool online' or replace the device **= * > * > > > with**** > > >** ** > > > 'zpool replace'.**** > > >** ** > > > scan: scrub repaired 0 in 12h4m with 0 errors on Sun Sep 23 19:14:19 **= * > * > > > 2012**** > > >** ** > > > config:**** > > >** ** > > >** ** > > >** ** > > > NAME STATE READ WRITE CKSUM**** > > >** ** > > > tank DEGRADED 0 0 0**** > > >** ** > > > raidz1-0 DEGRADED 0 0 0**** > > >** ** > > > hast/disk1 ONLINE 0 0 0**** > > >** ** > > > 11919832608590631234 OFFLINE 0 0 0 was**** > > > /dev/hast/disk2**** > > >** ** > > > hast/disk3 ONLINE 0 0 0**** > > >** ** > > > hast/disk4 ONLINE 0 0 0**** > > >** ** > > > hast/disk5 ONLINE 0 0 0**** > > >** ** > > > hast/disk6 ONLINE 0 0 0**** > > >** ** > > > hast/disk7 ONLINE 0 0 0**** > > >** ** > > > hast/disk8 ONLINE 0 0 0**** > > >** ** > > > hast/disk9 ONLINE 0 0 0**** > > >** ** > > > hast/disk10 ONLINE 0 0 0**** > > >** ** > > >** ** > > >** ** > > > errors: No known data errors**** > > >** ** > > > [root@san1 /usr/home/jose]#**** > > >** ** > > > [root@san1 /usr/home/jose]# zpool replace tank hast/disk2**** > > >** ** > > > cannot open 'hast/disk2': no such GEOM provider**** > > >** ** > > > must be a full path or shorthand device name**** > > >** ** > > > [root@san1 /usr/home/jose]#**** > > >** ** > > > [root@san1 /usr/home/jose]#**** > > >** ** > > > [root@san1 /usr/home/jose]# cfgadm**** > > >** ** > > > bash: cfgadm: command not found**** > > >** ** > > > [root@san1 /usr/home/jose]#**** > > >** ** > > > [root@san1 /usr/home/jose]#**** > > >** ** > > > [root@san1 /usr/home/jose]#**** > > >** ** > > > [root@san1 /usr/home/jose]#**** > > >** ** > > > [root@san1 /usr/home/jose]#**** > > >** ** > > > [root@san1 /usr/home/jose]#**** > > >** ** > > > [root@san1 /usr/home/jose]#**** > > >** ** > > > [root@san1 /usr/home/jose]#**** > > >** ** > > > [root@san1 /usr/home/jose]#**** > > >** ** > > > [root@san1 /usr/home/jose]#**** > > >** ** > > > [root@san1 /usr/home/jose]#**** > > >** ** > > > [root@san1 /usr/home/jose]#**** > > >** ** > > > [root@san1 /usr/home/jose]#**** > > >** ** > > > [root@san1 /usr/home/jose]#**** > > >** ** > > > [root@san1 /usr/home/jose]#**** > > >** ** > > > [root@san1 /usr/home/jose]#**** > > >** ** > > > [root@san1 /usr/home/jose]#**** > > >** ** > > > [root@san1 /usr/home/jose]#**** > > >** ** > > > [root@san1 /usr/home/jose]#**** > > >** ** > > > [root@san1 /usr/home/jose]#**** > > >** ** > > > [root@san1 /usr/home/jose]#**** > > >** ** > > > [root@san1 /usr/home/jose]#**** > > >** ** > > > [root@san1 /usr/home/jose]#**** > > >** ** > > > [root@san1 /usr/home/jose]#**** > > >** ** > > > [root@san1 /usr/home/jose]# zpool offline tank hast/disk2**** > > >** ** > > > [root@san1 /usr/home/jose]#**** > > >** ** > > > [root@san1 /usr/home/jose]#**** > > >** ** > > > [root@san1 /usr/home/jose]#**** > > >** ** > > > [root@san1 /usr/home/jose]# zpool status -x**** > > >** ** > > > pool: tank**** > > >** ** > > > state: DEGRADED**** > > >** ** > > > status: One or more devices has been taken offline by the administrator= . > **** > > >** ** > > > Sufficient replicas exist for the pool to continue functioning = * > *** > > > in a**** > > >** ** > > > degraded state.**** > > >** ** > > > action: Online the device using 'zpool online' or replace the device **= * > * > > > with**** > > >** ** > > > 'zpool replace'.**** > > >** ** > > > scan: scrub repaired 0 in 12h4m with 0 errors on Sun Sep 23 19:14:19 **= * > * > > > 2012**** > > >** ** > > > config:**** > > >** ** > > >** ** > > >** ** > > > NAME STATE READ WRITE CKSUM**** > > >** ** > > > tank DEGRADED 0 0 0**** > > >** ** > > > raidz1-0 DEGRADED 0 0 0**** > > >** ** > > > hast/disk1 ONLINE 0 0 0**** > > >** ** > > > 11919832608590631234 OFFLINE 0 0 0 was**** > > > /dev/hast/disk2**** > > >** ** > > > hast/disk3 ONLINE 0 0 0**** > > >** ** > > > hast/disk4 ONLINE 0 0 0**** > > >** ** > > > hast/disk5 ONLINE 0 0 0**** > > >** ** > > > hast/disk6 ONLINE 0 0 0**** > > >** ** > > > hast/disk7 ONLINE 0 0 0**** > > >** ** > > > hast/disk8 ONLINE 0 0 0**** > > >** ** > > > hast/disk9 ONLINE 0 0 0**** > > >** ** > > > hast/disk10 ONLINE 0 0 0**** > > >** ** > > >** ** > > >** ** > > > errors: No known data errors**** > > >** ** > > > [root@san1 /usr/home/jose]#**** > > >** ** > > > [root@san1 /usr/home/jose]#**** > > >** ** > > > [root@san1 /usr/home/jose]# zpool online tank hast/disk2**** > > >** ** > > > warning: device 'hast/disk2' onlined, but remains in faulted state**** > > >** ** > > > use 'zpool replace' to replace devices that are no longer present**** > > >** ** > > > [root@san1 /usr/home/jose]#**** > > >** ** > > > [root@san1 /usr/home/jose]# zpool replace tank hast/disk2**** > > >** ** > > > cannot open 'hast/disk2': no such GEOM provider**** > > >** ** > > > must be a full path or shorthand device name**** > > >** ** > > > [root@san1 /usr/home/jose]#**** > > >** ** > > > [root@san1 /usr/home/jose]#**** > > >** ** > > >** ** > > >** ** > > > From: Garrett Cooper **** > > > Date: September 23, 2012 12:25:52 PM PDT**** > > > To: "Jose A. Lombera" **** > > > Cc: freebsd-current@freebsd.org**** > > > Subject: Re: zpool can't bring online disk2**** > > >** ** > > > On Sun, Sep 23, 2012 at 11:23 AM, Jose A. Lombera > wrote:**** > > >** ** > > >** ** > > >** ** > > > Hello! all,**** > > >** ** > > >** ** > > >** ** > > > I hope someone can help me out with this.**** > > >** ** > > >** ** > > >** ** > > > Recently disk2 when bad, I have used**** > > >** ** > > >** ** > > >** ** > > > Zpool offline tank hast/disk2**** > > >** ** > > >** ** > > >** ** > > > To bring the disk offline.**** > > >** ** > > > Then I replaced it.**** > > >** ** > > >** ** > > >** ** > > >** ** > > >** ** > > >** ** > > >** ** > > > And use the command**** > > >** ** > > >** ** > > >** ** > > > Zpool online tank hast/disk2**** > > >** ** > > >** ** > > >** ** > > > But the disk show REMOVE.**** > > >** ** > > >** ** > > >** ** > > >** ** > > >** ** > > >** ** > > >** ** > > >** ** > > >** ** > > >** ** > > >** ** > > > [root@san1 /usr/home/jose]# zpool status -v**** > > >** ** > > > pool: tank**** > > >** ** > > > state: DEGRADED**** > > >** ** > > > status: One or more devices has been removed by the administrator.**** > > >** ** > > >** ** > > >** ** > > > Sufficient replicas exist for the pool to continue functioning *= * > ** > > > in a**** > > >** ** > > > degraded state.**** > > >** ** > > >** ** > > >** ** > > > action: Online the device using 'zpool online' or replace the device **= * > * > > > with**** > > >** ** > > >** ** > > >** ** > > > 'zpool replace'.**** > > >** ** > > >** ** > > >** ** > > > scan: resilvered 2.49M in 0h2m with 0 errors on Sat Sep 22 01:03:13 ***= * > > > 2012**** > > >** ** > > > config:**** > > >** ** > > >** ** > > >** ** > > > NAME STATE READ WRITE CKSUM**** > > >** ** > > >** ** > > >** ** > > > tank DEGRADED 0 0 0**** > > >** ** > > >** ** > > >** ** > > > raidz1-0 DEGRADED 0 0 0**** > > >** ** > > >** ** > > >** ** > > > hast/disk1 ONLINE 0 0 0**** > > >** ** > > >** ** > > >** ** > > > 11919832608590631234 REMOVED 0 0 0 was**** > > >** ** > > > /dev/hast/disk2**** > > >** ** > > >** ** > > >** ** > > > hast/disk3 ONLINE 0 0 0**** > > >** ** > > >** ** > > >** ** > > > hast/disk4 ONLINE 0 0 0**** > > >** ** > > >** ** > > >** ** > > > hast/disk5 ONLINE 0 0 0**** > > >** ** > > >** ** > > >** ** > > > hast/disk6 ONLINE 0 0 0**** > > >** ** > > >** ** > > >** ** > > > hast/disk7 ONLINE 0 0 0**** > > >** ** > > >** ** > > >** ** > > > hast/disk8 ONLINE 0 0 0**** > > >** ** > > >** ** > > >** ** > > > hast/disk9 ONLINE 0 0 0**** > > >** ** > > >** ** > > >** ** > > > hast/disk10 ONLINE 0 0 0**** > > >** ** > > >** ** > > >** ** > > > [root@san1 /usr/home/jose]# zpool online tank hast/disk2**** > > >** ** > > >** ** > > >** ** > > > warning: device 'hast/disk2' onlined, but remains in faulted state**** > > >** ** > > >** ** > > >** ** > > > use 'zpool replace' to replace devices that are no longer present**** > > >** ** > > >** ** > > >** ** > > > [root@san1 /usr/home/jose]#**** > > >** ** > > >** ** > > >** ** > > > I can't bring it back online.**** > > >** ** > > >** ** > > >** ** > > > Can you guys help me out what to do.**** > > >** ** > > >** ** > > >** ** > > > This is a production server and I can't afford to bring the server down= . > **** > > >** ** > > >** ** > > >** ** > > > I have already swap 3 disks and I got the same result.**** > > >** ** > > >** ** > > >** ** > > > Thank you guys in advance.**** > > >** ** > > >** ** > > > You forgot to call zpool replace as the last step in the process of = * > *** > > > replacing your faulted disk:**** > > > http://docs.oracle.com/cd/E19253-01/819-5461/gbcet/index.html .**** > > > Cheers,**** > > > -Garrett**** > > >** ** > > > _______________________________________________**** > > > freebsd-current@freebsd.org mailing list **** > > > http://lists.freebsd.org/mailman/listinfo/freebsd-current**** > > > To unsubscribe, send any mail to " > freebsd-current-unsubscribe@freebsd.org"**** > > >** ** > > _______________________________________________**** > > freebsd-current@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-current**** > > To unsubscribe, send any mail to "freebsd-current-unsubscribe@freebsd.org= " > **** >