From owner-freebsd-questions@FreeBSD.ORG Fri Apr 24 21:36:08 2015 Return-Path: Delivered-To: freebsd-questions@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 4DA11AD7 for ; Fri, 24 Apr 2015 21:36:08 +0000 (UTC) Received: from mail-pd0-x230.google.com (mail-pd0-x230.google.com [IPv6:2607:f8b0:400e:c02::230]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 180BE16A4 for ; Fri, 24 Apr 2015 21:36:08 +0000 (UTC) Received: by pdea3 with SMTP id a3so59414271pde.3 for ; Fri, 24 Apr 2015 14:36:07 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=message-id:date:from:user-agent:mime-version:to:cc:subject :references:in-reply-to:content-type; bh=+dYz4rOhfCVAJ6ISug2y4vgtplRcbd6FiqNZrFgQuBc=; b=Vj9u8nBYCpKcWB5h5WQ8iCorYhtwwfRruxYAdlalKMR2oA9CyvS4cLqrrBJdhb2QHx in1wpbBY+xRILkT6AXz4LbcHpC5JhSDHysqe/YbmaZe8B+2L16NM6wj5TpXCLu/Rjrkh s+SafjEyxJ7YwPAMEuo9/rxiZzqWZVbhEWPph6un1gKnI/hgkLzcLmLVGSWz9il9ydBn D5QDpMy80LAXpK8u2T9Y7CDBHZtVza+69p/w/hj/qfEzx+qIX3OfVcGWimuq30vECEju DCDrwkdd+sHJQDbhWHGPJDZpRQ+hcER2udDyys4vOZQdGTkYQaG0pS+S3zLcAOKFgstn ULYg== X-Received: by 10.66.183.47 with SMTP id ej15mr782544pac.34.1429911367567; Fri, 24 Apr 2015 14:36:07 -0700 (PDT) Received: from [192.168.125.221] ([199.96.38.41]) by mx.google.com with ESMTPSA id sf6sm11951761pbb.82.2015.04.24.14.36.05 (version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Fri, 24 Apr 2015 14:36:06 -0700 (PDT) Message-ID: <553AB746.7060104@gmail.com> Date: Fri, 24 Apr 2015 14:36:06 -0700 From: Motty Cruz User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.6.0 MIME-Version: 1.0 To: Ricky G CC: "freebsd-questions@freebsd.org" Subject: Re: ZFS-FreeBSD 10.1 -zpool degraded/5638733535486357169 REMOVED 0 0 0 was /dev/label/z3 References: <553A9860.5000001@gmail.com> , <553A9FDD.80808@gmail.com> In-Reply-To: Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-Content-Filtered-By: Mailman/MimeDel 2.1.20 X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 24 Apr 2015 21:36:08 -0000 Thanks Ricky, yes you're right, I am using : Dual controller (J2600sD) http://www.promise.com/us/Products/Vess/J2000 I have two FreeBSD 10.1 machines connected through SAS LSI card, to the JBOD. Both Servers mount the drivers, however zpool is mounted only on Master machine. I confirm that rebooting slave machine, zpool on the Master machine reports driver "REMOVED" error and zpool goes into degraded mode. to get the zpool back on-line/clear the errors, I had to run "zpool clear tank". however, this can corrupt data once this machine go into production. I have a similar setup but running FreeBSD 8.2, that problem does not exist in FreeBSD 8.2. am posting this information in case someone out there can help me fix this error. Thanks, On 04/24/2015 02:13 PM, Ricky G wrote: > Hey Motty, > Reviewed your hardware and I'm still not quite positive on how the > setup works. From what I understand, this rack has two separate > servers running with two controllers that are connected providing > shared access to the storage. Please correct me if I am mistaken. > Someone else maybe more familiar may give you a better answer. I have > never used nor seen something like this. However, I will still suggest > what I suggested before, do hardware tests and make sure its not > faulty. Swap this z3 drive with another drive and see if its > that particular drive, or that particular port. > > Regards, > Ricky > > ------------------------------------------------------------------------ > Date: Fri, 24 Apr 2015 12:56:13 -0700 > From: motty.cruz@gmail.com > To: ricky1252@hotmail.com > Subject: Re: ZFS-FreeBSD 10.1 -zpool degraded/5638733535486357169 > REMOVED 0 0 0 was /dev/label/z3 > > Hello Ricky, > thank you very much for your reply; > > The JBOD Promise vess j26000SD has two SAS ports, 1 port is plug to > Machine A(master) 2nd port is plug to Machine B(slave). Both Machines > see the drivers, however zpool is only loaded on Machine A(master. > > Also, forgot to mention that if I ran "zpool clear tank" fixes that > issue. I am sure that rebooting the slave machine zpool on Master > machine reports drive was removed. > > any suggestions? > Thanks again, > > > On 04/24/2015 12:48 PM, Ricky G wrote: > > Hey there, > > This isn't really enough information to diagnose anything. What > relation does machine B have with A? is B a jail? is it a DAS or > SAN? are you positive rebooting the other machine that is causing > the drive to drop and the drive/backplane/port? > > Based on the little info provided I suggest moving drive to > another port/backplane and running smart test on the drive > assuming its not an ssd. > > Regards > Ricky > > > Date: Fri, 24 Apr 2015 12:24:16 -0700 > > From: motty.cruz@gmail.com > > To: freebsd-questions@freebsd.org > ; motty.cruz@gmail.com > > > Subject: ZFS-FreeBSD 10.1 -zpool degraded/5638733535486357169 > REMOVED 0 0 0 was /dev/label/z3 > > > > Hello, > > I get the following error: > > 5638733535486357169REMOVED000was /dev/label/z3 > > > > I have two FreeBSD 10.1 64bit machine A (master) and Machine > B(slave) if > > for whatever reason slave machine reboot, Machine A, reports zpool > > degraded and usually same disk (in this case z3) always appear > to be > > "REMOVED". > > > > any ideas? JBOD Promise Vess J2000D Series and LSI Card SAS9200. > > > > Thanks in advance! > > -Motty > > _______________________________________________ > > freebsd-questions@freebsd.org > mailing list > > http://lists.freebsd.org/mailman/listinfo/freebsd-questions > > To unsubscribe, send any mail to > "freebsd-questions-unsubscribe@freebsd.org" > > >