From owner-freebsd-fs@FreeBSD.ORG Tue Aug 19 20:16:40 2003 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 6946F16A4BF for ; Tue, 19 Aug 2003 20:16:40 -0700 (PDT) Received: from franky.speednet.com.au (franky.speednet.com.au [203.57.65.5]) by mx1.FreeBSD.org (Postfix) with ESMTP id 5DCA543F93 for ; Tue, 19 Aug 2003 20:16:39 -0700 (PDT) (envelope-from andyf@speednet.com.au) Received: from hewey.af.speednet.com.au (hewey.af.speednet.com.au [203.38.96.242])h7K3GcR0013000 for ; Wed, 20 Aug 2003 13:16:38 +1000 (EST) (envelope-from andyf@speednet.com.au) Received: from hewey.af.speednet.com.au (hewey.af.speednet.com.au [172.22.2.17])h7K3GbHT025077 for ; Wed, 20 Aug 2003 13:16:37 +1000 (EST) (envelope-from andyf@speednet.com.au) Date: Wed, 20 Aug 2003 13:16:37 +1000 (EST) From: Andy Farkas X-X-Sender: andyf@hewey.af.speednet.com.au To: freebsd-fs@freebsd.org In-Reply-To: <20030729075319.R13071-100000@hewey.af.speednet.com.au> Message-ID: <20030820125929.D24805-100000@hewey.af.speednet.com.au> MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII Subject: Re: buffers remaining... X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 20 Aug 2003 03:16:40 -0000 On Tue, 29 Jul 2003, Andy Farkas wrote on -current: > If you boot into single user mode (boot -s), do an fsck (a full fsck, no > options), then halt(8), you will get: > > syncing disks, buffers remaining... 1 1 1 1 1 1 1 1 1 1 > giving up on 1 buffers > > every time. Only happens with clean disks. 100% reproducable. > > I have UFS1 partitions. Been happening for quite a while (since 5.0) Should I worry about this? (sometimes there are 2 buffers remaining) Still happens on latest -current (19 Aug) -- :{ andyf@speednet.com.au Andy Farkas System Administrator Speednet Communications http://www.speednet.com.au/ From owner-freebsd-fs@FreeBSD.ORG Wed Aug 20 08:23:35 2003 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id CB4E016A4BF; Wed, 20 Aug 2003 08:23:35 -0700 (PDT) Received: from mail.westernunion.com (mail.westernunion.com [206.201.224.9]) by mx1.FreeBSD.org (Postfix) with ESMTP id 1B17743FB1; Wed, 20 Aug 2003 08:23:35 -0700 (PDT) (envelope-from PatrickArnoux@WesternUnion.com) To: freebsd-questions@FreeBSD.ORG MIME-Version: 1.0 X-Mailer: Lotus Notes Release 5.0.11 July 24, 2002 Message-ID: From: PatrickArnoux@WesternUnion.com Date: Wed, 20 Aug 2003 11:23:32 -0400 X-MIMETrack: Serialize by Router on SMTP1/WesternUnion(Release 5.0.11 |July 24, 2002) at 08/20/2003 11:17:00 AM, Serialize complete at 08/20/2003 11:17:00 AM X-Mailman-Approved-At: Wed, 20 Aug 2003 16:25:42 -0700 Content-Type: text/plain; charset="us-ascii" X-Content-Filtered-By: Mailman/MimeDel 2.1.1 cc: freebsd-fs@FreeBSD.ORG Subject: Whatever happened to CrossFS ?? X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 20 Aug 2003 15:23:36 -0000 Does any one know the whereabouts of CrossFS ? CrossFS was a port of the FreeBSD VFS to WindowsNT in order to implement an NFS C lient/Server running under ifsMgr. The web site is gone and the domain has lapsed. If any one has the source in their archives, knows the whereabouts of the author, or can point me to where I can further pursue this search, please let me know. Any and All informations is welcome. As I don't subscribe to the list could you please reply at; p.a.t.r.i.ck.a.r.n.o.ux@westernunion.com or pa.r.n.ou.x@adelphia.net Please remove the dots in the names, thank you. I apologize for mangling the addresses above, but I am trying to keep my spam level to a reasonable roar. Patrick Arnoux From owner-freebsd-fs@FreeBSD.ORG Fri Aug 22 07:17:04 2003 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 8353B16A4BF for ; Fri, 22 Aug 2003 07:17:04 -0700 (PDT) Received: from out-mx1.crosswinds.net (out-mx1.crosswinds.net [216.18.117.38]) by mx1.FreeBSD.org (Postfix) with ESMTP id E0EBD43F85 for ; Fri, 22 Aug 2003 07:17:03 -0700 (PDT) (envelope-from tony@crosswinds.net) Received: from admin.crosswinds.net (out-mx1.crosswinds.net [216.18.117.38]) by out-mx1.crosswinds.net (Postfix) with ESMTP id 2A00B2B038 for ; Fri, 22 Aug 2003 10:17:03 -0400 (EDT) Received: by admin.crosswinds.net (Postfix, from userid 1001) id DCB7C3F0B; Fri, 22 Aug 2003 10:17:02 -0400 (EDT) Date: Fri, 22 Aug 2003 10:17:02 -0400 From: Tony Holmes To: freebsd-fs@FreeBSD.ORG Message-ID: <20030822101702.A73928@crosswinds.net> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline User-Agent: Mutt/1.2.5i Subject: RAID 1+0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 22 Aug 2003 14:17:04 -0000 Just a quick question. I've been running a couple servers using vinum's RAID 5. Last night I had 2 of the disks in the RAID set drop dead (the first and last physcial drives) killing all the data on the set. This is not the first time I've lost all my RAID 5 data due to 2 disks dropping in a very short period of time (this is the third time actually). Thank god for backups. I was particularly frustrated because I have been trying to find a software solution to provide RAID 1+0 - striping of mirrored disks. Neither vinum nor ccd seem to support this and it would be *amazing* if they could. In the case of 2 disks dropping, I wouldn't have had any issues. I would have had 1 mirror of each of the mirrored pairs drop leaving the other mirrors up and striped (the first and last disk being the lucky combo in my particular use). In the case of RAID 5 and 0+1 (mirroring of stripes) I am dead in the water with 2 disk failures. Is there any intention of supporting this in any form? (I'm currently running -STABLE). Would RaidFrame help? If I have to move to a h/w controller then I will do it, I'm just getting tired of defying the odds and losing my data and having to restore :) -- Tony Holmes Founder and Senior Systems Architect Crosswinds Internet Communications Inc. From owner-freebsd-fs@FreeBSD.ORG Fri Aug 22 10:02:02 2003 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 5BC3616A4BF for ; Fri, 22 Aug 2003 10:02:02 -0700 (PDT) Received: from out-mx1.crosswinds.net (out-mx1.crosswinds.net [216.18.117.38]) by mx1.FreeBSD.org (Postfix) with ESMTP id B094443FF3 for ; Fri, 22 Aug 2003 10:02:01 -0700 (PDT) (envelope-from tony@crosswinds.net) Received: from admin.crosswinds.net (out-mx1.crosswinds.net [216.18.117.38]) by out-mx1.crosswinds.net (Postfix) with ESMTP id 4ACB62C577; Fri, 22 Aug 2003 13:02:01 -0400 (EDT) Received: by admin.crosswinds.net (Postfix, from userid 1001) id 0CA403F0B; Fri, 22 Aug 2003 13:02:01 -0400 (EDT) Date: Fri, 22 Aug 2003 13:02:00 -0400 From: Tony Holmes To: freebsd-fs@FreeBSD.ORG Message-ID: <20030822130200.B82013@crosswinds.net> References: <20030822101702.A73928@crosswinds.net> <20030822164603.GB45178@cnd.mcgill.ca> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline User-Agent: Mutt/1.2.5i In-Reply-To: <20030822164603.GB45178@cnd.mcgill.ca>; from mat@cnd.mcgill.ca on Fri, Aug 22, 2003 at 12:46:03PM -0400 Subject: Re: RAID 1+0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 22 Aug 2003 17:02:02 -0000 On +Aug 22, Mathew Kanner wrote: > > Hello Tony, > I've just recently trashed a vinum raid10 volume by loosing > two disks. So, yes it is possible in vinum, look for "RAID-10" in the > manual. That's what I would call RAID-0+1 (mirroring stripes). Ie. plex A = 1 + 2 striped plex B = 3 + 4 striped volume = A + B mirrored Dead Drive Chart - if these drives die, how is data? Drive 1 2 3 4 1 OKAY OKAY DEAD DEAD 2 OKAY OKAY DEAD DEAD 3 DEAD OKAY OKAY OKAY 4 DEAD DEAD OKAY OKAY ie. 50% of the cases you can recover (drive 1 and 1 dying is single drive) What I'm looking for is RAID-1+0 (striping mirros) Ie. plex A = 1 + 2 mirrored plex B = 3 + 4 mirrored volume = A + B striped Drive 1 2 3 4 1 OKAY DEAD OKAY OKAY 2 DEAD OKAY OKAY OKAY 3 OKAY OKAY OKAY DEAD 4 OKAY OKAY DEAD OKAY ie. 75% of the cases you can recover For the RAID 1+0 case you require both drives of the same mirror to die to lose your data. Given vinums configuration file, we'd need something like the following that is not supported (just to help you visualize). drive d1 device /dev/da1e drive d2 device /dev/da2e drive d3 device /dev/da3e drive d4 device /dev/da4e volume raid10 setupstate plex org striped 512k subplex org concat sd length 512m drive d1 subplex org concat sd length 512m drive d2 plex org striped 512k subplex org concat sd length 512m drive d3 subplex org concat sd length 512m drive d4 -- Tony Holmes Founder and Senior Systems Architect Crosswinds Internet Communications Inc. From owner-freebsd-fs@FreeBSD.ORG Fri Aug 22 10:04:43 2003 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id D531316A4BF for ; Fri, 22 Aug 2003 10:04:43 -0700 (PDT) Received: from out-mx1.crosswinds.net (out-mx1.crosswinds.net [216.18.117.38]) by mx1.FreeBSD.org (Postfix) with ESMTP id 5118B43FE1 for ; Fri, 22 Aug 2003 10:04:43 -0700 (PDT) (envelope-from tony@crosswinds.net) Received: from admin.crosswinds.net (out-mx1.crosswinds.net [216.18.117.38]) by out-mx1.crosswinds.net (Postfix) with ESMTP id E3F632C577 for ; Fri, 22 Aug 2003 13:04:42 -0400 (EDT) Received: by admin.crosswinds.net (Postfix, from userid 1001) id D13873F0B; Fri, 22 Aug 2003 13:04:42 -0400 (EDT) Date: Fri, 22 Aug 2003 13:04:42 -0400 From: Tony Holmes To: freebsd-fs@FreeBSD.ORG Message-ID: <20030822130442.A83032@crosswinds.net> References: <20030822101702.A73928@crosswinds.net> <20030822164603.GB45178@cnd.mcgill.ca> <20030822130200.B82013@crosswinds.net> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline User-Agent: Mutt/1.2.5i In-Reply-To: <20030822130200.B82013@crosswinds.net>; from tony@crosswinds.net on Fri, Aug 22, 2003 at 01:02:00PM -0400 Subject: Re: RAID 1+0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 22 Aug 2003 17:04:44 -0000 On +Aug 22, Tony Holmes wrote: > That's what I would call RAID-0+1 (mirroring stripes). > > What I'm looking for is RAID-1+0 (striping mirros) Of course it dawns on me I may have the terminology backwards, but you should see what I mean :) -- Tony Holmes Founder and Senior Systems Architect Crosswinds Internet Communications Inc. From owner-freebsd-fs@FreeBSD.ORG Fri Aug 22 10:14:44 2003 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 8AE3016A4BF for ; Fri, 22 Aug 2003 10:14:44 -0700 (PDT) Received: from out-mx1.crosswinds.net (out-mx1.crosswinds.net [216.18.117.38]) by mx1.FreeBSD.org (Postfix) with ESMTP id B2D1243FD7 for ; Fri, 22 Aug 2003 10:14:43 -0700 (PDT) (envelope-from tony@crosswinds.net) Received: from admin.crosswinds.net (out-mx1.crosswinds.net [216.18.117.38]) by out-mx1.crosswinds.net (Postfix) with ESMTP id 512B72B038 for ; Fri, 22 Aug 2003 13:14:43 -0400 (EDT) Received: by admin.crosswinds.net (Postfix, from userid 1001) id 28CAD3F0B; Fri, 22 Aug 2003 13:14:43 -0400 (EDT) Date: Fri, 22 Aug 2003 13:14:43 -0400 From: Tony Holmes To: freebsd-fs@FreeBSD.ORG Message-ID: <20030822131443.A83534@crosswinds.net> References: <20030822101702.A73928@crosswinds.net> <20030822164603.GB45178@cnd.mcgill.ca> <20030822130200.B82013@crosswinds.net> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline User-Agent: Mutt/1.2.5i In-Reply-To: <20030822130200.B82013@crosswinds.net>; from tony@crosswinds.net on Fri, Aug 22, 2003 at 01:02:00PM -0400 Subject: Re: RAID 1+0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 22 Aug 2003 17:14:44 -0000 On +Aug 22, Tony Holmes wrote: > drive d1 device /dev/da1e > drive d2 device /dev/da2e > drive d3 device /dev/da3e > drive d4 device /dev/da4e > volume raid10 setupstate > plex org striped 512k > subplex org concat > sd length 512m drive d1 > subplex org concat > sd length 512m drive d2 > plex org striped 512k > subplex org concat > sd length 512m drive d3 > subplex org concat > sd length 512m drive d4 Definately not my day, I meant more like this drive d1 device /dev/da1e drive d2 device /dev/da2e drive d3 device /dev/da3e drive d4 device /dev/da4e volume raid10 setupstate plex org striped 512k subplex org mirrored sd length 512m drive d1 sd length 512m drive d2 subplex org mirrored sd length 512m drive d3 sd length 512m drive d4 -- Tony Holmes Founder and Senior Systems Architect Crosswinds Internet Communications Inc. From owner-freebsd-fs@FreeBSD.ORG Sat Aug 23 22:38:33 2003 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 65A6316A4BF for ; Sat, 23 Aug 2003 22:38:33 -0700 (PDT) Received: from mail.wolves.k12.mo.us (duey.wolves.k12.mo.us [207.160.214.9]) by mx1.FreeBSD.org (Postfix) with ESMTP id 9A4D143FE9 for ; Sat, 23 Aug 2003 22:38:32 -0700 (PDT) (envelope-from cdillon@wolves.k12.mo.us) Received: from localhost (localhost [127.0.0.1]) by mail.wolves.k12.mo.us (Postfix) with ESMTP id B18611FE32; Sun, 24 Aug 2003 00:38:31 -0500 (CDT) Received: from mail.wolves.k12.mo.us ([127.0.0.1]) by localhost (duey.wolves.k12.mo.us [127.0.0.1]) (amavisd-new, port 10024) with LMTP id 08191-02; Sun, 24 Aug 2003 00:38:21 -0500 (CDT) Received: by mail.wolves.k12.mo.us (Postfix, from userid 1001) id 2F0ED1FE24; Sun, 24 Aug 2003 00:38:21 -0500 (CDT) Received: from localhost (localhost [127.0.0.1]) by mail.wolves.k12.mo.us (Postfix) with ESMTP id 2B8AA1BC6A; Sun, 24 Aug 2003 00:38:21 -0500 (CDT) Date: Sun, 24 Aug 2003 00:38:21 -0500 (CDT) From: Chris Dillon To: Tony Holmes In-Reply-To: <20030822101702.A73928@crosswinds.net> Message-ID: <20030824002334.E7724@duey.wolves.k12.mo.us> References: <20030822101702.A73928@crosswinds.net> MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII X-Virus-Scanned: by amavisd-new at wolves.k12.mo.us cc: freebsd-fs@FreeBSD.ORG Subject: Re: RAID 1+0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 24 Aug 2003 05:38:33 -0000 On Fri, 22 Aug 2003, Tony Holmes wrote: > I've been running a couple servers using vinum's RAID 5. Last night > I had 2 of the disks in the RAID set drop dead (the first and last > physcial drives) killing all the data on the set. This is not the > first time I've lost all my RAID 5 data due to 2 disks dropping in a > very short period of time (this is the third time actually). If this is a SCSI array, and I assume it is, make sure your termination is correct. After troubleshooting somebody's white-box 10-drive external array when it would consistently drop disks and new replacements would again "drop dead" a few days to weeks later, I noticed the vendor didn't properly terminate either of the two LVD busses. I was totally surprised that it worked at all with a half-terminated bus, but I guess LVD is relatively forgiving compared to SE busses when it comes to termination. Once a terminator was put on the end of each bus (the RAID controller was already terminating the other end), a drive hasn't dropped out in several months. -- Chris Dillon - cdillon(at)wolves.k12.mo.us FreeBSD: The fastest and most stable server OS on the planet - Available for IA32, IA64, PC98, Alpha, and UltraSPARC architectures - x86-64, PowerPC, ARM, MIPS, and S/390 under development - http://www.freebsd.org No trees were harmed in the composition of this message, although some electrons were mildly inconvenienced.