From owner-freebsd-geom@FreeBSD.ORG Tue Jan 24 22:07:17 2006 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id AE7BB16A420 for ; Tue, 24 Jan 2006 22:07:17 +0000 (GMT) (envelope-from sergey.lungu@gmail.com) Received: from uproxy.gmail.com (uproxy.gmail.com [66.249.92.196]) by mx1.FreeBSD.org (Postfix) with ESMTP id 49C5543D68 for ; Tue, 24 Jan 2006 22:07:09 +0000 (GMT) (envelope-from sergey.lungu@gmail.com) Received: by uproxy.gmail.com with SMTP id o2so126481uge for ; Tue, 24 Jan 2006 14:07:08 -0800 (PST) DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=beta; d=gmail.com; h=received:date:from:to:cc:subject:message-id:in-reply-to:references:x-mailer:mime-version:content-type:content-transfer-encoding; b=DAJg5iffY8ByMKLdEB/7mRW89i9YirqN7iJPIZQgBTW9GYWPB/p3EpzcD6W86pXnteJWjeK4vfu1nDeOMUaK6Glf4UmqVp9leeVcv8z+d/T4r9La/UWO7ekBCrz7Z2zD0nV4R3mRLQNi9RBWIUpnGSkUQ/KHDu92gEmEtqdn/is= Received: by 10.66.254.17 with SMTP id b17mr347388ugi; Tue, 24 Jan 2006 14:07:08 -0800 (PST) Received: from ogre.obchaga.org ( [195.225.128.22]) by mx.gmail.com with ESMTP id j3sm5115603ugd.2006.01.24.14.07.07; Tue, 24 Jan 2006 14:07:08 -0800 (PST) Date: Wed, 25 Jan 2006 01:07:04 +0300 From: Sergey Lungu To: Eric Anderson Message-Id: <20060125010704.54736edd.sergey.lungu@gmail.com> In-Reply-To: <43D6A1E9.2070207@centtech.com> References: <20060122192257.273734cf.sergey.lungu@gmail.com> <20060124232443.2e252b87.sergey.lungu@gmail.com> <43D6985A.1030101@centtech.com> <20060125004419.17dd39b1.sergey.lungu@gmail.com> <43D6A1E9.2070207@centtech.com> X-Mailer: Sylpheed version 2.0.4 (GTK+ 2.8.10; i386-portbld-freebsd6.0) Mime-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit Cc: freebsd-geom@freebsd.org Subject: Re: GEOM stripe + concat X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 24 Jan 2006 22:07:17 -0000 On Tue, 24 Jan 2006 15:53:45 -0600 Eric Anderson wrote: > Sergey Lungu wrote: > > On Tue, 24 Jan 2006 15:12:58 -0600 Eric Anderson > > wrote: > > > > > >> Sergey Lungu wrote: > >> > >>> On Sun, 22 Jan 2006 19:22:57 +0300 I wrote: > >>> > >>> > >>> > >>>> Hello, > >>>> > >>>> I have FreeBSD 6.0-RELEASE running on my FTP server. There are > >>>> three disks on that box: two identical 120GB and one 300GB. I am > >>>> using gvinum for stripping between first two disks. I am going to > >>>> give gstripe a try, sine gvinum is too unstable. > >>>> > >>>> > >>> Since nobody has answered my question, possibly it was too silly, > >>> I decided to experiment a bit. I'll answer my questions: > >>> > >>> > >>> > >>>> Am I able to concatenate created stripe with 300GB disk? > >>>> > >>>> > >>> Yes, you can! > >>> > >>> > >>> > >>>> And is it wise at all? > >>>> > >>>> > >>> I have made some simple benchmarking on three different > >>> geometries. Legend: > >>> a * b - stripping between a and b > >>> a + b - concatenation of a and b > >>> ad1 - 120GB disk > >>> ad2 - 120GB disk > >>> ad3 - 300GB disk > >>> > >>> I tried to upload and then download a 700MB movie. Here are my > >>> results: > >>> > >>> ad1 * ad2: > >>> Uploading: 1m8.406s > >>> Downloading: 1m4.656s > >>> > >>> ad1 * ad2 + ad3: > >>> Uploading: 1m4.115s > >>> Downloading: 1m4.962s > >>> > >>> ad1 + ad2 + ad3: > >>> Uploading: 1m4.110s > >>> Downloading: 1m4.971s > >>> > >>> Conclusion: > >>> There is no big difference between all this geometries in FTP > >>> context, or possibly there are some on high load!? > >>> > >>> > >> I'm not sure the details of your tests, since 'upload and then > >> download' doesn't really explain the test, however I'm guessing you > >> were limited by network or the destination rather than the local > >> disk > >> - 1m 4s looks alot like 100mbit to me. > >> > > > > Yes, we have 100mbit network. > > > > > >> You should try one of the many benchmarking tools as a first start > >> (try iozone, or bonnie, etc). > >> > > > > I'm not interested in real disk performance, since this box is used > > only for ftp. Probably I was wrong from the begining and I am > > limited only by the network speed, so software RAID is not the > > right way to boost our ftp server :) > > > > Well, I guess it depends on the files, and the usage. It could be > that you are using much less than 100mbit normally, due to the > transfer of random small files to many clients. I would guess that > if you are not hitting the 100mbit network wall yet, you could > benefit from a stripe of multiple disks, and a larger amount of > available memory. If all the files you are serving are large > (hundreds of megabytes) then you probably won't be disk bound. This server is mostly used to share movies in our hostel, so files are about 700MB or 4GB (DVD images) :) > >> Also, concat won't give you any performance increase, but striping > >> could. You could easily test your 700mb file by doing something > >> like this: > >> > >> dd if=/path/to/700mb-file of=/dev/null bs=1m > >> > > > > I don't think that stripping between two disks can give some > > significant performance boost (I may be wrong, of course), > > especially in ftp context. > > > > Well, stripes can definitely increase disk performance, that's the > whole idea. Otherwise, one wouldn't use it, as it increases risk of > failure (without the use of a parity drive). Unfortunately we don't have enough disks for parity. Does this mean that you suggest to use a+b+c instead? > > I think I'll use a*b+c geometry, but the question is: Will I have > > the same problems with gstripe+gconcat as with gvinum? :) > > I don't think anyone could answer that without information on what > problems you did see with gvinum. We have rather unstable power supply. This is the main problem. One of the disks went down after power jump and now I have to resetconfig (gvinum does not have this one, so this is another inconvenience) and then configure it again after each crash. This is the only sollution I've found. -- Sergey Lungu Return on investments won't.