From owner-freebsd-geom@FreeBSD.ORG Sun Jan 22 07:39:26 2006 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 263AE16A41F for ; Sun, 22 Jan 2006 07:39:26 +0000 (GMT) (envelope-from xride@x12.dk) Received: from swip.net (mailfe08.swip.net [212.247.154.225]) by mx1.FreeBSD.org (Postfix) with ESMTP id 8163D43D45 for ; Sun, 22 Jan 2006 07:39:25 +0000 (GMT) (envelope-from xride@x12.dk) X-T2-Posting-ID: lkM/Dn7LTUP9vUt2XCoVCw== X-Cloudmark-Score: 0.000000 [] Received: from x12.dk ([83.72.97.237] verified) by mailfe08.swip.net (CommuniGate Pro SMTP 5.0.2) with ESMTP id 92087487 for freebsd-geom@freebsd.org; Sun, 22 Jan 2006 08:39:23 +0100 Received: by x12.dk (Postfix, from userid 666) id 543B05083D; Sun, 22 Jan 2006 08:39:23 +0100 (CET) Received: from localhost (localhost [127.0.0.1]) by x12.dk (Postfix) with ESMTP id 4A2AF5083A for ; Sun, 22 Jan 2006 08:39:23 +0100 (CET) Date: Sun, 22 Jan 2006 08:39:23 +0100 (CET) From: Soeren Straarup To: freebsd-geom@freebsd.org Message-ID: <20060122081830.M49688@x12.dk> MIME-Version: 1.0 Content-Type: MULTIPART/MIXED; BOUNDARY="0-872256273-1137915563=:49688" Subject: Geom version/generation sysctl X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 22 Jan 2006 07:39:26 -0000 This message is in MIME format. The first part should be readable text, while the remaining parts are likely unreadable without MIME-aware tools. --0-872256273-1137915563=:49688 Content-Type: TEXT/PLAIN; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: QUOTED-PRINTABLE Hi I'm looking for a way to have a version/generation sysctl value. one way i could do this is: sysct -b kern.geom.confxml > file_a sleep for some time sysct -b kern.geom.confxml > file_b diff file_a file_b | wc -l If the last line is zero then do nothing. And then repeat it. What i'm looking for a cheap way to get around this, with a version/ generation number that i test on. Would something like that be hard to implement? vbr S=F8ren Soeren Straarup | aka OZ2DAK aka Xride FreeBSD wannabe | FreeBSD since 2.2.6-R Incorrect documentation is often worse than no documentation. - Bertrand Meyer --0-872256273-1137915563=:49688-- From owner-freebsd-geom@FreeBSD.ORG Sun Jan 22 16:29:31 2006 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id C23A616A41F for ; Sun, 22 Jan 2006 16:29:31 +0000 (GMT) (envelope-from sergey.lungu@gmail.com) Received: from uproxy.gmail.com (uproxy.gmail.com [66.249.92.202]) by mx1.FreeBSD.org (Postfix) with ESMTP id 2BB8F43D45 for ; Sun, 22 Jan 2006 16:29:30 +0000 (GMT) (envelope-from sergey.lungu@gmail.com) Received: by uproxy.gmail.com with SMTP id o2so579023uge for ; Sun, 22 Jan 2006 08:29:30 -0800 (PST) DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=beta; d=gmail.com; h=received:date:from:to:subject:message-id:x-mailer:x-operating-system:mime-version:content-type:content-transfer-encoding; b=GYBVJtF60fBvJrSsxH4jxYII9CvjI0I+lDt8YwsfWsSySmrpFbonp9EWE119GPJG7Vt+YZOvE1V4Cs5oRRvkX0H6FtOT8n/IJGeT6PFTMtr3p2RCIWJlTCXpCiYusF2mYLXiWU/KGdZpBSg8GwMuXvRXj1266A1M/Rd8BnaEsBI= Received: by 10.66.252.4 with SMTP id z4mr1848114ugh; Sun, 22 Jan 2006 08:23:01 -0800 (PST) Received: from ogre.obchaga.org ( [195.225.128.22]) by mx.gmail.com with ESMTP id a1sm3348286ugf.2006.01.22.08.22.59; Sun, 22 Jan 2006 08:23:00 -0800 (PST) Date: Sun, 22 Jan 2006 19:22:57 +0300 From: Sergey Lungu To: freebsd-geom@freebsd.org Message-Id: <20060122192257.273734cf.sergey.lungu@gmail.com> X-Mailer: Sylpheed version 2.0.4 (GTK+ 2.8.10; i386-portbld-freebsd6.0) X-Operating-System: FreeBSD 6-STABLE Mime-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit Subject: GEOM stripe + concat X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 22 Jan 2006 16:29:31 -0000 Hello, I have FreeBSD 6.0-RELEASE running on my FTP server. There are three disks on that box: two identical 120GB and one 300GB. I am using gvinum for stripping between first two disks. I am going to give gstripe a try, sine gvinum is too unstable. So, the questin is: Am I able to concatenate created stripe with 300GB disk? And is it wise at all? -- Sergey Lungu Real programmers do not read books like "effective listening" and "communication skills". From owner-freebsd-geom@FreeBSD.ORG Mon Jan 23 11:02:34 2006 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 07CB616A41F for ; Mon, 23 Jan 2006 11:02:34 +0000 (GMT) (envelope-from owner-bugmaster@freebsd.org) Received: from freefall.freebsd.org (freefall.freebsd.org [216.136.204.21]) by mx1.FreeBSD.org (Postfix) with ESMTP id 2FE6F43D5A for ; Mon, 23 Jan 2006 11:02:24 +0000 (GMT) (envelope-from owner-bugmaster@freebsd.org) Received: from freefall.freebsd.org (peter@localhost [127.0.0.1]) by freefall.freebsd.org (8.13.4/8.13.4) with ESMTP id k0NB2No8086222 for ; Mon, 23 Jan 2006 11:02:23 GMT (envelope-from owner-bugmaster@freebsd.org) Received: (from peter@localhost) by freefall.freebsd.org (8.13.4/8.13.4/Submit) id k0NB2Miw086215 for freebsd-geom@freebsd.org; Mon, 23 Jan 2006 11:02:22 GMT (envelope-from owner-bugmaster@freebsd.org) Date: Mon, 23 Jan 2006 11:02:22 GMT Message-Id: <200601231102.k0NB2Miw086215@freefall.freebsd.org> X-Authentication-Warning: freefall.freebsd.org: peter set sender to owner-bugmaster@freebsd.org using -f From: FreeBSD bugmaster To: freebsd-geom@FreeBSD.org Cc: Subject: Current problem reports assigned to you X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 23 Jan 2006 11:02:34 -0000 Current FreeBSD problem reports Critical problems Serious problems S Submitted Tracker Resp. Description ------------------------------------------------------------------------------- o [2005/01/21] kern/76538 geom [gbde] nfs-write on gbde partition stalls o [2005/08/04] kern/84556 geom [geom] GBDE-encrypted swap causes panic a o [2005/10/16] kern/87544 geom [gbde] mmaping large files on a gbde file o [2005/11/16] kern/89102 geom [geom_vfs] [panic] panic when forced unmo o [2005/12/08] bin/90093 geom fdisk(8) incapable of altering in-core ge o [2005/12/18] kern/90582 geom [geom_mirror] [panic] Restore cause panic 6 problems total. Non-critical problems S Submitted Tracker Resp. Description ------------------------------------------------------------------------------- o [2005/02/26] bin/78131 geom gbde "destroy" not working. o [2005/03/26] kern/79251 geom [2TB] newfs fails on 2.6TB gbde device 2 problems total. From owner-freebsd-geom@FreeBSD.ORG Tue Jan 24 20:24:53 2006 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 8143516A420 for ; Tue, 24 Jan 2006 20:24:53 +0000 (GMT) (envelope-from sergey.lungu@gmail.com) Received: from uproxy.gmail.com (uproxy.gmail.com [66.249.92.192]) by mx1.FreeBSD.org (Postfix) with ESMTP id 32C5C43D60 for ; Tue, 24 Jan 2006 20:24:51 +0000 (GMT) (envelope-from sergey.lungu@gmail.com) Received: by uproxy.gmail.com with SMTP id j3so94820ugf for ; Tue, 24 Jan 2006 12:24:50 -0800 (PST) DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=beta; d=gmail.com; h=received:date:from:to:subject:message-id:in-reply-to:references:x-mailer:mime-version:content-type:content-transfer-encoding; b=aSBFlE2n58nJLUMLBps7wzD2sIgQEZybMHytFs5LuxUqPxcZQ9G7tvbBs45hFz6BL+QDIjrztbyNWqD0wNLmuQ7BeA8fUGERt/TMYTSwvEOVeLHYRR0UrknX+R5Eu7MrO6cBN3RSTv6/D1XgsfxfYDwlcqSb6zvwwSRbOxNaNn0= Received: by 10.66.234.14 with SMTP id g14mr3104555ugh; Tue, 24 Jan 2006 12:24:50 -0800 (PST) Received: from ogre.obchaga.org ( [195.225.128.22]) by mx.gmail.com with ESMTP id j1sm3656471ugf.2006.01.24.12.24.48; Tue, 24 Jan 2006 12:24:49 -0800 (PST) Date: Tue, 24 Jan 2006 23:24:43 +0300 From: Sergey Lungu To: freebsd-geom@freebsd.org Message-Id: <20060124232443.2e252b87.sergey.lungu@gmail.com> In-Reply-To: <20060122192257.273734cf.sergey.lungu@gmail.com> References: <20060122192257.273734cf.sergey.lungu@gmail.com> X-Mailer: Sylpheed version 2.0.4 (GTK+ 2.8.10; i386-portbld-freebsd6.0) Mime-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit Subject: Re: GEOM stripe + concat X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 24 Jan 2006 20:24:53 -0000 On Sun, 22 Jan 2006 19:22:57 +0300 I wrote: > Hello, > > I have FreeBSD 6.0-RELEASE running on my FTP server. There are three > disks on that box: two identical 120GB and one 300GB. I am using > gvinum for stripping between first two disks. I am going to give > gstripe a try, sine gvinum is too unstable. Since nobody has answered my question, possibly it was too silly, I decided to experiment a bit. I'll answer my questions: > Am I able to concatenate created stripe with 300GB disk? Yes, you can! > And is it wise at all? I have made some simple benchmarking on three different geometries. Legend: a * b - stripping between a and b a + b - concatenation of a and b ad1 - 120GB disk ad2 - 120GB disk ad3 - 300GB disk I tried to upload and then download a 700MB movie. Here are my results: ad1 * ad2: Uploading: 1m8.406s Downloading: 1m4.656s ad1 * ad2 + ad3: Uploading: 1m4.115s Downloading: 1m4.962s ad1 + ad2 + ad3: Uploading: 1m4.110s Downloading: 1m4.971s Conclusion: There is no big difference between all this geometries in FTP context, or possibly there are some on high load!? -- Sergey Lungu Fuzzy project objectives are used to avoid the embarrassment of estimating the corresponding costs. From owner-freebsd-geom@FreeBSD.ORG Tue Jan 24 21:13:01 2006 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 3912216A46A for ; Tue, 24 Jan 2006 21:13:01 +0000 (GMT) (envelope-from anderson@centtech.com) Received: from mh1.centtech.com (moat3.centtech.com [207.200.51.50]) by mx1.FreeBSD.org (Postfix) with ESMTP id AE47743D45 for ; Tue, 24 Jan 2006 21:13:00 +0000 (GMT) (envelope-from anderson@centtech.com) Received: from [10.177.171.220] (neutrino.centtech.com [10.177.171.220]) by mh1.centtech.com (8.13.1/8.13.1) with ESMTP id k0OLCxEh071129; Tue, 24 Jan 2006 15:12:59 -0600 (CST) (envelope-from anderson@centtech.com) Message-ID: <43D6985A.1030101@centtech.com> Date: Tue, 24 Jan 2006 15:12:58 -0600 From: Eric Anderson User-Agent: Thunderbird 1.5 (X11/20060112) MIME-Version: 1.0 To: Sergey Lungu References: <20060122192257.273734cf.sergey.lungu@gmail.com> <20060124232443.2e252b87.sergey.lungu@gmail.com> In-Reply-To: <20060124232443.2e252b87.sergey.lungu@gmail.com> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Virus-Scanned: ClamAV 0.87.1/1248/Tue Jan 24 04:54:38 2006 on mh1.centtech.com X-Virus-Status: Clean Cc: freebsd-geom@freebsd.org Subject: Re: GEOM stripe + concat X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 24 Jan 2006 21:13:02 -0000 Sergey Lungu wrote: > On Sun, 22 Jan 2006 19:22:57 +0300 I wrote: > > >> Hello, >> >> I have FreeBSD 6.0-RELEASE running on my FTP server. There are three >> disks on that box: two identical 120GB and one 300GB. I am using >> gvinum for stripping between first two disks. I am going to give >> gstripe a try, sine gvinum is too unstable. >> > > Since nobody has answered my question, possibly it was too silly, I > decided to experiment a bit. I'll answer my questions: > > >> Am I able to concatenate created stripe with 300GB disk? >> > > Yes, you can! > > >> And is it wise at all? >> > > I have made some simple benchmarking on three different geometries. > Legend: > a * b - stripping between a and b > a + b - concatenation of a and b > ad1 - 120GB disk > ad2 - 120GB disk > ad3 - 300GB disk > > I tried to upload and then download a 700MB movie. Here are my results: > > ad1 * ad2: > Uploading: 1m8.406s > Downloading: 1m4.656s > > ad1 * ad2 + ad3: > Uploading: 1m4.115s > Downloading: 1m4.962s > > ad1 + ad2 + ad3: > Uploading: 1m4.110s > Downloading: 1m4.971s > > Conclusion: > There is no big difference between all this geometries in FTP context, > or possibly there are some on high load!? > I'm not sure the details of your tests, since 'upload and then download' doesn't really explain the test, however I'm guessing you were limited by network or the destination rather than the local disk - 1m 4s looks alot like 100mbit to me. You should try one of the many benchmarking tools as a first start (try iozone, or bonnie, etc). Also, concat won't give you any performance increase, but striping could. You could easily test your 700mb file by doing something like this: dd if=/path/to/700mb-file of=/dev/null bs=1m Eric -- ------------------------------------------------------------------------ Eric Anderson Sr. Systems Administrator Centaur Technology Anything that works is better than anything that doesn't. ------------------------------------------------------------------------ From owner-freebsd-geom@FreeBSD.ORG Tue Jan 24 21:44:59 2006 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 26C1516A422 for ; Tue, 24 Jan 2006 21:44:59 +0000 (GMT) (envelope-from sergey.lungu@gmail.com) Received: from uproxy.gmail.com (uproxy.gmail.com [66.249.92.193]) by mx1.FreeBSD.org (Postfix) with ESMTP id 3038843D6D for ; Tue, 24 Jan 2006 21:44:26 +0000 (GMT) (envelope-from sergey.lungu@gmail.com) Received: by uproxy.gmail.com with SMTP id o2so116968uge for ; Tue, 24 Jan 2006 13:44:25 -0800 (PST) DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=beta; d=gmail.com; h=received:date:from:to:cc:subject:message-id:in-reply-to:references:x-mailer:mime-version:content-type:content-transfer-encoding; b=rfgXSngjVOjVK4Hrxxs1InLkowB5cz+FZDOVGp+phbItrPDvqSU/sMVXefLfHuYVChuZBbr8UjOJX//EI1NzzsEv8axYgGSJHRL3/Ipe4yn0cnGc6YZLr12EQD1eU3NAmF48J8md5H3ARA9tTaqBjdOwep92qG8PbVYXa2ZRvUA= Received: by 10.67.26.13 with SMTP id d13mr3164155ugj; Tue, 24 Jan 2006 13:44:25 -0800 (PST) Received: from ogre.obchaga.org ( [195.225.128.22]) by mx.gmail.com with ESMTP id q40sm2424197ugc.2006.01.24.13.44.23; Tue, 24 Jan 2006 13:44:24 -0800 (PST) Date: Wed, 25 Jan 2006 00:44:19 +0300 From: Sergey Lungu To: Eric Anderson Message-Id: <20060125004419.17dd39b1.sergey.lungu@gmail.com> In-Reply-To: <43D6985A.1030101@centtech.com> References: <20060122192257.273734cf.sergey.lungu@gmail.com> <20060124232443.2e252b87.sergey.lungu@gmail.com> <43D6985A.1030101@centtech.com> X-Mailer: Sylpheed version 2.0.4 (GTK+ 2.8.10; i386-portbld-freebsd6.0) Mime-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit Cc: freebsd-geom@freebsd.org Subject: Re: GEOM stripe + concat X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 24 Jan 2006 21:44:59 -0000 On Tue, 24 Jan 2006 15:12:58 -0600 Eric Anderson wrote: > Sergey Lungu wrote: > > On Sun, 22 Jan 2006 19:22:57 +0300 I wrote: > > > > > >> Hello, > >> > >> I have FreeBSD 6.0-RELEASE running on my FTP server. There are > >> three disks on that box: two identical 120GB and one 300GB. I am > >> using gvinum for stripping between first two disks. I am going to > >> give gstripe a try, sine gvinum is too unstable. > >> > > > > Since nobody has answered my question, possibly it was too silly, I > > decided to experiment a bit. I'll answer my questions: > > > > > >> Am I able to concatenate created stripe with 300GB disk? > >> > > > > Yes, you can! > > > > > >> And is it wise at all? > >> > > > > I have made some simple benchmarking on three different geometries. > > Legend: > > a * b - stripping between a and b > > a + b - concatenation of a and b > > ad1 - 120GB disk > > ad2 - 120GB disk > > ad3 - 300GB disk > > > > I tried to upload and then download a 700MB movie. Here are my > > results: > > > > ad1 * ad2: > > Uploading: 1m8.406s > > Downloading: 1m4.656s > > > > ad1 * ad2 + ad3: > > Uploading: 1m4.115s > > Downloading: 1m4.962s > > > > ad1 + ad2 + ad3: > > Uploading: 1m4.110s > > Downloading: 1m4.971s > > > > Conclusion: > > There is no big difference between all this geometries in FTP > > context, or possibly there are some on high load!? > > > > I'm not sure the details of your tests, since 'upload and then > download' doesn't really explain the test, however I'm guessing you > were limited by network or the destination rather than the local disk > - 1m 4s looks alot like 100mbit to me. Yes, we have 100mbit network. > You should try one of the many benchmarking tools as a first start > (try iozone, or bonnie, etc). I'm not interested in real disk performance, since this box is used only for ftp. Probably I was wrong from the begining and I am limited only by the network speed, so software RAID is not the right way to boost our ftp server :) > Also, concat won't give you any performance increase, but striping > could. You could easily test your 700mb file by doing something like > this: > > dd if=/path/to/700mb-file of=/dev/null bs=1m I don't think that stripping between two disks can give some significant performance boost (I may be wrong, of course), especially in ftp context. I think I'll use a*b+c geometry, but the question is: Will I have the same problems with gstripe+gconcat as with gvinum? :) Thanks for the answer. -- Sergey Lungu The deficiency will never show itself during the test runs. From owner-freebsd-geom@FreeBSD.ORG Tue Jan 24 21:53:51 2006 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id D3CBD16A420 for ; Tue, 24 Jan 2006 21:53:51 +0000 (GMT) (envelope-from anderson@centtech.com) Received: from mh2.centtech.com (moat3.centtech.com [207.200.51.50]) by mx1.FreeBSD.org (Postfix) with ESMTP id B907A43D72 for ; Tue, 24 Jan 2006 21:53:47 +0000 (GMT) (envelope-from anderson@centtech.com) Received: from [10.177.171.220] (neutrino.centtech.com [10.177.171.220]) by mh2.centtech.com (8.13.1/8.13.1) with ESMTP id k0OLrkM1086568; Tue, 24 Jan 2006 15:53:47 -0600 (CST) (envelope-from anderson@centtech.com) Message-ID: <43D6A1E9.2070207@centtech.com> Date: Tue, 24 Jan 2006 15:53:45 -0600 From: Eric Anderson User-Agent: Thunderbird 1.5 (X11/20060112) MIME-Version: 1.0 To: Sergey Lungu References: <20060122192257.273734cf.sergey.lungu@gmail.com> <20060124232443.2e252b87.sergey.lungu@gmail.com> <43D6985A.1030101@centtech.com> <20060125004419.17dd39b1.sergey.lungu@gmail.com> In-Reply-To: <20060125004419.17dd39b1.sergey.lungu@gmail.com> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Virus-Scanned: ClamAV 0.87.1/1248/Tue Jan 24 04:54:38 2006 on mh2.centtech.com X-Virus-Status: Clean Cc: freebsd-geom@freebsd.org Subject: Re: GEOM stripe + concat X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 24 Jan 2006 21:53:52 -0000 Sergey Lungu wrote: > On Tue, 24 Jan 2006 15:12:58 -0600 Eric Anderson > wrote: > > >> Sergey Lungu wrote: >> >>> On Sun, 22 Jan 2006 19:22:57 +0300 I wrote: >>> >>> >>> >>>> Hello, >>>> >>>> I have FreeBSD 6.0-RELEASE running on my FTP server. There are >>>> three disks on that box: two identical 120GB and one 300GB. I am >>>> using gvinum for stripping between first two disks. I am going to >>>> give gstripe a try, sine gvinum is too unstable. >>>> >>>> >>> Since nobody has answered my question, possibly it was too silly, I >>> decided to experiment a bit. I'll answer my questions: >>> >>> >>> >>>> Am I able to concatenate created stripe with 300GB disk? >>>> >>>> >>> Yes, you can! >>> >>> >>> >>>> And is it wise at all? >>>> >>>> >>> I have made some simple benchmarking on three different geometries. >>> Legend: >>> a * b - stripping between a and b >>> a + b - concatenation of a and b >>> ad1 - 120GB disk >>> ad2 - 120GB disk >>> ad3 - 300GB disk >>> >>> I tried to upload and then download a 700MB movie. Here are my >>> results: >>> >>> ad1 * ad2: >>> Uploading: 1m8.406s >>> Downloading: 1m4.656s >>> >>> ad1 * ad2 + ad3: >>> Uploading: 1m4.115s >>> Downloading: 1m4.962s >>> >>> ad1 + ad2 + ad3: >>> Uploading: 1m4.110s >>> Downloading: 1m4.971s >>> >>> Conclusion: >>> There is no big difference between all this geometries in FTP >>> context, or possibly there are some on high load!? >>> >>> >> I'm not sure the details of your tests, since 'upload and then >> download' doesn't really explain the test, however I'm guessing you >> were limited by network or the destination rather than the local disk >> - 1m 4s looks alot like 100mbit to me. >> > > Yes, we have 100mbit network. > > >> You should try one of the many benchmarking tools as a first start >> (try iozone, or bonnie, etc). >> > > I'm not interested in real disk performance, since this box is used > only for ftp. Probably I was wrong from the begining and I am limited > only by the network speed, so software RAID is not the right way to > boost our ftp server :) > Well, I guess it depends on the files, and the usage. It could be that you are using much less than 100mbit normally, due to the transfer of random small files to many clients. I would guess that if you are not hitting the 100mbit network wall yet, you could benefit from a stripe of multiple disks, and a larger amount of available memory. If all the files you are serving are large (hundreds of megabytes) then you probably won't be disk bound. >> Also, concat won't give you any performance increase, but striping >> could. You could easily test your 700mb file by doing something like >> this: >> >> dd if=/path/to/700mb-file of=/dev/null bs=1m >> > > I don't think that stripping between two disks can give some > significant performance boost (I may be wrong, of course), especially > in ftp context. > Well, stripes can definitely increase disk performance, that's the whole idea. Otherwise, one wouldn't use it, as it increases risk of failure (without the use of a parity drive). > I think I'll use a*b+c geometry, but the question is: Will I have the > same problems with gstripe+gconcat as with gvinum? :) I don't think anyone could answer that without information on what problems you did see with gvinum. Eric -- ------------------------------------------------------------------------ Eric Anderson Sr. Systems Administrator Centaur Technology Anything that works is better than anything that doesn't. ------------------------------------------------------------------------ From owner-freebsd-geom@FreeBSD.ORG Tue Jan 24 22:07:17 2006 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id AE7BB16A420 for ; Tue, 24 Jan 2006 22:07:17 +0000 (GMT) (envelope-from sergey.lungu@gmail.com) Received: from uproxy.gmail.com (uproxy.gmail.com [66.249.92.196]) by mx1.FreeBSD.org (Postfix) with ESMTP id 49C5543D68 for ; Tue, 24 Jan 2006 22:07:09 +0000 (GMT) (envelope-from sergey.lungu@gmail.com) Received: by uproxy.gmail.com with SMTP id o2so126481uge for ; Tue, 24 Jan 2006 14:07:08 -0800 (PST) DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=beta; d=gmail.com; h=received:date:from:to:cc:subject:message-id:in-reply-to:references:x-mailer:mime-version:content-type:content-transfer-encoding; b=DAJg5iffY8ByMKLdEB/7mRW89i9YirqN7iJPIZQgBTW9GYWPB/p3EpzcD6W86pXnteJWjeK4vfu1nDeOMUaK6Glf4UmqVp9leeVcv8z+d/T4r9La/UWO7ekBCrz7Z2zD0nV4R3mRLQNi9RBWIUpnGSkUQ/KHDu92gEmEtqdn/is= Received: by 10.66.254.17 with SMTP id b17mr347388ugi; Tue, 24 Jan 2006 14:07:08 -0800 (PST) Received: from ogre.obchaga.org ( [195.225.128.22]) by mx.gmail.com with ESMTP id j3sm5115603ugd.2006.01.24.14.07.07; Tue, 24 Jan 2006 14:07:08 -0800 (PST) Date: Wed, 25 Jan 2006 01:07:04 +0300 From: Sergey Lungu To: Eric Anderson Message-Id: <20060125010704.54736edd.sergey.lungu@gmail.com> In-Reply-To: <43D6A1E9.2070207@centtech.com> References: <20060122192257.273734cf.sergey.lungu@gmail.com> <20060124232443.2e252b87.sergey.lungu@gmail.com> <43D6985A.1030101@centtech.com> <20060125004419.17dd39b1.sergey.lungu@gmail.com> <43D6A1E9.2070207@centtech.com> X-Mailer: Sylpheed version 2.0.4 (GTK+ 2.8.10; i386-portbld-freebsd6.0) Mime-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit Cc: freebsd-geom@freebsd.org Subject: Re: GEOM stripe + concat X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 24 Jan 2006 22:07:17 -0000 On Tue, 24 Jan 2006 15:53:45 -0600 Eric Anderson wrote: > Sergey Lungu wrote: > > On Tue, 24 Jan 2006 15:12:58 -0600 Eric Anderson > > wrote: > > > > > >> Sergey Lungu wrote: > >> > >>> On Sun, 22 Jan 2006 19:22:57 +0300 I wrote: > >>> > >>> > >>> > >>>> Hello, > >>>> > >>>> I have FreeBSD 6.0-RELEASE running on my FTP server. There are > >>>> three disks on that box: two identical 120GB and one 300GB. I am > >>>> using gvinum for stripping between first two disks. I am going to > >>>> give gstripe a try, sine gvinum is too unstable. > >>>> > >>>> > >>> Since nobody has answered my question, possibly it was too silly, > >>> I decided to experiment a bit. I'll answer my questions: > >>> > >>> > >>> > >>>> Am I able to concatenate created stripe with 300GB disk? > >>>> > >>>> > >>> Yes, you can! > >>> > >>> > >>> > >>>> And is it wise at all? > >>>> > >>>> > >>> I have made some simple benchmarking on three different > >>> geometries. Legend: > >>> a * b - stripping between a and b > >>> a + b - concatenation of a and b > >>> ad1 - 120GB disk > >>> ad2 - 120GB disk > >>> ad3 - 300GB disk > >>> > >>> I tried to upload and then download a 700MB movie. Here are my > >>> results: > >>> > >>> ad1 * ad2: > >>> Uploading: 1m8.406s > >>> Downloading: 1m4.656s > >>> > >>> ad1 * ad2 + ad3: > >>> Uploading: 1m4.115s > >>> Downloading: 1m4.962s > >>> > >>> ad1 + ad2 + ad3: > >>> Uploading: 1m4.110s > >>> Downloading: 1m4.971s > >>> > >>> Conclusion: > >>> There is no big difference between all this geometries in FTP > >>> context, or possibly there are some on high load!? > >>> > >>> > >> I'm not sure the details of your tests, since 'upload and then > >> download' doesn't really explain the test, however I'm guessing you > >> were limited by network or the destination rather than the local > >> disk > >> - 1m 4s looks alot like 100mbit to me. > >> > > > > Yes, we have 100mbit network. > > > > > >> You should try one of the many benchmarking tools as a first start > >> (try iozone, or bonnie, etc). > >> > > > > I'm not interested in real disk performance, since this box is used > > only for ftp. Probably I was wrong from the begining and I am > > limited only by the network speed, so software RAID is not the > > right way to boost our ftp server :) > > > > Well, I guess it depends on the files, and the usage. It could be > that you are using much less than 100mbit normally, due to the > transfer of random small files to many clients. I would guess that > if you are not hitting the 100mbit network wall yet, you could > benefit from a stripe of multiple disks, and a larger amount of > available memory. If all the files you are serving are large > (hundreds of megabytes) then you probably won't be disk bound. This server is mostly used to share movies in our hostel, so files are about 700MB or 4GB (DVD images) :) > >> Also, concat won't give you any performance increase, but striping > >> could. You could easily test your 700mb file by doing something > >> like this: > >> > >> dd if=/path/to/700mb-file of=/dev/null bs=1m > >> > > > > I don't think that stripping between two disks can give some > > significant performance boost (I may be wrong, of course), > > especially in ftp context. > > > > Well, stripes can definitely increase disk performance, that's the > whole idea. Otherwise, one wouldn't use it, as it increases risk of > failure (without the use of a parity drive). Unfortunately we don't have enough disks for parity. Does this mean that you suggest to use a+b+c instead? > > I think I'll use a*b+c geometry, but the question is: Will I have > > the same problems with gstripe+gconcat as with gvinum? :) > > I don't think anyone could answer that without information on what > problems you did see with gvinum. We have rather unstable power supply. This is the main problem. One of the disks went down after power jump and now I have to resetconfig (gvinum does not have this one, so this is another inconvenience) and then configure it again after each crash. This is the only sollution I've found. -- Sergey Lungu Return on investments won't. From owner-freebsd-geom@FreeBSD.ORG Tue Jan 24 22:28:28 2006 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 1091E16A420 for ; Tue, 24 Jan 2006 22:28:28 +0000 (GMT) (envelope-from pjd@garage.freebsd.pl) Received: from mail.garage.freebsd.pl (arm132.internetdsl.tpnet.pl [83.17.198.132]) by mx1.FreeBSD.org (Postfix) with ESMTP id 66B0743D5E for ; Tue, 24 Jan 2006 22:28:18 +0000 (GMT) (envelope-from pjd@garage.freebsd.pl) Received: by mail.garage.freebsd.pl (Postfix, from userid 65534) id 0D54D50BAC; Tue, 24 Jan 2006 23:28:16 +0100 (CET) Received: from localhost (dlh203.neoplus.adsl.tpnet.pl [83.24.37.203]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mail.garage.freebsd.pl (Postfix) with ESMTP id 54E9E50A3E; Tue, 24 Jan 2006 23:28:09 +0100 (CET) Date: Tue, 24 Jan 2006 23:27:47 +0100 From: Pawel Jakub Dawidek To: Sergey Lungu Message-ID: <20060124222747.GA7617@garage.freebsd.pl> References: <20060122192257.273734cf.sergey.lungu@gmail.com> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="45Z9DzgjV8m4Oswq" Content-Disposition: inline In-Reply-To: <20060122192257.273734cf.sergey.lungu@gmail.com> X-PGP-Key-URL: http://people.freebsd.org/~pjd/pjd.asc X-OS: FreeBSD 7.0-CURRENT i386 User-Agent: mutt-ng/devel-r535 (FreeBSD) X-Spam-Checker-Version: SpamAssassin 3.0.4 (2005-06-05) on mail.garage.freebsd.pl X-Spam-Level: X-Spam-Status: No, score=-0.5 required=3.0 tests=BAYES_00,RCVD_IN_NJABL_DUL, RCVD_IN_SORBS_DUL autolearn=no version=3.0.4 Cc: freebsd-geom@freebsd.org Subject: Re: GEOM stripe + concat X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 24 Jan 2006 22:28:28 -0000 --45Z9DzgjV8m4Oswq Content-Type: text/plain; charset=iso-8859-2 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Sun, Jan 22, 2006 at 07:22:57PM +0300, Sergey Lungu wrote: +> Hello, +>=20 +> I have FreeBSD 6.0-RELEASE running on my FTP server. There are three +> disks on that box: two identical 120GB and one 300GB. I am using gvinum +> for stripping between first two disks. I am going to give gstripe a +> try, sine gvinum is too unstable. +>=20 +> So, the questin is: +> Am I able to concatenate created stripe with 300GB disk? And is it wise +> at all? I'd do something like this: da0 - 120GB disk da1 - 120GB disk da2 - 300GB disk da2a - 240GB partition da2d - 60GB partition concat( stripe( concat(da0, da1), da2a ), da2d) In other words: # gconcat C0 da0 da1 # gstripe S0 concat/C0 da2a # gconcat C1 stripe/S0 da2d # newfs -U /dev/concat/C1 This way you have 240GB in stripe and only 60GB without stripe (so slower). Yes, you can do this with GEOM:) --=20 Pawel Jakub Dawidek http://www.wheel.pl pjd@FreeBSD.org http://www.FreeBSD.org FreeBSD committer Am I Evil? Yes, I Am! --45Z9DzgjV8m4Oswq Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.2 (FreeBSD) iD8DBQFD1qniForvXbEpPzQRAqpYAJ0aVbWpqTndu2aSBUg6P4sOqr/bmwCaAgXV tEuBJxwK2tuPEC/NukdIM+g= =HZHd -----END PGP SIGNATURE----- --45Z9DzgjV8m4Oswq-- From owner-freebsd-geom@FreeBSD.ORG Tue Jan 24 22:43:17 2006 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 9D6B716A42A for ; Tue, 24 Jan 2006 22:43:17 +0000 (GMT) (envelope-from sergey.lungu@gmail.com) Received: from uproxy.gmail.com (uproxy.gmail.com [66.249.92.201]) by mx1.FreeBSD.org (Postfix) with ESMTP id 9ED8E43D45 for ; Tue, 24 Jan 2006 22:43:16 +0000 (GMT) (envelope-from sergey.lungu@gmail.com) Received: by uproxy.gmail.com with SMTP id o2so5283uge for ; Tue, 24 Jan 2006 14:43:15 -0800 (PST) DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=beta; d=gmail.com; h=received:date:from:to:cc:subject:message-id:in-reply-to:references:x-mailer:mime-version:content-type:content-transfer-encoding; b=ZvUAjT6zL4+atd5wnP4QggS2t6rBp7/ey6fHak9vZAfOi2MAR/cOl4O1FEb0AE8l4YRaZwU/83iyBjYjzwQQs7UHu3s7MMpuRUfw9PUrrkcPFeCnEd8XRWMfHtf12u9EtrMo8vEUkuIDkt9aemjuYColAc8Qxzl0DQKmBvEjG7Q= Received: by 10.66.222.2 with SMTP id u2mr247ugg; Tue, 24 Jan 2006 14:43:14 -0800 (PST) Received: from ogre.obchaga.org ( [195.225.128.22]) by mx.gmail.com with ESMTP id a1sm5483056ugf.2006.01.24.14.43.13; Tue, 24 Jan 2006 14:43:14 -0800 (PST) Date: Wed, 25 Jan 2006 01:43:10 +0300 From: Sergey Lungu To: Pawel Jakub Dawidek Message-Id: <20060125014310.3f1ce1c9.sergey.lungu@gmail.com> In-Reply-To: <20060124222747.GA7617@garage.freebsd.pl> References: <20060122192257.273734cf.sergey.lungu@gmail.com> <20060124222747.GA7617@garage.freebsd.pl> X-Mailer: Sylpheed version 2.0.4 (GTK+ 2.8.10; i386-portbld-freebsd6.0) Mime-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit Cc: freebsd-geom@freebsd.org Subject: Re: GEOM stripe + concat X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 24 Jan 2006 22:43:17 -0000 On Tue, 24 Jan 2006 23:27:47 +0100 Pawel Jakub Dawidek wrote: > On Sun, Jan 22, 2006 at 07:22:57PM +0300, Sergey Lungu wrote: > +> Hello, > +> > +> I have FreeBSD 6.0-RELEASE running on my FTP server. There are > three +> disks on that box: two identical 120GB and one 300GB. I am > using gvinum +> for stripping between first two disks. I am going to > give gstripe a +> try, sine gvinum is too unstable. > +> > +> So, the questin is: > +> Am I able to concatenate created stripe with 300GB disk? And is it > wise +> at all? > > I'd do something like this: > > da0 - 120GB disk > da1 - 120GB disk > da2 - 300GB disk > > da2a - 240GB partition > da2d - 60GB partition > > concat( stripe( concat(da0, da1), da2a ), da2d) > > In other words: > > # gconcat C0 da0 da1 > # gstripe S0 concat/C0 da2a > # gconcat C1 stripe/S0 da2d > # newfs -U /dev/concat/C1 > > This way you have 240GB in stripe and only 60GB without stripe (so > slower). Nice :) Perhaps this is dangerous and slow!? I'll try that. What about: da0 - 120GB da1 - 120GB da2 - 300GB da2a - 120GB da2d - 120GB da2e - 60GB concat(stripe(da0, da1, da2a, da2e), da2e) >From mathematical point of view this looks simplified :) -- Sergey Lungu It is better for civilization to be going down the drain, than to be coming up it. From owner-freebsd-geom@FreeBSD.ORG Tue Jan 24 23:43:10 2006 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 558B716A41F for ; Tue, 24 Jan 2006 23:43:10 +0000 (GMT) (envelope-from pjd@garage.freebsd.pl) Received: from mail.garage.freebsd.pl (arm132.internetdsl.tpnet.pl [83.17.198.132]) by mx1.FreeBSD.org (Postfix) with ESMTP id 8DFCE43D4C for ; Tue, 24 Jan 2006 23:43:09 +0000 (GMT) (envelope-from pjd@garage.freebsd.pl) Received: by mail.garage.freebsd.pl (Postfix, from userid 65534) id 4D2AE50F90; Wed, 25 Jan 2006 00:43:07 +0100 (CET) Received: from localhost (dls182.neoplus.adsl.tpnet.pl [83.24.48.182]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mail.garage.freebsd.pl (Postfix) with ESMTP id 8304350A79; Wed, 25 Jan 2006 00:42:59 +0100 (CET) Date: Wed, 25 Jan 2006 00:42:35 +0100 From: Pawel Jakub Dawidek To: Sergey Lungu Message-ID: <20060124234235.GC7617@garage.freebsd.pl> References: <20060122192257.273734cf.sergey.lungu@gmail.com> <20060124222747.GA7617@garage.freebsd.pl> <20060125014310.3f1ce1c9.sergey.lungu@gmail.com> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="GZVR6ND4mMseVXL/" Content-Disposition: inline In-Reply-To: <20060125014310.3f1ce1c9.sergey.lungu@gmail.com> X-PGP-Key-URL: http://people.freebsd.org/~pjd/pjd.asc X-OS: FreeBSD 7.0-CURRENT i386 User-Agent: mutt-ng/devel-r535 (FreeBSD) X-Spam-Checker-Version: SpamAssassin 3.0.4 (2005-06-05) on mail.garage.freebsd.pl X-Spam-Level: X-Spam-Status: No, score=-0.5 required=3.0 tests=BAYES_00,RCVD_IN_NJABL_DUL, RCVD_IN_SORBS_DUL autolearn=no version=3.0.4 Cc: freebsd-geom@freebsd.org Subject: Re: GEOM stripe + concat X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 24 Jan 2006 23:43:10 -0000 --GZVR6ND4mMseVXL/ Content-Type: text/plain; charset=iso-8859-2 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Wed, Jan 25, 2006 at 01:43:10AM +0300, Sergey Lungu wrote: +> Perhaps this is dangerous and slow!? Give it a try. +> What about: +> da0 - 120GB +> da1 - 120GB +> da2 - 300GB +> da2a - 120GB +> da2d - 120GB +> da2e - 60GB +>=20 +> concat(stripe(da0, da1, da2a, da2e), da2e) -----------------------------------------^ s/e/d/ +> >From mathematical point of view this looks simplified :) Using two partitions of the same disk in stripe is very bad idea. --=20 Pawel Jakub Dawidek http://www.wheel.pl pjd@FreeBSD.org http://www.FreeBSD.org FreeBSD committer Am I Evil? Yes, I Am! --GZVR6ND4mMseVXL/ Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.2 (FreeBSD) iD8DBQFD1rtrForvXbEpPzQRAoYIAKCQTrNzT0cpIUJocs4T+kL+ocXZHgCdHxwo KwvWQmKHJJrkuGTbdMso4YI= =tM7e -----END PGP SIGNATURE----- --GZVR6ND4mMseVXL/-- From owner-freebsd-geom@FreeBSD.ORG Wed Jan 25 01:00:37 2006 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 12C1416A41F for ; Wed, 25 Jan 2006 01:00:37 +0000 (GMT) (envelope-from sergey.lungu@gmail.com) Received: from uproxy.gmail.com (uproxy.gmail.com [66.249.92.203]) by mx1.FreeBSD.org (Postfix) with ESMTP id 2D40C43D45 for ; Wed, 25 Jan 2006 01:00:35 +0000 (GMT) (envelope-from sergey.lungu@gmail.com) Received: by uproxy.gmail.com with SMTP id o2so43683uge for ; Tue, 24 Jan 2006 17:00:34 -0800 (PST) DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=beta; d=gmail.com; h=received:date:from:to:cc:subject:message-id:in-reply-to:references:x-mailer:mime-version:content-type:content-transfer-encoding; b=C8YhTbVhKr+Jou7R8RV4MeQKsiwQp16C6ED4Ypno6YGkUcqy3gYBA1210r6amCoj+PLF6gZ/KeLPfabQGtt6eLQYRM5cjW2mqO3kuoEfN+vdVwugGueCb+leEuqRDiv1s3fUQIFrMzo8NSQwF9FmaGVLR5rZz1Ui+SZA0iOvsds= Received: by 10.66.241.16 with SMTP id o16mr46907ugh; Tue, 24 Jan 2006 17:00:34 -0800 (PST) Received: from ogre.obchaga.org ( [195.225.128.22]) by mx.gmail.com with ESMTP id q1sm28832uge.2006.01.24.17.00.33; Tue, 24 Jan 2006 17:00:33 -0800 (PST) Date: Wed, 25 Jan 2006 04:00:14 +0300 From: Sergey Lungu To: Pawel Jakub Dawidek Message-Id: <20060125040014.371eae38.sergey.lungu@gmail.com> In-Reply-To: <20060124234235.GC7617@garage.freebsd.pl> References: <20060122192257.273734cf.sergey.lungu@gmail.com> <20060124222747.GA7617@garage.freebsd.pl> <20060125014310.3f1ce1c9.sergey.lungu@gmail.com> <20060124234235.GC7617@garage.freebsd.pl> X-Mailer: Sylpheed version 2.0.4 (GTK+ 2.8.10; i386-portbld-freebsd6.0) Mime-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit Cc: freebsd-geom@freebsd.org Subject: Re: GEOM stripe + concat X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 25 Jan 2006 01:00:37 -0000 On Wed, 25 Jan 2006 00:42:35 +0100 Pawel Jakub Dawidek wrote: > On Wed, Jan 25, 2006 at 01:43:10AM +0300, Sergey Lungu wrote: > +> Perhaps this is dangerous and slow!? > > Give it a try. Certainly I will. > +> What about: > +> da0 - 120GB > +> da1 - 120GB > +> da2 - 300GB > +> da2a - 120GB > +> da2d - 120GB > +> da2e - 60GB > +> > +> concat(stripe(da0, da1, da2a, da2e), da2e) > > -----------------------------------------^ s/e/d/ Sorry, my mistake. > +> >From mathematical point of view this looks simplified :) > > Using two partitions of the same disk in stripe is very bad idea. This was just a joke :) -- Sergey Lungu The more complicated and grandiose the plan, the greater the chance of failure. From owner-freebsd-geom@FreeBSD.ORG Wed Jan 25 22:44:29 2006 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 1C63E16A420 for ; Wed, 25 Jan 2006 22:44:29 +0000 (GMT) (envelope-from schoch6@gmail.com) Received: from uproxy.gmail.com (uproxy.gmail.com [66.249.92.203]) by mx1.FreeBSD.org (Postfix) with ESMTP id 792AB43D46 for ; Wed, 25 Jan 2006 22:44:28 +0000 (GMT) (envelope-from schoch6@gmail.com) Received: by uproxy.gmail.com with SMTP id o2so60922uge for ; Wed, 25 Jan 2006 14:44:27 -0800 (PST) DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=beta; d=gmail.com; h=received:message-id:date:from:sender:to:subject:mime-version:content-type:content-transfer-encoding:content-disposition; b=JaXdH3/I90cXex3bBIdBUXmACTIvUCUoavsL9QmEkBuKLEizUQiBURGRUcQUvCXUX9YGXEuxjO2/hz7BMqEj0mq5oKrFitThMNCb6QEOGgJqYAPoq8SyYdIFszGwteDmFJHB3wgBtXsDG2dAofD86Vwekkd1ub89ZyyzrLR3BhA= Received: by 10.48.224.14 with SMTP id w14mr113304nfg; Wed, 25 Jan 2006 14:44:26 -0800 (PST) Received: by 10.48.203.17 with HTTP; Wed, 25 Jan 2006 14:44:26 -0800 (PST) Message-ID: <6650332b0601251444v47e6320dr44a4976a5adf5e14@mail.gmail.com> Date: Wed, 25 Jan 2006 14:44:26 -0800 From: Steven Schoch Sender: schoch6@gmail.com To: freebsd-geom@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Content-Disposition: inline Subject: gmirror on disks of different size X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 25 Jan 2006 22:44:29 -0000 I have two disks: da0 is 18GB, da1 is 35MB. I want to mirror /var and /usr, with /tmp and swap not mirrored, and / either mirrored or simply keep a duplicate on the second disk since it rarely changes. I have been using gvinum, but it seems that's not supported in FreeBSD 6.0, so I'd like to switch to something more reliable like gmirror. My current gvinum setup is as follows: drive a device /dev/da0s1d drive b device /dev/da1s1g volume var plex org concat sd length 3g drive a plex org concat sd length 3g drive b volume usr plex org concat sd length 12g drive a plex org concat sd length 12g drive b da0s1d and da1s1g are the same size. This leaves unused space on da1, on which I have da1s1e (/tmp) and da1s1f (/scratch). da0s1a and da1s1a are both the same size and have / on both. da0s1b and da1s1b are both swap partitions. In the event of a failure of da1, I can simply boot from da0s1a, and continue where I left off (with the loss of /scratch and /tmp - no big deal). A failure of da0 will only be noticed by gvinum (although the loss of the swap partition da0s1b may require a reboot.) So how do I run this setup using gmirror? All the documentation I have read shows giving full disks of identical size. -- Steve From owner-freebsd-geom@FreeBSD.ORG Thu Jan 26 08:48:50 2006 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 4249316A420 for ; Thu, 26 Jan 2006 08:48:50 +0000 (GMT) (envelope-from pjd@garage.freebsd.pl) Received: from mail.garage.freebsd.pl (arm132.internetdsl.tpnet.pl [83.17.198.132]) by mx1.FreeBSD.org (Postfix) with ESMTP id 9668B43D46 for ; Thu, 26 Jan 2006 08:48:49 +0000 (GMT) (envelope-from pjd@garage.freebsd.pl) Received: by mail.garage.freebsd.pl (Postfix, from userid 65534) id 09EC550BAC; Thu, 26 Jan 2006 09:48:47 +0100 (CET) Received: from localhost (ana50.internetdsl.tpnet.pl [83.17.82.50]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mail.garage.freebsd.pl (Postfix) with ESMTP id BF76050A16; Thu, 26 Jan 2006 09:48:39 +0100 (CET) Date: Thu, 26 Jan 2006 09:48:15 +0100 From: Pawel Jakub Dawidek To: Steven Schoch Message-ID: <20060126084815.GA5926@garage.freebsd.pl> References: <6650332b0601251444v47e6320dr44a4976a5adf5e14@mail.gmail.com> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="FL5UXtIhxfXey3p5" Content-Disposition: inline In-Reply-To: <6650332b0601251444v47e6320dr44a4976a5adf5e14@mail.gmail.com> X-PGP-Key-URL: http://people.freebsd.org/~pjd/pjd.asc X-OS: FreeBSD 7.0-CURRENT i386 User-Agent: mutt-ng/devel-r535 (FreeBSD) X-Spam-Checker-Version: SpamAssassin 3.0.4 (2005-06-05) on mail.garage.freebsd.pl X-Spam-Level: X-Spam-Status: No, score=-5.9 required=3.0 tests=ALL_TRUSTED,BAYES_00 autolearn=ham version=3.0.4 Cc: freebsd-geom@freebsd.org Subject: Re: gmirror on disks of different size X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 26 Jan 2006 08:48:50 -0000 --FL5UXtIhxfXey3p5 Content-Type: text/plain; charset=iso-8859-2 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Wed, Jan 25, 2006 at 02:44:26PM -0800, Steven Schoch wrote: +> I have been using gvinum, but it seems that's not supported in FreeBSD +> 6.0, so I'd like to switch to something more reliable like gmirror. AFAIK gvinum is supported. +> da0s1d and da1s1g are the same size. This leaves unused space on da1, +> on which I have da1s1e (/tmp) and da1s1f (/scratch). +>=20 +> da0s1a and da1s1a are both the same size and have / on both. +> da0s1b and da1s1b are both swap partitions. +>=20 +> In the event of a failure of da1, I can simply boot from da0s1a, and +> continue where I left off (with the loss of /scratch and /tmp - no big +> deal). A failure of da0 will only be noticed by gvinum (although the +> loss of the swap partition da0s1b may require a reboot.) +>=20 +> So how do I run this setup using gmirror? All the documentation I +> have read shows giving full disks of identical size. With gmirror you can mirror any GEOM providers (disks, slices, partitions, stripes, encrypted providers - anything). You can simply: # gmirror label root da0s1a da1s1a # gmirror label usr da0s1d da1s1g Which will create /dev/mirror/root and /dev/mirror/usr for you. --=20 Pawel Jakub Dawidek http://www.wheel.pl pjd@FreeBSD.org http://www.FreeBSD.org FreeBSD committer Am I Evil? Yes, I Am! --FL5UXtIhxfXey3p5 Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.2 (FreeBSD) iD8DBQFD2IzPForvXbEpPzQRAv0wAKDPsNKsi3q4gU1q+JtD/zs1kHWplQCg3Y1Q JFWvBAvmA1bihcknns7Xj/0= =xnQi -----END PGP SIGNATURE----- --FL5UXtIhxfXey3p5-- From owner-freebsd-geom@FreeBSD.ORG Thu Jan 26 17:37:55 2006 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id E553116A420 for ; Thu, 26 Jan 2006 17:37:55 +0000 (GMT) (envelope-from schoch6@gmail.com) Received: from uproxy.gmail.com (uproxy.gmail.com [66.249.92.200]) by mx1.FreeBSD.org (Postfix) with ESMTP id 529C843D55 for ; Thu, 26 Jan 2006 17:37:54 +0000 (GMT) (envelope-from schoch6@gmail.com) Received: by uproxy.gmail.com with SMTP id o2so269481uge for ; Thu, 26 Jan 2006 09:37:53 -0800 (PST) DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=beta; d=gmail.com; h=received:message-id:date:from:sender:to:subject:mime-version:content-type:content-transfer-encoding:content-disposition; b=CaqhHLKHUHzEjQXlECEaPf1SkN9iy2tAjgr1aNCWur1rW0DLU9jR7TJ06X5Ut2kw6lUB35aAQQ1I9V9+vlAND4niJNtUDy1Pqkl3Uw7kyUU6bLqZCYA9qbE5y8J2vuuNIA+9CMP5UcLJyHTUfvNNjkGlASWpPvrt3UxOZRd1B2Q= Received: by 10.48.250.5 with SMTP id x5mr191684nfh; Thu, 26 Jan 2006 09:37:53 -0800 (PST) Received: by 10.48.203.17 with HTTP; Thu, 26 Jan 2006 09:37:53 -0800 (PST) Message-ID: <6650332b0601260937m2571371fld70df3dcdd941821@mail.gmail.com> Date: Thu, 26 Jan 2006 09:37:53 -0800 From: Steven Schoch Sender: schoch6@gmail.com To: freebsd-geom@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Content-Disposition: inline Subject: Re: gmirror on disks of different size X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 26 Jan 2006 17:37:56 -0000 Pawel Jakub Dawidek wrote: > AFAIK gvinum is supported. In a previous message, Fred R. said that with 6.0, after running gvinum start, the entries /dev/gvinum/* were not there. Lukas Ertl replied that gvinum was last supported in the latest -STABLE release, which was not 6.0. I also found that I couldn't use gvinum after upgrading to 6.0, so I figured gvinum was not supported, or at least on the back burner. > With gmirror you can mirror any GEOM providers (disks, slices, > partitions, stripes, encrypted providers - anything). Thanks! Alec Berryman also pointed me to http://people.freebsd.org/~rse/mirror/ , which suggests using gmirror on a slice, and then partitioning the gmirrored slice. In order to avoid mirroring the swap partition, which seems unwise to me, I'm planning on dividing each disk into two slices, with slice 2 taking up the last part of the disk. Then I can gmirror as follows: =09# gmirror label root da0s1a da1s1a =09# gmirror label gm0 da0s2 da1s2 Then I'll use disklabel on gm0 to set up two partitions, /dev/gmirror/gm0d for /usr and /dev/gmirror/gm0e for /var. Then, I'll have two swap partitions, da0s1b and da1s1b, and scratch partitions on da1s1{d,e} (the larger disk). Is there something wrong with doing it this way? Is there a better way? From owner-freebsd-geom@FreeBSD.ORG Thu Jan 26 22:55:04 2006 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 1184016A420 for ; Thu, 26 Jan 2006 22:55:04 +0000 (GMT) (envelope-from gbaratto@superb.net) Received: from smail2.superb.net (smail2.superb.net [64.251.80.10]) by mx1.FreeBSD.org (Postfix) with ESMTP id B1CE243D45 for ; Thu, 26 Jan 2006 22:55:03 +0000 (GMT) (envelope-from gbaratto@superb.net) Received: from guinness (100.80.251.64.yvr1.superb.net [64.251.80.100]) by smail2.superb.net (Postfix) with SMTP id 564831F8C69 for ; Thu, 26 Jan 2006 14:55:02 -0800 (PST) Message-ID: <013c01c622cb$43256ef0$6450fb40@guinness> From: "Gustavo A. Baratto" To: Date: Thu, 26 Jan 2006 14:53:02 -0800 MIME-Version: 1.0 Content-Type: text/plain; format=flowed; charset="iso-8859-1"; reply-type=original Content-Transfer-Encoding: 7bit X-Priority: 3 X-MSMail-Priority: Normal X-Mailer: Microsoft Outlook Express 6.00.2900.2670 X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2900.2670 Subject: gmirror + ggate X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 26 Jan 2006 22:55:04 -0000 This maybe a very stipid question, but since the hanbook says "Regardless of the disk configuration, the important aspect is that information on one disk or partition is being replicated", I'm wondering if one could mount two partitions from two different servers, then mirror them... Something like: On server A, I mount ggate0 from server B, and ggate1 from server C. Then mirror them ggate0 and ggate1, so the end result is two mirrored partition in two remote servers. Am I dreaming here? Thanks From owner-freebsd-geom@FreeBSD.ORG Fri Jan 27 01:08:27 2006 Return-Path: X-Original-To: geom@freebsd.org Delivered-To: freebsd-geom@FreeBSD.ORG Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 72F6716A420 for ; Fri, 27 Jan 2006 01:08:27 +0000 (GMT) (envelope-from ivoras@fer.hr) Received: from pinus.cc.fer.hr (pinus.cc.fer.hr [161.53.73.18]) by mx1.FreeBSD.org (Postfix) with ESMTP id BD8BB43D48 for ; Fri, 27 Jan 2006 01:08:26 +0000 (GMT) (envelope-from ivoras@fer.hr) Received: from [161.53.72.113] (lara.cc.fer.hr [161.53.72.113]) by pinus.cc.fer.hr (8.12.2/8.12.2) with ESMTP id k0R18GFx010393; Fri, 27 Jan 2006 02:08:17 +0100 (MET) Message-ID: <43D97268.2030700@fer.hr> Date: Fri, 27 Jan 2006 02:07:52 +0100 From: Ivan Voras User-Agent: Mozilla Thunderbird 1.0.6 (X11/20050921) X-Accept-Language: en-us, en MIME-Version: 1.0 To: "Gustavo A. Baratto" References: <013c01c622cb$43256ef0$6450fb40@guinness> In-Reply-To: <013c01c622cb$43256ef0$6450fb40@guinness> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: geom@freebsd.org Subject: Re: gmirror + ggate X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 27 Jan 2006 01:08:27 -0000 Gustavo A. Baratto wrote: > This maybe a very stipid question, but since the hanbook says > "Regardless of the disk configuration, the important aspect is that > information on one disk or partition is being replicated", I'm wondering > if one could mount two partitions from two different servers, then > mirror them... This is a FAQ. See: http://docs.freebsd.org/cgi/mid.cgi?43A18CAB.6020705 http://docs.freebsd.org/cgi/mid.cgi?43CD5505.2040705 http://docs.freebsd.org/cgi/mid.cgi?439ED00E.7050701 (in short: yes, but you can't mount the copy or copies) From owner-freebsd-geom@FreeBSD.ORG Fri Jan 27 02:49:07 2006 Return-Path: X-Original-To: geom@freebsd.org Delivered-To: freebsd-geom@FreeBSD.ORG Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 4C63F16A420 for ; Fri, 27 Jan 2006 02:49:07 +0000 (GMT) (envelope-from gbaratto@superb.net) Received: from smail2.superb.net (smail2.superb.net [64.251.80.10]) by mx1.FreeBSD.org (Postfix) with ESMTP id E3D9B43D45 for ; Fri, 27 Jan 2006 02:49:06 +0000 (GMT) (envelope-from gbaratto@superb.net) Received: from guinness (100.80.251.64.yvr1.superb.net [64.251.80.100]) by smail2.superb.net (Postfix) with SMTP id 0DB5C1F8C97; Thu, 26 Jan 2006 18:49:06 -0800 (PST) Message-ID: <01a601c622eb$f5d62970$6450fb40@guinness> From: "Gustavo A. Baratto" To: "Ivan Voras" References: <013c01c622cb$43256ef0$6450fb40@guinness> <43D97268.2030700@fer.hr> Date: Thu, 26 Jan 2006 18:47:06 -0800 MIME-Version: 1.0 Content-Type: text/plain; format=flowed; charset="iso-8859-1"; reply-type=response Content-Transfer-Encoding: 7bit X-Priority: 3 X-MSMail-Priority: Normal X-Mailer: Microsoft Outlook Express 6.00.2900.2670 X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2900.2670 Cc: geom@freebsd.org Subject: Re: gmirror + ggate X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 27 Jan 2006 02:49:07 -0000 Thanks for the links Ivan... They answered some of my questions, but mostly they don't really describe what I wanna do, because they mostly refer to more than one client mounting a gmirrored+ggated device. I want just one server to mount a gmirrored device, exported from two different boxes through ggated. Being more specific: - Servers X and Y will be file server. They will have big sized identical partitions (for example /dev/da0s1f), that will be exported through ggated, and of course not mounted on servers X and Y. - Server A will ggatec the remote /dev/da0s1f devices from both servers X and Y (/dev/ggate0 and /dev/ggate1). Then, server A will create the mirror with the devices ggate0 and ggate1: # gmirror label -v -b round-robin data ggate0 # gmirror insert data ggate1 # mount /dev/mirror/data /mnt Just server A will mount /dev/mirror/data RW (or even RO). Thanks :) ----- Original Message ----- From: "Ivan Voras" To: "Gustavo A. Baratto" Cc: Sent: Thursday, January 26, 2006 5:07 PM Subject: Re: gmirror + ggate > Gustavo A. Baratto wrote: >> This maybe a very stipid question, but since the hanbook says "Regardless >> of the disk configuration, the important aspect is that information on >> one disk or partition is being replicated", I'm wondering if one could >> mount two partitions from two different servers, then mirror them... > > This is a FAQ. See: > http://docs.freebsd.org/cgi/mid.cgi?43A18CAB.6020705 > http://docs.freebsd.org/cgi/mid.cgi?43CD5505.2040705 > http://docs.freebsd.org/cgi/mid.cgi?439ED00E.7050701 > > (in short: yes, but you can't mount the copy or copies) > _______________________________________________ > freebsd-geom@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-geom > To unsubscribe, send any mail to "freebsd-geom-unsubscribe@freebsd.org" > From owner-freebsd-geom@FreeBSD.ORG Fri Jan 27 03:01:11 2006 Return-Path: X-Original-To: geom@freebsd.org Delivered-To: freebsd-geom@FreeBSD.ORG Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 1A40E16A420 for ; Fri, 27 Jan 2006 03:01:11 +0000 (GMT) (envelope-from ivoras@fer.hr) Received: from pinus.cc.fer.hr (pinus.cc.fer.hr [161.53.73.18]) by mx1.FreeBSD.org (Postfix) with ESMTP id 688AA43D45 for ; Fri, 27 Jan 2006 03:01:10 +0000 (GMT) (envelope-from ivoras@fer.hr) Received: from [161.53.72.113] (lara.cc.fer.hr [161.53.72.113]) by pinus.cc.fer.hr (8.12.2/8.12.2) with ESMTP id k0R311Fx018325; Fri, 27 Jan 2006 04:01:01 +0100 (MET) Message-ID: <43D98CD4.8060701@fer.hr> Date: Fri, 27 Jan 2006 04:00:36 +0100 From: Ivan Voras User-Agent: Mozilla Thunderbird 1.0.6 (X11/20050921) X-Accept-Language: en-us, en MIME-Version: 1.0 To: "Gustavo A. Baratto" References: <013c01c622cb$43256ef0$6450fb40@guinness> <43D97268.2030700@fer.hr> <01a601c622eb$f5d62970$6450fb40@guinness> In-Reply-To: <01a601c622eb$f5d62970$6450fb40@guinness> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: geom@freebsd.org Subject: Re: gmirror + ggate X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 27 Jan 2006 03:01:11 -0000 Gustavo A. Baratto wrote: > Thanks for the links Ivan... > - Server A will ggatec the remote /dev/da0s1f devices from both servers > X and Y (/dev/ggate0 and /dev/ggate1). > Then, server A will create the mirror with the devices ggate0 and ggate1: > # gmirror label -v -b round-robin data ggate0 > # gmirror insert data ggate1 > # mount /dev/mirror/data /mnt > > Just server A will mount /dev/mirror/data RW (or even RO). Yes, this should be possible without problems, especially if you use 6.0-release or later. If you do this, it would be very nice if you post/send information about possible problems if you encounter them, and also performance measurements (be sure to include hardware details also!) :) From owner-freebsd-geom@FreeBSD.ORG Fri Jan 27 08:55:56 2006 Return-Path: X-Original-To: geom@freebsd.org Delivered-To: freebsd-geom@FreeBSD.ORG Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 2EC1016A420 for ; Fri, 27 Jan 2006 08:55:56 +0000 (GMT) (envelope-from pjd@garage.freebsd.pl) Received: from mail.garage.freebsd.pl (arm132.internetdsl.tpnet.pl [83.17.198.132]) by mx1.FreeBSD.org (Postfix) with ESMTP id AABAB43D45 for ; Fri, 27 Jan 2006 08:55:51 +0000 (GMT) (envelope-from pjd@garage.freebsd.pl) Received: by mail.garage.freebsd.pl (Postfix, from userid 65534) id 0DF4751181; Fri, 27 Jan 2006 09:55:49 +0100 (CET) Received: from localhost (ana50.internetdsl.tpnet.pl [83.17.82.50]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mail.garage.freebsd.pl (Postfix) with ESMTP id 95F8D50A7F; Fri, 27 Jan 2006 09:55:41 +0100 (CET) Date: Fri, 27 Jan 2006 09:55:17 +0100 From: Pawel Jakub Dawidek To: "Gustavo A. Baratto" Message-ID: <20060127085517.GA789@garage.freebsd.pl> References: <013c01c622cb$43256ef0$6450fb40@guinness> <43D97268.2030700@fer.hr> <01a601c622eb$f5d62970$6450fb40@guinness> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="liOOAslEiF7prFVr" Content-Disposition: inline In-Reply-To: <01a601c622eb$f5d62970$6450fb40@guinness> X-PGP-Key-URL: http://people.freebsd.org/~pjd/pjd.asc X-OS: FreeBSD 7.0-CURRENT i386 User-Agent: mutt-ng/devel-r535 (FreeBSD) X-Spam-Checker-Version: SpamAssassin 3.0.4 (2005-06-05) on mail.garage.freebsd.pl X-Spam-Level: X-Spam-Status: No, score=-5.9 required=3.0 tests=ALL_TRUSTED,BAYES_00 autolearn=ham version=3.0.4 Cc: geom@freebsd.org, Ivan Voras Subject: Re: gmirror + ggate X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 27 Jan 2006 08:55:56 -0000 --liOOAslEiF7prFVr Content-Type: text/plain; charset=iso-8859-2 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Thu, Jan 26, 2006 at 06:47:06PM -0800, Gustavo A. Baratto wrote: +> Thanks for the links Ivan... +>=20 +> They answered some of my questions, but mostly they don't really describ= e what I wanna do, because they mostly refer to more than one client mounti= ng a gmirrored+ggated=20 +> device. I want just one server to mount a gmirrored device, exported fr= om two different boxes through ggated. +>=20 +> Being more specific: +>=20 +> - Servers X and Y will be file server. They will have big sized identica= l partitions (for example /dev/da0s1f), that will be exported through ggate= d, and of course not=20 +> mounted on servers X and Y. +>=20 +> - Server A will ggatec the remote /dev/da0s1f devices from both servers = X and Y (/dev/ggate0 and /dev/ggate1). +> Then, server A will create the mirror with the devices ggate0 and ggate1: +> # gmirror label -v -b round-robin data ggate0 +> # gmirror insert data ggate1 +> # mount /dev/mirror/data /mnt +>=20 +> Just server A will mount /dev/mirror/data RW (or even RO). There will be a problem when you lost connection to one of the servers - ggate will return EIO (or ENXIO) on every I/O request, so gmirror will mark this component as broken and will remove it from the mirror so it won't be automatically reconnected when the connection come back. I was wondering how to handle this better. I think we can return ENXIO =66rom ggate and just disconnect provider on error !=3D EIO (without marking it as broken). --=20 Pawel Jakub Dawidek http://www.wheel.pl pjd@FreeBSD.org http://www.FreeBSD.org FreeBSD committer Am I Evil? Yes, I Am! --liOOAslEiF7prFVr Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.2 (FreeBSD) iD8DBQFD2d/1ForvXbEpPzQRAn0tAKCBDcwqS9VdjSHdz7CJsp5jnmnx2wCdFRJo jY9qhbtzV0PEg0/P01WR2GI= =7VuA -----END PGP SIGNATURE----- --liOOAslEiF7prFVr-- From owner-freebsd-geom@FreeBSD.ORG Fri Jan 27 11:06:06 2006 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id A13E616A420 for ; Fri, 27 Jan 2006 11:06:06 +0000 (GMT) (envelope-from brenthostetler@gmail.com) Received: from zproxy.gmail.com (zproxy.gmail.com [64.233.162.200]) by mx1.FreeBSD.org (Postfix) with ESMTP id E239843D49 for ; Fri, 27 Jan 2006 11:06:05 +0000 (GMT) (envelope-from brenthostetler@gmail.com) Received: by zproxy.gmail.com with SMTP id 9so603996nzo for ; Fri, 27 Jan 2006 03:06:05 -0800 (PST) DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=beta; d=gmail.com; h=received:message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; b=Sa50MxDbBd7ZiqTQSxszaFdO4W5jCZ6ZboMge1gtdYiqPSwrdSxFChwTb7KnuL33qQZ5sBkwwrvWppoEArLkri+sruNmqHCPlobFPps9wBRdDSCo2p4iBwfPhC6ESWNq1mmoixrOox0yeava1izXGjqcdXtDA+fuTWhb0CAWrdI= Received: by 10.37.21.36 with SMTP id y36mr2352707nzi; Fri, 27 Jan 2006 03:06:05 -0800 (PST) Received: by 10.36.91.13 with HTTP; Fri, 27 Jan 2006 03:06:05 -0800 (PST) Message-ID: Date: Fri, 27 Jan 2006 06:06:05 -0500 From: Brent Hostetler To: Pawel Jakub Dawidek In-Reply-To: <20060117120908.GB20602@garage.freebsd.pl> MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Content-Disposition: inline References: <20060117120908.GB20602@garage.freebsd.pl> Cc: freebsd-geom@freebsd.org Subject: Re: Metadata info. X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 27 Jan 2006 11:06:06 -0000 Thank you, This has helped my understanding greatly of how the meta data works! Brent H. On 1/17/06, Pawel Jakub Dawidek wrote: > No, example 2: > > [----------- ad4 --------------] > [----ad4s1------][---ad4s2-----] > [ad4s1d][ad4s1e]*[---ad4s2a----] > > Example 3: > > [----------- ad4 --------------] > [----ad4s1------][---ad4s2-----] > [ad4s1d][ad4s1e]*[---ad4s2a---]* > > > +> If operating on geom's class providers it works the same way > +> correct? > +> > +> Example 4: > +> > +> gmirror label -v -n -b round-robin data1 /dev/stripe/stripe1 > +> > +> [------------stripe1-----------] > +> [------stripe1s1--------------]* > +> [------stripe1s1a-------------]* > But the more correct pictures are: > > Disk mirroring: > [------------ ad4 ------------] > [-------- mirror/foo --------]* > [------- mirror/foos1 -------]* > [mirror/foos1s][mirror/foos1d]* > > Slice mirroring: > [------------ ad4 ------------] > [---- ad4s1 ----][--- ad4s2 --] > [- mirror/foo -]*[-- ad4s2a --] > [ mirror/fooa -]* > > Partition mirroring: > [------------ ad4 ------------] > [---- ad4s1 ----][--- ad4s2 --] > [---- ad4s1a ---][-- ad4s2a --] > [- mirror/foo -]* > > Stripe mirroring: > [--- stripe/foo ---] > [--- mirror/bar --]* > [-- mirror/bars1 -]* > [- mirror/bars1a -]* > > Remember that you can setup slices/partitions on mirror device, you > don't have to do it on plain disk. > > -- > Pawel Jakub Dawidek http://www.wheel.pl > pjd@FreeBSD.org http://www.FreeBSD.org > FreeBSD committer Am I Evil? Yes, I Am! > > > From owner-freebsd-geom@FreeBSD.ORG Fri Jan 27 14:02:33 2006 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 68ACB16A420 for ; Fri, 27 Jan 2006 14:02:33 +0000 (GMT) (envelope-from brenthostetler@gmail.com) Received: from zproxy.gmail.com (zproxy.gmail.com [64.233.162.203]) by mx1.FreeBSD.org (Postfix) with ESMTP id EDF1843D48 for ; Fri, 27 Jan 2006 14:02:32 +0000 (GMT) (envelope-from brenthostetler@gmail.com) Received: by zproxy.gmail.com with SMTP id 9so633207nzo for ; Fri, 27 Jan 2006 06:02:32 -0800 (PST) DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=beta; d=gmail.com; h=received:message-id:date:from:to:subject:mime-version:content-type:content-transfer-encoding:content-disposition; b=Oq2g6ea7Ul56v0W6JVd/HKfwOax6fk+PZWvQ/iJvFxMei7yBdQAwQkLOXfBfvdClYMEXSyIBMQxQbMIWTR5STANy/u2axwDK62lPLnsxlZOlJJGLgposaKunCyC6eHVvpr+9UHPpsmslmE4Ss/xUADurZHaaXYIyBmQ6hu4sM4c= Received: by 10.36.86.11 with SMTP id j11mr2459216nzb; Fri, 27 Jan 2006 06:02:31 -0800 (PST) Received: by 10.36.91.13 with HTTP; Fri, 27 Jan 2006 06:02:31 -0800 (PST) Message-ID: Date: Fri, 27 Jan 2006 09:02:31 -0500 From: Brent Hostetler To: freebsd-geom@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Content-Disposition: inline Subject: Setup problem with multiple mirrored devices X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 27 Jan 2006 14:02:33 -0000 I have been trying to setup a series of mirrors of disk partitions with mixed results. I have multiple ide disks on multiple ide controllers. Each controller has only a master drive no slaves. Ultimately I want to end up with something like: gmroota -> ad0s1, ad0s2 [ mirrored ] M1 -> ad0s2, ad2s2 [ mirrored ] M2 -> ad4s1, ad6s1 [ mirrored ] M3 -> ad8s1, ad10s1 [ mirrored ] M4 -> ad12s1, ad14s1 [ mirrored ] gmdata -> M1, M2, M3, M4 [ concat ] ad0 and ad2 same size disks sliced into two parts. ad0s1 and ad2s1 are mirrored as gmroot. gmroot is bsdlabel partitioned: /, swap, var, tmp, usr with the last partion 1 sector smaller then size of partition c: . System boots fine. ad0s2 and ad2s2 are bsdlabeled as one partition a: that is 1 sector smaller then c:. bsdlabel -w ad0s2 bsdlabel -w ad2s2 bsdlabel -e ad0s2 bsdlabel -e ad2s2 gmirror label -v -b round-robin M1 ad0s2 gmirror configure -a M1 gmirror insert M1 ad2s2 This appears to work fine. So then I move on to ad4 and ad6. fdisk -I ad4 fdisk -I ad6 bsdlabel -w ad4s1 bsdlabel -w ad6s1 bsdlabel -e ad6s1 bsdlabel -e ad4s1 gmirror label -v -b round-robin M2 ad4s1 gmirror configure -a M2 gmirror insert M2 ad6s1 gmirror picks up ad6 as the provider instead of ad6s1. I have also tried fdisk -I ad4; fdisk -I ad6 gmirror label -v -b round-robin M2 ad4s1 bsdlabel -w /dev/mirror/M2 bsdlabel -e /dev/mirror/M2 # make a: on sector smaller then c: gmirror configure -a M2 gmirror insert M2 ad6s1 Same results. ad6 is picked up a provider instead of ad6s1. What am I doing= ? Seems like a meta-data problem. If I hardcode providers name with -h it wor= ks as expected. Please enlighten me to my errorrs! Brent relevant output: files# gmirror status Name Status Components mirror/gmroot COMPLETE ad0s1 ad2s1 mirror/M1 COMPLETE ad0s2 ad2s2 mirror/M2 DEGRADED ad4s1 ad6 (19%) files# diskinfo ad4 ad4 512 160041885696 312581808 310101 16 63 files# diskinfo ad6 ad6 512 160041885696 312581808 310101 16 63 files# dmesg | grep ^ad ad0: 114473MB at ata0-master UDMA100 ad2: 114473MB at ata1-master UDMA100 ad4: 152627MB at ata2-master UDMA100 ad6: 152627MB at ata3-master UDMA100 files# files# gmirror list Geom name: gmroot State: COMPLETE Components: 2 Balance: round-robin Slice: 4096 Flags: NONE GenID: 0 SyncID: 1 ID: 2015974814 Providers: 1. Name: mirror/gmroot Mediasize: 26843152384 (25G) Sectorsize: 512 Mode: r5w5e5 Consumers: 1. Name: ad0s1 Mediasize: 26843152896 (25G) Sectorsize: 512 Mode: r1w1e1 State: ACTIVE Priority: 0 Flags: NONE GenID: 0 SyncID: 1 ID: 3541228437 2. Name: ad2s1 Mediasize: 26843152896 (25G) Sectorsize: 512 Mode: r1w1e1 State: ACTIVE Priority: 0 Flags: NONE GenID: 0 SyncID: 1 ID: 2970860838 Geom name: M1 State: COMPLETE Components: 2 Balance: round-robin Slice: 4096 Flags: NONE GenID: 0 SyncID: 1 ID: 3840021545 Providers: 1. Name: mirror/M1 Mediasize: 93190551040 (87G) Sectorsize: 512 Mode: r0w0e0 Consumers: 1. Name: ad0s2 Mediasize: 93190551552 (87G) Sectorsize: 512 Mode: r1w1e1 State: ACTIVE Priority: 0 Flags: NONE GenID: 0 SyncID: 1 ID: 2818130314 2. Name: ad2s2 Mediasize: 93190551552 (87G) Sectorsize: 512 Mode: r1w1e1 State: ACTIVE Priority: 0 Flags: NONE GenID: 0 SyncID: 1 ID: 3215541282 Geom name: M2 State: DEGRADED Components: 2 Balance: round-robin Slice: 4096 Flags: NONE GenID: 0 SyncID: 1 ID: 3917683988 Providers: 1. Name: mirror/M2 Mediasize: 160041852928 (149G) Sectorsize: 512 Mode: r1w0e0 Consumers: 1. Name: ad4s1 Mediasize: 160041853440 (149G) Sectorsize: 512 Mode: r1w1e1 State: ACTIVE Priority: 0 Flags: NONE GenID: 0 SyncID: 1 ID: 3973561558 2. Name: ad6 Mediasize: 160041885696 (149G) Sectorsize: 512 Mode: r1w1e1 State: SYNCHRONIZING Priority: 0 Flags: DIRTY, SYNCHRONIZING GenID: 0 SyncID: 1 Synchronized: 22% ID: 2258110550 From owner-freebsd-geom@FreeBSD.ORG Fri Jan 27 14:47:54 2006 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 28CDD16A420 for ; Fri, 27 Jan 2006 14:47:54 +0000 (GMT) (envelope-from pjd@garage.freebsd.pl) Received: from mail.garage.freebsd.pl (arm132.internetdsl.tpnet.pl [83.17.198.132]) by mx1.FreeBSD.org (Postfix) with ESMTP id 759C343DF1 for ; Fri, 27 Jan 2006 14:47:52 +0000 (GMT) (envelope-from pjd@garage.freebsd.pl) Received: by mail.garage.freebsd.pl (Postfix, from userid 65534) id 1724F50C77; Fri, 27 Jan 2006 15:47:51 +0100 (CET) Received: from localhost (ana50.internetdsl.tpnet.pl [83.17.82.50]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mail.garage.freebsd.pl (Postfix) with ESMTP id CD20150A79; Fri, 27 Jan 2006 15:47:42 +0100 (CET) Date: Fri, 27 Jan 2006 15:47:42 +0100 From: Pawel Jakub Dawidek To: Brent Hostetler Message-ID: <20060127144742.GB789@garage.freebsd.pl> References: Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="bCsyhTFzCvuiizWE" Content-Disposition: inline In-Reply-To: X-PGP-Key-URL: http://people.freebsd.org/~pjd/pjd.asc X-OS: FreeBSD 7.0-CURRENT i386 User-Agent: mutt-ng/devel-r535 (FreeBSD) X-Spam-Checker-Version: SpamAssassin 3.0.4 (2005-06-05) on mail.garage.freebsd.pl X-Spam-Level: X-Spam-Status: No, score=-5.9 required=3.0 tests=ALL_TRUSTED,BAYES_00 autolearn=ham version=3.0.4 Cc: freebsd-geom@freebsd.org Subject: Re: Setup problem with multiple mirrored devices X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 27 Jan 2006 14:47:54 -0000 --bCsyhTFzCvuiizWE Content-Type: text/plain; charset=iso-8859-2 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Fri, Jan 27, 2006 at 09:02:31AM -0500, Brent Hostetler wrote: +> So then I move on to ad4 and ad6. +> fdisk -I ad4 +> fdisk -I ad6 +> bsdlabel -w ad4s1 +> bsdlabel -w ad6s1 +> bsdlabel -e ad6s1 +> bsdlabel -e ad4s1 +> gmirror label -v -b round-robin M2 ad4s1 +> gmirror configure -a M2 +> gmirror insert M2 ad6s1 +>=20 +> gmirror picks up ad6 as the provider instead of ad6s1. Which FreeBSD version do you use? It should work fine with 6.0. If you cannot upgrade, you need to use -h option, eventually you can create slices one sector smaller so they don't end at the same sector as disk. BTW. Don't create partitions on adXsX if you mirror slices. Instead create them on mirror provider. --=20 Pawel Jakub Dawidek http://www.wheel.pl pjd@FreeBSD.org http://www.FreeBSD.org FreeBSD committer Am I Evil? Yes, I Am! --bCsyhTFzCvuiizWE Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.2 (FreeBSD) iD8DBQFD2jKNForvXbEpPzQRAqAjAJ9rAm3kBNFTW1wPHPPKsnZEYEdwOwCcDo/k 7MzhSrvU3qTi/ByKz4ZvmLs= =RUun -----END PGP SIGNATURE----- --bCsyhTFzCvuiizWE-- From owner-freebsd-geom@FreeBSD.ORG Fri Jan 27 16:40:36 2006 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 352B716A424 for ; Fri, 27 Jan 2006 16:40:36 +0000 (GMT) (envelope-from brenthostetler@gmail.com) Received: from zproxy.gmail.com (zproxy.gmail.com [64.233.162.204]) by mx1.FreeBSD.org (Postfix) with ESMTP id A9D5844525 for ; Fri, 27 Jan 2006 16:07:17 +0000 (GMT) (envelope-from brenthostetler@gmail.com) Received: by zproxy.gmail.com with SMTP id 9so660006nzo for ; Fri, 27 Jan 2006 08:07:14 -0800 (PST) DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=beta; d=gmail.com; h=received:message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; b=HQIYM9uY/ecZ8arnKUkwNfubo+eCzrb1HSZ6dPKsuhyWUO9It3i6ImMa5IKAQU9V8XujjQdDsezmEPyzj7AAm+Tv8Fxa17dMQLsjRlZusZZFwaRf/8heSrPa4h7ZKol3V+vIupWxBRN/wGfbJi+HWkTjED+buJ6Y+L+GLd8LStE= Received: by 10.36.194.8 with SMTP id r8mr2499439nzf; Fri, 27 Jan 2006 08:07:14 -0800 (PST) Received: by 10.36.91.13 with HTTP; Fri, 27 Jan 2006 08:07:14 -0800 (PST) Message-ID: Date: Fri, 27 Jan 2006 08:07:14 -0800 From: Brent Hostetler To: Pawel Jakub Dawidek In-Reply-To: <20060127144742.GB789@garage.freebsd.pl> MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Content-Disposition: inline References: <20060127144742.GB789@garage.freebsd.pl> Cc: freebsd-geom@freebsd.org Subject: Re: Setup problem with multiple mirrored devices X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 27 Jan 2006 16:40:37 -0000 On 1/27/06, Pawel Jakub Dawidek wrote: > Which FreeBSD version do you use? > It should work fine with 6.0. If you cannot upgrade, you need to use -h > option, eventually you can create slices one sector smaller so they > don't end at the same sector as disk. files # uname -a FreeBSD files.hostetler.ws 6.0-RELEASE FreeBSD 6.0-RELEASE #0: Thu Nov 3 09:36:13 UTC 2005 =20 root@x64.samsco.home:/usr/obj/usr/src/sys/GENERIC i386 > > BTW. Don't create partitions on adXsX if you mirror slices. Instead > create them on mirror provider. Since it kept mixing up ad6 for ad6s1 I was trying to save a sector in the label for the meta-data.. stupid.. I know. I would think I could do this: ( this is what you mean correct? ) files# diskinfo ad4 ad4 512 160041885696 312581808 310101 16 63 sector size is 312581808 so make slice one sector smaller. files# ( echo "p 1 165 63 312581807"; echo "a 1" ) | fdisk -v -f- -i /dev/a= d4 files# ( echo "p 1 165 63 312581807"; echo "a 1" ) | fdisk -v -f- -i /dev/a= d6 files# fdisk -s ad4 /dev/ad4: 310101 cyl 16 hd 63 sec Part Start Size Type Flags 1: 63 312581745 0xa5 0x80 files# fdisk -s ad6 /dev/ad6: 310101 cyl 16 hd 63 sec Part Start Size Type Flags 1: 63 312581745 0xa5 0x80 files# files# gmirror label -v -n -b round-robin M2 ad4s1 files# gmirror insert M2 ad6s1 files# gmirror status Name Status Components mirror/gmroot COMPLETE ad0s1 ad2s1 mirror/M1 COMPLETE ad0s2 ad2s2 mirror/M2 DEGRADED ad4s1 ad6 files# files# gmirror deactivate M2 ad6 files# gmirror clear ad6 files# gmirror forget M2 files# gmirror insert -h M2 ad6s1 files# gmirror status Name Status Components mirror/gmroot COMPLETE ad0s1 ad2s1 mirror/M1 COMPLETE ad0s2 ad2s2 mirror/M2 DEGRADED ad4s1 ad6s1 So whats going on?? It's like gmirror cant decide whether the meta is for provider ad6 or ad6s1. It also does not matter order I bring the mirror up in. If I start with ad6 then it is ad4 that has the issues. Please Advise... I shouldnt have to hardcode the provider name correct? Thanks for your previous quick response! :) Brent. From owner-freebsd-geom@FreeBSD.ORG Sat Jan 28 03:20:08 2006 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 72F4B16A438 for ; Sat, 28 Jan 2006 03:20:08 +0000 (GMT) (envelope-from joeldiaz@nc.rr.com) Received: from ms-smtp-02-eri0.southeast.rr.com (ms-smtp-02-lbl.southeast.rr.com [24.25.9.101]) by mx1.FreeBSD.org (Postfix) with ESMTP id 2C77A43D48 for ; Sat, 28 Jan 2006 03:20:07 +0000 (GMT) (envelope-from joeldiaz@nc.rr.com) Received: from [10.0.1.3] (cpe-024-088-253-079.nc.res.rr.com [24.88.253.79]) by ms-smtp-02-eri0.southeast.rr.com (8.13.4/8.13.4) with ESMTP id k0S3K6pm014707 for ; Fri, 27 Jan 2006 22:20:06 -0500 (EST) Mime-Version: 1.0 (Apple Message framework v746.2) Content-Transfer-Encoding: 7bit Message-Id: <70FB710A-0D64-49EA-9CBE-C76C24CB0C39@nc.rr.com> Content-Type: text/plain; charset=US-ASCII; delsp=yes; format=flowed To: freebsd-geom@freebsd.org From: Joel Diaz Date: Fri, 27 Jan 2006 22:20:06 -0500 X-Mailer: Apple Mail (2.746.2) X-Virus-Scanned: Symantec AntiVirus Scan Engine Subject: unable to dd an image onto a USB floppy X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 28 Jan 2006 03:20:08 -0000 I've been trying to dump a disk image I downloaded off the internet onto a USB floppy drive. I was reading through dd(1) and at the bottom it pointed me to geom (4) and so I set: sysctl kern.geom.debugflags=16 Then tried the following: dd if=/root/bios.img of=/dev/da0 The drive makes some noise and after a few minutes it just gives up with: dd: /dev/da0: Device busy 1+0 records in 0+0 records out 0 bytes transfered in 2.667840 secs (0 bytes/sec) 'geom disk list da0' gives: Geom name: da0 Providers: 1. Name: da0 Mediasize: 1474560 (1.4M) Sectorsize: 512 Mode: r0w0e0 fwsectors: 32 fwheads: 64 dmesg contained the following: (da0:umass-sim0:0:0:0): READ CAPACITY. CDB: 25 0 0 0 0 0 0 0 0 0 (da0:umass-sim0:0:0:0): CAM Status: SCSI Status Error (da0:umass-sim0:0:0:0): SCSI Status: Check Condition (da0:umass-sim0:0:0:0): UNIT ATTENTION asc:28,0 (da0:umass-sim0:0:0:0): Not ready to ready change, medium may have changed (da0:umass-sim0:0:0:0): Retries Exhausted Opened disk da0 -> 6 This was all done as root with 0640 permissions on /dev/da0 on 6.0- STABLE built Jan 24th. Not sure where to go from here. Any help would be greatly appreciated. Joel From owner-freebsd-geom@FreeBSD.ORG Sat Jan 28 04:22:58 2006 Return-Path: X-Original-To: geom@freebsd.org Delivered-To: freebsd-geom@FreeBSD.ORG Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id DD2E516A420; Sat, 28 Jan 2006 04:22:58 +0000 (GMT) (envelope-from gbaratto@superb.net) Received: from smail2.superb.net (smail2.superb.net [64.251.80.10]) by mx1.FreeBSD.org (Postfix) with ESMTP id 8E78E43D46; Sat, 28 Jan 2006 04:22:58 +0000 (GMT) (envelope-from gbaratto@superb.net) Received: from guinness (100.80.251.64.yvr1.superb.net [64.251.80.100]) by smail2.superb.net (Postfix) with SMTP id CC33F1F8D2D; Fri, 27 Jan 2006 20:22:56 -0800 (PST) Message-ID: <02d901c623c2$3cb54ca0$6450fb40@guinness> From: "Gustavo A. Baratto" To: "Pawel Jakub Dawidek" References: <013c01c622cb$43256ef0$6450fb40@guinness> <43D97268.2030700@fer.hr><01a601c622eb$f5d62970$6450fb40@guinness> <20060127085517.GA789@garage.freebsd.pl> Date: Fri, 27 Jan 2006 20:20:57 -0800 MIME-Version: 1.0 Content-Type: text/plain; format=flowed; charset="iso-8859-2"; reply-type=original Content-Transfer-Encoding: 7bit X-Priority: 3 X-MSMail-Priority: Normal X-Mailer: Microsoft Outlook Express 6.00.2900.2670 X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2900.2670 Cc: geom@freebsd.org Subject: Re: gmirror + ggate X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 28 Jan 2006 04:22:59 -0000 Hi Pawel... Is there any patch available for that out there? or it is something in the "to be done" queue? I checked the ggatec.c code, but I'm not really confident in changing stuff that deals with kernel. Thanks a lot :) ----- Original Message ----- From: "Pawel Jakub Dawidek" To: "Gustavo A. Baratto" Cc: ; "Ivan Voras" Sent: Friday, January 27, 2006 12:55 AM Subject: Re: gmirror + ggate