From owner-freebsd-cluster@FreeBSD.ORG Mon Sep 8 01:04:51 2003 Return-Path: Delivered-To: freebsd-cluster@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id CFE6416A4BF for ; Mon, 8 Sep 2003 01:04:51 -0700 (PDT) Received: from moutng.kundenserver.de (moutng.kundenserver.de [212.227.126.186]) by mx1.FreeBSD.org (Postfix) with ESMTP id F056143FDF for ; Mon, 8 Sep 2003 01:04:49 -0700 (PDT) (envelope-from sporner@nentec.de) Received: from [212.227.126.161] (helo=mrelayng.kundenserver.de) by moutng.kundenserver.de with esmtp (Exim 3.35 #1) id 19wH0z-0001RC-00 for freebsd-cluster@freebsd.org; Mon, 08 Sep 2003 10:04:49 +0200 Received: from [80.131.130.171] (helo=gate.nentec.de) (TLSv1:EDH-RSA-DES-CBC3-SHA:168) (Exim 3.35 #1) id 19wH0y-0002f7-00 for freebsd-cluster@FreeBSD.ORG; Mon, 08 Sep 2003 10:04:48 +0200 Received: from nenny.nentec.de (nenny.nentec.de [153.92.64.1]) by gate.nentec.de (8.11.3/) with ESMTP id h8884kA03901 for ; Mon, 8 Sep 2003 10:04:46 +0200 Received: from nentec.de (andromeda.nentec.de [153.92.64.34]) by nenny.nentec.de (8.11.3/8.11.3) with ESMTP id h8884VZ19900 for ; Mon, 8 Sep 2003 10:04:31 +0200 Message-ID: <3F5C380F.6080403@nentec.de> Date: Mon, 08 Sep 2003 10:04:31 +0200 From: Andy Sporner User-Agent: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.2a) Gecko/20020910 X-Accept-Language: en-us, en MIME-Version: 1.0 To: freebsd-cluster Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Virus-Scanned: by AMaViS-perl11-milter (http://amavis.org/) Subject: Directory shadowing utility now available... X-BeenThere: freebsd-cluster@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Clustering FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 08 Sep 2003 08:04:51 -0000 Hi list, After a long silence, I have some software to release. The link: http://www.sporner.com/freebsdclusters/frep What it is: Well it's a start of a directory replication scheme. In the moment it replicates changes from one filesystem tree to another on a remote machine. NO THIS IS NOT NFS!! As files are changed, the changes are reflected to another node. This creates a duplicate of the data changes that are occurring locally. The directories that are replicated are configured (up to 16 at present). Any changes (file creation, writes, deletes) are also performed on the remote system (assyncronously). For more information read the README in the package. It lists the installation instructions as well as the current limitations. Bye! Andy From owner-freebsd-cluster@FreeBSD.ORG Mon Sep 8 01:18:47 2003 Return-Path: Delivered-To: freebsd-cluster@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 2AE1216A4BF for ; Mon, 8 Sep 2003 01:18:47 -0700 (PDT) Received: from moutng.kundenserver.de (moutng.kundenserver.de [212.227.126.186]) by mx1.FreeBSD.org (Postfix) with ESMTP id C0BA043FE9 for ; Mon, 8 Sep 2003 01:18:45 -0700 (PDT) (envelope-from sporner@nentec.de) Received: from [212.227.126.206] (helo=mrelayng.kundenserver.de) by moutng.kundenserver.de with esmtp (Exim 3.35 #1) id 19wHES-0006JA-00 for freebsd-cluster@freebsd.org; Mon, 08 Sep 2003 10:18:45 +0200 Received: from [80.131.130.171] (helo=gate.nentec.de) (TLSv1:EDH-RSA-DES-CBC3-SHA:168) (Exim 3.35 #1) id 19wHES-0003De-00 for freebsd-cluster@freebsd.org; Mon, 08 Sep 2003 10:18:44 +0200 Received: from nenny.nentec.de (nenny.nentec.de [153.92.64.1]) by gate.nentec.de (8.11.3/) with ESMTP id h888IgA04107 for ; Mon, 8 Sep 2003 10:18:42 +0200 Received: from nentec.de (andromeda.nentec.de [153.92.64.34]) by nenny.nentec.de (8.11.3/8.11.3) with ESMTP id h888IRZ21205; Mon, 8 Sep 2003 10:18:27 +0200 Message-ID: <3F5C3B53.4060805@nentec.de> Date: Mon, 08 Sep 2003 10:18:27 +0200 From: Andy Sporner User-Agent: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.2a) Gecko/20020910 X-Accept-Language: en-us, en MIME-Version: 1.0 To: Andy Sporner References: <3F5C380F.6080403@nentec.de> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Virus-Scanned: by AMaViS-perl11-milter (http://amavis.org/) cc: freebsd-cluster Subject: Re: Directory shadowing utility now available... X-BeenThere: freebsd-cluster@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Clustering FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 08 Sep 2003 08:18:47 -0000 PS. It has been tested with 5.0-RELEASE. If there are any brave souls who wish to try other FreeBSD releases, let me know the results. Andy Andy Sporner wrote: > Hi list, > > After a long silence, I have some software to release. > > The link: > > http://www.sporner.com/freebsdclusters/frep > > What it is: > > Well it's a start of a directory replication scheme. In the moment it > replicates changes from one filesystem tree to another on a remote > machine. NO THIS IS NOT NFS!! As files are changed, the changes > are reflected to another node. This creates a duplicate of the data > changes > that are occurring locally. > > The directories that are replicated are configured (up to 16 at present). > Any changes (file creation, writes, deletes) are also performed on the > remote system (assyncronously). > > For more information read the README in the package. It lists > the installation instructions as well as the current limitations. > > Bye! > > > > > Andy > > > _______________________________________________ > freebsd-cluster@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-cluster > To unsubscribe, send any mail to > "freebsd-cluster-unsubscribe@freebsd.org" > > From owner-freebsd-cluster@FreeBSD.ORG Tue Sep 9 05:04:23 2003 Return-Path: Delivered-To: freebsd-cluster@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 3E0A316A4C0 for ; Tue, 9 Sep 2003 05:04:23 -0700 (PDT) Received: from mccinet.ru (relay.cell.ru [212.119.96.41]) by mx1.FreeBSD.org (Postfix) with ESMTP id 717E243FEC for ; Tue, 9 Sep 2003 05:04:21 -0700 (PDT) (envelope-from dolgop@mccinet.ru) Received: from [212.1.235.150] (HELO server.dep624) by mccinet.ru (CommuniGate Pro SMTP 4.1) with ESMTP-TLS id 7041172; Tue, 09 Sep 2003 16:04:19 +0400 From: Evgeny Dolgopiat To: "Andy Sporner" Date: Tue, 9 Sep 2003 16:05:45 +0400 User-Agent: KMail/1.5 MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Content-Disposition: inline Message-Id: <200309091605.45748.dolgop@mccinet.ru> cc: freebsd-cluster Subject: Re: Directory shadowing utility now available... X-BeenThere: freebsd-cluster@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list Reply-To: evg_dolgop@mail.ru List-Id: Clustering FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 09 Sep 2003 12:04:23 -0000 Hello! I tested your frep utility on CURRENT. Device code (frep.c.patch) has error: 243+ if (strlen(xpath) > 1) { /* must be - if (strlen(xpath) > 0) */ 244+ *cptr++ = '/'; 245+ } When I use dd command to create big file (dd if=/dev/urandom of=/{path_to_frep_directory}/bigfile bs=1024 count=10000), frep goes to overrun very quickly :( Are you have some ideas to correct this problem? Maybe dynamic queue with sysctl tunable size will help? And one more question: What about data recovery? How directory data from client will get to new server? I mean if one server goes down and i'll set up new one instead of it. Do you have some ideas or protocol? Best wishes, Evgeny :)