From owner-freebsd-cluster@FreeBSD.ORG Sun Oct 9 13:00:53 2005 Return-Path: X-Original-To: freebsd-cluster@freebsd.org Delivered-To: freebsd-cluster@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id C0F4A16A41F for ; Sun, 9 Oct 2005 13:00:53 +0000 (GMT) (envelope-from freebsd.cluster@gmail.com) Received: from qproxy.gmail.com (qproxy.gmail.com [72.14.204.205]) by mx1.FreeBSD.org (Postfix) with ESMTP id 4951A43D45 for ; Sun, 9 Oct 2005 13:00:53 +0000 (GMT) (envelope-from freebsd.cluster@gmail.com) Received: by qproxy.gmail.com with SMTP id o12so118376qba for ; Sun, 09 Oct 2005 06:00:52 -0700 (PDT) DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=beta; d=gmail.com; h=received:message-id:date:from:reply-to:to:subject:mime-version:content-type; b=s/f5wMo2+WUx62YOKojNUiBfe0JZqDyrbhN21OWwN39zTgZEtvcuB0Z1K+M+aBkhyopwvEb6ecslJ6wzkq3JlInNPs+Z3Ahte+KRrUDAQo7ev5iY1PiPMAWVmWwpa0TkoT/FDOZ7mvRlNO/yTsL9klHnwmYCpjg670fCFbSpZ70= Received: by 10.64.184.3 with SMTP id h3mr1895950qbf; Sun, 09 Oct 2005 06:00:52 -0700 (PDT) Received: by 10.64.199.2 with HTTP; Sun, 9 Oct 2005 06:00:52 -0700 (PDT) Message-ID: Date: Sun, 9 Oct 2005 09:00:52 -0400 From: Wole Akpose To: freebsd-cluster@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Content-Disposition: inline X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Subject: New To Clustering Where Do I start X-BeenThere: freebsd-cluster@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: Wole Akpose List-Id: Clustering FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 09 Oct 2005 13:00:53 -0000 Hello , I am new to clustering but I have a project that requires some intelligent clustering. Two (or more) machines will access the same SATA raid appliance. Machines will serve as load balancing servers, but each reading and writing from/to same block on storage. Where do I start with my configuration changes and or research? Machines are running same operating System, FreeBSD5.4, primary application is streaming server. Also I have another project, this time machine will run courier mta. Thanks. From owner-freebsd-cluster@FreeBSD.ORG Sun Oct 9 13:44:36 2005 Return-Path: X-Original-To: freebsd-cluster@freebsd.org Delivered-To: freebsd-cluster@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id EBF4816A41F for ; Sun, 9 Oct 2005 13:44:36 +0000 (GMT) (envelope-from WD@US-Webmasters.com) Received: from usw2.natel.net (2b.bz [209.152.117.190]) by mx1.FreeBSD.org (Postfix) with SMTP id 6C47843D45 for ; Sun, 9 Oct 2005 13:44:36 +0000 (GMT) (envelope-from WD@US-Webmasters.com) Received: (qmail 92137 invoked from network); 9 Oct 2005 13:44:34 -0000 Received: from batv-01-192.dsl.netins.net (HELO Htebazile.US-Webmasters.com) (207.199.193.192) by us-webmasters.com with SMTP; 9 Oct 2005 13:44:34 -0000 Message-Id: <5.1.0.14.2.20051009083340.03874100@209.152.117.178> X-Sender: wd@209.152.117.178 X-Mailer: QUALCOMM Windows Eudora Version 5.1 Date: Sun, 09 Oct 2005 08:43:41 -0500 To: Wole Akpose From: "W. D." In-Reply-To: Mime-Version: 1.0 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable Cc: freebsd-cluster@freebsd.org Subject: Re: New To Clustering Where Do I start X-BeenThere: freebsd-cluster@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Clustering FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 09 Oct 2005 13:44:37 -0000 At 08:00 10/9/2005, Wole Akpose wrote: >Hello , > >I am new to clustering but I have a project that requires some intelligent >clustering. > >Two (or more) machines will access the same SATA raid appliance. Machines >will serve as load balancing servers, but each reading and writing from/to >same block on storage. > >Where do I start with my configuration changes and or research? > >Machines are running same operating System, FreeBSD5.4, primary application >is streaming server. > >Also I have another project, this time machine will run courier mta. http://www.google.com/search?hl=3Den&q=3DHigh-performance+Computing+Cluster+= FreeBSD http://www.freshports.org/parallel/ http://www.google.com/search?hl=3Den&q=3Dclusterit http://snipurl.com/i9zq http://www2.ua.freebsd.org/ports/parallel.html Start Here to Find It Fast!=99 ->= http://www.US-Webmasters.com/best-start-page/ $8.77 Domain Names -> http://domains.us-webmasters.com/ From owner-freebsd-cluster@FreeBSD.ORG Mon Oct 10 12:15:51 2005 Return-Path: X-Original-To: freebsd-cluster@freebsd.org Delivered-To: freebsd-cluster@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id C46D716A41F for ; Mon, 10 Oct 2005 12:15:51 +0000 (GMT) (envelope-from anderson@centtech.com) Received: from mh1.centtech.com (moat3.centtech.com [207.200.51.50]) by mx1.FreeBSD.org (Postfix) with ESMTP id 60AEE43D46 for ; Mon, 10 Oct 2005 12:15:50 +0000 (GMT) (envelope-from anderson@centtech.com) Received: from [10.177.171.220] (neutrino.centtech.com [10.177.171.220]) by mh1.centtech.com (8.13.1/8.13.1) with ESMTP id j9ACFnxM001022; Mon, 10 Oct 2005 07:15:49 -0500 (CDT) (envelope-from anderson@centtech.com) Message-ID: <434A5B62.5050608@centtech.com> Date: Mon, 10 Oct 2005 07:15:30 -0500 From: Eric Anderson User-Agent: Mozilla/5.0 (X11; U; FreeBSD i386; en-US; rv:1.7.11) Gecko/20050914 X-Accept-Language: en-us, en MIME-Version: 1.0 To: Wole Akpose References: In-Reply-To: Content-Type: text/plain; charset=us-ascii; format=flowed Content-Transfer-Encoding: 7bit X-Virus-Scanned: ClamAV 0.82/1125/Mon Oct 10 04:16:52 2005 on mh1.centtech.com X-Virus-Status: Clean Cc: freebsd-cluster@freebsd.org Subject: Re: New To Clustering Where Do I start X-BeenThere: freebsd-cluster@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Clustering FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 10 Oct 2005 12:15:51 -0000 Wole Akpose wrote: > Hello , > > I am new to clustering but I have a project that requires some intelligent > clustering. > > Two (or more) machines will access the same SATA raid appliance. Machines > will serve as load balancing servers, but each reading and writing from/to > same block on storage. > > Where do I start with my configuration changes and or research? > > Machines are running same operating System, FreeBSD5.4, primary application > is streaming server. > > Also I have another project, this time machine will run courier mta. Currently, FreeBSD does not offer any solution for direct shared block devices for write access, since there is no shared/clustered filesystem in FreeBSD. You could use NFS, which would probably work ok for you, or have both hosts reading from the same disks, but writing to the same shared array (via fibre channel for instance) won't work currently. Eric -- ------------------------------------------------------------------------ Eric Anderson Sr. Systems Administrator Centaur Technology Anything that works is better than anything that doesn't. ------------------------------------------------------------------------ From owner-freebsd-cluster@FreeBSD.ORG Mon Oct 10 12:40:19 2005 Return-Path: X-Original-To: freebsd-cluster@freebsd.org Delivered-To: freebsd-cluster@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id B124516A445 for ; Mon, 10 Oct 2005 12:40:19 +0000 (GMT) (envelope-from discussion-lists@linnet.org) Received: from orb.pobox.com (orb.pobox.com [207.8.226.5]) by mx1.FreeBSD.org (Postfix) with ESMTP id 336B443D46 for ; Mon, 10 Oct 2005 12:40:18 +0000 (GMT) (envelope-from discussion-lists@linnet.org) Received: from orb (localhost [127.0.0.1]) by orb.pobox.com (Postfix) with ESMTP id 7984B1EA5; Mon, 10 Oct 2005 08:40:41 -0400 (EDT) Received: from billdog.local.linnet.org (dsl-212-74-113-66.access.uk.tiscali.com [212.74.113.66]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by orb.sasl.smtp.pobox.com (Postfix) with ESMTP id 3A6A987; Mon, 10 Oct 2005 08:40:39 -0400 (EDT) Received: from lists by billdog.local.linnet.org with local (Exim 4.50 (FreeBSD)) id 1EOx11-0002CC-CU; Mon, 10 Oct 2005 13:44:27 +0100 Date: Mon, 10 Oct 2005 13:44:27 +0100 From: Brian Candler To: Wole Akpose Message-ID: <20051010124427.GA8412@uk.tiscali.com> References: Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.4.2.1i Cc: freebsd-cluster@freebsd.org Subject: Re: New To Clustering Where Do I start X-BeenThere: freebsd-cluster@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Clustering FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 10 Oct 2005 12:40:19 -0000 On Sun, Oct 09, 2005 at 09:00:52AM -0400, Wole Akpose wrote: > I am new to clustering but I have a project that requires some intelligent > clustering. > > Two (or more) machines will access the same SATA raid appliance. Machines > will serve as load balancing servers, but each reading and writing from/to > same block on storage. There is no cluster-safe filesystem for FreeBSD that I'm aware of - that is, where two machines can simultaneously making direct block-level access to the same blocks on the storage device. If you find a solution, I'd be interested to know of it. The options which I know *should* work are: (1) Master-slave. One machine mounts the RAID array, the other is quiescent. Whilst the slave can take over the master's IP address fairly easily (e.g. with carp), you will need to write nasty scripts to kill the master machine, preferably by turning off its power remotely, then mount the array on the slave and fsck it before bringing the application up on the slave. IMO this sort of cluster is likely to _reduce_ the reliability of your machine, as there are many possible failure modes and it's very hard to write failover scripts which work correctly in every case. (1a) Master-slave x 2. One machine is master for dataset A and slave for dataset B; the other is master for dataset B and slave for dataset A. Each machine only mounts half the RAID array normally. This has the same failover problems as (1), but at least you won't be wasting a whole machine, and you get a little more confidence that the backup machine will actually work when you need it. (2) NFS. Lots of front-end machines all access the same data on an NFS server. NFS has some problems when it comes to file locking, but courier-MTA won't have a problem with this as it uses Maildir format, and I've successfully built large mail and web clusters using this approach. However, the NFS server itself then becomes a single point of failure. You either have to build a failover NFS server (see 1), or buy yourself out of trouble with something like a NetApp. Regards, Brian.