From owner-freebsd-cluster@FreeBSD.ORG Sat Jan 30 04:23:26 2010
Return-Path: <owner-freebsd-cluster@FreeBSD.ORG>
Delivered-To: freebsd-cluster@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34])
by hub.freebsd.org (Postfix) with ESMTP id 276291065679
for <freebsd-cluster@freebsd.org>; Sat, 30 Jan 2010 04:23:26 +0000 (UTC)
(envelope-from rizzo@i805.com.br)
Received: from server.i805.com.br (server.i805.com.br [200.179.43.130])
by mx1.freebsd.org (Postfix) with ESMTP id 903F18FC15
for <freebsd-cluster@freebsd.org>; Sat, 30 Jan 2010 04:23:25 +0000 (UTC)
Received: from i805.com.br (localhost.i805.com.br [127.0.0.1])
by server.i805.com.br (8.14.3/8.14.3) with ESMTP id o0U45uQt028498
for <freebsd-cluster@freebsd.org>;
Sat, 30 Jan 2010 02:05:56 -0200 (BRST)
(envelope-from rizzo@i805.com.br)
From: "Nilton Jose Rizzo" <rizzo@i805.com.br>
To: freebsd-cluster@freebsd.org
Date: Sat, 30 Jan 2010 01:05:56 -0300
Message-Id: <20100130035458.M44249@i805.com.br>
X-Mailer: OpenWebMail 2.53
X-OriginatingIP: 200.179.43.130 (rizzo)
MIME-Version: 1.0
Content-Type: text/plain;
charset=iso-8859-1
Subject: some informations to beginner in cluster
X-BeenThere: freebsd-cluster@freebsd.org
X-Mailman-Version: 2.1.5
Precedence: list
List-Id: Clustering FreeBSD <freebsd-cluster.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-cluster>,
<mailto:freebsd-cluster-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-cluster>
List-Post: <mailto:freebsd-cluster@freebsd.org>
List-Help: <mailto:freebsd-cluster-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-cluster>,
<mailto:freebsd-cluster-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Sat, 30 Jan 2010 04:23:26 -0000
Hi all,
I`m work with FreeBSD some year, on servers ( http, smtp,smb and other
thinks), now I`ll work with cluster to parallel computing. My BigBoss should
be install Linux, but I would like to install FreeBSD, but I not have idea
or correct point to start. I look for in google, and some references talk
about Beowulf cluster. Is this only struct? Have differents about perfomance
with work diskless struct and non-diskless? Is FreeBSD ready to work with
parallel computing?
Please, send me links to white pappers or posts or one start point.
TIA,
--
Nilton José Rizzo
From owner-freebsd-cluster@FreeBSD.ORG Sat Jan 30 12:51:21 2010
Return-Path: <owner-freebsd-cluster@FreeBSD.ORG>
Delivered-To: freebsd-cluster@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34])
by hub.freebsd.org (Postfix) with ESMTP id D31B21065670
for <freebsd-cluster@freebsd.org>; Sat, 30 Jan 2010 12:51:21 +0000 (UTC)
(envelope-from danielbristot@gmail.com)
Received: from mail-pz0-f194.google.com (mail-pz0-f194.google.com
[209.85.222.194])
by mx1.freebsd.org (Postfix) with ESMTP id A896C8FC19
for <freebsd-cluster@freebsd.org>; Sat, 30 Jan 2010 12:51:21 +0000 (UTC)
Received: by pzk32 with SMTP id 32so98546pzk.27
for <freebsd-cluster@freebsd.org>; Sat, 30 Jan 2010 04:51:21 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma;
h=domainkey-signature:mime-version:received:in-reply-to:references
:date:message-id:subject:from:to:cc:content-type
:content-transfer-encoding;
bh=pDLpNvDe8WbhI/5NzZ7/K/PPyXc0GJW0QNj4GOQw2Gk=;
b=OPAvmsGMMR8YHNvIpTxZG4OTy42ZNij16SBVlQKoXqlwVe/WH6fgHUvupYtmuAddFL
wRs3cbq5nbdx7KNuJ+2WbYO0lle9p4g3gYXDs8BTEC5mOVEXy/0sZzA4ERMmaQgd0ENF
iJO7D0mQH9MtMrK38JP+k9M3f3k1ygk8AlEjU=
DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma;
h=mime-version:in-reply-to:references:date:message-id:subject:from:to
:cc:content-type:content-transfer-encoding;
b=FeymjNam/ydli6CWEaFQ3USLn0ymH4NZ7cx20mriOGrDSzcvlSr7NKeOHHwEXHZc7H
d0Q0QHDtEBDHJAZPfY5Try9HNMjvZSI/8+8ztipNuvqNeSeLT7GclOlk58lSpGB6U0Qj
fpT4kRiCGRHNC0jBqUCxe6ftWdVWWaMOhmj+U=
MIME-Version: 1.0
Received: by 10.142.152.11 with SMTP id z11mr1454323wfd.71.1264853994953; Sat,
30 Jan 2010 04:19:54 -0800 (PST)
In-Reply-To: <20100130035458.M44249@i805.com.br>
References: <20100130035458.M44249@i805.com.br>
Date: Sat, 30 Jan 2010 10:19:54 -0200
Message-ID: <b0c339111001300419x22d23d94t6023e476ffe0ec7c@mail.gmail.com>
From: Daniel Bristot de Oliveira <danielbristot@gmail.com>
To: Nilton Jose Rizzo <rizzo@i805.com.br>
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable
Cc: freebsd-cluster@freebsd.org
Subject: Re: some informations to beginner in cluster
X-BeenThere: freebsd-cluster@freebsd.org
X-Mailman-Version: 2.1.5
Precedence: list
List-Id: Clustering FreeBSD <freebsd-cluster.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-cluster>,
<mailto:freebsd-cluster-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-cluster>
List-Post: <mailto:freebsd-cluster@freebsd.org>
List-Help: <mailto:freebsd-cluster-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-cluster>,
<mailto:freebsd-cluster-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Sat, 30 Jan 2010 12:51:21 -0000
2010/1/30 Nilton Jose Rizzo <rizzo@i805.com.br>:
>
> =A0 Hi all,
>
> =A0 =A0 =A0I`m work with FreeBSD some year, on servers ( http, smtp,smb a=
nd other
> =A0thinks), now I`ll work with cluster to parallel computing. =A0My BigBo=
ss should
> =A0be install Linux, but I would like to install FreeBSD, but I not have =
idea
> =A0or correct point to start. =A0I look for in google, and some reference=
s talk
> =A0about Beowulf cluster. Is this only struct? =A0Have differents about p=
erfomance
> =A0with work diskless struct and non-diskless? =A0Is FreeBSD ready to wor=
k with
> =A0parallel computing?
>
> =A0 =A0 Please, send me links to white pappers or posts or one start poin=
t.
>
> =A0 =A0 TIA,
> --
> Nilton Jos=E9 Rizzo
>
> _______________________________________________
> freebsd-cluster@freebsd.org mailing list
> http://lists.freebsd.org/mailman/listinfo/freebsd-cluster
> To unsubscribe, send any mail to "freebsd-cluster-unsubscribe@freebsd.org=
"
>
Hi Newton,
(I'm also Brazilian)
I have some articles at FUG-BR (FreeBSD Brazilian Users Group) site,
where I explain about some kinds of cluster, by example how to build a
bewoulf cluster to parallel processing with MPI and PVM.
I think that the correct point to start is know "What you want run on
this cluster" and "What kind of technology will distribute the work
over the cluster nodes".
If you explain better this, I can help you better...
About the links, I have two:
How to build a Bewoulf cluster with FreeBSD
http://www.fug.com.br/content/view/163/60/ (pt_BR)
mailto:danielbristot@gmail.com (I Use the google to reply on
many languages) ;)
Cheers
--=20
Daniel Bristot de Oliveira
From owner-freebsd-cluster@FreeBSD.ORG Sat Jan 30 17:05:32 2010
Return-Path: <owner-freebsd-cluster@FreeBSD.ORG>
Delivered-To: freebsd-cluster@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34])
by hub.freebsd.org (Postfix) with ESMTP id 9F6B21065670
for <freebsd-cluster@freebsd.org>; Sat, 30 Jan 2010 17:05:32 +0000 (UTC)
(envelope-from jwbacon@tds.net)
Received: from mail-vw0-f54.google.com (mail-vw0-f54.google.com
[209.85.212.54])
by mx1.freebsd.org (Postfix) with ESMTP id 5E5658FC0A
for <freebsd-cluster@freebsd.org>; Sat, 30 Jan 2010 17:05:32 +0000 (UTC)
Received: by vws11 with SMTP id 11so637705vws.13
for <freebsd-cluster@freebsd.org>; Sat, 30 Jan 2010 09:05:31 -0800 (PST)
Received: by 10.220.83.91 with SMTP id e27mr2488904vcl.53.1264871131555;
Sat, 30 Jan 2010 09:05:31 -0800 (PST)
Received: from intern2.jbacon.dyndns.org (rrcs-67-53-186-9.west.biz.rr.com
[67.53.186.9])
by mx.google.com with ESMTPS id 30sm29564167vws.9.2010.01.30.09.05.30
(version=TLSv1/SSLv3 cipher=RC4-MD5);
Sat, 30 Jan 2010 09:05:31 -0800 (PST)
Message-Id: <400470FA-59EF-41EA-8E3C-CDF4F652E40C@uwm.edu>
From: Jason Bacon <jwbacon@tds.net>
To: Nilton Jose Rizzo <rizzo@i805.com.br>
In-Reply-To: <20100130035458.M44249@i805.com.br>
Content-Type: text/plain; charset=ISO-8859-1; format=flowed; delsp=yes
Content-Transfer-Encoding: quoted-printable
Mime-Version: 1.0 (Apple Message framework v936)
Date: Sat, 30 Jan 2010 11:05:28 -0600
References: <20100130035458.M44249@i805.com.br>
X-Mailer: Apple Mail (2.936)
Cc: freebsd-cluster@freebsd.org
Subject: Re: some informations to beginner in cluster
X-BeenThere: freebsd-cluster@freebsd.org
X-Mailman-Version: 2.1.5
Precedence: list
List-Id: Clustering FreeBSD <freebsd-cluster.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-cluster>,
<mailto:freebsd-cluster-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-cluster>
List-Post: <mailto:freebsd-cluster@freebsd.org>
List-Help: <mailto:freebsd-cluster-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-cluster>,
<mailto:freebsd-cluster-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Sat, 30 Jan 2010 17:05:32 -0000
I would guess you've already found these links, but if not:
http://people.freebsd.org/~brooks/papers/bsdcon2003/
http://www.youtube.com/watch?v=3DBpsRb9fJ4Ds
A few things I would add:
At its core, I think FreeBSD is an ideal OS for clusters. It's faster =20=
and more stable than any other OS I've worked with.
In my past life I managed about 30 Linux workstations using a wide =20
variety of hardware and several large servers for fMRI research. The =20=
expected uptime of the Linux workstations varied from about a week to =20=
infinity. We experienced frequent dropped connections on long-running =20=
file transfers. The Linux NFS servers frequently froze up under =20
heavy load. I reproduced all these problems over several different =20
Linux distributions running kernels from 2.2 through early 2.6.
I decided to try FreeBSD on the servers, and they never crashed =20
again. In the several years I remained there, they only went down for =20=
upgrades and power outages. I eventually rolled FreeBSD out to the =20
workstations, and most of them never crashed again (unless there was a =20=
hardware problem, someone force-ejected a DVDRAM, etc.)
This is not to put Linux down, it's just pointing out that FreeBSD =20
worked better for us in an environment where maximum stability was =20
critical. We had researchers routinely running analysis jobs for =20
weeks or months, and moving datasets of 20 or 30 gigabytes to and from =20=
the fileservers. FreeBSD's stability made all this run smoothly and =20
prevented a lot of setbacks in the research. Based on this =20
experience, I would have a lot of confidence in FreeBSD as a cluster =20
platform.
That said, Linux has its place as well. If I were going to fill a =20
school computer lab with general-use desktop machines for development, =20=
Internet, etc., I would lean toward Ubuntu at this point for ease of =20
setup and maintenance. Having to reboot them once a month isn't going =20=
to pose a problem in that environment.
The "obvious" advantage of Linux for clusters is availability of more =20=
applications, although FreeBSD can run most Linux applications. I've =20=
run Matlab versions 6.5, 7.3, and now 7.7 for Linux on FreeBSD. I've =20=
seen reports of people running Mathematica and other apps. Matlab =20
7.7.0 works very well on FreeBSD 8.0, Java desktop and all. I have a =20=
mostly functional port for it at http://personalpages.tds.net/=20
~jwbacon. There's also a port called "cluster-installer" under =20
development to help automate the setup of a FreeBSD cluster. You =20
should be able to use it to set up a small FreeBSD cluster in about =20
half a day. ( Note that there's a bug in the Ganglia port for which I =20=
have submitted a PR. Check it out before attempting to set up =20
Ganglia. ) I've started working on ports for DL_POLY and Lava =20
(although the latter is low priority given that Sun Grid Engine and =20
Torque are already in the ports tree).
Good luck,
-J
On Jan 29, 2010, at 10:05 PM, Nilton Jose Rizzo wrote:
>
> Hi all,
>
> I`m work with FreeBSD some year, on servers ( http, smtp,smb =20
> and other
> thinks), now I`ll work with cluster to parallel computing. My =20
> BigBoss should
> be install Linux, but I would like to install FreeBSD, but I not =20
> have idea
> or correct point to start. I look for in google, and some =20
> references talk
> about Beowulf cluster. Is this only struct? Have differents about =20=
> perfomance
> with work diskless struct and non-diskless? Is FreeBSD ready to =20
> work with
> parallel computing?
>
> Please, send me links to white pappers or posts or one start =20
> point.
>
> TIA,
> --=20
> Nilton Jos=E9 Rizzo
>
> _______________________________________________
> freebsd-cluster@freebsd.org mailing list
> http://lists.freebsd.org/mailman/listinfo/freebsd-cluster
> To unsubscribe, send any mail to =
"freebsd-cluster-unsubscribe@freebsd.org=20
> "
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D
Jason Bacon
Systems Programmer / Instructor
University of Wisconsin - Milwaukee
bacon@uwm.edu
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D