Skip site navigation (1)Skip section navigation (2)
Date:      Mon, 13 Feb 2012 06:33:41 -0800 (PST)
From:      Bleakwiser <traebarlow@gmail.com>
To:        freebsd-ports@freebsd.org
Subject:   Re: [CFT] Hadoop preliminary port
Message-ID:  <CAEVfBA_wPA8Hp2LQTTZZbNV7UjOFPpc7nZx5U=nC715er1Nd_A@mail.gmail.com>
In-Reply-To: <168ca9f150b4af07ddc91340fff7cb99@bluelife.at>
References:  <20110808091432.GA16138@goofy.cultdeadsheep.org> <1329119043376-5478416.post@n5.nabble.com> <HWPffMLk/yCuhsOy2IZmsptEMik@ccIJq6nEuRe/NjgSGItUEiBW9ng> <CAEVfBA9Yx8Bp-bUiWmZbum3dmGYLhMNVgobq2-e%2B06jaB1gNbw@mail.gmail.com> <4F38C95D.6020807@infracaninophile.co.uk> <CAEVfBA-vJhwJDFhh72U1q-LaJJuVM4JUmpLEVFuDSnnQ5XfUEw@mail.gmail.com> <168ca9f150b4af07ddc91340fff7cb99@bluelife.at>

next in thread | previous in thread | raw e-mail | index | archive | help
Annn /fail on the manual edit, but I 1UPed that....

localhost# cd /usr/ports
localhost# wget http://people.freebsd.org/~clement/hadoop/hadoop-1.0.0.diff
localhost# patch < hadoop-1.0.0.diff

Well, now i see what the .diff file is for... updating everything by hand
would have been x(

Looks like all is well, it's compiling.
Oh hey =D

BUILD SUCCESSFUL
Total time: 1 second
===>  Installing for hadoop-1.0.0
===>   Generating temporary packing list
===>  Checking if devel/hadoop already installed
===> Creating users and/or groups.
Creating group `hadoop' with gid `954'.
Creating user `hadoop' with uid `954'.
===> Installing rc.d startup script(s)
=> Creating RUNDIR /var/run/hadoop... => Creating LOGDIR /var/log/hadoop...
===> Correct pkg-plist sequence to create group(s) and user(s)
===>   Registering installation for hadoop-1.0.0

===>  Cleaning for hadoop-1.0.0

===>>> Installation of devel/hadoop (hadoop-1.0.0) complete


On Mon, Feb 13, 2012 at 8:26 AM, Trae Barlow <traebarlow@gmail.com> wrote:

> Hah. Snap! I found the UIDs and GIDs... they're in that .diff file =D


>
> On Mon, Feb 13, 2012 at 8:16 AM, Trae Barlow <traebarlow@gmail.com> wrote:
>
>> I found some documentation here... although it pertains to RHEL and
>> Debian and there is a good chance our IDs differ....
>> https://issues.apache.org/jira/browse/HADOOP-7603
>>
>> I'm no pro but by inducing some of the conversations in the above thread
>> I'm guessing any UID or GID that isn't allocated for something else is safe
>> to use?
>>
>> PS: Something else that mind be interesting to the maintainer... some...
>> disenchanting claims are made about FreeBSD and Hadoop...
>>
>> http://search-hadoop.com/m/L1UhF1QJo982/UID+GID+FreeBSD&subj=What+s+the+problem+with+nio+on+FreeBSD+
>>
>>
>>
>> On Mon, Feb 13, 2012 at 8:07 AM, Trae Barlow <traebarlow@gmail.com>wrote:
>>
>>> Well, the poster ^^ was right. The UIDs and GIDs need to be set manually.
>>>
>>> I'm wanting to do this proper... I'm guessing I need to create a user
>>> hadoop, get it's UID and GID then add it to /usr/ports/UIDs /usr/ports/GIDs
>>> ?
>>>
>>> I'm guessing the best way to find out what users I need to create is
>>> documented on the hadoop.apache.org site?
>>>
>>>
>>> On Mon, Feb 13, 2012 at 8:00 AM, Trae Barlow <traebarlow@gmail.com>wrote:
>>>
>>>> SVN worked like a charm. I didn't have devel/hadoop initally I guess
>>>> because I'm running using 9.0 amd_64?
>>>>
>>>> I just ran portsnap fetch too, so the port tree was 100% up to date
>>>> (unless change were made in the last 5 minutes) so that was a non issue.
>>>> https://svn.redports.org/clement/devel/hadoop/
>>>> was the repo that I used and I followed the otherwise unrelated guide
>>>> on how to use Subversion here....
>>>>
>>>> http://developer.berlios.de/docman/display_doc.php?docid=394&group_id=2#checkhttps
>>>>
>>>> I'm installing on a clean environment (only portmaster, diablo-jdk16,
>>>> wget, and subversion installed in that order).
>>>>
>>>> We'll see how things go. I'm glad you folks hadn't given up on me as it
>>>> appears we have found the source of the issue (port tree missing from 9.0?).
>>>>
>>>> On Mon, Feb 13, 2012 at 3:27 AM, Bernhard Froehlich-2 [via FreeBSD] <
>>>> ml-node+s1045724n5478581h42@n5.nabble.com> wrote:
>>>>
>>>>> On 13.02.2012 09:48, Bleakwiser wrote:
>>>>>
>>>>> > I was able to find some better information on the patch command
>>>>> > through
>>>>> > wikipeida, their article on it is really great.
>>>>> >
>>>>> > However I'm still not clear on what files I'm supposed to download
>>>>> to
>>>>> > be
>>>>> > running the patch on. I've dug around inside the .diff file with
>>>>> pico
>>>>> > a bit
>>>>> > and it's rather cryptic. Lots of things are commented (I assume by
>>>>> +)
>>>>> > and I
>>>>> > was also able to find some relevant man pages on 'patch' as opposed
>>>>> > to 'man
>>>>> > diff' i was using earlier.
>>>>> >
>>>>> > The correct command would be 'patch -p1 < hadoop-1.0.0.diff' not
>>>>> just
>>>>> > 'patch -p1' w/o any other arguments, which tells the patch program
>>>>> to
>>>>> > use
>>>>> > the directory structure inside the .diff file. But perhaps piping
>>>>> the
>>>>> > output of 'fetch' handles that all for me?
>>>>> >
>>>>> > However, we are getting way ahead of ourselves here and the same
>>>>> > thing can
>>>>> > be accomplished with different syntax. W/o having the correct
>>>>> > software
>>>>> > apply the patch to there isn't much sense in running the command at
>>>>> > all
>>>>> > anyway. Since I'm not familiar with the rather cryptic contents of
>>>>> > .diff
>>>>> > files I've wasted a good half hour just looking through it's
>>>>> contents
>>>>> > for
>>>>> > some clue as to exactly what I need to be downloading. Of course
>>>>> > there is
>>>>> > always the try and fail technique, where I would just simply try
>>>>> each
>>>>> > tbz
>>>>> > off the site and try and fail until it worked... for some reason I
>>>>> > never
>>>>> > liked that method.
>>>>> >
>>>>> > Thanks and again. I am defiantly not eleete enough to be helping
>>>>> test
>>>>> > this
>>>>> > port so I'll leave it to those informed already on the list. I
>>>>> > wouldn't
>>>>> > want to continue to waste anyone's time w/ trivial questions much
>>>>> > less
>>>>> > waste hours and hours of my own time looking up syntax for nitche
>>>>> CLI
>>>>> > utilities so take care and good luck with the port. It's defiantly a
>>>>> > 'killer app' so for BSD's sake I hope you folks get it.
>>>>> >
>>>>> > And as promiced, the /facepalm of failure...
>>>>> > /facepalm
>>>>>
>>>>>
>>>>> There are at least 2 more ways to get hadoop. Clement has an
>>>>> redports.org
>>>>> account and is working on hadoop there. So you could just checkout his
>>>>> svn tree and get the latest port:
>>>>>
>>>>> 1) just fetch his redports.org repository compressed as tar.bz2:
>>>>>
>>>>> fetch http://redports.org/~clement/svn.tar.bz2
>>>>> tar xvf svn.tar.bz2
>>>>>
>>>>>
>>>>> 2) you need devel/subversion installed for that
>>>>>
>>>>> svn co https://svn.redports.org/clement/
>>>>>
>>>>>
>>>>> Now you need to manually add the hadoop lines in GIDs/UIDs to your
>>>>> /usr/ports/GIDs|UIDs files as well as copying over the devel/hadoop
>>>>> directory to /usr/ports.
>>>>>
>>>>> --
>>>>> Bernhard Froehlich
>>>>> http://www.bluelife.at/
>>>>> _______________________________________________
>>>>> [hidden email] <http://user/SendEmail.jtp?type=node&node=5478581&i=0>mailing list
>>>>> http://lists.freebsd.org/mailman/listinfo/freebsd-ports
>>>>> To unsubscribe, send any mail to "[hidden email]<http://user/SendEmail.jtp?type=node&node=5478581&i=1>"
>>>>>
>>>>>
>>>>>
>>>>> ------------------------------
>>>>>  If you reply to this email, your message will be added to the
>>>>> discussion below:
>>>>>
>>>>> http://freebsd.1045724.n5.nabble.com/CFT-Hadoop-preliminary-port-tp4677071p5478581.html
>>>>>  To unsubscribe from [CFT] Hadoop preliminary port, click here<http://freebsd.1045724.n5.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_code&node=4677071&code=dHJhZWJhcmxvd0BnbWFpbC5jb218NDY3NzA3MXwtMTM3NzMyMDgyNA==>;
>>>>> .
>>>>> NAML<http://freebsd.1045724.n5.nabble.com/template/NamlServlet.jtp?macro=macro_viewer&id=instant_html%21nabble%3Aemail.naml&base=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespace&breadcrumbs=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml>;
>>>>>
>>>>
>>>>
>>>>
>>>> --
>>>> Trae Barlow
>>>>
>>>
>>>
>>>
>>> --
>>> Trae Barlow
>>>
>>
>>
>>
>> --
>> Trae Barlow
>>
>
>
>
> --
> Trae Barlow
>



-- 
Trae Barlow


--
View this message in context: http://freebsd.1045724.n5.nabble.com/CFT-Hadoop-preliminary-port-tp4677071p5479419.html
Sent from the freebsd-ports mailing list archive at Nabble.com.



Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?CAEVfBA_wPA8Hp2LQTTZZbNV7UjOFPpc7nZx5U=nC715er1Nd_A>