Site Sponsors:
Hadoop, Ununtu, and Maven ... Oh My! 

Light Musings


While I am indeed gratified that my blog helps others out, from time to time one cannot help but to wonder if it is more about self-documentation ... One never knows when the same path must be trod!

Oh well, no matter if others have staunchly refused to upgrade their 'Gnome or not - For me & for now the task for the day was to get Hadoop working with the latest edition of Hortonworks, Windows, Ubuntu, Eclipse Kepler, and the code from that latest copy of "Hadoop: The Definitive Guide, 3rd Edition."

Here are the key dependancies:

Hadoop 2.2.0 (finally here!)
Hortonworks 2.0
The 3rd Edition Code

Honourable Mention:
Protocol Buffers - Google's data interchange format
Copyright 2008 Google Inc.
http://code.google.com/apis/protocolbuffers/


Upgrading to Maven 3


When it came to the mainstream, the maven2 under Ubuntu was simply a no-go. Version 3.0.* was required for the book. Higher is also required for creating Hadoop.

Following the thread of ideas found here, after removing maven2, here is what worked to get that first pass at those POMs a 'poppin:
sudo -H gedit /etc/apt/sources.list

Add the following line the sources.list file:

deb http://ppa.launchpad.net/natecarlson/maven3/ubuntu precise main
deb-src http://ppa.launchpad.net/natecarlson/maven3/ubuntu precise main

Then we can:
sudo apt-get update && sudo apt-get install maven3
sudo ln -s /usr/share/maven3/bin/mvn /usr/bin/mvn
sudo ln -s /usr/bin/mvn3 /usr/bin/mvn

Other Obsolescence


Next was the need to get a few of those c-libs up to spec. That bit of sage advice came from here.

Since we need to install manually, we will need to have g++ installed:
sudo apt-get install g++

Next, we will need to get the source code:
wget http://protobuf.googlecode.com/files/pr ... 5.0.tar.gz
tar xzvf protobuf-2.5.0.tar.gz
cd protobuf-2.5.0
./configure
make
make check
sudo make install
sudo ldconfig

Finally, since the version was indeed the killer here, be sure to re-check the above newly-installed version:
$ protoc --version
libprotoc 2.5.0

So far all is well (i.e. the locus is still building as I type this) ...

Cheers,

'Da Nag.

[ view entry ] ( 1674 views )   |  permalink  |  related link

<<First <Back | 43 | 44 | 45 | 46 | 47 | 48 | 49 | 50 | 51 | 52 | Next> Last>>