Local Hadoop test cluster up and running

Posted on 14 Sep, 2011 in Quantitative Tools | 0 comments

Thanks to Cloudera’s CDH3 image, I have a virtual machine with Hadoop on CentOS 5 working. I’m more of an Ubuntu guy, so CentOS is a new for me. But nothing Google couldn’t solve.

I also ran into a Hadoop exception about the java heap space. I couldn’t find a solution online so I just bumped up the memory on the virtual machine and it solved the problem.

In any case, I managed to run the pi calculation example on my local Hadoop cluster.

Related posts:

  1. Building a distributed back-tester with Hadoop on Amazon AWS
  2. First time setting up JForex on Amazon EC2 t1.micro
  3. I got JForex running smoothly on Amazon EC2 t1.micro!
  4. Choosing a budget VPS provider for hosting automated trading programs
  5. Passing Japan’s hardest test: If there is a certifying exam for trading, this would be like it

Leave a Reply

Your email address will not be published. Required fields are marked *

*

You may use these HTML tags and attributes: <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <strike> <strong>