How to Build an Optimal Hadoop Cluster

Re:How to Build an Optimal Hadoop Cluster by oellegaard on Wednesday January 02, 2013 @10:17AM (#4997064)

I recently tried to setup a hadoop cluster, just for the fun of it - but I found it slightly painful. Does anyone know if there are good puppet modules available for configuring everything? I wasn't able to find any.

[ Parent | on HN ]

Re:How to Build an Optimal Hadoop Cluster by photorized on Wednesday January 02, 2013 @01:51PM (#4998434)

Both Cloudera (CDH) and Hortonworks (HDP) distros make it easy to configure small clusters.

You just need to make sure all nodes have clocks properly set and synchronized, hostnames and DNS names are set for each machine, SE Linux is turned off, and firewall settings (on each node) allow machines to talk to each other.

Also, Dell offers a downloadable Crowbar ISO for Hadoop - and that's Puppet-based, if you are familiar with Puppet.

[ Parent | on HN ]

Re:How to Build an Optimal Hadoop Cluster by Littleme on Wednesday January 02, 2013 @12:45PM (#4997934)

I hate to sound like a shill for the company I work for, but Cloudera Manager (https://ccp.cloudera.com/display/SUPPORT/Cloudera+Manager+Do...) is free for up to 50 nodes and makes installation a breeze.

[ Parent | on HN ]