Saturday, November 23, 2013

Hadoop 2 setup on local environment

Short notes

- Follow http://raseshmori.wordpress.com/2012/10/14/install-hadoop-nextgen-yarn-multi-node-cluster/
- enable ssh to localhost
- install open ssh client etc
- change mapredude.shuffle to mapreduce_shuffle in the xml file in abive blog.
   - http://www.thecloudavenue.com/2012/01/getting-started-with-nextgen-mapreduce.html
- change all master: hosts in all *.xml files etc to locahost
 e.g

    yarn.resourcemanager.resource-tracker.address
    localhost:8031
 
 
    yarn.resourcemanager.scheduler.address
    localhost:8030
 
 
    yarn.resourcemanager.address
    localhost:8040
 




No comments: