Tuesday, 16 August 2016

installation of Hadoop-2.6.0

                         Steps to Install hadoop on  ubuntu




1. Install Jdk 1.6 or greater here.
2. Download the required hadoop tar file .
3. Extract by tar xvzf hadoop-2.6.0.tar.gz in terminal.
4. update the JAVA_HOME inside the hadoop-env.sh file.
5. update your bashrc by 
    $sudo gedit .bashrc

paste this export lines atlast line
export HADOOP_HOME=/home/ratul/hadoop-2.6.0
export HADOOP_CONF_DIR=/home/ratul/hadoop-2.6.0/etc/hadoop
export HADOOP_MAPRED_HOME=/home/ratul/hadoop-2.6.0
export HADOOP_COMMON_HOME=/home/ratul/hadoop-2.6.0
export HADOOP_HDFS_HOME=/home/ratul/hadoop-2.6.0
export YARN_HOME=/home/ratul/hadoop-2.6.0

export JAVA_HOME=/usr/lib/jvm/java-8-openjdk-i386
export PATH=$PATH:/home/ratul/hadoop-2.6.0
export HADOOP_USER_CLASSPATH_FIRST=true

6. modify your core-site.xml, hdfs-site.xml yarn-site.xml and mapred-site.xml.
7. Install ssh on your system using sudo apt-get install ssh.
8. run the below two commands to save the auth keys.
       $ ssh-keygen -t dsa -P '' -f ~/.ssh/id_dsa
       $ cat ~/.ssh/id_dsa.pub >> ~/.ssh/authorized_keys
9. now your system is setup and installed with hadoop, format your namenode
   > go to bin folder of hadoop-2.6.0 then run below command
     $ ./hadoop namenode -format
10. now go to sbin folder of hadoop-2.6.0
11. run ./start-all.sh to run your namenode,datanode,secondarynamenode,resourcemanager and nodemanager.
12. You can view the namenode on http://localhost:50070
13. You can view the cluster at http://localhost:8088

No comments:

Post a Comment