Prerequisites
Hardware requirements:
Local machine
RAM 8 GB or above
software requirements:
VMware Workstation: https://prwatech.in/blog/software-installation/vmware-workstation-installation/
Ubuntu 10.x or above: https://prwatech.in/blog/software-installation/vmware-workstation-installation/
Programming language: Linux
Learn Linux: https://prwatech.in/blog/linux/linux-architecture/
1.Open the ubuntu vm in VMware Workstation
2. Power on the virtual machine
3.Open the Terminal
4.Update the repository
command: sudo apt-get update
password is password
5.Install java
Command: sudo apt-get install openjdk-8-jdk
6.check the java version whether it is installed or not
7.Install openssh-server
Command: sudo apt-get install openssh-server
Type 'y' if asked and password is the password
8. Download and extract hadoop: http://prwatech.in/online-softwares/
9. Now go to the directory where the hadoop is downloaded and extract the hadoop folder in the terminal by using command : tar -xvf hadoop- 1.2.0.tar.gz
10. Get into hadoop-1.2.0 directory
11. Go to conf directory and type ls
12. Edit core-site.xml
Command: sudo gedit core-site.xml
Now add the below lines:
<property>
<name>fs.default.name</name>
<value>hdfs://localhost:8020</value>
</property>
13. Edit mapred-site.xml
Command: sudo gedit mapred-site.xml
Add the below lines:
<property>
<name>mapred.job.tracker</name>
<value>localhost:8021</value>
</property>
14. Edit hdfs-site.xml
Command: sudo gedit hdfs-site.xml
Add the below lines:
<property>
<name>dfs.replication</name>
<value>1</value>
</property>
<property>
<name>dfs.permissions</name>
<value>false</value>
</property>
15. Add java home path in hadoop-env.sh file
Command: gedit hadoop-env.sh
Uncomment the below shown export and add the below the path to your JAVA_HOME:
16. Create a ssh key
Command: ssh-keygen -t rsa
17. Moving the key to authorized key
Command: cat $HOME /.ssh /id_rsa.pub>>$HOME/ .ssh/ authorized_keys
18. Copy the key to other hosts
Command: ssh-copy-id -i $HOME/.ssh/id_rsa.pub user@hostname
19. Get into your bin directory.
20. Format the name node
Command: sh hadoop namenode –format
21. Start the nodes
Command: sh start-all.sh
22. To check hadoop started correctly type 'jps' command
Command: jps
Note- if you get the above output by typing jps command then you have successfully installed hadoop 1.2.0
