Hadoop High Availability setup

  • date 7th March, 2019 |
  • by Prwatech |
  • 0 Comments

 

Hadoop High Availability Setup

 

Hadoop High Availability Setup, Welcome to the world of advanced Tutorials on High Availability Cluster in Hadoop technology. Are you looking forward to a High Availability Hadoop configuration Platform? Or looking for some help on how to set up a Hadoop Cluster with high availability? Then you’ve landed on the Right Path which providing advanced based concepts on the Hadoop high availability tutorial. In this tutorial, one can easily explore how to setup Hadoop Cluster with high availability with step by step explanation.

 

There are many possible ways to Create Hadoop high availability setup Platform, just follow the below-mentioned step by step process of How to Set Up Hadoop Cluster with high availability tutorials which were originally designed by India’s Leading Hadoop Training institute Professionals who also offering advanced Hadoop Course and Certification Programs.

 

How to set up a Hadoop Cluster with high availability

 

Step 1: Download the zookeeper from the browser.

 

https://zookeeper.apache.org/releases.html

Step 2: Untar the zookeeper using the terminal by a given command.

 

hadoop high availability setup

 

 Step 3: Download the Hadoop from the browser.

 

https://archive.apache.org/dist/hadoop/core/hadoop-2.6.0/hadoop-2.6.0.tar.gz

 

Step 4: Untar Hadoop using the below command.

 

hadoop high availability setup

 

Step 5: Change the Host Name.

 

hadoop high availability setup

 

Step 6: Update your system.

 

hadoop high availability setup

 

Step 7: Install Java

 

hadoop high availability setup

 

Step 8: Install SSH Server

 

hadoop high availability setup

 

Step 9: Add Java, Hadoop and Zookeeper path in bashrc file.

 

hadoop high availability setup

 

hadoop high availability setup

 

Step 10: Update bashrc file.

 

hadoop high availability setup

 

Step 11: Open core-site.xml inactive name node and add below properties.

 

hadoop high availability setup

hadoop high availability setup

 

Step 12: Open hdfs-site.xml inactive name node and add below properties.

 

hadoop high availability setup

Set Up Hadoop Cluster with high availability Set Up Hadoop Cluster with high availability

Set Up Hadoop Cluster with high availability

Set Up Hadoop Cluster with high availability

 

Step 13: Change the directory and go to zookeeper/conf

 

Set Up Hadoop Cluster with high availability

 

Step 14 : Copy zoo_sample.cfg to zoo.cfg

 

Set Up Hadoop Cluster with high availability

 

Step 15: Edit zoo.cfg file and give the dataDir path

 

Set Up Hadoop Cluster with high availability

Set Up Hadoop Cluster with high availability

Step 16: Make the Clone of this and rename them as NN2 and DN1.

 

 

Step 17: Add each node IP in etc/hosts in every node

 

 

Set Up Hadoop Cluster with high availability

 

Step 18: Generate ssh key and copy in each other.

 

Step 19: Go to DN1 and open hdfs-site.xml and this property

 

 

Set Up Hadoop Cluster with high availability

Set Up Hadoop Cluster with high availability

 

Step 20: Go to NN1 and in zookeeper metadata directory create one file myid and add number 1.

 

 

Set Up Hadoop Cluster with high availability

Set Up Hadoop Cluster with high availability

 

Step 21: Go to NN2 and in zookeeper metadata directory create one file myid and add number 2.

 

High Availability hadoop configuration

High Availability hadoop configuration

 

Step 22: Go to NN2 and in zookeeper metadata directory create one file myid and add number 3

 

High Availability hadoop configuration

High Availability hadoop configuration

 

Step 23: Start the journal node in all nodes.

 

High Availability hadoop configuration

High Availability hadoop configuration

 

Step 24:  write jps in all node

 

High Availability hadoop configuration

 

Step 25: Format name node in NN1

 

High Availability hadoop configuration

 

Step 26: Start name node in NN1

 

High Availability hadoop configuration

 

Step 27: Go to NN2 and copy metadata from NN1 to NN2

 

High Availability hadoop configuration

 

Step 28: Start name node in NN2

 

High Availability hadoop configuration

 

Step 29: Now Start Zookeeper service in all three nodes.

 

High Availability hadoop configuration

High Availability hadoop configuration

High Availability hadoop configuration

 

Step 30: Run Jps in NN1

 

High Availability hadoop configuration

 

Step 31: Kill the NameNode process

kill -9 3776

and refresh the UI of Standby NameNode it will be active now

 

Get success in your career as a Hadoop developer by being a part of the Prwatech, India’s leading Hadoop training institute in Bangalore.

 

 

 

 

Leave a Reply

Your email address will not be published. Required fields are marked *

Quick Support

image image