Spark Installation in Ubuntu

  • date 31st March, 2021 |
  • by Prwatech |
  • 0 Comments

Prerequisites

Hardware requirements:

Local machine

RAM 8 gb or above

Software requirements:

VMware Workstation , Version : 16 pro

Download the software from given link :- https://prwatech.in/blog/software-installation/vmware-workstation-installation/

Ubuntu , Version:18.04 :- https://prwatech.in/blog/software-installation/vmware-workstation-installation/

Programming languages: Linux

Learn Linux :  https://prwatech.in/blog/linux/linux-architecture/

1.Install java

Command: $sudo apt-get install openjdk-8-jdk

2. check the java version whether it is installed

3. Download spark in terminal by using following command :

wget https://archive.apache.org/dist/spark/spark-2.4.0/spark-2.4.0-bin-hadoop2.7.tgz

4. Untar the file using following command :

tar -xvf spark-2.4.0-bin-hadoop2.7.tgz

5. Edit bashrc file

6. Add the following lines in bashrc file

export SPARK_HOME=/home/user/spark-2.4.0-bin-hadoop2.7

export PATH=$PATH:$SPARK_HOME/bin

7. Save the bashrc file

8. Run spark-shell from the bin directory of spark

9. Spark installation is completed now you can write query

Quick Support

image image