Spark Streaming Kafka Tutorial

  • date 6th March, 2019 |
  • by Prwatech |
  • 1 Comments

 

Spark Streaming Kafka Tutorial – Spark Streaming with Kafka

Spark streaming Kafka tutorial, In this tutorial, one can easily know the information about Kafka setup for spark streaming which is available and are used by most of the Spark developers. Are you dreaming to become to certified Pro Spark Developer, then stop just dreaming, get your Apache Spark Scala certification course from India’s Leading Apache Spark Scala Training institute.

 

In this tutorial, we will learn Kafka setup for spark streaming. We will learn various steps for how to read from Kafka and write to Kafka. We will start with platform requirements for Kafka setup for spark streaming, Spark Streaming example code. Do you want to set up Kafka for spark streaming, So follow the below mentioned Spark streaming Kafka tutorial from Prwatech and take Apache Spark Scala training like a pro from today itself under 15+ Years of Hands-on Experienced Professionals.

 

Kafka setup for Spark Streaming

 

Step 1:Download Kafka from this link

 

https://www.apache.org/dyn/closer.cgipath=/kafka/0.11.0.0/kafka_2.11-0.11.0.0.tgz

 

Step 2:Untar using this command

 

Spark Streaming Kafka Tutorial

 

Step 3: Use the cd command to get into the directory

 

cd kafka_2.11-0.11.0.0

 

Spark Streaming Kafka Tutorial

 

Step 4:Open a terminal and run

 

bin/zookeeper-server-start.shconfig/zookeeper.properties

 

Spark Streaming Kafka Tutorial

 

Step 5:Open another terminal and run

 

bin/Kafka-server-start.shconfig/server.properties

 

Spark Streaming Kafka Tutorial

 

Step 6:Open another terminal and run

 

bin/Kafka-topics.sh –create –zookeeper localhost:2181 –replication-factor 1 –partitions 1 –topic test2

 

Spark Streaming Kafka Tutorial

 

bin/Kafka-topics.sh –list –zookeeper localhost:2181 test2

 

Spark Streaming Kafka Tutorial

 

bin/kafka-console-producer.sh –broker-list localhost:9092 –topic test2

 

Spark Streaming Kafka Tutorial

 

Hello World

Hello India

 

Step 7:Open another terminal and run

 

bin/Kafka-console-consumer.sh –bootstrap-server localhost:9092 –topic test2 –from-beginning

 

Spark Streaming Kafka Tutorial

 

Whatever is typed in producer prompt, will be shown here

HelloWorld

HelloIndia

 

Interested in learning more? Become a certified expert in Apache Spark by getting enrolled from Prwatech E-learning India’s leading advanced Apache Spark training institute in Bangalore.

One thought on “Spark Streaming Kafka Tutorial”

Leave a Reply

Your email address will not be published. Required fields are marked *

Quick Support

image image