Spark Streaming Kafka Tutorial – Spark Streaming with Kafka

Spark streaming Kafka tutorial, In this tutorial, one can easily know the information about Kafka setup for spark streaming which is available and are used by most of the Spark developers. Are you dreaming to become to certified Pro Spark Developer, then stop just dreaming, get your Apache Spark Scala certification course from India’s Leading Apache Spark Scala Training institute.

In this tutorial, we will learn Kafka setup for spark streaming. We will learn various steps for how to read from Kafka and write to Kafka. We will start with platform requirements for Kafka setup for spark streaming, Spark Streaming example code. Do you want to set up Kafka for spark streaming, So follow the below mentioned Spark streaming Kafka tutorial from Prwatech and take Apache Spark Scala training like a pro from today itself under 15+ Years of Hands-on Experienced Professionals.

Kafka setup for Spark Streaming

Step 1:Download Kafka from this link

https://www.apache.org/dyn/closer.cgipath=/kafka/0.11.0.0/kafka_2.11-0.11.0.0.tgz

Step 2:Untar using this command

Step 3: Use the cd command to get into the directory

cd kafka_2.11-0.11.0.0

Step 4:Open a terminal and run

bin/zookeeper-server-start.shconfig/zookeeper.properties

Step 5:Open another terminal and run

bin/Kafka-server-start.shconfig/server.properties

Step 6:Open another terminal and run

bin/Kafka-topics.sh –create –zookeeper localhost:2181 –replication-factor 1 –partitions 1 –topic test2

bin/Kafka-topics.sh –list –zookeeper localhost:2181 test2

bin/kafka-console-producer.sh –broker-list localhost:9092 –topic test2

Hello World

Hello India

Step 7:Open another terminal and run

bin/Kafka-console-consumer.sh –bootstrap-server localhost:9092 –topic test2 –from-beginning

Whatever is typed in producer prompt, will be shown here

HelloWorld

HelloIndia

Interested in learning more? Become a certified expert in Apache Spark by getting enrolled from Prwatech E-learning India’s leading advanced Apache Spark training institute in Bangalore.