Spark Streaming Kafka Tutorial - Spark Streaming with Kafka
Spark streaming Kafka tutorial, In this tutorial, one can easily know the information about Kafka setup which is available and are used by most of the Spark developers. Are you dreaming to become to certified Pro
Spark Developer, then stop just dreaming, get your
Apache Spark Scala certification course from India’s Leading
Apache Spark Scala Training institute.
Kafka setup for Spark Streaming
Step 1:Download Kafka from this link
https://www.apache.org/dyn/closer.cgipath=/kafka/0.11.0.0/kafka_2.11-0.11.0.0.tgz
Step 2:Untar using this command
Step 3: Use the cd command to get into the directory
cd kafka_2.11-0.11.0.0
Step 4:Open a terminal and run
bin/zookeeper-server-start.shconfig/zookeeper.properties
Step 5:Open another terminal and run
bin/Kafka-server-start.shconfig/server.properties
Step 6:Open another terminal and run
bin/Kafka-topics.sh --create --zookeeper localhost:2181 --replication-factor 1 --partitions 1 --topic test2
bin/Kafka-topics.sh --list --zookeeper localhost:2181 test2
bin/kafka-console-producer.sh --broker-list localhost:9092 --topic test2
Hello World
Hello India
Step 7:Open another terminal and run
bin/Kafka-console-consumer.sh –bootstrap-server localhost:9092 --topic test2 –from-beginning
Whatever is typed in producer prompt, will be shown here
HelloWorld
HelloIndia
Interested in learning more? Become a certified expert in Apache Spark by getting enrolled from
Prwatech E-learning India’s leading advanced
Apache Spark training institute in Bangalore.
Spark streaming Kafka tutorial
Interested in learning more?
Interested in learning more? Become a certifiy expert in Apache Spark by getting enroll from
Prwatech E-learning India’s leading advanced
Apache Spark training institute in Bangalore.
