Skip to content

Latest commit

 

History

History
51 lines (45 loc) · 2.66 KB

README.md

File metadata and controls

51 lines (45 loc) · 2.66 KB
Raw

Apache Kafka With Spring Boot

Steps I Have Followed(windows):

  1. First of all download apache kafka. from here.
  2. After downloading the kafka_2.12-2.3.0.tgz file extracted it with winzip.

Running the zookeeper

  1. Go to the kafka_2.12-2.3.0 directory.
  2. Run the command from the cmd bin/windows/zookeeper-server-start.bat C:/Apache/kafka_2.12-2.3.0/config/zookeeper.properties.
  3. I have followed their official site at Apache Kafka site.
  4. I had use the full path for configuration file, otherwise it was giving error(not find).
  5. After lots of messages I got zookeeper running on port 2181 which is default in the configuration file. INFO binding to port 0.0.0.0/0.0.0.0:2181.
  6. I have updated my configuration for dataDir as ../logs.

Running the kafka server

  1. Go to the kafka_2.12-2.3.0 directory.
  2. Run the command from the cmd bin/windows/kafka-server-start.bat C:/Apache/kafka_2.12-2.3.0/config/server.properties.
  3. I couldn't run it at the first attempt! Got an error as 'wmic' is not recognized as an internal or external command, operable program or batch file.
  4. So I had to add C:\Windows\System32\wbem as path variable in the Environment Variables.
  5. Again run the command.
  6. This time after lots of messages I got kafka server running on port 9092 which is default in the configuration file. INFO Awaiting socket connections on 0.0.0.0:9092.
  7. I have updated my configuration for dataDir as ../logs here as well.

Creating a topic

  1. Got to the kafka_2.12-2.3.0 directory.
  2. Run the command from the cmd bin/windows/kafka-topics.bat --create --bootstrap-server localhost:9092 --replication-factor 1 --partitions 1 --topic users.
  3. Here my replica is 1, partition is 1 and topic name is users(in my code I named the topic name as users).
  4. I have checked the topic list by running the command bin/windows/kafka-topics.bat --list --bootstrap-server localhost:9092 .
  5. That's all command line part.

So, my zookeeper and kafka server are up & running.

Spring Boot project to produce & consume messages

  1. Go to Spring Initializer.
  2. Add Web & Kafka dependency.
  3. Create the project.
  4. Configure the kafka configuration in application.properties.
  5. Created a producer, a consumer & one controller with an endpoint.
  6. Run the project.
  7. When the project is running go to the endpoint in the browser http://localhost:9000/kafka/publish/myMessage.
  8. The producer will publish the message & the consumer will consume it.
  9. Both will log the message in the console.