Insprired by the video High Performance Kafka Producers in Python from Kris Jenkins:
It reads from the GitHub Firehose using Server-Sent Events (SSE) and publishes that data to a topic in Apache Kafka or Redpanda.
Install the requirements first:
pip install -r requirements.txt
Run the main application:
python main.py
You can find these in the accompanying .env file.
output = github-data
Quix__Broker__Address = localhost:19092