C# and F# language binding and extensions to Apache Spark
A end-to-end real-time stock market data pipeline with Python, AWS EC2, Apache Kafka, and Cassandra Data is processed on AWS EC2 with Apache Kafka and stored in a local Cassandra database.
Stream real time Tweets of current affairs like covid-19 using Kafka 2.0.0 high throughput producer & consumer into Elasticsearch using safe, idempotent and compression configurations. Aggregate the data and use it for further analytics.
Build a Kafka streaming app using IBM Streams
A pipeline that consumes twitter data to extract meaningful insights about a variety of topics using the following technologies: twitter API, Kafka, MongoDB, and Tableau.
This project implements an end-to-end pipeline for batch to stream processing using Kafka on Docker images. Besides that, there are exercises for a full course in Kafka.
Kafka streaming performance tests.
Data streaming project with Apache Druid & Grafana: Real-time data processing, alerts, integration with AWS. It uses a combination of technologies and services, including Confluent-Kafka, Apache Druid, AWS SNS, EC2, Athena, S3, Glue and EventBridge, StepFunctions. Contribute to this powerful solution!
🎶 Scripts for music feature analysis, model training, and real-time recommendation using Apache Kafka. Extract features with Librosa 🎹, store them in MongoDB 🗄️, and process the data with Apache Spark ⚡. A 🌐 web interface 💻✨ is also included. Contributors: Tashfeen Abbasi 👤, Laiba Mazhar 👤, and Rafia Khan 👤.
The purpose of this project is to learn, develop and explore microservices using spring boot, spring cloud, event streaming
Base project for kafka-streams development and testing
The objectives of this project are to get experience of coding with: Spark, Spark SQL, Spark Streaming, Kafka, Scala and functional programming
Tests with Spark local, kafka streaming and socket streaming
Using kafka streaming to implement the streaming ETL job, append data onto GCP Big Query after formatting.
Example from Designing Event-driven Applications Using Apache Kafka Ecosystem By Bogdan Sucaciu m 5
This repository is a comprehensive guide and toolkit for anyone looking to understand and implement data streaming solutions using Apache Kafka.
Consumer Producer Components
Add a description, image, and links to the kafka-streaming topic page so that developers can more easily learn about it.
To associate your repository with the kafka-streaming topic, visit your repo's landing page and select "manage topics."