STOCK DATA STREAMING AND ANALYSIS

DESCRIPTION

• This project is basically for collecting enormous data and analysing it.
• It includes live streaming of data from FOREX ( Foreign Exchange ) trading API and Electric Vehicle stocks API.
• The data is fetched and processed using Kafka Streaming and Spark streaming.
• Throughout this project stocks of Forex data and Electric Vehicle parts making companies data were analyzed and business use case is implemented.
• The analyzed data is then visualized by plotting different graphs using python libraries.

STREAMING TOOLS

• Websocket,
• Requests library,
• Pandas datareader library,
• Netcat,
• API : Tiingo API,Alpha Vantage API.
• data visualization tool: matplotlib,Seaborn

TECHNOLOGIES USED:

• Spark
• Kafka
• Pyspark

Project Flow

ROLES AND RESPONSIBILITIES

• DATA STREAMING AND SPARK submit job- Rajib’s team
• Use cases- Eshwar’s team
• Visualization- Karan’s team
• EV stock use case-Kareem's team
• Deployment-Trupti’s Team

This project uses the following license: MIT License