I'm a passionate Data Engineer specializing in building scalable data pipelines, data warehousing, and analytics solutions. With a strong background in data science and engineering, I enjoy tackling complex data challenges and leveraging data to drive business insights.
- Recently completed a Master of Science in Data Science at Indiana University.
- Nearly 2 years of experience in data engineering, focusing on building and optimizing data pipelines using AWS, GCP, and Snowflake.
- Proficient in programming languages such as Python, Java, and SQL, with hands-on experience in big data analytics like PySpark, Kafka and in visualization tools like Tableau and Power BI.
- Enthusiastic about emerging technologies, machine learning, and Gen AI.
- Data Engineer: Developed and maintained data pipelines with Docker and Airflow for processing and analyzing text data and metadata from book files.
- Data Analytics Engineer: Conducted research and integrated diverse data sources at the O'Neil School of Public and Environmental Affairs, significantly improving data accuracy and retrieval speed.
- Associate Data Engineer: Worked at Accenture, focusing on HR and Payroll data, enhancing operational efficiency through innovative data solutions.
- Languages: Python, Java, SQL, R, C
- Tools & Technologies: Docker, Airflow, AWS, Snowflake, Tableau, Power BI, Neo4j, ChatHuggingface
- Concepts: Data Engineering, Data Warehousing, ETL, Data Modeling, Machine Learning
- Reddit Data Engineering Pipeline: Led the development of a robust data pipeline using Apache Airflow, Docker, and AWS, extracting data with Python and PRAW API for improved efficiency.
- Financial Data Streaming Pipeline: Built a data ingestion pipeline using Docker, Kafka, and Spark, optimizing real-time data processing for financial analytics.
- Real-Time Food Delivery Data Analytics: Developed a data processing pipeline using AWS Kinesis and PySpark Streaming, enhancing analysis capabilities through a QuickSight dashboard.
- CRNY Survey Data Analysis: Analyzed survey data to explore guaranteed income's impact on artistic communities in New York, providing insights into demographics, enrollment, financial wellness, and COVID-19 effects.
- Global Football Transfer Market Analysis: Conducted a comprehensive analysis of the football transfer market across the top 5 global leagues, examining financial trends and player transfer dynamics.
Feel free to reach out or connect with me on LinkedIn or through email at nagamanohar07@gmail.com.
Thanks for visiting my GitHub profile! π