Spark_projects

Spark and Python for Big Data with PySpark * course notebooks.

Installation of Spark on Windows *.

• Spark DataFrame
  • Basics
  • Basic Operations
  • GroupBy and Aggregations
  • Missing Data
  • Dates and Timestamps
  • Project Exercise with Wallmart Stock Data
• Spark MLib
  • Linear Regression
    • Analysis and prediction with E-Commerce data
    • Hyundai Consulting Project for Cruise Ship Crew prediction
  • Logistic Regression
    • Prediction of survival rate in Titanic accident
    • Customer Churn prediction
  • Tree Algorithms
    • Predicting private colleges with USA College data
    • Identification of most important ingredient in Dog Food with Random Forest classification
  • Clustering
    • Determination of Seed species
    • Hacker identification consulting project
  • Natural Language Processing
    • NLP Tools
    • Spam Detection System
  • Collaborative Filtering
    • Movie Recommendation System with Alternating Least Squares algorithm