PySpark Raspberry Pi Cluster Project

This repo is being used to document my project for building a small raspberry pi cluster running spark. Similar to this article which I used as a guide, I only wanted to have to use a single wall plug for the entire setup. I also wanted to minimize the footprint of the cluster. In this example all of the devices except for the USB hub are powered by USB. I have broken the project into 3 sections: building the cluster, setting up the os, and configuring spark.

Shopping List

• 3 - Raspberry Pi 3b, (I also added an old 2b, not show in some pictures, but added it later)
• 1 - GeauxRobot Raspberry Pi 3 Model B 4-layer Dog Bone Stack (case)
• 1 - Anker PowerPort 6 (60W 6-Port USB Charging Hub) (power supply)
• 1 - Black Box USB-Powered 10/100 5-Port Switch
• 4 - 6" Ethernet Network Cables

System Monitor

The following plot shows the cluster usage over the last 24 hours.