Skip to content

Releases: daniel-cortez-stevenson/cookiecutter-pyspark-cloud

v0.0.1-alpha

07 May 02:34
Compare
Choose a tag to compare
v0.0.1-alpha Pre-release
Pre-release

First working iteration of cookiecutter-pyspark-cloud. It for sure ran without error at least one time!

Open Issues

Some issues remain 👷:

  • 🚨 Network ACL policies (especially for the private subnet) are not fully secure
  • EMR bootstrap scripts and init Steps should have better usage / extending documentation
  • 🚨 Bucket policies for AWS S3 buckets have not been suggested, and no templating for S3 infrastructure is present
  • Features / What's cool needs to be documented
  • References to similar projects and inspiration need to be inserted
  • 🚨 Tests for Python modules, PySpark jobs, pyspark_entrypoint.py, cli.py need to be written ... 👀