v0.0.19

What's Changed

• Fix issue with emr serverless timeout introduced in #43

v0.0.18

• Add timeout for EMR Serverless jobs

v0.0.17

What's Changed

• Pin poetry to Python 3.7-compat version by @dacort in #40

Full Changelog: v0.0.16...v0.0.17

v0.0.16 - EMR on EKS Support

Overview

With this release, you can now deploy PySpark jobs across all 3 EMR deployment options - EMR on EC2, EMR on EKS, and EMR Serverless. By swapping out the --cluster-id, --virtual-cluster-id, and --application-id parameters, the EMR CLI will package and submit your job with the relevant job configuration.

What's Changed

• Add EMR on EKS support by @dacort in #38

Installation

Use python3 -m pip install -U emr-cli to install or upgrade to the latest version.

Full Changelog: v0.0.15...v0.0.16

v0.0.15 - Fix EMR on EC2 spark-submit and job params

What's Changed

• Add support for spark-submit params and job args in EMR on EC2 by @dacort in #35

Full Changelog: v0.0.14...v0.0.15

v0.0.14 - Python 3.7 Compat

The previous release broke Python 3.7 compatibility and this release fixes that.

What's Changed

• Bump urllib3 from 1.26.17 to 1.26.18 by @dependabot in #31
• Fix Python3.7 breakage by @dacort in #33

New Contributors

• @dependabot made their first contribution in #31

Full Changelog: v0.0.13...v0.0.14

v0.0.13 - Save config

With this release, you can now use the --save-config flag on the emr run command to save your configuration options to the .emr/config.yaml file. With this, you can now use emr run with no options and it will re-use your previous configuration. Enjoy!

What's Changed

• Add support for --save-config for the run command by @dacort in #28

Full Changelog: v0.0.12...v0.0.13

v0.0.12 - EMR on EC2 Runtime Roles 🎉

Thanks to @chrisabbott you can now use --job-role with --cluster-id to run a job on EMR on EC2 with runtime roles!

In addition, we added a new --target to the emr bootstrap command if you'd like to test out this new feature.

emr bootstrap --target emr-ec2 \
    --code-bucket emrclitest-logsbucket003 \
    --job-role-name emrec2-jobrun \
    --instance-profile-name emrec2-instanceprofile

emr run --entrypoint <your_script.py> --build --show-stdout

What's Changed

• Feature/runtime roles by @chrisabbott in #21
• EMR EC2 bootstrap by @dacort in #23

New Contributors

• @chrisabbott made their first contribution in #21

Full Changelog: v0.0.11...v0.0.12

v0.0.11 - Minor cosmetic improvements

What's Changed

• Pretty uploader by @dacort in #19
  

Full Changelog: v0.0.10...v0.0.11

v0.0.10 - EMR on EC2 run fix

What's Changed

• Fixes a small bug with the emr run command with EMR on EC2

Full Changelog: v0.0.9...v0.0.10