Skip to content

This is a CDK pattern for ETL processes using a serverless approach.

Notifications You must be signed in to change notification settings

martinKindall/cdk-etl-eventbridge

Repository files navigation

CDK Patterns - ETL Eventbridge

The original proyect https://github.com/cdk-patterns/serverless/blob/main/the-eventbridge-etl/README.md. I basically rewrited the project using the CDK 2.0.

Deploy

Make sure to have the Docker daemon running, because this project builds a Docker image and pushes it to ECR.

npm run build
cdk deploy

Usage

To trigger the ETL pipeline, upload the example .csv in the data_example folder.

Debug

Every lambda writes logs to CloudWatch. The Observer lambda writes every event sent via Eventbridge to Cloudwatch too.

Useful commands

  • npm run build compile typescript to js
  • npm run watch watch for changes and compile
  • npm run test perform the jest unit tests
  • cdk deploy deploy this stack to your default AWS account/region
  • cdk diff compare deployed stack with current state
  • cdk synth emits the synthesized CloudFormation template

About

This is a CDK pattern for ETL processes using a serverless approach.

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published