Skip to content

Latest commit

 

History

History
83 lines (68 loc) · 6.7 KB

README.md

File metadata and controls

83 lines (68 loc) · 6.7 KB
Raw

AWS ECS Airflow Datadog Agent Terraform module

Features

For a given ECS cluster this module creates a service which maintains one task definition to run one datadog agent container.
The container can be assessed by the service discovery endpoint.

The default configuration is focused to monitor Airflow.

How to use it

Example:

module "airflow_monitoring" {
  source = "github.com/gfkse/ecs_airflow_datadog_module?ref=<x.y.z>"

  dd_api_key_parameter_name = "/datadog/apiKey"
  airflow_ecs_cluster_name  = "my-cluster"
  resource_prefix           = "airflow"
  vpc_id                    = "<vpc_id>"
  subnet_ids                = "<subnet_ids>"
  service_endpoint_url      = "http://example.com"
}

Requirements

No requirements.

Providers

Name Version
aws n/a
template n/a

Modules

No modules.

Resources

Name Type
aws_ecs_service.datadog resource
aws_ecs_task_definition.datadog resource
aws_iam_policy.datadog_task_execution_role_policy resource
aws_iam_policy.datadog_task_execution_role_policy_with_kms_key resource
aws_iam_role.datadog_task_execution_role resource
aws_iam_role_policy_attachment.datadog_tasks_execution_role_policy_attachment resource
aws_iam_role_policy_attachment.datadog_tasks_execution_role_policy_attachment_with_kms_key resource
aws_security_group.sg_datadog_internal resource
aws_service_discovery_private_dns_namespace.datadog resource
aws_service_discovery_service.datadog resource
aws_caller_identity.current data source
aws_ecs_cluster.airflow-ecs-cluster data source
aws_region.current data source
aws_vpc.selected_vpc data source
template_file.dd_dogstatsd_mapper_profiles data source

Inputs

Name Description Type Default Required
airflow_ecs_cluster_name Name of the airflow ECS cluster for which the datadog monitoring will be attached. string n/a yes
datadog_container_cpu Desired container cpu. number 10 no
datadog_container_memory Desired container memory. number 256 no
datadog_task_definition https://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/aws-properties-ecs-taskdefinition-containerdefinitions.html list(object({})) null no
datadog_task_definition_cpu Desired task definition cpu. string null no
datadog_task_definition_file_dd_statsd_mapper_profiles https://docs.datadoghq.com/developers/dogstatsd/dogstatsd_mapper/ string null no
datadog_task_definition_memory Desired task definition memory. string null no
datadog_task_definition_network_mode n/a string "awsvpc" no
dd_api_encryption_kms_key_id Required only if your secret uses a custom KMS key and not the default key. The ARN for your custom key should be added as a resource. string "" no
dd_api_key_parameter_name The name of the parameter store secret containing the key to access Datadog API. string n/a yes
region n/a string n/a yes
resource_prefix Prefix name for the resources. string n/a yes
service_endpoint_url The url of the service to check whether it can connect and is healthy: https://docs.datadoghq.com/integrations/airflow/?tab=containerized#configuration string n/a yes
subnet_ids The VPC's private Subnet IDs, where rds, elasticache, alb and ecs cluster will reside. list(string) n/a yes
tags A mapping of tags to assign to the resources in the module. map(string) {} no
vpc_id ID of VPC, where rds, elasticache, alb and ecs cluster will reside. string n/a yes

Outputs

Name Description
service_discovery_endpoint n/a