-
-## `run-instance`
-
-
-
-## Command line
-
-### AWS development
-
-```bash
-$ cd ${GOPATH}/src/github.com/DataDog/datadog-agent
-$ aws-vault exec ${DEV} -- inv -e e2e-tests -t dev --agent-image datadog/agent-dev:master --dca-image datadog/cluster-agent-dev:master
-```
-
-### Locally (Linux only)
-
-```bash
-$ inv -e e2e-tests -t local --agent-image datadog/agent-dev:master --dca-image datadog/cluster-agent-dev:master
-```
-
-# Argo workflow
-
-The argo documentation is available [here](https://argo-cd.readthedocs.io/en/stable/), there are a lot of examples [here](https://github.com/argoproj/argo/tree/master/examples) too.
-
-## Argo assertion
-
-To assert something in an argo workflow, you need to create a mongodb query:
-```yaml
-name: find-kubernetes-state-deployments
-activeDeadlineSeconds: 200
-script:
- image: mongo:3.6.3
- command: [mongo, "fake-datadog.default.svc.cluster.local/datadog"]
- source: |
- while (1) {
- var nb = db.series.find({
- metric: "kubernetes_state.deployment.replicas_available",
- tags: {$all: ["namespace:default", "deployment:fake-datadog"] },
- "points.0.1": { $eq: 1} });
- print("find: " + nb)
- if (nb != 0) {
- break;
- }
- prevNb = nb;
- sleep(2000);
- }
-```
-
-This is an infinite loop with a timeout set by `activeDeadlineSeconds: 200`.
-The source is EOF to the command, equivalent to:
-```bash
-mongo "fake-datadog.default.svc.cluster.local/datadog" << EOF
-while (1)
-[...]
-EOF
-```
-
-Try to maximise the usage of MongoDB query system without rewriting too much logic in JavaScript.
-
-See some examples [here](./containers/fake_datadog/README.md#find)
-
-To discover more MongoDB capabilities:
-- [find](https://docs.mongodb.com/manual/tutorial/query-documents/)
-- [aggregation](https://docs.mongodb.com/manual/aggregation/)
-
-## Argo container
-
-If you need to add a non existing public container in the workflow, create it in the [container directory](./containers).
-
-But, keep in mind this become an additional piece of software to maintain.
-
-# Upgrade - bump
-
-This section helps you to upgrade any part of the end to end testing.
-
-The current end to end testing pipeline relies on:
-* [Argo](https://github.com/argoproj/argo)
-
-Upgrade Argo version by changing version in `test/e2e/scripts/run-instance/20-argo-download.sh` and setting new checksum value in `test/e2e/scripts/run-instance/argo.sha512sum`
-
-* [Kind](https://kind.sigs.k8s.io/)
-
-Upgrade Kind version by changing version in `test/e2e/scripts/run-instance/10-setup-kind.sh`.
-By default Kind will use the latest stable Kubernetes known at the time of Kind release.
-
-* [Fedora CoreOS](https://getfedora.org/en/coreos?stream=stable)
-
-You don't need to update CoreOS version as the setup script (`test/e2e/scripts/setup-instance/00-entrypoint-[dev|gitlab].sh`) always uses the latest `stable` version by default.
-
-If needed, use the [ignition-linter](https://coreos.com/validate/) to validate any changes.
diff --git a/test/e2e/argo-workflows/cspm-workflow.yaml b/test/e2e/argo-workflows/cspm-workflow.yaml
deleted file mode 100644
index c124dbf807d74..0000000000000
--- a/test/e2e/argo-workflows/cspm-workflow.yaml
+++ /dev/null
@@ -1,121 +0,0 @@
-apiVersion: argoproj.io/v1alpha1
-kind: Workflow
-metadata:
- generateName: argo-datadog-agent-
-spec:
- entrypoint: main
- onExit: exit-handler
- arguments:
- parameters:
- - name: datadog-agent-image-repository
- - name: datadog-agent-image-tag
- - name: datadog-agent-site
- - name: datadog-cluster-agent-image-repository
- - name: datadog-cluster-agent-image-tag
- - name: ci_commit_short_sha
- - name: ci_pipeline_id
- - name: ci_job_id
- volumes:
- - name: datadog-agent-volume
- hostPath:
- path: /host/datadog-agent
- - name: host-root-proc
- hostPath:
- path: /proc
- templates:
- - name: main
- inputs:
- parameters:
- - name: datadog-agent-image-repository
- - name: datadog-agent-image-tag
- - name: datadog-agent-site
- - name: datadog-cluster-agent-image-repository
- - name: datadog-cluster-agent-image-tag
- - name: ci_commit_short_sha
- - name: ci_pipeline_id
- - name: ci_job_id
- steps:
- - - name: start-fake-datadog
- templateRef:
- name: fake-datadog
- template: create
- arguments:
- parameters:
- - name: namespace
- value: "{{workflow.namespace}}"
-
- - name: start-dsd-hostname
- templateRef:
- name: dsd-hostname
- template: create
- arguments:
- parameters:
- - name: namespace
- value: "{{workflow.namespace}}"
-
- - - name: start-datadog-agent
- templateRef:
- name: datadog-agent
- template: create
- arguments:
- parameters:
- - name: namespace
- value: "{{workflow.namespace}}"
- - name: agent-image-repository
- value: "{{inputs.parameters.datadog-agent-image-repository}}"
- - name: agent-image-tag
- value: "{{inputs.parameters.datadog-agent-image-tag}}"
- - name: cluster-agent-image-repository
- value: "{{inputs.parameters.datadog-cluster-agent-image-repository}}"
- - name: cluster-agent-image-tag
- value: "{{inputs.parameters.datadog-cluster-agent-image-tag}}"
- - name: site
- value: "{{inputs.parameters.datadog-agent-site}}"
- - name: dd-url
- value: ""
- - name: ci_commit_short_sha
- value: "{{inputs.parameters.ci_commit_short_sha}}"
- - name: ci_pipeline_id
- value: "{{inputs.parameters.ci_pipeline_id}}"
- - name: ci_job_id
- value: "{{inputs.parameters.ci_job_id}}"
- - name: remote_configuration_enabled
- value: "false"
- - name: networkmonitoring_enabled
- value: "false"
-
- - - name: wait-datadog-agent
- templateRef:
- name: datadog-agent
- template: wait
- arguments:
- parameters:
- - name: namespace
- value: "{{workflow.namespace}}"
-
- - - name: test-cspm-e2e
- templateRef:
- name: datadog-agent
- template: test-cspm-e2e
- arguments:
- parameters:
- - name: namespace
- value: "{{workflow.namespace}}"
- - name: site
- value: "{{inputs.parameters.datadog-agent-site}}"
-
- - name: exit-handler
- steps:
- - - name: diagnose
- template: diagnose
-
- - name: diagnose
- steps:
- - - name: diagnose-datadog-agent
- templateRef:
- name: datadog-agent
- template: diagnose
- arguments:
- parameters:
- - name: namespace
- value: "{{workflow.namespace}}"
diff --git a/test/e2e/argo-workflows/default-workflow.yaml b/test/e2e/argo-workflows/default-workflow.yaml
deleted file mode 100644
index 9c9f54e30d89c..0000000000000
--- a/test/e2e/argo-workflows/default-workflow.yaml
+++ /dev/null
@@ -1,352 +0,0 @@
-apiVersion: argoproj.io/v1alpha1
-kind: Workflow
-metadata:
- generateName: argo-datadog-agent-
-spec:
- entrypoint: main
- onExit: exit-handler
- arguments:
- parameters:
- - name: datadog-agent-image-repository
- - name: datadog-agent-image-tag
- - name: datadog-cluster-agent-image-repository
- - name: datadog-cluster-agent-image-tag
- - name: ci_commit_short_sha
- - name: ci_pipeline_id
- - name: ci_job_id
- volumes:
- - name: datadog-agent-volume
- hostPath:
- path: /host/datadog-agent
- templates:
- - name: main
- inputs:
- parameters:
- - name: datadog-agent-image-repository
- - name: datadog-agent-image-tag
- - name: datadog-cluster-agent-image-repository
- - name: datadog-cluster-agent-image-tag
- - name: ci_commit_short_sha
- - name: ci_pipeline_id
- - name: ci_job_id
- steps:
- - - name: start-fake-datadog
- templateRef:
- name: fake-datadog
- template: create
- arguments:
- parameters:
- - name: namespace
- value: "{{workflow.namespace}}"
-
- - name: start-redis
- templateRef:
- name: redis
- template: create
- arguments:
- parameters:
- - name: namespace
- value: "{{workflow.namespace}}"
-
- - name: start-cpu-stress
- templateRef:
- name: cpu-stress
- template: create
- arguments:
- parameters:
- - name: namespace
- value: "{{workflow.namespace}}"
-
- - name: start-dsd-hostname
- templateRef:
- name: dsd-hostname
- template: create
- arguments:
- parameters:
- - name: namespace
- value: "{{workflow.namespace}}"
-
- - name: start-logs-hello-world
- templateRef:
- name: logs-hello-world
- template: create
- arguments:
- parameters:
- - name: namespace
- value: "{{workflow.namespace}}"
-
- - name: start-nginx
- templateRef:
- name: nginx
- template: create
- arguments:
- parameters:
- - name: namespace
- value: "{{workflow.namespace}}"
-
- - - name: fake-dd-reset
- templateRef:
- name: fake-datadog
- template: reset
- arguments:
- parameters:
- - name: namespace
- value: "{{workflow.namespace}}"
-
- - - name: start-datadog-agent
- templateRef:
- name: datadog-agent
- template: create
- arguments:
- parameters:
- - name: namespace
- value: "{{workflow.namespace}}"
- - name: agent-image-repository
- value: "{{inputs.parameters.datadog-agent-image-repository}}"
- - name: agent-image-tag
- value: "{{inputs.parameters.datadog-agent-image-tag}}"
- - name: dd-url
- value: "http://fake-datadog.{{workflow.namespace}}.svc.cluster.local"
- - name: site
- value: ""
- - name: cluster-agent-image-repository
- value: "{{inputs.parameters.datadog-cluster-agent-image-repository}}"
- - name: cluster-agent-image-tag
- value: "{{inputs.parameters.datadog-cluster-agent-image-tag}}"
- - name: ci_commit_short_sha
- value: "{{inputs.parameters.ci_commit_short_sha}}"
- - name: ci_pipeline_id
- value: "{{inputs.parameters.ci_pipeline_id}}"
- - name: ci_job_id
- value: "{{inputs.parameters.ci_job_id}}"
- - name: remote_configuration_enabled
- value: "false"
- - name: networkmonitoring_enabled
- value: "false"
-
- - - name: wait-datadog-agent
- templateRef:
- name: datadog-agent
- template: wait
- arguments:
- parameters:
- - name: namespace
- value: "{{workflow.namespace}}"
-
- - - name: start-busybox
- templateRef:
- name: busybox
- template: create
- arguments:
- parameters:
- - name: namespace
- value: "{{workflow.namespace}}"
-
- - - name: test-datadog-agent
- templateRef:
- name: datadog-agent
- template: test
- arguments:
- parameters:
- - name: namespace
- value: "{{workflow.namespace}}"
-
- - name: test-redis
- templateRef:
- name: redis
- template: test
- arguments:
- parameters:
- - name: namespace
- value: "{{workflow.namespace}}"
-
- - name: test-cpu
- templateRef:
- name: cpu-stress
- template: test
- arguments:
- parameters:
- - name: namespace
- value: "{{workflow.namespace}}"
-
- - name: test-dsd
- templateRef:
- name: dsd-hostname
- template: test
- arguments:
- parameters:
- - name: namespace
- value: "{{workflow.namespace}}"
-
- - name: test-nginx
- templateRef:
- name: nginx
- template: test
- arguments:
- parameters:
- - name: namespace
- value: "{{workflow.namespace}}"
-
- - name: test-busybox
- templateRef:
- name: busybox
- template: test
- arguments:
- parameters:
- - name: namespace
- value: "{{workflow.namespace}}"
-
- - - name: stop-redis
- templateRef:
- name: redis
- template: delete
- arguments:
- parameters:
- - name: namespace
- value: "{{workflow.namespace}}"
-
- - name: stop-nginx
- templateRef:
- name: nginx
- template: delete
- arguments:
- parameters:
- - name: namespace
- value: "{{workflow.namespace}}"
-
- - - name: no-more-redis
- templateRef:
- name: redis
- template: no-more-metrics
- arguments:
- parameters:
- - name: namespace
- value: "{{workflow.namespace}}"
-
- - name: no-more-nginx
- templateRef:
- name: nginx
- template: no-more-metrics
- arguments:
- parameters:
- - name: namespace
- value: "{{workflow.namespace}}"
-
- - name: exit-handler
- steps:
- - - name: delete
- template: delete
- when: "{{workflow.status}} == Succeeded"
-
- - name: diagnose
- template: diagnose
- when: "{{workflow.status}} != Succeeded"
-
- - name: delete
- steps:
- - - name: stop-datadog-agent
- templateRef:
- name: datadog-agent
- template: delete
- arguments:
- parameters:
- - name: namespace
- value: "{{workflow.namespace}}"
-
- - name: stop-redis
- templateRef:
- name: redis
- template: delete
- arguments:
- parameters:
- - name: namespace
- value: "{{workflow.namespace}}"
-
- - name: stop-cpu-stress
- templateRef:
- name: cpu-stress
- template: delete
- arguments:
- parameters:
- - name: namespace
- value: "{{workflow.namespace}}"
-
- - name: stop-dsd-hostname
- templateRef:
- name: dsd-hostname
- template: delete
- arguments:
- parameters:
- - name: namespace
- value: "{{workflow.namespace}}"
-
- - name: stop-logs-hello-world
- templateRef:
- name: logs-hello-world
- template: delete
- arguments:
- parameters:
- - name: namespace
- value: "{{workflow.namespace}}"
-
- - name: stop-nginx
- templateRef:
- name: nginx
- template: delete
- arguments:
- parameters:
- - name: namespace
- value: "{{workflow.namespace}}"
-
- - name: stop-fake-datadog
- templateRef:
- name: fake-datadog
- template: delete
- arguments:
- parameters:
- - name: namespace
- value: "{{workflow.namespace}}"
-
- - name: stop-busybox
- templateRef:
- name: busybox
- template: delete
- arguments:
- parameters:
- - name: namespace
- value: "{{workflow.namespace}}"
-
- - name: diagnose
- steps:
- - - name: diagnose-datadog-agent
- templateRef:
- name: datadog-agent
- template: diagnose
- arguments:
- parameters:
- - name: namespace
- value: "{{workflow.namespace}}"
- - name: diagnose-fake-datadog
- templateRef:
- name: fake-datadog
- template: diagnose
- arguments:
- parameters:
- - name: namespace
- value: "{{workflow.namespace}}"
- - name: diagnose-nginx
- templateRef:
- name: nginx
- template: diagnose
- arguments:
- parameters:
- - name: namespace
- value: "{{workflow.namespace}}"
- - name: diagnose-busybox
- templateRef:
- name: busybox
- template: diagnose
- arguments:
- parameters:
- - name: namespace
- value: "{{workflow.namespace}}"
diff --git a/test/e2e/argo-workflows/templates/cpu-stress.yaml b/test/e2e/argo-workflows/templates/cpu-stress.yaml
deleted file mode 100644
index e210d9aa0eaf2..0000000000000
--- a/test/e2e/argo-workflows/templates/cpu-stress.yaml
+++ /dev/null
@@ -1,175 +0,0 @@
-apiVersion: argoproj.io/v1alpha1
-kind: WorkflowTemplate
-metadata:
- name: cpu-stress
-spec:
- templates:
- - name: create
- inputs:
- parameters:
- - name: namespace
- resource:
- action: apply
- manifest: |
- apiVersion: apps/v1
- kind: Deployment
- metadata:
- name: cpu-stress
- namespace: {{inputs.parameters.namespace}}
- spec:
- replicas: 1
- selector:
- matchLabels:
- app: cpu-stress
- template:
- metadata:
- labels:
- app: cpu-stress
- spec:
- containers:
- - name: cpu-stress
- image: datadog/docker-library:progrium_stress
- args:
- - "--cpu"
- - "2"
- resources:
- requests:
- memory: "64Mi"
- cpu: "1"
- limits:
- memory: "64Mi"
- cpu: "1"
-
- - name: delete
- inputs:
- parameters:
- - name: namespace
- resource:
- action: delete
- manifest: |
- apiVersion: apps/v1
- kind: Deployment
- metadata:
- name: cpu-stress
- namespace: {{inputs.parameters.namespace}}
-
- - name: find-metrics-cpu-container-runtime
- inputs:
- parameters:
- - name: namespace
- activeDeadlineSeconds: 300
- script:
- image: mongo:4.4.1
- command: [mongo, "fake-datadog.{{inputs.parameters.namespace}}.svc.cluster.local/datadog"]
- source: |
- while (1) {
- var nb = db.series.find({
- metric: "cri.cpu.usage",
- tags: { $all: ["kube_deployment:cpu-stress", "kube_container_name:cpu-stress"] },
- "points.0.1": { $gt: 950000000, $lt: 1010000000 } }).count();
- print("find: " + nb)
- if (nb != 0) {
- print("cpu value in target range")
- break;
- }
- sleep(2000);
- }
-
- - name: find-metrics-cpu-kubelet
- inputs:
- parameters:
- - name: namespace
- activeDeadlineSeconds: 300
- script:
- image: mongo:4.4.1
- command: [mongo, "fake-datadog.{{inputs.parameters.namespace}}.svc.cluster.local/datadog"]
- source: |
- while (1) {
- var nb = db.series.find({
- metric: "kubernetes.cpu.usage.total",
- tags: { $all: ["kube_deployment:cpu-stress", "kube_container_name:cpu-stress"] },
- "points.0.1": { $gt: 800000000, $lt: 1200000000 } }).count();
- print("find: " + nb)
- if (nb != 0) {
- print("cpu value in target range")
- break;
- }
- sleep(2000);
- }
-
- - name: find-metrics-cpu-system
- inputs:
- parameters:
- - name: namespace
- activeDeadlineSeconds: 300
- script:
- image: mongo:4.4.1
- command: [mongo, "fake-datadog.{{inputs.parameters.namespace}}.svc.cluster.local/datadog"]
- source: |
- while (1) {
- sleep(2000);
-
- // Determine the hostname the cpu-stress pod is running on
- var point = db.series.find({
- metric: "kubernetes.cpu.usage.total",
- tags: {$all: ["kube_deployment:cpu-stress", "kube_container_name:cpu-stress"]}
- }).limit(1).sort({$natural:-1})[0];
- if (!point) {
- print("cannot get hostname for pod");
- continue;
- }
- hostname = point.host;
-
- // Get the number of CPUs on that host
- var point = db.series.find({
- metric: "kubernetes_state.node.cpu_capacity",
- host: hostname
- }).limit(1).sort({$natural:-1})[0];
- if (!point) {
- print("cannot get cpu capacity for host " + hostname);
- continue;
- }
- cpucount = point.points[0][1];
- print("cpu count: " + cpucount)
-
- // Get the user CPU usage, make sure it's above 39% non-normalized
- var point = db.series.find({
- metric: "system.cpu.user",
- host: hostname
- }).limit(1).sort({$natural:-1})[0];
- if (!point) {
- print("no system.cpu.usage metric reported for host " + hostname)
- continue;
- }
- print("raw value: " + point.points[0][1])
- value = point.points[0][1] * cpucount;
- print("cpu value: " + value)
- if (value > 95) {
- print("cpu value in target range");
- break;
- }
- }
-
- - name: test
- inputs:
- parameters:
- - name: namespace
- steps:
- - - name: find-metrics-cpu-container-runtime
- template: find-metrics-cpu-container-runtime
- arguments:
- parameters:
- - name: namespace
- value: "{{inputs.parameters.namespace}}"
- - name: find-metrics-cpu-kubelet
- template: find-metrics-cpu-kubelet
- arguments:
- parameters:
- - name: namespace
- value: "{{inputs.parameters.namespace}}"
- - name: find-metrics-cpu-system
- template: find-metrics-cpu-system
- arguments:
- parameters:
- - name: namespace
- value: "{{inputs.parameters.namespace}}"
diff --git a/test/e2e/argo-workflows/templates/datadog-agent.yaml b/test/e2e/argo-workflows/templates/datadog-agent.yaml
deleted file mode 100644
index 2c040444f3104..0000000000000
--- a/test/e2e/argo-workflows/templates/datadog-agent.yaml
+++ /dev/null
@@ -1,666 +0,0 @@
-apiVersion: argoproj.io/v1alpha1
-kind: WorkflowTemplate
-metadata:
- name: datadog-agent
-spec:
- templates:
- - name: create
- inputs:
- parameters:
- - name: namespace
- - name: dd-url
- - name: site
- - name: agent-image-repository
- - name: agent-image-tag
- - name: cluster-agent-image-repository
- - name: cluster-agent-image-tag
- - name: ci_commit_short_sha
- - name: ci_pipeline_id
- - name: ci_job_id
- - name: remote_configuration_enabled
- - name: networkmonitoring_enabled
- script:
- image: alpine/k8s:1.27.1
- envFrom:
- - secretRef:
- name: dd-keys
- command: [sh]
- source: |
- set -euo pipefail
-
- cat > /tmp/values.yaml <