Skip to content

Commit

Permalink
TT-1473 Refactor integration-tests.yml workflow to use run-e2e-tests-…
Browse files Browse the repository at this point in the history
…reusable-workflow.yml (#14134)

* wip

* fix secrets and test log level

* comment eth-smoke-tests-matrix-automation and use reusable workflow instead

* comment eth-smoke-tests-matrix-log-poller and use reusable workflow instead

* Fix

* migrate node upgrade tests

* fix test_config_chainlink_upgrade_version

* use default workflow name

* bump run-tests

* comment compare-tests

* add name to reusable workflow

* Add chainlink-testing-framework/show-test-summary to reusable workflow and run collect metrics step for aggregated result

* Move Upload CL Node Coverage Data Artifacts to reusable workflow

* Fix

* Update cl node coverage artifact prefix

* Update reusable workflow to have test results as output

* Fix

* fix

* test

* fix

* remove old node migration tests

* migrate otel traces steps to reusable workflow

* uncomment eth-smoke-go-mod-cache

* rename some steps and jobs

* Use citool from CTF

* Fix

* Fix

* Add cache for citool

* Update setup-go GHA

* Cache ctf builds

* Bump

* Fix

* Bump

* Remove eth-smoke-go-mod-cache as cache is saved in run-tests

* Bump

* Remove duplicated step

* Bump

* Bump

* trigger build

* Clean up after_tests job

* Run all PR tests

* Fix record test result step

* Remove duplicated tests from e2e-tests.yml

* Bump GHA

* Run ccip tests in reusable workflow

* fix go mod

* Fix

* Update test_env names

* Install citool bin intead of checking out ctf repo

* Add more ccip tests

* chore: Update Go setup in reusable workflow

* Update test names

* Use ctf from branch

* Run all PR tests

* fix plugins test

* Run core and ccip tests based on changes

* Fix

* Bump citool

* Bump run-tests

* Fix collect metrics

* Bump ctf

* Simplify test ids

* uncomment tags

* fix

* Fix TEST_TYPE

* Fix test env vars

* Update check-e2e-test-results

* Fix check results

* test

* fix

* test

* fix

* Do not build integration-tests, run only lint

* fix test_result artifact

* Fix cache

* Fix unique workflow id

* Fix e2e-tests and skip one test

* test when ccip tests skipped

* fix
  • Loading branch information
lukaszcl authored Aug 21, 2024
1 parent d7645dd commit 0cbad1b
Show file tree
Hide file tree
Showing 18 changed files with 838 additions and 2,467 deletions.
640 changes: 375 additions & 265 deletions .github/e2e-tests.yml

Large diffs are not rendered by default.

1,218 changes: 128 additions & 1,090 deletions .github/workflows/integration-tests.yml

Large diffs are not rendered by default.

68 changes: 34 additions & 34 deletions .github/workflows/run-automation-ondemand-e2e-tests.yml
Original file line number Diff line number Diff line change
Expand Up @@ -91,53 +91,53 @@ jobs:
# Always run upgrade tests
cat > test_list.yaml <<EOF
- id: integration-tests/smoke/automation_upgrade_test.go:^TestAutomationNodeUpgrade/registry_2_0
test_inputs:
chainlink_image: ${{ steps.determine-build.outputs.image }}
chainlink_version: ${{ steps.determine-build.outputs.version }}
chainlink_upgrade_image: ${{ steps.determine-build.outputs.upgrade_image }}
chainlink_upgrade_version: ${{ steps.determine-build.outputs.upgrade_version }}
- id: smoke/automation_upgrade_test.go:^TestAutomationNodeUpgrade/registry_2_0
test_env_vars:
E2E_TEST_CHAINLINK_IMAGE: ${{ steps.determine-build.outputs.image }}
E2E_TEST_CHAINLINK_VERSION: ${{ steps.determine-build.outputs.version }}
E2E_TEST_CHAINLINK_UPGRADE_IMAGE: ${{ steps.determine-build.outputs.upgrade_image }}
E2E_TEST_CHAINLINK_UPGRADE_VERSION: ${{ steps.determine-build.outputs.upgrade_version }}
- id: integration-tests/smoke/automation_upgrade_test.go:^TestAutomationNodeUpgrade/registry_2_1
test_inputs:
chainlink_image: ${{ steps.determine-build.outputs.image }}
chainlink_version: ${{ steps.determine-build.outputs.version }}
chainlink_upgrade_image: ${{ steps.determine-build.outputs.upgrade_image }}
chainlink_upgrade_version: ${{ steps.determine-build.outputs.upgrade_version }}
- id: smoke/automation_upgrade_test.go:^TestAutomationNodeUpgrade/registry_2_1
test_env_vars:
E2E_TEST_CHAINLINK_IMAGE: ${{ steps.determine-build.outputs.image }}
E2E_TEST_CHAINLINK_VERSION: ${{ steps.determine-build.outputs.version }}
E2E_TEST_CHAINLINK_UPGRADE_IMAGE: ${{ steps.determine-build.outputs.upgrade_image }}
E2E_TEST_CHAINLINK_UPGRADE_VERSION: ${{ steps.determine-build.outputs.upgrade_version }}
- id: integration-tests/smoke/automation_upgrade_test.go:^TestAutomationNodeUpgrade/registry_2_2
test_inputs:
chainlink_image: ${{ steps.determine-build.outputs.image }}
chainlink_version: ${{ steps.determine-build.outputs.version }}
chainlink_upgrade_image: ${{ steps.determine-build.outputs.upgrade_image }}
chainlink_upgrade_version: ${{ steps.determine-build.outputs.upgrade_version }}
- id: smoke/automation_upgrade_test.go:^TestAutomationNodeUpgrade/registry_2_2
test_env_vars:
E2E_TEST_CHAINLINK_IMAGE: ${{ steps.determine-build.outputs.image }}
E2E_TEST_CHAINLINK_VERSION: ${{ steps.determine-build.outputs.version }}
E2E_TEST_CHAINLINK_UPGRADE_IMAGE: ${{ steps.determine-build.outputs.upgrade_image }}
E2E_TEST_CHAINLINK_UPGRADE_VERSION: ${{ steps.determine-build.outputs.upgrade_version }}
EOF
# Run reorg tests if enabled
if [[ "${{ github.event.inputs.enableReorg }}" == 'true' ]]; then
cat >> test_list.yaml <<EOF
- id: integration-tests/reorg/automation_reorg_test.go^TestAutomationReorg/registry_2_0
test_inputs:
chainlink_image: ${{ steps.determine-build.outputs.image }}
chainlink_version: ${{ steps.determine-build.outputs.version }}
- id: integration-tests/reorg/automation_reorg_test.go^TestAutomationReorg/registry_2_1
test_inputs:
chainlink_image: ${{ steps.determine-build.outputs.image }}
chainlink_version: ${{ steps.determine-build.outputs.version }}
- id: integration-tests/reorg/automation_reorg_test.go^TestAutomationReorg/registry_2_2
test_inputs:
chainlink_image: ${{ steps.determine-build.outputs.image }}
chainlink_version: ${{ steps.determine-build.outputs.version }}
- id: reorg/automation_reorg_test.go^TestAutomationReorg/registry_2_0
test_env_vars:
E2E_TEST_CHAINLINK_IMAGE: ${{ steps.determine-build.outputs.image }}
E2E_TEST_CHAINLINK_VERSION: ${{ steps.determine-build.outputs.version }}
- id: reorg/automation_reorg_test.go^TestAutomationReorg/registry_2_1
test_env_vars:
E2E_TEST_CHAINLINK_IMAGE: ${{ steps.determine-build.outputs.image }}
E2E_TEST_CHAINLINK_VERSION: ${{ steps.determine-build.outputs.version }}
- id: reorg/automation_reorg_test.go^TestAutomationReorg/registry_2_2
test_env_vars:
E2E_TEST_CHAINLINK_IMAGE: ${{ steps.determine-build.outputs.image }}
E2E_TEST_CHAINLINK_VERSION: ${{ steps.determine-build.outputs.version }}
EOF
fi
# Run chaos tests if enabled
if [[ "${{ github.event.inputs.enableChaos }}" == 'true' ]]; then
cat >> test_list.yaml <<EOF
- id: integration-tests/chaos/automation_chaos_test.go
test_inputs:
chainlink_image: ${{ steps.determine-build.outputs.image }}
chainlink_version: ${{ steps.determine-build.outputs.version }}
- id: chaos/automation_chaos_test.go
test_env_vars:
E2E_TEST_CHAINLINK_IMAGE: ${{ steps.determine-build.outputs.image }}
E2E_TEST_CHAINLINK_VERSION: ${{ steps.determine-build.outputs.version }}
EOF
fi
Expand Down
Loading

0 comments on commit 0cbad1b

Please sign in to comment.