TT-1550 Migrate remaining E2E workflows to the reusable workflow (#14403

)

* Update some test workflows to run with test config path

* Fix summary

* Fix

* Update on-demand-ocr-soak-test.yml

* Run vrfplus tests on ARBITRUM_SEPOLIA on existing env

* Add config for staging release testing on arbitrum sepolia

* Show test_secrets_override_key in summary

* Generate hash of integration-tests/ for test runner image if tag not provided

* test updating config but not rebuilding test image

* Fix test_runner_hash

* Commit all configs for staging

* test config change

* Update release configs

* Do not rebuild test image when md or .github files were changed

* Add wemix testnet config for ocrv2 soak test

* Use chainlink version from config

* Update reusable workflow inputs

* Add soak/ocr_test.go:^TestOCRv2Soak$WemixTestnet to CI tests

* Fix

* Fix test image tag

* Remove image from default.toml

* Fix chainlink_version

* Fix test image hash value

* Fix summary

* Update workflow

* Update config overrides, read from default, env vars and then from BASE64_CONFIG_OVERRIDE if exists

BASE64_CONFIG_OVERRIDE should be able to override everything that was already set in the test config

* Build chainlink image sha if required

* Fix

* Add new workflow

* Show test config path in reusable workflow

* Update list of tests

* Update run-selected-tests workflow

* Fix

* Rename steps

* fix workflow

* Add TestVRFv2Plus_LiveTestnets to CI tests definition

* Fix

* Run vrfv2plus tests on simulated network by default

* Fix

* fix

* fix

* Update test definition

* Add TestVRFv2Plus_Release_Sepolia

* Add workflow to run vrf e2e release tests

* test new workflow with slack notification

* fix

* fix

* fix

* fix color

* fix

* revert if

* revert test definition changes

* Add test_secrets_override_key

* fix for slack notification after test

* TT-1550: reorganizing VRF V2 Plus configs

* Use test_config_override_path instead of base64 in other VRFv2Plus workflows

* remove file

* Refactor on-demand-vrfv2plus-performance-test.yml

* Add slack notification for on-demand-vrfv2plus-smoke-tests.yml

* Fix

* fix 2

* remove debug info

* update color of slack notification

* Migrate on-demand-vrfv2-eth2-clients-test

* Migrate on-demand-ocr-soak-test.yml (WIP)

* Rename step

* update test names

* fix

* fix name

* fix

* Migrate automation-nightly-tests.yml

* Build remote runner image asap

* Fix

* add ocr2 celo_alfajores and base_sepolia test configs

* Fix

* Fix

* Migrate automation-benchmark-tests.yml

* fix

* Migrate automation-load-tests.yml

* Migrate on-demand-vrfv2-eth2-clients-test.yml

* Migrate on-demand-vrfv2-performance-test.yml

* Remove unused actions

* Always show console logs for ocr tests

* Allow custom docker test artifacts

* Migrate ccip-load-tests.yml

* revert this commits

* fix ARTIFACT_PATHS

* fix

* Allow to upload custom test artifacts

* Fux

* Fix

* Clean up toml examples

* Remove unused live-testnet-tests.yml workflow

Confirmed with Adam

* Remove old action

* Fix

* Fix

* update test duration to 24h

* Fix citool

* debug artifacts on failure

* debug

* Fix

* Use ubuntu-latest

* Update workflow slack notifications

* Fix test id when running custom tests

* Fix

* Fix

* Add OCR test configs

* remove unused workflow

* Add slack notifications for vrfv2 workflows

* Fix slack notifications for automation workflows

* Fix SLACK_USER input in on-demand-ocr-soak-test.yml

* Do not use github.sha as default chainlink version

* Remove chainlink_version input form automation workflows. Use config instead

* update base sepolia test config duration to 1h

* Fix

* Do not upload cpu and memory profile by default

* Do not set E2E_TEST_PYROSCOPE_ENABLED. Get it from toml config instead

* reverting base sepolia duration to 24h

* Fix TEST_UPLOAD_CPU_PROFILE and TEST_UPLOAD_MEM_PROFILE

* debug TEST_UPLOAD_CPU_PROFILE

* Read config from env var first then override with TOML

* remove debug info

* Include tag and sha in workflow slack notification

* Fix notification

Do not use link for tag because it may not exist. Use short sha.

* Revert "Read config from env var first then override with TOML"

This reverts commit 2b2fb18.

* Fix and bump ctf

* go mod tidy

* bump ctf

* add automation test configs (#14455)

* add automation test configs

* update grafana config

* update testid in workflow

* update testid in e2e-tests

* restructure configs

* update config

* add testType input in benchmark workflow

* add testType input in e2e reusable workflow

* Revert "add testType input in e2e reusable workflow"

This reverts commit 937607c.

* update benchmark workflow

* update test log level for load and benchmark

---------

Co-authored-by: lukaszcl <120112546+lukaszcl@users.noreply.github.com>

* Increase test_log_upload_retention_days from 3 to 5

* Fix

* Debug CCIP Load Test in E2E Workflow Conversion (#14479)

Fixes CCIP load tests

* Run selected e2e tests in merge queue

* Run selected e2e tests in merge queue part 2

* Run selected e2e tests in merge queue part 3

* Use ctf-build-test-image@0.1.0

* Fix suites for k8s tests

Use test_suite input and matrix.tests.test_env_vars.TEST_SUITE to set test suites for tests in e2e-tests.yml

* Update gha

* Rename step

* Update run-tests GHA

* update testsconfigs to use ocr common

---------

Co-authored-by: Ilja Pavlovs <ilja.pavlovs@gmail.com>
Co-authored-by: joaoluisam <joao.luismoreira@smartcontract.com>
Co-authored-by: davidcauchi <david.cauchi@smartcontract.com>
Co-authored-by: Anirudh Warrier <12178754+anirudhwarrier@users.noreply.github.com>
Co-authored-by: Adam Hamrick <adam.hamrick@smartcontract.com>

.github/actions/build-chainlink-image/action.yml

@@ -37,7 +37,7 @@ runs:
         AWS_ROLE_TO_ASSUME: ${{ inputs.AWS_ROLE_TO_ASSUME }}
     - name: Build Image
       if: steps.check-image.outputs.exists != 'true'
-      uses: smartcontractkit/chainlink-github-actions/chainlink-testing-framework/build-image@75a9005952a9e905649cfb5a6971fd9429436acd # v2.3.25
+      uses: smartcontractkit/.github/actions/ctf-build-image@1a26fe378d7ebdc34ab1fe31ec4a6d1c376199f8 # ctf-build-image@0.0.0
       with:
         cl_repo: smartcontractkit/chainlink
         cl_ref: ${{ inputs.git_commit_sha }}