Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

wip: trigger build test #14942

Closed
wants to merge 86 commits into from

Conversation

ajgrande924
Copy link
Collaborator

Requires

Resolves

@ajgrande924 ajgrande924 added the build-publish Build and Publish image to SDLC label Oct 24, 2024
@ajgrande924 ajgrande924 requested a review from a team as a code owner October 24, 2024 14:27
@ajgrande924 ajgrande924 requested review from patrickhuie19 and removed request for a team October 24, 2024 14:27
Copy link
Contributor

github-actions bot commented Oct 24, 2024

AER Report: CI Core

aer_workflow , commit , Detect Changes , Clean Go Tidy & Generate , Scheduled Run Frequency , Find New Flaky Tests In Root Project / Find Tests To Run , lint , Core Tests (go_core_tests) , Core Tests (go_core_tests_integration) , Core Tests (go_core_ccip_deployment_tests) , Core Tests (go_core_race_tests) , Core Tests (go_core_fuzz) , Find New Flaky Tests In Deployment Project / Find Tests To Run , Find New Flaky Tests In Root Project / Run Tests (github.com/smartcontractkit/chainlink/v2/core/capabilities/ccip/launcher,github.com/sm... , Find New Flaky Tests In Root Project / Run Tests (github.com/smartcontractkit/chainlink/v2/core/services/fluxmonitorv2,github.com/smartc... , Find New Flaky Tests In Root Project / Run Tests (github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/ccip/internal/pric... , Find New Flaky Tests In Root Project / Run Tests (github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/mercury,github.com... , Find New Flaky Tests In Root Project / Run Tests (github.com/smartcontractkit/chainlink/v2/core/capabilities,github.com/smartcontractkit... , Find New Flaky Tests In Root Project / Run Tests (github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/ccip/internal/ccip... , Find New Flaky Tests In Root Project / Run Tests (github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/ccip/internal/cach... , Find New Flaky Tests In Root Project / Run Tests (github.com/smartcontractkit/chainlink/v2/core/services/blockhashstore,github.com/smart... , Find New Flaky Tests In Deployment Project / Run Tests , Find New Flaky Tests In Deployment Project / Report , Flakey Test Detection , SonarQube Scan , Find New Flaky Tests In Root Project / Report

1. Missing go.sum entry for module providing package:

[go_core_ccip_deployment_tests]

Source of Error:
Run tests	2024-11-29T23:42:40.0379288Z ##[error]environment.go:21:2: missing go.sum entry for module providing package github.com/smartcontractkit/chainlink-common/pkg/logger (imported by github.com/smartcontractkit/chainlink/deployment); to add:
Run tests	2024-11-29T23:42:40.0386930Z 	go get github.com/smartcontractkit/chainlink/deployment
Run tests	2024-11-29T23:42:40.0389285Z ##[error]../core/utils/thread_control.go:7:2: missing go.sum entry for module providing package github.com/smartcontractkit/chainlink-common/pkg/services (imported by github.com/smartcontractkit/chainlink/v2/core/services/p2p/types); to add:
Run tests	2024-11-29T23:42:40.0391284Z 	go get github.com/smartcontractkit/chainlink/v2/core/services/p2p/types@v2.0.0-00010101000000-000000000000
Run tests	2024-11-29T23:42:40.0393679Z ##[error]../../../../go/pkg/mod/github.com/smartcontractkit/chainlink-ccip@v0.0.0-20241112095015-3e85d9f1898b/pluginconfig/commit.go:14:2: missing go.sum entry for module providing package github.com/smartcontractkit/chainlink-common/pkg/config (imported by github.com/smartcontractkit/chainlink/deployment/ccip); to add:
Run tests	2024-11-29T23:42:40.0395639Z 	go get github.com/smartcontractkit/chainlink/deployment/ccip
Run tests	2024-11-29T23:42:40.0397868Z ##[error]../../../../go/pkg/mod/github.com/smartcontractkit/chainlink-ccip@v0.0.0-20241112095015-3e85d9f1898b/pluginconfig/commit.go:12:2: missing go.sum entry for module providing package github.com/smartcontractkit/chainlink-common/pkg/merklemulti (imported by github.com/smartcontractkit/chainlink/deployment/ccip); to add:
Run tests	2024-11-29T23:42:40.0399840Z 	go get github.com/smartcontractkit/chainlink/deployment/ccip
Run tests	2024-11-29T23:42:40.0401765Z ##[error]ccip/test_helpers.go:19:2: missing go.sum entry for module providing package github.com/smartcontractkit/chainlink-common/pkg/utils (imported by github.com/smartcontractkit/chainlink/deployment/ccip); to add:
Run tests	2024-11-29T23:42:40.0403430Z 	go get github.com/smartcontractkit/chainlink/deployment/ccip
Run tests	2024-11-29T23:42:40.0405266Z ##[error]ccip/test_assertions.go:17:2: missing go.sum entry for module providing package github.com/smartcontractkit/chainlink-common/pkg/utils/tests (imported by github.com/smartcontractkit/chainlink/deployment/ccip); to add:
Run tests	2024-11-29T23:42:40.0406975Z 	go get github.com/smartcontractkit/chainlink/deployment/ccip
Run tests	2024-11-29T23:42:40.0409590Z ##[error]../core/chains/evm/utils/big/big.go:11:2: missing go.sum entry for module providing package github.com/smartcontractkit/chainlink-common/pkg/utils/big_math (imported by github.com/smartcontractkit/chainlink/v2/core/chains/evm/assets); to add:
Run tests	2024-11-29T23:42:40.0411571Z 	go get github.com/smartcontractkit/chainlink/v2/core/chains/evm/assets@v2.0.0-00010101000000-000000000000
Run tests	2024-11-29T23:42:40.0414278Z ##[error]../core/chains/evm/utils/big/big.go:14:2: missing go.sum entry for module providing package github.com/smartcontractkit/chainlink-common/pkg/utils/bytes (imported by github.com/smartcontractkit/chainlink/v2/core/chains/evm/assets); to add:
Run tests	2024-11-29T23:42:40.0416322Z 	go get github.com/smartcontractkit/chainlink/v2/core/chains/evm/assets@v2.0.0-00010101000000-000000000000
Run tests	2024-11-29T23:42:40.0418506Z ##[error]../core/chains/evm/utils/big/big.go:12:2: missing go.sum entry for module providing package github.com/smartcontractkit/chainlink-common/pkg/utils/hex (imported by github.com/smartcontractkit/chainlink/v2/core/chains/evm/utils); to add:
Run tests	2024-11-29T23:42:40.0420428Z 	go get github.com/smartcontractkit/chainlink/v2/core/chains/evm/utils@v2.0.0-00010101000000-000000000000
Run tests	2024-11-29T23:42:40.0422573Z ##[error]../core/services/job/models.go:20:2: missing go.sum entry for module providing package github.com/smartcontractkit/chainlink-common/pkg/assets (imported by github.com/smartcontractkit/chainlink/v2/core/chains/evm/assets); to add:
Run tests	2024-11-29T23:42:40.0424482Z 	go get github.com/smartcontractkit/chainlink/v2/core/chains/evm/assets@v2.0.0-00010101000000-000000000000
Run tests	2024-11-29T23:42:40.0426566Z ##[error]../core/services/job/kv_orm.go:10:2: missing go.sum entry for module providing package github.com/smartcontractkit/chainlink-common/pkg/sqlutil (imported by github.com/smartcontractkit/chainlink/v2/core/chains/legacyevm); to add:
Run tests	2024-11-29T23:42:40.0428453Z 	go get github.com/smartcontractkit/chainlink/v2/core/chains/legacyevm@v2.0.0-00010101000000-000000000000
Run tests	2024-11-29T23:42:40.0430521Z ##[error]../core/services/job/models.go:21:2: missing go.sum entry for module providing package github.com/smartcontractkit/chainlink-common/pkg/types (imported by github.com/smartcontractkit/chainlink/v2/core/services/relay); to add:
Run tests	2024-11-29T23:42:40.0432482Z 	go get github.com/smartcontractkit/chainlink/v2/core/services/relay@v2.0.0-00010101000000-000000000000
Run tests	2024-11-29T23:42:40.0434648Z ##[error]../core/services/job/yaml_spec_factory.go:8:2: missing go.sum entry for module providing package github.com/smartcontractkit/chainlink-common/pkg/workflows (imported by github.com/smartcontractkit/chainlink/v2/core/services/job); to add:
Run tests	2024-11-29T23:42:40.0436465Z 	go get github.com/smartcontractkit/chainlink/v2/core/services/job@v2.0.0-00010101000000-000000000000
Run tests	2024-11-29T23:42:40.0438576Z ##[error]../core/services/job/models.go:18:2: missing go.sum entry for module providing package github.com/smartcontractkit/chainlink-common/pkg/workflows/sdk (imported by github.com/smartcontractkit/chainlink/v2/core/services/job); to add:
Run tests	2024-11-29T23:42:40.0440460Z 	go get github.com/smartcontractkit/chainlink/v2/core/services/job@v2.0.0-00010101000000-000000000000
Run tests	2024-11-29T23:42:40.0442658Z ##[error]../core/services/job/wasm_file_spec_factory.go:15:2: missing go.sum entry for module providing package github.com/smartcontractkit/chainlink-common/pkg/workflows/wasm/host (imported by github.com/smartcontractkit/chainlink/v2/core/services/job); to add:
Run tests	2024-11-29T23:42:40.0444632Z 	go get github.com/smartcontractkit/chainlink/v2/core/services/job@v2.0.0-00010101000000-000000000000
Run tests	2024-11-29T23:42:40.0446740Z ##[error]../core/services/keystore/beholder.go:6:2: missing go.sum entry for module providing package github.com/smartcontractkit/chainlink-common/pkg/beholder (imported by github.com/smartcontractkit/chainlink/v2/core/services/keystore); to add:
Run tests	2024-11-29T23:42:40.0448705Z 	go get github.com/smartcontractkit/chainlink/v2/core/services/keystore@v2.0.0-00010101000000-000000000000
Run tests	2024-11-29T23:42:40.0450941Z ##[error]../core/services/keystore/aptos.go:9:2: missing go.sum entry for module providing package github.com/smartcontractkit/chainlink-common/pkg/loop (imported by github.com/smartcontractkit/chainlink/deployment/environment/memory); to add:
Run tests	2024-11-29T23:42:40.0452774Z 	go get github.com/smartcontractkit/chainlink/deployment/environment/memory
Run tests	2024-11-29T23:42:40.0455463Z ##[error]../core/services/keystore/starknet.go:13:2: missing go.sum entry for module providing package github.com/smartcontractkit/chainlink-common/pkg/loop/adapters/starknet (imported by github.com/smartcontractkit/chainlink/v2/core/services/keystore); to add:
Run tests	2024-11-29T23:42:40.0457571Z 	go get github.com/smartcontractkit/chainlink/v2/core/services/keystore@v2.0.0-00010101000000-000000000000
Run tests	2024-11-29T23:42:40.0459786Z ##[error]../core/services/pipeline/common.go:21:2: missing go.sum entry for module providing package github.com/smartcontractkit/chainlink-common/pkg/utils/jsonserializable (imported by github.com/smartcontractkit/chainlink/v2/core/services/chainlink); to add:
Run tests	2024-11-29T23:42:40.0461800Z 	go get github.com/smartcontractkit/chainlink/v2/core/services/chainlink@v2.0.0-00010101000000-000000000000
Run tests	2024-11-29T23:42:40.0463975Z ##[error]../core/services/pipeline/task.eth_tx.go:17:2: missing go.sum entry for module providing package github.com/smartcontractkit/chainlink-common/pkg/utils/null (imported by github.com/smartcontractkit/chainlink/v2/common/txmgr/types); to add:
Run tests	2024-11-29T23:42:40.0465931Z 	go get github.com/smartcontractkit/chainlink/v2/common/txmgr/types@v2.0.0-00010101000000-000000000000
Run tests	2024-11-29T23:42:40.0467979Z ##[error]../common/txmgr/broadcaster.go:17:2: missing go.sum entry for module providing package github.com/smartcontractkit/chainlink-common/pkg/chains/label (imported by github.com/smartcontractkit/chainlink/v2/common/txmgr); to add:
Run tests	2024-11-29T23:42:40.0469816Z 	go get github.com/smartcontractkit/chainlink/v2/common/txmgr@v2.0.0-00010101000000-000000000000
Run tests	2024-11-29T23:42:40.0471989Z ##[error]../common/txmgr/confirmer.go:23:2: missing go.sum entry for module providing package github.com/smartcontractkit/chainlink-common/pkg/utils/mailbox (imported by github.com/smartcontractkit/chainlink/deployment/environment/memory); to add:
Run tests	2024-11-29T23:42:40.0473677Z 	go get github.com/smartcontractkit/chainlink/deployment/environment/memory
Run tests	2024-11-29T23:42:40.0476003Z ##[error]../core/chains/evm/logpoller/log_poller.go:28:2: missing go.sum entry for module providing package github.com/smartcontractkit/chainlink-common/pkg/timeutil (imported by github.com/smartcontractkit/chainlink/v2/core/chains/evm/logpoller); to add:
Run tests	2024-11-29T23:42:40.0478074Z 	go get github.com/smartcontractkit/chainlink/v2/core/chains/evm/logpoller@v2.0.0-00010101000000-000000000000
Run tests	2024-11-29T23:42:40.0480287Z ##[error]../core/chains/evm/logpoller/disabled.go:10:2: missing go.sum entry for module providing package github.com/smartcontractkit/chainlink-common/pkg/types/query (imported by github.com/smartcontractkit/chainlink/v2/core/services/relay/evm); to add:
Run tests	2024-11-29T23:42:40.0482208Z 	go get github.com/smartcontractkit/chainlink/v2/core/services/relay/evm@v2.0.0-00010101000000-000000000000
Run tests	2024-11-29T23:42:40.0484475Z ##[error]../core/chains/evm/logpoller/parser.go:15:2: missing go.sum entry for module providing package github.com/smartcontractkit/chainlink-common/pkg/types/query/primitives (imported by github.com/smartcontractkit/chainlink/v2/core/services/relay/evm); to add:
Run tests	2024-11-29T23:42:40.0486528Z 	go get github.com/smartcontractkit/chainlink/v2/core/services/relay/evm@v2.0.0-00010101000000-000000000000
Run tests	2024-11-29T23:42:40.0488705Z ##[error]../core/chains/evm/logpoller/log_poller.go:30:2: missing go.sum entry for module providing package github.com/smartcontractkit/chainlink-common/pkg/utils/mathutil (imported by github.com/smartcontractkit/chainlink/v2/core/chains/evm/gas); to add:
Run tests	2024-11-29T23:42:40.0490685Z 	go get github.com/smartcontractkit/chainlink/v2/core/chains/evm/gas@v2.0.0-00010101000000-000000000000
Run tests	2024-11-29T23:42:40.0492966Z ##[error]../core/chains/legacyevm/chain.go:15:2: missing go.sum entry for module providing package github.com/smartcontractkit/chainlink-common/pkg/chains (imported by github.com/smartcontractkit/chainlink/v2/core/chains/legacyevm); to add:
Run tests	2024-11-29T23:42:40.0495177Z 	go get github.com/smartcontractkit/chainlink/v2/core/chains/legacyevm@v2.0.0-00010101000000-000000000000
Run tests	2024-11-29T23:42:40.0497427Z ##[error]../core/capabilities/launcher.go:16:2: missing go.sum entry for module providing package github.com/smartcontractkit/chainlink-common/pkg/capabilities (imported by github.com/smartcontractkit/chainlink/v2/core/capabilities); to add:
Run tests	2024-11-29T23:42:40.0499419Z 	go get github.com/smartcontractkit/chainlink/v2/core/capabilities@v2.0.0-00010101000000-000000000000
Run tests	2024-11-29T23:42:40.0501703Z ##[error]../core/capabilities/encoder_factory.go:6:2: missing go.sum entry for module providing package github.com/smartcontractkit/chainlink-common/pkg/capabilities/consensus/ocr3 (imported by github.com/smartcontractkit/chainlink/v2/core/capabilities); to add:
Run tests	2024-11-29T23:42:40.0503653Z 	go get github.com/smartcontractkit/chainlink/v2/core/capabilities@v2.0.0
</cicore>
    
    



















































































<operatoruici>

## AER Report: [Operator UI CI](https://github.com/smartcontractkit/chainlink/actions/runs/12124794406) ran successfully :white_check_mark:

[aer_workflow](https://github.com/smartcontractkit/chainlink/actions/runs/12124824988/job/33803384220) , [commit](https://github.com/smartcontractkit/chainlink/commit/2a6d21cc3b2708fef9f1b3ea6360b46e715970c5)

</operatoruici>

@ajgrande924 ajgrande924 force-pushed the demo-working-changes-test branch 8 times, most recently from e8f9bcf to 9853b4b Compare October 24, 2024 22:14
@jinhoonbang jinhoonbang force-pushed the demo-working-changes-test branch 6 times, most recently from 8abb5fc to 5cecea6 Compare November 1, 2024 19:16
@jinhoonbang jinhoonbang requested review from a team as code owners November 1, 2024 19:16
@jinhoonbang jinhoonbang force-pushed the demo-working-changes-test branch 2 times, most recently from b8d69e7 to 4be23de Compare November 1, 2024 22:49
@jinhoonbang jinhoonbang requested review from a team as code owners November 1, 2024 22:49
@jinhoonbang jinhoonbang force-pushed the demo-working-changes-test branch 4 times, most recently from de45b0f to 788be92 Compare November 2, 2024 02:03
Copy link
Contributor

Flaky Test Detector for ./go.mod project has failed ❌

Ran new or updated tests between demo-working-changes and 6ba5619 (demo-working-changes-test).

View Flaky Detector Details | Compare Changes

Failed Tests

Ran 3571 tests in total for all affected test packages. Below are the tests identified as flaky, with a pass ratio lower than the 100% threshold:

TestPackage                                                               TestName                                                                                                      PassRatio  RunCount   Skipped
---------                                                                 ---------                                                                                                     ---------  ---------  ---------
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/ccip  TestIntegration_legacy_CCIP                                                                                   0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/ccip  TestIntegration_legacy_CCIP/with_pipeline                                                                     0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/ccip  TestIntegration_legacy_CCIP/with_pipeline/config_change_or_price_registry_update_while_requests_are_inflight  0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/fluxmonitorv2      TestFluxMonitor_Deviation/eip1559                                                                             0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/fluxmonitorv2      TestFluxMonitor_Deviation                                                                                     0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/fluxmonitorv2      TestFluxMonitor_Deviation/legacy                                                                              0%         1          false

Copy link
Contributor

Flaky Test Detector for ./go.mod project has failed ❌

Ran new or updated tests between demo-working-changes and 39b38f5 (demo-working-changes-test).

View Flaky Detector Details | Compare Changes

Failed Tests

Ran 3557 tests in total for all affected test packages. Below are the tests identified as flaky, with a pass ratio lower than the 100% threshold:

TestPackage                                                               TestName                                                                                                                  PassRatio  RunCount   Skipped
---------                                                                 ---------                                                                                                                 ---------  ---------  ---------
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/ccip  TestIntegration_legacy_CCIP                                                                                               0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/ccip  TestIntegration_legacy_CCIP/with_pipeline/config_change_or_price_registry_update_while_requests_are_inflight              0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/ccip  TestIntegration_legacy_CCIP/with_pipeline                                                                                 0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/ccip  TestIntegration_legacy_CCIP/with_dynamic_price_getter/config_change_or_price_registry_update_while_requests_are_inflight  0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/ccip  TestIntegration_legacy_CCIP/with_dynamic_price_getter                                                                     0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/fluxmonitorv2      TestFluxMonitor_Deviation/eip1559                                                                                         0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/fluxmonitorv2      TestFluxMonitor_Deviation                                                                                                 0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/fluxmonitorv2      TestFluxMonitor_Deviation/legacy                                                                                          0%         1          false
github.com/smartcontractkit/chainlink/v2/core/chains/evm/txmgr            TestEthConfirmer_ResumePendingRuns                                                                                        80%        5          false
github.com/smartcontractkit/chainlink/v2/core/chains/evm/txmgr            TestEthConfirmer_ResumePendingRuns/processes_eth_txes_with_receipt_older_than_minConfirmations_that_reverted              80%        5          false

Copy link
Contributor

Flaky Test Detector for ./go.mod project has failed ❌

Ran new or updated tests between demo-working-changes and cbe3e17 (demo-working-changes-test).

View Flaky Detector Details | Compare Changes

Failed Tests

Ran 3571 tests in total for all affected test packages. Below are the tests identified as flaky, with a pass ratio lower than the 100% threshold:

TestPackage                                                               TestName                                                                                                      PassRatio  RunCount   Skipped
---------                                                                 ---------                                                                                                     ---------  ---------  ---------
github.com/smartcontractkit/chainlink/v2/core/services/fluxmonitorv2      TestFluxMonitor_Deviation/legacy                                                                              0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/fluxmonitorv2      TestFluxMonitor_Deviation                                                                                     0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/fluxmonitorv2      TestFluxMonitor_Deviation/eip1559                                                                             0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/ccip  TestIntegration_legacy_CCIP                                                                                   50%        2          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/ccip  TestIntegration_legacy_CCIP/with_pipeline/config_change_or_price_registry_update_while_requests_are_inflight  50%        2          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/ccip  TestIntegration_legacy_CCIP/with_pipeline                                                                     50%        2          false
github.com/smartcontractkit/chainlink/v2/core/chains/evm/logpoller        TestLogPoller_BlockTimestamps                                                                                 80%        5          false

Copy link
Contributor

Flaky Test Detector for ./go.mod project has failed ❌

Ran new or updated tests between demo-working-changes and 291ad0a (demo-working-changes-test).

View Flaky Detector Details | Compare Changes

Failed Tests

Ran 3571 tests in total for all affected test packages. Below are the tests identified as flaky, with a pass ratio lower than the 100% threshold:

TestPackage                                                               TestName                                                                                                                  PassRatio  RunCount   Skipped
---------                                                                 ---------                                                                                                                 ---------  ---------  ---------
github.com/smartcontractkit/chainlink/v2/core/capabilities/compute        TestCache_EvictAfterSize                                                                                                  0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/fluxmonitorv2      TestFluxMonitor_Deviation                                                                                                 0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/fluxmonitorv2      TestFluxMonitor_Deviation/eip1559                                                                                         0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/fluxmonitorv2      TestFluxMonitor_Deviation/legacy                                                                                          0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/ccip  TestIntegration_legacy_CCIP                                                                                               0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/ccip  TestIntegration_legacy_CCIP/with_dynamic_price_getter                                                                     0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/ccip  TestIntegration_legacy_CCIP/with_dynamic_price_getter/config_change_or_price_registry_update_while_requests_are_inflight  0%         1          false

Copy link
Contributor

Flaky Test Detector for ./go.mod project has failed ❌

Ran new or updated tests between demo-working-changes and 9fa2228 (demo-working-changes-test).

View Flaky Detector Details | Compare Changes

Failed Tests

Ran 1871 tests in total for all affected test packages. Below are the tests identified as flaky, with a pass ratio lower than the 100% threshold:

TestPackage                                                           TestName                           PassRatio  RunCount   Skipped
---------                                                             ---------                          ---------  ---------  ---------
github.com/smartcontractkit/chainlink/v2/core/services/fluxmonitorv2  TestFluxMonitor_Deviation/eip1559  0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/fluxmonitorv2  TestFluxMonitor_Deviation          0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/fluxmonitorv2  TestFluxMonitor_Deviation/legacy   0%         1          false

@jinhoonbang jinhoonbang force-pushed the demo-working-changes-test branch from 24482c1 to 844b104 Compare November 15, 2024 08:33
Copy link
Contributor

Flaky Test Detector for ./go.mod project has failed ❌

Ran new or updated tests between demo-working-changes and 24482c1 (demo-working-changes-test).

View Flaky Detector Details | Compare Changes

Failed Tests

Ran 2821 tests in total for all affected test packages. Below are the tests identified as flaky, with a pass ratio lower than the 100% threshold:

TestPackage                                                           TestName                           PassRatio  RunCount   Skipped
---------                                                             ---------                          ---------  ---------  ---------
github.com/smartcontractkit/chainlink/v2/core/services/fluxmonitorv2  TestFluxMonitor_Deviation/eip1559  0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/fluxmonitorv2  TestFluxMonitor_Deviation          0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/fluxmonitorv2  TestFluxMonitor_Deviation/legacy   0%         1          false
github.com/smartcontractkit/chainlink/v2/core/capabilities/compute    TestCache_EvictAfterSize           0%         1          false

Copy link
Contributor

Flaky Test Detector for ./go.mod project has failed ❌

Ran new or updated tests between demo-working-changes and 844b104 (demo-working-changes-test).

View Flaky Detector Details | Compare Changes

Failed Tests

Ran 3564 tests in total for all affected test packages. Below are the tests identified as flaky, with a pass ratio lower than the 100% threshold:

TestPackage                                                               TestName                                                                                                                             PassRatio  RunCount   Skipped
---------                                                                 ---------                                                                                                                            ---------  ---------  ---------
github.com/smartcontractkit/chainlink/v2/core/services/fluxmonitorv2      TestFluxMonitor_Deviation/eip1559                                                                                                    0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/fluxmonitorv2      TestFluxMonitor_Deviation/legacy                                                                                                     0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/fluxmonitorv2      TestFluxMonitor_Deviation                                                                                                            0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/ccip  TestIntegration_legacy_CCIP/with_dynamic_price_getter                                                                                0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/ccip  TestIntegration_CCIP/with_pipeline_allowOutOfOrderExecution_true                                                                     0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/ccip  TestIntegration_CCIP/with_pipeline_allowOutOfOrderExecution_true/config_change_or_price_registry_update_while_requests_are_inflight  0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/ccip  TestIntegration_legacy_CCIP                                                                                                          0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/ccip  TestIntegration_legacy_CCIP/with_dynamic_price_getter/config_change_or_price_registry_update_while_requests_are_inflight             0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/ccip  TestIntegration_CCIP                                                                                                                 0%         1          false

@jinhoonbang jinhoonbang force-pushed the demo-working-changes-test branch from 6a1f556 to d3af57a Compare November 15, 2024 10:10
Copy link
Contributor

Flaky Test Detector for ./go.mod project has failed ❌

Ran new or updated tests between demo-working-changes and 6a1f556 (demo-working-changes-test).

View Flaky Detector Details | Compare Changes

Failed Tests

Ran 2102 tests in total for all affected test packages. Below are the tests identified as flaky, with a pass ratio lower than the 100% threshold:

TestPackage                                                           TestName                           PassRatio  RunCount   Skipped
---------                                                             ---------                          ---------  ---------  ---------
github.com/smartcontractkit/chainlink/v2/core/services/fluxmonitorv2  TestFluxMonitor_Deviation          0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/fluxmonitorv2  TestFluxMonitor_Deviation/legacy   0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/fluxmonitorv2  TestFluxMonitor_Deviation/eip1559  0%         1          false

Copy link
Contributor

Flaky Test Detector for ./go.mod project has failed ❌

Ran new or updated tests between demo-working-changes and d3af57a (demo-working-changes-test).

View Flaky Detector Details | Compare Changes

Failed Tests

Ran 3571 tests in total for all affected test packages. Below are the tests identified as flaky, with a pass ratio lower than the 100% threshold:

TestPackage                                                           TestName                           PassRatio  RunCount   Skipped
---------                                                             ---------                          ---------  ---------  ---------
github.com/smartcontractkit/chainlink/v2/core/services/fluxmonitorv2  TestFluxMonitor_Deviation/eip1559  0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/fluxmonitorv2  TestFluxMonitor_Deviation          0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/fluxmonitorv2  TestFluxMonitor_Deviation/legacy   0%         1          false

Copy link
Contributor

Flaky Test Detector for ./go.mod project has failed ❌

Ran new or updated tests between demo-working-changes and cff88a5 (demo-working-changes-test).

View Flaky Detector Details | Compare Changes

Failed Tests

Ran 3571 tests in total for all affected test packages. Below are the tests identified as flaky, with a pass ratio lower than the 100% threshold:

TestPackage                                                               TestName                                                                                                                                          PassRatio  RunCount   Skipped
---------                                                                 ---------                                                                                                                                         ---------  ---------  ---------
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/ccip  TestIntegration_CCIP/with_dynamic_price_getter_allowOutOfOrderExecution_false                                                                     0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/ccip  TestIntegration_CCIP                                                                                                                              0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/ccip  TestIntegration_CCIP/with_dynamic_price_getter_allowOutOfOrderExecution_false/config_change_or_price_registry_update_while_requests_are_inflight  0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/fluxmonitorv2      TestFluxMonitor_Deviation                                                                                                                         0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/fluxmonitorv2      TestFluxMonitor_Deviation/legacy                                                                                                                  0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/fluxmonitorv2      TestFluxMonitor_Deviation/eip1559                                                                                                                 0%         1          false
github.com/smartcontractkit/chainlink/v2/core/chains/evm/logpoller        TestLogPoller_BlockTimestamps                                                                                                                     50%        2          false

Copy link
Contributor

Flaky Test Detector for ./go.mod project has failed ❌

Ran new or updated tests between demo-working-changes and 8ae5776 (demo-working-changes-test).

View Flaky Detector Details | Compare Changes

Failed Tests

Ran 3571 tests in total for all affected test packages. Below are the tests identified as flaky, with a pass ratio lower than the 100% threshold:

TestPackage                                                              TestName                                                                                                                                                                                                                                                                                                                                                                                 PassRatio  RunCount   Skipped
---------                                                                ---------                                                                                                                                                                                                                                                                                                                                                                                ---------  ---------  ---------
github.com/smartcontractkit/chainlink/v2/core/services/fluxmonitorv2     TestFluxMonitor_Deviation/legacy                                                                                                                                                                                                                                                                                                                                                         0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/fluxmonitorv2     TestFluxMonitor_Deviation                                                                                                                                                                                                                                                                                                                                                                0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/fluxmonitorv2     TestFluxMonitor_Deviation/eip1559                                                                                                                                                                                                                                                                                                                                                        0%         1          false
github.com/smartcontractkit/chainlink/v2/core/chains/evm/txmgr           TestEthConfirmer_ResumePendingRuns                                                                                                                                                                                                                                                                                                                                                       50%        2          false
github.com/smartcontractkit/chainlink/v2/core/chains/evm/txmgr           TestEthConfirmer_ResumePendingRuns/processes_eth_txes_with_receipt_older_than_minConfirmations_that_reverted                                                                                                                                                                                                                                                                             50%        2          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/llo  TestIntegration_LLO/using_legacy_verifier_configuration_contract,_produces_reports_in_v0.3_format/receives_at_least_one_report_per_channel_from_each_oracle_when_EAs_are_at_100%_reliability/test_on-chain_verification_-_node_36623739633537653661303935323339323832633034383138653936313132663366303361343030316261393761353634633233383532613366316561356663                          80%        5          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/llo  TestIntegration_LLO/using_legacy_verifier_configuration_contract,_produces_reports_in_v0.3_format/receives_at_least_one_report_per_channel_from_each_oracle_when_EAs_are_at_100%_reliability/test_on-chain_verification_-_node_63656363313530376463316464643732393539353163323930383838663039356164623930343464316237336436393665366466303635643638336264346663/destination_verifier     80%        5          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/llo  TestIntegration_LLO/using_legacy_verifier_configuration_contract,_produces_reports_in_v0.3_format/receives_at_least_one_report_per_channel_from_each_oracle_when_EAs_are_at_100%_reliability/test_on-chain_verification_-_node_63656363313530376463316464643732393539353163323930383838663039356164623930343464316237336436393665366466303635643638336264346663#01                       80%        5          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/llo  TestIntegration_LLO/using_legacy_verifier_configuration_contract,_produces_reports_in_v0.3_format/receives_at_least_one_report_per_channel_from_each_oracle_when_EAs_are_at_100%_reliability/test_on-chain_verification_-_node_33623661323762636365623661343264363261336138643032613666306437333635333231353737316465323433613633616330343861313862353964613239#01                       80%        5          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/llo  TestIntegration_LLO/using_legacy_verifier_configuration_contract,_produces_reports_in_v0.3_format                                                                                                                                                                                                                                                                                        80%        5          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/llo  TestIntegration_LLO/using_legacy_verifier_configuration_contract,_produces_reports_in_v0.3_format/receives_at_least_one_report_per_channel_from_each_oracle_when_EAs_are_at_100%_reliability/test_on-chain_verification_-_node_33623661323762636365623661343264363261336138643032613666306437333635333231353737316465323433613633616330343861313862353964613239                          80%        5          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/llo  TestIntegration_LLO/using_legacy_verifier_configuration_contract,_produces_reports_in_v0.3_format/receives_at_least_one_report_per_channel_from_each_oracle_when_EAs_are_at_100%_reliability/test_on-chain_verification_-_node_36623739633537653661303935323339323832633034383138653936313132663366303361343030316261393761353634633233383532613366316561356663#01/destination_verifier  80%        5          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/llo  TestIntegration_LLO/using_legacy_verifier_configuration_contract,_produces_reports_in_v0.3_format/receives_at_least_one_report_per_channel_from_each_oracle_when_EAs_are_at_100%_reliability/test_on-chain_verification_-_node_63656363313530376463316464643732393539353163323930383838663039356164623930343464316237336436393665366466303635643638336264346663#01/destination_verifier  80%        5          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/llo  TestIntegration_LLO/using_legacy_verifier_configuration_contract,_produces_reports_in_v0.3_format/receives_at_least_one_report_per_channel_from_each_oracle_when_EAs_are_at_100%_reliability/test_on-chain_verification_-_node_36623739633537653661303935323339323832633034383138653936313132663366303361343030316261393761353634633233383532613366316561356663#01                       80%        5          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/llo  TestIntegration_LLO/using_legacy_verifier_configuration_contract,_produces_reports_in_v0.3_format/receives_at_least_one_report_per_channel_from_each_oracle_when_EAs_are_at_100%_reliability/test_on-chain_verification_-_node_64616462643138346132643532366631656264643563303666646164393335396232323837353962346437663739643636363839666132353461616438353436#01/destination_verifier  80%        5          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/llo  TestIntegration_LLO/using_legacy_verifier_configuration_contract,_produces_reports_in_v0.3_format/receives_at_least_one_report_per_channel_from_each_oracle_when_EAs_are_at_100%_reliability/test_on-chain_verification_-_node_63656363313530376463316464643732393539353163323930383838663039356164623930343464316237336436393665366466303635643638336264346663                          80%        5          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/llo  TestIntegration_LLO/using_legacy_verifier_configuration_contract,_produces_reports_in_v0.3_format/receives_at_least_one_report_per_channel_from_each_oracle_when_EAs_are_at_100%_reliability/test_on-chain_verification_-_node_33623661323762636365623661343264363261336138643032613666306437333635333231353737316465323433613633616330343861313862353964613239#01/destination_verifier  80%        5          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/llo  TestIntegration_LLO/using_legacy_verifier_configuration_contract,_produces_reports_in_v0.3_format/receives_at_least_one_report_per_channel_from_each_oracle_when_EAs_are_at_100%_reliability/test_on-chain_verification_-_node_64616462643138346132643532366631656264643563303666646164393335396232323837353962346437663739643636363839666132353461616438353436/destination_verifier     80%        5          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/llo  TestIntegration_LLO                                                                                                                                                                                                                                                                                                                                                                      80%        5          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/llo  TestIntegration_LLO/using_legacy_verifier_configuration_contract,_produces_reports_in_v0.3_format/receives_at_least_one_report_per_channel_from_each_oracle_when_EAs_are_at_100%_reliability/test_on-chain_verification_-_node_64616462643138346132643532366631656264643563303666646164393335396232323837353962346437663739643636363839666132353461616438353436#01                       80%        5          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/llo  TestIntegration_LLO/using_legacy_verifier_configuration_contract,_produces_reports_in_v0.3_format/receives_at_least_one_report_per_channel_from_each_oracle_when_EAs_are_at_100%_reliability/test_on-chain_verification_-_node_33623661323762636365623661343264363261336138643032613666306437333635333231353737316465323433613633616330343861313862353964613239/destination_verifier     80%        5          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/llo  TestIntegration_LLO/using_legacy_verifier_configuration_contract,_produces_reports_in_v0.3_format/receives_at_least_one_report_per_channel_from_each_oracle_when_EAs_are_at_100%_reliability/test_on-chain_verification_-_node_64616462643138346132643532366631656264643563303666646164393335396232323837353962346437663739643636363839666132353461616438353436                          80%        5          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/llo  TestIntegration_LLO/using_legacy_verifier_configuration_contract,_produces_reports_in_v0.3_format/receives_at_least_one_report_per_channel_from_each_oracle_when_EAs_are_at_100%_reliability                                                                                                                                                                                             80%        5          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/llo  TestIntegration_LLO/using_legacy_verifier_configuration_contract,_produces_reports_in_v0.3_format/receives_at_least_one_report_per_channel_from_each_oracle_when_EAs_are_at_100%_reliability/test_on-chain_verification_-_node_36623739633537653661303935323339323832633034383138653936313132663366303361343030316261393761353634633233383532613366316561356663/destination_verifier     80%        5          false

Copy link
Contributor

Flaky Test Detector for ./go.mod project has failed ❌

Ran new or updated tests between demo-working-changes and ea474ca (demo-working-changes-test).

View Flaky Detector Details | Compare Changes

Failed Tests

Ran 3571 tests in total for all affected test packages. Below are the tests identified as flaky, with a pass ratio lower than the 100% threshold:

TestPackage                                                               TestName                                                                                                                  PassRatio  RunCount   Skipped
---------                                                                 ---------                                                                                                                 ---------  ---------  ---------
github.com/smartcontractkit/chainlink/v2/core/services/fluxmonitorv2      TestFluxMonitor_Deviation                                                                                                 0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/fluxmonitorv2      TestFluxMonitor_Deviation/eip1559                                                                                         0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/fluxmonitorv2      TestFluxMonitor_Deviation/legacy                                                                                          0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/ccip  TestIntegration_legacy_CCIP/with_dynamic_price_getter                                                                     0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/ccip  TestIntegration_legacy_CCIP/with_dynamic_price_getter/config_change_or_price_registry_update_while_requests_are_inflight  0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/ccip  TestIntegration_legacy_CCIP                                                                                               0%         1          false
github.com/smartcontractkit/chainlink/v2/core/chains/evm/txmgr            TestEthConfirmer_ResumePendingRuns                                                                                        0%         1          false
github.com/smartcontractkit/chainlink/v2/core/chains/evm/txmgr            TestEthConfirmer_ResumePendingRuns/processes_eth_txes_with_receipt_older_than_minConfirmations_that_reverted              0%         1          false

Copy link
Contributor

Flaky Test Detector for ./go.mod project has failed ❌

Ran new or updated tests between demo-working-changes and 3b6728f (demo-working-changes-test).

View Flaky Detector Details | Compare Changes

Failed Tests

Ran 3571 tests in total for all affected test packages. Below are the tests identified as flaky, with a pass ratio lower than the 100% threshold:

TestPackage                                                               TestName                                                                                                                                          PassRatio  RunCount   Skipped
---------                                                                 ---------                                                                                                                                         ---------  ---------  ---------
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/ccip  TestIntegration_legacy_CCIP/with_pipeline                                                                                                         0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/ccip  TestIntegration_CCIP/with_dynamic_price_getter_allowOutOfOrderExecution_false                                                                     0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/ccip  TestIntegration_CCIP/with_dynamic_price_getter_allowOutOfOrderExecution_false/config_change_or_price_registry_update_while_requests_are_inflight  0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/ccip  TestIntegration_legacy_CCIP/with_pipeline/config_change_or_price_registry_update_while_requests_are_inflight                                      0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/ccip  TestIntegration_CCIP                                                                                                                              0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/ccip  TestIntegration_legacy_CCIP                                                                                                                       0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/fluxmonitorv2      TestFluxMonitor_Deviation/legacy                                                                                                                  0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/fluxmonitorv2      TestFluxMonitor_Deviation/eip1559                                                                                                                 0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/fluxmonitorv2      TestFluxMonitor_Deviation                                                                                                                         0%         1          false
github.com/smartcontractkit/chainlink/v2/core/chains/evm/txmgr            TestEthConfirmer_ResumePendingRuns/processes_eth_txes_with_receipt_older_than_minConfirmations_that_reverted                                      75%        4          false
github.com/smartcontractkit/chainlink/v2/core/chains/evm/txmgr            TestEthConfirmer_ResumePendingRuns                                                                                                                75%        4          false
github.com/smartcontractkit/chainlink/v2/core/chains/evm/logpoller        TestLogPoller_BlockTimestamps                                                                                                                     80%        5          false

Copy link
Contributor

Flaky Test Detector for ./go.mod project has failed ❌

Ran new or updated tests between demo-working-changes and fa7bbd9 (demo-working-changes-test).

View Flaky Detector Details | Compare Changes

Failed Tests

Ran 3564 tests in total for all affected test packages. Below are the tests identified as flaky, with a pass ratio lower than the 100% threshold:

TestPackage                                                               TestName                                                                                                                             PassRatio  RunCount   Skipped
---------                                                                 ---------                                                                                                                            ---------  ---------  ---------
github.com/smartcontractkit/chainlink/v2/core/services/fluxmonitorv2      TestFluxMonitor_Deviation/eip1559                                                                                                    0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/fluxmonitorv2      TestFluxMonitor_Deviation/legacy                                                                                                     0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/fluxmonitorv2      TestFluxMonitor_Deviation                                                                                                            0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/ccip  TestIntegration_CCIP                                                                                                                 0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/ccip  TestIntegration_CCIP/with_pipeline_allowOutOfOrderExecution_true                                                                     0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/ccip  TestIntegration_CCIP/with_pipeline_allowOutOfOrderExecution_true/config_change_or_price_registry_update_while_requests_are_inflight  0%         1          false
github.com/smartcontractkit/chainlink/v2/core/chains/evm/logpoller        TestLogPoller_BlockTimestamps                                                                                                        0%         1          false
github.com/smartcontractkit/chainlink/v2/core/chains/evm/txmgr            TestEthConfirmer_ResumePendingRuns/processes_eth_txes_with_receipt_older_than_minConfirmations_that_reverted                         75%        4          false
github.com/smartcontractkit/chainlink/v2/core/chains/evm/txmgr            TestEthConfirmer_ResumePendingRuns                                                                                                   75%        4          false

Copy link
Contributor

Flaky Test Detector for ./go.mod project has failed ❌

Ran new or updated tests between demo-working-changes and de153f4 (demo-working-changes-test).

View Flaky Detector Details | Compare Changes

Failed Tests

Ran 3557 tests in total for all affected test packages. Below are the tests identified as flaky, with a pass ratio lower than the 100% threshold:

TestPackage                                                               TestName                                                                                                                                                                                                                                                                                                                                                                                 PassRatio  RunCount   Skipped
---------                                                                 ---------                                                                                                                                                                                                                                                                                                                                                                                ---------  ---------  ---------
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/ccip  TestIntegration_legacy_CCIP/with_dynamic_price_getter                                                                                                                                                                                                                                                                                                                                    0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/ccip  TestIntegration_legacy_CCIP                                                                                                                                                                                                                                                                                                                                                              0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/ccip  TestIntegration_legacy_CCIP/with_dynamic_price_getter/config_change_or_price_registry_update_while_requests_are_inflight                                                                                                                                                                                                                                                                 0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/fluxmonitorv2      TestFluxMonitor_Deviation/eip1559                                                                                                                                                                                                                                                                                                                                                        0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/fluxmonitorv2      TestFluxMonitor_Deviation/legacy                                                                                                                                                                                                                                                                                                                                                         0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/fluxmonitorv2      TestFluxMonitor_Deviation                                                                                                                                                                                                                                                                                                                                                                0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/llo   TestIntegration_LLO/using_legacy_verifier_configuration_contract,_produces_reports_in_v0.3_format/receives_at_least_one_report_per_channel_from_each_oracle_when_EAs_are_at_100%_reliability/test_on-chain_verification_-_node_64616462643138346132643532366631656264643563303666646164393335396232323837353962346437663739643636363839666132353461616438353436#01                       50%        2          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/llo   TestIntegration_LLO/using_legacy_verifier_configuration_contract,_produces_reports_in_v0.3_format/receives_at_least_one_report_per_channel_from_each_oracle_when_EAs_are_at_100%_reliability/test_on-chain_verification_-_node_63656363313530376463316464643732393539353163323930383838663039356164623930343464316237336436393665366466303635643638336264346663#01                       50%        2          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/llo   TestIntegration_LLO/using_legacy_verifier_configuration_contract,_produces_reports_in_v0.3_format/receives_at_least_one_report_per_channel_from_each_oracle_when_EAs_are_at_100%_reliability/test_on-chain_verification_-_node_33623661323762636365623661343264363261336138643032613666306437333635333231353737316465323433613633616330343861313862353964613239#01/destination_verifier  50%        2          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/llo   TestIntegration_LLO/using_legacy_verifier_configuration_contract,_produces_reports_in_v0.3_format/receives_at_least_one_report_per_channel_from_each_oracle_when_EAs_are_at_100%_reliability/test_on-chain_verification_-_node_63656363313530376463316464643732393539353163323930383838663039356164623930343464316237336436393665366466303635643638336264346663                          50%        2          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/llo   TestIntegration_LLO/using_legacy_verifier_configuration_contract,_produces_reports_in_v0.3_format/receives_at_least_one_report_per_channel_from_each_oracle_when_EAs_are_at_100%_reliability/test_on-chain_verification_-_node_63656363313530376463316464643732393539353163323930383838663039356164623930343464316237336436393665366466303635643638336264346663#01/destination_verifier  50%        2          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/llo   TestIntegration_LLO/using_legacy_verifier_configuration_contract,_produces_reports_in_v0.3_format/receives_at_least_one_report_per_channel_from_each_oracle_when_EAs_are_at_100%_reliability/test_on-chain_verification_-_node_33623661323762636365623661343264363261336138643032613666306437333635333231353737316465323433613633616330343861313862353964613239/destination_verifier     50%        2          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/llo   TestIntegration_LLO/using_legacy_verifier_configuration_contract,_produces_reports_in_v0.3_format/receives_at_least_one_report_per_channel_from_each_oracle_when_EAs_are_at_100%_reliability/test_on-chain_verification_-_node_36623739633537653661303935323339323832633034383138653936313132663366303361343030316261393761353634633233383532613366316561356663                          50%        2          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/llo   TestIntegration_LLO/using_legacy_verifier_configuration_contract,_produces_reports_in_v0.3_format/receives_at_least_one_report_per_channel_from_each_oracle_when_EAs_are_at_100%_reliability/test_on-chain_verification_-_node_64616462643138346132643532366631656264643563303666646164393335396232323837353962346437663739643636363839666132353461616438353436#01/destination_verifier  50%        2          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/llo   TestIntegration_LLO/using_legacy_verifier_configuration_contract,_produces_reports_in_v0.3_format/receives_at_least_one_report_per_channel_from_each_oracle_when_EAs_are_at_100%_reliability/test_on-chain_verification_-_node_36623739633537653661303935323339323832633034383138653936313132663366303361343030316261393761353634633233383532613366316561356663/destination_verifier     50%        2          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/llo   TestIntegration_LLO                                                                                                                                                                                                                                                                                                                                                                      50%        2          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/llo   TestIntegration_LLO/using_legacy_verifier_configuration_contract,_produces_reports_in_v0.3_format/receives_at_least_one_report_per_channel_from_each_oracle_when_EAs_are_at_100%_reliability/test_on-chain_verification_-_node_64616462643138346132643532366631656264643563303666646164393335396232323837353962346437663739643636363839666132353461616438353436                          50%        2          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/llo   TestIntegration_LLO/using_legacy_verifier_configuration_contract,_produces_reports_in_v0.3_format                                                                                                                                                                                                                                                                                        50%        2          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/llo   TestIntegration_LLO/using_legacy_verifier_configuration_contract,_produces_reports_in_v0.3_format/receives_at_least_one_report_per_channel_from_each_oracle_when_EAs_are_at_100%_reliability/test_on-chain_verification_-_node_63656363313530376463316464643732393539353163323930383838663039356164623930343464316237336436393665366466303635643638336264346663/destination_verifier     50%        2          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/llo   TestIntegration_LLO/using_legacy_verifier_configuration_contract,_produces_reports_in_v0.3_format/receives_at_least_one_report_per_channel_from_each_oracle_when_EAs_are_at_100%_reliability/test_on-chain_verification_-_node_64616462643138346132643532366631656264643563303666646164393335396232323837353962346437663739643636363839666132353461616438353436/destination_verifier     50%        2          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/llo   TestIntegration_LLO/using_legacy_verifier_configuration_contract,_produces_reports_in_v0.3_format/receives_at_least_one_report_per_channel_from_each_oracle_when_EAs_are_at_100%_reliability/test_on-chain_verification_-_node_36623739633537653661303935323339323832633034383138653936313132663366303361343030316261393761353634633233383532613366316561356663#01                       50%        2          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/llo   TestIntegration_LLO/using_legacy_verifier_configuration_contract,_produces_reports_in_v0.3_format/receives_at_least_one_report_per_channel_from_each_oracle_when_EAs_are_at_100%_reliability/test_on-chain_verification_-_node_36623739633537653661303935323339323832633034383138653936313132663366303361343030316261393761353634633233383532613366316561356663#01/destination_verifier  50%        2          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/llo   TestIntegration_LLO/using_legacy_verifier_configuration_contract,_produces_reports_in_v0.3_format/receives_at_least_one_report_per_channel_from_each_oracle_when_EAs_are_at_100%_reliability/test_on-chain_verification_-_node_33623661323762636365623661343264363261336138643032613666306437333635333231353737316465323433613633616330343861313862353964613239                          50%        2          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/llo   TestIntegration_LLO/using_legacy_verifier_configuration_contract,_produces_reports_in_v0.3_format/receives_at_least_one_report_per_channel_from_each_oracle_when_EAs_are_at_100%_reliability/test_on-chain_verification_-_node_33623661323762636365623661343264363261336138643032613666306437333635333231353737316465323433613633616330343861313862353964613239#01                       50%        2          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/llo   TestIntegration_LLO/using_legacy_verifier_configuration_contract,_produces_reports_in_v0.3_format/receives_at_least_one_report_per_channel_from_each_oracle_when_EAs_are_at_100%_reliability                                                                                                                                                                                             50%        2          false
github.com/smartcontractkit/chainlink/v2/core/chains/evm/txmgr            TestEthConfirmer_ResumePendingRuns/processes_eth_txes_with_receipt_older_than_minConfirmations_that_reverted                                                                                                                                                                                                                                                                             50%        2          false
github.com/smartcontractkit/chainlink/v2/core/chains/evm/txmgr            TestEthConfirmer_ResumePendingRuns                                                                                                                                                                                                                                                                                                                                                       50%        2          false

Copy link
Contributor

Flaky Test Detector for ./go.mod project has failed ❌

Ran new or updated tests between demo-working-changes and bcaa22f (demo-working-changes-test).

View Flaky Detector Details | Compare Changes

Failed Tests

Ran 3551 tests in total for all affected test packages. Below are the tests identified as flaky, with a pass ratio lower than the 100% threshold:

TestPackage                                                               TestName                                                                                                      PassRatio  RunCount   Skipped
---------                                                                 ---------                                                                                                     ---------  ---------  ---------
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/ccip  TestIntegration_legacy_CCIP/with_pipeline                                                                     0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/ccip  TestIntegration_legacy_CCIP/with_pipeline/config_change_or_price_registry_update_while_requests_are_inflight  0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/ccip  TestIntegration_legacy_CCIP                                                                                   0%         1          false
github.com/smartcontractkit/chainlink/v2/core/chains/evm/txmgr            TestEthConfirmer_ResumePendingRuns/processes_eth_txes_with_receipt_older_than_minConfirmations_that_reverted  50%        2          false
github.com/smartcontractkit/chainlink/v2/core/chains/evm/txmgr            TestEthConfirmer_ResumePendingRuns                                                                            50%        2          false
github.com/smartcontractkit/chainlink/v2/core/chains/evm/logpoller        TestLogPoller_BlockTimestamps                                                                                 50%        2          false
github.com/smartcontractkit/chainlink/v2/core/services/fluxmonitorv2      TestFluxMonitor_Deviation/eip1559                                                                             80%        5          false
github.com/smartcontractkit/chainlink/v2/core/services/fluxmonitorv2      TestFluxMonitor_Deviation                                                                                     80%        5          false
github.com/smartcontractkit/chainlink/v2/core/services/fluxmonitorv2      TestFluxMonitor_Deviation/legacy                                                                              80%        5          false

Copy link
Contributor

Flaky Test Detector for ./go.mod project has failed ❌

Ran new or updated tests between demo-working-changes and 07ec50c (demo-working-changes-test).

View Flaky Detector Details | Compare Changes

Failed Tests

Ran 3571 tests in total for all affected test packages. Below are the tests identified as flaky, with a pass ratio lower than the 100% threshold:

TestPackage                                                                    TestName                                                                                                                                                                                                                                                                                                                                                                                 PassRatio  RunCount   Skipped
---------                                                                      ---------                                                                                                                                                                                                                                                                                                                                                                                ---------  ---------  ---------
github.com/smartcontractkit/chainlink/v2/core/services/fluxmonitorv2           TestFluxMonitor_Deviation                                                                                                                                                                                                                                                                                                                                                                0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/fluxmonitorv2           TestFluxMonitor_Deviation/eip1559                                                                                                                                                                                                                                                                                                                                                        0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/fluxmonitorv2           TestFluxMonitor_Deviation/legacy                                                                                                                                                                                                                                                                                                                                                         0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/llo        TestIntegration_LLO/using_legacy_verifier_configuration_contract,_produces_reports_in_v0.3_format/receives_at_least_one_report_per_channel_from_each_oracle_when_EAs_are_at_100%_reliability/test_on-chain_verification_-_node_33623661323762636365623661343264363261336138643032613666306437333635333231353737316465323433613633616330343861313862353964613239                          0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/llo        TestIntegration_LLO/using_legacy_verifier_configuration_contract,_produces_reports_in_v0.3_format/receives_at_least_one_report_per_channel_from_each_oracle_when_EAs_are_at_100%_reliability/test_on-chain_verification_-_node_63656363313530376463316464643732393539353163323930383838663039356164623930343464316237336436393665366466303635643638336264346663                          0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/llo        TestIntegration_LLO/using_legacy_verifier_configuration_contract,_produces_reports_in_v0.3_format/receives_at_least_one_report_per_channel_from_each_oracle_when_EAs_are_at_100%_reliability/test_on-chain_verification_-_node_64616462643138346132643532366631656264643563303666646164393335396232323837353962346437663739643636363839666132353461616438353436#01/destination_verifier  0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/llo        TestIntegration_LLO/using_legacy_verifier_configuration_contract,_produces_reports_in_v0.3_format/receives_at_least_one_report_per_channel_from_each_oracle_when_EAs_are_at_100%_reliability/test_on-chain_verification_-_node_63656363313530376463316464643732393539353163323930383838663039356164623930343464316237336436393665366466303635643638336264346663/destination_verifier     0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/llo        TestIntegration_LLO/using_legacy_verifier_configuration_contract,_produces_reports_in_v0.3_format/receives_at_least_one_report_per_channel_from_each_oracle_when_EAs_are_at_100%_reliability/test_on-chain_verification_-_node_64616462643138346132643532366631656264643563303666646164393335396232323837353962346437663739643636363839666132353461616438353436/destination_verifier     0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/llo        TestIntegration_LLO/using_legacy_verifier_configuration_contract,_produces_reports_in_v0.3_format/receives_at_least_one_report_per_channel_from_each_oracle_when_EAs_are_at_100%_reliability/test_on-chain_verification_-_node_36623739633537653661303935323339323832633034383138653936313132663366303361343030316261393761353634633233383532613366316561356663#01                       0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/llo        TestIntegration_LLO/using_legacy_verifier_configuration_contract,_produces_reports_in_v0.3_format/receives_at_least_one_report_per_channel_from_each_oracle_when_EAs_are_at_100%_reliability/test_on-chain_verification_-_node_36623739633537653661303935323339323832633034383138653936313132663366303361343030316261393761353634633233383532613366316561356663#01/destination_verifier  0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/llo        TestIntegration_LLO/using_legacy_verifier_configuration_contract,_produces_reports_in_v0.3_format/receives_at_least_one_report_per_channel_from_each_oracle_when_EAs_are_at_100%_reliability/test_on-chain_verification_-_node_64616462643138346132643532366631656264643563303666646164393335396232323837353962346437663739643636363839666132353461616438353436#01                       0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/llo        TestIntegration_LLO/using_legacy_verifier_configuration_contract,_produces_reports_in_v0.3_format/receives_at_least_one_report_per_channel_from_each_oracle_when_EAs_are_at_100%_reliability/test_on-chain_verification_-_node_63656363313530376463316464643732393539353163323930383838663039356164623930343464316237336436393665366466303635643638336264346663#01/destination_verifier  0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/llo        TestIntegration_LLO/using_legacy_verifier_configuration_contract,_produces_reports_in_v0.3_format/receives_at_least_one_report_per_channel_from_each_oracle_when_EAs_are_at_100%_reliability/test_on-chain_verification_-_node_64616462643138346132643532366631656264643563303666646164393335396232323837353962346437663739643636363839666132353461616438353436                          0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/llo        TestIntegration_LLO/using_legacy_verifier_configuration_contract,_produces_reports_in_v0.3_format/receives_at_least_one_report_per_channel_from_each_oracle_when_EAs_are_at_100%_reliability/test_on-chain_verification_-_node_36623739633537653661303935323339323832633034383138653936313132663366303361343030316261393761353634633233383532613366316561356663/destination_verifier     0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/llo        TestIntegration_LLO/using_legacy_verifier_configuration_contract,_produces_reports_in_v0.3_format/receives_at_least_one_report_per_channel_from_each_oracle_when_EAs_are_at_100%_reliability/test_on-chain_verification_-_node_33623661323762636365623661343264363261336138643032613666306437333635333231353737316465323433613633616330343861313862353964613239/destination_verifier     0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/llo        TestIntegration_LLO/using_legacy_verifier_configuration_contract,_produces_reports_in_v0.3_format/receives_at_least_one_report_per_channel_from_each_oracle_when_EAs_are_at_100%_reliability/test_on-chain_verification_-_node_33623661323762636365623661343264363261336138643032613666306437333635333231353737316465323433613633616330343861313862353964613239#01/destination_verifier  0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/llo        TestIntegration_LLO/using_legacy_verifier_configuration_contract,_produces_reports_in_v0.3_format/receives_at_least_one_report_per_channel_from_each_oracle_when_EAs_are_at_100%_reliability/test_on-chain_verification_-_node_33623661323762636365623661343264363261336138643032613666306437333635333231353737316465323433613633616330343861313862353964613239#01                       0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/llo        TestIntegration_LLO/using_legacy_verifier_configuration_contract,_produces_reports_in_v0.3_format/receives_at_least_one_report_per_channel_from_each_oracle_when_EAs_are_at_100%_reliability                                                                                                                                                                                             0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/llo        TestIntegration_LLO/using_legacy_verifier_configuration_contract,_produces_reports_in_v0.3_format/receives_at_least_one_report_per_channel_from_each_oracle_when_EAs_are_at_100%_reliability/test_on-chain_verification_-_node_63656363313530376463316464643732393539353163323930383838663039356164623930343464316237336436393665366466303635643638336264346663#01                       0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/llo        TestIntegration_LLO/using_legacy_verifier_configuration_contract,_produces_reports_in_v0.3_format/receives_at_least_one_report_per_channel_from_each_oracle_when_EAs_are_at_100%_reliability/test_on-chain_verification_-_node_36623739633537653661303935323339323832633034383138653936313132663366303361343030316261393761353634633233383532613366316561356663                          0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/llo        TestIntegration_LLO/using_legacy_verifier_configuration_contract,_produces_reports_in_v0.3_format                                                                                                                                                                                                                                                                                        0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/llo        TestIntegration_LLO                                                                                                                                                                                                                                                                                                                                                                      0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/relay/evm/capabilities  TestLogEventTriggerEVMHappyPath                                                                                                                                                                                                                                                                                                                                                          0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/relay/evm/capabilities  TestLogEventTriggerCursorNewLogs                                                                                                                                                                                                                                                                                                                                                         0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/ccip       TestIntegration_CCIP/with_dynamic_price_getter_allowOutOfOrderExecution_false                                                                                                                                                                                                                                                                                                            50%        2          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/ccip       TestIntegration_CCIP                                                                                                                                                                                                                                                                                                                                                                     50%        2          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/ccip       TestIntegration_CCIP/with_pipeline_allowOutOfOrderExecution_true                                                                                                                                                                                                                                                                                                                         50%        2          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/ccip       TestIntegration_CCIP/with_dynamic_price_getter_allowOutOfOrderExecution_false/config_change_or_price_registry_update_while_requests_are_inflight                                                                                                                                                                                                                                         50%        2          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/ccip       TestIntegration_CCIP/with_pipeline_allowOutOfOrderExecution_true/config_change_or_price_registry_update_while_requests_are_inflight                                                                                                                                                                                                                                                      50%        2          false
github.com/smartcontractkit/chainlink/v2/core/chains/evm/txmgr                 TestEthConfirmer_ResumePendingRuns/processes_eth_txes_with_receipts_older_than_minConfirmations                                                                                                                                                                                                                                                                                          75%        4          false
github.com/smartcontractkit/chainlink/v2/core/chains/evm/txmgr                 TestEthConfirmer_ResumePendingRuns                                                                                                                                                                                                                                                                                                                                                       75%        4          false

Copy link
Contributor

Flaky Test Detector for ./go.mod project has failed ❌

Ran new or updated tests between demo-working-changes and 260486f (demo-working-changes-test).

View Flaky Detector Details | Compare Changes

Failed Tests

Ran 3102 tests in total for all affected test packages. Below are the tests identified as flaky, with a pass ratio lower than the 100% threshold:

TestPackage                                                               TestName                                                                                                                                          PassRatio  RunCount   Skipped
---------                                                                 ---------                                                                                                                                         ---------  ---------  ---------
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/ccip  TestIntegration_CCIP/with_dynamic_price_getter_allowOutOfOrderExecution_false/config_change_or_price_registry_update_while_requests_are_inflight  0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/ccip  TestIntegration_CCIP                                                                                                                              0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/ccip  TestIntegration_CCIP/with_dynamic_price_getter_allowOutOfOrderExecution_false                                                                     0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/fluxmonitorv2      TestFluxMonitor_Deviation                                                                                                                         0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/fluxmonitorv2      TestFluxMonitor_Deviation/eip1559                                                                                                                 0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/fluxmonitorv2      TestFluxMonitor_Deviation/legacy                                                                                                                  0%         1          false
github.com/smartcontractkit/chainlink/v2/core/chains/evm/txmgr            TestEthConfirmer_ResumePendingRuns/processes_eth_txes_with_receipt_older_than_minConfirmations_that_reverted                                      50%        2          false
github.com/smartcontractkit/chainlink/v2/core/chains/evm/txmgr            TestEthConfirmer_ResumePendingRuns                                                                                                                50%        2          false

Copy link
Contributor

Flaky Test Detector for ./go.mod project has failed ❌

Ran new or updated tests between demo-working-changes and a457b20 (demo-working-changes-test).

View Flaky Detector Details | Compare Changes

Failed Tests

Ran 3571 tests in total for all affected test packages. Below are the tests identified as flaky, with a pass ratio lower than the 100% threshold:

TestPackage                                                               TestName                                                                                                                  PassRatio  RunCount   Skipped
---------                                                                 ---------                                                                                                                 ---------  ---------  ---------
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/ccip  TestIntegration_legacy_CCIP/with_pipeline                                                                                 50%        2          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/ccip  TestIntegration_legacy_CCIP/with_dynamic_price_getter/config_change_or_price_registry_update_while_requests_are_inflight  50%        2          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/ccip  TestIntegration_legacy_CCIP/with_dynamic_price_getter                                                                     50%        2          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/ccip  TestIntegration_legacy_CCIP                                                                                               50%        2          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/ccip  TestIntegration_legacy_CCIP/with_pipeline/config_change_or_price_registry_update_while_requests_are_inflight              50%        2          false
github.com/smartcontractkit/chainlink/v2/core/services/fluxmonitorv2      TestFluxMonitor_Deviation/legacy                                                                                          50%        2          false
github.com/smartcontractkit/chainlink/v2/core/services/fluxmonitorv2      TestFluxMonitor_Deviation/eip1559                                                                                         50%        2          false
github.com/smartcontractkit/chainlink/v2/core/services/fluxmonitorv2      TestFluxMonitor_Deviation                                                                                                 50%        2          false

Copy link
Contributor

Flaky Test Detector for ./go.mod project has failed ❌

Ran new or updated tests between demo-working-changes and 1aaf5a5 (demo-working-changes-test).

View Flaky Detector Details | Compare Changes

Failed Tests

Ran 3571 tests in total for all affected test packages. Below are the tests identified as flaky, with a pass ratio lower than the 100% threshold:

TestPackage                                                               TestName                                                                                                                                                                                                                                                                                                                                                                                 PassRatio  RunCount   Skipped
---------                                                                 ---------                                                                                                                                                                                                                                                                                                                                                                                ---------  ---------  ---------
github.com/smartcontractkit/chainlink/v2/core/services/fluxmonitorv2      TestFluxMonitor_Deviation/legacy                                                                                                                                                                                                                                                                                                                                                         0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/fluxmonitorv2      TestFluxMonitor_Deviation                                                                                                                                                                                                                                                                                                                                                                0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/fluxmonitorv2      TestFluxMonitor_Deviation/eip1559                                                                                                                                                                                                                                                                                                                                                        0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/llo   TestIntegration_LLO/using_legacy_verifier_configuration_contract,_produces_reports_in_v0.3_format/receives_at_least_one_report_per_channel_from_each_oracle_when_EAs_are_at_100%_reliability/test_on-chain_verification_-_node_63656363313530376463316464643732393539353163323930383838663039356164623930343464316237336436393665366466303635643638336264346663                          0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/llo   TestIntegration_LLO/using_legacy_verifier_configuration_contract,_produces_reports_in_v0.3_format/receives_at_least_one_report_per_channel_from_each_oracle_when_EAs_are_at_100%_reliability/test_on-chain_verification_-_node_63656363313530376463316464643732393539353163323930383838663039356164623930343464316237336436393665366466303635643638336264346663#01                       0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/llo   TestIntegration_LLO/using_legacy_verifier_configuration_contract,_produces_reports_in_v0.3_format/receives_at_least_one_report_per_channel_from_each_oracle_when_EAs_are_at_100%_reliability/test_on-chain_verification_-_node_36623739633537653661303935323339323832633034383138653936313132663366303361343030316261393761353634633233383532613366316561356663#01                       0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/llo   TestIntegration_LLO/using_legacy_verifier_configuration_contract,_produces_reports_in_v0.3_format/receives_at_least_one_report_per_channel_from_each_oracle_when_EAs_are_at_100%_reliability/test_on-chain_verification_-_node_64616462643138346132643532366631656264643563303666646164393335396232323837353962346437663739643636363839666132353461616438353436/destination_verifier     0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/llo   TestIntegration_LLO                                                                                                                                                                                                                                                                                                                                                                      0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/llo   TestIntegration_LLO/using_legacy_verifier_configuration_contract,_produces_reports_in_v0.3_format/receives_at_least_one_report_per_channel_from_each_oracle_when_EAs_are_at_100%_reliability/test_on-chain_verification_-_node_33623661323762636365623661343264363261336138643032613666306437333635333231353737316465323433613633616330343861313862353964613239                          0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/llo   TestIntegration_LLO/using_legacy_verifier_configuration_contract,_produces_reports_in_v0.3_format/receives_at_least_one_report_per_channel_from_each_oracle_when_EAs_are_at_100%_reliability/test_on-chain_verification_-_node_36623739633537653661303935323339323832633034383138653936313132663366303361343030316261393761353634633233383532613366316561356663                          0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/llo   TestIntegration_LLO/using_legacy_verifier_configuration_contract,_produces_reports_in_v0.3_format/receives_at_least_one_report_per_channel_from_each_oracle_when_EAs_are_at_100%_reliability/test_on-chain_verification_-_node_64616462643138346132643532366631656264643563303666646164393335396232323837353962346437663739643636363839666132353461616438353436#01                       0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/llo   TestIntegration_LLO/using_legacy_verifier_configuration_contract,_produces_reports_in_v0.3_format/receives_at_least_one_report_per_channel_from_each_oracle_when_EAs_are_at_100%_reliability/test_on-chain_verification_-_node_63656363313530376463316464643732393539353163323930383838663039356164623930343464316237336436393665366466303635643638336264346663/destination_verifier     0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/llo   TestIntegration_LLO/using_legacy_verifier_configuration_contract,_produces_reports_in_v0.3_format/receives_at_least_one_report_per_channel_from_each_oracle_when_EAs_are_at_100%_reliability/test_on-chain_verification_-_node_33623661323762636365623661343264363261336138643032613666306437333635333231353737316465323433613633616330343861313862353964613239/destination_verifier     0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/llo   TestIntegration_LLO/using_legacy_verifier_configuration_contract,_produces_reports_in_v0.3_format                                                                                                                                                                                                                                                                                        0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/llo   TestIntegration_LLO/using_legacy_verifier_configuration_contract,_produces_reports_in_v0.3_format/receives_at_least_one_report_per_channel_from_each_oracle_when_EAs_are_at_100%_reliability/test_on-chain_verification_-_node_64616462643138346132643532366631656264643563303666646164393335396232323837353962346437663739643636363839666132353461616438353436                          0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/llo   TestIntegration_LLO/using_legacy_verifier_configuration_contract,_produces_reports_in_v0.3_format/receives_at_least_one_report_per_channel_from_each_oracle_when_EAs_are_at_100%_reliability/test_on-chain_verification_-_node_64616462643138346132643532366631656264643563303666646164393335396232323837353962346437663739643636363839666132353461616438353436#01/destination_verifier  0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/llo   TestIntegration_LLO/using_legacy_verifier_configuration_contract,_produces_reports_in_v0.3_format/receives_at_least_one_report_per_channel_from_each_oracle_when_EAs_are_at_100%_reliability                                                                                                                                                                                             0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/llo   TestIntegration_LLO/using_legacy_verifier_configuration_contract,_produces_reports_in_v0.3_format/receives_at_least_one_report_per_channel_from_each_oracle_when_EAs_are_at_100%_reliability/test_on-chain_verification_-_node_36623739633537653661303935323339323832633034383138653936313132663366303361343030316261393761353634633233383532613366316561356663/destination_verifier     0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/llo   TestIntegration_LLO/using_legacy_verifier_configuration_contract,_produces_reports_in_v0.3_format/receives_at_least_one_report_per_channel_from_each_oracle_when_EAs_are_at_100%_reliability/test_on-chain_verification_-_node_33623661323762636365623661343264363261336138643032613666306437333635333231353737316465323433613633616330343861313862353964613239#01                       0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/llo   TestIntegration_LLO/using_legacy_verifier_configuration_contract,_produces_reports_in_v0.3_format/receives_at_least_one_report_per_channel_from_each_oracle_when_EAs_are_at_100%_reliability/test_on-chain_verification_-_node_33623661323762636365623661343264363261336138643032613666306437333635333231353737316465323433613633616330343861313862353964613239#01/destination_verifier  0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/llo   TestIntegration_LLO/using_legacy_verifier_configuration_contract,_produces_reports_in_v0.3_format/receives_at_least_one_report_per_channel_from_each_oracle_when_EAs_are_at_100%_reliability/test_on-chain_verification_-_node_36623739633537653661303935323339323832633034383138653936313132663366303361343030316261393761353634633233383532613366316561356663#01/destination_verifier  0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/llo   TestIntegration_LLO/using_legacy_verifier_configuration_contract,_produces_reports_in_v0.3_format/receives_at_least_one_report_per_channel_from_each_oracle_when_EAs_are_at_100%_reliability/test_on-chain_verification_-_node_63656363313530376463316464643732393539353163323930383838663039356164623930343464316237336436393665366466303635643638336264346663#01/destination_verifier  0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/ccip  TestIntegration_legacy_CCIP                                                                                                                                                                                                                                                                                                                                                              0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/ccip  TestIntegration_CCIP/with_dynamic_price_getter_allowOutOfOrderExecution_false/config_change_or_price_registry_update_while_requests_are_inflight                                                                                                                                                                                                                                         0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/ccip  TestIntegration_legacy_CCIP/with_dynamic_price_getter                                                                                                                                                                                                                                                                                                                                    0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/ccip  TestIntegration_CCIP/with_dynamic_price_getter_allowOutOfOrderExecution_false                                                                                                                                                                                                                                                                                                            0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/ccip  TestIntegration_legacy_CCIP/with_dynamic_price_getter/config_change_or_price_registry_update_while_requests_are_inflight                                                                                                                                                                                                                                                                 0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/ccip  TestIntegration_CCIP                                                                                                                                                                                                                                                                                                                                                                     0%         1          false

Copy link
Contributor

Flaky Test Detector for ./go.mod project has failed ❌

Ran new or updated tests between demo-working-changes and 8a366f1 (demo-working-changes-test).

View Flaky Detector Details | Compare Changes

Failed Tests

Ran 3570 tests in total for all affected test packages. Below are the tests identified as flaky, with a pass ratio lower than the 100% threshold:

TestPackage                                                               TestName                                                                                                      PassRatio  RunCount   Skipped
---------                                                                 ---------                                                                                                     ---------  ---------  ---------
github.com/smartcontractkit/chainlink/v2/core/chains/evm/txmgr            TestEthConfirmer_ResumePendingRuns/processes_eth_txes_with_receipts_older_than_minConfirmations               0%         1          false
github.com/smartcontractkit/chainlink/v2/core/chains/evm/txmgr            TestEthConfirmer_ResumePendingRuns                                                                            0%         1          false
github.com/smartcontractkit/chainlink/v2/core/chains/evm/txmgr            TestEthConfirmer_ResumePendingRuns/processes_eth_txes_with_receipt_older_than_minConfirmations_that_reverted  0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/ccip  TestIntegration_legacy_CCIP/with_pipeline                                                                     0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/ccip  TestIntegration_legacy_CCIP                                                                                   0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/ccip  TestIntegration_legacy_CCIP/with_pipeline/config_change_or_price_registry_update_while_requests_are_inflight  0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/fluxmonitorv2      TestFluxMonitor_Deviation                                                                                     0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/fluxmonitorv2      TestFluxMonitor_Deviation/eip1559                                                                             0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/fluxmonitorv2      TestFluxMonitor_Deviation/legacy                                                                              0%         1          false

Copy link
Contributor

Flaky Test Detector for ./go.mod project has failed ❌

Ran new or updated tests between demo-working-changes and 9ae54af (demo-working-changes-test).

View Flaky Detector Details | Compare Changes

Failed Tests

Ran 3571 tests in total for all affected test packages. Below are the tests identified as flaky, with a pass ratio lower than the 100% threshold:

TestPackage                                                               TestName                                                                                                                                                                                                                                                                                                                                                                                 PassRatio  RunCount   Skipped
---------                                                                 ---------                                                                                                                                                                                                                                                                                                                                                                                ---------  ---------  ---------
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/ccip  TestIntegration_CCIP/with_pipeline_allowOutOfOrderExecution_true                                                                                                                                                                                                                                                                                                                         0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/ccip  TestIntegration_CCIP/with_pipeline_allowOutOfOrderExecution_true/config_change_or_price_registry_update_while_requests_are_inflight                                                                                                                                                                                                                                                      0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/ccip  TestIntegration_CCIP                                                                                                                                                                                                                                                                                                                                                                     0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/llo   TestIntegration_LLO/using_legacy_verifier_configuration_contract,_produces_reports_in_v0.3_format/receives_at_least_one_report_per_channel_from_each_oracle_when_EAs_are_at_100%_reliability/test_on-chain_verification_-_node_64616462643138346132643532366631656264643563303666646164393335396232323837353962346437663739643636363839666132353461616438353436                          0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/llo   TestIntegration_LLO/using_legacy_verifier_configuration_contract,_produces_reports_in_v0.3_format/receives_at_least_one_report_per_channel_from_each_oracle_when_EAs_are_at_100%_reliability/test_on-chain_verification_-_node_36623739633537653661303935323339323832633034383138653936313132663366303361343030316261393761353634633233383532613366316561356663/destination_verifier     0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/llo   TestIntegration_LLO/using_legacy_verifier_configuration_contract,_produces_reports_in_v0.3_format/receives_at_least_one_report_per_channel_from_each_oracle_when_EAs_are_at_100%_reliability/test_on-chain_verification_-_node_64616462643138346132643532366631656264643563303666646164393335396232323837353962346437663739643636363839666132353461616438353436#01                       0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/llo   TestIntegration_LLO/using_legacy_verifier_configuration_contract,_produces_reports_in_v0.3_format/receives_at_least_one_report_per_channel_from_each_oracle_when_EAs_are_at_100%_reliability/test_on-chain_verification_-_node_63656363313530376463316464643732393539353163323930383838663039356164623930343464316237336436393665366466303635643638336264346663#01                       0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/llo   TestIntegration_LLO/using_legacy_verifier_configuration_contract,_produces_reports_in_v0.3_format/receives_at_least_one_report_per_channel_from_each_oracle_when_EAs_are_at_100%_reliability/test_on-chain_verification_-_node_33623661323762636365623661343264363261336138643032613666306437333635333231353737316465323433613633616330343861313862353964613239#01/destination_verifier  0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/llo   TestIntegration_LLO/using_legacy_verifier_configuration_contract,_produces_reports_in_v0.3_format/receives_at_least_one_report_per_channel_from_each_oracle_when_EAs_are_at_100%_reliability/test_on-chain_verification_-_node_64616462643138346132643532366631656264643563303666646164393335396232323837353962346437663739643636363839666132353461616438353436#01/destination_verifier  0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/llo   TestIntegration_LLO/using_legacy_verifier_configuration_contract,_produces_reports_in_v0.3_format/receives_at_least_one_report_per_channel_from_each_oracle_when_EAs_are_at_100%_reliability/test_on-chain_verification_-_node_33623661323762636365623661343264363261336138643032613666306437333635333231353737316465323433613633616330343861313862353964613239                          0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/llo   TestIntegration_LLO                                                                                                                                                                                                                                                                                                                                                                      0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/llo   TestIntegration_LLO/using_legacy_verifier_configuration_contract,_produces_reports_in_v0.3_format/receives_at_least_one_report_per_channel_from_each_oracle_when_EAs_are_at_100%_reliability/test_on-chain_verification_-_node_36623739633537653661303935323339323832633034383138653936313132663366303361343030316261393761353634633233383532613366316561356663#01/destination_verifier  0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/llo   TestIntegration_LLO/using_legacy_verifier_configuration_contract,_produces_reports_in_v0.3_format/receives_at_least_one_report_per_channel_from_each_oracle_when_EAs_are_at_100%_reliability/test_on-chain_verification_-_node_36623739633537653661303935323339323832633034383138653936313132663366303361343030316261393761353634633233383532613366316561356663#01                       0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/llo   TestIntegration_LLO/using_legacy_verifier_configuration_contract,_produces_reports_in_v0.3_format/receives_at_least_one_report_per_channel_from_each_oracle_when_EAs_are_at_100%_reliability/test_on-chain_verification_-_node_33623661323762636365623661343264363261336138643032613666306437333635333231353737316465323433613633616330343861313862353964613239/destination_verifier     0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/llo   TestIntegration_LLO/using_legacy_verifier_configuration_contract,_produces_reports_in_v0.3_format/receives_at_least_one_report_per_channel_from_each_oracle_when_EAs_are_at_100%_reliability                                                                                                                                                                                             0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/llo   TestIntegration_LLO/using_legacy_verifier_configuration_contract,_produces_reports_in_v0.3_format/receives_at_least_one_report_per_channel_from_each_oracle_when_EAs_are_at_100%_reliability/test_on-chain_verification_-_node_63656363313530376463316464643732393539353163323930383838663039356164623930343464316237336436393665366466303635643638336264346663/destination_verifier     0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/llo   TestIntegration_LLO/using_legacy_verifier_configuration_contract,_produces_reports_in_v0.3_format/receives_at_least_one_report_per_channel_from_each_oracle_when_EAs_are_at_100%_reliability/test_on-chain_verification_-_node_64616462643138346132643532366631656264643563303666646164393335396232323837353962346437663739643636363839666132353461616438353436/destination_verifier     0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/llo   TestIntegration_LLO/using_legacy_verifier_configuration_contract,_produces_reports_in_v0.3_format/receives_at_least_one_report_per_channel_from_each_oracle_when_EAs_are_at_100%_reliability/test_on-chain_verification_-_node_33623661323762636365623661343264363261336138643032613666306437333635333231353737316465323433613633616330343861313862353964613239#01                       0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/llo   TestIntegration_LLO/using_legacy_verifier_configuration_contract,_produces_reports_in_v0.3_format/receives_at_least_one_report_per_channel_from_each_oracle_when_EAs_are_at_100%_reliability/test_on-chain_verification_-_node_36623739633537653661303935323339323832633034383138653936313132663366303361343030316261393761353634633233383532613366316561356663                          0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/llo   TestIntegration_LLO/using_legacy_verifier_configuration_contract,_produces_reports_in_v0.3_format/receives_at_least_one_report_per_channel_from_each_oracle_when_EAs_are_at_100%_reliability/test_on-chain_verification_-_node_63656363313530376463316464643732393539353163323930383838663039356164623930343464316237336436393665366466303635643638336264346663#01/destination_verifier  0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/llo   TestIntegration_LLO/using_legacy_verifier_configuration_contract,_produces_reports_in_v0.3_format                                                                                                                                                                                                                                                                                        0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/llo   TestIntegration_LLO/using_legacy_verifier_configuration_contract,_produces_reports_in_v0.3_format/receives_at_least_one_report_per_channel_from_each_oracle_when_EAs_are_at_100%_reliability/test_on-chain_verification_-_node_63656363313530376463316464643732393539353163323930383838663039356164623930343464316237336436393665366466303635643638336264346663                          0%         1          false
github.com/smartcontractkit/chainlink/v2/core/chains/evm/txmgr            TestEthConfirmer_ResumePendingRuns/processes_eth_txes_with_receipt_older_than_minConfirmations_that_reverted                                                                                                                                                                                                                                                                             0%         1          false
github.com/smartcontractkit/chainlink/v2/core/chains/evm/txmgr            TestEthConfirmer_ResumePendingRuns                                                                                                                                                                                                                                                                                                                                                       0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/fluxmonitorv2      TestFluxMonitor_Deviation                                                                                                                                                                                                                                                                                                                                                                50%        2          false
github.com/smartcontractkit/chainlink/v2/core/services/fluxmonitorv2      TestFluxMonitor_Deviation/eip1559                                                                                                                                                                                                                                                                                                                                                        50%        2          false
github.com/smartcontractkit/chainlink/v2/core/services/fluxmonitorv2      TestFluxMonitor_Deviation/legacy                                                                                                                                                                                                                                                                                                                                                         50%        2          false

Copy link
Contributor

Flaky Test Detector for ./go.mod project has failed ❌

Ran new or updated tests between demo-working-changes and d912ee4 (demo-working-changes-test).

View Flaky Detector Details | Compare Changes

Failed Tests

Ran 3571 tests in total for all affected test packages. Below are the tests identified as flaky, with a pass ratio lower than the 100% threshold:

TestPackage                                                           TestName                                                                                                      PassRatio  RunCount   Skipped
---------                                                             ---------                                                                                                     ---------  ---------  ---------
github.com/smartcontractkit/chainlink/v2/core/chains/evm/txmgr        TestEthConfirmer_ResumePendingRuns                                                                            0%         1          false
github.com/smartcontractkit/chainlink/v2/core/chains/evm/txmgr        TestEthConfirmer_ResumePendingRuns/processes_eth_txes_with_receipt_older_than_minConfirmations_that_reverted  0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/fluxmonitorv2  TestFluxMonitor_Deviation/legacy                                                                              0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/fluxmonitorv2  TestFluxMonitor_Deviation/eip1559                                                                             0%         1          false
github.com/smartcontractkit/chainlink/v2/core/services/fluxmonitorv2  TestFluxMonitor_Deviation                                                                                     0%         1          false

Copy link
Contributor

github-actions bot commented Dec 2, 2024

Flaky Test Detector for ./go.mod project has failed ❌

Ran new or updated tests between demo-working-changes and 2a6d21c (demo-working-changes-test).

View Flaky Detector Details | Compare Changes

Failed Tests

Ran 3571 tests in total for all affected test packages. Below are the tests identified as flaky, with a pass ratio lower than the 100% threshold:

TestPackage                                                               TestName                                                                                                                  PassRatio  RunCount   Skipped
---------                                                                 ---------                                                                                                                 ---------  ---------  ---------
github.com/smartcontractkit/chainlink/v2/core/services/fluxmonitorv2      TestFluxMonitor_Deviation                                                                                                 50%        2          false
github.com/smartcontractkit/chainlink/v2/core/services/fluxmonitorv2      TestFluxMonitor_Deviation/legacy                                                                                          50%        2          false
github.com/smartcontractkit/chainlink/v2/core/services/fluxmonitorv2      TestFluxMonitor_Deviation/eip1559                                                                                         50%        2          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/ccip  TestIntegration_legacy_CCIP                                                                                               50%        2          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/ccip  TestIntegration_legacy_CCIP/with_dynamic_price_getter/config_change_or_price_registry_update_while_requests_are_inflight  50%        2          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/ccip  TestIntegration_legacy_CCIP/with_pipeline                                                                                 50%        2          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/ccip  TestIntegration_legacy_CCIP/with_pipeline/config_change_or_price_registry_update_while_requests_are_inflight              50%        2          false
github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/ccip  TestIntegration_legacy_CCIP/with_dynamic_price_getter                                                                     50%        2          false

@jinhoonbang jinhoonbang force-pushed the demo-working-changes-test branch from 2a6d21c to 9d4390c Compare December 3, 2024 17:46
@jinhoonbang jinhoonbang deleted the branch demo-working-changes December 3, 2024 18:09
@jinhoonbang jinhoonbang closed this Dec 3, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
build-publish Build and Publish image to SDLC do-not-merge
Projects
None yet
Development

Successfully merging this pull request may close these issues.