Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

web: Add onchainSigningStrategy to job spec & generalize chains/nodes API/CLI #15591

Open
wants to merge 2 commits into
base: develop
Choose a base branch
from

Conversation

archseer
Copy link
Contributor

@archseer archseer commented Dec 10, 2024

Generalize chains/nodes API and CLI so new LOOPs are automatically supported. UI changes here too smartcontractkit/operator-ui#98

Copy link
Contributor

I see you updated files related to core. Please run pnpm changeset in the root directory to add a changeset as well as in the text include at least one of the following tags:

  • #added For any new functionality added.
  • #breaking_change For any functionality that requires manual action for the node to boot.
  • #bugfix For bug fixes.
  • #changed For any change to the existing functionality.
  • #db_update For any feature that introduces updates to database schema.
  • #deprecation_notice For any upcoming deprecation functionality.
  • #internal For changesets that need to be excluded from the final changelog.
  • #nops For any feature that is NOP facing and needs to be in the official Release Notes for the release.
  • #removed For any functionality/config that is removed.
  • #updated For any functionality that is updated.
  • #wip For any change that is not ready yet and external communication about it should be held off till it is feature complete.

🎖️ No JIRA issue number found in: PR title, commit message, or branch name. Please include the issue ID in one of these.

Copy link
Contributor

Flakeguard Summary

Setting Value
Project github.com/smartcontractkit/chainlink/v2
Max Pass Ratio 100.00%
Test Run Count 3
Race Detection false
Excluded Tests TestChainComponents

Found Flaky Tests ❌

Category Total
Tests 329
Panicked Tests 0
Raced Tests 0
Flaky Tests 2
Flaky Test Ratio 0.60%
Runs 987
Passes 981
Failures 6
Skips 0
Pass Ratio 99.39%
Name Pass Ratio Panicked? Timed Out? Race? Runs Successes Failures Skips Package Package Panicked? Avg Duration Code Owners
TestResolver_OCR2Spec 0.00% false false false 3 0 3 0 github.com/smartcontractkit/chainlink/v2/core/web/resolver false 0s @smartcontractkit/deployment-automation, @smartcontractkit/foundations, @smartcontractkit/core
TestResolver_OCR2Spec/OCR_2_spec 0.00% false false false 3 0 3 0 github.com/smartcontractkit/chainlink/v2/core/web/resolver false 40ms @smartcontractkit/deployment-automation, @smartcontractkit/foundations, @smartcontractkit/core

Copy link
Contributor

github-actions bot commented Dec 10, 2024

AER Report: CI Core

aer_workflow , commit , Detect Changes , Clean Go Tidy & Generate , Scheduled Run Frequency , Flakeguard Root Project / Get Tests To Run , lint , Core Tests (go_core_tests) , Core Tests (go_core_tests_integration) , Flakeguard Deployment Project , Core Tests (go_core_ccip_deployment_tests) , Core Tests (go_core_race_tests) , Core Tests (go_core_fuzz) , Flakeguard Root Project / Run Tests (github.com/smartcontractkit/chainlink/v2/core/cmd, ubuntu-latest) , Flakeguard Root Project / Run Tests (github.com/smartcontractkit/chainlink/v2/core/web, ubuntu-latest) , Flakeguard Root Project / Run Tests (github.com/smartcontractkit/chainlink/v2/core/web/presenters, ubuntu-latest) , Flakeguard Root Project / Run Tests (github.com/smartcontractkit/chainlink/v2/core/web/resolver, ubuntu-latest) , Flakeguard Root Project / Report , Flakey Test Detection , SonarQube Scan

1. Flaky tests below pass ratio threshold: Run tests with flakeguard

Source of Error:
Run tests with flakeguard	2024-12-13T17:08:30.6906729Z All test results saved to test-result.json
Run tests with flakeguard	2024-12-13T17:08:30.6907692Z Found 5 flaky tests below the pass ratio threshold of 1.00:
Run tests with flakeguard	2024-12-13T17:08:30.6922547Z | TestETHKeysController_ChainSuccess_ResetWithAbandon | 66.67% | false | false | false | 3 | 2 | 1 | 0 | github.com/smartcontractkit/chainlink/v2/core/web | false | 1.386666666s | Unknown |
Run tests with flakeguard	2024-12-13T17:08:30.6924101Z | TestETHKeysController_ChainSuccess_UpdateNonce | 66.67% | false | false | false | 3 | 2 | 1 | 0 | github.com/smartcontractkit/chainlink/v2/core/web | false | 1.323333333s | Unknown |
Run tests with flakeguard	2024-12-13T17:08:30.6925803Z | TestPipelineRunsController_Index_Pagination | 66.67% | false | false | false | 3 | 2 | 1 | 0 | github.com/smartcontractkit/chainlink/v2/core/web | false | 1.306666666s | Unknown |
Run tests with flakeguard	2024-12-13T17:08:30.6927333Z | TestTransfersController_CreateSuccess_From_BalanceMonitorDisabled | 66.67% | false | false | false | 3 | 2 | 1 | 0 | github.com/smartcontractkit/chainlink/v2/core/web | false | 1.266666666s | Unknown |
Run tests with flakeguard	2024-12-13T17:08:30.6928911Z | TestTransfersController_TransferBalanceToLowError_ZeroBalance | 66.67% | false | false | false | 3 | 2 | 1 | 0 | github.com/smartcontractkit/chainlink/v2/core/web | false | 1.523333333s | Unknown |
Run tests with flakeguard	2024-12-13T17:08:30.6932534Z ##[error]Process completed with exit code 1.

Why: The tests listed have a pass ratio below the required threshold of 1.00, indicating that they are flaky and failed at least once during the multiple runs.

Suggested fix: Investigate the flaky tests to identify and resolve the underlying issues causing the intermittent failures. This may involve improving test stability or addressing race conditions.

2. Flaky tests below pass ratio threshold: Run tests with flakeguard

Source of Error:
Run tests with flakeguard	2024-12-13T17:06:03.3197804Z All test results saved to test-result.json
Run tests with flakeguard	2024-12-13T17:06:03.3198713Z Found 2 flaky tests below the pass ratio threshold of 1.00:
Run tests with flakeguard	2024-12-13T17:06:03.3206566Z | TestShell_CreateETHKey | 66.67% | false | false | false | 3 | 2 | 1 | 0 | github.com/smartcontractkit/chainlink/v2/core/cmd | false | 1.266666666s | Unknown |
Run tests with flakeguard	2024-12-13T17:06:03.3211042Z | TestShell_ListETHKeys | 66.67% | false | false | false | 3 | 2 | 1 | 0 | github.com/smartcontractkit/chainlink/v2/core/cmd | false | 1.266666666s | Unknown |
Run tests with flakeguard	2024-12-13T17:06:03.3218727Z ##[error]Process completed with exit code 1.

Why: The tests listed have a pass ratio below the required threshold of 1.00, indicating that they are flaky and failed at least once during the multiple runs.

Suggested fix: Investigate the flaky tests to identify and resolve the underlying issues causing the intermittent failures. This may involve improving test stability or addressing race conditions.

3. Test failures in mercury package: Run tests

Source of Error:
Run tests	2024-12-13T17:20:25.0148880Z FAIL	github.com/smartcontractkit/chainlink/v2/core/services/ocr2/plugins/mercury	1202.606s
Run tests	2024-12-13T17:20:25.0184065Z go_core_tests exiting with code 1
Run tests	2024-12-13T17:20:25.0187356Z ##[error]Process completed with exit code 1.

Why: The mercury package tests failed, causing the overall test suite to exit with a non-zero status code.

Suggested fix: Review the specific tests within the mercury package to determine the cause of the failures. Address any issues related to test logic, dependencies, or environment setup.

AER Report: Operator UI CI ran successfully ✅

aer_workflow , commit

Copy link
Contributor

Flakeguard Summary

Ran new or updated tests between develop and f65d196 (web-fixes).

View Flaky Detector Details | Compare Changes

Found Flaky Tests ❌

Name Pass Ratio Panicked? Timed Out? Race? Runs Successes Failures Skips Package Package Panicked? Avg Duration Code Owners
TestResolver_Chain 0.00% false false false 3 0 3 0 github.com/smartcontractkit/chainlink/v2/core/web/resolver false 0s @smartcontractkit/deployment-automation, @smartcontractkit/foundations, @smartcontractkit/core
TestResolver_Chain/multiple_chain_with_same_chainID_found_error 0.00% false false false 3 0 3 0 github.com/smartcontractkit/chainlink/v2/core/web/resolver false 86.666666ms @smartcontractkit/deployment-automation, @smartcontractkit/foundations, @smartcontractkit/core
TestResolver_Chain/not_found_error 0.00% false false false 3 0 3 0 github.com/smartcontractkit/chainlink/v2/core/web/resolver false 83.333333ms @smartcontractkit/deployment-automation, @smartcontractkit/foundations, @smartcontractkit/core
TestResolver_Chain/should_return_aptos_chain_if_network_is_aptos 0.00% false false false 3 0 3 0 github.com/smartcontractkit/chainlink/v2/core/web/resolver false 70ms @smartcontractkit/deployment-automation, @smartcontractkit/foundations, @smartcontractkit/core
TestResolver_Chain/success 0.00% false false false 3 0 3 0 github.com/smartcontractkit/chainlink/v2/core/web/resolver false 73.333333ms @smartcontractkit/deployment-automation, @smartcontractkit/foundations, @smartcontractkit/core
TestResolver_Chains 0.00% false false false 3 0 3 0 github.com/smartcontractkit/chainlink/v2/core/web/resolver false 0s @smartcontractkit/deployment-automation, @smartcontractkit/foundations, @smartcontractkit/core
TestResolver_Chains/no_chains 0.00% false false false 3 0 3 0 github.com/smartcontractkit/chainlink/v2/core/web/resolver false 83.333333ms @smartcontractkit/deployment-automation, @smartcontractkit/foundations, @smartcontractkit/core
TestResolver_Chains/success 0.00% false false false 3 0 3 0 github.com/smartcontractkit/chainlink/v2/core/web/resolver false 86.666666ms @smartcontractkit/deployment-automation, @smartcontractkit/foundations, @smartcontractkit/core
TestResolver_ETHKeys 0.00% false false false 3 0 3 0 github.com/smartcontractkit/chainlink/v2/core/web/resolver false 0s @smartcontractkit/deployment-automation, @smartcontractkit/foundations, @smartcontractkit/core
TestResolver_ETHKeys/Empty_set_on_legacy_evm_chains 0.00% false false false 3 0 3 0 github.com/smartcontractkit/chainlink/v2/core/web/resolver false 70ms @smartcontractkit/deployment-automation, @smartcontractkit/foundations, @smartcontractkit/core
TestResolver_ETHKeys/generic_error_on_GetLINKBalance() 0.00% false false false 3 0 3 0 github.com/smartcontractkit/chainlink/v2/core/web/resolver false 86.666666ms @smartcontractkit/deployment-automation, @smartcontractkit/foundations, @smartcontractkit/core
TestResolver_ETHKeys/success_on_prod 0.00% false false false 3 0 3 0 github.com/smartcontractkit/chainlink/v2/core/web/resolver false 83.333333ms @smartcontractkit/deployment-automation, @smartcontractkit/foundations, @smartcontractkit/core
TestResolver_ETHKeys/success_with_no_chains 0.00% false false false 3 0 3 0 github.com/smartcontractkit/chainlink/v2/core/web/resolver false 80ms @smartcontractkit/deployment-automation, @smartcontractkit/foundations, @smartcontractkit/core
TestResolver_ETHKeys/success_with_no_eth_balance 0.00% false false false 3 0 3 0 github.com/smartcontractkit/chainlink/v2/core/web/resolver false 76.666666ms @smartcontractkit/deployment-automation, @smartcontractkit/foundations, @smartcontractkit/core
TestResolver_EthTransaction 0.00% false false false 3 0 3 0 github.com/smartcontractkit/chainlink/v2/core/web/resolver false 0s @smartcontractkit/deployment-automation, @smartcontractkit/foundations, @smartcontractkit/core
TestResolver_EthTransaction/success 0.00% false false false 3 0 3 0 github.com/smartcontractkit/chainlink/v2/core/web/resolver false 90ms @smartcontractkit/deployment-automation, @smartcontractkit/foundations, @smartcontractkit/core
TestResolver_EthTransaction/success_without_nil_values 0.00% false false false 3 0 3 0 github.com/smartcontractkit/chainlink/v2/core/web/resolver false 83.333333ms @smartcontractkit/deployment-automation, @smartcontractkit/foundations, @smartcontractkit/core
TestResolver_Nodes 0.00% false false false 3 0 3 0 github.com/smartcontractkit/chainlink/v2/core/web/resolver false 0s @smartcontractkit/deployment-automation, @smartcontractkit/foundations, @smartcontractkit/core
TestResolver_Nodes/generic_error 0.00% false false false 3 0 3 0 github.com/smartcontractkit/chainlink/v2/core/web/resolver false 63.333333ms @smartcontractkit/deployment-automation, @smartcontractkit/foundations, @smartcontractkit/core
TestResolver_Nodes/success 0.00% false false false 3 0 3 0 github.com/smartcontractkit/chainlink/v2/core/web/resolver false 63.333333ms @smartcontractkit/deployment-automation, @smartcontractkit/foundations, @smartcontractkit/core
Test_NodeQuery 0.00% false false false 3 0 3 0 github.com/smartcontractkit/chainlink/v2/core/web/resolver false 0s @smartcontractkit/deployment-automation, @smartcontractkit/foundations, @smartcontractkit/core
Test_NodeQuery/not_found_error 0.00% false false false 3 0 3 0 github.com/smartcontractkit/chainlink/v2/core/web/resolver false 73.333333ms @smartcontractkit/deployment-automation, @smartcontractkit/foundations, @smartcontractkit/core
Test_NodeQuery/success 0.00% false false false 3 0 3 0 github.com/smartcontractkit/chainlink/v2/core/web/resolver false 83.333333ms @smartcontractkit/deployment-automation, @smartcontractkit/foundations, @smartcontractkit/core

Artifacts

For detailed logs of the failed tests, please refer to the artifact failed-test-results-with-logs.json.

@archseer archseer force-pushed the web-fixes branch 3 times, most recently from 0a91bed to cdf40ed Compare December 12, 2024 07:45
Copy link
Contributor

Flakeguard Summary

Ran new or updated tests between develop and cdf40ed (web-fixes).

View Flaky Detector Details | Compare Changes

Found Flaky Tests ❌

Name Pass Ratio Panicked? Timed Out? Race? Runs Successes Failures Skips Package Package Panicked? Avg Duration Code Owners
TestETHKeysController_ChainFailure_InvalidAbandon 33.33% false false false 3 1 2 0 github.com/smartcontractkit/chainlink/v2/core/web false 1.39s Unknown
TestPipelineRunsController_Index_Pagination 66.67% false false false 3 2 1 0 github.com/smartcontractkit/chainlink/v2/core/web false 1.336666666s Unknown
TestPipelineRunsController_Show_HappyPath 66.67% false false false 3 2 1 0 github.com/smartcontractkit/chainlink/v2/core/web false 1.253333333s Unknown
TestTransfersController_CreateSuccess_From_BalanceMonitorDisabled 66.67% false false false 3 2 1 0 github.com/smartcontractkit/chainlink/v2/core/web false 1.273333333s Unknown
Test_CosmosChainsController_Index 0.00% false false false 3 0 3 0 github.com/smartcontractkit/chainlink/v2/core/web false 1.26s Unknown
Test_CosmosChainsController_Show 0.00% false false false 3 0 3 0 github.com/smartcontractkit/chainlink/v2/core/web false 0s Unknown
Test_CosmosChainsController_Show/not_found 0.00% false false false 3 0 3 0 github.com/smartcontractkit/chainlink/v2/core/web false 1.233333333s Unknown
Test_CosmosChainsController_Show/success 0.00% false false false 3 0 3 0 github.com/smartcontractkit/chainlink/v2/core/web false 1.256666666s Unknown
Test_EVMChainsController_Index 0.00% false false false 3 0 3 0 github.com/smartcontractkit/chainlink/v2/core/web false 1.356666666s Unknown
Test_EVMChainsController_Show 0.00% false false false 3 0 3 0 github.com/smartcontractkit/chainlink/v2/core/web false 0s Unknown
Test_EVMChainsController_Show/invalid_id 0.00% false false false 3 0 3 0 github.com/smartcontractkit/chainlink/v2/core/web false 1.066666666s Unknown
Test_EVMChainsController_Show/not_found 0.00% false false false 3 0 3 0 github.com/smartcontractkit/chainlink/v2/core/web false 1.23s Unknown
Test_EVMChainsController_Show/success 0.00% false false false 3 0 3 0 github.com/smartcontractkit/chainlink/v2/core/web false 1.186666666s Unknown
Test_SolanaChainsController_Index 0.00% false false false 3 0 3 0 github.com/smartcontractkit/chainlink/v2/core/web false 1.346666666s Unknown
Test_SolanaChainsController_Show 0.00% false false false 3 0 3 0 github.com/smartcontractkit/chainlink/v2/core/web false 0s Unknown
Test_SolanaChainsController_Show/not_found 0.00% false false false 3 0 3 0 github.com/smartcontractkit/chainlink/v2/core/web false 1.23s Unknown
Test_SolanaChainsController_Show/success 0.00% false false false 3 0 3 0 github.com/smartcontractkit/chainlink/v2/core/web false 1.14s Unknown
TestResolver_Chain 0.00% false false false 3 0 3 0 github.com/smartcontractkit/chainlink/v2/core/web/resolver false 0s @smartcontractkit/deployment-automation, @smartcontractkit/foundations, @smartcontractkit/core
TestResolver_Chain/multiple_chain_with_same_chainID_found_error 0.00% false false false 3 0 3 0 github.com/smartcontractkit/chainlink/v2/core/web/resolver false 86.666666ms @smartcontractkit/deployment-automation, @smartcontractkit/foundations, @smartcontractkit/core
TestResolver_Chain/not_found_error 0.00% false false false 3 0 3 0 github.com/smartcontractkit/chainlink/v2/core/web/resolver false 86.666666ms @smartcontractkit/deployment-automation, @smartcontractkit/foundations, @smartcontractkit/core
TestResolver_Chain/should_return_aptos_chain_if_network_is_aptos 0.00% false false false 3 0 3 0 github.com/smartcontractkit/chainlink/v2/core/web/resolver false 83.333333ms @smartcontractkit/deployment-automation, @smartcontractkit/foundations, @smartcontractkit/core
TestResolver_Chain/success 0.00% false false false 3 0 3 0 github.com/smartcontractkit/chainlink/v2/core/web/resolver false 76.666666ms @smartcontractkit/deployment-automation, @smartcontractkit/foundations, @smartcontractkit/core
TestResolver_Chains 0.00% false false false 3 0 3 0 github.com/smartcontractkit/chainlink/v2/core/web/resolver false 0s @smartcontractkit/deployment-automation, @smartcontractkit/foundations, @smartcontractkit/core
TestResolver_Chains/no_chains 0.00% false false false 3 0 3 0 github.com/smartcontractkit/chainlink/v2/core/web/resolver false 80ms @smartcontractkit/deployment-automation, @smartcontractkit/foundations, @smartcontractkit/core
TestResolver_Chains/success 0.00% false false false 3 0 3 0 github.com/smartcontractkit/chainlink/v2/core/web/resolver false 80ms @smartcontractkit/deployment-automation, @smartcontractkit/foundations, @smartcontractkit/core
TestResolver_ETHKeys 0.00% false false false 3 0 3 0 github.com/smartcontractkit/chainlink/v2/core/web/resolver false 0s @smartcontractkit/deployment-automation, @smartcontractkit/foundations, @smartcontractkit/core
TestResolver_ETHKeys/Empty_set_on_legacy_evm_chains 0.00% false false false 3 0 3 0 github.com/smartcontractkit/chainlink/v2/core/web/resolver false 86.666666ms @smartcontractkit/deployment-automation, @smartcontractkit/foundations, @smartcontractkit/core
TestResolver_ETHKeys/generic_error_on_GetLINKBalance() 0.00% false false false 3 0 3 0 github.com/smartcontractkit/chainlink/v2/core/web/resolver false 83.333333ms @smartcontractkit/deployment-automation, @smartcontractkit/foundations, @smartcontractkit/core
TestResolver_ETHKeys/success_on_prod 0.00% false false false 3 0 3 0 github.com/smartcontractkit/chainlink/v2/core/web/resolver false 103.333333ms @smartcontractkit/deployment-automation, @smartcontractkit/foundations, @smartcontractkit/core
TestResolver_ETHKeys/success_with_no_chains 0.00% false false false 3 0 3 0 github.com/smartcontractkit/chainlink/v2/core/web/resolver false 96.666666ms @smartcontractkit/deployment-automation, @smartcontractkit/foundations, @smartcontractkit/core
TestResolver_ETHKeys/success_with_no_eth_balance 0.00% false false false 3 0 3 0 github.com/smartcontractkit/chainlink/v2/core/web/resolver false 83.333333ms @smartcontractkit/deployment-automation, @smartcontractkit/foundations, @smartcontractkit/core
TestResolver_EthTransaction 0.00% false false false 3 0 3 0 github.com/smartcontractkit/chainlink/v2/core/web/resolver false 0s @smartcontractkit/deployment-automation, @smartcontractkit/foundations, @smartcontractkit/core
TestResolver_EthTransaction/success 0.00% false false false 3 0 3 0 github.com/smartcontractkit/chainlink/v2/core/web/resolver false 86.666666ms @smartcontractkit/deployment-automation, @smartcontractkit/foundations, @smartcontractkit/core
TestResolver_EthTransaction/success_without_nil_values 0.00% false false false 3 0 3 0 github.com/smartcontractkit/chainlink/v2/core/web/resolver false 100ms @smartcontractkit/deployment-automation, @smartcontractkit/foundations, @smartcontractkit/core
TestResolver_Nodes 0.00% false false false 3 0 3 0 github.com/smartcontractkit/chainlink/v2/core/web/resolver false 0s @smartcontractkit/deployment-automation, @smartcontractkit/foundations, @smartcontractkit/core
TestResolver_Nodes/generic_error 0.00% false false false 3 0 3 0 github.com/smartcontractkit/chainlink/v2/core/web/resolver false 90ms @smartcontractkit/deployment-automation, @smartcontractkit/foundations, @smartcontractkit/core
TestResolver_Nodes/success 0.00% false false false 3 0 3 0 github.com/smartcontractkit/chainlink/v2/core/web/resolver false 83.333333ms @smartcontractkit/deployment-automation, @smartcontractkit/foundations, @smartcontractkit/core
Test_NodeQuery 0.00% false false false 3 0 3 0 github.com/smartcontractkit/chainlink/v2/core/web/resolver false 0s @smartcontractkit/deployment-automation, @smartcontractkit/foundations, @smartcontractkit/core
Test_NodeQuery/not_found_error 0.00% false false false 3 0 3 0 github.com/smartcontractkit/chainlink/v2/core/web/resolver false 76.666666ms @smartcontractkit/deployment-automation, @smartcontractkit/foundations, @smartcontractkit/core
Test_NodeQuery/success 0.00% false false false 3 0 3 0 github.com/smartcontractkit/chainlink/v2/core/web/resolver false 90ms @smartcontractkit/deployment-automation, @smartcontractkit/foundations, @smartcontractkit/core

Artifacts

For detailed logs of the failed tests, please refer to the artifact failed-test-results-with-logs.json.

@archseer archseer force-pushed the web-fixes branch 2 times, most recently from d2d1ad8 to 8315b78 Compare December 12, 2024 08:20
Copy link
Contributor

Flakeguard Summary

Ran new or updated tests between develop and 8315b78 (web-fixes).

View Flaky Detector Details | Compare Changes

Found Flaky Tests ❌

Name Pass Ratio Panicked? Timed Out? Race? Runs Successes Failures Skips Package Package Panicked? Avg Duration Code Owners
TestShell_CreateETHKey 66.67% false false false 3 2 1 0 github.com/smartcontractkit/chainlink/v2/core/cmd false 1.266666666s Unknown
TestShell_IndexCosmosChains 0.00% false false false 3 0 3 0 github.com/smartcontractkit/chainlink/v2/core/cmd false 1.23s Unknown
TestShell_IndexEVMChains 0.00% false false false 3 0 3 0 github.com/smartcontractkit/chainlink/v2/core/cmd false 1.25s Unknown
TestShell_IndexSolanaChains 0.00% false false false 3 0 3 0 github.com/smartcontractkit/chainlink/v2/core/cmd false 1.23s Unknown
TestETHKeysController_ChainFailure_InvalidAbandon 66.67% false false false 3 2 1 0 github.com/smartcontractkit/chainlink/v2/core/web false 1.276666666s Unknown
TestETHKeysController_ChainSuccess_Disable 66.67% false false false 3 2 1 0 github.com/smartcontractkit/chainlink/v2/core/web false 1.173333333s Unknown
TestETHKeysController_ChainSuccess_UpdateNonce 66.67% false false false 3 2 1 0 github.com/smartcontractkit/chainlink/v2/core/web false 1.203333333s Unknown
TestTransfersController_CreateSuccess_From 66.67% false false false 3 2 1 0 github.com/smartcontractkit/chainlink/v2/core/web false 1.153333333s Unknown
Test_CosmosChainsController_Index 0.00% false false false 3 0 3 0 github.com/smartcontractkit/chainlink/v2/core/web false 1.376666666s Unknown
Test_CosmosChainsController_Show 0.00% false false false 3 0 3 0 github.com/smartcontractkit/chainlink/v2/core/web false 0s Unknown
Test_CosmosChainsController_Show/not_found 0.00% false false false 3 0 3 0 github.com/smartcontractkit/chainlink/v2/core/web false 1.23s Unknown
Test_CosmosChainsController_Show/success 0.00% false false false 3 0 3 0 github.com/smartcontractkit/chainlink/v2/core/web false 1.216666666s Unknown
Test_EVMChainsController_Index 0.00% false false false 3 0 3 0 github.com/smartcontractkit/chainlink/v2/core/web false 1.393333333s Unknown
Test_EVMChainsController_Show 0.00% false false false 3 0 3 0 github.com/smartcontractkit/chainlink/v2/core/web false 0s Unknown
Test_EVMChainsController_Show/invalid_id 0.00% false false false 3 0 3 0 github.com/smartcontractkit/chainlink/v2/core/web false 1.19s Unknown
Test_EVMChainsController_Show/not_found 0.00% false false false 3 0 3 0 github.com/smartcontractkit/chainlink/v2/core/web false 1.153333333s Unknown
Test_EVMChainsController_Show/success 0.00% false false false 3 0 3 0 github.com/smartcontractkit/chainlink/v2/core/web false 1.163333333s Unknown
Test_SolanaChainsController_Index 0.00% false false false 3 0 3 0 github.com/smartcontractkit/chainlink/v2/core/web false 1.353333333s Unknown
Test_SolanaChainsController_Show 0.00% false false false 3 0 3 0 github.com/smartcontractkit/chainlink/v2/core/web false 0s Unknown
Test_SolanaChainsController_Show/not_found 0.00% false false false 3 0 3 0 github.com/smartcontractkit/chainlink/v2/core/web false 1.143333333s Unknown
Test_SolanaChainsController_Show/success 0.00% false false false 3 0 3 0 github.com/smartcontractkit/chainlink/v2/core/web false 1.166666666s Unknown

Artifacts

For detailed logs of the failed tests, please refer to the artifact failed-test-results-with-logs.json.

@archseer archseer changed the title web: Add onchainSigningStrategy to job spec & other fixes web: Add onchainSigningStrategy to job spec & generalize chains/nodes API/CLI Dec 12, 2024
@archseer archseer force-pushed the web-fixes branch 2 times, most recently from e26dabb to a6064bc Compare December 13, 2024 06:06
Copy link
Contributor

Flakeguard Summary

Ran new or updated tests between develop and a6064bc (web-fixes).

View Flaky Detector Details | Compare Changes

Found Flaky Tests ❌

Name Pass Ratio Panicked? Timed Out? Race? Runs Successes Failures Skips Package Package Panicked? Avg Duration Code Owners
TestShell_ImportExportETHKey_WithChains 66.67% false false false 3 2 1 0 github.com/smartcontractkit/chainlink/v2/core/cmd false 1.303333333s Unknown
TestShell_IndexCosmosChains 0.00% false false false 3 0 3 0 github.com/smartcontractkit/chainlink/v2/core/cmd false 1.263333333s Unknown
TestShell_IndexEVMChains 0.00% false false false 3 0 3 0 github.com/smartcontractkit/chainlink/v2/core/cmd false 1.25s Unknown
TestShell_IndexSolanaChains 0.00% false false false 3 0 3 0 github.com/smartcontractkit/chainlink/v2/core/cmd false 1.25s Unknown
TestETHKeysController_ChainSuccess_Disable 66.67% false false false 3 2 1 0 github.com/smartcontractkit/chainlink/v2/core/web false 1.256666666s Unknown
TestPipelineRunsController_Index_HappyPath 66.67% false false false 3 2 1 0 github.com/smartcontractkit/chainlink/v2/core/web false 1.393333333s Unknown
TestTransfersController_TransferBalanceToLowError 66.67% false false false 3 2 1 0 github.com/smartcontractkit/chainlink/v2/core/web false 1.316666666s Unknown
Test_CosmosChainsController_Index 0.00% false false false 3 0 3 0 github.com/smartcontractkit/chainlink/v2/core/web false 1.283333333s Unknown
Test_CosmosChainsController_Show 0.00% false false false 3 0 3 0 github.com/smartcontractkit/chainlink/v2/core/web false 0s Unknown
Test_CosmosChainsController_Show/not_found 0.00% false false false 3 0 3 0 github.com/smartcontractkit/chainlink/v2/core/web false 1.22s Unknown
Test_CosmosChainsController_Show/success 0.00% false false false 3 0 3 0 github.com/smartcontractkit/chainlink/v2/core/web false 1.156666666s Unknown
Test_EVMChainsController_Index 0.00% false false false 3 0 3 0 github.com/smartcontractkit/chainlink/v2/core/web false 1.293333333s Unknown
Test_EVMChainsController_Show 0.00% false false false 3 0 3 0 github.com/smartcontractkit/chainlink/v2/core/web false 0s Unknown
Test_EVMChainsController_Show/success 0.00% false false false 3 0 3 0 github.com/smartcontractkit/chainlink/v2/core/web false 1.23s Unknown
Test_SolanaChainsController_Index 0.00% false false false 3 0 3 0 github.com/smartcontractkit/chainlink/v2/core/web false 1.406666666s Unknown
Test_SolanaChainsController_Show 0.00% false false false 3 0 3 0 github.com/smartcontractkit/chainlink/v2/core/web false 0s Unknown
Test_SolanaChainsController_Show/success 0.00% false false false 3 0 3 0 github.com/smartcontractkit/chainlink/v2/core/web false 1.24s Unknown

Artifacts

For detailed logs of the failed tests, please refer to the artifact failed-test-results-with-logs.json.

Copy link
Contributor

Flakeguard Summary

Ran new or updated tests between develop and 76729a1 (web-fixes).

View Flaky Detector Details | Compare Changes

Found Flaky Tests ❌

Name Pass Ratio Panicked? Timed Out? Race? Runs Successes Failures Skips Package Package Panicked? Avg Duration Code Owners
TestShell_IndexCosmosChains 0.00% false false false 3 0 3 0 github.com/smartcontractkit/chainlink/v2/core/cmd false 1.236666666s Unknown
TestShell_IndexEVMChains 0.00% false false false 3 0 3 0 github.com/smartcontractkit/chainlink/v2/core/cmd false 1.246666666s Unknown
TestShell_IndexSolanaChains 0.00% false false false 3 0 3 0 github.com/smartcontractkit/chainlink/v2/core/cmd false 1.21s Unknown
TestETHKeysController_ChainFailure_MissingChainID 33.33% false false false 3 1 2 0 github.com/smartcontractkit/chainlink/v2/core/web false 1.28s Unknown
TestTransfersController_CreateSuccess_From_BalanceMonitorDisabled 66.67% false false false 3 2 1 0 github.com/smartcontractkit/chainlink/v2/core/web false 1.203333333s Unknown
Test_CosmosChainsController_Index 0.00% false false false 3 0 3 0 github.com/smartcontractkit/chainlink/v2/core/web false 1.31s Unknown
Test_CosmosChainsController_Show 0.00% false false false 3 0 3 0 github.com/smartcontractkit/chainlink/v2/core/web false 0s Unknown
Test_CosmosChainsController_Show/not_found 0.00% false false false 3 0 3 0 github.com/smartcontractkit/chainlink/v2/core/web false 1.243333333s Unknown
Test_CosmosChainsController_Show/success 0.00% false false false 3 0 3 0 github.com/smartcontractkit/chainlink/v2/core/web false 1.276666666s Unknown
Test_EVMChainsController_Index 0.00% false false false 3 0 3 0 github.com/smartcontractkit/chainlink/v2/core/web false 1.37s Unknown
Test_EVMChainsController_Show 0.00% false false false 3 0 3 0 github.com/smartcontractkit/chainlink/v2/core/web false 0s Unknown
Test_EVMChainsController_Show/success 0.00% false false false 3 0 3 0 github.com/smartcontractkit/chainlink/v2/core/web false 1.13s Unknown
Test_SolanaChainsController_Index 0.00% false false false 3 0 3 0 github.com/smartcontractkit/chainlink/v2/core/web false 1.27s Unknown
Test_SolanaChainsController_Show 0.00% false false false 3 0 3 0 github.com/smartcontractkit/chainlink/v2/core/web false 0s Unknown
Test_SolanaChainsController_Show/success 0.00% false false false 3 0 3 0 github.com/smartcontractkit/chainlink/v2/core/web false 1.263333333s Unknown
TestNodeResource 0.00% false false false 3 0 3 0 github.com/smartcontractkit/chainlink/v2/core/web/presenters false 0s Unknown

Artifacts

For detailed logs of the failed tests, please refer to the artifact failed-test-results-with-logs.json.

Copy link
Contributor

Flakeguard Summary

Ran new or updated tests between develop and e392985 (web-fixes).

View Flaky Detector Details | Compare Changes

Found Flaky Tests ❌

Name Pass Ratio Panicked? Timed Out? Race? Runs Successes Failures Skips Package Package Panicked? Avg Duration Code Owners
TestShell_CreateETHKey 66.67% false false false 3 2 1 0 github.com/smartcontractkit/chainlink/v2/core/cmd false 1.233333333s Unknown
TestShell_ImportExportETHKey_NoChains 66.67% false false false 3 2 1 0 github.com/smartcontractkit/chainlink/v2/core/cmd false 1.36s Unknown
TestShell_IndexCosmosChains 0.00% false false false 3 0 3 0 github.com/smartcontractkit/chainlink/v2/core/cmd false 1.226666666s Unknown
TestShell_IndexEVMChains 0.00% false false false 3 0 3 0 github.com/smartcontractkit/chainlink/v2/core/cmd false 1.24s Unknown
TestShell_IndexSolanaChains 0.00% false false false 3 0 3 0 github.com/smartcontractkit/chainlink/v2/core/cmd false 1.216666666s Unknown
TestShell_ListETHKeys_Error 66.67% false false false 3 2 1 0 github.com/smartcontractkit/chainlink/v2/core/cmd false 1.24s Unknown
TestETHKeysController_ChainFailure_MissingChainID 66.67% false false false 3 2 1 0 github.com/smartcontractkit/chainlink/v2/core/web false 1.273333333s Unknown
TestETHKeysController_ChainSuccess_ResetWithAbandon 66.67% false false false 3 2 1 0 github.com/smartcontractkit/chainlink/v2/core/web false 1.283333333s Unknown
TestPipelineRunsController_Index_GlobalHappyPath 66.67% false false false 3 2 1 0 github.com/smartcontractkit/chainlink/v2/core/web false 1.263333333s Unknown
TestTransfersController_CreateSuccess_From_WEI 66.67% false false false 3 2 1 0 github.com/smartcontractkit/chainlink/v2/core/web false 1.303333333s Unknown
Test_CosmosChainsController_Show 0.00% false false false 3 0 3 0 github.com/smartcontractkit/chainlink/v2/core/web false 0s Unknown
Test_CosmosChainsController_Show/not_found 0.00% false false false 3 0 3 0 github.com/smartcontractkit/chainlink/v2/core/web false 1.17s Unknown
Test_CosmosChainsController_Show/success 0.00% false false false 3 0 3 0 github.com/smartcontractkit/chainlink/v2/core/web false 1.163333333s Unknown
Test_EVMChainsController_Index 0.00% false false false 3 0 3 0 github.com/smartcontractkit/chainlink/v2/core/web false 1.39s Unknown
Test_EVMChainsController_Show 0.00% false false false 3 0 3 0 github.com/smartcontractkit/chainlink/v2/core/web false 0s Unknown
Test_EVMChainsController_Show/success 0.00% false false false 3 0 3 0 github.com/smartcontractkit/chainlink/v2/core/web false 1.063333333s Unknown
Test_SolanaChainsController_Show 0.00% false false false 3 0 3 0 github.com/smartcontractkit/chainlink/v2/core/web false 0s Unknown
Test_SolanaChainsController_Show/success 0.00% false false false 3 0 3 0 github.com/smartcontractkit/chainlink/v2/core/web false 1.173333333s Unknown

Artifacts

For detailed logs of the failed tests, please refer to the artifact failed-test-results-with-logs.json.

Copy link
Contributor

Flakeguard Summary

Ran new or updated tests between develop and 06bfb65 (web-fixes).

View Flaky Detector Details | Compare Changes

Found Flaky Tests ❌

Name Pass Ratio Panicked? Timed Out? Race? Runs Successes Failures Skips Package Package Panicked? Avg Duration Code Owners
TestShell_CreateETHKey 66.67% false false false 3 2 1 0 github.com/smartcontractkit/chainlink/v2/core/cmd false 1.256666666s Unknown
TestShell_ImportExportETHKey_NoChains 66.67% false false false 3 2 1 0 github.com/smartcontractkit/chainlink/v2/core/cmd false 1.29s Unknown
TestShell_IndexCosmosChains 0.00% false false false 3 0 3 0 github.com/smartcontractkit/chainlink/v2/core/cmd false 1.213333333s Unknown
TestShell_IndexEVMChains 0.00% false false false 3 0 3 0 github.com/smartcontractkit/chainlink/v2/core/cmd false 1.196666666s Unknown
TestShell_IndexSolanaChains 0.00% false false false 3 0 3 0 github.com/smartcontractkit/chainlink/v2/core/cmd false 1.216666666s Unknown
TestETHKeysController_ChainFailure_InvalidAbandon 33.33% false false false 3 1 2 0 github.com/smartcontractkit/chainlink/v2/core/web false 1.253333333s Unknown
TestETHKeysController_ChainFailure_InvalidEnabled 33.33% false false false 3 1 2 0 github.com/smartcontractkit/chainlink/v2/core/web false 1.343333333s Unknown
TestETHKeysController_ChainSuccess_ResetWithAbandon 66.67% false false false 3 2 1 0 github.com/smartcontractkit/chainlink/v2/core/web false 1.283333333s Unknown
TestETHKeysController_Index_Errors 66.67% false false false 3 2 1 0 github.com/smartcontractkit/chainlink/v2/core/web false 1.27s Unknown
TestETHKeysController_Index_Success 66.67% false false false 3 2 1 0 github.com/smartcontractkit/chainlink/v2/core/web false 1.276666666s Unknown
TestPipelineRunsController_Show_HappyPath 66.67% false false false 3 2 1 0 github.com/smartcontractkit/chainlink/v2/core/web false 1.346666666s Unknown
TestTransfersController_CreateSuccess_From_BalanceMonitorDisabled 66.67% false false false 3 2 1 0 github.com/smartcontractkit/chainlink/v2/core/web false 1.383333333s Unknown

Artifacts

For detailed logs of the failed tests, please refer to the artifact failed-test-results-with-logs.json.

Copy link
Contributor

Flakeguard Summary

Ran new or updated tests between develop and 6b93238 (web-fixes).

View Flaky Detector Details | Compare Changes

Found Flaky Tests ❌

Name Pass Ratio Panicked? Timed Out? Race? Runs Successes Failures Skips Package Package Panicked? Avg Duration Code Owners
TestShell_ImportExportETHKey_WithChains 66.67% false false false 3 2 1 0 github.com/smartcontractkit/chainlink/v2/core/cmd false 1.356666666s Unknown
TestETHKeysController_Index_Errors 33.33% false false false 3 1 2 0 github.com/smartcontractkit/chainlink/v2/core/web false 1.37s Unknown
TestTransfersController_TransferBalanceToLowError_ZeroBalance 66.67% false false false 3 2 1 0 github.com/smartcontractkit/chainlink/v2/core/web false 1.306666666s Unknown

Artifacts

For detailed logs of the failed tests, please refer to the artifact failed-test-results-with-logs.json.

Copy link
Contributor

Flakeguard Summary

Ran new or updated tests between develop and 6b93238 (web-fixes).

View Flaky Detector Details | Compare Changes

Found Flaky Tests ❌

Name Pass Ratio Panicked? Timed Out? Race? Runs Successes Failures Skips Package Package Panicked? Avg Duration Code Owners
TestShell_ImportExportETHKey_WithChains 66.67% false false false 6 4 2 0 github.com/smartcontractkit/chainlink/v2/core/cmd false 1.338333333s Unknown
TestETHKeysController_ChainSuccess_ResetWithAbandon 83.33% false false false 6 5 1 0 github.com/smartcontractkit/chainlink/v2/core/web false 1.32s Unknown
TestETHKeysController_Index_Errors 66.67% false false false 6 4 2 0 github.com/smartcontractkit/chainlink/v2/core/web false 1.318333333s Unknown
TestETHKeysController_Index_Success 83.33% false false false 6 5 1 0 github.com/smartcontractkit/chainlink/v2/core/web false 1.311666666s Unknown
TestTransfersController_CreateSuccess_From 83.33% false false false 6 5 1 0 github.com/smartcontractkit/chainlink/v2/core/web false 1.391666666s Unknown
TestTransfersController_TransferBalanceToLowError_ZeroBalance 83.33% false false false 6 5 1 0 github.com/smartcontractkit/chainlink/v2/core/web false 1.34s Unknown

Artifacts

For detailed logs of the failed tests, please refer to the artifact failed-test-results-with-logs.json.

@archseer archseer marked this pull request as ready for review December 13, 2024 10:12
@archseer archseer requested review from a team as code owners December 13, 2024 10:12
Copy link
Contributor

Flakeguard Summary

Ran new or updated tests between develop and 42614d2 (web-fixes).

View Flaky Detector Details | Compare Changes

Found Flaky Tests ❌

Name Pass Ratio Panicked? Timed Out? Race? Runs Successes Failures Skips Package Package Panicked? Avg Duration Code Owners
TestETHKeysController_ChainFailure_InvalidEnabled 66.67% false false false 3 2 1 0 github.com/smartcontractkit/chainlink/v2/core/web false 1.35s Unknown
TestETHKeysController_DeleteSuccess 66.67% false false false 3 2 1 0 github.com/smartcontractkit/chainlink/v2/core/web false 1.32s Unknown
TestETHKeysController_Index_NotDev 66.67% false false false 3 2 1 0 github.com/smartcontractkit/chainlink/v2/core/web false 1.283333333s Unknown
TestETHKeysController_Index_Success 66.67% false false false 3 2 1 0 github.com/smartcontractkit/chainlink/v2/core/web false 1.34s Unknown
TestPipelineRunsController_Index_Pagination 66.67% false false false 3 2 1 0 github.com/smartcontractkit/chainlink/v2/core/web false 1.403333333s Unknown
TestTransfersController_CreateSuccess_From 66.67% false false false 3 2 1 0 github.com/smartcontractkit/chainlink/v2/core/web false 1.28s Unknown

Artifacts

For detailed logs of the failed tests, please refer to the artifact failed-test-results-with-logs.json.

@@ -27,11 +27,13 @@ type CosmosTransfersController struct {
App chainlink.Application
}

var ErrCosmosNotEnabled = errChainDisabled{name: "Cosmos", tomlKey: "Cosmos.Enabled"}
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Perhaps we could standardize these around errors.Unsupported: https://pkg.go.dev/errors#pkg-variables

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

By implementing Is on errChainDisabled? I'll leave this as a follow up

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yeah better to follow up.

I was imagining we could shed the per family enumeration too, since we'll want to be more dynamic eventually.

jmank88
jmank88 previously approved these changes Dec 13, 2024
Copy link
Contributor

Flakeguard Summary

Ran new or updated tests between develop and fbe9728 (web-fixes).

View Flaky Detector Details | Compare Changes

Found Flaky Tests ❌

Name Pass Ratio Panicked? Timed Out? Race? Runs Successes Failures Skips Package Package Panicked? Avg Duration Code Owners
TestShell_ImportExportETHKey_NoChains 66.67% false false false 3 2 1 0 github.com/smartcontractkit/chainlink/v2/core/cmd false 1.373333333s Unknown
TestShell_ImportExportETHKey_WithChains 66.67% false false false 3 2 1 0 github.com/smartcontractkit/chainlink/v2/core/cmd false 1.276666666s Unknown
TestShell_ListETHKeys 66.67% false false false 3 2 1 0 github.com/smartcontractkit/chainlink/v2/core/cmd false 1.223333333s Unknown
TestShell_ListETHKeys_Error 66.67% false false false 3 2 1 0 github.com/smartcontractkit/chainlink/v2/core/cmd false 1.253333333s Unknown

Artifacts

For detailed logs of the failed tests, please refer to the artifact failed-test-results-with-logs.json.

Copy link
Contributor

Flakeguard Summary

Ran new or updated tests between develop and fdc4cd1 (web-fixes).

View Flaky Detector Details | Compare Changes

Found Flaky Tests ❌

Name Pass Ratio Panicked? Timed Out? Race? Runs Successes Failures Skips Package Package Panicked? Avg Duration Code Owners
TestETHKeysController_ChainFailure_InvalidEnabled 33.33% false false false 3 1 2 0 github.com/smartcontractkit/chainlink/v2/core/web false 1.256666666s Unknown
TestETHKeysController_ChainFailure_MissingChainID 66.67% false false false 3 2 1 0 github.com/smartcontractkit/chainlink/v2/core/web false 1.26s Unknown
TestETHKeysController_Index_Success 0.00% false false false 3 0 3 0 github.com/smartcontractkit/chainlink/v2/core/web false 1.29s Unknown
TestTransfersController_CreateSuccess_From_WEI 66.67% false false false 3 2 1 0 github.com/smartcontractkit/chainlink/v2/core/web false 1.393333333s Unknown
TestTransfersController_TransferBalanceToLowError 66.67% false false false 3 2 1 0 github.com/smartcontractkit/chainlink/v2/core/web false 1.323333333s Unknown

Artifacts

For detailed logs of the failed tests, please refer to the artifact failed-test-results-with-logs.json.

Make it easier to add new LOOPs by reducing the amount of boilerplate
Copy link
Contributor

Flakeguard Summary

Ran new or updated tests between develop and 19f8084 (web-fixes).

View Flaky Detector Details | Compare Changes

Found Flaky Tests ❌

Name Pass Ratio Panicked? Timed Out? Race? Runs Successes Failures Skips Package Package Panicked? Avg Duration Code Owners
TestShell_CreateETHKey 66.67% false false false 3 2 1 0 github.com/smartcontractkit/chainlink/v2/core/cmd false 1.266666666s Unknown
TestShell_ListETHKeys 66.67% false false false 3 2 1 0 github.com/smartcontractkit/chainlink/v2/core/cmd false 1.266666666s Unknown
TestETHKeysController_ChainSuccess_ResetWithAbandon 66.67% false false false 3 2 1 0 github.com/smartcontractkit/chainlink/v2/core/web false 1.386666666s Unknown
TestETHKeysController_ChainSuccess_UpdateNonce 66.67% false false false 3 2 1 0 github.com/smartcontractkit/chainlink/v2/core/web false 1.323333333s Unknown
TestPipelineRunsController_Index_Pagination 66.67% false false false 3 2 1 0 github.com/smartcontractkit/chainlink/v2/core/web false 1.306666666s Unknown
TestTransfersController_CreateSuccess_From_BalanceMonitorDisabled 66.67% false false false 3 2 1 0 github.com/smartcontractkit/chainlink/v2/core/web false 1.266666666s Unknown
TestTransfersController_TransferBalanceToLowError_ZeroBalance 66.67% false false false 3 2 1 0 github.com/smartcontractkit/chainlink/v2/core/web false 1.523333333s Unknown

Artifacts

For detailed logs of the failed tests, please refer to the artifact failed-test-results-with-logs.json.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants