Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

refactor(levm): ef test runner #1206

Merged
merged 22 commits into from
Nov 25, 2024
Merged

refactor(levm): ef test runner #1206

merged 22 commits into from
Nov 25, 2024

Conversation

ilitteri
Copy link
Contributor

@ilitteri ilitteri commented Nov 19, 2024

Description

  • Fixes EF tests parsing
  • Adds levm_runner module
  • Adds revm_runner module
  • Refactors runner module
  • Fixes post-state validations
  • Refactors report module.
  • Adds more reports.

@ilitteri ilitteri added ef-tests Hive tests, execution-spec-tests levm Lambda EVM implementation labels Nov 19, 2024
@ilitteri ilitteri self-assigned this Nov 19, 2024
@ilitteri ilitteri requested a review from a team as a code owner November 19, 2024 15:46
maximopalopoli
maximopalopoli previously approved these changes Nov 19, 2024
Copy link
Contributor

@maximopalopoli maximopalopoli left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM after passing the CI

Now we have a levm_runner in charge of running the whole suite of tests (or the chosen ones) and then a revm_runner that re-runs the tests that levm failed to run successfully
This reverts commit 1391e03.
@ilitteri ilitteri changed the title fix(levm): do not skip VMTests in EF tests refactor(levm): ef test runner Nov 21, 2024
Copy link
Contributor

@maximopalopoli maximopalopoli left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, after passing the CI

Copy link
Contributor

@JereSalo JereSalo left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM. It would be very good if we could run tests with --nocapture for debugging purposes but I don't know if clap allows that.

- Print and write report on internal errors
- Fix failed vector indexing error
@ilitteri ilitteri enabled auto-merge November 25, 2024 15:23
@ilitteri ilitteri added this pull request to the merge queue Nov 25, 2024
Merged via the queue into main with commit 7f4e76f Nov 25, 2024
25 of 26 checks passed
@ilitteri ilitteri deleted the fix_ef_test_parsing branch November 25, 2024 15:53
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
ef-tests Hive tests, execution-spec-tests levm Lambda EVM implementation
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants