Add simple json report generation #195

tuturu-tech · 2023-08-04T13:53:55Z

Added very simple json report generation (only lines found/covered)

Issues:

Error var is overridden, looking for guidance on how best to handle this
html path is modified in order to replace the file name, looking for guidance here as well
Currently not generating branches/functions coverage

montyly · 2023-08-04T14:12:58Z

@tuturu-tech can you fix the issues reported by golangci-lint?

You can look at https://github.com/crytic/medusa/blob/01c8d9efc40ac13ae937a7cef3f1999290dca7b7/CONTRIBUTING.md#linters to see how to install and run it

* Updated CallMessage to be compliant with core.Message made in new go-ethereum --------- Co-authored-by: anishnaik <anish.r.naik@gmail.com>

Bumps [golang.org/x/net](https://github.com/golang/net) from 0.12.0 to 0.14.0. - [Commits](golang/net@v0.12.0...v0.14.0) --- updated-dependencies: - dependency-name: golang.org/x/net dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

Introduce `console.log` functionality with string formatting capabilities. --------- Co-authored-by: David Pokora <dpokora@gmail.com>

* Added denomination parsing to AST constant mining * Added tests for AST value extraction, removed print from experimental code --------- Co-authored-by: anishnaik <anish.r.naik@gmail.com>

* Console output with optional coloring * optional Colorize * LF and CRLF line endings * update no-color flag description * code review changes --------- Authored-by: Exca-DK <Exca-DK@users.noreply.github.com>

Co-authored-by: anishnaik <anish.naik@trailofbits.com>

Bumps [github.com/rs/zerolog](https://github.com/rs/zerolog) from 1.29.0 to 1.30.0. - [Release notes](https://github.com/rs/zerolog/releases) - [Commits](rs/zerolog@v1.29.0...v1.30.0) --- updated-dependencies: - dependency-name: github.com/rs/zerolog dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: David Pokora <dpokora@gmail.com> Co-authored-by: anishnaik <anish.naik@trailofbits.com>

Bumps [github.com/google/uuid](https://github.com/google/uuid) from 1.3.0 to 1.3.1. - [Release notes](https://github.com/google/uuid/releases) - [Changelog](https://github.com/google/uuid/blob/master/CHANGELOG.md) - [Commits](google/uuid@v1.3.0...v1.3.1) --- updated-dependencies: - dependency-name: github.com/google/uuid dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: anishnaik <anish.naik@trailofbits.com>

Bumps [golang.org/x/crypto](https://github.com/golang/crypto) from 0.12.0 to 0.13.0. - [Commits](golang/crypto@v0.12.0...v0.13.0) --- updated-dependencies: - dependency-name: golang.org/x/crypto dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: anishnaik <anish.naik@trailofbits.com>

Bumps [github.com/rs/zerolog](https://github.com/rs/zerolog) from 1.30.0 to 1.31.0. - [Release notes](https://github.com/rs/zerolog/releases) - [Commits](rs/zerolog@v1.30.0...v1.31.0) --- updated-dependencies: - dependency-name: github.com/rs/zerolog dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

Bumps [actions/checkout](https://github.com/actions/checkout) from 3 to 4. - [Release notes](https://github.com/actions/checkout/releases) - [Changelog](https://github.com/actions/checkout/blob/main/CHANGELOG.md) - [Commits](actions/checkout@v3...v4) --- updated-dependencies: - dependency-name: actions/checkout dependency-type: direct:production update-type: version-update:semver-major ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: anishnaik <anish.naik@trailofbits.com>

Bumps [golang.org/x/crypto](https://github.com/golang/crypto) from 0.13.0 to 0.14.0. - [Commits](golang/crypto@v0.13.0...v0.14.0) --- updated-dependencies: - dependency-name: golang.org/x/crypto dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: anishnaik <anish.naik@trailofbits.com>

Co-authored-by: anishnaik <anish.naik@trailofbits.com>

* fix warp cheatcode * revert if warp input value is greater than type(uint64).max * Make max uint64 a global value

Bumps [github.com/spf13/cobra](https://github.com/spf13/cobra) from 1.7.0 to 1.8.0. - [Release notes](https://github.com/spf13/cobra/releases) - [Commits](spf13/cobra@v1.7.0...v1.8.0) --- updated-dependencies: - dependency-name: github.com/spf13/cobra dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: David Pokora <dpokora@gmail.com>

Bumps [github.com/google/uuid](https://github.com/google/uuid) from 1.3.1 to 1.6.0. - [Release notes](https://github.com/google/uuid/releases) - [Changelog](https://github.com/google/uuid/blob/master/CHANGELOG.md) - [Commits](google/uuid@v1.3.1...v1.6.0) --- updated-dependencies: - dependency-name: github.com/google/uuid dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

Bumps [golang.org/x/net](https://github.com/golang/net) from 0.14.0 to 0.21.0. - [Commits](golang/net@v0.14.0...v0.21.0) --- updated-dependencies: - dependency-name: golang.org/x/net dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: David Pokora <dpokora@gmail.com>

…prove UX, allow for contracts to have starting balances, and fix coverage panic (#216) * - merged all three testing modes - created testing provider utils file to evaluate whether an abi.method is an optimization / property test - updated fuzzer tests - made default property test prefix "invariant_" * enable all testing modes, update fuzzer tests * add verification for config * improve config-related errors * update deploymentOrder to targetContracts * update edge case where coverage is 0/0 lines * add support for payable constructors * linting * fix bug * fix panic and improve return data printing in execution trace * encode bytes and byteX as hex strings * fix console * updates from PR review * change config language

…e up errors with exit codes from cmd, organized exit code definitions into one package (#301) Co-authored-by: anishnaik <anish.naik@trailofbits.com>

* * Fixed a corpus call method resolution bug. * Deprecated "methodName" in corpus (lack of support for function overloading). To be removed later, in favor of new "methodSignature" key. * Improved fuzzer initialization logging * Print basic metrics for corpus health on startup * Reorder printing to avoid "Creating X workers" message after "fuzz: elapsed[...]" message. * Update corpus health log for readability --------- Co-authored-by: anishnaik <anish.naik@trailofbits.com>

* Add shrinking limits, improve "call removal" logic, fixed a bug where corpus results could re-record if replayed/reshrunk differently * Removed comment indicating shrinkLimit must be greater than zero (untrue) * Re-order unexecuted sequences so test result corpus items are replayed first * change where shrinkIncrement is updated --------- Co-authored-by: Anish Naik <anish.naik@trailofbits.com>

Co-authored-by: anishnaik <anish.naik@trailofbits.com>

* fix: use signature in traces to handle overloaded function names * fix test --------- Co-authored-by: anishnaik <anish.naik@trailofbits.com>

* feat: add execution trace for failed target contract deployments * fix bugs in logging and improve trace output to console --------- Co-authored-by: anishnaik <anish.naik@trailofbits.com>

* Output error message if there was one * Slight cleanup/refactor * Updated exit code and error return so error messages are only printed if there is an error (despite exiting with a special exit code) * proposed changed to prevent double logging/printing of fuzzer errors * change name of exit code * fix bug --------- Co-authored-by: anishnaik <anish.naik@trailofbits.com>

Closes #341

Bumps [golang.org/x/crypto](https://github.com/golang/crypto) from 0.19.0 to 0.22.0. - [Commits](golang/crypto@v0.19.0...v0.22.0) --- updated-dependencies: - dependency-name: golang.org/x/crypto dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

Bumps google.golang.org/protobuf from 1.28.1 to 1.33.0. --- updated-dependencies: - dependency-name: google.golang.org/protobuf dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: anishnaik <anish.naik@trailofbits.com>

Bumps [github.com/stretchr/testify](https://github.com/stretchr/testify) from 1.8.4 to 1.9.0. - [Release notes](https://github.com/stretchr/testify/releases) - [Commits](stretchr/testify@v1.8.4...v1.9.0) --- updated-dependencies: - dependency-name: github.com/stretchr/testify dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: anishnaik <anish.naik@trailofbits.com>

* add M1 mac arch build and test * Update .github/workflows/ci.yml Co-authored-by: Emilio López <2642849+elopez@users.noreply.github.com> * Update .github/workflows/ci.yml Co-authored-by: Emilio López <2642849+elopez@users.noreply.github.com> * ci: automate release creation when pushing a tag * ci: upgrade actions/setup-{node,go} * ci: fix Python dependency installation on macOS error: externally-managed-environment × This environment is externally managed ╰─> To install Python packages system-wide, try brew install xyz, where xyz is the package you are trying to install. If you wish to install a non-brew-packaged Python package, create a virtual environment using python3 -m venv path/to/venv. Then use path/to/venv/bin/python and path/to/venv/bin/pip. If you wish to install a non-brew packaged Python application, it may be easiest to use pipx install xyz, which will manage a virtual environment for you. Make sure you have pipx installed. note: If you believe this is a mistake, please contact your Python installation or OS distribution provider. You can override this, at the risk of breaking your Python installation or OS, by passing --break-system-packages. hint: See PEP 668 for the detailed specification. * ci: use `alls-green` to decide success status `release` can be skipped, but GitHub will then skip `all-checks`. We need to check that `release` is successful when it runs, but ignore it when it is skipped. --------- Co-authored-by: Anish Naik <anish.naik@trailofbits.com>

* Migrate to mdbook (#223) Co-authored-by: Zach McManus <59886732+zachmdsi@users.noreply.github.com> Co-authored-by: Damilola Edwards <damilolaedwards@gmail.com>

…them (#363) * feat: call constant methods ocassionally and allow assertion testing them * add test

* fix: re-encode calldata in mutator and refactor * panic on misuse

* fix: excluding compilation platform fallsback to default * warn if coverage is disabled --------- Co-authored-by: anishnaik <anish.naik@trailofbits.com>

* feat: display test cases discovered by the fuzzer * check whether optimization test case has started

simple json report generation

cbde4a3

tuturu-tech added 3 commits August 4, 2023 17:20

fix json template, change htmlReportPath to corpus path

095fb73

added html and json file path configs, updated report generation

18433cc

fix lint error

8ec0007

tuturu-tech marked this pull request as ready for review August 4, 2023 16:20

tuturu-tech requested review from Xenomega and anishnaik as code owners August 4, 2023 16:20

anishnaik mentioned this pull request Jan 31, 2024

Feature request: Add output type flag to CLI #144

Closed

Xenomega and others added 21 commits July 8, 2024 18:25

Update to go-ethereum 1.12.0 (#199)

194a782

* Updated CallMessage to be compliant with core.Message made in new go-ethereum --------- Co-authored-by: anishnaik <anish.r.naik@gmail.com>

console.log go brrr (#193)

ab00c59

Introduce `console.log` functionality with string formatting capabilities. --------- Co-authored-by: David Pokora <dpokora@gmail.com>

Added denomination parsing to AST value extraction (#202)

3172b53

* Added denomination parsing to AST constant mining * Added tests for AST value extraction, removed print from experimental code --------- Co-authored-by: anishnaik <anish.r.naik@gmail.com>

Update README.md (#184)

b911551

Multi-channel and multi-error log support (#180)

931bba0

Update version (#210)

aa82533

Support NoColor and --no-color (#222)

24ebcc4

* Console output with optional coloring * optional Colorize * LF and CRLF line endings * update no-color flag description * code review changes --------- Authored-by: Exca-DK <Exca-DK@users.noreply.github.com>

Update CONTRIBUTING.md (#185)

e370832

Co-authored-by: anishnaik <anish.naik@trailofbits.com>

add setuptools to pip install line (#252)

f4f6605

Fix testAllContracts behavior (#253)

1f8afda

Open non-zero coverage reports in corpus by default (#243)

8cc3957

Co-authored-by: anishnaik <anish.naik@trailofbits.com>

Fix warp cheatcode (#255)

9ad9ff2

* fix warp cheatcode * revert if warp input value is greater than type(uint64).max * Make max uint64 a global value

Explicitly reset the state trie's cache to prevent mem leak (#290)

7065f74

dependabot bot and others added 30 commits July 8, 2024 18:28

Fix the copy length based panic in the parseBytes32 cheatcode (#293)

38ed335

fix OOB panic (#303)

57cc20c

Added a unique exit code for failed tests, added generic way to bubbl…

6692150

…e up errors with exit codes from cmd, organized exit code definitions into one package (#301) Co-authored-by: anishnaik <anish.naik@trailofbits.com>

update version (#310)

4a0f0c1

Feat: snapshot and revertTo cheatcodes (#276)

3f6a58d

fix: attach execution trace to reverting properties (#335)

75ac86e

Co-authored-by: anishnaik <anish.naik@trailofbits.com>

fix: use signature in traces to handle overloaded function names (#336)

c3127e4

* fix: use signature in traces to handle overloaded function names * fix test --------- Co-authored-by: anishnaik <anish.naik@trailofbits.com>

feat: add execution trace for failed target contract deployments (#337)

e50b36d

* feat: add execution trace for failed target contract deployments * fix bugs in logging and improve trace output to console --------- Co-authored-by: anishnaik <anish.naik@trailofbits.com>

Update README to reflect current CLI and config options (#343)

fa498d1

Closes #341

fix two outdated comments (#347)

e58ae6e

mdbook for medusa (#348)

68c5be2

* Migrate to mdbook (#223) Co-authored-by: Zach McManus <59886732+zachmdsi@users.noreply.github.com> Co-authored-by: Damilola Edwards <damilolaedwards@gmail.com>

fix: use the shrunken abi values as the msg's data (#374)

69a9979

chore: fix typos (#387)

5e5d0e0

feat: call constant methods occasionally and allow assertion testing …

827dbed

…them (#363) * feat: call constant methods ocassionally and allow assertion testing them * add test

fix: re-encode calldata in mutator and refactor (#380)

8320d6e

* fix: re-encode calldata in mutator and refactor * panic on misuse

excluding compilation platform fallsback to default (#362)

3259c27

* fix: excluding compilation platform fallsback to default * warn if coverage is disabled --------- Co-authored-by: anishnaik <anish.naik@trailofbits.com>

feat: display test cases discovered by the fuzzer (#382)

3cbe484

* feat: display test cases discovered by the fuzzer * check whether optimization test case has started

fix json template, change htmlReportPath to corpus path

f37287f

added html and json file path configs, updated report generation

ed6627f

Remove duplicate member values passed to ProjectConfig

4fb3645

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Add simple json report generation #195

Add simple json report generation #195

tuturu-tech commented Aug 4, 2023 •

edited

Loading

montyly commented Aug 4, 2023

Add simple json report generation #195

Are you sure you want to change the base?

Add simple json report generation #195

Conversation

tuturu-tech commented Aug 4, 2023 • edited Loading

montyly commented Aug 4, 2023

tuturu-tech commented Aug 4, 2023 •

edited

Loading