[CI] Create Github Job Summary for failing E2E tasks #13069
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Unfortunately, our E2E tests use custom LIT format so I wasn't able to make `llvm-lit` generate the results into a JSON file. That meant that I have to redirect the entire output into a log file and Github Actions won't be able to show intermediate progress until `llvm-lit` finishes execution. Another thing worth mentioning is that these summaries aren't "searchable" via Github's search queries (unlike comments), but I think it's still a usability improvement because it would allow to see all the failures on a single page.
aelovikov-intel
temporarily deployed
to
WindowsCILock
GitHub Actions
Inactive
|
Example output: https://github.com/intel/llvm/actions/runs/8351307003. |
aelovikov-intel
temporarily deployed
to
WindowsCILock
GitHub Actions
Inactive
aelovikov-intel
commented
Mar 20, 2024
aelovikov-intel
temporarily deployed
to
WindowsCILock
GitHub Actions
Inactive
aelovikov-intel
temporarily deployed
to
WindowsCILock
GitHub Actions
Inactive
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Unfortunately, our E2E tests use custom LIT format so I wasn't able to make
llvm-litgenerate the results into a JSON file. That meant that I have to redirect the entire output into a log file and Github Actions won't be able to show intermediate progress untilllvm-litfinishes execution.Another thing worth mentioning is that these summaries aren't "searchable" via Github's search queries (unlike comments), but I think it's still a usability improvement because it would allow to see all the failures on a single page.