Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Logical grouping of test runs and returning of final pass/fail status #3431

Open
kdhamric opened this issue Dec 7, 2023 · 0 comments
Open
Labels

Comments

@kdhamric
Copy link
Collaborator

kdhamric commented Dec 7, 2023

As a user, I want to be able to run a group of tests
in parallel and have a way to monitor the status of this group of runs
and fail a process based on the collective results of the group of runs.

Needs:

  • ability to logically group a set of test runs, such as tagging them or having a group run id.
  • Tests & test suites runs would need ability to be marked as being part of the group when run from the CLI or a CI/CD process such as Github Actions.
  • ability to call an API to check the status of the group. What test runs are part of it, details about each one including the run state and completion states.
  • a CLI command to watch a group of test runs, returning a pass or fail once they have all completed.
  • a UI in the app that allows you to look at this list of test runs, see the running and completion status, etc.
  • when looking at individual test runs, there should be an indication that a run was part of a group of runs with a link to inspect the group.
  • when running from CI/CD process we may want to use the github action id to group the tests automatically?
@kdhamric kdhamric added feature request triage requires triage labels Dec 7, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

1 participant