Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Test execution ordering/filtering extension #1943

Closed
NGloreous opened this issue Mar 6, 2019 · 1 comment
Closed

Test execution ordering/filtering extension #1943

NGloreous opened this issue Mar 6, 2019 · 1 comment

Comments

@NGloreous
Copy link
Contributor

Description

Add an extensibility point to support filtering what tests to run and the ability to control the order in which they run.

There is really two asks here but I think it makes sense to combine them into one extensibility point.

The OneDrive team has a large set of tests which need to run. To accomplish this in a reasonable time period we stripe our tests across multiple machines. We also have custom logic that uses historical test runtime to do this effectively by ordering tests in a smart way (e.g. longer tests run first).

We can accomplish the filtering by using the Translation Layer extension but we rather just run vstest.console.exe directly for various reasons.

The ordering could possibly be accomplished by providing a hard code config but being able to dynamically control ordering provides more flexibility and could possibly integrate with the retry support feature to control the order to run retries.

@Evangelink Evangelink added the needs-triage This item should be discussed in the next triage meeting. label Aug 1, 2022
@Evangelink Evangelink removed the needs-triage This item should be discussed in the next triage meeting. label Nov 30, 2022
@nohwnd
Copy link
Member

nohwnd commented Jul 9, 2024

This is a new feature and won't be implemented, we are focusing on adding new features to Testing.Platform instead. https://aka.ms/testingplatform

@nohwnd nohwnd closed this as not planned Won't fix, can't repro, duplicate, stale Jul 9, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

4 participants