Skip lists: Remove implicit pytest.skip() in UT, migrate to pytest-select configurations

[vlad-penkin]

This ticket consists of two task groups:

• Skip lists feature implementation and it's integration in local UT test runner script and CI workflows
• Actual tests code clean up and skip tests configuration creation

PR for first task group is

• PoC: skip lists #876

[AshburnLee]

@vlad-penkin I may need some clarification.

1. There are two items in the description, and the 1st one is merged, so I think I need to solve the 2nd one, right?

2. "Actual tests code clean up and skip tests configuration creation"

   • "tests code clean up": Are you sure that we remove "pytest.skip()" in all test scripts? I thought we are not supposed to modified the source code.
   • "skip tests configuration": Is this configuration like a "pytest.ini" or "pytest.ini.toml"?

[AshburnLee]

From what I understand, the aim is replacing 'pytest.skip()' using deselect list.

We have many platforms, platformA, platformB, platformC. for a single case that is coded as

...
if capability[0] < 9 and (ADTYPE == "float8e4nv" or BDTYPE == "float8e4nv"):
    pytest.skip("Only test float8e4nv on devices with sm >= 90")
...

This case could be SKIPPED(platformA), PASSED(platformB), FAILED(platfromC).

SKIPPED(platformA), expected, so put it in to skiplist of platfromA. those cases will not be detected (saving time)
PASSED(platformB), expected, do noting.
FAILED(platfromC), unexpected, so put it in to skiplist of platfromC and track it.

So before change any code, we

1. step1, run all tests, and collect skiplist for every platform.
2. step2, remove 'pytest.skip()' .

[AshburnLee]

As discussed with Vlad, close this one, and put the request into #1434