PYTHON-4769 Avoid pytest collection overhead when running perf benchmarks

PYTHON-4769 Avoid pytest collection overhead when running perf benchmarks #628