scantxt is a common way to allow/disallow scanning activity with additional features for ownership verification, notifications and scanning verification
scanner
vulnerability-scanners
performance-testing
seo-tools
accessibility-testing
scanning-tool
ownership-verification
scantxt
-
Updated
Dec 5, 2022 - HTML