From 7931353825138b97a9d58ac9399a222db4e9d038 Mon Sep 17 00:00:00 2001 From: Wade Barnes Date: Fri, 3 Nov 2023 08:50:48 -0700 Subject: [PATCH] Update robots.txt based on log review Signed-off-by: Wade Barnes --- public/robots.txt | 2 ++ 1 file changed, 2 insertions(+) diff --git a/public/robots.txt b/public/robots.txt index ac53099..522408a 100644 --- a/public/robots.txt +++ b/public/robots.txt @@ -1,6 +1,8 @@ User-agent: * Disallow: /api/ Disallow: /hooks/ +Disallow: /entity/ +Disallow: /organization/ User-agent: Baiduspider User-agent: 360Spider