X-Git-Url: https://git.arvados.org/arvados.git/blobdiff_plain/67728c239ed4d2e720b13eaf3d6441091f64ae43..b932f4fbf03b575ec92447a131e035fbe10a7b9e:/public/robots.txt diff --git a/public/robots.txt b/public/robots.txt index 085187fa58..c6742d8a8c 100644 --- a/public/robots.txt +++ b/public/robots.txt @@ -1,5 +1,2 @@ -# See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file -# -# To ban all spiders from the entire site uncomment the next two lines: -# User-Agent: * -# Disallow: / +User-Agent: * +Disallow: /