#robots.txt to prevent robots from scanning our site #Disallowing access to all robots User-agent: * Disallow: /