# Exclude Files From All Robots: User-agent: * Disallow: /internal/ Disallow: /includes/ Disallow: /img/ Disallow: /samples/ Disallow: /webalizer/ # End robots.txt file