# Robots.txt file from http://www.scraptraining.com User-agent: * Disallow: