# robots.txt zu http://www.2netit.de/ User-agent: * Crawl-delay: 3 Disallow: /partner/