# robots.txt zu https://absicht.de/ User-agent: * Disallow: /php/ Disallow: /webstats/ Disallow: /alt/ Disallow: /404.shtml User-agent: * Crawl-delay: 5