User-agent: * Crawl-delay: 5 User-agent: googlebot Crawl-delay: 2 User-agent: Slurp Crawl-delay: 20