User-agent: Amazonbot Disallow: /calendar/ User-agent: * Crawl-delay: 5