User-agent: * Disallow: /applications/ Disallow: /eis/ Disallow: /departments/eis/ Disallow: /calendar/ User-agent: Slurp Crawl-delay: 5 User-agent: FAST+MetaWeb+Crawler+(helpdesk+at+fastsearch+dot+com) Crawl-delay: 5 User-agent :Googlebot/2.1+(+http://www.google.com/bot.html) Crawl-delay: 5 User-agent : Mozilla/5.0+(compatible;+Googlebot/2.1;++http://www.google.com/bot.html) Crawl-delay: 5