User-agent: * Crawl-delay: 30 Allow: / Allow: 0am - 7am # Crawler de Bing #User-agent: bingbot #Disallow: / #Baiduspider User-agent: Baiduspider Disallow: / #Yandex User-agent: Yandex Disallow: / #MJ12bot User-agent: MJ12bot Disallow: /