User-agent: googlebot Disallow: /resources/ User-agent: googlebot-news Allow: https://blog.tsuru.io/ User-agent: googlebot-third Allow: https://docs.tsuru.io/ Sitemap: https://tsuru.io/sitemap.xml Sitemap: https://docs.tsuru.io/sitemap.xml Crawl-delay: 100 Host: tsuru.io