User-agent: * Allow: / Disallow: /admin/ Disallow: /private/ # Mind-map PDFs. Each is a live mPDF render, and ?pace= is a reader preference # rather than a different document -- 114 maps x 20 pace values is 2,280 # distinct URLs that all produce the same sheet at a different schedule. The # map page itself is the indexable thing and is in the sitemap; the PDF is a # take-away for a reader who already arrived. The * matches the language # prefix too, so /ar/mind-maps//download is covered. Disallow: /mind-maps/*/download Disallow: /*/mind-maps/*/download Sitemap: https://kuttab.com/sitemap.xml