User-agent: * Allow: / # /early-access/* is deliberately NOT disallowed. Those pages send # `noindex, nofollow`, and a crawler has to fetch a page to read that — blocking # them here would leave the tag unread, and a blocked URL can still be indexed # as a bare listing if something links to it. Allowing the crawl is what # actually keeps them out of the index. # Form and geo endpoints — no content, and already no-store/noindex by header. Disallow: /api/ Sitemap: https://parter.ai/sitemap.xml # Same URL set as sitemap.xml, grouped and described in Markdown for agents. Sitemap: https://parter.ai/sitemap.md