Sitemaps to llms.txt

Point us at a public site, we'll crawl it with mdream, and hand back a compliant llms.txt ready for LLM consumption.

Following the llmstxt.org proposal, we surface the Markdown output directly so you can review and iterate quickly.

We crawl the site with mdream and return a Markdown-friendly llms.txt.

Advanced: URL Grouping

Group pages by URL patterns (e.g., /services/**, /blog/**) or subdomains. Groups will appear as separate H2 sections in the generated llms.txt.

These path segments will be skipped when detecting first-level patterns (e.g., /en/services/ → /services/).

When enabled, generates separate llms.txt files for each language (e.g., llms-en.txt, llms-es.txt). Each file contains only pages for that language.

Groups will be auto-detected after crawling, or you can manually add them above.

Processing

Provide a URL above to kick off the crawl.