AI Crawler File Validator

AI language models increasingly use purpose-built hint files like llms.txt to understand website structure — similar to how search engines use sitemap.xml and robots.txt. The llms.txt format provides a curated Markdown index: links to your most important pages with titles and optional descriptions, organized by section.

This validator checks your llms.txt or llms-full.txt against the published specification. It verifies that links use proper Markdown syntax, sections are correctly formatted, the required H1 title is present, and the optional blockquote description is placed correctly.

AI crawlers from Anthropic, OpenAI, Google, and others reference these files to build accurate knowledge about your site. A valid, well-structured llms.txt improves how AI models represent and cite your content.