Rule Changelog

What changed —
and when?

RobotCheck checks websites against a living rule catalog. Here you can see every version: which rule was added, what changed, and which source triggered it.

Current version
v1.17.0
72 rules active
2026-10-12
🔄
Weekly update
Every Monday the official sources of AI providers are checked. A new version is created only when something genuinely changes — no updates for the sake of updates.
📌
Version stamp
Every analysis report shows which rule version it was run against. Older reports remain traceable — even if the rules have changed since.
🌐
Sources
Anthropic, OpenAI, Google and llmstxt.org — rules come directly from the official documentation of AI providers.
Background
Why RobotCheck updates its rules automatically
How the update pipeline works, why weekly makes more sense than monthly — and what stable rule IDs have to do with it.
Read the article
Jump tov1.17.0v1.16.0v1.15.0v1.14.0v1.13.0v1.12.0v1.11.0v1.10.0v1.9.0v1.8.0v1.7.0v1.6.0v1.5.0v1.4.0v1.3.0v1.2.0v1.0.0v0.4.0v0.3.0v0.2.0
All versions
v1.17.02026-10-12
Anthropic Docs — llms.txtllmstxt.org

72 checks active (prev 70) · max. score impact of new rules: 4 points

  • +llms-section-missing-mcp-serverinfo[llms_txt]w1 · max 1 pts
  • +llms-blocked-by-robotscritical[llms_txt]w3 · max 3 pts

v1.16.02026-09-21
llmstxt.org

70 checks active (prev 58) · max. score impact of new rules: 2 points

  • +llms-file-context-size-limitwarning[llms_txt]w2 · max 2 pts

v1.15.02026-09-17
Anthropic Docs — llms.txt
  • +llms-root-url-domain-mismatchwarning[llms_txt]w2 · max 2 pts

v1.14.02026-09-17
llmstxt.org
  • +llms-structured-data-referenceinfo[llms_txt]w1 · max 1 pts

v1.13.02026-09-14
Anthropic — ClaudeBot
  • +robots-anthropic-ip-verification-listinfo[robots_txt]w1 · max 1 pts

v1.12.02026-08-31
llmstxt.org
  • +header-link-describedby-llmsinfo[http_headers]

v1.11.02026-08-24
Google — Google-Extended
  • +http-protocol-http2-supportinfo[http_headers]

v1.10.02026-08-17
llmstxt.org
  • +meta-alternate-markdown-linkinfo[meta_tags]w1 · max 1 pts
  • +meta-describedby-llms-linkinfo[meta_tags]w1 · max 1 pts
  • +header-link-markdown-alternateinfo[http_headers]
  • +llms-most-specific-file-precedenceinfo[llms_txt]w1 · max 1 pts

v1.9.02026-08-10
Google — Google-Extended
  • +robots-google-ip-blocking-discouragedwarning[robots_txt]w2 · max 2 pts
  • +http-inappropriate-status-codeswarning[http_headers]
  • +header-caching-directives-unsupportedinfo[http_headers]

v1.8.02026-08-03
llmstxt.org
  • +llms-ctx-files-generationinfo[llms_txt]w1 · max 1 pts
  • +llms-context-file-testing-recommendedinfo[llms_txt]w1 · max 1 pts

v1.7.02026-07-27
Anthropic Docs — llms.txtAnthropic — ClaudeBotllmstxt.orgGoogle — Google-Extended
  • +llms-generic-link-titlesinfo[llms_txt]w1 · max 1 pts
  • +robots-claudebot-missinginfo[robots_txt]w1 · max 1 pts
  • +robots-subdomain-opt-out-coveragewarning[robots_txt]w2 · max 2 pts
  • +llms-section-order-requiredwarning[llms_txt]w2 · max 2 pts
  • +llms-concise-languageinfo[llms_txt]w1 · max 1 pts
  • +http-last-modified-date-formatinfo[http_headers]
  • +http-accept-encoding-supportinfo[http_headers]
  • +http-crawler-verification-methodsinfo[http_headers]
  • +robots-http2-opt-out-421info[robots_txt]w1 · max 1 pts

v1.6.02026-07-24
Anthropic Docs — llms.txtllmstxt.orgGoogle — Google-Extended
  • +llms-h3-subsection-categoriesinfo[llms_txt]w1 · max 1 pts
  • +llms-language-page-count-indicatorinfo[llms_txt]w1 · max 1 pts
  • +llms-horizontal-rule-separatorinfo[llms_txt]w1 · max 1 pts
  • +llms-index-html-md-fallbackinfo[llms_txt]w1 · max 1 pts
  • +llms-sitemap-not-substituteinfo[sitemap]w1 · max 1 pts
  • +llms-avoid-jargoninfo[llms_txt]w1 · max 1 pts
  • +header-etag-preferredinfo[http_headers]
  • +header-cache-control-max-ageinfo[http_headers]
  • +http-content-size-limitwarning[http_headers]

v1.5.02026-06-15
Anthropic Docs — llms.txtAnthropic — ClaudeBotllmstxt.org
  • +llms-language-count-availableinfo[llms_txt]w1 · max 1 pts
  • +llms-language-path-structurewarning[llms_txt]w2 · max 2 pts
  • +llms-content-inclusion-indicatorinfo[llms_txt]w1 · max 1 pts
  • +robots-claude-user-missinginfo[robots_txt]w1 · max 1 pts
  • +robots-claude-searchbot-missinginfo[robots_txt]w1 · max 1 pts
  • +llms-md-extension-pagesinfo[llms_txt]w1 · max 1 pts
  • +llms-hyperlink-format-requiredwarning[llms_txt]w2 · max 2 pts
  • +llms-external-urls-allowedinfo[llms_txt]w1 · max 1 pts

v1.4.02026-06-10
Anthropic Docs — llms.txtllmstxt.orgGoogle — Google-Extended
  • +llms-multilingual-content-availableinfo[llms_txt]w1 · max 1 pts
  • +llms-root-url-login-requiredwarning[llms_txt]w2 · max 2 pts
  • +llms-content-location-indicatorsinfo[llms_txt]w1 · max 1 pts
  • +llms-bom-optionalinfo[llms_txt]w1 · max 1 pts
  • +llms-colon-separator-formatwarning[llms_txt]w2 · max 2 pts
  • +llms-no-headings-between-sectionswarning[llms_txt]w2 · max 2 pts
  • +llms-h2-file-lists-onlycritical[llms_txt]w3 · max 3 pts
  • +llms-subpath-location-allowedinfo[llms_txt]w1 · max 1 pts
  • +robots-googlebot-blockedcritical[robots_txt]w3 · max 3 pts
  • +robots-respect-common-crawlersinfo[robots_txt]w1 · max 1 pts

v1.3.02026-06-01
llmstxt.orgGoogle — Google-Extended
  • +llms-h1-title-requiredcritical[llms_txt]w3 · max 3 pts
  • +llms-root-path-locationcritical[llms_txt]w3 · max 3 pts
  • +llms-file-lists-h2-structuredwarning[llms_txt]w2 · max 2 pts
  • +robots-googlebot-extended-blockedwarning[robots_txt]w2 · max 2 pts
  • +llms-blockquote-summary-presentwarning[llms_txt]w2 · max 2 pts
  • +robots-googlebot-extended-missinginfo[robots_txt]w1 · max 1 pts
  • +llms-optional-section-usageinfo[llms_txt]w1 · max 1 pts
  • +llms-markdown-companion-pagesinfo[llms_txt]w1 · max 1 pts

8 new rules from llmstxt.org and Google — covering llms.txt structure requirements and Google-Extended bot directives.

v1.2.02026-05-20
Anthropic — ClaudeBotllmstxt.org
  • +robots-anthropic-ip-blocking-discouragedwarning[robots_txt]w2 · max 2 pts
  • +llms-file-location-wrongwarning[llms_txt]w2 · max 2 pts
  • +robots-claudebot-crawl-delay-supportedinfo[robots_txt]w1 · max 1 pts
  • +llms-blockquote-missinginfo[llms_txt]w1 · max 1 pts
  • +llms-optional-section-presentinfo[llms_txt]w1 · max 1 pts
  • +llms-link-descriptions-missinginfo[llms_txt]w1 · max 1 pts

6 new rules from Anthropic and llmstxt.org — covering ClaudeBot crawl behavior and llms.txt content requirements.

v1.0.02026-05-20
Anthropic — ClaudeBotllmstxt.org
  • +robots-claudebot-training-exclusionwarningw2 · max 2 pts
  • +llms-file-structure-invalidwarningw2 · max 2 pts
  • +robots-claude-user-visibility-impactinfow1 · max 1 pts
  • +robots-claude-searchbot-indexing-impactinfow1 · max 1 pts
  • +llms-blockquote-description-missinginfow1 · max 1 pts
  • +llms-optional-section-presentinfo[llms_txt]w1 · max 1 pts
  • +llms-file-list-format-invalidwarningw2 · max 2 pts
  • +llms-root-path-locationcritical[llms_txt]w3 · max 3 pts

First production release — 8 rules covering ClaudeBot directives, llms.txt structure and file format.

v0.4.02026-05-12
llmstxt.org
  • +llmstxt-optional-section-presentinfow1 · max 1 pts
  • +llmstxt-api-docs-linkedwarningw2 · max 2 pts
  • ~llmstxt-description-lengthwarningw2 · max 2 pts

llmstxt.org clarified the spec for optional sections and concretised requirements for linked API documentation.

v0.3.02026-04-28
Anthropic Docs
  • +robots-claudebot-explicit-allowwarningw2 · max 2 pts
  • ~robots-ai-crawlers-presentcriticalw3 · max 3 pts

Anthropic updated its crawling documentation and listed ClaudeBot as a standalone crawler with explicit robots.txt support.

v0.2.02026-04-07
llmstxt.orgGoogle
  • +robots-google-extended-presentwarningw2 · max 2 pts
  • +llmstxt-file-presentcriticalw3 · max 3 pts

First stable version. Sources: llmstxt.org (6 rules) and Google Extended documentation (2 rules).

🔔

Notifications coming soon

Soon: get notified by email when a new rule version is released — with a direct link to re-analyze your saved websites.