← All checks
AI usage policy: Content-Signal and noai checker
Group E2 pointsrubric r1
We look in robots.txt for a Content-Signal: line or groups that name AI user agents such as GPTBot, and in the homepage for a robots meta tag containing noai or noimageai.
Why it matters
A site that states its terms for AI use is easy for a compliant agent to follow, while silence leaves the agent guessing and some err on the side of leaving. Any explicit policy scores 2, whether it allows or restricts. The check rewards stating a position, not a particular one.
How to fix it
- Add a line to robots.txt such as
Content-Signal: search=yes, ai-input=yes, ai-train=no. - Or add named groups, for example
User-agent: GPTBotfollowed byAllow: /. - Or add
<meta name="robots" content="noai">to pages you want excluded. - Publish the same policy in plain words on your terms page.
How to verify
Run curl -s https://example.com/robots.txt | grep -iE "content-signal|gptbot|claudebot".