How it works
A focused check,
not a mystery score.
01
We fetch the public page and its robots.txt file.
02
Crawler-specific allow and disallow rules are evaluated for the requested path.
03
Indexability, canonical, metadata and structured-data signals are summarized.
FAQ
Before you use it.
Does allowing an AI crawler guarantee a citation?+
No. Access only makes crawling possible. Citations also depend on relevance, authority, content quality and the systems used by each AI platform.
What is Google-Extended?+
Google-Extended is a robots.txt control token publishers can use to manage whether site content may help improve Gemini models and grounding.
Does this tool execute JavaScript?+
No. It inspects the initial HTML response. Content that exists only after client-side rendering may not appear in the report.