Bot information

CiteFlow-GEO-Scanner

CiteFlow operates a small, well-behaved scanner that fetches a handful of public pages on behalf of website owners running an AEO / GEO audit on their own site.

User-Agent

All requests sent by CiteFlow's scanner carry the following User-Agent string:

CiteFlow-GEO-Scanner/1.0 (+https://www.citeflow.io/bot)

What it does

  • Fetches a target page (HTML, headers, robots.txt, sitemap) to audit AEO/GEO readiness — schema, citability, AI crawler access, technical SEO, content quality.
  • Queries public APIs (Reddit, Wikipedia, Wikidata, YouTube, LinkedIn) to verify off-page brand presence relevant to AI citation.
  • Respects robots.txt. Honors HTTP rate-limit signals. One request per scan per resource — no recursive crawling.

Allow or block

To explicitly allow CiteFlow in your robots.txt:

User-agent: CiteFlow-GEO-Scanner
Allow: /

To block it instead:

User-agent: CiteFlow-GEO-Scanner
Disallow: /

Blocking takes effect on the next scan attempt — no retroactive effect on results already produced.

Contact

Questions, abuse reports, or rate-limit concerns: support@citeflow.io.