Next.js SEO for AI crawlers: rendering, metadata and robots
Next.js SEO for AI crawlers: what the App Router sends by default, where useEffect, Suspense and streamed metadata go wrong, and how to set robots.ts and JSON-LD.
9 min read
7 guides
Platform guides
Each platform has its own defaults for robots.txt, rendering and structured data, and its own places where things go wrong. These guides walk through the settings that matter on the platforms most sites are built with.
React SPA SEO: fixing the empty shell for AI crawlers
React SPA SEO for AI search: why Vite and Create React App sites send crawlers an empty root div, four fixes ranked by effort, and how to verify each one.
8 min read
Shopify and AI crawlers: robots.txt, schema and theme checks
How AI crawlers see a Shopify store: the default robots.txt, robots.txt.liquid edits, theme JSON-LD, app-injected content, duplicate URLs and bot protection.
9 min read
Squarespace AI crawlers: the settings to check
Squarespace's AI crawler checkbox asks 26 bots not to crawl, but not ChatGPT search or Perplexity. See what it changes in robots.txt and which settings hide pages.
9 min read
Webflow robots.txt and AI crawlers: the settings that matter
Where Webflow robots.txt rules live, what the Traffic control toggles block, how to keep webflow.io out of search, and how to add JSON-LD to CMS pages.
9 min read
Wix AI crawlers: what AI search sees on a Wix site
What AI crawlers see on a Wix site: server-rendered pages, the robots.txt editor, structured data settings, and the content that still goes missing.
10 min read
WordPress AI crawlers: the settings that decide what they see
The WordPress settings that decide whether AI crawlers can read your site: search visibility, robots.txt, SEO plugins, security plugins, builders and caching.
9 min read