Fix guides ยท Crawler access

Make your page readable without JavaScript

Server-render or pre-render your main content so it's in the initial HTML response.

Vendor documentation

What we check

We count the words in your homepage's raw HTML without running JavaScript. Under 30 words fails and under 100 warns.

81%

of 197 sites we could read pass this.

Why it matters

Vercel and MERJ reported that "none of the major AI crawlers currently render JavaScript," naming crawlers from OpenAI, Anthropic, Meta, ByteDance and Perplexity. Gemini was the exception, using Googlebot's rendering. That's a December 2024 measurement and may have changed.

Google itself runs JavaScript, but says "server-side or pre-rendering is still a great idea because it makes your website faster for users and crawlers, and not all bots can run JavaScript."

How to fix it

  1. View your page's source, not the inspector, and look for your main content.
  2. If it's missing, enable server-side rendering or static generation in your framework.
  3. Keep key facts like what you do, pricing and contact details in the HTML rather than loading them later.
<!-- Crawlers that don't run JavaScript get only this -->
<body>
  <div id="root"></div>
</body>

Fix it yourself with AI

Small fixes shouldn't sit in a queue. Give your AI agent one prompt, and it fixes and deploys for you.

PromptShip is made by the team behind this checker.

Sources

Fixed it?

Run your site through the checker, and re-check after you ship to see what improved.

Check my site

Related guides