promptship.dev

Can AI crawlers find your content and understand your policies?

• ✓
  robots.txt present

  HTTP 200
• ✓
  sitemap.xml present

  HTTP 200
• ✓
  Sitemap declared in robots.txt
• !
  AI bot rules in robots.txt

  No explicit rules for GPTBot / ClaudeBot / Google-Extended

  How to fix

  Add `User-agent: GPTBot`, `User-agent: ClaudeBot`, `User-agent: Google-Extended` blocks with explicit Allow/Disallow so AI crawlers know your stance.

• ✓
  Content Signals declared

  Cloudflare Content Signals present

Standard well-known endpoints agents probe to interact with your site.

• ✓
  MCP server card (/.well-known/mcp/server-card.json)

  HTTP 200
• ✓
  API catalog (/.well-known/api-catalog)

  HTTP 200
• ✗
  OAuth protected resource (/.well-known/oauth-protected-resource)

  RFC 9728 lets agents discover auth requirements

  How to fix

  Publish a JSON document at /.well-known/oauth-protected-resource with `resource` and `authorization_servers` fields. RFC 9728.

• ✗
  OpenID configuration (/.well-known/openid-configuration)

  Helpful if your site offers identity / sign-in for agents

  How to fix

  If your product supports sign-in, expose OpenID Connect discovery at /.well-known/openid-configuration so agents can authenticate users on their behalf.

How well your site speaks formats AI agents prefer.

• ✓
  llms.txt present

  HTTP 200
• ✓
  Markdown content negotiation

  Content-Type: text/markdown; charset=utf-8
• ✓
  Link header on /

  </.well-known/api-catalog>; rel="api-catalog", </.well-known/oauth-authorization-server>; rel="oauth-authorization-serve

HTML signals that Google AI Search + LLM crawlers use to rank you.

• ✓
  Homepage reachable

  HTTP 200
• ✓
  HTTPS
• ✓
  Title tag

  PromptShip: Deploy from Claude Code, Cursor & Codex
• ✓
  Meta description

  PromptShip deploys apps from Claude Code, Cursor, and Codex, backend, frontend, and mobile…
• ✓
  Canonical URL
• ✓
  Open Graph tags

  title, description, image
• ✓
  Schema.org structured data

  SoftwareApplication, FAQPage, Organization
• ✓
  Mobile viewport
• ✓
  html lang attribute
• ✓
  Image alt text

  1/1 images have alt

Optional: cryptographic verification for trusted bots.

• ✗
  Web Bot Auth directory

  Publish /.well-known/http-message-signatures-directory to verify trusted bots

  How to fix

  If you operate a bot, publish your signing keys at /.well-known/http-message-signatures-directory per draft-meunier-web-bot-auth-architecture. Most non-bot sites can leave this missing.