How CasinoRankr is exposed to crawlers and browsers.

Crawler access

The generated policy distinguishes search and user-requested retrieval from model-training controls. Robots rules are advisory and do not prove that a crawler visited or indexed a page.

Search and retrieval

OAI-SearchBot, ChatGPT-User, PerplexityBot, Perplexity-User, Claude-SearchBot, Claude-User, ClaudeBot, Meta-ExternalFetcher, YouBot, and mainstream search crawlers may fetch public content and citeable APIs.

Training controls

Google-Extended and CCBot are allowed for the current documented review window. GPTBot is blocked by default and can be enabled only through the deployment setting. Other named training crawlers remain blocked.

Public policy

robots.txt is the machine-readable source. The implementation notes are in the public crawler-policy documentation maintained with the application.

Sitemap and language-model files

Sitemap index

/sitemap-index.xml links the canonical page sitemap and the Google News sitemap.

Child sitemaps

/sitemap.xml and /news-sitemap.xml contain canonical, indexable URLs only. Noindexed, redirected, affiliate, and private routes stay out.

AI reference files

/llms.txt and /llms-full.txt are supplemental indexes. CasinoRankr does not claim that search or AI vendors consume them.

Response-header contract

Content Security Policy

Executable inline scripts require a per-response nonce. The script directive does not allowunsafe-inline. Frame ancestors and object sources are blocked.

Transport

Production responses declare one-year HSTS with subdomains and the preload token. Whether the domain is in a browser preload list is a separate external status and is not asserted here.

Browser isolation

The contract includes frame denial, MIME sniffing protection, strict-origin referrer policy, permissions restrictions, and same-origin/same-site cross-origin policies.

Structured-data rules

Organization, WebSite, BreadcrumbList, Dataset, Article, ItemList, Review, AggregateRating, and FAQPage are emitted only where the visible page supports the type. AggregateRating requires at least ten community votes. WebSite schema deliberately omits SearchAction because CasinoRankr has no index-safe public search route, and Google retired the sitelinks search box in November 2024. See the Google Search Central announcement.

Performance measurement

Field Core Web Vitals

Not measured for this release. No sufficient current CrUX or Vercel field dataset is attached, so no p75 LCP, INP, or CLS value is published here.

Lighthouse lab data

Measured July 11, 2026 against a local production build on Node 22.22.2 across ten key routes. Mobile Performance was 95-99, Accessibility 97-100, and Best Practices and SEO 100; LCP was 1.73-2.44 s, CLS 0.0079-0.0086, and TBT 61-200 ms. Desktop Performance was 99-100, Accessibility was 97-100, and Best Practices and SEO were 100; LCP was 0.13-0.79 s, CLS 0.0212-0.0246, and TBT 0 ms. These are throttled lab results, not production traffic or field CWV.

Synthetic interaction check

Measured July 11, 2026 on four representative mobile flows. Observed interaction latency was 32-128 ms. This controlled lab check is not a CrUX or Vercel p75 INP measurement.