TechnicalFree

XML Sitemap

Detects /sitemap.xml and checks if your analyzed page is included. Sitemaps guide AI crawlers to discover and prioritize your content.

Why It Matters for AI Visibility

AI crawlers from ChatGPT, Perplexity, and Google AI Overviews rely on sitemaps to discover and prioritize content. Unlike traditional search engines that have had years to build comprehensive indexes through link-following, AI engines often need to quickly identify which pages on a site are worth ingesting for their knowledge bases. Your sitemap.xml acts as a direct inventory of your content. Without a sitemap, you are relying entirely on AI crawlers finding your pages through internal and external links. That works eventually for well-linked pages, but newer content, deep pages, and orphaned URLs may never get discovered. Pages that AI engines never crawl cannot be cited in AI-generated answers. When Perplexity or ChatGPT retrieves information to answer a user query, they pull from pages they have already indexed. If your page is missing from their crawl queue because there was no sitemap pointing to it, a competitor's page gets cited instead. The sitemap is a low-effort, high-impact signal that tells every crawler exactly where your important content lives.

How We Score It

We score XML sitemaps on a 0-10 scale based on three outcomes. If your site has no sitemap.xml at all (missing or empty), you score 0. This is a fail. If we detect a sitemap index file (one that contains references to multiple sub-sitemaps), you score 5. This is a partial pass because we can confirm sitemaps exist but cannot verify that the specific page being analyzed appears in any of them without crawling each sub-sitemap. For standard sitemaps, we extract every URL listed and check whether the analyzed page appears. We normalize for case differences and trailing slashes, so `example.com/page` and `example.com/Page/` are treated as the same URL. If your page is found, you score 10. If the sitemap exists but your page is not listed, you score 5. Pass requires 7 or higher. Scores of 4-6 are partial. Below 4 is a fail.

See how your site scores on this factorAnalyze My Site

How to Improve

1
Add a sitemap.xml to your site root
If you have no sitemap at all, this is the single highest-impact fix. Place a valid sitemap.xml at your domain root (e.g., `https://example.com/sitemap.xml`). Most frameworks and CMS platforms can generate one automatically. WordPress has built-in sitemap support since version 5.5, and Next.js supports sitemap generation through its App Router.
2
Include every important page in the sitemap
A sitemap that exists but excludes the page being analyzed still drops your score to 5. Audit your sitemap and ensure it lists all public, indexable pages. Remove noindexed or redirected URLs, and add any missing content pages. Run a crawl with a tool like Screaming Frog to compare your live pages against your sitemap.
3
Reference your sitemap in robots.txt
Add `Sitemap: https://example.com/sitemap.xml` to your robots.txt file. This ensures that every crawler, including AI bots that check robots.txt first, knows where to find your sitemap without guessing. It takes one line and guarantees discoverability.
4
Keep your sitemap updated automatically
A stale sitemap with dead links or missing new pages undermines trust. Use dynamic sitemap generation so new pages are included on publish and removed pages are dropped. Most modern frameworks support this natively. If you manage your sitemap manually, set a recurring task to audit it monthly.

Before & After

Before

# robots.txt
User-agent: *
Allow: /

# No sitemap.xml exists at /sitemap.xml
# Result: Score 0 (fail)

After

<!-- sitemap.xml -->
<?xml version="1.0" encoding="UTF-8"?>
<urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9">
  <url>
    <loc>https://example.com/</loc>
    <lastmod>2025-12-01</lastmod>
  </url>
  <url>
    <loc>https://example.com/blog/geo-optimization-guide</loc>
    <lastmod>2025-11-15</lastmod>
  </url>
  <url>
    <loc>https://example.com/blog/ai-search-trends</loc>
    <lastmod>2025-10-20</lastmod>
  </url>
</urlset>

Code Examples

Basic sitemap.xml

<?xml version="1.0" encoding="UTF-8"?>
<urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9">
  <url>
    <loc>https://example.com/</loc>
    <lastmod>2025-12-01</lastmod>
    <changefreq>weekly</changefreq>
    <priority>1.0</priority>
  </url>
  <url>
    <loc>https://example.com/pricing</loc>
    <lastmod>2025-11-20</lastmod>
    <priority>0.8</priority>
  </url>
</urlset>

Sitemap index file

<?xml version="1.0" encoding="UTF-8"?>
<sitemapindex xmlns="http://www.sitemaps.org/schemas/sitemap/0.9">
  <sitemap>
    <loc>https://example.com/sitemap-pages.xml</loc>
    <lastmod>2025-12-01</lastmod>
  </sitemap>
  <sitemap>
    <loc>https://example.com/sitemap-blog.xml</loc>
    <lastmod>2025-11-28</lastmod>
  </sitemap>
</sitemapindex>

Referencing sitemap in robots.txt

User-agent: *
Allow: /

Sitemap: https://example.com/sitemap.xml

Frequently Asked Questions

Why does a sitemap index only score 5 instead of 10?

A sitemap index references multiple sub-sitemaps, but the analyzer cannot crawl into each sub-sitemap to verify your specific page is listed. The index confirms you have sitemaps in place, which earns partial credit, but it cannot prove your analyzed URL is discoverable. If possible, use a flat sitemap or ensure your pages appear in the referenced sub-sitemaps.

My page exists on the site but is not in the sitemap. Does that matter?

Yes. AI crawlers can find pages through links, but being listed in the sitemap explicitly signals that the page is important and should be indexed. Missing from the sitemap drops your score from 10 to 5. It also means crawlers may deprioritize or skip the page entirely during their next crawl cycle.

How often should I update my sitemap?

Update it whenever you add, remove, or significantly revise pages. The best approach is automatic generation so your sitemap stays in sync with your live content. Most CMS platforms and frameworks like WordPress, Next.js, and Astro support dynamic sitemap generation out of the box.

Related Factors

Technical

AI Bot Access

Technical

llms.txt File

Technical

Canonical URLs

Check Your GEO Score

Run a free analysis on your website and see how you score across all 52 factors.

Analyze My Site