Discovery

XML Sitemap Guide

An XML sitemap is a discovery file that presents the important canonical URLs on your site to search engines and crawler bots in an organized way.

Quick summary
  • A sitemap makes it easier to discover important URLs.
  • Only canonical, indexable URLs that return successful responses should be included.
  • On multilingual sites, the sitemap should be consistent with canonical and hreflang signals.

What is an XML sitemap?

An XML sitemap is a structured file that shows crawler bots which URLs on your site are important. It is especially useful for discovery on large sites, newly published content, and deep URL structures.

Which URLs should be included?

A sitemap should contain only canonical, indexable URLs that return successful responses. It should not be filled with low-quality URLs such as redirects, noindex pages, duplicates, parameter combinations, or internal search results.

Sitemaps on multilingual sites

Linking from robots.txt

Publish the sitemap in the site root when possible and reference it in robots.txt. This allows crawlers to discover the file without requiring manual submission.

How it supports GEO

AI and search systems benefit from clear discovery paths. A clean sitemap strengthens your site architecture and makes important resources easier to find.

Checklist

  • List only canonical, indexable URLs.
  • Remove redirects, noindex pages, and blocked URLs.
  • Use a consistent trailing-slash convention.
  • Reference sitemap.xml in robots.txt.
  • Keep language-version URLs aligned with hreflang annotations.
  • Update the sitemap after major URL changes.

Implementation order

  1. Create a list of canonical URLs that should be indexed.
  2. Make sure language alternatives and hreflang structure are correct.
  3. Reference the sitemap file in robots.txt.
  4. Submit the sitemap through Search Console and monitor errors.

Frequently asked questions

Should every URL be included in the XML sitemap?

No. Include only canonical, high-quality pages that you want indexed. Do not include filter, test, cart, or low-value URLs.

How should a sitemap work on multilingual sites?

Active English pages should be consistent with canonical signals, and the sitemap should contain only live, indexable URLs.

Does a sitemap directly improve rankings?

It does not directly guarantee higher rankings, but it helps important pages get discovered and communicates updates more clearly to search systems.