All resources
Technical SEO, updated October 2026
A plain-language guide to crawlability and indexability
What it means for search engines to find a page versus keep it, and the common mistakes that block both.
Two different questions
Crawlability asks whether a search engine can reach a page. Indexability asks whether it is allowed to keep that page and show it in results. A page can pass one and fail the other.
Common crawlability problems
These usually stop a page from being reached at all.
- A robots.txt file that blocks an important section of the site.
- Pages that are not linked from anywhere and are missing from the sitemap.
- Links that lead to error pages.
Common indexability problems
These tell search engines to leave a page out.
- A noindex directive left behind after a site launch or redesign.
- A canonical tag that points to a different page.
- Duplicate pages competing with each other.
How to check
Run a site audit and look at the crawlability group first. Then confirm any important page in the search console tools your search engine provides.