Crawling vs. indexing
These are two different steps, and they fail for different reasons. Crawling is Google's bot finding and reading your pages. Indexing is Google deciding to store them and make them eligible to rank. A page can be crawled and still not indexed.
We check both. On the crawl side, that's robots.txt, internal links, and crawl budget. On the index side, it's noindex tags, canonicals, duplicate content, and quality thresholds that keep pages out of the index even after they're crawled.
- Review robots.txt for rules accidentally blocking important sections
- Check for stray noindex tags on pages that should rank
- Audit canonical tags pointing pages away from themselves
- Find orphan pages with no internal links for Google to follow
- Assess XML sitemap accuracy and submission status
Reading the Search Console coverage report
Google Search Console's page indexing report is the source of truth for what's actually indexed and why the rest isn't. It groups excluded pages by reason — 'Discovered, not indexed,' 'Crawled, not indexed,' 'Duplicate,' 'Blocked by robots.txt,' and more.
Each reason points to a different fix. 'Crawled, currently not indexed' usually means Google didn't think the page was worth keeping — a quality or duplication signal, not a technical block. We translate those categories into specific actions.
- Interpret each 'not indexed' reason and its real cause
- Separate technical blocks from quality and duplication exclusions
- Identify duplicate and near-duplicate pages competing to be indexed
- Check crawl-budget waste on parameter URLs, filters, and infinite spaces
- Confirm important pages are actually in the index with live URL inspection
Opening the path for Google
Once we know what's blocking discovery and indexing, the fixes range from a one-line robots.txt change to restructuring internal links so deep pages get found. The goal is a clean, crawlable site where your important pages are easy to reach and worth indexing.
We hand you a prioritized list of what to change, why it matters, and which pages it affects — not a raw crawler export you have to interpret yourself.
- Fix robots.txt and remove erroneous noindex directives
- Correct canonical tags to point pages at themselves where appropriate
- Add internal links to orphan and deep pages to aid discovery
- Consolidate or prune duplicate and thin pages
- Clean up parameter and faceted URLs that waste crawl budget
- Rebuild and resubmit an accurate XML sitemap
More on seo audits
Frequently asked questions
Why isn't my new page showing up in Google?
Common reasons: it's too new and hasn't been crawled yet, it has no internal links so Google can't find it, it carries a leftover noindex tag, its canonical points elsewhere, or Google crawled it and judged it too thin or duplicative to index. The audit identifies which one it is using Search Console's URL inspection and coverage data.
What does 'Crawled - currently not indexed' mean?
Google found and read the page but chose not to add it to the index. That's usually a quality or duplication signal rather than a technical error — the page may be too thin, too similar to another page, or not distinct enough to earn a spot. The fix is usually improving or consolidating the content, not a code change.
Is crawl budget something I need to worry about?
For most small and mid-size sites, no — Google crawls them fully without trouble. Crawl budget matters on large sites, where filters, parameters, and duplicate pages can waste Google's crawling on junk and leave real pages undiscovered. We flag it only when your site is actually in that range.