Crawled Currently Not Indexed: What It Means and What to Do

What the crawled currently not indexed and discovered currently not indexed statuses mean, when to leave them alone and how to check the pages that matter.

A gold mesh sieve holding ivory spheres while a few drop through to a neat row below, like Google crawling many pages but indexing only some

Crawled currently not indexed means Google visited a page but didn’t add it to its index, so for now the page can’t appear in Google’s search results. Discovered currently not indexed means Google knows the page exists but hasn’t visited it yet. Both show up in Search Console, and Google says the first is common and doesn’t necessarily mean anything needs fixing. The work is sorting out which of those pages matter, checking them, asking Google to look again once and leaving the rest alone.

In short

  • Crawled currently not indexed: Google fetched the page and left it out. Discovered currently not indexed: Google knows the URL but hasn’t fetched it yet.
  • Not every URL should be indexed. Start with the pages you’d want a customer to land on.
  • For an important page that was crawled but not indexed, look for a near copy, thin content, content Google can’t see and missing links from your other pages.
  • Fix the page, then request indexing once. Google says repeat requests won’t get a URL crawled any faster, and no one can pay Google to crawl more often.

What crawled and discovered currently not indexed mean

Both statuses mean a URL isn’t in Google’s index. The difference is whether Google has fetched the page yet.

Google’s Page indexing report help describes them in these words:

  • Crawled currently not indexed: “The page was crawled by Google but not indexed. Google doesn’t index all pages across the web, so this is a common message for many sites and doesn’t necessarily indicate an issue that needs attention.”
  • Discovered currently not indexed: “The page was found by Google, but not crawled yet. Typically, Google wanted to crawl the URL but this was expected to overload the site; therefore Google rescheduled the crawl. This is why the last crawl date is empty on the report.”

Each is a row in the report’s Why pages aren’t indexed table, written Crawled - currently not indexed and Discovered - currently not indexed. Click a row for example URLs, or check one page with the URL Inspection tool.

What you seeWhat Google saysCheck firstAct?
Either status on a duplicate, sorted or filtered URLCopies like these probably shouldn’t be indexedThat the main version is indexedNo
Crawled currently not indexed on an important pageCommon, but diagnose important pagesURL Inspection and a live testYes
Discovered currently not indexed on a new pageCrawling can take up to a few weeksInternal links and your sitemapWait, then check
Discovered currently not indexed on many important pagesGoogle rescheduled the crawl to avoid overloading the siteHost status in the Crawl Stats reportYes

When not being indexed is normal

Google doesn’t expect every URL on a site to be indexed. “Some URLs might be duplicates or might not contain meaningful information,” its Page indexing help says. “Just be sure that the key pages on your site are indexed.” Google puts the goal this way: “Your goal is to get the canonical version of every important page indexed.” The canonical is the version Google picks to show from a group of similar pages.

So look at which URLs are in each row before you worry. Google says sorted or filtered versions of a list “probably shouldn’t be indexed, if they are just showing the same content that is sorted, filtered, or reached in different ways.” It also says “Google doesn’t index duplicate copies of a page.” If the main version is indexed, the copy being left out is the system working.

If your site has fewer than 500 pages, Google says you probably don’t need this report. It suggests searching site: plus the exact address of a key page to see whether Google has indexed it.

Discovered currently not indexed: Google hasn’t crawled the page yet

On a new page, the usual answer is time. If important pages stay in this status, check your links, your sitemap and your server.

Google’s description gives the usual reason: crawling the URL was expected to overload the site. Its crawl budget guide says Google crawls less when a site slows down or returns server errors (5xx) or rate-limiting signals such as HTTP 429.

Crawl budget itself is rarely the problem for a business website. The guide is intended primarily for “Large sites (1 million+ unique pages) with content that changes moderately often (once a week)” and “Medium or larger sites (10,000+ unique pages) with very rapidly changing content (daily),” plus sites with a large portion of their URLs in this status. If your site doesn’t have a large number of pages that change rapidly, it says, “keeping your sitemap up to date and checking the Page Indexing report regularly is adequate.”

On a smaller site, check these instead:

  1. How new is the page? After Google knows a URL, its report help says, “it can take some time (up to a few weeks) before Google crawls some or all of your site.”
  2. Do your other pages link to it? Google’s link best practices say “Every page you care about should have a link from at least one other page on your site.” Link it from a related page Google already crawls, like a service page or your blog’s main page.
  3. Is it in your sitemap? When Google isn’t crawling all of a small or medium site, the Crawl Stats report help suggests updating your sitemaps and making sure you’re not blocking any pages. Check 7 of our technical SEO checklist covers what a clean sitemap holds.
  4. Has your server had trouble? Google says sites under a thousand pages “should not need to use” the Crawl Stats report (under Settings), but its Host status is a quick check when important pages are stuck. Google says server errors “cause availability warnings and should be fixed if possible,” so take repeated ones to your host.

Crawled currently not indexed: what to check on important pages

Google fetched the page and left it out. If the page matters, check it against the conditions Google lists for indexing.

The URL Inspection help says a page that passes the live test must still meet other conditions to be indexed, including these:

  • “The page cannot be subject to any manual actions or legal issues.”
  • “The page cannot be a duplicate of another indexed page; it must either be unique, or selected as the canonical version of a set of similar pages.”
  • “The page quality must be high enough to warrant indexing.”

Google’s guide to how Search works adds that “Indexing isn’t guaranteed; not every page that Google processes will be indexed.” Manual actions have their own Search Console report (see the FAQ), so start with the checks below.

Is it too close to another page?

Google groups pages with similar content and picks “the one that’s most representative of the group,” its guide to how Search works says. Compare pages that say nearly the same thing, like service pages that differ only by material or town pages that differ only by the town name. Google’s guide to fixing canonicalization issues says the fix “technically boils down to ensuring that the pages that are clustered together are sufficiently different.” If a page has nothing of its own to say, merge it into the stronger one. Checks 5 and 6 of our checklist of technical SEO fixes cover canonical tags and redirects.

Is it thin or unhelpful?

Read it the way a customer would: does it answer what they came for, with details only you could give? Our SEO content writing guide covers adding what the current results don’t have, and our on-page SEO checklist covers giving each page one main topic.

Does Google see what your visitors see?

Run a live test in URL Inspection, click View tested page and open the Screenshot tab. Google says the screenshot helps confirm “that all elements of the page are present and appear as you intend,” and that “Differences might be the result of resources that are blocked to the Google-InspectionTool.” If text or photos are missing, Google may be seeing a thinner page than your visitors do. A page that looks like an error can land in the report’s separate Soft 404 row instead. Our checklist covers status codes and soft 404s in check 4 and content that only appears after scripts run in check 11.

Last, make sure another page on your site links to it.

How to check a page, step by step

Start from the report, inspect one important URL at a time, fix what you find and ask Google to look again once.

  1. Open the row in the Why pages aren’t indexed table. Google says the example list “is limited to 1,000 items, and isn’t guaranteed to show all URLs in a given status.”
  2. Sort the URLs into important pages and the rest (copies, sorted or filtered versions, pages with nothing a searcher needs). Leave the rest alone.
  3. Inspect each important URL with the icon next to it and read the fields below. Google notes “This is not a live test”: the results come from the last crawl.
  4. Test the live URL. Google says a positive result “is not a guarantee that it will appear in Search results, but it means that the URL can be crawled and parsed.” Its report help adds that “duplicate or canonical conditions are not tested in the live test.”
  5. Fix the page, using the checks above.
  6. Request indexing once. Google says “Submitting a request does not guarantee that the page will appear in the Google Index” and “There is a daily limit to how many index requests you can submit.” For many pages, it recommends a sitemap “with the updated pages marked by <lastmod>.”
URL Inspection fieldWhat it tells you
Crawl allowed?Whether a robots.txt rule blocks Google from the page
Page fetch“Whether or not Google could actually get the page from your server”
Indexing allowed?Whether the page “explicitly disallowed indexing,” for example with a noindex rule
User-declared and Google-selected canonicalThe version your page names as the main one, and the one Google picked. Google “might choose another URL that it considers a better canonical example”

Validate fix, if you use it

Validate fix asks Google to recheck every URL with a status. It’s optional: Google says “You can also fix issues without validating,” since it updates the count whenever it crawls an affected page. Validation stops when Google finds a single remaining instance, so a row that still holds URLs you mean to leave out can fail. Google suggests filtering the report by a sitemap of only your most important pages first, and says “Do not click Validate fix again until validation has succeeded or failed.”

StateWhat Google says it means
Looking good“All issue instances that have been checked so far have been fixed”
Passed“All known instances of the issue are gone (or the affected URL is no longer available)”
Failed“A certain threshold of pages still contain this issue”

How long indexing takes

Google gives ranges, not dates, and says “Indexing is never instant, even when you submit a crawl request directly.”

SituationWhat Google says
A new page or site“It can take a week or so for Google to start crawling and indexing a new page or site.”
A URL Google knows about but hasn’t crawled“Up to a few weeks” before Google crawls some or all of your site
After you ask for a recrawl“Crawling can take anywhere from a few days to a few weeks.”
After Request indexing“Indexing typically takes only a day or so, but can take much longer in some cases.”
After making similar pages differentPages may stay in a duplicate cluster “for up to two weeks”

The recrawl line is from Google’s guide to asking Google to recrawl your URLs. And indexed isn’t the finish line: Google says “Just because a page is indexed doesn’t guarantee that it will show up in your search results.” Our monthly SEO report guide explains how to read a page’s clicks and impressions once it’s in.

What doesn’t help

Most shortcuts do nothing, and Google’s own pages say why.

  • Repeat requests. Requesting a recrawl multiple times for the same URL “won’t get it crawled any faster,” Google says, and its canonicalization guide says to “reserve it for your most important URLs.”
  • Paying. “Google doesn’t accept payment to crawl a site more frequently, or rank it higher. If anyone tells you otherwise, they’re wrong,” says its guide to how Search works.
  • The Indexing API. Google’s Indexing API quickstart says it “can only be used to crawl pages with either JobPosting or BroadcastEvent embedded in a VideoObject.” Ordinary service pages and blog posts don’t qualify.
  • Hiding or deleting pages in a panic. Google says “Non-indexed URLs can be fine.” A noindex rule on a page you want found only keeps it out, and deleting a useful page takes it from visitors too. If a page really should go, the crawl budget guide says to return a 404 or 410.

A worked example (made up)

Brindlecrest Fence Co. is a made-up fence company in the made-up town of Corrowmead, with a website of about 40 pages. The owner finds 9 URLs under Crawled currently not indexed and 1 under Discovered currently not indexed, and logs what she finds:

URLStatusWhat she foundWhat she did
/gallery/?sort=newestCrawled currently not indexedA sorted copy of /gallery/, which is indexedNothing
/vinyl-fences/Crawled currently not indexedTwo short paragraphs, nearly identical to /wood-fences/Rewrote it from her own vinyl jobs, added real photos and requested indexing once
/fence-repair/Crawled currently not indexedThe live test screenshot showed only the header and footer. A robots.txt rule blocked the page’s script folderHad the rule removed, retested and requested indexing once
Six town pages under /service-areas/Crawled currently not indexedIdentical except for the town nameMerged them into one service area page with real local details and redirected the old addresses
/blog/how-deep-to-set-fence-posts/Discovered currently not indexedPublished 5 days earlier and in the sitemap, but no page linked to itLinked it from the blog page and the fence installation page, then waited

She skipped Validate fix, since the crawled row still holds a URL she means to leave out, and will recheck the fixed pages in URL Inspection in a few weeks.

When the not-indexed count jumps across the site

A sudden jump across many pages is a different problem. Google’s report help says a drop in indexed pages without matching errors can mean you’re “blocking access to your existing pages” through robots.txt, noindex or a required login, and that error spikes can come from “a change in your template that introduces a new error.” Checks 1, 3 and 4 of our technical SEO checklist for business websites cover robots.txt, noindex and status codes, and our guide to Google algorithm updates covers the other usual causes of a drop. Google’s report an indexing issue form is for a suspected site-wide bug, once you’ve “fully diagnosed potential issues.”

How we handle this for clients

On-site technical SEO is part of our monthly plan. We work through checks like these on your site, fix what we find and list each task in your monthly report. You keep ownership and full control of your website and accounts and give us access to do the work.

Frequently asked questions

Is crawled currently not indexed a penalty?

No. Google calls it a common message for many sites that “doesn’t necessarily indicate an issue that needs attention.” The closest thing to a penalty is a manual action, which Google issues when a human reviewer decides pages on a site don’t comply with its spam policies. Google says it will notify you in the Manual actions report and the Search Console message center. Our guide to Google algorithm updates and manual actions explains the difference.

How long does it take Google to index a new page?

Google gives ranges, not dates. Its Page indexing help says it can take a week or so for Google to start crawling and indexing a new page or site, and its recrawl guide says crawling can take anywhere from a few days to a few weeks. Requesting indexing can help, but Google says indexing is never instant and a request doesn’t guarantee the page will be indexed.

Should I request indexing for every URL in the report?

No. Request it once for each important page you’ve fixed or changed. Google says there’s a daily limit on requests and that asking again for the same URL won’t get it crawled any faster. It also recrawls pages on its own, so Google suggests asking only when there’s an important change it hasn’t noticed for a week or more. For many pages at once, submit an updated sitemap.

Will a sitemap fix discovered currently not indexed?

It can help, but it isn’t a switch. Google’s Crawl Stats help suggests updating your sitemaps when Google isn’t crawling all of a small or medium site, and its crawl budget guide says Google reads your sitemap regularly. The page also needs links from your other pages and a server that responds without errors, and crawling can still take a few weeks.

Do I need every page on my site indexed?

No. Google says not to expect every URL to be indexed, only the canonical version of every important page. Some URLs, it says, “might be duplicates or might not contain meaningful information.” Make sure the pages you’d want a customer to land on are indexed, starting with your homepage, which Google strongly recommends getting indexed.

Why does URL Inspection show a different status than the Page indexing report?

Usually because of timing. Google’s report help says you may have fixed the issue after Google last crawled the page, so compare the crawl date with when you made the change. A page that URL Inspection shows as indexed but the report doesn’t “was probably indexed recently, and will appear in the Page indexing report soon.” The live test also doesn’t check everything the report does: most notably, it doesn’t test duplicate or canonical conditions.

Want your site’s technical SEO handled every month while you run the business? See what’s included in our $950 a month plan, or send us a question first.

Want this handled for you?

Agency Out covers technical SEO, three optimized articles a week and Google Business Profile management in one plan for $950 a month.

See the plan