Google: Noindexed Pages Do Not Effect Crawl Budget Plan

Posted by

Google’s Search Relations team validates that noindexed pages do not negatively affect a site’s crawl budget plan, no matter how many a site has.

This subject is dealt with not once but thrice throughout the November 2022 edition of Google’s SEO office-hours Q&A session.

Google Search Supporters John Mueller and Gary Illyes take turns responding to three comparable questions from people concerned they have a lot of noindexed pages on their websites.

From Mueller’s and Illyes’ reactions, we discover there’s no such thing as “too many” indexed pages. Further, unless your site has more than a million pages, there’s no need to worry about crawl budget plan.

Here’s a quick wrap-up of each question and answer.

Concern 1: Excessive Indexed Pages

At the 8:23 mark in Google’s November 2022 office-hours, Illyes addresses a question asking if an “excessive” variety of indexed pages is a concern for discovery or indexed.

Illyes states noindex is a tool to help websites keep content out of online search engine. Google motivates utilizing the noindex tag when required, and because of that, there are no adverse results associated with it.

“Noindex is an extremely effective tool that online search engine support to help you, this site owner, keep material out of their indexes. For this factor, it doesn’t carry any unintentional effects when it pertains to crawling and indexing. For example, having many pages with noindex will not influence how Google crawls and indexes your website.”

Concern 2: Ratio Of Indexed/Noindexed Pages

The following question comes up at the 10:22 mark:

“Should we keep an eye on the ratio between indexed and non-indexed pages in Browse Console in order to much better recognize perhaps squandered crawl budget on non-indexed pages?”

Mueller debunks that sites must attempt to stabilize their indexed and nonindexed pages.

To that end, crawl budget plan is an element that couple of websites require to think of; Mueller states:

“No, there is no magic ratio to watch out for. Likewise, for a site that’s not massive, with less than a million pages, perhaps, you truly don’t require to worry about the crawl budget of your website. It’s great to eliminate unneeded internal links, however for small to medium-sized websites, that’s more of a site hygiene topic than an SEO one.”

Concern 3: Noindexed Pages Linked From Spammy Sites

At the 11:26 mark, a concern shows up about no indexed pages that’s a little various from the previous 2.

The question reads:

“A great deal of SEOs are complaining about having millions of URLs flagged as excluded by noindex in Google Search Console. All to nonsense internal search pages connected from spammy websites. Is this a problem for crawl budget?”

Ilyes reiterates the earlier point about noindex being a tool for websites to use as needed.

Assuming the pages are intentionally noindexed, there’s no need to fret about Browse Console flagging them. It doesn’t mean you’re doing anything wrong.

Illyes states:

“Noindex exists to assist you keep things out of the index, and it does not featured unexpected negative results, as we said formerly. If you wish to make sure that those pages or their URLs, more specifically, don’t wind up in Google’s index, continue using noindex and do not fret about crawl spending plan.”

Source: Google