Google: Noindexed Pages Do Not Effect Crawl Budget Plan

Posted by

Google’s Browse Relations team validates that noindexed pages do not negatively impact a website’s crawl spending plan, no matter how many a website has.

This topic is dealt with not once however thrice during the November 2022 edition of Google’s SEO office-hours Q&A session.

Google Browse Advocates John Mueller and Gary Illyes take turns responding to three comparable questions from individuals concerned they have a lot of noindexed pages on their sites.

From Mueller’s and Illyes’ reactions, we learn there’s no such thing as “a lot of” indexed pages. Even more, unless your website has over a million pages, there’s no requirement to worry about crawl spending plan.

Here’s a fast recap of each concern and response.

Question 1: Excessive Indexed Pages

At the 8:23 mark in Google’s November 2022 office-hours, Illyes addresses a question asking if an “extreme” variety of indexed pages is a problem for discovery or indexed.

Illyes says noindex is a tool to assist websites keep content out of online search engine. Google encourages using the noindex tag when needed, and for that reason, there are no negative impacts related to it.

“Noindex is a really effective tool that search engines support to assist you, this website owner, keep content out of their indexes. For this reason, it doesn’t bring any unintentional effects when it concerns crawling and indexing. For instance, having lots of pages with noindex will not affect how Google crawls and indexes your website.”

Question 2: Ratio Of Indexed/Noindexed Pages

The following question shows up at the 10:22 mark:

“Should we watch on the ratio between indexed and non-indexed pages in Browse Console in order to better acknowledge possibly wasted crawl spending plan on non-indexed pages?”

Mueller debunks that sites ought to attempt to stabilize their indexed and nonindexed pages.

To that end, crawl budget plan is an element that few websites need to consider; Mueller says:

“No, there is no magic ratio to keep an eye out for. Likewise, for a website that’s not massive, with less than a million pages, possibly, you truly don’t need to stress over the crawl budget of your website. It’s fine to get rid of unneeded internal links, but for little to medium-sized sites, that’s more of a website health topic than an SEO one.”

Concern 3: Noindexed Pages Linked From Spammy Sites

At the 11:26 mark, a concern comes up about no indexed pages that’s slightly various from the previous 2.

The question checks out:

“A great deal of SEOs are complaining about having millions of URLs flagged as omitted by noindex in Google Browse Console. All to rubbish internal search pages linked from spammy websites. Is this an issue for crawl budget?”

Ilyes reiterates the earlier point about noindex being a tool for websites to utilize as required.

Presuming the pages are purposefully noindexed, there’s no requirement to worry about Search Console flagging them. It doesn’t suggest you’re doing anything incorrect.

Illyes states:

“Noindex is there to help you keep things out of the index, and it doesn’t come with unintentional negative effects, as we stated previously. If you want to make sure that those pages or their URLs, more specifically, don’t end up in Google’s index, continue using noindex and do not worry about crawl budget plan.”

Source: Google