April 04, 2024

Google Crawling Priorities: Gary Illyes Explained Less Crawl Rate

Gary Illyes posted on LinkedIn that Google is trying to find a way to limit the crawl rate. Google’s focus is on reducing data consumption by lowering crawling. It also means that the content should be of high quality, helpful, and user-friendly to make it crawlable.

Google has been crawling website content due to multiple factors. It is a dynamic process that crawls and indexes content.

Gary Illyes said that Google is still crawling the content at the same rate. However, the focus is to reduce the crawl rate with intelligent technologies. The focus will be on crawling valuable content for the users.

Google Crawling Priorities: Gary Illyes Explained Less Crawl Rate: eAskme
Google Crawling Priorities: Gary Illyes Explained Less Crawl Rate: eAskme

Gary Illyes Explained Less Crawl Rate:

Gary’s LinkedIn post came after the Reddit discussion, where users talked about a lower crawl rate last year. Illyes also said that Google is trying to find ways to reduce the crawl rate.

He also explained that Google does not care about the number of pages on a website to crawl a complete webpage.

How Much to Crawl?

Gary Illyes said in a podcast that Google decides crawl rate based on search demand.

While Illyes has not explained everything in his podcast, yet the rise in search queries will increase the crawl rate. If the search queries decrease, then the crawl rate will also decrease.

Illyes explained that to increase the crawl rate, your content must be worth fetching.

In other words, the content must be the direct solution to user queries.

Quality is Crawl Rate Indicator:

Google’s crawl system is dynamic. There is no fixed crawl budget. Dynamic scheduling will index website content based on quality.

Crawl Efficiency:

Crawl efficiency will improve when Google decreases its crawl budget. According to Google, it is the way to reduce carbon emissions.

Illyes is asking for comments and suggestions to help Google achieve less crawling.

Why eAskme Cares and You Should Also?

Reduced crawling will make webmasters focus more on content quality, relevance, and engagement. The focus of content and SEO should be on adding value to user experience.

Content that answers user queries helps Google decide the crawl budget for the website. With this information, we can focus on creating content that resonates with user’s expectations.

What to do?

After this announcement, here is what you can do to ensure Google crawls your website.


Create engaging, quality, and relevant content. Content should answer user queries without wasting time.

Update content:

Create evergreen content. Update old posts. Replace outdated content with current solutions.

Search Demand:

Search demand is impacting the crawl rate. Focus on the search trends to keep the website content relevant for crawling.


Create user-friendly, clean design, easy navigation, etc. Fix structured errors.


Create quality content to help Google crawl your website even with a crawl budget. Focus on what your audience wants. Write for the audience, not for the search engines. The more your content experience improves, the more Google will crawl your content.

Still have any question, do share via comments.

Share this post with your friends and family.

join the eAskme newsletter to stay tuned with us.

Other handpicked guides for you;