Toggle navigation
Dashboard
Dashboard Tracker
Add / Edit My Forums
System Announcements
Discussion
Active Thread Feed
Top Threads Today
Top Threads This Week
Top Threads Library
Go!
View All
View All
Login
Logout
Home
Forums Index
Search Engines and SEO
/
Google Search and SEO
7:33 pm May 21, 2026
This page requires javascript.
Forum Moderators:
Robert Charlton
&
goodroi
Message Too Old, No Replies
What makes google crawl rate change?
dheeraj3600
Msg#:4917805
1:10 pm on Aug 29, 2018
(gmt 0)
The pages crawled per day have fallen drastically in a single day. From average of 20-30k per day to 4k in one day. What could be the reason?
keyplyr
Msg#:4917900
3:35 am on Aug 30, 2018
(gmt 0)
One cause might be the reason Googlebot is at your site.
We're in the Mobile-first (re)Index update. This is an ongoing process where all sites are being recrawled and revaluated for this new index.
We also just went through a Core update, where some sites may have seen added activity from Googlebot.
Then there's the normal web spidering where Googlebot follows incoming links from other sites.
You may also see more crawls if your site is getting high traffic.
phranque
Msg#:4917901
Votes:
1
4:20 am on Aug 30, 2018
(gmt 0)
welcome to WebmasterWorld
[webmasterworld.com], dheeraj3600!
if you analyze your server access logs for googlebot requests from a 20-30K day and compare it to a 4k day it may give you some clues.
JesterMagic
Msg#:4917960
12:26 pm on Aug 30, 2018
(gmt 0)
Doesn't answer your question directly but it does the title of the topic...
if I update my theme, depending on the amount of changes, this will trigger 3-4x increase in traffic from Googlebot for a few days to a week.
levo
Msg#:4918015
10:57 pm on Aug 30, 2018
(gmt 0)
[
support.google.com
...]
Join The Conversation
Register
For Free! -
Become a
Pro Member
!
See forum categories
-
Enter the Forum
Moderators and Top Contributors
Moderator List
| Top Contributors:
This Week
,
This Month
,
Apr
,
Mar
,
Archive
,
Top 100 All Time
,
Top Voted Members
Hot Threads This Week
May 2026 Google Search Observations
AdSense Earnings and Observations - May 2026
AI visibility audit
Adsense / Personal Manager / Support
Hacker spoofing as GoogleBot
Page indexed but live url test gets 500 error
Link collaboration strategies
in case you missed it .
Microsoft, AS8075. Google, AS396982.
Bad actor claiming to be OpenAi
Home
Forums Index
Search Engines and SEO
/
Google Search and SEO
7:33 pm May 21, 2026