Toggle navigation
Dashboard
Dashboard Tracker
Add / Edit My Forums
System Announcements
Discussion
Active Thread Feed
Top Threads Today
Top Threads This Week
Top Threads Library
Go!
View All
View All
Login
Logout
Home
Forums Index
General SEO Issues
/
Sitemaps, Meta Data, and robots.txt
12:50 pm May 21, 2026
This page requires javascript.
Forum Moderators:
goodroi
Message Too Old, No Replies
User-agent: Mediapartners-Google Disallow
Tom1961
Msg#:4920674
9:02 am on Sep 21, 2018
(gmt 0)
I just noticed each of my sites has the following as the only entry in their robots.txt file.
User-agent: Mediapartners-Google
Disallow:
I don’t remember putting this there. Maybe my host did so.
Bottom line: Is there any advantage to this entry?
keyplyr
Msg#:4920675
9:06 am on Sep 21, 2018
(gmt 0)
As written, that entry does not do anything at all. The disallow has no value. It will not cause any harm.
You can leave it alone or you can remove it.
Tom1961
Msg#:4920676
9:07 am on Sep 21, 2018
(gmt 0)
Actually, I just noticed I posted the same thing in June.
Sorry
keyplyr
Msg#:4920677
9:07 am on Sep 21, 2018
(gmt 0)
Yes, it sounded familiar :)
[
webmasterworld.com
...]
Join The Conversation
Register
For Free! -
Become a
Pro Member
!
See forum categories
-
Enter the Forum
Moderators and Top Contributors
Moderator List
| Top Contributors:
This Week
,
This Month
,
Apr
,
Mar
,
Archive
,
Top 100 All Time
,
Top Voted Members
Hot Threads This Week
May 2026 Google Search Observations
AdSense Earnings and Observations - May 2026
AI visibility audit
Adsense / Personal Manager / Support
Hacker spoofing as GoogleBot
Page indexed but live url test gets 500 error
Link collaboration strategies
in case you missed it .
Microsoft, AS8075. Google, AS396982.
Bad actor claiming to be OpenAi
Home
Forums Index
General SEO Issues
/
Sitemaps, Meta Data, and robots.txt
12:50 pm May 21, 2026