Forum Moderators: open
Message Too Old, No Replies
searchbot
Host: Time Warner Cable
45.48.0.0 - 45.51.255.255
45.48.0.0/14
"GET / HTTP/1.1" 403 926 "http://www.dmoz.org/" "Mozilla/5.0+(compatible;+searchbot/2.1;++search-engine-crawler)"
I thought that sounded awfully familiar, but red herring. The string "searchbot", case sensitive, is also part of the UA
SafeDNSBot (https://www.safedns.com/searchbot)as discussed last October [webmasterworld.com]. I've seen the latter a few times lately, but it seems to obey robots.txt so I'm not bothered.
Join The Conversation
- Register For Free! - Become a Pro Member!
- See forum categories - Enter the Forum
Moderators and Top Contributors
- Moderator List | Top Contributors:This Week, This Month, Aug, Jul, Archive, Top 100 All Time, Top Voted Members
Hot Threads This Week
