Toggle navigation
Dashboard
Dashboard Tracker
Add / Edit My Forums
System Announcements
Discussion
Active Thread Feed
Top Threads Today
Top Threads This Week
Top Threads Library
Go!
View All
View All
Login
Logout
Home
Forums Index
General SEO Issues
/
Crawler, Spider, and User Agent ID
5:17 am Jul 22, 2026
This page requires javascript.
Forum Moderators:
open
Message Too Old, No Replies
Proxy IT
keyplyr
Msg#:4130335
5:58 pm on May 10, 2010
(gmt 0)
UA: Python-urllib/2.4
rDNS: mc-106.proxyit.com
Host: MCI Communications Services, Inc. d/b/a Verizon Business
robots.txt: no
NetRange: 65.200.199.0 - 65.200.199.255
CIDR: 65.200.199.0/24
Pfui
Msg#:4130946
5:41 pm on May 11, 2010
(gmt 0)
Whoever it is has been at this for a long time. From 2008-09 notes; the exact same Host & UA:
mc-106.proxyit.com
Python-urllib/2.4
robots.txt? NO
Instead made a beeline for a dynamically generated file.
From the Host name, I thought this was yet another free/anon proxy. Rather, it's a server farm (etc.) IT company.
Join The Conversation
Register
For Free! -
Become a
Pro Member
!
See forum categories
-
Enter the Forum
Moderators and Top Contributors
Moderator List
| Top Contributors:
This Week
,
This Month
,
Jun
,
May
,
Archive
,
Top 100 All Time
,
Top Voted Members
Hot Threads This Week
July 2026 Google Search Observations
Annoying Crawler, Bot, or what?
Suspicious visitors
Do you still build external links in 2026?
How to find out why a page is suddenly popular?
Home
Forums Index
General SEO Issues
/
Crawler, Spider, and User Agent ID
5:17 am Jul 22, 2026