Forum Moderators: open

Message Too Old, No Replies

Another GoogleBot wannabe

They must think we are idiots!

         

GaryK

8:06 pm on Aug 6, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Mozilla/5.0 (compatible; googlebot/2.1; [google.com...] (googlebot@google.com)
66.230.157.90
No PTR
-----
OrgName: ISPrime, Inc.
OrgID: IPRM
City: New York
StateProv: NY
Country: US
NetRange: 66.230.128.0 - 66.230.191.255

wilderness

2:48 am on Aug 7, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Gary,
Their "may" be an old thread on this.
I've had the numbers denied since Sept 2005 (it used google as the UA then).

The company Oceanic owned.

The backbone a colo.

Don

incrediBILL

2:44 pm on Aug 7, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Gary,

This is from a dedicated server hosting company REALITYCHECKNETWORK which appears to be using a subset of ISPRIME's IPs. Odds are they aren't spoofing Google but that was actually Googlebot crawling via a proxy site being enticed via a cloaked list of links.

I see this all the time and that's one way I locate and block proxy servers in real time.

You should NEVER serve a page to a search engine crawling from outside their IP range unless you want your page potentially hijacked.

[edited by: incrediBILL at 2:45 pm (utc) on Aug. 7, 2006]

GaryK

4:09 pm on Aug 7, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Bill, I have trouble believing it's the real GoogleBot because the user agent is wrong. I have never seen that user agent before. I'm sorry I forgot to include it. Here it is:

Mozilla/5.0 (compatible; googlebot/2.1; [google.com...] (googlebot@google.com)

wilderness

4:47 pm on Aug 7, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



UA and IP from Sept 2005

66.230.167.231 - - [05/Sep/2005:09:45:37 -0700] "HEAD / HTTP/1.1" 200 0 "http://google.com/" "Mozilla/4.0 (compatible; MSIE 4.01; Windows 98)"

GaryK

6:55 pm on Aug 7, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Don, my mental density is particular thick today. Certainly that's confirmation we're dealing with a proxy of some sort, right? It also seems to confirm the GoogleBot I saw wasn't the real thing. Am I embarrassing myself in public again? ;)

wilderness

7:16 pm on Aug 7, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Am I embarrassing myself in public again

Hardly Gary.

Given the liklihood of two phony google bots appearing from the same colo (albeit different crawling sites), it only encourages denying the back bone (colo) to reduce the probabilities of more phony google bots spidering or even worse some unidentified crawling.

Don

GaryK

7:30 pm on Aug 7, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



How far would you go? Right now I'm just blocking ISPrime.

wilderness

8:04 pm on Aug 7, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Gary,
I just have the range denied that you specified in the closing line of Msg# 1.

The colo may have other ranges, however I'm not looking unless they begin more crawls from different numbers.

Don

GaryK

10:06 pm on Aug 7, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



That's what I'm currently blocking too. Thanks Don. :)