"slurp, yahoo! slurp, slurp/2.0, inktomi slurp, slurp.so/1.0"

Forum Moderators: open

Message Too Old, No Replies

"slurp, yahoo! slurp, slurp/2.0, inktomi slurp, slurp.so/1.0"

Is someone at Yahoo playing some sort of joke?

Pfui

4:22 pm on Jun 30, 2009 (gmt 0)

llf520151.crawl.yahoo.net
slurp, yahoo! slurp, slurp/2.0, inktomi slurp, slurp.so/1.0

robots.txt? Yes BUT... Simultaneous with home page grab

(...which was 403'd because my Yahoo-related UAs are case-specific.)

GaryK

10:41 pm on Jun 30, 2009 (gmt 0)

The folks at Yahoo are always attempting some sort of joke when it comes to their UAs and how they crawl. Sadly, their jokes are never funny.

I've given up trying to utilize my contact at Yahoo cause much like msndude he's constantly telling me one thing while corporate goes ahead and does whatever it wants to do.