Forum Moderated by: open
Forum to identify search engine spiders and user agents
| Thread Subject | Messages | Started by | Last Message | ||||
|---|---|---|---|---|---|---|---|
| Three spiders at same time with unusual behavior |
5 | innocbystr | 5:18 am Nov 1, 2005 | ||||
| Mozilla/5.0 |
3 | wilderness | 3:53 am Nov 1, 2005 | ||||
| RedKernel WWW-Spider 2/0 no robots |
4 | bull | 6:37 pm Oct 28, 2005 | ||||
| Thumbnail.CZ robot 1.0 University of Pardubice |
2 | bull | 10:45 pm Oct 27, 2005 | ||||
| SandCrawler Microsoft.com |
2 | CafeSelect | 5:15 pm Oct 27, 2005 | ||||
| Php Yeah...thats the whole UA *moans* |
8 | JAB_Creations | 5:26 pm Oct 18, 2005 | ||||
| New WebCo IP Web Content International - back again. |
2 | fiestagirl | 9:49 pm Oct 16, 2005 | ||||
| Multiple UA's |
2 | wilderness | 11:34 pm Oct 14, 2005 | ||||
| PMAFind Looks for PHP and MySQL vulnerabilities |
4 | GaryK | 12:38 pm Oct 14, 2005 | ||||
| Yahoo-alibaba |
3 | Staffa | 10:46 pm Oct 11, 2005 | ||||
| core-project/1.0 Seems to be looking for FrontPage vulnerabilities |
6 | GaryK | 6:38 am Oct 11, 2005 | ||||
| yacy german P2P SE |
2 | bull | 1:52 pm Oct 10, 2005 | ||||
| yahoo crawler submit your site for free? |
3 | lightning2004 | 12:31 am Oct 10, 2005 | ||||
| Is this spider useful? |
20 | joker197cinque | 1:24 am Oct 9, 2005 | ||||
| EverbeeCrawler? |
4 | keyplyr | 8:26 pm Oct 7, 2005 | ||||
| A tough one: spambot disguised as IE Problem with a spambot disguised as IE |
4 | tnlnyc | 8:01 pm Oct 7, 2005 | ||||
| YahooSeeker/bsv3.9 A new day, a new YahooSeeker |
4 | MaxM | 4:45 pm Oct 6, 2005 | ||||
| Anyone know what AuditBot/0.1 is Being hit everyday with this |
10 | dramstore | 11:36 am Oct 4, 2005 | ||||
| LocalcomBot/1.2 Claims to index local websites. |
10 | GaryK | 4:07 am Oct 3, 2005 | ||||
| ShunixBot New French search engine |
4 | GaryK | 7:20 pm Oct 2, 2005 | ||||
| Metaspinner |
2 | wilderness | 6:33 am Oct 2, 2005 | ||||
| PrivacyFinder Cache Bot |
3 | keyplyr | 12:26 am Sep 29, 2005 | ||||
| Yahoo requesting GET vars that don't exist It appears that slurp is auto-incrementing a get variable |
3 | stargeek | 12:36 am Sep 27, 2005 | ||||
| Lycos |
4 | volatilegx | 8:46 pm Sep 26, 2005 | ||||
| Longest User Agent Ever? Pure Spam |
6 | volatilegx | 7:18 pm Sep 25, 2005 |