Forum Moderated by: open
Forum to identify search engine spiders and user agents
| Thread Subject | Messages | Started by | Last Message | ||||
|---|---|---|---|---|---|---|---|
| Tandem scooter? (Scooter/3.3 & Scooter/3.3_SF) two UA's now |
4 | claus | 6:46 pm Aug 27, 2003 | ||||
| New UA signature for FAST |
2 | rbs10025 | 6:41 pm Aug 27, 2003 | ||||
| Mozilla/4.0 (compatible; GoogleToolbar 1.1.60-deleon; Windows 98 SE 4. wot? |
2 | claus | 6:07 pm Aug 27, 2003 | ||||
| Will this work Trying to get my robots.txt file right |
3 | le_gber | 2:28 pm Aug 27, 2003 | ||||
| Update on boitho.com-robot/1.1 Possible UA fake |
7 | cyberkat | 1:11 pm Aug 27, 2003 | ||||
| .net Clr 1.1.4322 Is this ok or not? |
4 | JadedJane | 4:57 am Aug 27, 2003 | ||||
| 64.37.103.2 (bundy.infomaxinc.com) |
5 | WarmGlow | 7:27 pm Aug 26, 2003 | ||||
| Mister Pix II 2.10 User-Agent Mister Pix II 2.10 |
3 | tnlnyc | 2:16 pm Aug 26, 2003 | ||||
| Taco Bell |
2 | wilderness | 11:58 pm Aug 25, 2003 | ||||
| Propfind Konqueror/3.1; Linux? |
5 | jim_w | 8:50 pm Aug 25, 2003 | ||||
| 69.10.144.45 Terrar-UK_Search robot@terrar.co.uk |
2 | volatilegx | 11:32 am Aug 25, 2003 | ||||
| User_Agent "MARTINI" - from Looksmart? Anybody heard of this UA? |
3 | Friday | 7:00 am Aug 25, 2003 | ||||
| Hit-and-run spidering? |
6 | jomaxx | 9:19 pm Aug 24, 2003 | ||||
| Mozilla/4.0 (compatible; MSIE 5.00; Windows 98 maxmp3 - chinese bot? |
3 | claus | 1:19 pm Aug 24, 2003 | ||||
| VERY Strange Visit! Someone PLEASE help me figure out what this is about. |
5 | Friday | 11:09 am Aug 23, 2003 | ||||
| 128.121.20.46 rapidly requesting nonexistent pages 28 attempts in 4 seconds |
2 | jazzguy | 1:28 pm Aug 21, 2003 | ||||
| Cipinet |
7 | volatilegx | 11:36 pm Aug 20, 2003 | ||||
| Zeus and Sqworm |
3 | coyote | 6:53 pm Aug 19, 2003 | ||||
| Getty Images (206.28.73.1) ignoring robots.txt Fake user-agent, tries to grab all pages |
3 | jazzguy | 5:01 pm Aug 19, 2003 | ||||
| Good robots and bad ones - your opinion. script to help get away bad spiders from our sites. |
3 | AlexPar | 6:22 pm Aug 18, 2003 | ||||
| UA: Java/1.4.1_03 |
2 | coyote | 4:23 pm Aug 18, 2003 | ||||
| SE's out in force |
4 | Brett_Tabke | 3:51 pm Aug 18, 2003 | ||||
| Anyone recognise 80.58.6.170 |
4 | decstar | 10:08 am Aug 18, 2003 | ||||
| new directory spider 64.69.79.210 |
3 | Peeress | 1:45 pm Aug 17, 2003 | ||||
| New bot? Dmoz-checker? |
4 | claus | 6:45 am Aug 17, 2003 |