Forum Moderated by: open
Forum to identify search engine spiders and user agents
| Thread Subject | Messages | Started by | Last Message | ||||
|---|---|---|---|---|---|---|---|
| JScript Processor - tool or bot? |
4 | keyplyr | 1:36 pm Oct 29, 2003 | ||||
| User-agent with ....../1.0? Mozilla/4.0 (compatible; MSIE 4.0; Windows NT; ....../1.0 ) |
6 | seindal | 12:52 pm Oct 29, 2003 | ||||
| Email Spider by AlexW |
6 | BlueSky | 11:17 pm Oct 28, 2003 | ||||
| Newbie question about lack of spiders to recently optimized pages |
4 | lawboy | 11:16 pm Oct 28, 2003 | ||||
| Vsecrawler@hotmail.com? Crawling Sites What is This? Any Insights Appreciated |
3 | COlarry | 7:57 pm Oct 28, 2003 | ||||
| Bots ignoring Session IDs How to set Session IDs to ignore bots |
3 | chavezr | 6:45 pm Oct 27, 2003 | ||||
| DickBlick |
3 | RammsteinNicCage | 2:09 am Oct 27, 2003 | ||||
| 69.61.12.100 colocation |
3 | coyote | 12:28 am Oct 27, 2003 | ||||
| 212.142.33.101 -- sprung bot trap |
3 | BlueSky | 12:25 am Oct 27, 2003 | ||||
| Java/1.x.y Bot or not? |
7 | WebJoe | 9:58 am Oct 26, 2003 | ||||
| Anybody know what this is Jakarta Commons-HttpClient/2.0rc1 |
7 | StanTheMan | 10:07 am Oct 25, 2003 | ||||
| kuloko-bot with hidden hostname coming from "." -- very funny |
3 | Romeo | 8:20 pm Oct 24, 2003 | ||||
| Scooter/3.2 doing weird things on my site What is this all about? |
2 | kewlbeezer | 6:21 pm Oct 24, 2003 | ||||
| blocking visitors but not search engines |
2 | jakob77 | 5:57 pm Oct 24, 2003 | ||||
| Session IDs Session IDs or not |
2 | chavezr | 4:08 pm Oct 24, 2003 | ||||
| Msnia New? |
4 | ganderla | 5:00 am Oct 24, 2003 | ||||
| voilabot beta 1.2 need to ban, but don't see reques for robots.txt |
4 | macrost | 9:02 pm Oct 23, 2003 | ||||
| kuloko-bot crawling hard |
6 | creative_craig | 2:46 pm Oct 23, 2003 | ||||
| Fbot/1.1 http*//www.fetchbook.info/bot.jsp |
2 | pendanticist | 12:01 pm Oct 23, 2003 | ||||
| dakkastats strange behavior |
2 | SeanL | 9:08 pm Oct 22, 2003 | ||||
| Research Crawler appears to be ok |
6 | coyote | 7:38 pm Oct 22, 2003 | ||||
| CHIP Explorer HU what's this? |
3 | coyote | 4:24 am Oct 21, 2003 | ||||
| Microsoft Internet Explorer 5.5 Java/? what's this? |
3 | keyplyr | 4:20 am Oct 21, 2003 | ||||
| icsbot-0.1 Any Clues |
3 | xcandyman | 7:01 pm Oct 20, 2003 | ||||
| Slammed by 12.148.209.198 |
4 | King_of_Bling | 1:21 pm Oct 20, 2003 |