Forum Moderated by: open
Forum to identify search engine spiders and user agents
| Thread Subject | Messages | Started by | Last Message | ||||
|---|---|---|---|---|---|---|---|
| QuepasaCreep anyone have a clue who this is |
2 | penfold25 | 7:03 pm Aug 16, 2003 | ||||
| Need to Block Pesky Spider markmonitor |
9 | guillermo5000 | 10:19 pm Aug 15, 2003 | ||||
| who am i yet another bot |
6 | coyote | 9:39 pm Aug 15, 2003 | ||||
| Someone repeatedly asking for two images that don't exist They have been hitting me hard requesting them |
7 | AWildman | 8:52 pm Aug 15, 2003 | ||||
| Deciphering log files tracking bots |
4 | Mr_Busby | 4:50 pm Aug 15, 2003 | ||||
| Google? Not sure. |
3 | wilderness | 3:12 pm Aug 15, 2003 | ||||
| spider.ilab.sztaki.hu Seems well behaved |
2 | WitchLars | 3:06 pm Aug 15, 2003 | ||||
| Multiple IP Access Who, What, How? Bot? |
5 | Latigo | 3:35 pm Aug 14, 2003 | ||||
| Pita now is called WebVac name change |
6 | webvaccrawler | 4:24 pm Aug 13, 2003 | ||||
| New UA: FavOrg Favicon/link-checker |
2 | claus | 10:04 pm Aug 12, 2003 | ||||
| minibot(NaverRobot)/1.0 Who is this? |
16 | darryl_foshee | 6:24 pm Aug 12, 2003 | ||||
| NaverRobot masquerading as GoogleBot I don't like it |
6 | Powdork | 3:31 pm Aug 12, 2003 | ||||
| ia_archiver archive.org |
10 | wilderness | 3:08 am Aug 12, 2003 | ||||
| Kasetsart University (Department of Computer Engineering) in Bangkok, SpiderKU/0.9 |
3 | aaron2b | 6:00 pm Aug 11, 2003 | ||||
| What is readwebpage? |
2 | BlueSky | 4:30 pm Aug 11, 2003 | ||||
| InternetLinkAgent/3.1 |
4 | rainborick | 1:48 pm Aug 11, 2003 | ||||
| Who or what is WebHiker/1.0 |
3 | viggen | 12:38 pm Aug 11, 2003 | ||||
| 68.192.98.81 |
6 | wilderness | 3:20 pm Aug 10, 2003 | ||||
| Cityreview Robot strange one. no robots. |
6 | bull | 2:58 pm Aug 10, 2003 | ||||
| Being used as a proxy? appears something is passing off a URL through my site |
19 | anchordesk | 2:57 pm Aug 10, 2003 | ||||
| Useragent "Mozilla" just fetches robots.txt |
2 | viggen | 9:52 am Aug 10, 2003 | ||||
| 198.210.1.1 fell in bt trap |
2 | coyote | 11:39 pm Aug 9, 2003 | ||||
| SearchSpider.com/1.1 24.90.240.54 |
4 | jon80 | 5:42 pm Aug 8, 2003 | ||||
| Martini anyone? I've been left a martini... |
5 | Goober | 9:47 pm Aug 7, 2003 | ||||
| webbot bot include - what is this |
4 | Megatech | 4:18 pm Aug 7, 2003 |