Forum Moderated by: open
Forum to identify search engine spiders and user agents
| Thread Subject | Messages | Started by | Last Message | ||||
|---|---|---|---|---|---|---|---|
| New User Agent visited my site |
2 | ned911 | 3:29 pm Mar 8, 2003 | ||||
| Fast PartnerSite Crawler Part Two - Ammending Prior Post of Same Title |
2 | pendanticist | 5:05 pm Mar 6, 2003 | ||||
| Spider and Flash Which spiders could now submit websites in Flash? |
2 | Hafsa | 3:21 am Mar 6, 2003 | ||||
| How do you block requests with no UA Would this work? |
10 | Kerrin | 7:53 pm Mar 5, 2003 | ||||
| HeinrichderMiragoRobot What's this? |
3 | Scooter24 | 5:55 pm Mar 5, 2003 | ||||
| Scooter-W3.1.2 (infoSpider URL check) Anybody seen this one? |
4 | volatilegx | 2:59 pm Mar 5, 2003 | ||||
| New member intro |
10 | acronym | 12:14 am Mar 5, 2003 | ||||
| Msn preview |
4 | wilderness | 8:47 pm Mar 4, 2003 | ||||
| Can your data base effect the deapth of the search PHP site with links to HTML pages |
3 | Travel_man | 11:34 am Mar 4, 2003 | ||||
| Mouse-House Spider Anyone know anything about this spider? |
3 | react | 8:46 pm Mar 3, 2003 | ||||
| Heavily Armed Browser okay... what/who is this, and should I be worried? |
2 | Mad_Max | 10:35 am Mar 3, 2003 | ||||
| FlickBot 2.0 RPT-HTTPClient/0.3-3 |
3 | frontpage | 9:28 pm Mar 2, 2003 | ||||
| are these ips websense? |
9 | leoo24 | 4:57 pm Mar 2, 2003 | ||||
| Beijing Email DTS Agent Dig EXT DTS Agent |
9 | Elgoog | 2:45 pm Mar 1, 2003 | ||||
| Robot. that's my name. |
2 | ga_ga | 1:29 pm Mar 1, 2003 | ||||
| anyone ever see this bot before? |
4 | AcesHigh | 7:18 am Mar 1, 2003 | ||||
| Help, I'm having problems blocking Teleport Pro What am I doing wrong? |
5 | Mad_Max | 7:16 am Mar 1, 2003 | ||||
| Fetch API Request Mozilla/4.0 (compatible; MSIE 5.5; Windows NT 5.0) Fetch API Request |
5 | jamesyap | 4:27 am Feb 28, 2003 | ||||
| Who is this? I have never seen thi s one |
2 | Laurel | 1:08 am Feb 28, 2003 | ||||
| WebcraftBoot Anyone shed some light on this lil' critter? |
3 | ritch_b | 4:07 pm Feb 27, 2003 | ||||
| Please help with .htaccess ban 163.179.0.0 to 163.179.255.255 range |
10 | nativenewyorker | 5:53 am Feb 27, 2003 | ||||
| Under protecting in IP ranges being tolerant and safe NEVER Pays |
6 | wilderness | 2:58 am Feb 27, 2003 | ||||
| 212.20.147.34 -> Whois? |
2 | akvario | 8:42 pm Feb 26, 2003 | ||||
| 66.207.121.61, P-P-C Cancel, {World Online}, pide-09-00 Violated robots.txt, changed U-A four times in two minutes |
4 | jazzguy | 6:08 pm Feb 26, 2003 | ||||
| Microsoft+URL+Control+-+6.00.8862 What is this fella up to...? |
4 | ukgimp | 3:25 pm Feb 26, 2003 |