Forum Moderated by: open
Forum to identify search engine spiders and user agents
| Thread Subject | Messages | Started by | Last Message | ||||
|---|---|---|---|---|---|---|---|
| Bingbot UA from 13.64-107 |
15 | keyplyr | 8:04 pm Jul 4, 2018 | ||||
| Server Farms - Jan 2018 Continuing discussion of hosting company IP ranges[3] ( 1 2 3 ) |
68 | keyplyr | 4:43 am Jul 4, 2018 | ||||
| msnbot-media the number of the beast |
3 | lucy24 | 9:22 pm Jun 30, 2018 | ||||
| Mediatoolkitbot |
10 | TorontoBoy | 8:16 pm Jun 30, 2018 | ||||
| Should I just block Yandex bot UA? |
11 | born2run | 4:51 am Jun 30, 2018 | ||||
| IndustryIndexBot |
2 | keyplyr | 3:17 am Jun 30, 2018 | ||||
| GDPR = No WhoIs data for websites |
4 | Bewenched | 7:50 pm Jun 29, 2018 | ||||
| To block "bad" IP ranges, or to allow "good" ones ? |
17 | Dimitri | 2:47 pm Jun 29, 2018 | ||||
| Mozilla/5.0 - APS ROBOTS GRAB |
6 | Pfui | 12:43 pm Jun 29, 2018 | ||||
| bnf.fr bot |
12 | Dimitri | 8:37 pm Jun 25, 2018 | ||||
| Plainclothes Agent from 23.96/13 Possibly Bingbot |
15 | lucy24 | 8:28 pm Jun 25, 2018 | ||||
| snaptracker.org |
3 | keyplyr | 9:02 pm Jun 24, 2018 | ||||
| NLUX IAHarvester New UA for Internet Archive |
6 | keyplyr | 8:54 pm Jun 24, 2018 | ||||
| IP Range and CIDR Blocking with cPanel |
14 | azlinda | 2:50 am Jun 17, 2018 | ||||
| adbeat bot |
2 | keyplyr | 7:57 pm Jun 15, 2018 | ||||
| Trying to identify some UA |
13 | QuaterPan | 6:31 pm Jun 15, 2018 | ||||
| Feedspotbot |
6 | keyplyr | 3:27 am Jun 15, 2018 | ||||
| Anyone allowing AhrefsBot? |
5 | born2run | 3:05 am Jun 10, 2018 | ||||
| Quick-Crawler |
4 | keyplyr | 7:37 pm Jun 9, 2018 | ||||
| Powermarks |
4 | TorontoBoy | 4:31 am Jun 3, 2018 | ||||
| Mail.RU new range |
9 | lucy24 | 4:37 am Jun 1, 2018 | ||||
| Long User Agent Useful or Privacy Concern? |
10 | JAB_Creations | 5:46 am May 28, 2018 | ||||
| probably not from Yandex |
5 | lucy24 | 3:12 am May 26, 2018 | ||||
| Alternate Googlebot UA |
3 | lucy24 | 8:48 pm May 21, 2018 | ||||
| KloopBot |
3 | keyplyr | 3:11 am May 21, 2018 |