Forum Moderated by: open
Forum to identify search engine spiders and user agents
| Thread Subject | Messages | Started by | Last Message | ||||
|---|---|---|---|---|---|---|---|
| Microcomputers Etc. new bot? |
2 | leifwessman | 9:40 am Jun 3, 2003 | ||||
| franklin locator what is it and where to get it? |
7 | wkitty42 | 5:33 am Jun 3, 2003 | ||||
| When do I need Options +FollowSymLinks? in htaccess |
8 | guillermo5000 | 2:08 am Jun 3, 2003 | ||||
| Brand New IP gets hits! An interesting experiment |
6 | carfac | 8:07 pm Jun 2, 2003 | ||||
| Denying innocent bystanders |
3 | wilderness | 5:43 am Jun 1, 2003 | ||||
| boitho.com-robot/1.0 |
6 | sarahk | 9:38 pm May 31, 2003 | ||||
| Need Spider Info Help |
2 | Porkchop | 12:38 am May 31, 2003 | ||||
| Is this new? NetNose-Crawler 2.0 |
2 | jim_w | 1:11 pm May 30, 2003 | ||||
| Need help identifying a spider what spider is this? |
3 | tim3562 | 11:06 pm May 29, 2003 | ||||
| ETS v5.1 what is it? |
7 | bobmark | 4:33 pm May 29, 2003 | ||||
| More Cogeco Outdated thread |
8 | wilderness | 4:24 am May 29, 2003 | ||||
| Microsofts .NET hitting my site like crazy Need help to stop it |
10 | DrOliver | 2:12 pm May 28, 2003 | ||||
| Halo - the magical bot |
2 | jimmykav | 9:38 am May 28, 2003 | ||||
| Here is a reason NOT to block blank U-As It just might be this website checking for valid code |
9 | Wizcrafts | 6:21 pm May 27, 2003 | ||||
| need help with 403 custom page not working in .htaccess I included an ErrorDocument 403 custom page but I get error message |
9 | Wizcrafts | 5:34 pm May 26, 2003 | ||||
| Need to block a specific spider Help with robots txt |
7 | coosblues | 9:38 pm May 25, 2003 | ||||
| Visits from 'mercury.hiddenservers.com' Is this a Google bot? |
5 | salson | 1:37 pm May 25, 2003 | ||||
| kulokobot backweave |
3 | DavidT | 8:07 pm May 24, 2003 | ||||
| Why is deepbot using freshbot ip? |
2 | requiem | 7:44 pm May 24, 2003 | ||||
| wizard.dataforce.net kore wa, nani? (= what's this?) |
4 | berli | 7:43 pm May 23, 2003 | ||||
| freshbot instead ob deepbot 216.x.x.x 64.x.x.x classification still true? |
3 | plasma | 5:23 pm May 23, 2003 | ||||
| Is this Googlebot or an imposter? New type of entry in my log files |
4 | birdstuff | 9:03 pm May 22, 2003 | ||||
| Googlebot? 216.239.39.x |
10 | Stefan | 8:37 pm May 22, 2003 | ||||
| 207.42.75.170 |
8 | DavidT | 4:44 am May 22, 2003 | ||||
| How do I set up a spider trap? badwidth theft |
3 | Digger | 11:55 pm May 21, 2003 |
