Forum Moderated by: open
Forum to identify search engine spiders and user agents
| Thread Subject | Messages | Started by | Last Message | ||||
|---|---|---|---|---|---|---|---|
| What is This? Micro$oft? |
3 | frontpage | 12:14 pm Apr 19, 2002 | ||||
| New to SEO and robots robots.txt for multiple sites on one server |
2 | dabrisz | 10:11 pm Apr 17, 2002 | ||||
| spiders! unknown spider species |
7 | mikeala_2000 | 6:07 pm Apr 17, 2002 | ||||
| unknown from exodus 216.33.229.162 |
2 | berno | 1:36 pm Apr 17, 2002 | ||||
| trafficfixer.com advertisment in the logfiles |
6 | skirril | 7:47 am Apr 17, 2002 | ||||
| Teoma's Spider Does anyone have any idea on this one? |
4 | dvb_99 | 7:43 pm Apr 16, 2002 | ||||
| New Scooter UA |
8 | msgraph | 10:06 am Apr 14, 2002 | ||||
| new ua: Viking/1.8 |
3 | skirril | 5:03 pm Apr 13, 2002 | ||||
| Blocking UA "-" |
5 | skirril | 12:24 am Apr 13, 2002 | ||||
| htdig |
6 | wilderness | 10:31 pm Apr 12, 2002 | ||||
| Heads Up |
6 | toolman | 8:40 am Apr 12, 2002 | ||||
| FAST-WebCrawler/3.5 Sunday was 3.3 Now, 3.5 |
6 | bobriggs | 5:00 pm Apr 11, 2002 | ||||
| AnnoMille Spider A not so very new robot for the Italian Middle Ages |
2 | misosoph | 6:45 am Apr 11, 2002 | ||||
| Can you get Inktomi Slurp to index new pages? It takes the old and ignores the new |
7 | misosoph | 8:16 am Apr 10, 2002 | ||||
| Szukacz/1.4 (from Poland?) |
5 | Crazy_Fool | 4:56 am Apr 10, 2002 | ||||
| WhizBang revisited |
8 | Feynman | 4:26 am Apr 10, 2002 | ||||
| What's this? only came for files |
3 | keyplyr | 6:07 pm Apr 8, 2002 | ||||
| who know`s this spider? |
4 | goetz54 | 7:48 pm Apr 6, 2002 | ||||
| Anyone recognize any of these IPs? New spiders visiting "robots.txt" |
5 | Friday | 1:01 am Apr 6, 2002 | ||||
| Microsoft Internet Explorer/4.40.426 (Windows 95) new ID for old e-mail grabber |
5 | bird | 8:34 pm Apr 5, 2002 | ||||
| ASP question XML /Database bot list |
6 | johnhamman | 5:23 pm Apr 5, 2002 | ||||
| x1crawler3-1-0.x-echo.com what is this echo thing? |
4 | PinkPanther | 3:40 pm Apr 5, 2002 | ||||
| Szukacz/1.5 |
14 | Marcia | 9:57 am Apr 5, 2002 | ||||
| ASP bot block Any ASP solutions? |
8 | Hman | 5:54 am Apr 5, 2002 | ||||
| Good list of spiders |
6 | pcguru333 | 9:13 pm Apr 4, 2002 |