Forum Moderators: not2easy

Message Too Old, No Replies

Help regarding web spiders data xtraction

How a web spider should behave for contents with terms of use

         

soumadri

3:09 pm on Aug 7, 2007 (gmt 0)

10+ Year Member



I want to build an web spider and scrapper for inspirational content archiving in PERL. Now the issue is there are contents on the web, which is limited by "Terms of Use". I need help regarding this issue as how I should proceed in this case. What are the rules for a well behaved web spider and scrapper?