I was trying to read a web page by using "get $url" in PERL, but it checked cookies and redirected to another confirmation page where users were asked to click on "AGREE" button. Is there any way that I can fake clicking on the button and read the page I need?
For example, if I want to read the page:
http://www.example.com/products/indices/stdindex/performance.jsp
and it will redirect to the following link and ask users to click button before proceeding to the content page.
http://www.example.com/about/indexdata_tou.jsp?/products/indices/stdindex/performance.jsp
I've tried UserAgent POST but it didn't work.
Thanks a lot.
[edited by: tedster at 7:37 pm (utc) on Nov. 28, 2007]
[edit reason] switch to example.com [/edit]