This is kind of tricky. There is this webpage which, I am guessing, uses some kind of AJAX to pull out content based on the search query. When I fetch the page using get in Perl, it fetches the script code behind the php/html, but not the results which are displayed when the query is searched manually. I need to be able to fetch the content of the results page. Is there anyway to do this in Perl?
Share
Take a look at Selenium RC and the
WWW::Seleniummodule in Perl. With them you can control a real web browser.Another option is
WWW::HtmlUnitwhich uses the HtmlUnit Java library to execute the JavaScript without a web browser.WWW::HtmlUnituses Inline::Java to give Perl access to the library. I have found that when installing, it is best to say No to the question “Do you wish to build the JNI extension?”.