Sign Up to our social questions and Answers Engine to ask questions, answer people’s questions, and connect with other people.
Login to our social questions & Answers Engine to ask questions answer people’s questions & connect with other people.
Lost your password? Please enter your email address. You will receive a link and will create a new password via email.
Please briefly explain why you feel this question should be reported.
Please briefly explain why you feel this answer should be reported.
Please briefly explain why you feel this user should be reported.
I would like to scrape web pages that load content dynamically with Javascript or similar.
Something like a headless browser, that I could use on a Linux Shared Host without X.
I can use PHP, Perl, Ruby or Python.
Do any of you know some framework/headless browser that can help me?
Thank you very much.
Try Selenium to control the browser if you need to simulate key presses or clicks in order to get the content to load.
For a headless browser, there are some listed here: headless internet browser?