Sign Up to our social questions and Answers Engine to ask questions, answer people’s questions, and connect with other people.
Login to our social questions & Answers Engine to ask questions answer people’s questions & connect with other people.
Lost your password? Please enter your email address. You will receive a link and will create a new password via email.
Please briefly explain why you feel this question should be reported.
Please briefly explain why you feel this answer should be reported.
Please briefly explain why you feel this user should be reported.
The data I want is visible from the browser, but I can’t find it from the html source code. I suspect the data was generated by scripts. I’d like to grad such kind of data. Is it possible using Jsoup? I’m aware Jsoup just does not execute Javascript.
Take this page for example, I’d like to grab all the colleges and schools under Academics -> COLLEGES & SCHOOLS.
If the dom content is generated via scripts or plugins, then you really should consider a scriptable browser like phantomjs. Then you can just write some javascript to extract the data.
I didn’t check your link, and I assume you’re looking for a general answer not specific to any page.