I wanna write a crawler to fetch data. from an asp.net site which uses javascript to do the pagination
Share
Sign Up to our social questions and Answers Engine to ask questions, answer people’s questions, and connect with other people.
Login to our social questions & Answers Engine to ask questions answer people’s questions & connect with other people.
Lost your password? Please enter your email address. You will receive a link and will create a new password via email.
Please briefly explain why you feel this question should be reported.
Please briefly explain why you feel this answer should be reported.
Please briefly explain why you feel this user should be reported.
Use CURL Library to get html code of each page, then you must only parse this pages.
For other type of page you must write other parser, do it on a DOM Library then parsers will have few lines for each type of page.
But you must have permission to do this, you must ask the author of agree of what you doing.