Can this be done if so, how? I want to scrape data from xbox.com but the pages I need to scrape only appear after a successful login.
Share
Sign Up to our social questions and Answers Engine to ask questions, answer people’s questions, and connect with other people.
Login to our social questions & Answers Engine to ask questions answer people’s questions & connect with other people.
Lost your password? Please enter your email address. You will receive a link and will create a new password via email.
Please briefly explain why you feel this question should be reported.
Please briefly explain why you feel this answer should be reported.
Please briefly explain why you feel this user should be reported.
Can this be done if so, how? I want to scrape data from xbox.com but the pages I need to scrape only appear after a successful login.
You will have to go through the required login transaction by sending POST data with your CURL requests. That said, it is a bad idea to scrape data from behind a login – the site didn’t put that information in the public for a reason, and for you to do so might constitute copyright infringement,