Sign Up to our social questions and Answers Engine to ask questions, answer people’s questions, and connect with other people.
Login to our social questions & Answers Engine to ask questions answer people’s questions & connect with other people.
Lost your password? Please enter your email address. You will receive a link and will create a new password via email.
Please briefly explain why you feel this question should be reported.
Please briefly explain why you feel this answer should be reported.
Please briefly explain why you feel this user should be reported.
I wan’t to write a script to get the source of a website which requires a post login.
I need a shell script to do this. I want to parse some information.
Any idea which language is the best choice for handling the http request and maybe cookies?
Thank you.
Starting with shell programming, curl can do a POST to get you the source of a web page. — See the -d option.
You can then use shell scripting with grep, sed or other options to parse the results.
More automated/sophisticated/complicated is to write a web scraper program using Perl, Ruby, pick-your-language