Sign Up to our social questions and Answers Engine to ask questions, answer people’s questions, and connect with other people.
Login to our social questions & Answers Engine to ask questions answer people’s questions & connect with other people.
Lost your password? Please enter your email address. You will receive a link and will create a new password via email.
Please briefly explain why you feel this question should be reported.
Please briefly explain why you feel this answer should be reported.
Please briefly explain why you feel this user should be reported.
How does one use curl to crawl a website but with a different session each time? Basically, I would like to visit a page using curl, but with a new session every time.
Basically the web app should think each curl visit is a different user.
Is such a thing possible?
First of all, http is stateless and there is no such thing (in the http protocol itself) as a session.
There is a Rails session, which I believe is managed with cookies. (At least I was in Rails 2.x.) As long as you don’t send a cookie, it should think it’s a new Rails session.
The web server may be tracking sessions, or some utility to track visits and hits. This is done when a request is from the same IP address in a given window of time. For these sessions, you will not be able to use curl to be a different visit from before.