Question

Say for example I wanted grab the results from the first 3 pages in Google. So basically I want the top 30 results. I can go about grabbing the first 10 on page 1, but how do I tell Curl that once page one is done, “click” the second page and so on?

Answer 1

Just take a closer look at the URLs:

First page:

http://www.google.com/search?q=lmgtfy

Second page:

http://www.google.com/search?q=lmgtfy&start=10