Question

I am trying to get the first 20 results from a Google search.
When I use urllib2.urlopen() it gives me an error and says I am forbidden.
I heard that it has something to do with faking you user agent string, but i have next to no urllib2 experience and would be very grateful if anyone could help.

Thanks,
giodamelio

Answer 1

You should probably just use a library that does all the hard work.

xGoogle enables you to get the search results in a list

From the examples,

from xgoogle.search import GoogleSearch
gs = GoogleSearch("quick and dirty")
gs.results_per_page = 50
results = gs.get_results()