Sign Up to our social questions and Answers Engine to ask questions, answer people’s questions, and connect with other people.
Login to our social questions & Answers Engine to ask questions answer people’s questions & connect with other people.
Lost your password? Please enter your email address. You will receive a link and will create a new password via email.
Please briefly explain why you feel this question should be reported.
Please briefly explain why you feel this answer should be reported.
Please briefly explain why you feel this user should be reported.
HUsing the regular search engine, as a human, can get you not more than 1000 results, which is far more than a regular person needs.
But what If I do want to get 2000? is it possible? I read that it is possible using the App Engine or something like that (over here…), but, is it possible, somehow, to do it through Perl?
I don’t know a way around this limit, other than to use a series of refined searches versus one general search.
For example instead of just “Tim Medora”, I might search for myself by:
Search #1: “Tim Medora Phoenix”
Search #2: “Tim Medora Boston”
Search #3: “Tim Medora Canada”
However, if you are trying to use Google to search a particular site, you may be able to read that site’s Google sitemaps.
For example, http://www.linkedin.com exposes all 80 million+ users/businesses via a series of nested sitemap XML files: http://www.linkedin.com/sitemap.xml.
Using this method, you can crawl a specific site quite easily with your own search algorithm if they have good Google sitemaps.
Of course, I am in no way suggesting that you exploit a sitemap for illegal/unfriendly purposes.