Question

I want to create a file search engine for educational purposes. But i dont know how. Can you point me in the right direction please? Im aware of screen scrapping and apis. I use asp.net & c# for programming.

As an example, how does this search engine search kohit.net and ectract the links. Kohit does not provide API or use parameters in url.

Answer 1

Based on your example I would say that

1. Either you get an API from each of the search engines you want to scan and use that API to execute searches on them using your search terms and displaying the results
2. Or if there’s no way to use API you can access their search url with the search terms inserted there (like http://search.ie/search.php?search=search+terms) and parse the result, create your list of results and display it to the user. This is the least favorite of the two methods as it is most likely to fail with any restructuring of the target search engines’ code