I need to get information from couple of web sites . For example this site
What would be the best way to get all the links from the page so that the information could be extracted.
Some times need to click on a link to get other links inside that.
I tried Watin and I tried doing the same from within Excel 2007 with Web Data option.
Could you please suggest some better way which I am not aware of .
I need to get information from couple of web sites . For example this
Share
Ncrawler might be very useful for the deep level crawling . You could also set the MaxCrawlDepth for specifying the same.