Question

I just need some clarity here on whether this concept is possible or whether i have misunderstood what is capable of crawlers.

Say 1 have a list of 100 websites/blogs and every day, my program ( i am assuming its a crawler thingy ) will crwal thru them and if there is a match for some specified phrases like “miami heat” or “lebron james”, it will proceed to download that page -> convert it to a pdf with full text/images and save that pdf.

So my questions are;

1. This type of thing is possible right ? Pls note that i dont want just text snippets but i am hoping to get the entire page as if it was printed out on a piece of paper?
2. This type of programs are called as crawlers right ?
3. i am planning to build on code from http://phpcrawl.cuab.de/about.html

Answer 1

This is perfectly possible, as you are going to use phpcrawl to crawl the web pages use wkhtmltopdf to convert your html to pdf as it is

1. Yes it is possible, by using wkhtmltopdf tool you can convert web page as it is. its a desktop bases s/w so you can install in in you machine
2. Yes Crawlers.
3. Its a perfect tool for building what you want to build.