Question

I’m looking for a step in the right direction — maybe which languages I would need, or anything else.

I’m wondering how I can write a script to keep watch on a website and notify me, perhaps by email, of when that website makes a specific change. The specific change I want, for example, is when a website posts a job title with a certain keyword.

So, I want an email sent to me when a website posts a job with a certain keyword, like ‘intern’. I.e., I’m interested in what language(s) I can use to make a crawler that will visit websites for me and, upon finding something, do something else. What languages/tools would be best?

Answer 1

Python is a good choice. If I were you, I’d look into urllib2, BeautifulSoup4, and smtplib. Those, maybe in combination with some regular expressions should be all you need to complete your project.