Question

I am trying to read data from a website. I can see the value I need but the value does not appear in the downloaded html code (using urllib2). The value is created by some js file and embedded into the webpage as innerhtml for that id.
PS: How can that be extracted? raw source code cannot render js unlike the browsers!

Answer 1

Another way of getting data is leaving the browser do all the stuff using Selenium and read the rendered html. A bit slow but surely effective.

Here you can find a getting started guide for using Selenium with Python:
http://jimmyg.org/blog/2009/getting-started-with-selenium-and-python.html