Question

I need to get content for this XPath:

/html/body/div/table[2]/tbody/tr/td[2]

It’s copied from FireBug. How can I do this? I have a very large HTML document, so I don’t want (and don’t know how:) ) to grep it. Thanks.

Answer 1

lxml can handle html (and provides pretty good xpath support):

>>> import lxml.html
>>> tree = lxml.html.parse('test.html')
>>> for node in tree.xpath('/html/body/div/table[2]/tbody/tr/td[2]'):
...     print node.text
...          
first row, second column
second row, second column

Just make sure that you use it’s html parser.