Home/ Questions/Q 6072291
In Process

The Archive Base Latest Questions

Editorial Team
  • 0
Asked: 2026-05-23T10:08:38+00:00

I want to do some screen-scraping with Python 2.7, and I have no context

  • 0

I want to do some screen-scraping with Python 2.7, and I have no context for the differences between HTMLParser, SGMLParser, or Beautiful Soup.

Are these all trying to solve the same problem, or do they exist for different reasons? Which is simplest, which is most robust, and which (if any) is the default choice?

Also, please let me know if I have overlooked a significant option.

Edit: I should mention that I’m not particularly experienced in HTML parsing, and I’m particularly interested in which will get me moving the quickest, with the goal of parsing HTML on one particular site.

Share

Leave an answer

You must login to add an answer.

Need An Account,

1 Answer

  1. Editorial Team

    I am using and would recommend lxml and pyquery for parsing HTML. I had to write a web scraping bot a few month ago and of all the popular alternatives I tried, including HTMLParser and BeautifulSoup, I went with lxml and the syntax sugar of pyquery. I haven’t tried SGMLParser though.

    For what I’ve seen, lxml is more or less the most feature-rich library and its underlying C core is quite performant when compared to its alternatives. As for pyquery, I really liked its jQuery-inspired syntax which makes navigating the DOM more enjoyable.

    Here are some resources you might find useful in case you decide to give it a try:

    Well, that’s my 2c 🙂 I hope this helps.

    • 0