Home/ Questions/Q 919323
In Process

The Archive Base Latest Questions

Editorial Team
  • 0
Asked: 2026-05-15T18:31:31+00:00

I am currrently using BeautifulSoup to scrape some websites, however I have a problem

  • 0

I am currrently using BeautifulSoup to scrape some websites, however I have a problem with some specific characters, the code inside UnicodeDammit seems to indicate this (again) are some Microsoft-invented ones.

I’m using the newest version of BeautifulSoup(3.0.8.1) as I am still using python2.5

The following code illustrates my problem:

from BeautifulSoup import BeautifulSoup
soup = BeautifulSoup('...Baby One More Time (Digital Deluxe Version…')
print soup

'...Baby One More Time (Digital Deluxe Version…'

As you can see the problem is the ‘…'(&hellip) character at the end (which your browser probably escaped correctly). Obviously that’s not what I am interested in.

It would be nice to have this characters unicode representation or something.
Even sinmply ignoring it would solve my particular problem.

How can I do this with BeautifulSoup?

Share

Leave an answer

You must login to add an answer.

Need An Account,

1 Answer

  1. Editorial Team

    Found the solution myself:

    soup = BeautifulSoup('...Baby One More Time (Digital Deluxe Version…', convertEntities="html")
    • 0