Home/ Questions/Q 6153905
In Process

The Archive Base Latest Questions

Editorial Team
  • 0
Asked: 2026-05-23T20:10:17+00:00

I’m trying to parse the url ‘http://www.5min.com/handlers/SitemapHandler.ashx?type=videositemap&page=1’ in python 2.7. The problem is when

  • 0

I’m trying to parse the url ‘http://www.5min.com/handlers/SitemapHandler.ashx?type=videositemap&page=1’ in python 2.7. The problem is when i open the url in urlopen, it doesn’t display the source, it displays weird characters. It might be encoded.

Share

Leave an answer

You must login to add an answer.

Need An Account,

1 Answer

  1. Editorial Team

    You are parsing the response of webserver not a .ashx file. Open that url in your browser. That is what python will see when you open it with urlopen.

    From opening that these are the headers I got with the response:

    Cache-Control:private
Content-Encoding:gzip
Content-Length:1100193
Content-Type:application/xml
Date:Mon, 11 Jul 2011 20:21:40 GMT
Server:Microsoft-IIS/7.5
Set-Cookie:NSC_bobmztjt-5njo-opjq*80=ffffffff4304fd3345525d5f4f58455e445a4a423660;expires=Mon, 11-Jul-2011 20:23:42     GMT;path=/;httponly
X-AspNet-Version:4.0.30319
X-Powered-By:ASP.NET
X-Server:fmv-m09 - www

    In fact it looks like the response is going to be in xml format. So you will need to parse the xml with ElementTree (or something else of your preference). Also note that the server is sending the response encoded as gzip (ZipFile), it may or may not do that depending on if urlopen allows that or not. If you’re seeing gibberish with Urlopen try using python’s ZipFile to decompress the response

    • 0