Question

I am working with urllib2, and trying to extract the headers in a printable form from a Response object.

Presently I am printing str(response.info()), however what is printed, is itself a Python string (at least to my understanding).

(Pdb) p str(response.info())
'Date: Tue, 23 Feb 2010 03:12:26 GMT\r\nServer: Apache\r\nVary: Accept-Encoding,User-Agent\r\nContent-Encoding: gzip\r\nContent-Length: 9045\r\nConnection: close\r\nContent-Type: text/html; charset=ISO-8859-1\r\n'

I need to turn that string into an “actual” string, such as by evaluation or something similar. The best theoretical solution I’ve found is to use:

s = str(response.info())
print s.decode("string_escape")

But this does not work. Further adding to the confusion is how to handle the quotes within the string, calling eval(s) and str(s) do not work either.

Is there some better way to extract the raw headers in the response without quoting, or a method to decode the string s as above?

Answer 1

str(info()) does give a normal string:

>>> import urllib2
>>> f = urllib2.urlopen('http://tejp.de')
>>> print str(f.info())
Connection: close
Vary: Accept-Encoding
Content-Type: text/html
Accept-Ranges: bytes
ETag: "-807357257"
Last-Modified: Wed, 01 Jul 2009 10:05:34 GMT
Content-Length: 285
Date: Tue, 23 Feb 2010 03:24:10 GMT
Server: lighttpd/1.4.19

It’s only the debugger’s p command which prints the string in escaped form.