Question

I tried to make programme to get urls from google

but the problem is i got encoded urls ! like this !

`[u'http://www.motorrad-live.de/test.php%3Fid%3D11', u'http://www.autogaleria.pl/
auto_test/test.php%3Fid%3D37', u'http://oculus.ru/test.php%3Fid%3D2', u'http://o
culus.ru/test.php%3Fid%3D1', u'http://www.kerrytaylorauctions.com/detail-test.ph
p%3Fid%3D3432', u'http://radio.ghanaweb.com/live-radio.test.php?id=3D4', u'http:
//www.studygerman.ru/test/test.php%3Fid%3D261', u'http://www.mhealth.ru/tests/te
st.php%3Fid%3D300']

as you see after .php there something encoded !

here is my code even thoug my code content part to decode !!

import json
import urllib


def print_results(results):
    mylist=[]
    n=[]
    for r in results:
        mylist.append(r['url'])
    for each in mylist:
         n.append(each.replace(u"%3FID%","?id="))
    print n


def query(qs):
    f = urllib.urlopen('http://ajax.googleapis.com/ajax/services/search/web?v=1.0&gl=de&q=%s&rsz=8&start=7'%qs)
    s = f.read()
    j = json.loads(s)

    return j['responseData']['results']
a=query('inurl:"test.php?id"')
print_results(a)

Answer 1

you’re searching for the function unquote:

urllib.unquote(url)