Home/ Questions/Q 699417
In Process

The Archive Base Latest Questions

Editorial Team
  • 0
Asked: 2026-05-14T03:23:03+00:00

def download(source_url): socket.setdefaulttimeout(10) agents = [‘Mozilla/4.0 (compatible; MSIE 5.5; Windows NT 5.0)’,’Mozilla/4.0 (compatible; MSIE

  • 0
def download(source_url):
    socket.setdefaulttimeout(10)
    agents = ['Mozilla/4.0 (compatible; MSIE 5.5; Windows NT 5.0)','Mozilla/4.0 (compatible; MSIE 7.0b; Windows NT 5.1)','Microsoft Internet Explorer/4.0b1 (Windows 95)','Opera/8.00 (Windows NT 5.1; U; en)']
    ree = urllib2.Request(source_url)
    ree.add_header('User-Agent',random.choice(agents))
    resp = urllib2.urlopen(ree)
    htmlSource = resp.read()
    return htmlSource


url = "http://myIP/details/?id=4"
result_html = download(url)

It shouldn’t time out…even with the 10 second timeout..

Share

Leave an answer

You must login to add an answer.

Need An Account,

1 Answer

  1. Editorial Team

    This will fail if you’re running the development server, since it’s single-threaded and it’s busy serving the original request. Use mod_wsgi or strap on something like CherryPy if you want it to work.

    • 0