Home/ Questions/Q 7128939
In Process

The Archive Base Latest Questions

Editorial Team
  • 0
Asked: 2026-05-28T11:11:26+00:00

I am trying to download this page using Wget. Here is the page link:

  • 0

I am trying to download this page using Wget. Here is the page link:

http://cgi.ebay.com/ws/eBayISAPI.dll?ViewItem&rt=nc&item=250972882769&si=a8iGAIchyvEbn7KveYFZ5QbEE7o%3D&print=all&category=31387

And here is my cmd:

wget -O ebay.html –user-agent=”Mozilla/5.0 (Windows NT 5.2; rv:2.0.1) Gecko/20100101 Firefox/4.0.1″ “http://cgi.ebay.com/ws/eBayISAPI.dll?ViewItem&rt=nc&item=250972882769&si=a8iGAIchyvEbn7KveYFZ5QbEE7o%3D&print=all&category=31387“

When I use it to access the page using a browser it works fine. When I use Wget, it downloads another page, not the original one. I think the problem is for user-agent. What’s the solution?

Share

Leave an answer

You must login to add an answer.

Need An Account,

1 Answer

  1. Editorial Team

    The problem isn’t user-agent, it’s a missing cookie or cookies. The solution is

    1. Retrieve the normal product page with wget –save-cookies=ebay-cookies ,
    2. Fish the “Print” link URL out of that HTML file. (I did this by hand, you should obviously write a script to do it.)
    3. Retrieve the “Print” URL with wget –load-cookies=ebay-cookies

    I tried it with a random product page; it worked.

    • 0