Home/ Questions/Q 701583
In Process

The Archive Base Latest Questions

Editorial Team
  • 0
Asked: 2026-05-14T03:37:34+00:00

I’m attempting to use wget with the -p option to download specific documents and

  • 0

I’m attempting to use wget with the -p option to download specific documents and the images linked in the HTML.

The problem is, the site that is hosting the HTML has some non-html information preceding the HTML. This is causing wget to not interpret the document as HTML and doesn’t search for images.

Is there a way to have wget strip the first X lines and/or force searching for images?

Example URL:

First Lines of Content:

<DOCUMENT>
<TYPE>S-4
<SEQUENCE>1
<FILENAME>ds4.htm
<DESCRIPTION>FORM S-4
<TEXT>
<HTML><HEAD>
<TITLE>Form S-4</TITLE>

Last Lines of Content:

</BODY></HTML>
</TEXT>
</DOCUMENT>

EDIT: Solutions in PHP are certainly accepted.

Share

Leave an answer

You must login to add an answer.

Need An Account,

1 Answer

  1. Editorial Team

    Wget is actually detecting the img tags. The issue is the website is question has a robots.txt that disallows /Archives. Wget honors that request and does not retrieve additional documents.

    However, you can use the downloaded document as input to wget to retrieve related documents:

    wget -l 1 –base=url –force-html -i file

    • 0