Home/ Questions/Q 6797217
In Process

The Archive Base Latest Questions

Editorial Team
  • 0
Asked: 2026-05-26T18:34:56+00:00

What i want to do is i want to crawl one website example www.abc.com

  • 0

What i want to do is i want to crawl one website example http://www.abc.com all pages and see if there are any instances of other domain code in all the pages. For example if the site has some reference to http://www.xyz.com then it should show that this page is refering some other urls /domains.

Want to use PHP, i have done research on it but all i can find is broken link checker

Share

Leave an answer

You must login to add an answer.

Need An Account,

1 Answer

  1. Editorial Team

    What language are you using? What have you tried?

    This comes down to two steps:

    1. Fetch the web page. Many modern languages include libraries to do this, WebRequest in .NET, urllib in python, cURL in many languages including PHP, etc.
    2. Search through the text of the page, searching for strings that match the pattern of a URL. Regular expressions rule here. In PHP you would use preg_match().
    • 0