Home/ Questions/Q 949861
In Process

The Archive Base Latest Questions

Editorial Team
  • 0
Asked: 2026-05-15T23:28:15+00:00

I am using HttpWebRequest to put a remote web page into a String and

  • 0

I am using HttpWebRequest to put a remote web page into a String and I want to make a list of all it’s script tags (and their contents) for parsing.

What is the best method to do this?

Share

Leave an answer

You must login to add an answer.

Need An Account,

1 Answer

  1. Editorial Team

    The best method is to use an HTML parser such as the HTML Agilty Pack.

    From the site:

    It is a .NET code library that allows you to parse "out of the web" HTML files. The parser is very tolerant with "real world" malformed HTML. The object model is very similar to what proposes System.Xml, but for HTML documents (or streams).

    Sample applications:

    • Page fixing or generation. You can fix a page the way you want, modify the DOM, add nodes, copy nodes, well… you name it.

    • Web scanners. You can easily get to img/src or a/hrefs with a bunch XPATH queries.

    • Web scrapers. You can easily scrap any existing web page into an RSS feed for example, with just an XSLT file serving as the binding. An example of this is provided.

    • 0