Question

I am interested in extracting links from sites where the links are dynamically generated with JavaScript and are essentially invisible in HTML source. For instance here is an example site where the links are inserted via a js menu:
http://www.stcroixwebsolutions.com/

When I hover with the mouse over the links, I see the links, but they are not discernible in HTML source.

I would like to output the links like so:

http://www.stcroixwebsolutions.com/?110000

http://www.stcroixwebsolutions.com/?110010

etc.

What do you recommend I use to extract these links?

Answer 1

You could try something like this… This will at least get you started!

http://jsfiddle.net/Qv4St/

function showLinks() {

  var links = document.getElementsByTagName( 'a' );
  var last = links.length;
  var list = {};

  // for each anchor...
  for (var i = 0; i < last; i++) {

    list[links[i].href] = i;
    console.log(list);
    //' - text=' + links[i].innerHTML + '<br>';

}

  var linksList = document.getElementById( 'linksList' );
  linksList.innerHTML = list;
}    ​