Home/ Questions/Q 5982701
In Process

The Archive Base Latest Questions

Editorial Team
  • 0
Asked: 2026-05-22T22:07:28+00:00

all. I have an huge html file which contains tags like these: <h3 class=r>

  • 0

all.
I have an huge html file which contains tags like these:

<h3 class="r">
<a href="http://en.wikipedia.org/wiki/Digital_Signature_Algorithm" class=l onmousedown="return clk(this.href,'','','','6','','0CDEQFjACOAM')">

I need to extract all the urls from this page in python.

In a loop:

  1. Find occurences of <h3 class="r"> one by one.

  2. Extract the url

http://xrayoptics.by.ru/database/misc/goog2text.py I need to re-write this script to extract all the links found on google.

How can i achieve that?
Thanks.

Share

Leave an answer

You must login to add an answer.

Need An Account,

1 Answer

  1. Editorial Team
    from BeautifulSoup import BeautifulSoup

html = """<html>
...
<h3 class="r">
<a href="http://en.wikipedia.org/wiki/Digital_Signature_Algorithm" class=l
   onmousedown="return clk(this.href,'','','','6','','0CDEQFjACOAM')">
text</a>
</h3>
...
<h3>Don't find me!</h3>
<h3 class="r"><a>Don't find me!</a></h3>
<h3 class="r"><a class="l">Don't error on missing href!</a></h3>
...
</html>
"""
soup = BeautifulSoup(html)

for h3 in soup.findAll("h3", {"class": "r"}):
  for a in h3.findAll("a", {"class": "l", "href": True}):
    print a["href"]
    • 0