Home/ Questions/Q 5937391
In Process

The Archive Base Latest Questions

Editorial Team
  • 0
Asked: 2026-05-22T15:32:06+00:00

I am trying to create a function which will extract meta keywords from a

  • 0

I am trying to create a function which will extract meta keywords from a given URL and return it. However no matter what URLs I pass to it, it will always fail.

def GetKeywords(url):
  soup = BeautifulSoup(url)
  keywords = soup.findAll('meta', attrs={'name':re.compile("^keywords$", re.I)}) #Find all meta keywords on that page
  if len(keywords) == 0: #Check to see if that page has any meta keywords to begin with
    print "No meta keywords for: " + str(url)
    return -1
  else:  #If so then return them
    return keywords
Share

Leave an answer

You must login to add an answer.

Need An Account,

1 Answer

  1. Editorial Team

    Where does the BeautifulSoup state that it would accept and fetch an URL?

    soup = BeautifulSoup(url)

    Sorry but read the BeautifulSoup documentation first yourself instead trying and guessing API methods..

    http://www.crummy.com/software/BeautifulSoup/documentation.html#Parsing a Document

    What you want is likely using the urllib2 module of Python for fetching data yourself
    before feeding it into BeautifulSoup or you look at something like the scrapy module.

    • 0