Question

Im trying to obtain javascript “.js” files from a website using beautifulsoup. This is the code I’m using at the moment which works but misses on some files

jss = soup.findAll(name = 'script', attrs = { 'src': re.compile('\.js') })

for example js file:

src=http://krebsonsecurity.com/wp-content/plugins/comment-rating-pro/ck-karma.js?ver=3.3.2

then it misses.

Anyone knows of the best implementation to be able to extract js files.

Cheers

Answer 1

Remove the limit on what the value of the src is (beyond “having a src”).:

re.compile('\.+')