Home/ Questions/Q 9142679
In Process

The Archive Base Latest Questions

Editorial Team
  • 0
Asked: 2026-06-17T09:50:15+00:00

Possible Duplicate: BeautifulSoup Grab Visible Webpage Text Web scraping with Python Say I am

  • 0

Possible Duplicate:
BeautifulSoup Grab Visible Webpage Text
Web scraping with Python

Say I am a very complex HTML page consisting usual HTML tags, CSS & JS in the middle. We might see all worst cases.

All I want is strip all the above tags/ code and return “text”.

In simple terms:

<html><body>Text</body></html>

This might contain JS, CSS etc. etc..

I am trying to use BeautifulSoup but its not removing JS from the code.. Now ,I am thinking to use Regex.. but not sure how to do

edit1

Here is my try on a simple bootstrap html page…

from bs4 import BeautifulSoup as bs
import requests

bs( requests.get(MY-URL).text ).get_text()

$ return text

html
Home
Le styles
body {
        padding-top: 10%;
        padding-left: 30%;
      }
HTML5 shim, for IE6-8 support of HTML5 elements
[if lt IE 9]>
      <script src="http://htm...html5.js"></script>
    <![endif]
Home | Under Construction
Sample Page 1
The app
might
face some ........
Firefox
. Ple..
/container
var _gaq = _gaq || [];

  _gaq.push(['_trackPageview']);

  (function() {
    var ga = do...............
  })();
Share

Leave an answer

You must login to add an answer.

Need An Account,

1 Answer

  1. Editorial Team

    Django using this function to strip tags from text:

    def strip_tags(value):
    """Returns the given HTML with all tags stripped."""
    return re.sub(r'<[^>]*?>', '', force_unicode(value))

    (You won’t need the force_unicode part)

    • 0