Home/ Questions/Q 9161473
In Process

The Archive Base Latest Questions

Editorial Team
  • 0
Asked: 2026-06-17T13:58:28+00:00

I’m busy trying to scrape a dynamic website in order to get a URL

  • 0

I’m busy trying to scrape a dynamic website in order to get a URL that I can use to download the server software for a game every time it updates.

The site is “http://craftstud.io/builds” and where it says “Server XX.X.X.X” is what I’m trying to scrape.

I really don’t want it to get complicated with Javascript and external modules, so if there is a simple solution I am all ears.

I also can’t for the life of me get third party modules installed such as BeautifulSoup (Stupid Windows).

Thanks all!

Share

Leave an answer

You must login to add an answer.

Need An Account,

1 Answer

  1. Editorial Team

    If you want something simple, consider using a simple regular expression:

    >>> import re
>>> import urllib2
>>> html = urllib2.urlopen("http://craftstud.io/builds").read()
>>> re.search(r"Server \d+\.\d+\.\d+\.\d+", html).group()
'Server 0.1.24.1'

    That said, if you can install BeautifulSoup4 via pip, you’ll find lots of use for it in the future. (Make sure you use pip install BeautifulSoup4 instead of just pip install BeautifulSoup I just installed a copy on a windows machine a couple days ago.)

    • 0