Sign Up to our social questions and Answers Engine to ask questions, answer people’s questions, and connect with other people.
Login to our social questions & Answers Engine to ask questions answer people’s questions & connect with other people.
Lost your password? Please enter your email address. You will receive a link and will create a new password via email.
Please briefly explain why you feel this question should be reported.
Please briefly explain why you feel this answer should be reported.
Please briefly explain why you feel this user should be reported.
I need to get data from several pages. Data are storied in html tables.
I want to generate SQL file which saves them to my database.
One of my aims are these results.
The easiest way to process sites could be JavaScript, but how to run script on each site and write results into my hard drive?
I could also download all needed sites using wget and processed them with Python, if it had necessary libraries to work with html.
If I correctly understood you basically have to scrape some content from the web and store it in a database.
I would probably go for a Python script which crawls the webpage by using the
urllib2library and then parse it in some way depending on the needed content (regexp, BeautifulSoup, etc…).Take a look at this question: Web scraping with Python