Sign Up to our social questions and Answers Engine to ask questions, answer people’s questions, and connect with other people.
Login to our social questions & Answers Engine to ask questions answer people’s questions & connect with other people.
Lost your password? Please enter your email address. You will receive a link and will create a new password via email.
Please briefly explain why you feel this question should be reported.
Please briefly explain why you feel this answer should be reported.
Please briefly explain why you feel this user should be reported.
Does anybody know where I can get a free web crawler that actually works with minimal coding by me?
I’ve Googled it and can only find really old ones that don’t work or openwebspider which doesn’t seem to work.
Ideally I’d like to store just the web addresses and which links that page contains.
Any suggestions?
I would recommend writing one from scratch. You can use the time you spend searching for the crawler to write one.