Question

I am a complete novice, so please excuse me if the answer is already out there-as i don’t have sufficient knowledge to make an accurate search.

I have a project where the CSV data i want is accessible from a web address such as http://www.xxxxxx.com/xxDATEFORMAT. I want to know what i need to learn/do to basically automate the process of

changing the date in that web address
and downloading the csv in a folder with file name as DATEFORMAT
then repeating the process for all dates back to some given date.

As far as i know this requires a script and some kind of loop…but i don’t really know much more. I guess it will require at least 2 dates to be specified, and it’s trading data so it will exclude weekends, so i would be open to entering a list of dates somewhere.

OS is windows7 but could consider using a linux distro via windows virtual machine if that will work.

Any pointers would be really appreciated, however scant.
Cheers

Answer 1

If you’re on linux, you can use something like this in a .sh script :

DATE_PART=`date +%Y/%m/%d`
mkdir -p "/wheretostore/$DATE_PART"
cd "/wheretostore/$DATE_PART"
wget "http://www.xxxxxx.com/$DATE_PART/myfile.csv"

And you can call this script from cron.