Question

I am using Ubuntu and have a known URL which I need to download/save as a CSV. The URL is based on a parameter and changes often for a project, so I want to write a script which does the download, so that I don’t have to manually save it every single time.

I was trying to use wget to get the file, but the website displays the contents as CSV, while the file itself is an HTML. How can I save the content of the page as a pure csv?

wget -O my.csv [url]

Can anyone help?

Answer 1

It seems the only HTML in the file is <br /> at the end of each line. To remove it, you can just

wget -O- "$URL" | sed 's#<br />$##' > my.csv