I am working on a file upload system which will store individual parts of large files on more than one server. So the distribution of a 1GB file will look something like this:
Server 1: 0-128MB
Server 2: 128MB-256MB
Server 2: 256MB-384MB
... etc
The intention of this is to allow for redundancy (each part will exist on more than one server), security (no one server has access to the entire file), and cost (bandwidth expenses are distributed).
I am curious if anyone has an opinion on how I might be able to “trick” web browsers into downloading the various parts all in one link.
What I had in mind was something like:
- Browser is linked to Server 1, which provides a content-size of the full file
- Once 128MB is served, Server 1 will intentionally close the connection
- Hopefully, the browser will try to restart the download, requesting Server 1
- Server 1 provides a 3XX redirect to Server 2
- Browser continues downloading from Server 2
I don’t know for certain that my example works, as I haven’t tested it yet. I was curious if there were other solutions someone might have?
I’d like to make the whole process as easy as possible (ideally requiring no work beyond a simple download). I don’t want the users to have to use another program (ie: cat’ing the files together). I’d also like to not use a proxy server, since it would incur extra bandwidth costs.
As far as I’m aware, there is no javascript solution for writing a file, if there was one, that would be great.
AFAIK this is not possible by using the HTTP protocol. You can probably use a custom browser extension but it would depend on the browser. Another alternative is to create a Java applet that would download the file from different servers. The applet can accept the URLs to the different servers as parameters.