Home/ Questions/Q 3999192
In Process

The Archive Base Latest Questions

Editorial Team
  • 0
Asked: 2026-05-20T07:37:31+00:00

I am wondering what is the general consensus for uploading moderately large files. I

  • 0

I am wondering what is the general consensus for uploading moderately large files. I have a web app, and every time a user uploads a file (typically larger than 5mb), the web server tends to hang until the file upload is finished.

The above seems normal, because a single upload can take up a single HTTP request handler. Do web devs take this into consideration and either:

a) Pay for more HTTP handlers

b) Use some other method to overcome this by using AJAX, or other approach

I’ve heard that it is quite normal for web apps to have a few HTTP request handlers to take care of this, which will cost quite a bit more. On the other, if cost is an issue, then some have suggested trying to upload directly to the web server or storage service (i.e. Amazon S3) directly via Flash + AJAX. The latter method takes a bit of scripting and is a bit messy.

My second concern:

By using ajax to upload files onto a server. Does this still take up a whole HTTP request handler? i.e. does the server hang until the upload is finished?

Even with flash, I would still need to specify a url to upload to. The url would be one of the actions on my controller. Which would mean that processing still takes place on the server side. Is this right so far?

I was thinking. If I were, in the other hand, to use one of the upload scripts (plupload, uploadify, swfupload, etc) to upload directly to Amazon S3, then the processing is handled on the S3 server instead of the local web server. Which wont hang the web app at all. Am I understanding this correctly?

Would like to hear your feedback.

Share

Leave an answer

You must login to add an answer.

Need An Account,

1 Answer

  1. Editorial Team

    Thanks for the responses so far.

    Unfortunately, our host Heroku does not support non-blocking, evented servers. I’ve also tried flash + javascript based uploaders like SWFUpload, Uploadify. Some variations of the mentioned plugins worked, and some didn’t. Spent countless hours of trial and error, but didnt like how the code was being integrated on my Rails app.

    In the end, went with manually uploading the file to S3 directly following this link. Which also enables a response back from the S3 server to notify us that an upload was successful, giving us the path to the uploaded file so that we can then create a background job (via redis + resque) to process the file.

    • 0