Question

I have to handle large amount of data retrieved from server using ajax and store it in JavaScript. I am currently using an array to store all the data. this is how I get data and store it in the javascript:

var buffer=new Array();
//when each ajax returns 
buffer=buffer.concat(JSON.parse(ajaxReq.responseText));

there are two questions in my mind:

1. Is using an array to store all the data efficient, is there an overflow issue with 1 million rows of data??
2. How is the concat performance? how can it be optimized here?

thanks for any input.

Answer 1

It looks like you are dumping your whole database on the client at every pageload, so that at the particular page load he may or may not have to wait for quick ajax responses. This is honestly by far the most insane thing I have ever heard of, and hopefully you can see it as such as well.

Even if your users wouldn’t have to wait for small ajax calls that don’t really take long (look at google autosuggest), having to have them wait for 1 million database rows to transfer and load in memory on every pageload is even worse user experience.

What you are doing is only feasible if your data fits in localStorage (5MB), which it probably doesn’t.