We are working on a Vista/Windows 7 application that will be running in 64 bit mode using VS2008/C++. We will be needing to cache hundreds of 2-3 mb blobs of data in RAM for performance reasons up to some memory limit. Our usage profile is such that we cannot read the data in fast enough if it is all on the the disk. Cached Memory usage will be larger than 1gb memory used. For this to work well, we need to ensure that Windows does not page this memory out as it will defeat the purpose of why we are doing this.
I’ve done a fair amount of research and cannot find documentation that states exactly how to do this. I’ve seen several references that infer memory mapped files work this way. Is there an expert who can clarify this for me?
I’m aware there are other programs that we could adapt to do this, for example, splitting the blobs and loading into memcache or inmemory databases, but they all have too many problems with performance or code complexity.
Suggestions?
From user mode, you can’t (EDIT: At least for the sizes you’re talking about). User mode allocations all come down to either the VirtualAlloc API (On top of which the GlobalAlloc/LocalAlloc/C Runtime’s functions are written) or the Memory Mapped File API. Neither API supports this, and therefore it’s impossible to obtain on Win32. It is possible from whithin Kernel Mode, but somehow I suspect this is a user-mode application 🙂
Note that the memory manager is not going to decide to page your RAM without good reason to do so.
Now, you could of course, if you control the machine completely (this is for internal use or something) disable the pagefile on the machine in question, but that does not seem to solve your problem.