Home/ Questions/Q 6866253
In Process

The Archive Base Latest Questions

Editorial Team
  • 0
Asked: 2026-05-27T03:09:35+00:00

I need to grab large amounts (4-8Gb) of data in realtime – without dropping

  • 0

I need to grab large amounts (4-8Gb) of data in realtime – without dropping any data.

The old system could just about keep up with writing the data to a striped RAID array but the data has got bigger, faster than the disk have got faster (!) So I don’t have time to access the disk.
The new plan is to switch to Win64, install LOTS of ram, stuff the incoming data into a buffer and then write it all at the end.

So I’m looking for:
A windows API that limits new[] to physical memory and locks pages into physical ram, or I just disable the pagefile.

Or I use memory mapped files and force a sync at the end when I close the file. Is there a memory mapped file flag that prevents a write behind until I am ready?

Share

Leave an answer

You must login to add an answer.

Need An Account,

1 Answer

  1. Editorial Team

    What you’ll have to do is overload operator new and allocate and lock that memory yourself.

    1. Call VirtualAlloc to allocate your chunk of memory.
    2. Call VirtualLock to lock those pages to physical RAM. Note that it can sometimes be difficult to convince windows to do this, but will usually work if you have way more than enough RAM and you have set the process working set size appropriately using SetProcessWorkingSetSize. Note the special PROCESS_SET_QUOTA permission the user account your process is running under will need.
    • 0