I have lots of data to operate on (write, sort, read). This data can potentially be larger than the main memory and doesn’t need to be stored permanently.
Is there any kind of library/database that can store these data for me in memory and that does have and automagically fallback to disk if system runs in a OOM situation? The API and storage type is unimportant as long as it can store basic Python types (str, int, list, date and ideally dict).
I will go for the in memory solution and let the OS swap. I can still replace the storage component if this will be really a problem. Thanks agf.