Question

I’m trying to find a database to function as a Python set. This is because my data is way too big to be stored in memory.

I tried using SQLite, but heard that it might have performance issues for > ten gigabytes of data, so I’m looking at trying CouchDB

Problem is that it seems to work like a dict, not like a set?

Is there a database tool that functions as a Python set? That is, it just stores values and not key-value pairs?

(I have to code in Python so I’m interested in something that is easy to use with Python)

Edit:

I will store it as one giant set, not several small ones.

Answer 1

A key/value store acts like a dict, but that’s pretty much how set is implemented anyway, according to the main answer of How is set() implemented?. Why not just use a small dummy value, and do your set operations on the keys?