Sign Up to our social questions and Answers Engine to ask questions, answer people’s questions, and connect with other people.
Login to our social questions & Answers Engine to ask questions answer people’s questions & connect with other people.
Lost your password? Please enter your email address. You will receive a link and will create a new password via email.
Please briefly explain why you feel this question should be reported.
Please briefly explain why you feel this answer should be reported.
Please briefly explain why you feel this user should be reported.
I have a database with 150 million products, I would like index these using sphinx but only have ~2 GB of RAM, is there any feasible way to index all of this data using sphinx but staying under 2 GBs?
I only need to index Product name, Product description, and brand. Although I do have several attributes, but those wouldnt need to be searchable.
Change
ondisk_dicthttp://sphinxsearch.com/docs/current.html#conf-ondisk-dict
That way only a small amount of data is loaded. Sphinx shouldnt need much memory at all.
As you using attributes,
docinfo, could be used to control themhttp://sphinxsearch.com/docs/current.html#conf-docinfo
Also reducing max_matches via the setLimit function should also reduce runtime memory usage.