It is easy to understand how map-reduce is used to collect text and build a large inverted index. But how can map-reduce be used in inverted index search?
Share
Sign Up to our social questions and Answers Engine to ask questions, answer people’s questions, and connect with other people.
Login to our social questions & Answers Engine to ask questions answer people’s questions & connect with other people.
Lost your password? Please enter your email address. You will receive a link and will create a new password via email.
Please briefly explain why you feel this question should be reported.
Please briefly explain why you feel this answer should be reported.
Please briefly explain why you feel this user should be reported.
It is easy to understand how map-reduce is used to collect text and build a large inverted index. But how can map-reduce be used in inverted index search?
build a large inverted index, right. But not for search. MapReduce is batch processing.
I’m pretty sure that you don’t want to wait until a MapReduce job runs on 2 mio. items and score them, afterwards another Job has to run and sort the scores descending.
But that is only the case for Hadoop. Maybe if you use MapReduce inside of MongoDB, this might be accurate. But still a lot of overhead.