My map-reduce job writes the final results to sequence files. Is there any efficient way to find the sequence file for a given key?
My map-reduce job writes the final results to sequence files. Is there any efficient
Share
Sign Up to our social questions and Answers Engine to ask questions, answer people’s questions, and connect with other people.
Login to our social questions & Answers Engine to ask questions answer people’s questions & connect with other people.
Lost your password? Please enter your email address. You will receive a link and will create a new password via email.
Please briefly explain why you feel this question should be reported.
Please briefly explain why you feel this answer should be reported.
Please briefly explain why you feel this user should be reported.
My map-reduce job writes the final results to sequence files. Is there any efficient way to find the sequence file for a given key?
If the key emitted from the mapper is the same key output in the reducer, then you can run your seach key through the used partitioner (Hash Paritioner is the default), passing the key and the number of reducers the job was originally run. This should give you the reducer number the key was sent to, and hence the part-r-xxxxx file which should contain it.