Home/ Questions/Q 8614743
In Process

The Archive Base Latest Questions

Editorial Team
  • 0
Asked: 2026-06-12T05:11:36+00:00

I’ve found this discussion: MongoDB: Terrible MapReduce Performance . Basically it says try to

  • 0

I’ve found this discussion: MongoDB: Terrible MapReduce Performance. Basically it says try to avoid Mongo’s MR queries as it single-threaded and not supposed to be for real-time at all. 2 years has passed, and I wonder what has been changed since the time. Now we have MongoDb 2.2. I heard MRs are now multi-threaded. Please share your ideas over MR usage for real-time requests like fetching data for web application frequent http requests. Is it able to effectively use indexes?

Share

Leave an answer

You must login to add an answer.

Need An Account,

1 Answer

  1. Editorial Team

    Here is the current state of functionality for Map/Reduce in MongoDB

    1) Most of the performance limitations for Map/Reduce still remain in MongoDB version 2.2. The Map/Reduce engine still requires that every record get converted from BSON to JSON, the actual calculations are performed using the embedded JavaScript engine (which is slow), and there still is a single global JavaScript lock, which only allows a single JavaScript thread to run at a single time.

    There have been some incremental improvements to Map/Reduce for sharded clusters. Most notably, the final Reduce operation is now distributed across multiple shards, and the output is also sharded in parallel.

    I would not recommend Map/Reduce for real-time aggregation in MongoDB version 2.2

    2) Starting with MongoDB 2.2, there is now a new Aggregation Framework. This is a new implementation of aggregation operations, written in C++, and tightly integrated into the MongoDB framework.

    Most Map/Reduce jobs can be rewritten to use the Aggregation Framework. They usually run faster (20x speed improvement vs. Map/Reduce is common in version 2.2), they make full use of the existing query engine, and you can run multiple Aggregation commands in parallel.

    If you have real-time aggregation requirements, the first place to start is with the Aggregation Framework. For more information about the aggregation framework, take a look at these links:

    3) There have been significant improvements in Map/Reduce in MongoDB version 2.4. The SpiderMonkey JavaScript engine has been replaced by the V8 JavaScript engine, and there is no longer a global JavaScript lock, which means that multiple Map/Reduce threads can run concurrently.

    The Map/Reduce engine is still considerably slower than the aggregation framework, for two main reasons:

    • The JavaScript engine is interpreted, while the Aggregation Framework
      runs compiled C++ code

    • The JavaScript engine still requires that every document being examined get converted from BSON to JSON; if you’re saving the output in a collection, the result set must then be converted from JSON back to BSON

    There are no significant changes in Map/Reduce between 2.4 and 2.6.

    I still do not recommend using the Map/Reduce for real-time aggregation in MongoDB version 2.4 or 2.6.

    4) If you really need Map/Reduce, you can also look at the Hadoop Adaptor. There’s more information here:

    • 0