Home/ Questions/Q 3946302
In Process

The Archive Base Latest Questions

Editorial Team
  • 0
Asked: 2026-05-20T01:07:02+00:00

When running Hadoop in EC2, I seem to have two options: A: Manage the

  • 0

When running Hadoop in EC2, I seem to have two options:

  • A: Manage the cluster myself, using the EC2-specific shell scripts that come with Hadoop.
  • B: Use Elastic MapReduce, and pay a little extra for the convenience.

I’m leaning towards B, but I’d appreciate some advice from people with more experience. Here are my questions:

  1. Are there any tasks that can be done with one of these methods but not the other?
  2. Are there other options besides these two that I’m overlooking?
  3. If I choose B, how easy would it be to go back to A? That is, what’s the danger of vendor lock-in?
Share

Leave an answer

You must login to add an answer.

Need An Account,

1 Answer

  1. Editorial Team

    I have been told by people close to the Amazon Elastic MapReduce (EMR) development team that there are at least two other advantages to using EMR: a) Amazon is actively applying bug fixes and performance enhancements to the Hadoop code base used on EMR, and b) Amazon employs a high performance network between EMR servers and S3 servers that may not be available between EC2 servers and S3 servers.

    UPDATE: See @mat’s comments that refute the rumored advantages of using EMR.

    • 0