The setup:
- SQL for queueing jobs
- EC2 workers for running jobs (autoscaling via CloudWatch)
The problem:
As jobs are run, many of them require connecting to third-party systems that have very strict security policies. As such, the only way to access these systems is by white-listing our worker’s IP address in advance. However, as new EC2 instances spin up they will (obviously) have different IP addresses.
What would it take to make all the workers’ requests come from a single, static IP address? I don’t see anything in AWS that covers this.
You would probably need to run your instances inside a Virtual Private Cloud with a VPC router to where you can have control over the NAT translations for the machines. Check teh documentation here as a starting point:
http://aws.amazon.com/vpc/