Suppose I create a Windows Azure application that consists of multiple instances talking to each other by starting a server on each instance and exchanging big chunks of data.
What data transfer speed should I expect from the underlying infrastructure?
It depends a bit on what size your instances are:
Those are the limits. There are other factors as well of course:
There are likely other factors as well, but these are what I can think of off the top of my head.