Problem
App running in the cloud expecting to handle a large number of requests :
not handle synchronously, rather handle them asynchronously.
At peak hours, using a single instance can cause the instance to become flooded with requests.
Solution
Using multiple instances to make the workload to be load balanced across consumers to prevent an instance to become the bottleneck.
Need a message queue to distribute work to instances of a service.
Competing Consumers In Practice