Work-around Route 53 API limit

[cho00013]

Route 53 has a API limit of 5 calls per second and it will throttle future calls. SDK (boto3 API) already has 5 retry logics built-in so it will retry, however, if there are multiple instances being spun up/torn down, then the probability of a failure increases. Currently the code tested successfully with 30 simultaneous launches.

Short-Term

• Combine all records in one Private Hosted Zone (PHZ) into a single ChangeRecordSet API call.
• Add a 1 second delay between API call to spread out the call per Instance

Long-Term

• Leverage SQS to store/retry logic for any ChangeRecordSet API calls. This will ensure that records are created properly AND deleted properly

[cho00013]

work-around added and in Pull Request.
#16

[cho00013]

@badra001 - I think we can close this task...