Kudos for admitting the mistake. One of our engineers did something similar and AWS actually contacted us shortly after with a warning that the creds could be viewed publically. Bummer they didn't catch it for OlinData but they are somewhat on top of this issue.

I remember someone posting something like this:

https://github.com/awslabs/git-secrets