Typically you would use cloudfront with S3 if you want to use it for serving web assets.

It will cache frequently accessed assets, and in addition to reducing latency may reduce cost quite a bit.