For binary content I would recommend serving those files directly from S3 via Cloudfront under a different domain. Lambda and API gateway really aren't set up to work with binaries right now. Even serving .csv files requires some workarounds.

FYI it is also possible to go directly from the API Gateway to S3 without going thru Lambda