Ask HN: Is S3 down?

Re:Ask HN: Is S3 down? by sandGorgon on Tuesday February 28, 2017 @10:33PM (#13760832)

i have had problems integrating apache spark using google storage. especially because s3 is directly supported in spark.

if you are api compatible with s3, could you make it easy /possible to work with google storage inside spark?

remember i may or may not run my spark on Dataproc.

[ Parent | on HN ]

Re:Ask HN: Is S3 down? by bluedonuts on Wednesday March 08, 2017 @08:23PM (#13825900)

You can use the Google cloud storage connector (https://cloud.google.com/hadoop/google-cloud-storage-connect...) which works with hadoop (and therefore spark).

[ Parent | on HN ]