News for hackers. Stuff that matters.
Re:Open source cloud file system. Posix, HDFS and S3 compatible by Lucasoato on Wednesday February 08, 2023 @06:16AM (#34706653)
Do you know if strong read-after-write consistency is supported (as in s3)? Is an atomic put-if-absent method supported in JuiceFS (as in Azure blob storage)? If so, this could be a really cool platform for formats like Delta.io :)
Re:Open source cloud file system. Posix, HDFS and S3 compatible by FlyingGeta on Wednesday February 08, 2023 @06:31AM (#34706750)
It seems not, instead it provides 'close-to-open' consistency, as documented here: https://juicefs.com/docs/community/cache_management/#data-co...
Re:Open source cloud file system. Posix, HDFS and S3 compatible by remram on Wednesday February 08, 2023 @12:01PM (#34710991)
That is the same as S3 then, once an upload is complete it is seen by all other clients.
Re:Open source cloud file system. Posix, HDFS and S3 compatible by daviesliu on Wednesday February 08, 2023 @07:23AM (#34707098)
JuiceFS supports create-if-not-existed by using the Java SDK (HDFS compatible), so I guess it should work well with Delta.io.