Re:Tachyon – Memory Centric Reliable Distributed Storage
by nickpsecurity on Thursday November 05, 2015 @12:34PM
(#10514730)
Main domain told me almost nothing. The documentation link transforms it into what should've been their homepage given it's presented like a whole, different site with everything you need.
Re:Tachyon – Memory Centric Reliable Distributed Storage
by techdragon on Thursday November 05, 2015 @10:49PM
(#10517742)
Never heard of it before. Seems... possibly useful if they would actually tell me what its useful for then perhaps I might find the documentation more engaging.
Re:Tachyon – Memory Centric Reliable Distributed Storage
by jnaour on Thursday November 05, 2015 @08:53AM
(#10513260)
Anyone has experience with this project? We are currently thinking about using it in our cluster with Spark Streaming instead of an external DB (MongoDB)
Re:Tachyon – Memory Centric Reliable Distributed Storage
by doug1001 on Thursday November 05, 2015 @07:50PM
(#10517198)
we use it, but (after reading the homepage linked to at the bottom) pretty clearly outside the core use case. In particular, we use it for off-heap caching, which we configure through org.apache.spark.StorageLevel. We monitor via tachyoneFolderName which as you probably know is a spark context (sc) attribute (eg, ./bin/spark-shell, then type "sc."[Tab] to find it).
http://tachyon-project.org/documentation/