News for hackers. Stuff that matters.
Re:FastSpark: A New Fast Native Implementation of Spark from... by mvitorino on Thursday October 31, 2019 @02:31PM (#21412072)
How would you efficiently keep continuously updated complex metrics (aggregations, windowed functions, etc) calculated on top of unbounded/streaming data using a database? I'm not saying that Spark is the ideal solution, but there are a set of problems that require tools such as Spark.
Re:FastSpark: A New Fast Native Implementation of Spark from... by truth_seeker on Thursday October 31, 2019 @02:51PM (#21412287)
One example could be PipelineDB extension for PostgreSQL

http://docs.pipelinedb.com/introduction.html

Re:FastSpark: A New Fast Native Implementation of Spark from... by bsg75 on Thursday October 31, 2019 @03:01PM (#21412381)
Re:FastSpark: A New Fast Native Implementation of Spark from... by truth_seeker on Friday November 01, 2019 @01:04AM (#21416409)
I know. But at the same time, 1.0 is pretty much capable. Give it a try and you will realize it.