News for hackers. Stuff that matters.
Re:TiSpark sits Spark SQL on top of a storage engine to answ... by ilovesoup on Friday August 04, 2017 @04:49AM (#14927272)
I'm the main dev of TiSpark. I totally agree. For now we allow trx only in TiDB. I believe one day those big-data stuff will be unified onto one platform. With a full-featured distributed db storage layer underneath, there might be tons of tricks to play comparing to data on hdfs. Ultimately, we plan to put a mysql layer on top of Spark SQL (maybe or something else as mpp engine), as you said, to make user not aware of existence of Spark SQL underneath.
Re:TiSpark sits Spark SQL on top of a storage engine to answ... by elvinyung on Friday August 04, 2017 @05:04PM (#14932249)
Just curious -- what other MPP engines are you currently considering, and what are the criteria?