Re:Show HN: Prophecy.io – Cloud Native Data Engineering
by tgtweak on Friday August 16, 2019 @08:24PM
(#20720976)
How does this compare to cask hydrator/cdap? What does the migration from R or python ETLs to this resemble?
[ Parent
| on HN ]
Re:Show HN: Prophecy.io – Cloud Native Data Engineering
by ibains on Friday August 16, 2019 @09:07PM
(#20721222)
We're not adding a layer on top of all big data platforms, instead we work on Spark directly. This has advantages, disadvantages.
When you use our product, your code looks very similar to writing Spark code in IntelliJ. You get visual workflows along with it.
Our users are not having to learn or use another layer of abstractions that locks them into our API, and we avoid performance
Apart from interface, we automatically "convert" your legacy code into Spark & "migrate" these Spark workflows from one cluster to another. You can move workflows from private cloud to public cloud, or to another datacenter.