Re:Fluvio: A programmable data platform
by mjburgess on Sunday July 11, 2021 @06:24AM
(#27799752)
An implicit sentiment of the post is how hard "big data jvm" systems are to learn and work with, as an individual developer.
The open source tools of old were all "apt install" and begin. These "ageing modern" big data systems were hacked together on the massive data centres of internet giants and very poorly packaged for use anywhere else. This has created high barriers to entry for would-be junior data engineers.
I support any system, eg., this one, which brings back this ability to scale naturally up from a one-dev-machine prototype.
Re:Fluvio: A programmable data platform
by sehz on Wednesday July 14, 2021 @11:24AM
(#27834133)
Thanks. A key reason for starting Fluvio is to democratize data. Make data streaming & data engineering accessible to everyone and remove barriers much as possible.
The open source tools of old were all "apt install" and begin. These "ageing modern" big data systems were hacked together on the massive data centres of internet giants and very poorly packaged for use anywhere else. This has created high barriers to entry for would-be junior data engineers.
I support any system, eg., this one, which brings back this ability to scale naturally up from a one-dev-machine prototype.