News for hackers. Stuff that matters.
Re:Serverless Databases: The Future of Event-Driven Architec... by marknadal on Wednesday February 14, 2018 @06:20PM (#16380496)
Exactly! It is also ridiculous that this "serverless" phrase is being used to push this agenda.

"Serverless" DBs are also very pricey if you consider everything. Instead, it isn't actually that hard to do some work loads at huge scale for cheap, two good articles on this (one discord, one ours)

- https://blog.discordapp.com/how-discord-stores-billions-of-m...

- https://www.youtube.com/watch?v=x_WqBuEA7s8 (100M records/day for $10 total cost, server, disk, S3 backup!)

Re:Serverless Databases: The Future of Event-Driven Architec... by hodgesrm on Wednesday February 14, 2018 @06:55PM (#16380757)
Thanks for the references! Just read the blog article. It was kind of obvious from first paragraph it would be a Cassandra deployment story. ;)

Gun is new to me. You have a good way of handling distributed consistency. It's intriguing that the system still can reach consistency even if every node loses network connectivity temporarily. Is there any academic work behind this?

Re:Serverless Databases: The Future of Event-Driven Architec... by marknadal on Wednesday February 14, 2018 @07:21PM (#16380885)
Thank you! Yes, there is currently just a whitepaper we're publishing with Stanford and that was also reviewed by colleagues at MIT. However it isn't up to snuff yet to be posted publicly, so shoot me an email [email protected] and I'll send you the link.

For non-academics though, I did a comic strip explainer for the layperson (as distributed systems are often hyped up with elitist jargon) here: http://gun.js.org/distributed/matters.html !

The prototype shown in the video was specific to append-only data and was done last year, we recently rewrote the system to be more generalizable using a radix trie structure and have released an alpha of it with the Radix Storage Engine (RSE) in the main repo: https://github.com/amark/gun

Let me know if you need help with any/all of that, or more links/resources (docs are somewhat scarce on it currently, sadly), and I'll do what I can!

Although, I can't resist but to leave this one last animated explainer gif that shows what a radix looks like: http://gun.js.org/see/radix.gif