Re:Databases = Frameworks for Distributed Systems
by ianbutler on Tuesday May 24, 2022 @11:47AM
(#31493609)
I think that's a great idea, I already have the beginnings of a plugin system since local non distributed is a mode you can run in and I had to abstract etcd away to do that. Will add it to the list!
Re:Databases = Frameworks for Distributed Systems
by hardwaresofton on Tuesday May 24, 2022 @06:13PM
(#31498117)
Thanks! Also I’m pretty curious where I can find your project…
Re:Databases = Frameworks for Distributed Systems
by ianbutler on Wednesday May 25, 2022 @10:40AM
(#31505234)
Hey at the moment it’s not public but I’m getting to the point where it will be. Happy to ping you when it is, also planning to do a show HN post here as well with it.
Re:Databases = Frameworks for Distributed Systems
by hardwaresofton on Wednesday May 25, 2022 @09:43PM
(#31513265)
Please do! email in bio and also I'll try to look out for the Show HN!
> I’m also currently building a distributed search engine using etcd for the service registry, broker peer announcements, and worker queue and it’s been a good experience so far.
As a random stranger on the internet, please build an abstraction layer around etcd. Even if there's only one implementation, I've found that so many distributed projects that just never reach the scale that etcd is built for would benefit from the option of writing their own drivers (you don't need a full plugin system just a regular abstraction layer).
One example is Kine[0] for k8s -- if k8s had a built in option for writing/reading from something like Postgres from the beginning it would have been a better project for it, IMO.
If you do build a plugin system though, you can pass off the work of maintaining the other implementations!
[0]: https://vadosware.io/post/paxosmon-gotta-concensus-them-all
[1]: https://github.com/k3s-io/kine