I don't see how Kafka means less worries about deployment
For event streaming, a shout out for redis's streams data type. A lot like Kafka for a lot less administrative overhead. Works in cluster mode, too.
Re:Connect: A Better gRPC
by thinkharderdev on Thursday June 02, 2022 @06:23AM
(#31593258)
gRPC streaming is too complicated so you should ... deploy Kafka?
Re:Connect: A Better gRPC
by discreteevent on Thursday June 02, 2022 @07:32AM
(#31593639)
I think the principle of using messaging is valid. You could just use a simple reliable MQTT broker.
gRPC is overkill for pretty much everything I do, but I like Protocol Buffers[0] for serialisation/deserialisation of big objects to disk.
[0] FlatBuffers would probably work well too, though I haven't used it
If you want code gen, just edit OAS specs with Stoplight’s OpenAPI editor, and generate clients/servers with OpenAPI generator. If you really need event streaming between services, just use something like Google PubSub, webhooks, Kafka, whatever - external systems are better for this than direct server to server comms because they’re more reliable, far less worries about deployment, etc.
RPC seems simple at first but always balloons into excess complexity. Just stick with REST, and sprinkle in a PubSub system if absolutely necessary, it’ll stay simpler that way.