Jay Kreps is an extremely well read man; the reference is surely ironic. Enterprise middleware, after all, is and always has been a bureaucratic rigmarole.

The nightmare has existed since the first ETL job was written, but by democratizing pub/sub access throughout companies, we can't help but be horrified by what we see going on in the dataplane. Apache Kafka, rather than creating this nightmare, brings light to it, just as Franz Kafka's literature brought light to the absurdity of life under evil bureaucracies.

Now he can't quite say this outright lest he offend some set of his customers who have to live in this reality, so we have that vague quote about "he's one of my favorite writers", but surely we can take a direct literary reference as a wink and a nod and read between the lines?