News for hackers. Stuff that matters.
Re:Anything can be a message queue if you use it wrongly enough by binwiederhier on Sunday June 04, 2023 @04:14PM (#36189160)
A company I used to work for extensively used this method. It's incredibly useful to be able to read a config or state value from any language and even bash scripts quickly.

However, and this is a big drawback, once you have too many config files and you start reading and writing from different processes, you get into bottleneck situations quickly.

Re:Anything can be a message queue if you use it wrongly enough by moron4hire on Sunday June 04, 2023 @08:26PM (#36190882)
I haven't used this system extensively yet. But I don't really see how that situation gets improved by having a single-file configuration system.

First of all, if you have multiple processes trying to read/write the same config, that's kind of suspect, and if file I/O is a bottleneck for your config system, that's a different suspicious situation. Why are your processes writing to the config so... often?

But regardless, I can't see how those problems get immediately better by storing that config in a single file. If anything, having it split across multiple files would improve the situation, as different processes that might only be concerned with different sections of the config won't need to wait on file locks from process unrelated to their concerns.

Re:Anything can be a message queue if you use it wrongly enough by binwiederhier on Sunday June 04, 2023 @08:49PM (#36191015)
I realize it may have sounded like I was suggesting the approach. Quite the contrary: I would never do that again or suggest it. I was merely pointing out that it was quite useful at times :-) We had lots of problems similar to what you were describing. Luckily that's all in the past now.