News for hackers. Stuff that matters.

codenski

Ask HN: Pros and cons of switching to self-hosted inference?

Management is pushing us toward running open-weight models in-house after some compliance conversations around data privacy. Before we commit, we'd love to hear from people who've made this transition.Specifically curious about:Did it actually end up cheaper than paying for API access at your request volume? Were there any issues related to managing performance, more specifically latency,...

( Read More... | 1 comment | on HN )
Re:Linux IPC with Persistence Layer on Saturday January 25, 2025 @12:33AM (#42819751)
Thank you for your response. I am trying to stay away from a homebrew solution. There were issues with its stability, that why I’ve been looking for an alternative.

Linux IPC with Persistence Layer

Looking for a UDS like mechanisms for communication between Linux processes, where the receiver can go offline for some time and once back should be able to retrieve all the messages the sender has sent. There no need for the sender to have acknowledgement that the receiver read the message.Dear hacker community, and suggestions for libraries out there which can help with? We have implemented...

( Read More... | 2 comments | on HN )