News for hackers. Stuff that matters.

tschillaci

Show HN: Open-source verification and tuning layer for self-hosted LLMs

https://github.com/colomalabs/coloma

Hi HN,Thomas here, I'm a Machine Learning, and I've been deploying models in prod for the last 5 years and decided it was time to open-source some of my learnings!In Coloma you'll find my vLLM tuner, I use it to ensure models don't OOM at runtime, and are optimized for the metric that matters the most for that deployment: low per-user latency vs maximum system throughput. To make it easier the...

( Read More... | no comments | 2 points | on HN )
Re:Improved Gemini 2.5 Flash and Flash-Lite on Friday September 26, 2025 @04:38AM (#45384223)
Half my requests get retried because they fail, I've contributed to a ticket in June, with no fix yet.
Re:Ask HN: What are you working on? (July 2025) on Monday July 28, 2025 @05:30AM (#44708968)
I quit my job to work to create a story game powered by AI. We have a few agents that are in charge of memories, perception, and unlocking game achievements. If that sounds cool you can give it a try here: https://k58.duya.io
Re:Show HN: K-58 – a story game powered by AI on Wednesday July 23, 2025 @11:46AM (#44660538)
Thank you so much, I appreciate it! I've actually quit my job to build games!

Show HN: K-58 – a story game powered by AI

https://k58.duya.io/

I've been working on a game for the last few weeks, it's called Kettle-Station K-58 and is about talking to Alex, a space courier resting at your remote asteroid stop.The goal is to build enough trust with Alex to get him to open up about his hidden backstory.Alex is powered by a few AI agents that handle memories, intimacy, and achievements. The achievements agent analyzes the conversation...

( Read More... | 2 comments | 2 points | on HN )
This is a really exciting project! I love how it makes each message feel more valuable, like modern-day letters, but more convenient.
Re:Ask HN: What Are You Working On? (June 2025) on Monday June 30, 2025 @02:10PM (#44426230)
I've just released a little story game where the goal is to build trust with the main character to uncover his backstory. And now I'm trying to figure out how to get the word out, which I have 0 experience doing! https://k58.duya.io
Re:John Carmack at Upper Bound 2025 (slides and notes) on Friday May 23, 2025 @04:00AM (#44070855)
You will find many agents that solved (e.g., finished, reached high score) atari games, but there is still so much more work to do in the field. I wrote my Master's thesis on how to learn from few interactions with the game, so that if the algorithm is ported to actual robots they don't need to walk and fall for centuries before learning behaviors. I think there is more research to do on higher levels of generalization: when you know how to play a few video games, you quickly understand how to play a new one intuitively, and I haven't seen thorough research on that.
Re:Ask HN: What are you working on? (March 2025) on Monday March 31, 2025 @04:49AM (#43532704)
My team’s building micro AI agents that perform very specific tasks really well. Right now, we see ourselves more as a consulting firm, developing custom agents while we search for the right vertical to specialize in. Eventually, we’d love to turn that into a SaaS product. We only have demos to show yet, but I’d be happy to chat more about it :)
Re:Ask HN: What Are You Working On? (February 2025) on Monday February 24, 2025 @03:48AM (#43157199)
I quit my job last December to start an AI x AdTech startup which didn't work out: we discovered a similar piece of tech was about to get released by Google AdX. So now it's back to finding ideas, I'm sure there are niche problems that can be addressed using AI agents, one idea we have is developing an AI agent enabling content creators to better connect with their community.