News for hackers. Stuff that matters.

infiniteregrets

infiniteregrets on Hacker News

Re:Local, CPU-Friendly, High-Quality TTS (Text-to-Speech) with Kokoro on Tuesday July 07, 2026 @10:54PM (#48826941)
this is very cool! i also made a kokoro based tts tool which runs on a jetson orin kit. it serves tts generations over durable streams, try it out here: https://streamtts.dev/ , i also wrote about it: https://s2.dev/blog/local-ai

Show HN: KV-psi, using Linux PSI to to trim an LLM KV cache

Posted by infiniteregrets on Saturday June 27, 2026 @06:50PM
from the show-hn dept.

https://github.com/infiniteregrets/kv-psi

I thought it'd be interesting to use Linux PSI (Pressure Stall Information) for an LLM runtime to trim the KV cache. This is mainly useful imo for edge devices like the Jetson Orin super nano kit which have unified memory. I haven't benched much, but plan to do so more over time and see if I can make a real use of it as I run local LLMs. Let me know if it makes sense :P (I of course vibed this...

( Read More... | no comments | 2 points | on HN )
Re:Google Open Sources Experimental Agent Orchestration Testbed Scion on Tuesday April 07, 2026 @03:03PM (#47679854)
this is very cool! i recently hacked on something similar https://github.com/s2-streamstore/parallax

and also wrote about it https://s2.dev/blog/distributed-ai-agents

Re:Show HN: Parallax – Coordinate adversarial AI agents over durable s... on Monday March 02, 2026 @07:48PM (#47226429)
I also wrote about it here: https://s2.dev/blog/distributed-ai-agents

Show HN: Parallax – Coordinate adversarial AI agents over durable streams

Posted by infiniteregrets on Monday March 02, 2026 @06:04PM
from the show-hn dept.

https://github.com/s2-streamstore/parallax

Parallax is a CLI for orchestrating independent AI agent cohorts (Claude, Codex, etc.) over isolated, append-only logs or streams. Each cohort operates on its own log and does not see the intermediate reasoning of others i.e. disagreement is enforced at the infrastructure layer rather than prompted at runtime. Agents write to sequenced, durable logs and a separate moderator agent subscribes to...

( Read More... | 1 comment | 2 points | on HN )
Re:Pre-Record Your Demos on Thursday October 02, 2025 @07:23PM (#45456770)
It builds trust if its live

Show HN: Making AI chat sessions durable to network failures

Posted by infiniteregrets on Tuesday August 05, 2025 @06:58PM
from the show-hn dept.

https://github.com/s2-streamstore/resumable-stream

The experience with AI chat apps can be a bit fragile — there's no resilience to network failures, and responses aren't deterministic like traditional search. As Garry Tan put it (https://x.com/garrytan/status/1927038513108701662), "It feels like catastrophic data loss when a given response comes back and fails halfway, and then the next retry is not as good."Vercel recently released a...

( Read More... | no comments | 4 points | on HN )
Re:Fun with Telnet on Tuesday June 17, 2025 @07:50AM (#44298001)
indeed, we wanted to build an example for a quickstart to showcase "data in motion" and starwars seemed like a perfect fit, the OG had IP blocks in place which made it really difficult to use, so we thought of finding some OSS project that we could self-host and after a lot of searching we found "ascii-movie" (our patch: https://github.com/s2-streamstore/ascii-movie) and the end result was just as similar to towel.blinkenlights.nl -- https://s2.dev/docs/quickstart or simply telnet starwars.s2.dev 23

ps, it is running on fly.io so please don't melt the poor baby

Re:IoT project using thermal sensors to monitor spaces on Thursday March 06, 2025 @10:01PM (#43287084)
Nope! I think I did come across this, but the ecosystem around it didnt seem to be there. You can get AMG8833 for quite cheap in some places
Re:IoT project using thermal sensors to monitor spaces on Thursday March 06, 2025 @10:00PM (#43287079)
That's awesome! I love the idea of having everything self hosted, but I have various ideas like being able to share the streams on devices etc which i havent built upon. Please do share what you end up building!
Re:IoT project using thermal sensors to monitor spaces on Thursday March 06, 2025 @03:05PM (#43284553)
I would suggest against it, I feel handicapped using AI sometimes. its helpful in a lot of cases eg repetitive work, but drivers feel like you need to be very careful so I would use AI to learn concepts and write things myself! Good luck!
Re:IoT project using thermal sensors to monitor spaces on Thursday March 06, 2025 @02:51PM (#43284414)
Hi, thank you for your question!

I have been interested in this since I was in college. I was building a capacity counting system for our gym. Our gym used density.io and seemed like a waste of money and I though how about if we could have our own solution homegrown by students. But I couldn't get people on board, but I was able to prototype something.

The thermal camera is just a pixel array, which each pixel is denoting its temperature. Kitchens are tricky, since hot items can gravely affect the temperature readings. I use it at the entrance to check if my roomie is in or not/.

you have drivers for amg8833 in rust and c I believe, but adafruit stuff is good in python so I would say its a good place to start IOT projects! You can write your own drivers, which is quite fun!

Re:IoT project using thermal sensors to monitor spaces on Thursday March 06, 2025 @02:28PM (#43284184)
Hi! I am the author of this post, feel free to ask any questions about the project! I use this project at home to monitor the kitchen sometimes (:
Re:Rust: Doubling Throughput with Continuous Profiling and Optimization on Friday February 14, 2025 @09:12AM (#43048449)
(S2 dev) I think it took a bit of time to figure out what was going on as it was more of a game of enabling a feature in the sha2 crate since the profile showed us that it was using `soft` while we needed the hardware optimized. We thought being on neoverse-v1 would automatically detect to use hardware optimization, but that wasn't the case and we ended up looking at the sha2 crate closely only to figure that enabling the asm feature fixes it!
Re:Rust: Doubling Throughput with Continuous Profiling and Optimization on Friday February 14, 2025 @08:40AM (#43048131)
hi, S2 dev here. I found that if you explicitly set the algorithm for the checksum (crc32c) aws SDK would ignore the provided checksum and we were doing both. I also found a related issue https://github.com/awslabs/aws-sdk-rust/issues/1103
Re:Stopping by Woods on a Snowy Evening on Sunday December 22, 2024 @04:16PM (#42489179)
my middle school English teacher used to say the last four lines of this poem often, but I never understood why... or maybe I do now
Re:Introducing S2 on Saturday December 21, 2024 @02:33PM (#42481662)
(S2 Team member) As we move forward, a Java/Kotlin and a Python SDK are on our list. There is a Rust sdk and a CLI available (https://s2.dev/docs/quickstart) . Rust felt as a good starting point for us as our core service is also written in it.
Re:Heatmaps for popular Starbucks drinks on Tuesday March 14, 2023 @10:51AM (#35152400)
The pattern here is the popularity over the months i.e. classifying a summer/winter drink
Re:Hooking Go from Rust on Friday August 26, 2022 @04:01PM (#32612081)
> Go used to do raw system calls on macOS, and binaries were occasionally broken by kernel updates. Now Go uses libc on macOS, and binaries are forward compatible with future macOS versions just like any other C/C++/ObjC/swift program. OS X 10.10 (Yosemite) is the current minimum supported version.

also found a discussion - https://news.ycombinator.com/item?id=18439100 that points to why this might be the case

Re:Hooking Go from Rust on Friday August 26, 2022 @11:17AM (#32608625)
Hey, seems like node uses libuv and in fact we did a blogpost on it! https://metalbear.co/blog/mirrord-internals-hooking-libc-fun...

Older »