News for hackers. Stuff that matters.

debadyutirc

Re:Ask HN: Good LLM Observability Platforms? on Monday October 27, 2025 @11:32AM (#45722132)
What entails the LLM Completion are you talking sequence of prompts with files / mcp servers. Could you share a bit more, cause I have spent some time with this and have something that might be precisely what you are asking for...
This is awesome. Love seeing more teams investing early in observability and evals instead of treating them as an afterthought.

Your setup (LLM-assessed complexity, semantic success metrics, tool-level telemetry) hits what a lot of orgs miss, tying evaluation and observability together. Most teams stop at traces and latency, but without semantic evals, you can’t really explain or improve behavior.

We’ve seen the same pattern across production agent systems: once you layer in LLM-as-judge evals, distributed tracing, and data quality signals, debugging turns from “black box” to “explainable system.” That’s when scaling becomes viable.

Would love to hear how you’re handling drift or regression detection across those metrics. With CoAgent, we’ve been exploring automated L2–L4 eval loops (semantic, behavioral, business-value levels) and it’s been eye-opening.

Re:What If We Could Rebuild Kafka from Scratch? on Monday April 28, 2025 @03:20PM (#43824966)
Fluvio is streaming transport. And we built Stateful DataFlow on top of that for Stream Processing.

Arroyo is SQL first stream processing. Fluvio is streaming transport which can send data to Arroyo and there is an integration.

Stateful DataFlow and Arroyo are similar in the stream processing pattern and the use of Apache Arrow.

The interfaces are different. Fluvio and Stateful DataFlow support for SQL is the same dialect as columnar SQL supported by Polars. The Fluvio and Stateful DataFlow paradigm is more intricate more expressive and the platform is broader and deeper.

Re:What If We Could Rebuild Kafka from Scratch? on Monday April 28, 2025 @03:06PM (#43824847)
We have had folks over the years asking us about the Kafka wire compatibility. We had a project 3 years ago which we archived. I think we have a case for reviving it in the near future.
Re:What If We Could Rebuild Kafka from Scratch? on Friday April 25, 2025 @01:40PM (#43796467)
This is a question we asked 6 years ago.

What if we wrote it in Rust. And leveraged and WASM.

We have been at it for the past 6 years. https://github.com/infinyon/fluvio

For the past 2 years we have also been building Flink using Rust and WASM. https://github.com/infinyon/stateful-dataflow-examples/

Re:38.8x lower latency with 95% less infrastructure overhead on Friday February 14, 2025 @11:36AM (#43050167)
The search on HN is weird.
Re:38.8x lower latency with 95% less infrastructure overhead on Friday February 14, 2025 @11:35AM (#43050159)
Isn't the Show HN: a different filter?
Re:Show HN: Fluvio 38.8x faster than Kafka on Wednesday February 12, 2025 @03:50PM (#43029646)
Agree with you 100%. We are working on more elaborate benchmarking on bare metal instances. This was just an initial run to utilize the benchmarking tool which is usable by all fluvio users.

We will do a full setup and benchmarks comparing Kafka, Pulsar, RedPanda using a real dataset on barmetal servers soon.

Really cool project! Look forward to trying this out. I have been using the copilot extensions with local docs toRAG augmentation. This seems to be a step up.
Re:Ask HN: How do I make Fluvio known? on Monday December 09, 2024 @06:45PM (#42371896)
That's a really good suggestion. I am trying to build some tutorial videos now. I feel the same way about listicles but they get a lot of impressions. People seem to love lists.
Re:Ask HN: How do I make Fluvio known? on Monday December 09, 2024 @12:31PM (#42368211)
Have been to a few pods. a few meetups.

Conferences has not been that great. Tried a couple.

The course option is very interesting. Have not tried something there.

Does it make sense to be part of some existing course? Or Should I create one?

Ask HN: How do I make Fluvio known?

I have been writing, creating tutorials, posting on social and there is a lot of traffic on the docs. But still people don't know about Fluvio.Surely I am missing something. How do I make fluvio known?Fluvio is a lightweight distributed streaming engine built from the ground up in Rust.Fluvio includes developer tooling to build connectors, integrations, modular data transformations, and end to...

( Read More... | 4 comments | on HN )
Isn't it interesting that plays like the thing industries cant offer beyond QoS 0? Why do you say the gap is?
LOL. AI generated the image. But as far as I understand AJ wrote the rest. But it's a dry subject. I am curious what makes you say it is an AI generated Ad?
That sounds like an interesting approach.

I am curious about the details of how you do it.

No you don't. The open source project is here. You can self host and try it easy - https://www.fluvio.io/docs/fluvio/quickstart
Written by Wade Chambers, Chief Engineering Officer @ Amplitude

Older »