News for hackers. Stuff that matters.

gregojaca

Re:Running Qwen3.8 at 255 tok/s on a single 5090 on Wednesday October 14, 2026 @10:25AM (#50088245)
What's the prefill speed and time to first token? Did you see any slowdown at concurrency for the prefill or decode?
Re:Running Qwen3.8 at 255 tok/s on a single 5090 on Wednesday October 14, 2026 @10:18AM (#50088160)
That's fast, thanks for the hf weights release

Show HN: Lilith-zero update: fast Rust security for agents

https://github.com/BadC-mpany/lilith-zero

We added support for claude code, vs code copilot, gh copilot cli and MCP servers You simply connect Lilith to the hooks and define your security policies.Lilith Zero is a high-performance security runtime designed to mitigate data exfiltration and unauthorized tool invocation in LLM-based agent systems. By interposing at the transport layer, Lilith Zero enforces security invariants through...

( Read More... | no comments | 2 points | on HN )
sounds interesting. Definitely the scores can be used as policy input. 2 questions: 1. Can you also assign scores to an MCP server for example? or to skills? can it be generalized? bc I see many malicious attacks being hidden in those. 2. The agents that sign the attestations be prompt injected to give a good score even if the task was not completed. Do you imagine some more deterministic test to grant the attestations? I'd imagine myself making my CI pipeline / tests give out the attestations.
Yes exactly, we focused on runtime validation for this project. But pre-connection trust is also very relevant, have you seen any projects attacking this issue? I'd be curious to see their approach.

Show HN: Lilith-zero: Ultra-fast, Rust-based security middleware for MCP

https://github.com/BadC-mpany/lilith-zero

Lilith Zero is a high-performance security runtime designed to mitigate data exfiltration and unauthorized tool invocation in LLM-based agent systems. By interposing at the transport layer, Lilith Zero enforces security invariants through deterministic policy evaluation and strictly framed execution.Lilith Zero is OS, framework, and language agnostic, providing uniform security primitives...

( Read More... | 9 comments | 2 points | on HN )