News for hackers. Stuff that matters.
Re:Ask HN: What are you working on? (September 2026) by torsi0n on Monday September 14, 2026 @08:38AM (#49695844)
https://github.com/t0rsion/leone

Working on my local LLM runtime Leone. It has a CPU path that verifies the CUDA kernels.

Re:Ask HN: What are you working on? (September 2026) by mfog on Monday September 14, 2026 @09:40PM (#49706672)
why not just compare against a Pytorch reference instead of comparing the kernels to a separate scalar Rust implementation?

(is it for perf reasons because bottleneck becomes verification? Though in that case perhaps it's better to just run a Pytorch reference on the GPUs, which should be good enough. Though, perhaps if you could get this current design to the point where `overlap(CPU, GPU cuda) < GPU cuda + GPU reference` that would be pretty awesome.