News for hackers. Stuff that matters.

ayushnangia16

Show HN: Coding agents find the right GPU bottleneck 70% of the time, fix it 30%

https://ayushnangia.github.io/iso-bench-website/

One of the authors. Some things that surprised us while running these experiments:The tasks are pulled from real merged PRs in vLLM and SGLang, so there's a known-good human solution for each one. Agents get the full codebase, the issue description, and a test harness. Pretty generous setup.What we didn't expect: the agents are genuinely good at diagnosing the problem. They read the code, find...

( Read More... | 1 comment | 2 points | on HN )

Show HN: DistilKitPlus, a distillation framework between any LLMs

https://github.com/agokrani/distillKitPlus

Over the past few months, I have built a distillation toolkit that supports cross-tokenizer distillation (e.g., distilling from LLaMA to Qwen vocab, or others). This approach has worked well on reasoning datasets like AIME, and we’ve validated on models like Phi and Qwen.We’ve also integrated Modal for quick deployment (with $30/month credits to try it out).Would love any feedback!GitHub:...

( Read More... | 4 comments | 2 points | on HN )