News for hackers. Stuff that matters.

yz-yu

Re:Nano-vLLM: How a vLLM-style inference engine works on Monday February 02, 2026 @12:12PM (#46858409)
The comments here turned out much more interesting than I expected—this has become a great place to discuss the difference between AI-generated, AI-written, and AI-assisted content.

So let me start from @jbarrow's comment: "AI written, generated from the codebase."

My actual learning process looked like this:

1. I walked through the nano-vLLM codebase, asking Claude Code some high-level questions to warm up. 2. Then I asked detailed questions one by one, let it explore, and double-checked the code myself. As someone without an ML background, it sometimes took hours to understand a single concept. 3. Once I felt I understood enough, I started drawing Excalidraw diagrams to explain what I learned.

Does this count as "generated from the codebase"? I don't think so.

Where we might disagree is the writing process.

As a non-native English speaker, my workflow looks like this:

1. Write a short paragraph (<100 words), then ask my writing agent to "fix this for readability and grammar." 2. Review the output. *If it changes any technical meaning, I correct it.* I consider this a responsible way to write a tech blog. 3. Move to the next paragraph.

Is this "AI-written"? I'd call it "AI-assisted." Every idea in every sentence is mine. Honestly, things like "em dashes" never stood out to me when reviewing. I suspect that's common for non-native speakers.

I wrote this comment the same way. The LLM fixed 14 grammar mistakes that I think would distract readers more than any LLM-ish phrasing.

That said, I'm open to suggestions on how to improve my writing process :)

Re:Nano-vLLM: How a vLLM-style inference engine works on Monday February 02, 2026 @10:43AM (#46857253)
Since HN only allows one link per submission, dropping Part 2 here.

https://www.neutree.ai/blog/nano-vllm-part-2

Re:Nano-vLLM: How a vLLM-style inference engine works on Monday February 02, 2026 @10:40AM (#46857219)
Cool, humans hallucinate too. — AI
Re:Nano-vLLM: How a vLLM-style inference engine works on Monday February 02, 2026 @10:05AM (#46856818)
Hi jbarrow, thanks for your feedback and the links you shared—they're great readings for me (and likely others too).

That said, I need to clarify: the content was not written by AI, and certainly not generated from a database in one shot. If there's some agent + prompt that can produce what I wrote, I'd love to learn it—it would've saved me two weekends :)

Before addressing your questions further, some context: I'm a developer with no ML background but plenty of Cloud Infra experience. I'm currently building an open-source AI Infra project, which is why I studied nano-vllm. So my writing reflects some gaps in ML knowledge.

To your specific points:

> it goes into (nano)vLLM internals and doesn't mention PagedAttention once

I didn't find any explicit "paged attention" naming in nano-vllm. After reading the first article you linked—specifically the "Paged KV Caching" section—I believe the block management logic and CPU/GPU block mapping it describes is exactly what I covered in both posts. It may not be the full picture of paged attention, but I interpreted what I saw in the code and captured the core idea. I think that's a reasonable outcome.

> Part 2 will cover dense vs MoE's, which is weird because nanovllm hardcodes a dense Qwen3 into the source

This reflects my learning approach and background. Same as point 1—I may not have realized the block design was the famous PagedAttention implementation, so I didn't name it as such. For point 2, seeing a dense Qwen3 naturally made me wonder how it differs from the xx-B-A-yy-B MoE models I'd seen on Hugging Face—specifically what changes in the decoder layers. That curiosity led me to learn about MoE and write it up for others with the same questions.

---

I completely understand that in this era, people care more about whether what they're reading is AI-generated—no one wants to waste time on low-effort slop with no human involvement.

But as I explained above—and as my hand-drawn Excalidraw diagrams show (I haven't seen an LLM produce diagrams with logic that satisfies me)—this is the result of learning shaped by my own knowledge background and preferences.

Show HN: Convert OpenAPI Specifications into Agent Skills

https://github.com/neutree-ai/openapi-to-skills

AI agents often need domain-specific knowledge to complete tasks. Rather than writing custom prompts or building MCP tools from scratch, leveraging existing API documentation is a practical approach - and OpenAPI is the de facto standard with battle-tested specifications maintained over years.However, feeding raw OpenAPI specs to agents has limitations. Complex specifications can exceed LLM...

( Read More... | no comments | on HN )

Show HN: I made a tiny, playable benchmark where LLMs compete head-to-head

https://llm-fighter.com

TL;DR: LLM Fighter is a small, open-source, playable benchmark for agentic behavior. You bring an OpenAI-compatible API; the demo runs in the browser. It creates head-to-head “battles” that stress tools, planning, and efficiency, and shows step-by-step logs you can download.What it does well: quick, honest feel for how agents act under the same rules. What it’s not: a formal academic benchmark...

( Read More... | no comments | 2 points | on HN )

Show HN: Relia – Build your own LLM benchmark

https://relia.dev/

Relia is an E2E testing framework for LLMs, designed to help you build AI benchmarks tailored to your specific use cases. It identifies the most suitable LLM model for your needs and ensures that model upgrades do not cause performance regressions through continuous testing. Built specifically for function calling (or "tool use") scenarios, which are at the core of agent-based AI applications.

( Read More... | no comments | 3 points | on HN )
We released vx.dev a few days ago and received some feedback. After adopting everyone's suggestions, we rebranded vx.dev to Dewhale and gave it a simpler and more beautiful landing page.

Looking forward to your feedback.

I see...It's just published like a blog, and maybe worth a redesign as a landing page.

Thanks for the suggestion!

Since the prompt part of this project is highly inspired by Vercel's v0.dev, I chose a name that shows my respect for that product.
yes you are right, the domain is a little expensive and already sold out:)
yes, now I found the time mainly caused by: 1. openAI API call, which could not be optimized for now 2. the time to build and deploy, which can be optimized by a preset setup
~6000 tokens

Show HN: V0.dev OSS Alternative, Customizable, Budget-Flexible, Live in GitHub

https://github.com/Yuyz0112/vx.dev

Hello everyone, I'm excited to share the project vx.dev with you all. Inspired by the technical insights and experiences from v0.dev, we've now managed to seamlessly integrate the experience of converting text and images into UI code with the familiar GitHub issue/PR/code-review process. Additionally, this project offers further customization of prompts and the choice of suitable AI models....

( Read More... | 4 comments | 3 points | on HN )

Older »