yz-yu
Show HN: Turn any OpenAPI spec into agent-callable skills
Show HN: Minimalist Glitch Art Maker (100% client-side)
How a vLLM-style inference engine works: The model part
So let me start from @jbarrow's comment: "AI written, generated from the codebase."
My actual learning process looked like this:
1. I walked through the nano-vLLM codebase, asking Claude Code some high-level questions to warm up. 2. Then I asked detailed questions one by one, let it explore, and double-checked the code myself. As someone without an ML background, it sometimes took hours to understand a single concept. 3. Once I felt I understood enough, I started drawing Excalidraw diagrams to explain what I learned.
Does this count as "generated from the codebase"? I don't think so.
Where we might disagree is the writing process.
As a non-native English speaker, my workflow looks like this:
1. Write a short paragraph (<100 words), then ask my writing agent to "fix this for readability and grammar." 2. Review the output. *If it changes any technical meaning, I correct it.* I consider this a responsible way to write a tech blog. 3. Move to the next paragraph.
Is this "AI-written"? I'd call it "AI-assisted." Every idea in every sentence is mine. Honestly, things like "em dashes" never stood out to me when reviewing. I suspect that's common for non-native speakers.
I wrote this comment the same way. The LLM fixed 14 grammar mistakes that I think would distract readers more than any LLM-ish phrasing.
That said, I'm open to suggestions on how to improve my writing process :)
That said, I need to clarify: the content was not written by AI, and certainly not generated from a database in one shot. If there's some agent + prompt that can produce what I wrote, I'd love to learn it—it would've saved me two weekends :)
Before addressing your questions further, some context: I'm a developer with no ML background but plenty of Cloud Infra experience. I'm currently building an open-source AI Infra project, which is why I studied nano-vllm. So my writing reflects some gaps in ML knowledge.
To your specific points:
> it goes into (nano)vLLM internals and doesn't mention PagedAttention once
I didn't find any explicit "paged attention" naming in nano-vllm. After reading the first article you linked—specifically the "Paged KV Caching" section—I believe the block management logic and CPU/GPU block mapping it describes is exactly what I covered in both posts. It may not be the full picture of paged attention, but I interpreted what I saw in the code and captured the core idea. I think that's a reasonable outcome.
> Part 2 will cover dense vs MoE's, which is weird because nanovllm hardcodes a dense Qwen3 into the source
This reflects my learning approach and background. Same as point 1—I may not have realized the block design was the famous PagedAttention implementation, so I didn't name it as such. For point 2, seeing a dense Qwen3 naturally made me wonder how it differs from the xx-B-A-yy-B MoE models I'd seen on Hugging Face—specifically what changes in the decoder layers. That curiosity led me to learn about MoE and write it up for others with the same questions.
---
I completely understand that in this era, people care more about whether what they're reading is AI-generated—no one wants to waste time on low-effort slop with no human involvement.
But as I explained above—and as my hand-drawn Excalidraw diagrams show (I haven't seen an LLM produce diagrams with logic that satisfies me)—this is the result of learning shaped by my own knowledge background and preferences.
Nano-vLLM: How a vLLM-style inference engine works
Show HN: Convert OpenAPI Specifications into Agent Skills
https://github.com/neutree-ai/openapi-to-skills
AI agents often need domain-specific knowledge to complete tasks. Rather than writing custom prompts or building MCP tools from scratch, leveraging existing API documentation is a practical approach - and OpenAPI is the de facto standard with battle-tested specifications maintained over years.However, feeding raw OpenAPI specs to agents has limitations. Complex specifications can exceed LLM...
Show HN: I made a tiny, playable benchmark where LLMs compete head-to-head
TL;DR: LLM Fighter is a small, open-source, playable benchmark for agentic behavior. You bring an OpenAI-compatible API; the demo runs in the browser. It creates head-to-head “battles” that stress tools, planning, and efficiency, and shows step-by-step logs you can download.What it does well: quick, honest feel for how agents act under the same rules. What it’s not: a formal academic benchmark...
Show HN: I Built a Tool to Visualize Claude Code's LLM Interactions
Show HN: Reverse Engineering Claude Code in a better way
LLM-Assisted Reverse Engineering: Decoding Claude Code in Under an Hour
Show HN: Reverse Engineering Claude Code with LLMs: Dive into the 4.6MB Cli.mjs
Minimal bolts.new implemented in <60 lines of shell for educational purposes
Show HN: Find the Best LLM for Your Needs
Show HN: Relia – Build your own LLM benchmark
Relia is an E2E testing framework for LLMs, designed to help you build AI benchmarks tailored to your specific use cases. It identifies the most suitable LLM model for your needs and ensures that model upgrades do not cause performance regressions through continuous testing. Built specifically for function calling (or "tool use") scenarios, which are at the core of agent-based AI applications.
Looking forward to your feedback.
Show HN: Dewhale – GitHub-Powered AI for effortless development
Thanks for the suggestion!
Show HN: Vx.dev – GitHub-Powered AI for effortless development
I Reverse Engineered Vercel's v0.dev Prompt and Code Optimization Logic
Show HN: V0.dev OSS Alternative, Customizable, Budget-Flexible, Live in GitHub
https://github.com/Yuyz0112/vx.dev
Hello everyone, I'm excited to share the project vx.dev with you all. Inspired by the technical insights and experiences from v0.dev, we've now managed to seamlessly integrate the experience of converting text and images into UI code with the familiar GitHub issue/PR/code-review process. Additionally, this project offers further customization of prompts and the choice of suitable AI models....