News for hackers. Stuff that matters.

sherlockxu

Re:DeepSeek OCR on Sunday October 26, 2025 @09:57PM (#45716628)
Seems there’s still some confusion around what DeepSeek-OCR really does. Learn about the model, Contexts Optical Compression, and its impact on LLMs here: https://www.bentoml.com/blog/deepseek-ocr-contexts-optical-c...
Re:LLM Inference Handbook on Monday July 14, 2025 @08:26AM (#44559362)
Thanks. We just added the example.
Re:LLM Inference Handbook on Monday July 14, 2025 @08:25AM (#44559340)
Thanks. We have updated the image to make it more accurate.
Re:LLM Inference Handbook on Friday July 11, 2025 @04:00AM (#44529483)
Hi everyone. I'm one of the maintainers of this project. We're both excited and humbled to see it on Hacker News!

We created this handbook to make LLM inference concepts more accessible, especially for developers building real-world LLM applications. The goal is to pull together scattered knowledge into something clear, practical, and easy to build on.

We’re continuing to improve it, so feedback is very welcome!

GitHub repo: https://github.com/bentoml/llm-inference-in-production

Older »