sherlockxu
The Chinese finance whizz whose DeepSeek AI model stunned the world
Where to Buy or Rent GPUs for LLM Inference: The 2026 GPU Procurement Guide
Re:DeepSeek OCR
on Sunday October 26, 2025 @09:57PM (#45716628)
Seems there’s still some confusion around what DeepSeek-OCR really does. Learn about the model, Contexts Optical Compression, and its impact on LLMs here: https://www.bentoml.com/blog/deepseek-ocr-contexts-optical-c...
Re:LLM Inference Handbook
on Monday July 14, 2025 @08:26AM (#44559362)
Thanks. We just added the example.
Re:LLM Inference Handbook
on Monday July 14, 2025 @08:25AM (#44559340)
Thanks. We have updated the image to make it more accurate.
Re:LLM Inference Handbook
on Friday July 11, 2025 @04:00AM (#44529483)
Hi everyone. I'm one of the maintainers of this project. We're both excited and humbled to see it on Hacker News!
We created this handbook to make LLM inference concepts more accessible, especially for developers building real-world LLM applications. The goal is to pull together scattered knowledge into something clear, practical, and easy to build on.
We’re continuing to improve it, so feedback is very welcome!
GitHub repo: https://github.com/bentoml/llm-inference-in-production