LLM Inference Handbook

Re:LLM Inference Handbook by qrios on Friday July 11, 2025 @08:38AM (#44531436)

Thanks for putting this together! From now on I only need one link to point interested ones to learn.

Only one suggestion: On page "OpenAI-compatible API" it would be great to have also a simple example for the pure REST call instead of the need to import the OpenAI package.

[ Parent | on HN ]

Re:LLM Inference Handbook by sherlockxu on Monday July 14, 2025 @08:26AM (#44559362)

Thanks. We just added the example.

[ Parent | on HN ]