Show HN: Tiny-vLLM – high performance LLM inference engine in C++ and CUDA

Re:Show HN: Tiny-vLLM – high performance LLM inference engin... by sylware on Saturday May 30, 2026 @05:49AM (#48334472)

I am looking at a plain and simple C implemented LLM inference, and/or x86_64 assembly implemented, and/or AMD GPU RDNA assembly.

Anybody?

[ Parent | on HN ]

Re:Show HN: Tiny-vLLM – high performance LLM inference engin... by irishcoffee on Saturday May 30, 2026 @09:10AM (#48335775)

I heard once that c++ can become assembly at some point if you type the right things in. :)

[ Parent | on HN ]

Re:Show HN: Tiny-vLLM – high performance LLM inference engin... by sylware on Sunday May 31, 2026 @07:23AM (#48344855)

Well, the whole purpose is to be independent of invisible backdoor injectors...^W I mean compiler, to be more accurate those compilers which deals with computer languages with an absurd and grotesque syntax complexity.

[ Parent | on HN ]