News for hackers. Stuff that matters.
Re:C++ GPT-2 inference engine by version_five on Saturday July 01, 2023 @07:13PM (#36556310)
Context: https://twitter.com/a1k0n/status/1674644631156555780

"I reimplemented GPT-2 from scratch in C++ as an exercise to really understand the nuts and bolts of LLMs. GPT2-117M isn't a super great model, but it's extremely satisfying to get it to generate basically the same thing as other reference implementations."

"I" refers to the guy that wrote this, I, version_five have nothing to do with it, I just thought it looked cool.

Re:C++ GPT-2 inference engine by metiscus on Saturday July 01, 2023 @09:49PM (#36557368)
Indeed it does, thanks for posting this.