News for hackers. Stuff that matters.
Re:C++ GPT-2 inference engine by eugenhotaj on Saturday July 01, 2023 @10:33PM (#36557615)
This is pretty cool. I had the same idea but in zig: https://github.com/EugenHotaj/zig_gpt2

Not fully finished yet, haven't gotten around to implementing bpe encoding/decoding and only some ops use BLAS.

There are no comments on this comment yet.