News for hackers. Stuff that matters.
Re:Scalable MatMul-Free Language Modeling by throwaway71271 on Sunday June 09, 2024 @07:00AM (#40623601)
the github link in the paper: https://github.com/ridgerchu/matmulfreellm

it is super easy to try it out, the 2.7B, 1.3B, 0.37B models are on huggingface, and the generate.py example just works if you have triton 2.2 installed

There are no comments on this comment yet.