Re:Llama3 implemented from scratch
by pshc on Sunday May 19, 2024 @03:39PM
(#40409259)
My wild guess is that adjusting the shape before each step is not worth the speed hit. Uniform structures make GPUs go brrrrr
[ Parent
| on HN ]