Re:Llama3 implemented from scratch
by danielmarkbruce on Monday May 20, 2024 @03:33PM
(#40419276)
Understanding Deep Learning is a very approachable text that will get you 80% of the way there.
Dive into Deep Learning is another.
Both have free PDF versions available.
The math isn't difficult. The notation is a little foreign, and you have to take your time reading and rereading the equations.
That's exactly where I am at. Despite watching Karpathy's tutorial videos, I quickly got lost. My highest level of math education is Calculus 3 which I barely passed. This probably means that I will only ever understand LLMs at a high level.