News for hackers. Stuff that matters.
Re:Llama3 implemented from scratch by starik36 on Monday May 20, 2024 @01:45PM (#40418023)
> understand but don't really get

That's exactly where I am at. Despite watching Karpathy's tutorial videos, I quickly got lost. My highest level of math education is Calculus 3 which I barely passed. This probably means that I will only ever understand LLMs at a high level.

Re:Llama3 implemented from scratch by danielmarkbruce on Monday May 20, 2024 @03:33PM (#40419276)
Understanding Deep Learning is a very approachable text that will get you 80% of the way there.

Dive into Deep Learning is another.

Both have free PDF versions available.

The math isn't difficult. The notation is a little foreign, and you have to take your time reading and rereading the equations.