News for hackers. Stuff that matters.

Ask HN: Textbook Regarding LLMs

Are there any textbooks that cover LLMs in depth? I’m looking to read papers (especially review articles) or a textbook instead of trying to piece everything together from papers or blogs or watching YouTube videos, despite there obviously being some good stuff out there.
( 7 comments | on HN )
Re:Ask HN: Textbook Regarding LLMs by mindcrime on Saturday March 23, 2024 @02:10AM (#39797838)
I haven't seen any yet. Closest thing to that that I've seen would be something like one of these:

https://www.amazon.com/Transformers-Natural-Language-Process...

https://www.amazon.com/Natural-Language-Processing-Transform...

https://www.amazon.com/Generative-Deep-Learning-Teaching-Mac...

I wish I could give you a detailed review of all of those, but sadly while I have all three, I've been too slammed with other stuff to make much progress on any of them. :-(

And while it's not a book, there's that video series by Andrej Karpathy:

https://www.youtube.com/playlist?list=PLAqhIrjkxbuWI23v9cThs...

Re:Ask HN: Textbook Regarding LLMs by kadushka on Saturday March 23, 2024 @03:53PM (#39802662)
I've read the second book (by Tunstall et al). It's excellent.
Re:Ask HN: Textbook Regarding LLMs by nborwankar on Saturday March 23, 2024 @05:23PM (#39803176)
See Large Language Models - a Survey. Minaee et al https://arxiv.org/abs/2402.06196
Re:Ask HN: Textbook Regarding LLMs by p1esk on Saturday March 23, 2024 @07:53PM (#39803906)
Thanks! Big names among authors, I’m going to read it.
Re:Ask HN: Textbook Regarding LLMs by nborwankar on Sunday March 24, 2024 @01:34AM (#39805340)
Here’s another one - it’s older but has some interesting charts and graphs.

https://arxiv.org/abs/2303.18223

Re:Ask HN: Textbook Regarding LLMs by sandwichukulele on Sunday March 24, 2024 @04:32PM (#39810222)
someone here is writing such a book in public, here's the thread with the discussion

"Implementing a ChatGPT-like LLM from scratch, step by step"

https://news.ycombinator.com/item?id=39156778

you can view the github for the book as they work on it https://github.com/rasbt/LLMs-from-scratch

Re:Ask HN: Textbook Regarding LLMs by TowerTall on Monday March 25, 2024 @09:02PM (#39823170)
I have pre-ordered this book: Build a Large Language Model (From Scratch) https://www.manning.com/books/build-a-large-language-model-f...