Re:LLMs and GPT: Some of my favorite learning materials
by kitsune_ on Wednesday March 29, 2023 @03:00AM
(#35353627)
A couple of months. Also, there is a world of difference between knowing the topic on a superficial level and training and evaluating a model yourself.
Re:LLMs and GPT: Some of my favorite learning materials
by macrolocal on Tuesday March 28, 2023 @06:47PM
(#35349148)
Only a month or two for the basics, if you're willing to take some stochastic calculus in the SDs for granted.
Part of what's eluded public awareness so far is that these algorithms are simple.
Re:LLMs and GPT: Some of my favorite learning materials
by greesil on Tuesday March 28, 2023 @08:37PM
(#35350347)
The algos are but the architecture isn't.
Re:LLMs and GPT: Some of my favorite learning materials
by macrolocal on Tuesday March 28, 2023 @09:54PM
(#35351090)
For example, cf. ZionEX and Pathways.
AI accelerators are important.
Re:LLMs and GPT: Some of my favorite learning materials
by swyx on Tuesday March 28, 2023 @06:41PM
(#35349070)
i mean to learn all the details it'd prob take the equivalent work of doing a phd + research fellowship or two. but i have the qualifications you cite and I'm doing the fast.ai courses to get a working knowledge of things and that seems to take 4-8 weeks depending on your pace
Re:LLMs and GPT: Some of my favorite learning materials
by rakejake on Tuesday March 28, 2023 @11:32PM
(#35352024)
Not really. These algorithms are generally quite simple and you are not coming up with them from scratch.
It might take a PhD to build the JVM, but you don't need one to understand what it does (at least most parts of it).
Would it even make sense if one's interest is not image or text generation?