News for hackers. Stuff that matters.
Re:Building LLMs from the Ground Up: A 3-Hour Coding Workshop by ckok on Sunday September 01, 2024 @01:02AM (#41414424)
This has been said about pretty much every subject. Writing your own Browsers, compilers, cryptography, etc. But at least for me even if nothing comes of it just knowing how it really works, What steps are involved are part of using things properly. Some people are perfectly happy using a black box, but without kowning how its made, how do we know the limits? How will the next generation of llms happen if nobody can get excited about the internal workings?
Re:Building LLMs from the Ground Up: A 3-Hour Coding Workshop by ein0p on Sunday September 01, 2024 @01:36AM (#41414572)
You don’t need to write your own LLM to know how it works. And unlike, say, a browser it doesn’t really do anything even remotely impressive unless you have at least a few tens of thousands of dollars to spend on training. Source: my day job is to do precisely what I’m telling you not to bother doing, but I do have access to a large pool of GPUs. If I didn’t, I’d be doing what I suggest above.
Re:Building LLMs from the Ground Up: A 3-Hour Coding Workshop by richrichie on Sunday September 01, 2024 @02:47AM (#41414845)
Good points. For learning purpose, just understanding what a neural network is and how it works covers it all.
Re:Building LLMs from the Ground Up: A 3-Hour Coding Workshop by BaculumMeumEst on Sunday September 01, 2024 @07:06AM (#41415883)
But I mean people can always rent GPUs too. And they're getting pretty ubiquitous as we ramp up from the AI hype craze, I am just an IT monkey at the moment and even I have on-demand access to a server with something like 4x192GB GPUs at work.
Re:Building LLMs from the Ground Up: A 3-Hour Coding Workshop by ein0p on Sunday September 01, 2024 @03:16PM (#41419508)
Have you tried renting a few hundred GPUs in public clouds? Or TPUs for that matter? For weeks or months on end?