News for hackers. Stuff that matters.
Re:Building LLMs from the Ground Up: A 3-Hour Coding Workshop by ein0p on Sunday September 01, 2024 @01:36AM (#41414572)
You don’t need to write your own LLM to know how it works. And unlike, say, a browser it doesn’t really do anything even remotely impressive unless you have at least a few tens of thousands of dollars to spend on training. Source: my day job is to do precisely what I’m telling you not to bother doing, but I do have access to a large pool of GPUs. If I didn’t, I’d be doing what I suggest above.
Re:Building LLMs from the Ground Up: A 3-Hour Coding Workshop by richrichie on Sunday September 01, 2024 @02:47AM (#41414845)
Good points. For learning purpose, just understanding what a neural network is and how it works covers it all.
Re:Building LLMs from the Ground Up: A 3-Hour Coding Workshop by BaculumMeumEst on Sunday September 01, 2024 @07:06AM (#41415883)
But I mean people can always rent GPUs too. And they're getting pretty ubiquitous as we ramp up from the AI hype craze, I am just an IT monkey at the moment and even I have on-demand access to a server with something like 4x192GB GPUs at work.
Re:Building LLMs from the Ground Up: A 3-Hour Coding Workshop by ein0p on Sunday September 01, 2024 @03:16PM (#41419508)
Have you tried renting a few hundred GPUs in public clouds? Or TPUs for that matter? For weeks or months on end?