News for hackers. Stuff that matters.
Re:Let's build GPT: from scratch, in code, spelled out by An... by mattnewton on Tuesday January 17, 2023 @10:30PM (#34423115)
I gave up and moved to lambdalabs, then they ran out of quota across the board, and now I use a combination of Vast, and Coreweave today.
Re:Let's build GPT: from scratch, in code, spelled out by An... by Centigonal on Tuesday January 17, 2023 @11:05PM (#34423315)
b-but you work for- why wouldn't they... you know what, never mind.
Re:Let's build GPT: from scratch, in code, spelled out by An... by tysam_and on Tuesday January 17, 2023 @11:47PM (#34423529)
It is sometimes far more convenient to avoid the paper trail and bureaucracy of having to provision things internally, similarly I'm sure to how renting GPUs online for short periods of time avoids the issue of having to pay for the maintenance and time costs of maintaining them onsite.
Re:Let's build GPT: from scratch, in code, spelled out by An... by mattnewton on Wednesday January 18, 2023 @02:05AM (#34424167)
Oh, I quit recently. Very surprisingly, I learned it was harder to get access to GPUs at big tech companies outside their dedicated research teams than it was for a scrappy hacker outside on side projects with lots of savings. So I quit to work on those projects. I miss not having a dedicated infra team but don’t miss having to beg for resources. I wanted to use google cloud since I use some of their other services for this, but could not figure out how to get them to increase quotas and take my money. I was willing to pay nearly double the hourly rate I am currently paying at coreweave to use only one cloud provider but they just wouldn’t sell me it
Re:Let's build GPT: from scratch, in code, spelled out by An... by vGPU on Sunday January 22, 2023 @10:33AM (#34478310)
Out of curiosity, just how much resources are you able to access with google colab and can you use it for AI training? I’ve been becoming more interested in fintech and trying my hand at predictive/pattern recognition AI but the costs are incredibly prohibitive to getting started, both hardware and data.