Re:Neural Networks: Zero to Hero
by Buttons840 on Wednesday April 05, 2023 @08:59PM
(#35462700)
True, as much as I enjoy owning and controlling my own hardware, buying an A100 and then letting it sit idle while I procrastinate and play video games probably isn't the best use of resources. He did say "my GPU" (or similar) at one point, and I thought maybe he does enough ML stuff that he bought his own.
If you have an NVIDIA gaming GPU you can train reasonable transformers.
Approximately 40 cents USD for 15 minutes from cursory research.
Re:Neural Networks: Zero to Hero
by Buttons840 on Wednesday April 05, 2023 @09:08PM
(#35462772)
I'm completely unfamiliar with this market. Do you rent these on AWS? Or where?
https://jarvislabs.ai/pricing/
$1.29 per hour for a 40gb a100 apparently
https://lambdalabs.com/service/gpu-cloud#pricing
$1.10 per hour
If you're ok with 24GB you can use a 3090 https://www.genesiscloud.com/pricing for 0.70$/h
These are available to rent per hour at much lower costs. The author mentions this in the video description.