News for hackers. Stuff that matters.
Re:$2 H100s: How the GPU Rental Bubble Burst by elcomet on Friday October 11, 2024 @04:32AM (#41807505)
Not everyone is doing LLM training. I know plenty of startups selling AI products for various image tasks (agriculture, satellite, medical...)
Re:$2 H100s: How the GPU Rental Bubble Burst by mark_l_watson on Friday October 11, 2024 @09:10AM (#41809166)
Yes, a lot of the money to be made is in the middleware and application sides of development. I find even small models like Llama 3.2 2B to be extremely useful and fine tuning and integration with existing businesses can have a large potential payoff for smaller investments.