AI needs so much power that old coal plants are sticking around

Re:AI needs so much power that old coal plants are sticking ... by vmfunction on Monday February 12, 2024 @06:58PM (#39352389)

From my limited understanding of this AI field, that it cost over million $ to train the model, after that the the query against the model is fast and doesn't cost a lot money. So with this AI/LLM it is more about the upfront cost, and how well the model is train using that millions dollars, and according to some data expert seems to be an art and a science [1]. Some AI experts here please correct me if I'm wrong.

1: https://www.amorphousdata.com/blog/time-series-vs-regression

[ Parent | on HN ]

Re:AI needs so much power that old coal plants are sticking ... by sureglymop on Monday February 12, 2024 @07:30PM (#39352641)

But then isn't the model out of date very quickly? It would need to be constantly retrained with current information...

[ Parent | on HN ]

Re:AI needs so much power that old coal plants are sticking ... by Legend2440 on Monday February 12, 2024 @07:43PM (#39352776)

Yes, but for now you just accept that - ChatGPT had a knowledge cutoff in 2022 until relatively recently.

[ Parent | on HN ]

Re:AI needs so much power that old coal plants are sticking ... by saurik on Monday February 12, 2024 @09:59PM (#39353771)

Just because it doesn't cost that much to use the model vs. to train the model doesn't mean it isn't still quite a bit more expensive per query than a keyword search.

[ Parent | on HN ]