News for hackers. Stuff that matters.

A comment on Are we in an AI Overhang?. Parent comment

Re:Are we in an AI Overhang? by andyljones on Monday July 27, 2020 @11:23AM (#23965954)
Training an AI in 2020 is best thought of as a capital investment. Like digging a mine or building a wind farm, the initial investment is very large but the operating costs are much lower, and in the long run you expect to get a lot more money out - a lot more value out - than you put in.

Training GPT-3 cost $5m; running it costs .04c per page of output.

[ Parent | on HN ]
Re:Are we in an AI Overhang? by ac29 on Monday July 27, 2020 @02:16PM (#23967825)
If it is scaled up by 1000x as the article proposes, does that mean it will cost $40/page of output? Or does the additional cost just go into training the model?
[ Parent | on HN ]
Re:Are we in an AI Overhang? by andyljones on Monday July 27, 2020 @05:42PM (#23969735)
If it's 100x from increased investment and 10x from short-term efficiency gains, yeah you'd expect $4/page. Model compression or some other tech might make it more efficient in the long-run.
[ Parent | on HN ]
Re:Are we in an AI Overhang? by stainforth on Monday July 27, 2020 @01:28PM (#23967294)
Once the investment is recouped and a small margin rewarded, the value should be spread equitably among society.
[ Parent | on HN ]
Re:Are we in an AI Overhang? by dragongod2718 on Tuesday July 28, 2020 @08:53AM (#23975158)
Why only a small margin?
[ Parent | on HN ]