What Is ChatGPT Doing and Why Does It Work?

Re:What Is ChatGPT Doing and Why Does It Work? by lxgr on Tuesday June 18, 2024 @03:02PM (#40720996)

Are you referring to the (one-time) training cost or the cost per inferred token? The latter is pretty acceptable these days, especially with smaller models.

[ Parent | on HN ]

Re:What Is ChatGPT Doing and Why Does It Work? by namaria on Wednesday June 19, 2024 @03:12AM (#40725674)

Small models can't do impressive language corner cases. And the benefits of the models that can scale linearly while their cost grows geometrically.

Also claiming training costs are 'one off' when there's so much resources being poured into training new and bigger models is disingenuous.

[ Parent | on HN ]

Re:What Is ChatGPT Doing and Why Does It Work? by mensetmanusman on Wednesday June 19, 2024 @09:08AM (#40727937)

The resources pouring in still pale in comparison to capital expenditures in the semi conductor industry.

[ Parent | on HN ]

Re:What Is ChatGPT Doing and Why Does It Work? by namaria on Thursday June 20, 2024 @03:25AM (#40735893)

The inflation in semi conductor capital expenditure is the problem caused by the AI hype.

[ Parent | on HN ]

Re:What Is ChatGPT Doing and Why Does It Work? by mensetmanusman on Thursday June 20, 2024 @08:50AM (#40738167)

Nah, tsmc spending tens of billion annually on capital before OpenAI.

[ Parent | on HN ]