News for hackers. Stuff that matters.

A comment on What Is ChatGPT Doing and Why Does It Work?. Parent comment

Re:What Is ChatGPT Doing and Why Does It Work? by namaria on Wednesday June 19, 2024 @03:12AM (#40725674)
Small models can't do impressive language corner cases. And the benefits of the models that can scale linearly while their cost grows geometrically.

Also claiming training costs are 'one off' when there's so much resources being poured into training new and bigger models is disingenuous.

[ Parent | on HN ]
Re:What Is ChatGPT Doing and Why Does It Work? by mensetmanusman on Wednesday June 19, 2024 @09:08AM (#40727937)
The resources pouring in still pale in comparison to capital expenditures in the semi conductor industry.
[ Parent | on HN ]
Re:What Is ChatGPT Doing and Why Does It Work? by namaria on Thursday June 20, 2024 @03:25AM (#40735893)
The inflation in semi conductor capital expenditure is the problem caused by the AI hype.
[ Parent | on HN ]
Re:What Is ChatGPT Doing and Why Does It Work? by mensetmanusman on Thursday June 20, 2024 @08:50AM (#40738167)
Nah, tsmc spending tens of billion annually on capital before OpenAI.
[ Parent | on HN ]