News for hackers. Stuff that matters.
Re:Deep Learning’s Diminishing Returns – Cost of improvement... by rictic on Friday June 16, 2023 @04:49PM (#36363638)
A disappointing analysis. It discusses cost in isolation from revenue, and raises environmental impacts without mentioning that the major cloud computing providers where the largest models are trained and run are carbon neutral.

Better results for general purpose tasks are likely to find willing buyers at prices orders of magnitude higher than even the largest language models of today. In most cases, the best alternative is human labor, and for more latency-sensitive cases, there is no alternative to a language model available at any price.

Re:Deep Learning’s Diminishing Returns – Cost of improvement... by _Algernon_ on Friday June 16, 2023 @05:15PM (#36364000)
"Carbon neutrality" is shameless greenwashing while carbon credits in large part remain a scam.

https://en.wikipedia.org/wiki/Carbon_offsets_and_credits#Con...

Re:Deep Learning’s Diminishing Returns – Cost of improvement... by wokkel on Friday June 16, 2023 @05:12PM (#36363953)
Regarding carbon neutrality: yeah, by using their enourmous capital/pricing power to buy all green power relegating the rest of the country to either use greenwashed grey power or outright grey power. So learning is green, it's just the rest that is poluting....
Re:Deep Learning’s Diminishing Returns – Cost of improvement... by hn_thrwn on Friday June 16, 2023 @08:11PM (#36365702)
Carbon neutral is the indulgence of our age. And about as effective.