News for hackers. Stuff that matters.

A comment on The bigger-is-better approach to AI is running out of road. Parent comment

Re:The bigger-is-better approach to AI is running out of road by quickthrower2 on Sunday June 25, 2023 @06:24AM (#36466687)
This probability thing might be a red herring. I reckon it is just that softmax/cross entropy loss is a handy tool to get words out of the NN (and now transformers)
[ Parent | on HN ]

There are no comments on this comment yet.