News for hackers. Stuff that matters.

A comment on BloombergGPT.

Re:BloombergGPT by imranq on Friday March 31, 2023 @09:45PM (#35396196)
For all the hype, the benchmarks they report don't seem super compelling. Financial questions need to have 100% accurate responses (not 60% or so they report) otherwise they are worse than useless and can cost billions of dollars in losses
[ Parent | on HN ]
Re:BloombergGPT by throwaway50601 on Saturday April 01, 2023 @04:00AM (#35398229)
Isn't it enough to win 51% times?
[ Parent | on HN ]
Re:BloombergGPT by turingfeel on Saturday April 01, 2023 @05:23AM (#35398686)
It’s not trading anything, in which case the above still wouldn’t be true. It’s just answering financial questions, so if it hallucinates and tells you Tesla isn’t a public company 40% of the time then what’s the point? I’m using a very simple example here, I’m sure the model makes more intricate mistakes.
[ Parent | on HN ]