Re:The MTEB benchmark is dead
by upghost on Tuesday December 24, 2024 @04:45PM
(#42505161)
I would like to agree with you, but I doubt the honor system will work here. We are talking about companies that have blatantly trampled (or are willing to risk a judicial confrontation about trampling) copyright. It would be unreasonable to assume they would not engage in the same behavior about benchmarks and test sets, especially with the amount of money on the line for the winners.
[ Parent
| on HN ]
There are no comments on this comment yet.