Here’s what’s crazy: by making this widely available to SMB, they will soon have enough training data to beat this benchmark —- in probably less than a year is my guess.

True! Between improving training data and figuring out how to provide better context to the LLM, there will be rapid improvement within a year

I tend to agree, but the gains will come at the expense of the early adopters. Then again, this has been the case in so many industries throughout history.

Wish they would update it with the newest models. Probably still fails but would be interesting to see the mistakes getting fewer.