The pragmatic reason for that is that if a team spends a month and a few thousand dollars developing and tuning a system, and then they find that the first time they test it on their held-out test set it doesn't work, there is no way that they'll just drop it and accept that all their effort and funds got to waste. They'll just keep trying until their system retruns the best results on the test set. At which point they've overfitted their system to the test set.
It's rare that this is described as clearly as in the paper I quote from but I think that's because the authors of the paper are not machine learnig people. In most machine learning papers you really have to squint between the lines to be sure what's been done.
Edit: btw, this is the paper I quoted from, linked by the author upthread:
https://arxiv.org/abs/2108.00275
I should have posted my comment under theirs but I got distracted and posted it on top instead.
I know this is the done thing in machine learning and I don't hold it against the authors, I just hold it up as an example of the broken training regime that is the golden standard throughout machine learning: a test set is said to be "held out" only because it is not used to directly adjust the parameters of a model. In truth, it is not held out, because it is used to control when training has achieved its goal and the inner loop can stop adjusting the model's parameters.
In the paper, the device is nominally trained on "30 flowers" but in practice "the entire test set of 120 flowers is run through the network" between training steps. In other words, there is an "inner" learning loop performed on the "30 flowers" but this inner loop is dominated by an outer loop on another 120 flowers. At the end of each inner-outer loop pair, the system has seen all the data. Training ends only once the performance on the 120 flowers has stopped changing. Then it's asked to classify the 120 flowers again. What a surprise, it performs very well. But we have learned nothing of its ability to classify _truly_ unseen data that was not used in either its inner or outer training loop.
So from that point of view, I'm sorry to say (and with apologies to the authors who are probably monitoring this thread) but nothing new has been done. The same old bad practices have been encoded in hardware.