> Shuffling keeps the letters and destroys their order, so the difference in accuracy measures what the model knows about the sequence itself.
So by analogy, if you know a word in English starts with 'Q', you could reasonably predict the next letter would be 'u'. By shuffling, you might encounter the letter Q later on, and not successfully predict a 'u'.
Put another way, the shuffled sequences can only use frequency analysis for prediction, while the unshuffled ones have local and global order signals.
For a natural sequence, the observed molecule in nature is the source of truth.
However I thought the point was that the _difference_ between the shuffled prediction and the unshuffled is the measure here. So shuffled is the baseline, and the gap above that is how good the prediction is.
But the shuffled sequences aren't real sequences!
Sorry if I'm being daft here, but I still don't understand what the source of truth is for the shuffled sequence tests.
I wish the article had stated this clearly. It seems to imply the opposite, which is of course false.