I can relate. Extremely annoying when it happens on texts that are need to read, more acceptable when it’s leisure and I can always go back later.

It also happens when I listen to audiobooks. Sometimes I pause these or swap to music if the wandering is too bad.