I think a 'Delete' button which would delete the latest in order. So tapping the letters would act like typing on a keyboard, and 'Delete' would like Backspace.

NYT Spelling Bee works like this and it's a pretty similar interface.