OK so just thinking about it this way made me realize it doesn't matter if the person is autistic or not, the problem is the communication breakdown, not the underlying cause of it.

Saying 'I'm sorry but I don't think we're having the same conversation, ...' and then resetting context might be all it takes. It certainly would be less horrifically offensive haha.