Is that really an issue though? A website could be made less accessible to people with low powered devices, slow connections or small screens, their accessibility issues need not be medical.

Practically, there is no way to identify all the potential issues a user of your site might face.