For me it is helpful to think of it as a disability in the social model of disability. I wear glasses too and it's interesting to compare these two things.

Having poor vision doesn't negatively affect me much because I can easily access effective accommodations for it. ADHD can be the same, and is not mostly because of my lack of power & rights in respect to choices my employers make.