I don't think that's a fair assessment at all.
Scroll through their app directory and look at the comments: https://www.applevis.com/apps/latest?type=ios_app_directory
The most common rating is "The app is fully accessible with VoiceOver and is easy to navigate and use."
There has been a lot of work put into making apps and operating systems accessible. One of my friends has been using screen readers since he was a child and his ability to navigate modern OSes and apps is truly impressive.
There will always be places where where certain apps and platforms can improve, but to suggest that we "don't care" discounts all of the effort that has gone into technology accessibility over the years.
Granted, somebody ought to step up to the plate here. The govt. or third sector.-
Specifically within the Apple ecosystem, I feel like there's a lot of support for handicapped people and has been for a reasonably long time?
I think the real problem is we don't care about handicapped people.
This is where the govt should step in and fund startups building for these groups because these will never be venture scale but are really important for the world and all the people who aren't as lucky.