I'm sorry, I didn't notice until you clarified that you suffer from actual memory issues; I assumed you were just using hyperbole as a rhetorical device. With the context clear, I see why you would want to refer to those tools as prostheses, given that they lift you to (and hopefully above) the "normal" values. And as you say, they indeed perform both augmentative and assistive functions.
On the other hand, you're right that most people don't have that intuition and that "prosthesis" may not be effective communication. This particular issue disadvantages me compared to other humans and solutions to it help me recover basic functionality, but you're right that this technology is good enough that a run-of-the-mill human can benefit from it too. They just don't benefit as much as I do. So, hm, maybe I should switch to augmentative language over assistive. I'll think about it.