Now the memory being inaccurate to start with does not make manipulating that already inaccurate memory "ok". There's no question about that. Though having said that, it's important to note that because memories are so malleable and inaccurate, we've actually been manipulating them for a long time. It's actually a pretty well researched area.
I mean, this is not really new.
It is also bad to ignore the evidence that memories are unreliable with or without memory manipulation.
We can acknowledge the weakness without using it as justification.
I doubt myself, but I still see the need to make decisions. Most people, faced with my caveats, allow that they can be wrong as well, and we decide things. But the problem cases are without any doubt - my caveats only prove their correctness. If presented with convincing evidence of their fault, they move on to the next thing and never learn that 100% confidence is overconfidence.
I don't know that my lack of trust in my memories makes me more vulnerable to such people or if they only react to facing others as immovable as themselves, with everyone else being indistinguishable speed bumps.