Yes and no. You're assuming that everyone has the mental and physical ability to deal with something like this. Most people are not technical enough for really really basic tech tasks. It is rare that you would find someone who is a good therapist and can write software. Even rarer that someone would actually invest the time to build you the software you could tweak.

I believe in the singularity, so I guess I meant to say AGI. Such an AI will learn to be a therapist the same way that we do. Even if it’s only as smart as a human, I would trust it more than a human.

Because, yeah, I don’t trust humans to program an AI that I could ever trust, unless the model and training data are all made fully available for independent analysis.

Tweaking the model would be telling it to favor certain paradigms over others.

If (and it's a huge if) we ever get AGI we're either 1) screwed and the machines will remeber us like we remember cave people - ie footnote in the history "books" or 2) we will have a human + machine symbiosis where the AI will literally remove all out flaws.

Either way, therapy will be useless. Also, IMHO we are at least 500 years from anything that resembles AGI - if it ever happens.