Definitely agree that our understanding is only really beginning in these kinds of areas though ultimately you are often going to be treating a disorder of subjective experience with these drugs. That makes it very hard for us not to be wishy-washy these days
Until we're able to analytically evaluate perception (which we are no where close to understanding), what you're describing isn't possible
Maybe if you only consider the chemicals that are normally considered.
Blood work, including blood neurotransmitters and hormones, can tell you a lot about someone's state of mind specifically because of this.
Your "need to be able to say" can have no effective equivalent placebo, and any conclusion you drew from such a case study would be unpublishable and invalid.
This is not to say that I think modern science is correct in this, but it does already recognises the flaws in what you suggest - recording accurate data is not necessarily an existing major problem of science. You can easily record all that data yourself (if you have the resources/cash/time to arrange it), which will probably work out great for you, but it won't prove anything more generally.
The Moneyball revolution in sports has taken over front offices, scouting departments, and stats geeks. But not the holiest of holies, the world of player development. Keeping a player on the court for a few extra minutes per game could result in a huge gain for the team. Keeping Lebron James or Troy Tulowitzki healthy could literally be worth $20 million or more to the team. Yet they pay nothing on that side of the game and do not look for new avenues or approaches.
It is insanity. But it is also professional sports, so, it is what it is. Eventually, there will be a revolution. I only hope it's within the next 20 years.
Some day we'll look back on our methods of prescribing and follow-up with the same horrified face we make when we look at Civil War amputations.
We already look back at the early 20th century futurism's optimism as comical, but if we manage to hold our civilization together for another century or more I suspect we'll look back at today's faith in the practical power of data science as equally naive.
"The exact mechanism of X is unknown, however..."
It's kind of frightening.
(two off the top of my head: http://www.drugs.com/pro/klonopin.html & http://www.drugs.com/pro/prozac-capsules.html)
This is why I am working on a line of medication whose only effect is to make people tell doctors that they feel much better now. It's showing great promise in early trials.
If the patient still feels bad and the data shows no serotonin change, then the doctor can conclude that maybe serotonin is still the problem, but Zoloft isn't the right drug to fix it (or the dosage was wrong).
In other words, more data = better ability to get a real answer.
I'm really looking forward to the day when technology can more directly measure the effects of various substances on the body, rather than the inexact observation methods used today.
Take SSRIs, for example. Here's how it works. Patient tells doctor "I feel depressed". Doctor prescribes medicine. (A few weeks or months go by.) Doctor asks, "Well, how do you feel?"
We need to be able to say: "Over the course of your treatment, you ingested X milligrams of Zoloft, with an average concentration of Y in your bloodstream. Here's the 1-month graph. Your avg levels of serotonin were Z% higher than usual during this time. Your cortisol (stress hormone) level was C% lower. You slept an average of S hours per night, with E% improvement in deep sleep efficiency." etc.
At some point, the former is going to sound quaint and old-timey.