News for hackers. Stuff that matters.
Re:How the FDA Could Change the Way It Approves Drugs by danieltillett on Thursday September 03, 2015 @09:47PM (#10168445)
You have just pointed out the problem with all effectiveness trials. If you used the current threshold you can still do the same thing, you just need to test more non-toxic drugs.

A better approach would be to not have any effectiveness trials at all and just collect good data on all patients using the drug. If a drug really worked it would become obvious the more patients used the drug, while if it was worthless this would also become obvious. A new drug would start out unknown with only the most desperate trying it and overtime we would learn more and more about its effects and side-effects.

This bayesian approach was not possible in the past, but with modern technology it is now. We would get better drugs with better known side-effects at far lower costs.

Re:How the FDA Could Change the Way It Approves Drugs by schoen on Friday September 04, 2015 @12:12AM (#10168774)
There's a great xkcd about the p-value interpretation issue.

https://xkcd.com/882/

So, how does the FDA deal with this issue today? Suppose the scientists wanted to market (some flavor) of jelly beans as a drug to cure acne (instead of to cause it), and they test 20 flavors and get evidence at p < 0.05 that white jelly beans cure acne. Or 1000 flavors and evidence at p < 0.001.

Does the FDA look for a causal mechanism that would make the drug effective? Or are the companies afraid to market things that they genuinely suspect are ineffective because they'll eventually get sued? Or is the FDA's effectiveness standard so strong that you just can't cost-effectively game it like this today? (The last possibility seems a little bit unlikely.)

Re:How the FDA Could Change the Way It Approves Drugs by danieltillett on Friday September 04, 2015 @01:03AM (#10168887)
This is a good question and one that is hard to know. In theory you need to have some mechanism of action, but drugs do get approved without one, or more commonly with a wrong one. Quite a few of the drugs in the psychiatric field are little more than placebos-with-bad-side-effects that got lucky.

As far as I know nobody has ever been sued over a drug that didn’t work. From a purely legal perspective you would better selling a sugar pill than a real drug that worked and caused 1 in 100,000 people to drop dead.