The whole problem that this proposal is trying to eliminate is a combined problem of discrimination (for various reasons) and cargo-cult/groupthink; calling someone a 'shill' is an example of at least the first of these issues.
If the peer review process cannot successfully refute claims in a paper, and has to resort to name-calling, that is a sign that the reviewers are either incompetent or lazy (, and that there may be fundamental flaws in the peer review system).
There are.
One problem is that there are too many papers to be reviewed, another is that the papers generally do not include complete datasets. Also, where large volumes of data are involved it is common to perform computational transformations on that data to extract something; the source code and build process are not always described in such a way as to make the executable reproducible.
And those are just some of the problems with peer review, others include more human problems such as insufficient remuneration for the reviewer, reviewers who have too much at stake to give an unbiased review (whether too positive or too negative), too few reviewers with the necessary expertise, etc.
Even with competent and committed reviewers the system is flawed; unfortunately there doesn't seem to be any alternative.
I agree shills will eventually get sorted out though. The truth always wins in the end. Just not as fast as just peer review.
I think you are also tacitly describing a pessimistic view (which I share) of the reality of peer review, that it does not succeed in these lofty aims, and that publishability is influenced by a number of extraneous factors.
That's not what peer review does. Peer review isn't investigative journalism, nor is it a criminal trial, nor is it designed to figure out if the results of the study are correct or incorrect.
>"Peer review isn't... designed to figure out if the results of the study are correct or incorrect."
There is no way of verifying the correctness of most studies and papers; they are simply examined for flaws. I do not see any reason why papers by 'good' authors should be examined less critically than those by 'shills'.
The current system mostly relies on reputation and professional ethics/pride to filter out that kind of behavior even before the publication stage. The cost to replicate experiments is typically high - even in our current system we cannot replicate to the degree that we want. One presumes that in an anonymous system, the problem would get even worse.
If funding sources are also not disclosed in the paper, then the peer review process will be unable to determine bias.
The use of 'credibility' as a criteria for publication also creates large biases against novice scientists, or scientists from unusual backgrounds (scientific and otherwise). In addition, 'credible' scientists should never be given any benefit of the doubt; if someone depends on this, they are not doing good work.
[1] https://en.wikipedia.org/wiki/Fruit_of_the_poisonous_tree