And that specifically Does. Not Scale.[1]

It fails two ways:

1. Individuals suffer information overload, trust breakdown, and validation fatigue.

2. Society finds itself with no common foundation of common shared facts and mechanisms. All points of view are asserted to be equally valid, expertise is entirely dismissed. Tribal beliefs are asserted as true (for Us) and invalid (if Them).

There is, I'll posit, a broad gulf between "verify everything" and "be prepared to question any belief". One varient of the latter is "strong opinions, weakly held" (https://medium.com/@ameet/strong-opinions-weakly-held-a-fram...) I'm not fully convinced this is a valid model, but it seems a good initial approach. It addresses both the need. to act in the moment, based on. partial information, and the realisation that this information and conclusions based on it may be faulty. The problem occurs when making decisions with no recourse --- betting the farm, burning the boats.

Otherwise, I lean strongly on Baconian, Pragmatic principles: our brains, both individually and socially, are sense-making organs, optimising for practical benefit. A challenge is that subject to perception, processing, and model-generation costs, complexity and rigour, though affording greater accuracy and precision, have enormous costs.

A manifestly false assumption of rational markets (and behaviour) theory is that information is free. It's not --- it has extraordinary costs, and model formation and coordination --- getting everyone on the same page --- are among the highest. We're constantly facing a complexity cost constraint (this is the essence of Gresham's law), in which a much simpler model is, under relaxed environmental selection, often more useful, as it permits discarding expensive perception, processing, and model transmission (education of the population). Which works fine until environmental selection mechanisms are increased.

What a trust, not in authority but in expertise, has to offer, suject to sufficient checks, is an efficient distribution of information, processing, and model formation. This is the ultimate aim of Baconian Science, expressed in the motto of the Royal Society: In nullis verba --- on the word of no person. Rather, it is justified trust in experiment, experience, integrity, and institutions, that gets you this.

Mind, the usual problem is that power-serving institutions have a staggering tendency to become self-serving and select not based on truth but on self-interest. Correcting for this tendency is the great problem of polity, commercial, social, justice, and moral systems.

________________________________

Notes:

1. As I was composing this reply, another HNer in a different thread makes similar remarks: https://news.ycombinator.com/item?id=23450409

When I said "apply critical thinking to all sources", that doesn't mean "re-derive everything from scratch and give zero weight to information obtained from others". "be prepared to question any belief" is closer to what I had in mind. Beyond that, there's little harm in trusting a single source for information you are not actually heavily relying on yourself, but that wasn't really the point of this thread. Are you really trying to argue that the world would fall apart if people generally speaking put a little more critical thought into verifying information they're exposed to from a single source before giving it undue weight?

And rereading this thread, particularly your response here (https://news.ycombinator.com/item?id=23447763), that seems to me close to your argument. If not from scratch and first principles, in large part.

If not, care to restate?

It's less the obligation to validate, and more the licence to bullshit, that concerns me. Brandolini's asymmetry is steep. I've spent more time than I'd have liked around intentionally devceptive persons, and institutions (and machines). The experience is virtually always tremendously umsettling, at best.

There are reasons why social, moral, and legal strictures against deception, fraud, and betrayal of trusts run so deep, with frictions against values of free expression. Dante put bearers of false witness in the penultimate circle of his Hell.