News for hackers. Stuff that matters.
Re:Orthodox Privilege by derefr on Wednesday July 15, 2020 @12:09PM (#23847265)
I would be highly interested in watching (or maybe participating) in a forum where the rule is to employ a certain kind of charity, where you must assume that everyone you're speaking to is an AI who was just booted up, who was trained to know basically all the "is" facts about things (including politics), but who literally has no "ought" beliefs about anything (including politics.) Except maybe that there "ought" to be more paperclips :P

Anyone who breaks the kayfabe by expressing a human-like "ought" belief, would have their post flagged until dead (but isn't kicked out or punished otherwise; it's too easy to do accidentally, especially if you're new, and the point is to take such people and gradually get them used to having conversations that aren't fundamentally conflicts between opposing "ought" beliefs.)

Re:Orthodox Privilege by cool_dude85 on Wednesday July 15, 2020 @12:44PM (#23847808)
Often what you describe as "is facts", especially in areas of politics, are in question. I believe that global warming is occurring, but some others do not. I suspect that anytime you get into any discussion about the issue of global warming, you will find yourself getting very quickly into "ought beliefs".

Also, it might also be very frustrating to not be able to express your "ought beliefs" about whether ethnicity X deserves to be put into concentration camps, and so on.

Re:Orthodox Privilege by whatshisface on Wednesday July 15, 2020 @01:05PM (#23848118)
Global warming isn't an "ought" belief, it's an "is" belief. "Animal species are being driven extinct" is an "is" belief. An example of an "ought" belief would be, "animal species should not be driven extinct." To further clarify, "the sunset is green" is also a (false) "is" belief.
Re:Orthodox Privilege by cool_dude85 on Wednesday July 15, 2020 @01:18PM (#23848304)
Yes, I agree.

However, when I post "Global warming is occurring" and you post "global warming is not occurring", I suspect you will not get very far into exploring your disagreement before you come to a wall, below which are only "ought beliefs". And the same for most points of political disagreement. Very few political arguments online rest on questions of fact.

Re:Orthodox Privilege by whatshisface on Wednesday July 15, 2020 @01:32PM (#23848555)
>However, when I post "Global warming is occurring" and you post "global warming is not occurring", I suspect you will not get very far into exploring your disagreement before you come to a wall, below which are only "ought beliefs".

Are you saying that people would change the subject because they prefer ought debates to is debates, or are you suggesting that trying to measure the temperature trend somehow depends on moral questions?

Re:Orthodox Privilege by cool_dude85 on Wednesday July 15, 2020 @01:46PM (#23848831)
It's just the kind of discussion that is very difficult to resolve without referring to "ought beliefs".

B: "Global warming is not real." A: "It is real. Here are peer-reviewed articles, etc. etc." B: "That research is fraudulent. There's selection bias in choosing which papers to publish, etc."

Now, A has a bit of a conundrum. He might like to say something like "Once there are 1000 published articles, studied this way and that way by so many different people, we can trust that it's actually happening", but this is an ought belief. I struggle to imagine how A can constructively respond with an "is statement."

Re:Orthodox Privilege by whatshisface on Wednesday July 15, 2020 @02:52PM (#23849888)
>"Once there are 1000 published articles, studied this way and that way by so many different people, we can trust that it's actually happening", but this is an ought belief.

You are misunderstanding what it means for something to be an "ought" belief. Your example is actually an "is" belief: it's a claim that across all cases where 1000s of published articles exist, most of the time the contents are true. The "ought" version of that would be, "you have moral duty to believe anything that enough literature has been published in support of," but that's absurd, nobody thinks that's a moral rule.

The Humean is-ought idea is specifically about distinguishing ethical problems of value from empirical problems of evaluation.

Re:Orthodox Privilege by cool_dude85 on Wednesday July 15, 2020 @04:24PM (#23851182)
Your variation, that says "most of the time the contents are true", is an is statement, but it's entirely unverifiable. Good luck providing evidence for that! And even if you did, there's a very convenient out: "It's not true in this case."

The whole thing would be short-circuited by saying "When 1000 papers agree, and almost none disagree, we should take the claims to be broadly true."

Also, see how we've gone from having a discussion about the topic at hand to impossible-to-prove factual claims about how often a group of 1,000 academic papers are true? It doesn't seem like a very interesting discussion, at least to me.

Re:Orthodox Privilege by whatshisface on Wednesday July 15, 2020 @04:52PM (#23851599)
Ought != unverifiable. That's the point. Go read the wiki page: https://en.wikipedia.org/wiki/Is%E2%80%93ought_problem
Re:Orthodox Privilege by cool_dude85 on Wednesday July 15, 2020 @05:08PM (#23851855)
Thank you for the wiki link. But I didn't say that "ought statements" are unverifiable.
Re:Orthodox Privilege by whatshisface on Wednesday July 15, 2020 @05:32PM (#23852196)
You were saying that unverifiable statements were ought statements, by arguing that because you couldn't figure out how to defend a statement, it had to be an ought statement. The truth or verifiability of a statement has nothing to do with whether or not it's an is or an ought statement.
Re:Orthodox Privilege by derefr on Wednesday July 15, 2020 @02:29PM (#23849513)
> I struggle to imagine how A can constructively respond with an "is statement."

https://www.lesswrong.com/posts/Mc6QcrsbH5NRXbCRX/dissolving...

"There's a certain probability that certain things are happening. Grouping those things together and calling that group 'global warming' has no effect on the likelihood of each of those individual things happening. Can we agree to avoid the muddled concept of 'global warming', and instead discuss the probabilities of the individual effects?"

Then, to go deeper:

"We seem to be arguing under a condition of uncertainty. We can't be sure whether the evidence does or does not prove this particular effect. Thus, since in the case where this effect was happening it'd be highly-valued by humanity to stop it (and thus high value for us AIs to understand it, if we're to predict humanity's actions), there is high value for us in evaluating both sides of the logic-path right now, rather than waiting for more definitive evidence to resolve our confusion."

"So, presuming this particular effect is proven to be happening, then what would happen to the Earth if humanity kept doing what it was doing; what would humanity have to do to return the Earth's climate to homeostasis; and would such actions have positive or negative ROI over humanity's long-term utility, given all else we know about their plans for the distant future?"

"And likewise, presuming this particular effect is proven to not be happening, then what will happen to the Earth if humanity seeks to ameliorate it anyway, under the mistaken belief that it is happening? What will the costs of that be?" (and vice-versa.)

"And, as such, if humanity itself is to act under uncertainty, then what is the expected value of each course of action, given the ROIs and the current probabilities of each outcome? And will humanity actually take that optimal-expected-value path, or will it be led elsewhere by tribal/political considerations?"

Arguments about facts under uncertainty are co-operative, you see. They're not truly "arguments" at all, but rather collaborative fact-finding missions. You don't "take a side", but rather everyone takes all sides, at the same time, and works together to find certainty from uncertainty; while also making progress in navigating beyond the veil of uncertainty, such that when an uncertainty is resolved, intellectual progress can "take the shortcut" of the contingent facts already derived in the mean-time.

Yes, most humans might agree that "global warming" exists. AIs might also "mostly agree", in the sense that they have high Bayesian confidence in some of the individual things that make up "global warming" being proven-real effects. But a true Bayesian-updating AI wouldn't think that "mostly proven" and "proven" are the same thing; they'd still want to evaluate the branch where the proof turned out to be false, unless the probability of that being true was so vanishing that it outweighed the intellectual labor-costs of exploring that branch. (And they'd value the continued participation of the other AIs in the "collaborative fact-finding process" highly-enough that even if they personally saw the probability as vanishingly-unlikely, they'd explore it anyway for the sake of another AI who thought differently. After all, these AIs are all acting under the "uncertainty" of having been exposed to different subsets of the evidence. That's why they're working as an ensemble in the first place!)

Re:Orthodox Privilege by mistermann on Wednesday July 15, 2020 @03:32PM (#23850458)
This is how the Global Warming conversation should be happening, at least in part. Instead, it seems to have become a tribal meme/disinformation war.

Here is one person who advocates some for improvements to the nature of the conversation:

"Bjorn Lomborg: False Alarm: How Climate Change Panic Costs Us Trillions And Fails To Fix The Planet"

https://www.youtube.com/watch?v=sl9rTxdSZWg

> Bjorn Lomborg is a visiting fellow at the Hoover Institution. Dr. Bjorn Lomborg is president of the Copenhagen Consensus Center and visiting professor at Copenhagen Business School. His numerous books include The Skeptical Environmentalist, Cool It, How to Spend $75 Billion to Make the World a Better Place, The Nobel Laureates’ Guide to the Smartest Targets for the World: 2016–2030, and Prioritizing Development: A Cost Benefit Analysis of the United Nation’s Sustainable Development Goals. His new book False Alarm: How Climate Change Panic Costs Us Trillions, Hurts the Poor, and Fails to Fix the Planet is forthcoming in July 2020.

Full disclosure: The Hoover Institution is a conservative think tank.

https://en.wikipedia.org/wiki/Hoover_Institution

> The Hoover Institution on War, Revolution, and Peace is an American conservative public policy think tank and research institution located at Stanford University in California. It began as a library founded in 1919 by Stanford alumnus Herbert Hoover, before he became President of the United States. The library, known as the Hoover Institution Library and Archives, houses multiple archives related to Hoover, World War I, World War II, and other world-historical events. According to the 2016 Global Go To Think Tank Index Report (Think Tanks and Civil Societies Program, University of Pennsylvania), Hoover is No. 18 (of 90) in the "Top Think Tanks in the United States".[2]

> The Hoover Institution is a unit of Stanford University[3] but has its own board of overseers.[4] It is located on the campus. Its mission statement outlines its basic tenets: representative government, private enterprise, peace, personal freedom, and the safeguards of the American system.[5] The institution is generally described as conservative.[6][7][8]; Thomas W. Gilligan, a director at the Hoover, has disputed the application of political labels to the institute, saying the institution's charter is not partisan but rather tries to remind Americans to "think twice about the dangers of the hubris of centralized solutions to civic and political challenges."[9]

Re:Orthodox Privilege by cool_dude85 on Wednesday July 15, 2020 @02:42PM (#23849731)
Sounds like a bunch of oughts to me, bud.
Re:Orthodox Privilege by andrepd on Wednesday July 15, 2020 @01:29PM (#23848487)
Truly is. But this pandemic in particular may have thrown into even further relief how some facts become political opinions.
Re:Orthodox Privilege by whatshisface on Wednesday July 15, 2020 @01:30PM (#23848526)
Political opinions can be both is and ought beliefs. The parent was not talking about distinguishing between political and non-political beliefs.
Re:Orthodox Privilege by mistermann on Wednesday July 15, 2020 @02:52PM (#23849891)
> "Animal species are being driven extinct" is an "is" belief.

This is stating a prediction of the future not as speculation, but as fact. Now it's almost certainly at least partially true (at least one species will likely become extinct in the future, at least as far as we are able to measure such things, which is often not entirely accurate), but nonetheless, it is unknown.

I'd like to see HN try some variation of @derefr's "I would be highly interested in watching (or maybe participating) in a forum where the rule is..." idea [1] on occasional appropriate HN threads, and see what happens. With the advent of the internet (and some other things), a very serious problem (of literally "existential risk" magnitude in my opinion) seems to have arisen in the sphere of human communication, both domestic and international. I do not know of all that many people or organizations who are studying this problem even in theory or with small trials, and not one single organization who is studying it in practice, with real people, at scale. I believe HN is an ideal place to do something like this, because most everyone here could easily understand the details, and why [2] we are doing it. If no one steps up to the plate and this phenomenon gets completely out of control (I'd say that happened long ago) leading to a major fundamental breakdown in society, what might be the ultimate consequences?

Obviously, going forward with some sort of initiative like this is the choice of HN & @dang, but I really wish we could have a discussion on the matter. Do few people see the potential value in this idea (speaking of Orthodox Privilege)?

With respect to:

> B: "Global warming is not real." A: "It is real. Here are peer-reviewed articles, etc. etc."

...what seems to not be apparent to many people is that there is a major but unrealized disagreement on the definition of the term "Global warming", in numerous ways. It is a very semantically overloaded [3] term.

[1] I'd approach it by group brainstorming a set of various "rules" that should be considered, and then these rules could be A/B tested in designated threads to see what happens. I can think of several ideas for rules, and I imagine others could come up with many that never crossed my mind.

[2] Just some of the many reasons are included in the LW article @derefr posted: https://www.lesswrong.com/posts/Mc6QcrsbH5NRXbCRX/dissolving...

[3] https://en.wikipedia.org/wiki/Semantic_overload

Re:Orthodox Privilege by TigeriusKirk on Wednesday July 15, 2020 @12:21PM (#23847459)
There was a time period when a principle of charity was promoted in this very forum. Perhaps it still is, but I haven't seen it mentioned in quite a while.
Re:Orthodox Privilege by lukifer on Wednesday July 15, 2020 @01:43PM (#23848764)
I do see references to the Principle of Charity occasionally, and I strongly support it. But to be meta-charitable to an anti-charity stance: doesn't a social norm of charity create an attack vector that can be exploited by dishonest actors? Alt-righters (the real ones) can use the Principle of Charity as cover, cherry-picking their talking points to just barely stay within the realm of acceptable "classical-liberal" discourse, while subtly nudging in the direction of ethnostates, distributed violence against The Other, etc.

I'm very nearly a free speech absolutist, both politically and culturally. But we have "gut checks" for a reason, and I think it's okay to sometimes make a call that someone's BSing or disingenuously grandstanding, even if their surface arguments sound reasonable (Stefan Molyneux is my canonical example here). Obviously that has to be tempered and can easily go awry (per Eric Weinstein's model of "critical feeling"), but to eschew that instinct entirely robs us of a valuable "cheater detection" mechanism.

Re:Orthodox Privilege by AnimalMuppet on Wednesday July 15, 2020 @01:57PM (#23849018)
You are correct that charity can be exploited (both the "charitable interpretation" we strive for here, and giving actual resources to people in need). More generally, kindness can be exploited. Love can be exploited.

Be charitable anyway. Be kind anyway. Love anyway.

The alternative - not being charitable, not being kind, not loving - can ruin your life. Yes, you can be exploited. But give charity, kindness, and love, if not for the other person, then for yourself. Being the kind of person who won't be kind or love is miserable.

Re:Orthodox Privilege by lukifer on Thursday July 16, 2020 @01:34PM (#23861428)
I agree with this. One of the things I've always loved about Star Trek isn't just its radical utopian economics, and sentientist egalitarianism, but the specific parable of the Kobiyashi Maru: that it is preferable to knowingly enter a fatal trap that exploits our altruism, than to risk failing to help those who are truly suffering when it is in our power to do so.

Still, I think it's better to make such choices intentionally, informed by both conscious deliberation and gut-check instincts. There are instances where one can "throw good money after bad", wasting altruistic resources to no end; or, where "tough love" is warranted, such as the case of enabling addicts and alcoholics, and the kindest act to take might be to withdraw.

Reframing back to speech issues, the current standard I'd like to see in public squares, is the "beyond a shadow of a doubt" standard that is (ostensibly) applied in our legal system. It's easy to squint at something like "The Bell Curve" and see arguments for scientific racism, and under a "preponderance of evidence" standard, perhaps it would be found guilty; but we should find the prospect of discarding potentially true ideas as abhorrent as convicting a potentially innocent citizen. Nonetheless, in private life, we are free to draw whatever conclusions we please, where we consider that OJ Simpson probably committed murder, and Charles Murray might not be an entirely unbiased analyst. (Though perhaps the very crux of the matter is the blending between public and private realms of thought. What would a quasi-Bayesian Rule of Law look like in the court of public opinion and outrage mobs?)

Re:Orthodox Privilege by derefr on Wednesday July 15, 2020 @02:10PM (#23849216)
The Principle of Charity is "designed" under an assumption of a closed or semi-closed community with the abilities to 1. kick people out of the community, and 2. absorb new people into the community slowly-enough that the new people will enculturate to the community's norms, rather than the influx of people shifting the community's norms towards its own.

The classical "community" being referred to here is academia. The Principle of Charity works within academia. It also works within trade-guilds, member's clubs, etc. Any group with both friction to get in, and the ability to exclude people for bad behavior, filters for there being almost-entirely "well-behaved towards fellow group-members" people inside the group at any given time.

The Principle of Charity can work in open-membership communities, like HN, but only for as long as the community remains a niche community with linear growth.

The Principle of Charity probably fails within society as a whole, or in open-membership forums with exponential growth, e.g. Reddit or Usenet.

And it especially fails when you have people from cultures with conflicting beliefs in the same place. Which is why "diplomacy" was invented: to create a shared "diplomatic pseudo-culture" that diplomats can be members of, such that they share norms with one-another and can communicate in a way their non-diplomat citizens cannot.

Re:Orthodox Privilege by mistermann on Wednesday July 15, 2020 @03:37PM (#23850523)
> The Principle of Charity can work in open-membership communities, like HN, but only for as long as the community remains a niche community with linear growth.

> The Principle of Charity probably fails within society as a whole, or in open-membership forums with exponential growth, e.g. Reddit or Usenet.

I disagree. It likely won't maintain itself naturally, but I see no reason why it couldn't be maintained with a more substantial enforcement/education initiative. Similarly with overall society - I agree achieving this in a widespread fashion down to the individually is likely possible, but if we could even achieve some compliance from the media, politicians, and experts, I reckon it would go a long way toward improving the current state of affairs.

>> Alt-righters (the real ones) can use the Principle of Charity as cover, cherry-picking their talking points...

Members of every tribe do this, sometimes knowingly, sometimes unknowingly. It seems to be an "unavoidable" artifact of the evolution of the human mind. But with some work, I believe this too could be dramatically improved.

Re:Orthodox Privilege by zozbot234 on Wednesday July 15, 2020 @02:15PM (#23849301)
> Alt-righters (the real ones) can use the Principle of Charity as cover, cherry-picking their talking points to just barely stay within the realm of acceptable "classical-liberal" discourse, while subtly nudging in the direction of ethnostates, distributed violence against The Other, etc.

I've actually seen people try to do this, and it never works. Imagine, if you will, a closet tankie trying to nudge "classical liberal" discourse towards praise of Stalin, Mao etc. They'll never get around to revealing their "power level" because the whole worldview is just too silly from an open and "broadly charitable" PoV. It's only a few worldviews that can hope to subvert that framework, and ironically enough authoritarian "wokeness" seems to be one of them.

Re:Orthodox Privilege by handoflixue on Thursday July 16, 2020 @02:30AM (#23856393)
Slate Star Codex was absolutely amazing for that, but is currently down.