News for hackers. Stuff that matters.
Re:A Danish Political Party Led by an AI by cpeterso on Sunday October 16, 2022 @05:26PM (#33227335)
This reminds of “liquid democracy”: voters can delegate their votes (including fractional votes) to other people (representatives, friends, caregivers, etc), organizations, or, in this case, an AI.

https://en.m.wikipedia.org/wiki/Liquid_democracy

Science fiction author Alastair Reynold touches on different types of democracies in a couple of his novels. One example is the demarchists, cyborgs with a direct democracy where everyone votes on even minor issues using brain implants.

Another was a proportional democracy where voters who got the “right answers” in previous elections would have their future votes more heavily weighted, effectively becoming indirect representatives of other voters.

Re:A Danish Political Party Led by an AI by alexvoda on Sunday October 16, 2022 @06:35PM (#33227785)
How is the last example different from an incumbents paradise? To me it looks like a road to autocracy.

As for the demarchists, The Orville had an episode about this. There are many reasons it does not work in practice at a medium or large scale.

Re:A Danish Political Party Led by an AI by wardedVibe on Sunday October 16, 2022 @07:13PM (#33228051)
The demarchists were only several 100 people if I understood correctly, and they definitely ran into some problems. It was a very interesting rendition of a hivemind.
Re:A Danish Political Party Led by an AI by livueta on Sunday October 16, 2022 @08:03PM (#33228392)
Trying to provide some context without explicit spoilers:

> The demarchists were only several 100 people if I understood correctly

Demarchist society at/around Yellowstone was supposed to involve many millions of people, but the catch was the Glitter Band of federated space stations allowed a high degree of local control: different stations could vote themselves into being hippie communes or dictatorships or whatever, and one of the main roles of the overarching Demarchist organization (heh) was to make sure these little fiefs didn't violate the fundamental principles of the whole thing by preventing their inhabitants from voting in the broader hivemind or from leaving the station. That broader hivemind held together by largely staying out of hyperlocal concerns, focusing on the advancement of the overall system.

> they definitely ran into some problems

Yeah, though The Bad Thing that happens roughly halfway through the universe's chronology (some books set before The Event, some after) affects all the different polities and one of the more interesting aspects of the novels, at least personally, is how the different systems deal with this external shock; it's not quite that the Demarchist political system caused the event, although it did get itself into a variety of lesser scrapes.

It is a fun concept: representative democracy is indeed kind of a workaround for laggy, low-bandwidth communications. What's possible when that stops being a constraint?

Re:A Danish Political Party Led by an AI by visarga on Monday October 17, 2022 @05:06AM (#33231260)
Sometimes you need the constraint. The cells in my brain don't need to be tightly integrated with the cells in my hands, the hands don't neeed to know every little detail that happens in the brain.
Re:A Danish Political Party Led by an AI by gpderetta on Sunday October 16, 2022 @08:05PM (#33228416)
You are probably thinking of the Conjoiners (an actual hive mind although members did retain some individuality) which at some point were probably no more than a few thousand.

The Demarchists were probably the most successful offshoot of Earth and are billions across multiple solar systems. They are not an hive mind and their societies are not exactly an utopia (but not dystopian either).

Re:A Danish Political Party Led by an AI by berinateni on Sunday October 16, 2022 @09:35PM (#33228950)
> How is the last example different from an incumbents paradise? To me it looks like a road to autocracy.

That may be true if your vote is also your guess. But if they are two different things (i.e. I vote for candidate A but guess candidate B will win) I don't see an issue. In theory it simply favors a well-informed citizenry.

I would be curious if exit pollsters have ever asked this question. Ask people who they voted for, but also who they think will win. It would be interesting to see how accurate guesses are.

Re:A Danish Political Party Led by an AI by godelski on Sunday October 16, 2022 @10:40PM (#33229353)
> In theory it simply favors a well-informed citizenry.

This is a terrible "theory." No voter can be fully informed. I'm not even talking about the asymmetric information that leaders have (information from spy networks, experts, etc). Literally no single person can comprehend all these connections and complexities involved in many things. This is what representatives are supposed to resolve, but they frequently fail us. Your vote always is and always will be a guess. There may be a handful of subjects you're qualified to be an expert on, but the rest are effectively guesses. An "informed" voter is one that knows they are uninformed and doing their best.

This isn't a comment encouraging autocracy, but one against this myth of "education is the end all be all solution." We should inform people as much as possible but also be encouraging nuanced discussions. Wisdom of the crowds is powerful, but we also need to recognize the limitations.

> I would be curious if exit pollsters have ever asked this question. Ask people who they voted for, but also who they think will win. It would be interesting to see how accurate guesses are.

Absolutely not! We want to protect the secrecy of the vote. This can only encourage the degradation of that privacy. There are many ways to extract more information from votes without revealing identity. Cardinal methods, especially Score and STAR, give you a lot more information that you can use infer voter preferences. These methods also allow you to vote honestly, which defeats the entire purpose of your poll question.

Re:A Danish Political Party Led by an AI by comex on Monday October 17, 2022 @02:22AM (#33230333)
> But if they are two different things (i.e. I vote for candidate A but guess candidate B will win) I don't see an issue.

The problem is that most people are biased towards thinking their favorite candidate will win, so if it's a close election then most people will guess the same as their vote.

> I would be curious if exit pollsters have ever asked this question. Ask people who they voted for, but also who they think will win. It would be interesting to see how accurate guesses are.

Political betting markets are kind of like that. Though, with money on the line, participants have a stronger incentive to avoid bias than they would in a poll.

Re:A Danish Political Party Led by an AI by cdogl on Monday October 17, 2022 @05:07AM (#33231269)
This seems to select for people who have a balance of insight on the issues themselves and on the whims of the public - whether by data, experience or a hunch. Is that something meaningful or helpful to home in on? I’m not convinced..
Re:A Danish Political Party Led by an AI by kuramitropolis on Monday October 17, 2022 @11:36AM (#33235019)
I would argue that "the whims of the public" is the most significant political issue there is. You're basically saying this selects for people who have good theory of mind at scale; I fail to see how having more of those is a bad thing.
Re:A Danish Political Party Led by an AI by tremon on Sunday October 16, 2022 @07:09PM (#33228018)
voters who got the “right answers”

It is a fascist thing to assume that for every political question there is only one "right" answer and all the others must be wrong.

Re:A Danish Political Party Led by an AI by blueflow on Sunday October 16, 2022 @07:11PM (#33228030)
I think it was meant like, which decision had more favorable results. But this might only shift the problem to the entity to decide what is more favorable.

Aside from that, i agree with you, the "right or wrong opinion" mindset is dangerous.

Re:A Danish Political Party Led by an AI by godelski on Sunday October 16, 2022 @10:43PM (#33229365)
> I think it was meant like, which decision had more favorable results.

How does one even do this? Wait a hundred years? It's still probably impossible to determine the outcome of alternative policies. The right/wrong mindset is not only dangerous, but impossible in principle. But the autocrats won't tell you that.

Re:A Danish Political Party Led by an AI by prox on Monday October 17, 2022 @03:28AM (#33230695)
Wellness and happiness are two markers, if measured correctly/ scientifically that can be of use perhaps.
Re:A Danish Political Party Led by an AI by NL807 on Sunday October 16, 2022 @07:51PM (#33228292)
It depends on how you define "right answers". We could be talking about policy making based on objective truth, which is testable and is grounded in reality.
Re:A Danish Political Party Led by an AI by MichaelCollins on Sunday October 16, 2022 @10:42PM (#33229360)
Given an objective scientific fact, what is the appropriate policy that should be enacted concerning that fact? That depends on your values, priorities and ethical framework, none of which have objectively correct answers.
Re:A Danish Political Party Led by an AI by godelski on Sunday October 16, 2022 @10:46PM (#33229384)
> which is testable and is grounded in reality.

How? This is absolutely impossible. You can't run trials. Yes, we can analyze the effects of policies (which we should certainly be doing more of) but these results can also take decades. We can only do a singular experiment and so our sample is biased to all hell. There is no objective truth here, only results of a single experiment.

Re:A Danish Political Party Led by an AI by visarga on Monday October 17, 2022 @05:14AM (#33231312)
> How? This is absolutely impossible.

It is possible to use GPT-3 to impersonate someone. You give it a profile and it assumes the personality, then speaks from that point of view replicating its biases with uncanny ability. So what they did was to create a simulated poll using GPT-3 by aligning the model to personality profiles distributed identically to the real population.

The result? GPT-3 can predict how an idea would poll, how a population would react to a situation. So you can simulate various policies without actually having to test in reality. You can do MCMC like AlphaGO and see ten moves ahead.

It could probably be used to simulate the stock market and economy as well. Just train the model on the "digital exhaust" of companies to predict their future behaviour in aggregate.

This looks to be one of the most astounding uses of large language models. It would be of immediate interest to politicians, investors, advertisers, music and movie produces or any influencer.

It gives me heavy 'Matrix' and 'Psychohistory' vibes.

https://jack-clark.net/2022/10/11/import-ai-305-gpt3-can-sim...

https://arxiv.org/abs/2209.06899

Re:A Danish Political Party Led by an AI by someguyorother on Monday October 17, 2022 @09:16AM (#33233024)
>You can do MCMC like AlphaGO and see ten moves ahead.

The existence of adversarial attacks shows that most neural networks have pretty bad worst-case performance. Thus sticking GPT-3 into alpha-beta or MCTS could just as easily give you an ungeneralizable optimum, because optimizers are by nature intended to find extreme responses. Call it a Campbell's law for neural nets.

The actual AlphaZero nets are probably more robust because they were themselves trained by MCTS, although they still don't generalize very well out-of-sample: IIRC AlphaZero is not a very strong Fischer Random player.

Re:A Danish Political Party Led by an AI by godelski on Monday October 17, 2022 @01:13PM (#33236658)
You're entirely over estimating the capabilities of GPT and other LLMs. They aren't magic.
Re:A Danish Political Party Led by an AI by goto11 on Monday October 17, 2022 @03:16AM (#33230622)
> policy making based on objective truth

Policy making is not about truth, it is about values and priorities.

Re:A Danish Political Party Led by an AI by jcims on Monday October 17, 2022 @08:23AM (#33232554)
I would have a very difficult time coming up with an actionable policy where the objective, implementation and side-effects could all be modeled to a point where the policy in its entirety could be described as based on objective truth.
Re:A Danish Political Party Led by an AI by cpeterso on Monday October 17, 2022 @02:42PM (#33237872)
By "voters who got the 'right answers'", I meant voters whose votes most closely matched the final election results. If some voters always match the results of the group, then those voters are representative of the group psyche and could become official representatives of the group for future elections.
Re:A Danish Political Party Led by an AI by namlem on Monday October 17, 2022 @12:28AM (#33229811)
None of those seem nearly as cool as the real life vTaiwan project.

https://blog.pol.is/uber-responds-to-vtaiwans-coherent-blend...

Re:A Danish Political Party Led by an AI by prox on Monday October 17, 2022 @03:26AM (#33230683)
Found it difficult to understand, but is this like a way to reach a synthesis through a dialectic system?
Re:A Danish Political Party Led by an AI by patcon on Monday October 17, 2022 @06:51AM (#33231849)
While it's only a small part of the larger vTaiwan process, a few fans of Polis made a video to try to share what feels valuable about it: https://m.youtube.com/playlist?list=PLSL_F7Lwul2dlI9J6-Nzz9_...

Also, a paper on the vtaiwan process: https://osf.io/preprints/socarxiv/xyhft/

Re:A Danish Political Party Led by an AI by prox on Monday October 17, 2022 @08:18AM (#33232508)
Thank you, gonna check it out!
Re:A Danish Political Party Led by an AI by majou on Monday October 17, 2022 @06:42PM (#33240450)
Absurdly cool.
Re:A Danish Political Party Led by an AI by fuzzc0re on Monday October 17, 2022 @03:53AM (#33230831)
Ok I have been waiting for some time to find the right context on hackernews to shamelessly mention a democratic system that I have been working on for the last year: https://arxiv.org/pdf/2109.01436.pdf

IMO the problem with most {something} democracy systems is that they are voting paradigms that focus either only or mostly on how decisions are made but not how the options to decide upon are formed. This is true for the systems that you mentioned as well.

Moreover, the fact that decision-making and policy authoring are operations that take time leads to citizens' beliefs updating during the processes and after the fact, but with "old-school" type representative democracies there is no real-time mechanism to synchronise policy suggestions and voting outcomes with the new states of information accumulation by voters. "High-tech" democracies should take advantage of the technologies that enable fast and cheap communication but they should also have mechanisms that disincentivise the spam that inevitably follows cheap talk.

Regarding AI policy making, there are very interesting projects such as https://pol.is which address a lot of the problems that I mentioned above but, in my opinion, their output should be used as advise only. We have not yet exhausted human-centric democratic systems and neural networks are still privately-owned and privately-trained black boxes.

Re:A Danish Political Party Led by an AI by visarga on Monday October 17, 2022 @05:02AM (#33231231)
On the other hand you can test a neural network a million times, exhaustingly mapping its biases and failures. You can't do that with a human, you got to take a chance.
Re:A Danish Political Party Led by an AI by fuzzc0re on Monday October 17, 2022 @05:48AM (#33231487)
Yes you can do a million tests but the biases and failures of the neural net are chosen by human developers, a miniscule subset of citizens who themselves have some form of bias depending on their educational background, places where they grew up, family and friends etc. While you can replace a human in a powerful position with another one, since we do not know how to surgically correct individual weights in order to remove a specific decisional bias from a neural net, we can only retrain it and hope for the best. Because we are humans ourselves, we can understand the incentives of other humans and create adequate mechanisms to correct for their selfishness and their bias but what would be the incentive of an all powerful neural net? Which loss is it minimizing? And how does it know the citizens' preferences in the present and in the future? If the citizens stop feeding it (accurate) information at one point in time, will it still be the benevolent dictator that it was supposed to be?

*Edit: Another counterargument that generally applies to neural nets making decisions for human activities is the argument of accountability. While you can put on trial a bad politician for their harmful-to-society decision making, who is to blame when the neural net will inevitably spew the wrong output on an issue that it has not encountered before and a policy decision will be made based on that? Will we put the developers on trial?

Re:A Danish Political Party Led by an AI by visarga on Monday October 17, 2022 @06:27AM (#33231687)
Apparently GPT-3 has learned a large number of personality types and their fine grained biases, well enough to simulate a poll with good accuracy. This means you can poll it any time to check how a population of choice would have reacted had something happened. The language model does not carry the just biases of its builders, it learns all biases equally, you just need to specify the desired bias (personality type) when you call it. The responsibility falls with the user, builders are not to blame this time unless they didn't cover every bias equally well.

> GPT3 can simulate real people, Jack Clark

https://jack-clark.net/2022/10/11/import-ai-305-gpt3-can-sim...

Re:A Danish Political Party Led by an AI by fuzzc0re on Monday October 17, 2022 @07:04AM (#33231948)
Ok so GPT-3 can model biases well. This still doesn't solve problems such as the optimal aggregation of citizens' preferences, which is the actual optimization problem of policy making. Just to give an idea of how complex a field this is, there is a subdomain of economic theory and information theory called social choice https://en.wikipedia.org/wiki/Social_choice_theory that works with these issues and itself does not have many theories about policy formation, mostly choice between already formed policies. If a neural net finds the way to write policies that are Nash equilibrium collective decisions in all possible democracy systems then we will be close to solving the problem.
Re:A Danish Political Party Led by an AI by patcon on Monday October 17, 2022 @06:18AM (#33231634)
> you can test a neural network a million time [...] You can't do that with a human, you got to take a chance.

Funny, as a biochemist, I always took it that minds had essentially been through unfathomable numbers and levels of iteration through cultural and biological evolution cycles, and that ANNs were the untrustworthy new kids on the block :)

Re:A Danish Political Party Led by an AI by visarga on Monday October 17, 2022 @06:23AM (#33231663)
In aggregate, yes, but in particular, it's the opposite.
Re:A Danish Political Party Led by an AI by patcon on Monday October 17, 2022 @06:45AM (#33231807)
Been working with and around Polis software for a few years, and have had the chance to visit Taiwan to participate in vTaiwan for a few months. Definitely seconding it as massively interesting.

> they are voting paradigms that focus either only or mostly on how decisions are made but not how the options to decide upon are formed.

Just wanted to second your thought here, as we seem to have converged on this independently. I've been speaking similarly about the framing of Polis. Facilitative processes often require cycles of expansion of possibility and then collapse into singular options (whether the options to vote between, or the yay/nay decision). This expansion/collapse is often called the double diamond process.

For example, civil society discussion is often expansion, deliberative assembly in parliament is also ideally about expansion. Putting forward electorial candidates is expansion. Voting (electorial or parliamentary) is purely collapse. Who participates in either the expansion or collapse is a critical feature that differs in all these.

Different levels of expansion/collapse of possibility space are stitched together in our old process, often built on technology of their era, usually created to suit the era of postal mail and telegraphs (communicating electoral results) and horse-drawn carriage (attending parliamentary proceedings). In its prime, Roberts Rules of Order was a cutting-edge social technology that (coupled with other parliamentary democracy infra), allowed as many people as possible to have their views enshrined in governing law.

Most digital innovation focusses on modernizing the collapse process inherent in voting, but it is the less interesting part imho.

Polis is a tool that involves new technology that potentially unseats Roberts Rules of Order as the universal technology of deliberation (expansion). It's dimensional reduction allows for a lightweight process that accepts TONS of participation. It facilitates larger processes where people can participate more directly in issue-based expansion of the possibilities on the way to collapsing into a singular decision or compromise.

It is a deliberation-support tool (expansion), not a decision-making tool (collapse).

Hope this helps others trying to grapple with the significance of tools like Polis :)

Hit me up on Twitter if this stuff is up your alley: https://twitter.com/patcon_

EDIT: Or there's an unofficial "Polis User Group" discord server for aspiring facilitators or server hosters: http://link.g0v.network/pug

Re:A Danish Political Party Led by an AI by fuzzc0re on Monday October 17, 2022 @07:23AM (#33232080)
Thank you very much for the nice commment! I like the double diamond process idea. Informative comments like this make me come back to hackernews. I would say that the model that I have been working on is like a framework for both sides. From the few papers that exist about deliberative democracy, the idea is that with a well thought out and inclusive process of expansion on a particular subject, the collapse is essentially useless since its result will essentially confirm the outcome. Polis seems to work quite well with the plurality of opinions but IMO, for the process to be inclusive and for malevolent participants to not hijack the conversation, there needs to exist a set of incentives and disincentives that will make citizens have an honest behavior towards the system. Of course these types of conversations are what I live for so I sent you a message on Twitter :)
Re:A Danish Political Party Led by an AI by andrei_says_ on Monday October 17, 2022 @03:55AM (#33230843)
Could you mention the names of the novels?
Re:A Danish Political Party Led by an AI by komadori on Monday October 17, 2022 @05:04AM (#33231247)
Revelation Space, Redemption Ark, Absolution Gap, and Inhibitor Phase by Alastair Reynolds for the main arc.
Re:A Danish Political Party Led by an AI by cpeterso on Monday October 17, 2022 @02:38PM (#33237825)
Also "The Prefect", which takes place in the Revelation Space universe but is not connected to the other novels. The main plot in The Prefect is about applying updates to voting software. :)

https://en.wikipedia.org/wiki/The_Prefect

Re:A Danish Political Party Led by an AI by andrei_says_ on Monday October 17, 2022 @03:39PM (#33238516)
Thank you.

I discovered AR in the last couple of years and find his world building and imagination incredible.

Loved his short stories collections and House of Suns.

I started the Revelation Space novels this year.

Re:A Danish Political Party Led by an AI by ksidudwbw on Monday October 17, 2022 @02:35PM (#33237799)
Perverse incentives etc.