News for hackers. Stuff that matters.
Re:US Senator Uses ChatGPT for Opening Remarks at a Hearing ... by seydor on Tuesday May 16, 2023 @01:50PM (#35965318)
He already made the first step to his replacement.
Re:US Senator Uses ChatGPT for Opening Remarks at a Hearing ... by clnq on Tuesday May 16, 2023 @02:36PM (#35965837)
How is using an effective tool the first step to one's replacement? I would argue that rejecting the tools available to one is a bigger step in that direction.
Re:US Senator Uses ChatGPT for Opening Remarks at a Hearing ... by hammyhavoc on Tuesday May 16, 2023 @02:10PM (#35965555)
Unlike human beings, LLMs have no explicit world model, they're an LLM. Why would a politician be replaced by an LLM? It seems like a highly inappropriate use.
Re:US Senator Uses ChatGPT for Opening Remarks at a Hearing ... by patrickas on Tuesday May 16, 2023 @02:37PM (#35965842)
LLMs do have explicit world models that can be even manipulated. There are many recent papers on the subject.
Re:US Senator Uses ChatGPT for Opening Remarks at a Hearing ... by hammyhavoc on Tuesday May 16, 2023 @02:39PM (#35965883)
ChatGPT itself tells me it has no explicit world model.
Re:US Senator Uses ChatGPT for Opening Remarks at a Hearing ... by NumberWangMan on Tuesday May 16, 2023 @02:51PM (#35966026)
I mean, just like you can create 1-line python script that claims "I am an AGI" and have that fact be false, you can have ChatGPT tell you it has no explicit world model, while exhibiting behaviors that can only really be explained by it having some sort of model of the world inside it.

Fine-tuning is like a PR agent teaching someone what sorts of things not to mention on TV even though they may be true.

Re:US Senator Uses ChatGPT for Opening Remarks at a Hearing ... by hammyhavoc on Tuesday May 16, 2023 @03:02PM (#35966176)
What are some of these behaviours?
Re:US Senator Uses ChatGPT for Opening Remarks at a Hearing ... by NumberWangMan on Tuesday May 16, 2023 @04:40PM (#35967461)
Patrickas responded with some examples: https://news.ycombinator.com/item?id=35966307
Re:US Senator Uses ChatGPT for Opening Remarks at a Hearing ... by patrickas on Tuesday May 16, 2023 @03:13PM (#35966307)
It is not about what the model tells you.

This paper shows an emergent world model in an LLM that was taught to play otello moves https://ar5iv.labs.arxiv.org/html/2210.13382

https://arxiv.org/pdf/2303.12712.pdf This paper discusses (among other things) how a GPT4 model navigated between rooms in a text adventure game and was able to create a map afterward. Literally building a model of the world as it was navigating and drawing a map of that afterwards

Re:US Senator Uses ChatGPT for Opening Remarks at a Hearing ... by seydor on Tuesday May 16, 2023 @02:25PM (#35965708)
Neural networks are great at optimizing when the objectives are agreed upon and well known, and will not abuse power for their own gain (that is one objective).

Why would you want humans instead?

Re:US Senator Uses ChatGPT for Opening Remarks at a Hearing ... by InitialLastName on Tuesday May 16, 2023 @02:40PM (#35965894)
> when the objectives are agreed upon and well known,

The above is inherently not a feature of the problems that political systems are intended to solve.

Re:US Senator Uses ChatGPT for Opening Remarks at a Hearing ... by seydor on Tuesday May 16, 2023 @03:58PM (#35966945)
what are political systems trying to solve?
Re:US Senator Uses ChatGPT for Opening Remarks at a Hearing ... by InitialLastName on Tuesday May 16, 2023 @04:02PM (#35967007)
If the solution to a problem is obvious and agreed upon by everyone, you don't need political mechanisms to make a decision.

Politics is best-suited to issues of resource contention and coordination that aren't distillable to a clear set of goals that everyone agrees on.

Re:US Senator Uses ChatGPT for Opening Remarks at a Hearing ... by seydor on Tuesday May 16, 2023 @06:19PM (#35968539)
We can agree on mechanisms to accept or reject solutions, which is basically what representatives do. An AI can be a representative, subject to election like humans do. There is nothing inherently superior about flesh and blood. A political AI will be more measurable, more transparent and probably a lot more intelligent
Re:US Senator Uses ChatGPT for Opening Remarks at a Hearing ... by hammyhavoc on Tuesday May 16, 2023 @07:05PM (#35968939)
Why would it be more transparent if the data isn't human-readable and only the output is? Thus you can never know how it may have been interfered with, whereas politicians leave a paper trail.

A hypothetical AGI could well be more intelligent, but an LLM lacks all the qualities required to be a politician of any description.

Re:US Senator Uses ChatGPT for Opening Remarks at a Hearing ... by seydor on Wednesday May 17, 2023 @01:34PM (#35978633)
maybe i live in a different universe but very little is transparent about elected politicians, while we can always demand model to provide measures of its performance to guarantee that it is optimizing and not degrading
Re:US Senator Uses ChatGPT for Opening Remarks at a Hearing ... by hammyhavoc on Tuesday May 16, 2023 @02:28PM (#35965744)
Because human beings understand the way the world works, but an LLM only deals in language, whereas societies, economies et al are incredibly complex and nuanced, and also not defined by language.

Whilst a hypothetical application of a neural network politically may not abuse power for its own gain, that doesn't preclude it from making uninformed decisions, just like being a human being doesn't preclude someone from making poor decisions.

How would constituents hold a neural network accountable?

All kinds of shitty things could be done "because the neural net says so", and that lack of accountability is in and of itself a fundamental problem, especially the lack of human-readable data set as it is stored as tokens, it's only the output that is human-readable, so we wouldn't even be able to tell in what ways it had been manipulated. The ultimate patsy and scapegoat for real human beings to take advantage of.

Re:US Senator Uses ChatGPT for Opening Remarks at a Hearing ... by AnimalMuppet on Tuesday May 16, 2023 @02:20PM (#35965653)
Hmm. If you trained an LLM on all the feedback a Senator receives from constituents, that could be pretty effective.

Of course, once word gets out that that's what's going on, it will turn into a contest of which side of an issue can spam the Senator's office harder...

Re:US Senator Uses ChatGPT for Opening Remarks at a Hearing ... by hammyhavoc on Tuesday May 16, 2023 @02:25PM (#35965712)
Why would it be effective? If it only deals in language, but not an understanding of human issues, economies et al, it would be ineffective and inappropriate.

> it will turn into a contest of which side of an issue can spam the Senator's office harder

An LLM wouldn't even be required for analysing sentiment and recurring topics, this is how a lot of brands have handled millions of inbound tweets all these years.

To imply that a senator is just the political equivalent of a customer service agent is disingenuous when they themselves draft and propose legislation et al, and that legislation hopefully comes from a nuanced understanding of what it is that they're targeting, which an LLM wouldn't have.

Re:US Senator Uses ChatGPT for Opening Remarks at a Hearing ... by AnimalMuppet on Tuesday May 16, 2023 @03:21PM (#35966427)
I don't want an LLM writing legislation. That way lies disaster. (And that disaster is uncomfortably likely to happen within 10 years...)

But I'm cynical enough to think that training an LLM on constituents' comments, and then having it write a senator's speeches, could be effective. The speeches would lack specifics, but the tone would echo the constituents' concerns. That might be good enough to get re-elected. (As I said, I'm cynical. It shows up in me thinking that fine-sounding speeches are likely enough to get a senator re-elected.)

Re:US Senator Uses ChatGPT for Opening Remarks at a Hearing ... by s3p on Tuesday May 16, 2023 @02:22PM (#35965676)
I'm not sure this answers OP's question.