News for hackers. Stuff that matters.
Re:Microsoft lays off an ethical AI team as it doubles down ... by dragonwriter on Tuesday March 14, 2023 @04:04AM (#35148552)
> AI alignment people are the group who are capable of bringing AGI to life, but want to do it responsibly.

AI alignment people are the group who believe “responsibly” means, centrally, bringing AGI to existence as fast as possible, and, critically, under the tight, opaque, authoritarian control of a narrow group of people whose ideology is, well, exemplified by figures like Sam Bankman-Fried, and doing everything possible to advance that goal, including fostering broad acceptance of sub-AGI AI under the same tight control for other purposes without concern for adverse social impact as a means of advancing and funding progress toward AGI. They believe that the ends (AGI) inherently justifies any means taken in its pursuit.

AI ethics people are the group who believes “responsibly”, withe regard to AI, isn’t restricted to pursuit of AGI (which is maybe a nice to have, but a non-essential goal), and means openness, transparency, and resolving bias and harm issues as rapidly as possible when, and ideally before, adopting AI – including AI far short of AGI – in roles with social impact (and most critically, resolving those for roles with the greatest social impact.) They believe that AI is, to the extent it at any level is desirable, is a means to improving concrete, present, immediate conditions, not an ends to be pursued in itself.

Re:Microsoft lays off an ethical AI team as it doubles down ... by circuit10 on Tuesday March 14, 2023 @05:15AM (#35148962)
> AI alignment people are the group who believe “responsibly” means, centrally, bringing AGI to existence as fast as possible

From what I’ve seen it’s the exact opposite? They want AI development to slow down so we can get it right and make it safe. There are people who are trying to speed it up but that seems like the opposite of alignment to me

Re:Microsoft lays off an ethical AI team as it doubles down ... by dragonwriter on Tuesday March 14, 2023 @05:44AM (#35149174)
> From what I’ve seen it’s the exact opposite? They want AI development to slow down so we can get it right and make it safe.

The only way that the alignment faction wants to slow things down is in that they want to maintain tight control of models and gated access to assure “proper” use. This does have an effect of slowing certain kinds of development, as broader access to build around models without centralized controls fosters some aspects of development (the “Stable Diffusion moment”) but in ideal terms, the alignment faction is about fast-but-narrowly-controlled development.

The ethics faction is more about slowing things down – though more about adoption, particularly in sensitive uses, than development – but is more oriented toward openness/transparency.

Re:Microsoft lays off an ethical AI team as it doubles down ... by contextfree on Tuesday March 14, 2023 @08:51AM (#35150648)
There's no single "alignment faction" in terms of these questions. There are people associated with the alignment research program who do advocate slowing things down, e.g., https://worldspiritsockpuppet.substack.com/p/lets-think-abou... . There are a variety of other different positions, e.g., OpenAI, Anthropic, and MIRI have all taken different public stances on this
Re:Microsoft lays off an ethical AI team as it doubles down ... by skinner_ on Tuesday March 14, 2023 @06:54PM (#35160395)
https://aisafety.world/tiles/ lists dozens of institutions. Each hold different positions on AI development, but almost none of them hold the position that you ascribe to their "faction", maybe with the exception of OpenAI.
Re:Microsoft lays off an ethical AI team as it doubles down ... by ben_w on Tuesday March 14, 2023 @07:17AM (#35149758)
Sam Bankman-Fried is a uniquely terrible example of ideology, given St. Petersburg: https://conversationswithtyler.com/episodes/sam-bankman-frie... and https://astralcodexten.substack.com/p/open-thread-250

(and, y'know, being a fraudster who temporarily pulled the wool over the eyes of the regulators not just the charities he promised money to)

Also: is SBF really the central example of alignment in your head, and not, say Yudkowsky? Because Yudkowsky is my central example, and he's the exact opposite on all counts, wanting us to go slow and explicitly saying that humans are terrible at reasoning properly when they allow themselves to think "ends justify the means": https://www.lesswrong.com/posts/K9ZaZXDnL3SEmYZqB/ends-don-t...

Likewise, there are plenty of examples of misaligned non-general AI, and have been since at least the 80s when it was GOFAI and databanks rather than neutral nets that led to new legislation: https://www.legislation.gov.uk/ukpga/1984/35/enacted

Re:Microsoft lays off an ethical AI team as it doubles down ... by polygamous_bat on Tuesday March 14, 2023 @09:20AM (#35150986)
> Also: is SBF really the central example of alignment in your head, and not, say Yudkowsky? Because Yudkowsky is my central example, and he's the exact opposite on all counts.

For normal people who don't spend six hours every day on lesswrong, they were literally in the same camp up until about six months ago (when all the "rationalists" violently disclaimed SBF after being funded by him for a few good years.)

Re:Microsoft lays off an ethical AI team as it doubles down ... by ben_w on Tuesday March 14, 2023 @11:43AM (#35153358)
Bearing in mind that I don't spend 6 hours a day on lesswrong (or even per month, not even if I include podcasts tangentially inspired by it), and I hadn't even heard of SBF until his crypto-thingie did what I expect every crypto-thingie to do, that caricature you're painting is going to be one of those ones that need a lot of labels on everything.
Re:Microsoft lays off an ethical AI team as it doubles down ... by dragonwriter on Tuesday March 14, 2023 @10:42AM (#35152290)
> Also: is SBF really the central example of alignment in your head,

No, he's a particularly well-known example of the broader ideology to which virtually all of tbe alignment camp subscribes, and which centers their desires for AI.

Re:Microsoft lays off an ethical AI team as it doubles down ... by hughesjj on Tuesday March 14, 2023 @11:01PM (#35163228)
IMHO, the world would be better off without the Paypal Mafia and all their ilk.
Re:Microsoft lays off an ethical AI team as it doubles down ... by yanderekko on Tuesday March 14, 2023 @10:32AM (#35152145)
>AI alignment people are the group who believe “responsibly” means, centrally, bringing AGI to existence as fast as possible, and, critically, under the tight, opaque, authoritarian control of a narrow group of people

Hey, let's be fair now, a lot of them also believe that we just need a world government that tightly controls GPU use.

Sarcasm aside, the alignment crowd definitely does not have a consensus about the desirability about creating AGI asap. Yudkowsky is clearly horrified by OpenAI.