News for hackers. Stuff that matters.
Re:Nearly Half of Firms Are Drafting Policies on ChatGPT Use by wongarsu on Monday March 20, 2023 @01:30PM (#35235268)
> It's eye opening to see how much the ChatGPT produced content can fool managers at the top who catch glimpses of neatly composed and verbose documents.

Goodhart's law in action. If "neatly composed and verbose documents" is the metric higher ups use to judge product managers, then documents will become neater and more verbose to the detriment of everything else.

In the end, the alignment problems that plague AI safety research are all playing out in company structures every day. It's hard to give a metric that measures your intended outcome, and any proxy leads to unintended consequences once there's an easier way to reach that proxy.

Re:Nearly Half of Firms Are Drafting Policies on ChatGPT Use by 13years on Monday March 20, 2023 @01:42PM (#35235463)
In the end, the alignment problems that plague AI safety research are all playing out in company structures every day. It's hard to give a metric that measures your intended outcome, and any proxy leads to unintended consequences once there's an easier way to reach that proxy.

I've actually pointed this out as a fallacy of the premise of current alignment theory. That being we simply need to apply humanities values for the AI to be properly aligned. However, every alignment problem can also be seen as an existing human problem for which we have never resolved.

Re:Nearly Half of Firms Are Drafting Policies on ChatGPT Use by jacquesm on Monday March 20, 2023 @02:07PM (#35235911)
The scale is the key. Things that have impact at scale are harmless initially and then in the long run the damage becomes visible and by then we'll be as dependent on them as a heroin junk is on their fix.

Oil, plastic, electricity, natural gas, mines, wood, poultry, meat & fish, transportation etc. They're nice and super useful and when used in moderation or when there aren't that many humans to begin with you can easily absorb the consequences. But if you multiply the number of people while at the same time you increase the consumption/production on some or even all of these in tandem the effects are massively compounding.

Re:Nearly Half of Firms Are Drafting Policies on ChatGPT Use by 13years on Monday March 20, 2023 @02:37PM (#35236440)
Yes, but that is just one facet. Alignment theory affects everything regardless of scale. It is about whether or not you can reliably get the intended result given a particular goal or task.

We want AI to reason like humans and have humanities values. According alignment theory. Yet humans will also cheat to get a result. Our values also are what put us in conflict with each other.

FYI, I've elaborated in much more detail here on such issues with containment/alignment - https://dakara.substack.com/p/ai-singularity-the-hubris-trap

Re:Nearly Half of Firms Are Drafting Policies on ChatGPT Use by dTal on Monday March 20, 2023 @01:54PM (#35235696)
>the alignment problems that plague AI safety research are all playing out in company structures every day.

Yes yes yes holy crap yes.

Corporations are AI, and we are already in the AI apocalypse. Corporations exhibit emergent behavior that any individual human involved with them is powerless to stop, and they self-optimize towards inhuman goals. Coca Cola inc is a paperclip maximizer, except it maximizes the consumption of flavored sugar water. We are completely failing as a society to adequately rein them in.

Re:Nearly Half of Firms Are Drafting Policies on ChatGPT Use by jacquesm on Monday March 20, 2023 @02:04PM (#35235847)
There is this movie called Idiocracy. When I saw it the first time I thought it was hilarious. But over time I've stopped laughing and I now more or less realize that the makers may well have intended something funny but accidentally ended up making a prophesy. Or maybe the intended that from the get-go but they dressed it up as something funny for budget reasons.

It's scary how many of the things that are in that movie as caricatures you can now find IRL.

Re:Nearly Half of Firms Are Drafting Policies on ChatGPT Use by carapace on Monday March 20, 2023 @02:34PM (#35236402)
It's a horror movie.

I've tried to watch it twice and I can't get more than 20 minutes in because it's my life. I've been living in the Idiocracy since I was eight years old.

Everyone seems so slow. Their problems are trivial. They only reason they don't live well is because they just aren't interested.

- - - - -

I have high hopes that the talking computers will make good rulers...

Re:Nearly Half of Firms Are Drafting Policies on ChatGPT Use by saulpw on Monday March 20, 2023 @04:59PM (#35238610)
Mike Judge is a genius. He also did Office Space and Silicon Valley, among other things (I personally love King of the Hill). He has a sharp eye for both society and humor.
Re:Nearly Half of Firms Are Drafting Policies on ChatGPT Use by RangerScience on Monday March 20, 2023 @02:10PM (#35235965)
Fav Dune quote (it's from book 4):

> The problem isn't thinking machines, it's letting machines do the thinking for you

...and then I like to point out that many of our social structures (including corporations) are, essentially, machines. They're just machines running on meat instead of silicon.