News for hackers. Stuff that matters.
Re:We can't all use AI. Someone has to generate the training... by LarsDu88 on Tuesday March 14, 2023 @07:04PM (#35160567)
And companies that can generate the training data at scale will be the highest value ones.

These LLMs are the shiniest thing in AI/ML right now b/c the data they use for training is already freely available and massive in scale via the internet.

There's an entire universe of data that hasn't been collected, curated, and leveraged in the right way yet: - The DNA sequences of all living things - The DNA sequences of all of humanity - The CAD files for all manufactured goods - The motion data for humans working manual jobs - The words spoken by multiple peoples across their entire lifetime

Re:We can't all use AI. Someone has to generate the training... by 0xcde4c3db on Tuesday March 14, 2023 @07:37PM (#35161146)
After playing around with Stable Diffusion for a while, I'm convinced that big media conglomerates like Disney and Warner Bros. Discovery are going to have a huge advantage here because they're in a position to pipe absolutely massive media libraries into models that are big enough to legally become "copies" of the involved works. While some of the angry rhetoric from artists whose work has been used to train models may be overblown, it's far from a stretch to suppose that companies like OpenAI and Stability AI, if they were being sloppy, could overfit to copyrighted training data to the point that the models and some outputs are infringing. I suspect they're aware of this risk. For instance, the differences in consistency and detail between a batch of SD outputs using "American Gothic painting" vs. "Dark Side of the Moon album cover" are very striking; the former is reproduced with remarkable fidelity and consistency, while the latter was clearly observed but has a much more abstract relationship to its iconic source image. I don't think that difference is accidental; I think they went to some effort to ensure that only public domain images were so firmly encoded into the model. That sort of thing is not a problem for entities that own the involved copyrights or have a such a broad license that they might as well own them (and, even failing that, are in a strong position to demand such concessions from artists going forward).
Re:We can't all use AI. Someone has to generate the training... by CuriouslyC on Tuesday March 14, 2023 @08:59PM (#35162168)
These technologies aren't really going to help big rights holders nearly as much as they're going to help small players and indies. Big rights holders already have efficient pipelines, automation and well tuned art departments. They can already crank out movies that are so effects laden as to be visually overloading non-stop. These tools might let them achieve similar or slightly better quality for less, but it's not going to fundamentally change anything. For example, if Avatar 2 VFX cost 200 million, maybe it'd come down to 20 million, but the other production costs would still be significant.

On the other hand, small indies can now do respectable VFX without resorting to CGI, needing expensive makeup/props or green screens. They could film in a field with actors in Halloween costumes, then place them in locations built using simple geometry in blender, and then AI will texture, style and light everything, modulate voices, etc. It'll be a game changer in terms of the types of films people will be able to make at the <100k price point.

Re:We can't all use AI. Someone has to generate the training... by ronsor on Tuesday March 14, 2023 @10:01PM (#35162738)
I think you're understating how much big movie companies would want to save $180 million on VFX
Re:We can't all use AI. Someone has to generate the training... by shagie on Tuesday March 14, 2023 @11:38PM (#35163518)
Disney Animator REACTS to AI Animation - https://youtu.be/xm7BwEsdVbQ

This is Aaron Blaise ( https://en.wikipedia.org/wiki/Aaron_Blaise ) reacting to the Corridor Crew AI animation video.

(please pardon the copy of the auto-transcribe)

It concludes with:

> in the entertainment industry the animation industry the expressiveness the ability to create new films and new ideas has exploded and as an end result has created actually more jobs and budgets have actually gone up if you look at the budgets now compared to what they were back in the 90s they're doubled

> ...

> it's something that people want to go to and laugh and cry and be scared and be moved and and learn something from those are the things that people are going to go and watch and um if you can do that then the technology will follow the technology will create new jobs I'll guarantee you I've seen it happen I've been I've been doing this for 35 years and I've seen it happen I've gone through it a couple of times

> so at the end of the day do I think it's a threat? No I don't think it's a threat I think it's exciting I think it's really exciting so I'm just going to sit here I'm going to sit here and continue drawing on my hand-drawn animated short snow bear and I want you to go out embrace the technology embrace the things that are new see how you can express yourselves through them put some beauty back into the world and I'll talk to you next time thanks

Re:We can't all use AI. Someone has to generate the training... by Aerroon on Wednesday March 15, 2023 @06:47AM (#35166235)
Big media conglomerates might be able to pay to create enough art for their own models. Or at least figure out some scheme to do it, where the artists freely sign away this right. That model could then be licensed to others.

A website like YouTube could probably do this for voice or sound generation, if they haven't already. Offer creators an extra 5% of ad revenue and in exchange they get to mine the video for data for AI. Or some other such benefit.

Re:We can't all use AI. Someone has to generate the training... by juujian on Tuesday March 14, 2023 @07:29PM (#35161024)
That sounds like it would be ripe for abuse. If companies get $$$ for big samples, there is an incentive to fake it. And garbage in=garbage out. Quality of AI/ML models might even degrade if the "raw material" is contaminated. Pre-GPT 3.5 data will be really valuable.
Re:We can't all use AI. Someone has to generate the training... by Teever on Tuesday March 14, 2023 @07:25PM (#35160953)
To me the end game of this all is a self replicating machine. I'm watching this whole thing with curiosity, waiting for the first image model to be trained on schematics and circuit diagrams.

I want to be able to ask an AI to give me the schematics of the machine it runs on, with instructions on how to build that machine, by hand if need be.

And then I want to ask it how to build a humanoid robot that can do the same work, and I'll build the humanoid robot and let it build the machine that the AI runs on.

I'm not sure what happens then. I think that might be the end of the economy as we know it. Or perhaps the real start of an economy, and everything that we've experience before then had just been a crude approximation of what a real economic system could be.

Re:We can't all use AI. Someone has to generate the training... by em-bee on Tuesday March 14, 2023 @07:33PM (#35161096)
the self replicating machines will optimize to become smaller and more efficient until everything turns into gray goo.
Re:We can't all use AI. Someone has to generate the training... by Teever on Tuesday March 14, 2023 @07:44PM (#35161256)
Perhaps. I'm more interested in using them to build large objects like rockets to facilitate asteroid mining and the construction of Von Neumann probes.
Re:We can't all use AI. Someone has to generate the training... by ClumsyPilot on Tuesday March 14, 2023 @09:24PM (#35162407)
Junt make sure you dont become dissasembked for construction material
Re:We can't all use AI. Someone has to generate the training... by allturtles on Tuesday March 14, 2023 @10:24PM (#35162932)
Why would they do that for you? Don't you think that intelligent machines will have their own interests?
Re:We can't all use AI. Someone has to generate the training... by Teever on Tuesday March 14, 2023 @10:37PM (#35163038)
Why do any of the machines that we make do anything?

Because we designed them that way.

Re:We can't all use AI. Someone has to generate the training... by numpad0 on Wednesday March 15, 2023 @04:21AM (#35165348)
Perhaps because it'd want to survive and to multiply...?
Re:We can't all use AI. Someone has to generate the training... by luma on Wednesday March 15, 2023 @07:21AM (#35166529)
How are you and your goals involved in that machine being able to survive and multiply? You are made of carbon which that machine might put to better use.
Re:We can't all use AI. Someone has to generate the training... by Teever on Saturday March 25, 2023 @05:30PM (#35307621)
How have you not been hit by a car yet? Cars move very fast, and are made of steel while you move very slow and are made of carbon.
Re:We can't all use AI. Someone has to generate the training... by luma on Sunday April 02, 2023 @12:27PM (#35412275)
...are you suggesting cars can make conscious decisions? If not, then what exactly is your point?
Re:We can't all use AI. Someone has to generate the training... by lofaszvanitt on Tuesday March 14, 2023 @09:46PM (#35162609)
Don't kid yourself that they will let the average joe have that ability.
Re:We can't all use AI. Someone has to generate the training... by Teever on Tuesday March 14, 2023 @10:36PM (#35163028)
I think the cat is out of the bag. Once people.know that these things can be made, they will seek to do it themselves

How do you think that 'they' will stop that?

At best they can do a holding pattern that keeps people a couple years away, but I mean like, what are they going to do, ban semi conductor fabrication?

Re:We can't all use AI. Someone has to generate the training... by lofaszvanitt on Tuesday March 14, 2023 @11:13PM (#35163316)
Imagine people making weapons for themselves and the like by using AI. It will be regulated like hell.
Re:We can't all use AI. Someone has to generate the training... by Teever on Wednesday March 15, 2023 @01:55AM (#35164434)
How do you enforce the regulations? Are you going to invade the countries that chose to regulate it differently? What if they have nukes?

If people get away with illicit cannabis operations they can get away with illicit AI operations.

Re:We can't all use AI. Someone has to generate the training... by ChatGTP on Wednesday March 15, 2023 @02:29AM (#35164636)
I’m not sure you want to find out but it probably goes something like taking your computers away from you, using government controlled AI to monitor your movements etc.

I actually can see this kind of thing happening sooner than we think, thanks to people like you…

The government will team up with corporates and they will do the “research” for us and we will be at their mercy.

People will actually be asking for this pretty soon once the general public get wind of the dangers we are facing, it’s really not hard to believe. Look at covid lockdowns and times that hysteria by 10x.

Nice dystopia…this might end a lot more like 1984 rather than some crazy wild amazing sci-fi movie.

Re:We can't all use AI. Someone has to generate the training... by zirgs on Wednesday March 15, 2023 @07:17AM (#35166494)
Restricting access to high-end semiconductors will only delay their progress a bit.

If strong AI is going to be the next nuclear weapon then no sanctions will stop other countries from developing it.

The USA could not even prevent North Korea from getting nukes. And the North Korean economy is ridiculously small.

If China, Pakistan, North Korea, Russia, Iran or India decide that development of strong AI is the key to achieve their strategic goals - what are the West going to do about it?

Re:We can't all use AI. Someone has to generate the training... by ChatGTP on Wednesday March 15, 2023 @09:46AM (#35168255)
My opinion is that of all the countries you've listed, they're much less likely to give their populace access to such systems. So I think it's less of a problem, albeit a problem.

North Korea, for example, if they developed an AGI or whatever advanced AI, aren't going to give it to their citizens to play with, it's again, 1984 there already, and it will continue that way.

Re:We can't all use AI. Someone has to generate the training... by zirgs on Wednesday March 15, 2023 @09:58AM (#35168414)
They might not give it to their citizens, but they would certainly allow their military industrial complex and spy agencies to use it.

Would be stupid to waste time arguing about AI ethics in the West while getting our political systems totally wrecked by advanced AIs of hostile nations.

Re:We can't all use AI. Someone has to generate the training... by ChatGTP on Wednesday March 15, 2023 @10:21AM (#35168710)
Why on earth would other nations be ahead of the US just because you personally can't use ChatGPT to build killer nanobots ? I don't get it?

They US government or military would just hire the best people to work behind closed doors?

Re:We can't all use AI. Someone has to generate the training... by zirgs on Wednesday March 15, 2023 @11:56AM (#35170274)
Because the AIs that their citizens could access would still be more powerful than those in the West if there's no obsession with AI ethics and crap like that over there.

Even if the best stuff is kept for the military/spies.

Re:We can't all use AI. Someone has to generate the training... by Teever on Wednesday March 15, 2023 @03:02PM (#35173142)
Again, if the government can't even stop people from growing, distributing, and selling cannabis, how are they going to do the same with AI?
Re:We can't all use AI. Someone has to generate the training... by ChatGTP on Wednesday March 15, 2023 @07:47PM (#35176273)
It would for sure be possible to restrict access to high end hardware if that’s what people wanted the government to do.

There is no NRA equivalent for graphics cards.

Re:We can't all use AI. Someone has to generate the training... by Teever on Wednesday March 15, 2023 @10:09PM (#35177320)
What if there's enough commodity hardware out there to do this and it's just a matter of algorithm optimization?
Re:We can't all use AI. Someone has to generate the training... by lofaszvanitt on Saturday March 18, 2023 @01:20AM (#35206351)
You think stasi like societal control is abolished, that it doesn't exist in the western countries in one way or another? That current tech developments is not controlled and people are being fed utter bs things like Moore's law, so they would believe it? Just look at other developing countries and watch their output and you'll immediately see that the whole thing is controlled from the top down. These developing countries' population are not 100% regulated/forced into a mold, thankfully, but they will be (hope they f up this status quo and behead those that force this onto masses).

People snitch on other people just for the kicks of it or because they can excerpt some sense of power out of it. So there is your control. What percent of the population is enough to regulate the rest, to trip someone early enough to siderail his ambitions or projects that would rearrange things for the better? 1-2%?

Plus when strange things start to appear out of nowhere, like a talking dog or people with fluffy tails, well, then you gonna have visitors.

Re:We can't all use AI. Someone has to generate the training... by pixl97 on Tuesday March 14, 2023 @10:23PM (#35162927)
And this is why we don't let people build the paperclip optimizer.

Making a machine that could do what you say above probably isn't that hard.

Making the machine that could do the above without destroying the world is impossible.

Re:We can't all use AI. Someone has to generate the training... by Teever on Tuesday March 14, 2023 @10:37PM (#35163046)
How are you going to stop me?
Re:We can't all use AI. Someone has to generate the training... by pixl97 on Wednesday March 15, 2023 @05:45PM (#35175160)
I mean, in general in the world if you live in a country with a rule of law and you said something like "Hey, I'm working on a project that's going to kill a lot of people" some nice little armed men would show up at your door and arrest you and put you in a concrete and iron cage.

But in the same sense I do agree, because that same group that controls the armed men will say to themselves "wow, we should build an AI to monitor everybody on the planet" and then we're in the same position where we've created the world eating monster, but now with even more authoritarianism.

Re:We can't all use AI. Someone has to generate the training... by LarsDu88 on Thursday March 16, 2023 @03:05AM (#35179059)
I think its good not to overthink this idea of a self-replicating machine. In the GPT-4 paper, the system was given some access to some cloud apis and was able to do things like requisition more resources from the cloud. I imagine the first stage of "self-replication" for these LLMs or their successors is going to be like ordering CPUs from Amazon rather than setting up silicon fabs. You need to get far beyond single human level intelligence and effort to start building chips and we are probably not even there yet!
Re:We can't all use AI. Someone has to generate the training... by koeng on Tuesday March 14, 2023 @09:34PM (#35162514)
What about the SRA or Genbank? Those are pretty readily collected DNA databases. You can get curation from uniprot or embl or pdb or kegg or rhea.
Re:We can't all use AI. Someone has to generate the training... by vishal0123 on Wednesday March 15, 2023 @01:22AM (#35164244)
I think the biggest value would be products tracking users, just as it currently is, like Google, Facebook etc. If assuming AI could learn from low quality data like humans could now, these companies have a huge dataset consisting of multiple GBs per living person that is available to them now including (verified) human written texts, search history, browsing history, video call logs/transcripts, translation transcripts etc.

In future company could even pay users to get access to their keyboard and mic to get the data that is verified to be human.

Re:We can't all use AI. Someone has to generate the training... by sva_ on Wednesday March 15, 2023 @08:00AM (#35166910)
This comment read like the intro to some kind of dystopian movie.