News for hackers. Stuff that matters.
Re:Why Open Source AI Will Win by sillysaurusx on Thursday September 21, 2023 @10:03PM (#37607014)
I was served with papers yesterday from the Silverman folks. No idea what they could possibly want, since books3 is open source. https://twitter.com/theshawwn/status/1704559992135717238?s=4...

I think we’re witnessing the death of open source AI. The logical outcome of this is that only large companies will be able to acquire and use the training data necessary to compete with ChatGPT.

So anyone who thinks otherwise will have to answer the question: how are we going to make any datasets?

It’s tempting to think that we can pull together data out of non copyrighted work. But there isn’t enough data. That would mean the model has no knowledge about any books.

Re:Why Open Source AI Will Win by ozr on Thursday September 21, 2023 @10:56PM (#37607323)
Reminds me of when the RIAA and MPAA were able to end piracy. Dark days.
Re:Why Open Source AI Will Win by fallat on Thursday September 21, 2023 @11:34PM (#37607524)
They were? how
Re:Why Open Source AI Will Win by jazzyjackson on Thursday September 21, 2023 @11:37PM (#37607548)
Definitely a joke, but also maybe not a joke. Enough pressure was put on pirates through ISPs threatening to drop customers (or was it to sue them?) that streaming services saw greater adoption. People are risk averse when it comes to lawsuits from publishers I suppose.

So you can still pirate, but most people don't. Maybe LLMs will be the same, sure you could use an uncensored/unlicensed model that doesn't pay royalties to publishers, but why risk it?

Re:Why Open Source AI Will Win by brucethemoose2 on Thursday September 21, 2023 @11:49PM (#37607611)
It's not quite the same... maybe even reversed. Big companies can "secretly" use private datasets with copyrighted or legally questionable data with a wink and a nod, without anyone being able to prove it in court.

Open source models generally do not have that option. Maybe there are some exceptions like Meta using some private data in future Llamas, but I question how sustainable those efforts are.

Re:Why Open Source AI Will Win by csomar on Friday September 22, 2023 @12:36AM (#37607923)
Streaming services got higher adoption because the price/trouble cost was worth it. People saw value in putting $7/month into a service that delivers high quality video.

This might not last with the fragmentation of streaming services (I don't think people are ready to pay $10x10 for access to all services).

Re:Why Open Source AI Will Win by ghaff on Friday September 22, 2023 @06:42AM (#37610342)
Part of the trouble side though is taking the proper precautions to not trigger a strike from your ISP or a letter from RIAA. And a lot of people didn’t/don’t understand what those precautions are. Don’t know the size of the effect but there was probably some.
Re:Why Open Source AI Will Win by somenameforme on Friday September 22, 2023 @12:53AM (#37608015)
As peer comments mentioned, that's completely missing the order of causation. Steam is a better example, because there was never any weird organization threatening everybody they could send a letter to with lawsuits. Yet it grew exponentially.

I think, in general, there are relatively few completely ideological 'pirates.' People will buy things when they can easily afford it, and it's easy to do so. When it's too expensive, not locally available, or when the payment methods involve hassles, they will simply download it instead.

Re:Why Open Source AI Will Win by 29athrowaway on Friday September 22, 2023 @12:58AM (#37608055)
Most piracy is P2P and requires some "computer literacy" to use.

Most streaming, AFAIK, is not P2P. Streaming gives you instant access to the content, and streaming clients are often simpler to use, with features such as recommender systems, etc.

Re:Why Open Source AI Will Win by jazzyjackson on Thursday September 21, 2023 @11:41PM (#37607575)
It will take an act of congress or the supreme court to decide the matter one way or another. But copyright is not universal law.

Japan, for one, has thrown the fight - they stand to gain more by harboring new technology than ensuring royalties are paid to publishers of the last century.

https://web.archive.org/web/20230607091817/https://technoman...

discussion: https://news.ycombinator.com/item?id=36144241

Re:Why Open Source AI Will Win by thelittleone on Friday September 22, 2023 @04:49AM (#37609593)
Since the government in many ways views citizens as threats to their conntrol / power, the last thing they want is that population armed with a powerful AI.
Re:Why Open Source AI Will Win by thisiswater on Friday September 22, 2023 @05:32AM (#37609863)
I agree - LLMs are a massive threat to the current state of government power.

"<LLM>, analyze the contents of this 500 page bill. Who stands to gain from this bill, and what outcomes is it likely to have for the general public? Is this bill in line with good faith evidence-based policymaking for the good of the population and the planet? What existing legal mechanisms could be used to fight the special-interest aspects of this bill?"

Re:Why Open Source AI Will Win by pavlov on Friday September 22, 2023 @06:09AM (#37610121)
Is there really a shortage of this kind of analysis today?

Using those legal mechanisms requires money and often public support. The LLM can’t conjure either.

The world is already full of smart people and good ideas about policy. The reason they’re not getting implemented probably has little to do with things that AI can solve today. For starters, a lot of voters actively dislike policy suggestions from experts and choose politicians who proudly go against expert opinion. Giving AI tools to the experts won’t change that.

Re:Why Open Source AI Will Win by thisiswater on Friday September 22, 2023 @11:28PM (#37620369)
I think the difference is that instead of deferring to an expert's opinion, you can interact with a knowledge machine which can explore the topic in and on your terms, answer your questions about it, respond to your points and concerns about those responses, etc.

It's a fundamentally different kind of knowledge generation than reading an expert opinion - it's branching, self-directed, and responsive.

Re:Why Open Source AI Will Win by aussiegreenie on Sunday September 24, 2023 @06:11PM (#37637663)
This excatly the kind of work Universities love.

I personally know three different group trying to excatly that.

Re:Why Open Source AI Will Win by tetris11 on Friday September 22, 2023 @06:28AM (#37610254)
Are they?

"<More Powerful/Popular State/Corpo-owned LLM>: it's pretty hard to fight this, just trust we've got got your back. Remember, we're currently handling that other case for you. Would be a shame to lose you as a client."

Re:Why Open Source AI Will Win by thisiswater on Friday September 22, 2023 @03:57PM (#37616967)
Exactly. I want an unaligned LLM to give me X potential solutions ranging in ethicality from "don't worry about it, they might be nice people" to "steal a nuke and ransom the world", and let me as an aligned human craft my prompt or chain of reasoning to weed out the useless or unethical responses, and then I can decide what is useful and suitable.

This is more or less the process that goes on inside a thinking human, is it not? I don't want to outsource ethical decision making, I want to outsource cognitive effort. By analogy, you don't rely on a bulldozer to decide not to bulldoze a populated nursing home - that's on the user, as are the consequences.

Current power structures demonstrably cannot be trusted to limit themselves to ethical solutions (Military Industrial Complex, Climate Change, etc etc etc pick your poison) - why should they be trusted to censor cognitive tools?

Re:Why Open Source AI Will Win by tmpX7dMeXU on Friday September 22, 2023 @08:24PM (#37619485)
This is incredibly naive. “If only the people were EDUCATED!” No, we are far beyond that.
Re:Why Open Source AI Will Win by mach1ne on Friday September 22, 2023 @06:01AM (#37610075)
Oh, but this is interesting. If some countries stand to gain more by declaring copyrighted works "fair use" for training generative models, then other countries can either fall in line or risk falling back in technological development.

It's a race to the bottom in favor of open source.

Re:Why Open Source AI Will Win by lithiumii on Thursday September 21, 2023 @11:57PM (#37607655)
How about stay anonymous and just violate all the copyright laws? There's already pirate bay, libgen, sci-hub, zlibrary, etc., surely it's possible for there to be an opensource & pirate LLM model.
Re:Why Open Source AI Will Win by CamperBob2 on Friday September 22, 2023 @02:06AM (#37608444)
If it were practical to mirror sci-hub and libgen, that would be one thing, but despite a lot of talk online I have yet to see a practical way to put my hands on such a thing.
Re:Why Open Source AI Will Win by vlabakje90 on Friday September 22, 2023 @03:27AM (#37608985)
I'm not sure what you are referring to with 'such a thing', but mirroring libgen and zlib is really not hard. Libgen offers Torrent links as does Anna's Archive. The libgen domains are fragile, but here's a link to the Anna's Archive torrents: https://annas-archive.org/torrents. They even have a page talking about training LLMs on this data: https://annas-archive.org/llm
Re:Why Open Source AI Will Win by roel_v on Friday September 22, 2023 @05:00AM (#37609674)
Do any of these methods actually work though? Last time I looked (admittedly, 6 months or so ago), there were 0 seeders on the torrents.
Re:Why Open Source AI Will Win by CamperBob2 on Friday September 22, 2023 @01:01PM (#37614529)
Exactly, it's easy to say "Just torrent it," but that requires a lot of people to stick their necks out, including the user who just wants a copy of the data.

We need the ability to circulate HDDs physically in a semi-organized fashion, samizdat-style.

Re:Why Open Source AI Will Win by input_sh on Friday September 22, 2023 @04:01AM (#37609225)
Mirroring libgen is definitely within reach, it's "just" 50 or so terabytes with torrents freely available for bulk downloading.

Realistically only maybe 10% of that is actually useful, but reaching that 10% is gonna be very labour-intensive. You would have to do a lot of cleanup of different formats, duplicate uploads, different editions of the same book, scanned PDFs, and what not, while big players with their own ebook stores (Amazon, Google, Apple, any ebook store) already have all of the proper metadata, a common format to work with, and a lot less duplicates.

Re:Why Open Source AI Will Win by john_minsk on Friday September 22, 2023 @05:43AM (#37609943)
Isn't there some kind of standard for publication metadata? The one which will allow to uniquely identify publication + further track different editions as children of "original" publication? Maybe we should create one and make it freely available?
Re:Why Open Source AI Will Win by thelittleone on Friday September 22, 2023 @04:51AM (#37609607)
How would one anonymously train a LLM of sufficient size to produce the performance needed? Does it not required hundreds/ thousands of expensive Nvidia GPUs?
Re:Why Open Source AI Will Win by bionhoward on Friday September 22, 2023 @08:32AM (#37611147)
Hardware gets better, the masses have amassed quite a lot of it already, and it depends how soon you need your AI.
Re:Why Open Source AI Will Win by BeFlatXIII on Friday September 22, 2023 @10:51AM (#37612817)
Hostile foreign nation trains it and releases it in the persona of an anonymous hackerman.
Re:Why Open Source AI Will Win by yanker2 on Saturday September 23, 2023 @04:18PM (#37627079)
Basically the plot of Ghost in the Shell.
Re:Why Open Source AI Will Win by debaserab2 on Friday September 22, 2023 @12:54AM (#37608023)
Wow. Did you figure out what your next steps are? (understood if you don't want to discuss)
Re:Why Open Source AI Will Win by sillysaurusx on Friday September 22, 2023 @04:13AM (#37609312)
I spoke with a lawyer earlier tonight. Basically, there are no next steps for me. The next steps for them are to send targeted discovery requests for whatever it is they think I might have in relation to the case, and possibly ask me to testify in a deposition.
Re:Why Open Source AI Will Win by mchiang on Friday September 22, 2023 @12:55AM (#37608030)
Take a look at Databricks' getting a hand from internal team to create the dolly 15k dataset. ( https://www.databricks.com/blog/2023/04/12/dolly-first-open-... )

For training AGI (artificial general intelligence) maybe only a select few mega companies with massive datasets will be able to come up with training data.

There are so many other use cases that OSS projects can enable otherwise. Individuals or smaller companies have unique data that can be used to augment existing open source models. Many use cases are area specific, and without the need for general intelligence.

Palantir just did a talk at the AIPCon ( https://youtu.be/o2b0DwNg6Ko ), where they recommended the use of many LLMs, open and closed. ( the example had Llama 2 70B, GPT4, Palm coding, claude, + fine-tuned models) feeding into their synthesizer.

While I want open source to win, especially as an open source maintainer on Ollama (if you haven't seen it yet, it's one of the easiest ways to run LLMs locally - https://github.com/jmorganca/ollama ), I think the work so far in this space has been a positive sum one - open or closed.

Re:Why Open Source AI Will Win by ca_tech on Friday September 22, 2023 @08:40AM (#37611229)
People may hate on Palantir but sounds like they get it. I agree that the next step is going to be the interaction of multiple models. We have popular models that have been generalized across domains. The next step is models for specific domains, specific enterprise data sources, individual data sets. Each model has the opportunity to leverage the more generalized model above it. And if done properly, the models will be able to then build back references showing what data validates its output as a source of truth.
Re:Why Open Source AI Will Win by anon373839 on Friday September 22, 2023 @01:08AM (#37608124)
This is just a standard demand for preservation of evidence. They’re letting you know that although you’re not a party to the lawsuit, you may be called to produce information as a witness. They are informing you that certain classes of information are relevant to the litigation, and that you have a legal duty to preserve that information in case it is later subpoenaed.

Caveat: I am not your lawyer.

Re:Why Open Source AI Will Win by contrarian1234 on Friday September 22, 2023 @01:28AM (#37608239)
> Caveat: I am not your lawyer

???

Why would he suddenly think you are?

Re:Why Open Source AI Will Win by mixedCase on Friday September 22, 2023 @02:01AM (#37608410)
Because they were giving advice about a legal matter, so by stating what seems obvious to you and me, the GP is covering themselves from "implied" lawyer-client relationships which under some jurisdictions could adjudicate them the responsibilities of a lawyer to a client if a person could prove in court that they reasonably believed they were acting as their lawyer.

I don't know if this is actually been a problem ever brought to a judge to be honest, but that's the reason why that disclaimer is made and of course, I am not your lawyer.

Re:Why Open Source AI Will Win by contrarian1234 on Friday September 22, 2023 @04:09AM (#37609293)
I want to find out where lawyers hang out online and if they close ever sentence/post with "I am not your lawyer"
Re:Why Open Source AI Will Win by cyrillite on Friday September 22, 2023 @05:07AM (#37609715)
Check Legal Advice subreddits, it happens. It may be an abundance of caution most of the time, but it doesn’t hurt.
Re:Why Open Source AI Will Win by ghaff on Friday September 22, 2023 @06:36AM (#37610300)
It’s pretty common in situations where you could be seen as giving legal, accounting, financial, etc. advice especially if you have some certification to that effect to disclaim what you’re saying as actually being advice. Lawyers are especially careful about this outside of a specific client relationship.
Re:Why Open Source AI Will Win by K0balt on Friday September 22, 2023 @06:57AM (#37610423)
I also choose to not be this guy’s lawyer.
Re:Why Open Source AI Will Win by quitit on Friday September 22, 2023 @03:59AM (#37609216)
mixedCase outlined the liability point of view for a professional, the other: Each person seeking legal advice should retain a lawyer and not rely solely on advice from faceless internet forums. The same applies to many kinds of professions, such as health. "Hey I've heard x,y and z, but I'm not your doctor."

Everyone is of course free to speak about legal matters and provide their take, but keep in mind that even well studied lawyers, with all of the context and evidence are not always successful in their arguments. Internet forums are many steps removed from these professionals, so you should moderate accordingly.

In forums such as Reddit/Hacker News/etc, there are many discussions that concern legal matters - in my experience the overwhelming majority of highly voted comments and frequently repeated ideas are not ones which are grounded in fact, but rather comments that align with the groups desires. People upvote and repeat ideas that appeal to them, not to ones which they've investigated themselves as factual or accurate.

Another one to look out for is IANAL: "I am not a lawyer". (Yes I'm being serious with this acronym.) This is to avoid a different kind of liability: the unauthorised practice of law.

Re:Why Open Source AI Will Win by contrarian1234 on Friday September 22, 2023 @04:05AM (#37609250)
This line of reasoning hold for pretty much any online advice. You don't close your comments with "I'm not your DBA" or "please consult your own paid certified C++ developer" or whatever

I don't think once you pay a lawyer their IQ jumps 20 points and they're necessarily more correct than crowdsourced information. Doctors and lawyers arent somehow infallible once hired

Re:Why Open Source AI Will Win by rcxdude on Friday September 22, 2023 @04:09AM (#37609297)
Being someone's DBA does not imply certain legal status in the way being someone's lawyer does. It can be a real headache for a lawyer if someone they are not representing claims that they are representing them (which happens, a lot: funnily enough a lot of people seeking legal advice online are really not at all familiar with how this works), so it's standard boilerplate to clarify that if there's any potential cause for confusion.
Re:Why Open Source AI Will Win by TeMPOraL on Friday September 22, 2023 @07:26AM (#37610597)
DBAs and C++ developers aren't licensed professionals. Doctors and lawyers are.
Re:Why Open Source AI Will Win by gorlilla on Friday September 22, 2023 @12:07PM (#37613799)
Re:Why Open Source AI Will Win by TeMPOraL on Friday September 22, 2023 @12:31PM (#37614132)
Yes, some types of engineering are licensed professions too. Software engineering isn't one of them.
Re:Why Open Source AI Will Win by a1369209993 on Friday September 22, 2023 @11:08AM (#37613050)
> You don't close your comments with "I'm not your DBA" or "please consult your own paid certified C++ developer" or whatever

I (and others) actually do do that when it seems relevant, eg [0] (and it's parent which does similar[1]).

0: https://news.ycombinator.com/item?id=27658362

1: https://news.ycombinator.com/item?id=27658258

Re:Why Open Source AI Will Win by caesil on Friday September 22, 2023 @01:10AM (#37608138)
Sarah Silverman is almost certainly going to be crushed in court. The lawsuit is totally without merit.
Re:Why Open Source AI Will Win by pmarreck on Friday September 22, 2023 @02:37AM (#37608643)
> I think we’re witnessing the death of open source AI.

Nah, we aren't. You can't make any money off an open-source project via litigation, and torrents exist. This baseless fear-driven nonsense will eventually blow over.

Re:Why Open Source AI Will Win by 3abiton on Friday September 22, 2023 @03:29AM (#37609002)
Books3 and The Pile are still available on the internet, just not "legally".
Re:Why Open Source AI Will Win by ie9rifikr on Friday September 22, 2023 @04:07AM (#37609270)
Isn't there sort of an implication here that Criminally Open-Source ai will win?
Re:Why Open Source AI Will Win by sillysaurusx on Friday September 22, 2023 @04:09AM (#37609296)
Who will give them the compute? It requires million dollar clusters to make any progress.
Re:Why Open Source AI Will Win by ie9rifikr on Friday September 22, 2023 @04:21AM (#37609380)
Willingly? I wouldn't know. But then it becomespre a problem of obfuscation doesn't it?
Re:Why Open Source AI Will Win by lucubratory on Friday September 22, 2023 @07:15AM (#37610522)
There's a huge amount of money in AI, and there is no global organisation tracking GPUs and making sure that "X startup which purchased a bunch of GPUs then went bankrupt and sold them all to an unknown buyer" doesn't happen. Even stopping China from getting GPUs is proving extremely difficult and that's much, much more powerful actors than even the largest copyright cartel; NVIDIA is chafing even against that. GPU restrictions aren't going to work unless they're being enforced by the US military, and even then China is only ~5-10 years behind the US in fab tech and could easily custom build chips for AI to fill the demand, in the internal market if nothing else.

Basically, there is a lot of money to be made in AI, and if money is available to fund development it will not be that difficult to turn that money into compute, particularly in a context where the current huge "legitimate" buyers like Microsoft, Amazon, Google are banned from using AI chips for AI.

Re:Why Open Source AI Will Win by ghaff on Friday September 22, 2023 @06:29AM (#37610267)
The copyright issue is a big one and certainly unsettled but the (very good) IP lawyers I know are pretty much universally of the opinion that training models with copyrighted material probably passes muster for a number of reasons.

Of course, as someone else noted, this is probably ultimately going to be in the US a question for Congress and the courts.