News for hackers. Stuff that matters.
Re:AI weights are not open “source” by visarga on Wednesday July 05, 2023 @12:07PM (#36602420)
> is a result of unencumbered, massive, law-breaking, right-violating copyright infringement

Why? Copyright covers expression not information, AIs can learn information from any source regardless of copyright. They should just not regurgitate copyrighted content, that's all. And much of what organic content is online is common knowledge, thus can't be copyright-controlled.

Re:AI weights are not open “source” by version_five on Wednesday July 05, 2023 @12:12PM (#36602501)
A lot of people are just upset because their local equilibrium has been disrupted and they think that means they lost a natural right.

"You wouldn't look at a car and then remember what that looked like when someone asks you to draw another"

Re:AI weights are not open “source” by jrm4 on Wednesday July 05, 2023 @12:18PM (#36602613)
These are not bad arguments, but I don't think they're conclusive. I am a lawyer, and I could absolutely see this going the other way. "You can't make these machine things without literally feeding this copyrighted information into them, therefore they do contain a copy. You can see this by when they reproduce, e.g. the "getty images" deal."

*this is not legal advice, dangit commenter person below

Re:AI weights are not open “source” by staunton on Wednesday July 05, 2023 @12:29PM (#36602781)
This is the first time I ever saw a comment including the text "I am a lawyer". Does that mean the comment technically contains "legal advice"?
Re:AI weights are not open “source” by lcnPylGDnU4H9OF on Wednesday July 05, 2023 @12:55PM (#36603215)
As always, a lawyer is not necessarily your lawyer.
Re:AI weights are not open “source” by mike_d on Wednesday July 05, 2023 @02:40PM (#36605098)
If you choose to pay him, sure.
Re:AI weights are not open “source” by londons_explore on Wednesday July 05, 2023 @12:28PM (#36602770)
It's just a race for which test case gets to the supreme court first really...
Re:AI weights are not open “source” by pmoriarty on Wednesday July 05, 2023 @12:42PM (#36602979)
...and the Supreme Court could rule however it likes. It doesn't matter what anyone else says, or what any law says, what any lawyer or other judge says.

They could be completely biased, could completely ignore everyone and everything else and rule however they want.

I'm almost surprised they still bother to write any kind of "legal reasoning" in their ruling and don't simply focus on what the ruling is rather than why they ruled that way. But I guess such "reasoning" still serves a propaganda purpose and still provides a fig leaf for those who still believe in the quaint absurdity that "we are a nation of laws, not men."

Re:AI weights are not open “source” by londons_explore on Wednesday July 05, 2023 @05:03PM (#36607085)
Supreme court precedent seems to impact a lot of decisions...

Plenty of companies who have legal teams will keep an eye on the legal landscape of court decisions, and use them to decide if our T&C's or contracts need rewriting, or if any precedent puts us at legal risk.

Sure - the supreme court could overthrow its precedent anytime, but until it does, a lot of people will act as if what they say is the law.

Re:AI weights are not open “source” by dragonwriter on Wednesday July 05, 2023 @04:13PM (#36606411)
> It's just a race for which test case gets to the supreme court first really...

Not really for practical purposes. In the long term, the Supreme Court can and does overrule its own precedent, so the first case on the specific issue to get to the Supreme Court doesn’t end the discussion.

In the short-term, cases get resolved by lower courts and parties either lack funds to do the maximum level of appeals, or the Supreme Court chooses not to hear appeals (they tend to prefer an issue to be well-developed with circuit case law, often waiting till there is a conflict between the Circuit Courts of Appeal, before taking it up), so the state of the law prior to any specific ruling on the narrow topic by the Supreme Court matters quite a bit.

Re:AI weights are not open “source” by m4nu3l on Wednesday July 05, 2023 @01:41PM (#36603997)
> you can't make these machine things without literally feeding this copyrighted information into them, therefore they do contain a copy.

They don't necessarily do. Think about that. You can take some copyrighted material and transform the information contained in it (for instance a fictional book). You can then write a summary. The summary contains information that was present in the original but it has been transformed and hence it's not a copy. The ML model contains information that has been generalized by some degree. So it's just a grey area IMO.

Re:AI weights are not open “source” by visarga on Wednesday July 05, 2023 @02:04PM (#36604460)
This is a great example. Summarizing or paraphrasing copyrighted content, or simply using it as a seed to generate input-output pairs - this kind of data transformation prior to training could solve the issues with copyright. It cleanly separates form from content.
Re:AI weights are not open “source” by mike_d on Wednesday July 05, 2023 @02:39PM (#36605066)
> The summary contains information that was present in the original but it has been transformed and hence it's not a copy.

The summary also contains original thought, something is added to it by a human to make it unique. AI models are primarily deriviative.

A better example would be: if I take 1,000 different copyrighted works and put them into a ZIP file, does that resulting file violate copyright?

Re:AI weights are not open “source” by version_five on Wednesday July 05, 2023 @02:51PM (#36605267)
That example is awful, whatever side of the debate one is on
Re:AI weights are not open “source” by kevin42 on Wednesday July 05, 2023 @02:52PM (#36605299)
Let's say you take the harry potter books and create a spreadsheet with each word in it as a column, and the number of times that word appears. Would that violate the copyright? I'd be interested in the rationale if someone thinks it would.
Re:AI weights are not open “source” by mike_d on Wednesday July 05, 2023 @03:26PM (#36605795)
If your table was the number of times a word was followed by a chain of other words, that would be a closer comparison to AI weights. In that case it would be possible with reasonable accuracy to reconstruct passages from the harry potter books (see GitHub Copilot).

The copyright aspect makes more sense when you start thinking of AI training models as lossy compression for the original works. Is a downsampled copy of the new Star Wars movie still protected under copyright?

Just tabulating the word counts would not violate copyright as it is considered facts and figures.

Re:AI weights are not open “source” by drdeca on Wednesday July 05, 2023 @06:38PM (#36608188)
It resembles lossy compression in some ways, but in other important ways I think it doesn’t?

Like, if one has access to such a model, and doesn’t count it towards the size cost of a compression/decompression program nor as part of the compressed size of the compressed images, then that should allow for compressing images to have substantially fewer bits than one would otherwise be able to achieve (at least, assuming that one doesn’t care about the amount of time used to compress/decompress. Idk if this is actually practical.)

But unlike say, a zip file, the model doesn’t give you a representation of like, a list of what images (or image/caption pairs) it was trained on.

Or like, in your analogy with the lower resolution of the movie, the lower resolution of it still tells you how long the movie is (though maybe not as precisely due to lower framerate, but that’s just going to be off by less than a second, unless you have an exceedingly low framerate, but that’s hardly a video at that point.)

There is a sense in which any model of some data yields a way to compress data-points from it, where better models generally give a smaller size. But, like, any (precisely stated) description counts as a model?

So, whether it is “like lossy compression” in a way that matters to copyright, I would think depends a lot on things like,

Well, for one thing, isn’t there some kind of “might someone consume the allegedly infringing work as a substitute for the original work, e.g. if cheaper?” test?

For a lower resolution version of Star Wars movie, people clearly would.

But if one wanted to view some particular artwork that is in the training set, I would think that one couldn’t really obtain such a direct substitute? (Well, without using the work as an input to the trained model, asking it to make a variation, but in that case one already has the work separate from the model, so that’s not really relevant.)

If I wanted to know what happened in minute 33 of the Star Wars movie, I could look at minute 33 of the compressed version.

Re:AI weights are not open “source” by pxoe on Wednesday July 05, 2023 @02:54PM (#36605318)
what is a 'copy'? byte accurate, or 'something with general resemblance'? would a badly compressed "copy" image of a copyrighted material still be 'a copy' or would it be some other thing? would low quality image compression be enough to skirt around copyright claims? image formats and viewers just 'reproduce' an impression of original data from derive compressed data. it is also just 'information that's been generalized by some degree' - for space saving purposes and so on. so, what if image generators could be thought of as a 'very good multi-image compression algorithm' that can output multiple images as well, to a 'somewhat recognizable degree'.
Re:AI weights are not open “source” by hex4def6 on Wednesday July 05, 2023 @03:50PM (#36606110)
Badly compressed still counts. I think if the data allows you to reconstruct a recognizable recreation of the original work, you have a good chance of it being considered a derivative copy.

A mono audio version of Star Wars, compressed down to 320x240, filmed from the back of a theater on a VHS camera, converted to Video CD, would under any reasonable interpretation be just a copy of the original.

I assume it starts getting murky when there's some sort of transformation done it it. What if I run motion capture on it, and use that motion capture data to create a cartoon version of Star Paws (my puppies in space epic)? What if I do a scene for scene recreation as the animated cartoon (removing any mentions to copyrighted names -- Luke Skywalker is now Duke Dogwalker, for example)? In this case, there's been no actual data transfer -- all the sprites are hand drawn, backgrounds etc.

What would be an interesting exercise would be to try and create a series of artifacts that each on their own are considered non-derivatives, but can be used together to reconstitute the original. For example, create a compression method that relies heavily on transforms / macroblocks, but strip out any of the actual pixel data from the film. That info might be supplied as palette files which are themselves not really copyrighted data, but together with the compressed transform stream can be used to recreate the original video.

Re:AI weights are not open “source” by saynay on Wednesday July 05, 2023 @03:39PM (#36605982)
More over, you are clearly not in violation of copyright if you are talking about statistics about the material. In your example, printing out a "there were 7000 instances of the word 'the'" is certainly not a violation. A ML model is just a huge pile of these statistics.

However, saying "the first word of the book is 'The'" would not be a violation, while repeating that for every word in the book, as a whole, would be one.

Re:AI weights are not open “source” by version_five on Wednesday July 05, 2023 @06:04PM (#36607826)
I agree with you but I think it's important to have some nuance. Imagine I build a statistical model for 10-word sequences (10-grams) and then I trained it on a single book. I probably could pick some starting words and get most of the book back from the "statistics" I compiled. If I trained the same model on a giant dataset, the one book would just contribute to the stats.

All that to say, the models have potential to memorize, but they don't, and if they do it's an undesirable failure mode, not some deliberate copying.

Re:AI weights are not open “source” by jrm4 on Wednesday July 05, 2023 @03:40PM (#36605992)
I like this argument a lot; but again -- how does this play out in the real world? It's pretty easy to refute what will happen in real life. Think, e.g Batman. I could write a very new and original "Batman" comic that doesn't strongly resemble anything -- movie, toy, comic, whatever -- that exists, but would be recognizable to fans.

Once it starts doing well, will DC come after me? You bet.

Re:AI weights are not open “source” by ke88y on Wednesday July 05, 2023 @04:25PM (#36606605)
These models can definitely be used to intentionally store and recall content that is copyrighted in a way that's not subject to fair use. (eg: trivially, I can very easily train a large model that has a small subnetwork which encodes a compressed or even lossless copy of a picture, and if I were to intentionally train a model is that way then this would be no less a copyright violation than distributing a JPEG of the same image embedded in some large binary).

But also, an unintentional copy of a copyrighted image is not a violation of copyright. (eg: an executable binary which happens to contain the bits corresponding to a picture of Batman -- but which are actually instruction sequences and were provably not intended to encode the picture -- clearly doesn't infringe.)

LLMs are somewhere in-between #1 and #2, and the intent can happen both in the training and also the prompting.

Stack on top of this the fact that the models can also definitely generate content that counts as fair use, or which isn't copyrighted.

It's the multitude of possible outputs, across the copyright spectrum, combined with the function of intent in training and/or prompting, which make this such a thorny legal issue for which existing copyright statute and jurisprudence is ill-suited.

Taking your Batman example: DC would come after you for trademark as well as copyright, and the copyright claims would be very carefully evaluated with respect to your very specific work. But here we are talking about a large model that can generate tons of different work which isn't subject to copyright or which is possibly fair use.

I don't think that existing jurisprudence (or even statute?!) can handle this situation very well, at all, without tons of arbitrary interpretative work on the parts of juries/judges, because of the multitude and vague intent issues described above.

(...Also presumably the merits of the DC case wouldn't matter because your victory would be pyhrric unless you are a mega-corp. Which from a legal theory perspective is neither here nor there but from a legal practicality perspective may inform how companies go about enforcing copyright claims on model weights/outputs.)

Anyways. I think we have a right mess on our hands and the legislature needs to do their damn jobs. Welcome to America, I guess :)

Curious to hear your thoughts on these issues.

Re:AI weights are not open “source” by jrm4 on Wednesday July 05, 2023 @10:20PM (#36610207)
Honestly, your second to last sentence is literally the kind of thing I hate hearing most from non-lawyers; the whole "if the legislature were just smarter" thing is just a weird pie-in-the-sky concept that is more-or-less like saying "the world would be better if CEOs were less greedy."

Like, yes, but it's not very likely to happen and it's not a particularly horrible thing if it doesn't; the law is slow and little-c conservative and you're just expecting it to be something it MOST often just ain't.

Re:AI weights are not open “source” by jrm4 on Wednesday July 05, 2023 @10:16PM (#36610174)
I'm not saying that "they do or don't objectively" because that doesn't matter as much as people think it does. I'm thinking of what a "jury" COULD decide. I think average joe on a jury is very likely to see that process as "feeding them in."
Re:AI weights are not open “source” by wahnfrieden on Wednesday July 05, 2023 @12:18PM (#36602614)
IP itself violates a natural right

(Yes the idea of rights is also unnatural and absent from visions such as anarchy)

Re:AI weights are not open “source” by version_five on Wednesday July 05, 2023 @12:37PM (#36602902)
Yeah I didn't even think that was controversial. I'd always been taught that copyright and patents exist to explicitly restrict what people can do by granting a monopoly to the owners in order to encourage invention and creative work.
Re:AI weights are not open “source” by wahnfrieden on Wednesday July 05, 2023 @12:39PM (#36602933)
That’s a propaganda narrative. It’s simple enclosure, backed by state monopoly on caging people. I’m describing material conditions, you’re intellectualizing.
Re:AI weights are not open “source” by dragonwriter on Wednesday July 05, 2023 @12:22PM (#36602658)
Natural rights are a fiction to pretend that someone’s moral code is a privileged aspect of physical reality in a way every competing moral code is not.
Re:AI weights are not open “source” by ndriscoll on Wednesday July 05, 2023 @12:40PM (#36602960)
Even so, you can ask whether a given moral code is more principled than another (e.g. in the sense of having some algebraic structure), and use that to investigate what might be considered "more natural". For example, one might argue that if a "natural" right exists, then it ought to be symmetric under exchange of humans (or sentient beings or whatever). It's then "more natural" to conclude that you have a right to perform actions that have no interaction or consequences for other humans (e.g. to sing a copyrighted song to yourself in an empty room or downloading a song that you already have on CD but don't feel like ripping yourself) than those that do (e.g. taking food from someone because you'd otherwise starve).
Re:AI weights are not open “source” by dragonwriter on Wednesday July 05, 2023 @12:59PM (#36603285)
> Even so, you can ask whether a given moral code is more principled than another

What does “more principled” mean of a moral code? How does one quantify “degree of principledness”?

> and use that to investigate what might be considered "more natural".

What does the preceding (being “more principled”) have to do with being “more natural”? And what significance does being “more natural” have?

And none of that has any relevance to what is usually described as “natural rights”; its like taking existing words and coming upnwith entirely novel meanings and then a whole architecture around them, which is pretty advanced equivocation.

Re:AI weights are not open “source” by __MatrixMan__ on Wednesday July 05, 2023 @12:31PM (#36602801)
That's going a bit far. They're just fictions that are privileged over certain other fictions--it's like how you can often cast magic missile in D&D but you can't usually cast expelliarmus, it comes down to which fiction we agree to inhabit.
Re:AI weights are not open “source” by slaymaker1907 on Wednesday July 05, 2023 @12:39PM (#36602928)
My issue with this take is that machines are not people. We only have lax rules for humans precisely because they are humans, not on the basis that they can learn. Copyrighted works are produced for people and given how human learning works, applying the derivative works rule to humans would be completely impractical and destroy the point of works with copyright. The same cannot be said for AI companies treating everything on the internet as fair use for training AI.
Re:AI weights are not open “source” by wheelie_boy on Wednesday July 05, 2023 @12:22PM (#36602660)
It seems very difficult to ensure that a model will never output any of the copyrighted content that it was trained on. I can only think of three ways, but perhaps there are others

1. Evaluate every output from the model to ensure that none of the outputs are copyrighted

2. Evaluate every input to a model to ensure that the inputs are either not copyrighted or properly licensed

3. Change the definition of copyright so that ML models can do whatever they want

Nobody is doing #1, because that makes the business models not work. Established brands (like Adobe) are doing #2. I get the feeling that there are a lot of ML startups that are hoping that #3 will happen, but it seems unlikely

Re:AI weights are not open “source” by og_kalu on Wednesday July 05, 2023 @12:55PM (#36603220)
Ensuring a model never outputs copyrighted content is unimportant and tangential. It's irrelevant. You don't look for a way to make humans output no copyrighted content, you address each time they do case by case.

A model training being rendered fair use doesn't mean any of its output can be used for whatever regardless.

Re:AI weights are not open “source” by wheelie_boy on Wednesday July 05, 2023 @04:39PM (#36606774)
> you address each time they do case by case.

That's what I listed as #1 - evaluate each individual output of the model to see if it violates copyright.

Having a model like that makes it unusable for a lot of use cases

Re:AI weights are not open “source” by hnfong on Thursday July 06, 2023 @12:14PM (#36618266)
I think when GP says "address each time case by case", they mean "you sue them when they infringe", instead of "this human has an illegal brain because it remembers Taylor Swift's songs".

PS: your "#1" is really hard to do and I'd guess it is infeasible. Even Google (esp. Youtube) with their vast data capabilities, often gets it wrong.

Re:AI weights are not open “source” by wilde on Wednesday July 05, 2023 @12:22PM (#36602668)
Tell that to some illegal numbers: https://en.wikipedia.org/wiki/Illegal_number
Re:AI weights are not open “source” by svachalek on Wednesday July 05, 2023 @12:44PM (#36603016)
When the web was young, there was a lot of information considered "public" like criminal record, marriage records, birth certificates, property records, etc. But those were still fairly veiled because of the amount of effort required to see them. Suddenly these were getting blasted all over the internet because now that was an easy thing to do, and everyone had to rethink what "public" meant.

I suspect we're going to see the same kind of rethink about intellectual property in the age of AI.

Re:AI weights are not open “source” by pulvinar on Wednesday July 05, 2023 @01:28PM (#36603746)
Not sure about criminal records, but the other records are generally still public. Not blasted all over, but there if you know where to look.

Not that we really had all that much privacy in the past, as anyone who's browsed old newspapers knows.

Re:AI weights are not open “source” by pfdietz on Wednesday July 05, 2023 @12:51PM (#36603142)
Copyright is for things that are the result of human creativity. If the weights come from running an algorithm on a training set (that one does not have a copyright to) then how can the weights then be copyrightable? They might be a derivative work, but that just means they infringe copyright, not that they are copyrightable themselves.
Re:AI weights are not open “source” by stale2002 on Wednesday July 05, 2023 @01:42PM (#36604021)
The answer would be if the weights are transformative enough, and the copyright would come from the person who decided what images to include in the training set.

The act of choosing to place images in a certain arrangement, such as a collage, can be copyrightable. The same could be said for the "act" of choosing what images to include in a training set and which parameters to use to train the model.

Re:AI weights are not open “source” by kevin42 on Wednesday July 05, 2023 @02:58PM (#36605386)
Does that mean if someone copies a phone book but leaves out some numbers and adds some other numbers then it's a creative work?
Re:AI weights are not open “source” by stale2002 on Wednesday July 05, 2023 @03:21PM (#36605696)
It would depend on how transformative the work is.

There is in fact a whole art form where people cut out words from different newspapers and books, for example, and re-arrange those words to form new and interesting art.

So there are ways in which such a work would be a creative work, and ways it which it would not, and it would depend on the particular instance and example.

Re:AI weights are not open “source” by saynay on Wednesday July 05, 2023 @03:45PM (#36606061)
The legal system is not like a computer program. The line between what is "creative" and what is not concrete, but is instead up to the interpretation of the judge who rules on it.

So your phonebook modifications may or may not be considered "creative" depending on the judge and your ability to convince them. The more your modify it, the more likely you are to convince a judge it is a creative work, though.

Re:AI weights are not open “source” by shagie on Wednesday July 05, 2023 @01:50PM (#36604193)
Note that the requirements for copyright are not consistent between nations.

The US has the "threshold of originality" as its principle. Under that doctrine, it requires some human (and this has been emphasized many times over the years) originality in order for something to be copyrighted. It's a low bar for how original it needs to be, but it must be human (monkeys taking selfies are not human).

https://en.wikipedia.org/wiki/Threshold_of_originality

In England, the doctrine is "sweat of the brow" instead.

https://en.wikipedia.org/wiki/Sweat_of_the_brow

> Under a "sweat of the brow" doctrine, the creator of a work, even if it is completely unoriginal, is entitled to have that effort and expense protected; no one else may use such a work without permission, but must instead recreate the work by independent research or effort.

The definitive case for this in the US that set the two apart is Feist Publications, Inc., v. Rural Telephone Service Co. ( https://en.wikipedia.org/wiki/Feist_Publications,_Inc.,_v._R.... ) where it was deemed that a telephone directory is not copyrightable in the US as there is no originality in it... but under the sweat of the brow doctrine it would have been.

So the "[c]opyright is for things that are the result of human creativity" gets an "it depends" and it would be curious to see if companies that are firmly in the "models are valuable" camp go to the UK for what I believe would be a more favorable copyright protection.

... However there are other IP laws around trade secrets that may be better for it in the US (I'm not as familiar in that domain - I would be curious to find out).

Re:AI weights are not open “source” by hnfong on Thursday July 06, 2023 @12:11PM (#36618203)
Think about copyrights of photos.

A photo is presumed to be copyrightable. Even horrible photos taken by somebody without any aesthetic sense are presumed to be copyrightable. The argument (AFAIK) is that the photographer chooses the time, location, object, and tweaks various settings of the camera (exposure, aperture, etc.), and these choices are considered sufficient for a photo to be copyrightable.

How about LLMs?

The hyperparameters of LLMs are hugely important in training LLMs, as is the choice of source training data. To me the "degrees of freedom" (and hence room for "creativity") in training LLMs are larger than that of a photographer taking a photo. And as of today, training a good LLM is probably objectively harder than taking a good photo, even if we forget about hardware costs for a moment.

It's easy to convince judges and juries that copying phone numbers into a phone book doesn't require human creativity. But we're talking about the most bleeding edge tech companies producing a bleeding edge new product here. I think it's going to be really hard to convince judges and juries that making this new shiny thing doesn't require human creativity. Maybe in say 20 years when even a 10 year old can train a LLM the situation might change, but as of today, quite unlikely IMHO.