News for hackers. Stuff that matters.
Re:AI weights are not open “source” by Animats on Wednesday July 05, 2023 @01:11PM (#36603495)
> The complexity described seems to be resting on the unestablished idea that weights are copyrightable in the first place.

Yes. Weights probably aren't copyrightable in the US. See Feist vs. Rural Telephone, in which the Supreme Court ruled that telephone directories are not copyrightable. The copyright clause in the Constitution ("To promote the Progress of Science and useful Arts, by securing for limited Times to Authors and Inventors the exclusive Right to their respective Writings and Discoveries.") is understood to require human authorship. The US does not have database copyright, or "sweat of the brow" copyright. That it was expensive to produce some collection of data does not make it copyrightable.

Outputs from LLMs, machine generated art, and machine generated music probably are not copyrightable either. US Copyright Office: "Based on the Office's understanding of the generative AI technologies currently available, users do not exercise ultimate creative control over how such systems interpret prompts and generate material. Instead, these prompts function more like instructions to a commissioned artist."[1]

[1] https://www.reuters.com/world/us/us-copyright-office-says-so...

Re:AI weights are not open “source” by DannyBee on Wednesday July 05, 2023 @02:44PM (#36605155)
This is mostly right - It depends on what the weights represent and how they were generated so I would not go as far as the initial claim.

A collection of numbers is copyrightable if it's the encoded result of a creative process. Just because it's represented as a bunch of numbers does not make it non copyrightable. That's why it says " original works of authorship fixed in any tangible medium of expression, now known or later developed, from which they can be perceived, reproduced, or otherwise communicated, either directly or with the aid of a machine or device. "

You can't just classify the weights as facts simply because they are numbers. If they are creatively made by a human they would be copyrightable. Mechanically computed from random numbers, no. Somewhere in the middle? Harder

Re:AI weights are not open “source” by kevin42 on Wednesday July 05, 2023 @02:48PM (#36605220)
I'm not a lawyer, but it seems like you stood up a straw man there.

>Just because it's represented as a bunch of numbers does not make it non copyrightable.

Can you give an example of where the bunch of numbers is copyrightable when it's not just a numeric encoding of something that was already copyrightable? Taking music and encoding it as a wav file is not a creative work, but it's a representation of a copyrighted work.

Maybe you could create a long list of numbers and call it an artistic impression, but that's clearly not what AI weights are. I'm interested to hear an example of your copyrightable numbers.

Re:AI weights are not open “source” by mlyle on Wednesday July 05, 2023 @03:33PM (#36605898)
The key factor of Feist v Rural is whether there was any original or creative process in the way the facts were arranged.

Here, there's a whole lot of creative decisions in labelling and guiding of training that produces the weights, so it's reasonable to think it might be copyrightable.

That is, the numbers are a whole lot more original than the issuance of phone numbers or part numbers.

Re:AI weights are not open “source” by mft_ on Wednesday July 05, 2023 @03:57PM (#36606191)
IANAL, but I’d wonder whether ‘creativity’ is really present in labelling - and indeed, mightn’t it be the last thing you want? I’d argue labelling should be strictly factual and reproducible, and ideally following a logical structure… maybe akin to how addresses of buildings might appear in a phone directory…

(Agree that the skill in knowing how to code and guide the training of a model is probably very different though. It’s not just access to compute time that separates me from OpenAI :) )

Re:AI weights are not open “source” by dragonwriter on Wednesday July 05, 2023 @04:05PM (#36606294)
> Here, there's a whole lot of creative decisions in labelling and guiding of training that produces the weights

Often, labelling is part of large public datasets that are chosen for use for that exact reason, and/or is otherwise not the work of the party claiming copyright in the model.

Re:AI weights are not open “source” by Retric on Wednesday July 05, 2023 @04:35PM (#36606746)
The requirement for expertise doesn’t necessarily imply that that setting up perimeters for training AI is necessarily copyrightable. A normal brick wall for example needs skills to create but doesn’t qualify as the goal is not creative. If so the mechanical output of a process that doesn’t qualify for copyright is not going to qualify.

Labeling training data may qualify for copyright, but if the underlying training data doesn’t taint the output as a derivative work then labeling isn’t going to qualify by itself.

Thus without some new and very generous interpretation AI companies are at best not going to benefit from copyright and at worst may be forced to create all training data in house. My suspicion is this generation of AI companies are in a very difficult situation.

Re:AI weights are not open “source” by mlyle on Wednesday July 05, 2023 @04:52PM (#36606937)
> but if the underlying training data doesn’t taint the output as a derivative work then labeling isn’t going to qualify by itself.

It depends. If each individual training item has a small impact on the output coefficients, then perhaps it's not a derivative work of them. But if there's a large creative process in determining model training procedure, deciding labelling strategies, and applying those-- perhaps those numbers are strongly derived from those things.

Re:AI weights are not open “source” by Retric on Wednesday July 05, 2023 @06:20PM (#36607996)
That sounds like wishful thinking, individual training items have significant impact on the result.

Anyway, suppose you’re building an AI to walk, there’s nothing creative about selecting 9.8m/s/s for gravity that’s simply the ideal value to achieve a desired goal. Labeling an elephant as “Elephant” rather than “coat hanger” is similarly a functional choice.

Just because a person is holding a camera and taking a photo doesn’t mean the result is copyrightable.

Re:AI weights are not open “source” by mlyle on Wednesday July 05, 2023 @06:30PM (#36608110)
> Anyway, suppose you’re building an AI to walk, there’s nothing creative about selecting 9.8m/s/s for gravity that’s simply the ideal value to achieve a desired goal.

Suppose you're not building a strawman, but instead building an AI to be an LLM. The exact sequence of what you choose to do for instruction tuning, and the metrics and labels that you choose, the prompt/response pairs you write, and the loss functions you employ are quite creative. They greatly affect the coefficients and are not simple mechanical steps and are the result of a large amount of creative choice.

We are nowhere near a point where they are an uncreative, mechanical recipe to follow.

> Just because a person is holding a camera and taking a photo doesn’t mean the result is copyrightable.

No, but in the overwhelming majority of circumstances it is. What it depends upon is whether the person holding the camera is making a significant, original creative choice.

I am not sure what courts will decide, but I am certain that there is more creativity and originality employed than you are giving OpenAI et al. credit for.

Re:AI weights are not open “source” by Retric on Wednesday July 05, 2023 @09:29PM (#36609748)
> not simple mechanical steps and are the result of creative choice

Creative choices requires intentional control over the output across a meaningfully different range of viable possibilities. A brick layer has a huge range of viable options in the specific brick and its alignment in a wall but none of those choices are artistically meaningful.

The coefficients are not in any meaningful sense chosen based on instruction tuning. It’s no more under direct control than the specific arrangements of atoms in the brick wall and is instead the output of a purely mechanical process.

> We are nowhere near a point where they are an uncreative, mechanical recipe to follow.

Thus: We are nowhere near the point where the output is under creative control rather than being the result of a poorly understood mechanical recipe.

Re:AI weights are not open “source” by mlyle on Wednesday July 05, 2023 @10:48PM (#36610450)
I don't really agree.

Here's what the supremes said in Feist V. Rural:

> Factual compilations, on the other hand, may possess the requisite originality. The compilation author typically chooses which facts to include, in what order to place them, and how to arrange the collected data so that they may be used effectively by readers. These choices as to selection and arrangement, so long as they are made independently by the compiler and entail a minimal degree of creativity, are sufficiently original that Congress may protect such compilations through the copyright laws. Nimmer ss 2.11[D], 3.03; Denicola 523, n. 38. Thus, even a directory that contains absolutely no protectible written expression, only facts, meets the constitutional minimum for copyright protection if it features an original selection or arrangement.

Alphabetical order wasn't quite enough. But people directing the work that produces the coefficients are doing considerably more creative work than that.

> Thus: We are nowhere near the point where the output is under creative control rather than being the result of a poorly understood mechanical recipe.

No one requires complete creative control of the output. I can spatter paint and have relatively poor control of what's happening, but I am certainly generating a copyrightable work when I engage in creative choices as part of this.

Re:AI weights are not open “source” by Retric on Thursday July 06, 2023 @08:51AM (#36614987)
> Alphabetical order wasn’t quite enough, But people directing the work that produces the coefficients are doing considerably more creative work than that.

I agree it’s more effort but the metric isn’t effort so I disagree that qualifies the coefficients as copyrightable. The SHA256 hash of a movie isn’t copyrightable even though the movie itself was.

> No one requires complete creative control

That’s a strawman, there are requirements for creative control. You don’t own copyright to your normal dumps, but you can get copyright from looking down and selecting to take a picture. That’s the low bar for a creativity requirement, but it exists.

Re:AI weights are not open “source” by mlyle on Thursday July 06, 2023 @10:50AM (#36616844)
> I agree it’s more effort but the metric isn’t effort so I disagree that qualifies the coefficients as copyrightable.

I know the metric is no longer effort. But there's a lot of creative choices that I've mentioned that greatly affect the coefficients, even if we don't know what those creative choices are going to do to each film grain in the photograph or coefficient in the matrix.

> You don’t own copyright to your normal dumps

Yes, there's an explicit exemption in LOC's guidelines for things that are the direct output of natural processes.

If you have a lot of choices affecting output, then the output is subject to copyright. Indeed, the Supremes above said that factual contemplations can qualify if they involve a "minimal degree of creativity".

In the end, we'll see.

Re:AI weights are not open “source” by DannyBee on Wednesday July 05, 2023 @04:54PM (#36606962)
"Can you give an example of where the bunch of numbers is copyrightable when it's not just a numeric encoding of something that was already copyrightable?"

Sure, there are "poems" that consist of just a groups of numbers that are copyrighted. They are not encodings, it's just a string of numbers. It's indistinguishable from a bunch of numbers. This is just one example, there are lots.

They are enforceable to the degree it's creative, and to the degree the infringing use is also creative.

So you would not be able to sue me for using those numbers in a math equation. You would be able to sue me for reproducing your poem in a book of poems :)

As feist says, the creativity required for copyright is quite minimal. But it's still only as protectable as it is creative.

Look - AI is not the first thing to have this "issue". The answer remains the same as it always was - it's mostly about the process not the output.

The output mostly matters is if the output is not intended to be creative (or it's de minimis or ...).

Copyright as it currently exists is weird.

Like if you go to the copyright office and try to register your ssh public key and say "this was generated by ssh-keygen i had nothing to do with it" you may get a different result than if you said "this is my new visually stunning masterpiece, my ssh public key, which was generated with computer help but I used 37 precisely timed keyboard smashes to do it. Prints are available from my gallery for $500"

Re:AI weights are not open “source” by mlyle on Wednesday July 05, 2023 @06:37PM (#36608183)
I fully agree with what you say, with one bit of nuance to point out:

> Like if you go to the copyright office and try to register your ssh public key and say "this was generated by ssh-keygen i had nothing to do with it" you may get a different result than if you said "this is my new visually stunning masterpiece, my ssh public key, which was generated with computer help but I used 37 precisely timed keyboard smashes to do it. Prints are available from my gallery for $500"

The important thing, of course, isn't whether the copyright office denies to register your copyright, but instead what courts will ultimately do when you attempt to enforce your copyright.

We know the current administrative algorithms used by the copyright offices. We have less clarity on what courts will ultimately do.

Re:AI weights are not open “source” by gjvnq on Wednesday July 05, 2023 @09:44PM (#36609894)
> Can you give an example of where the bunch of numbers is copyrightable when it's not just a numeric encoding of something that was already copyrightable? Taking music and encoding it as a wav file is not a creative work, but it's a representation of a copyrighted work.

There are random number books and I know one of them has a copyright registration [1].

[1]: https://publicrecords.copyright.gov/detailed-record/7060844

Re:AI weights are not open “source” by saynay on Wednesday July 05, 2023 @03:32PM (#36605889)
I would say that is uncertain. Model weights are always going to effectively be a huge collection of statistics about the training corpus. Unless you are envisioning artisanal, hand-crafted, free-range model weights where a person used a non-mathematical method to purposely and creatively choose each one?
Re:AI weights are not open “source” by dxbydt on Wednesday July 05, 2023 @06:25PM (#36608057)
> Mechanically computed from random numbers, no

Even random numbers are copyrightable.

Below is an implementation of Marsaglia's invention, from p348, courtesy infamous NR[1]. Its a MWC (multiply with carry) random number generator, with two parameters, variable a and base b=2^32. --- For a, "The values below are recommended with no particular ordering." ID a B1 4294957665 B2 4294963023 B3 4162943475 B4 3947008974 B5 3874257210 B6 2936881968 B7 2811536238 B8 2654432763 B9 1640531364 --- as we all now know, the whole thing is copyrighted - you can't redistribute that code and can't use those specific numbers to generate random numbers without purchasing a license, which only allows you to use it once in your personal machine; that's why GSL[2]. The pseudorandom numbers you would get from MWC if you use above numbers are also copyrighted since they are work-product.

[1]http://numerical.recipes/book/book.html [2]https://www.gnu.org/software/gsl/design/gsl-design.html

Re:AI weights are not open “source” by mirekrusin on Wednesday July 05, 2023 @02:57PM (#36605363)
Assuming that weights are not copyrightable, how much restrictions can you put on output through API from those networks/weights?

Ie. if ClosedAI says you can't use output of their API to train competitive models - is that enforceable or not?

Re:AI weights are not open “source” by photonerd on Wednesday July 05, 2023 @02:59PM (#36605398)
That would be down to contract/terms of service. You’d be in breach of that, not copyright
Re:AI weights are not open “source” by mirekrusin on Wednesday July 05, 2023 @04:26PM (#36606622)
But is it enforceable? Companies can put in contracts all kind of nonsense, it doesn't mean all of it is unconditionally enforceable, right?

Ie. if somebody creates company that sells milkshakes and they say you can't use them to feed employees of competing milkshakes companies - it wouldn't fly, would it?

Re:AI weights are not open “source” by photonerd on Wednesday July 05, 2023 @06:49PM (#36608303)
Would strongly depend on the contract. Probably wouldn’t fly in a post sake terms of service agreement, but you’d likely be in breach of a normal contract yeah.
Re:AI weights are not open “source” by hnfong on Thursday July 06, 2023 @11:55AM (#36617955)
Perhaps you're thinking of the EULA kind of situation. EULAs are probably not enforceable because they require the user to agree to additional terms after the main sale of contract is complete. It's considered a one-sided agreement because the user doesn't get anything in return (the contract of sale of the software already grants the right to use the software).

For LLMs it really depends on the situation. If it's presented in a EULA scenario, where you already bought the rights to use the LLM and ClosedAI gave you the EULA with additional terms afterwards, then the logic above applies. But then everyone knows EULAs aren't very enforceable these days, and nobody buys packaged software any more, so this scenario is quite unlikely these days.

So, if the clause is just one of the many conditions in their main contract of service, of which you had ample opportunity to review before purchasing/agreeing to use their service, then as long as the terms are legal (eg. don't contradict some law), parties are generally free to agree to whatever they want in a contract, and courts will generally uphold those terms.

"can't use them to feed employees of competing milkshakes companies" is probably enforceable. Sounds silly, but I can't think of any reason why it wouldn't be upheld. Unless there's antitrust factors involved.

"Can't use output of their API to train competitive models" is most likely enforceable. Unless there's antitrust factors involved. These kinds of terms are pretty common too. Nobody seriously thinks they're unenforceable per se.

Of course there are practical barriers to enforce a contract -- the aggrieved party has to discover the breach, gather sufficient evidence, and file a lawsuit. As an average Joe individual, you're probably not worrying about getting sued by a company for trivial breaches of service agreements. Most likely the service provider will just cut the service instead of spending thousands of dollars tracking you down (and risk taking a PR hit for going after the little guy). But between businesses, the risks of getting sued by a competitor is real, and no sane lawyer would advise the business to ignore such contract terms.

(Btw, I am not a lawyer. I've studied these things a bit though.)

Re:AI weights are not open “source” by dllthomas on Wednesday July 05, 2023 @03:54PM (#36606160)
> Outputs from LLMs, machine generated art, and machine generated music probably are not copyrightable either.

I don't have a strong sense of whether this is reasonable (I see arguments both ways) but I do think it's pretty strongly at odds with how we treat photographs. There are a bunch of photos on my phone where I unquestionably own the copyright, despite putting in much less creativity than I did for some AI images I've generated.

I don't think it's clear how to resolve this, but I do think that if we are going to protect photos and not prompted AI images, the distinction needs to turn on something other than whether "sufficient creativity" was applied to the input of the mechanical system.

Edited to add: It's probably also worth calling out that the question of whether we protect the work produced by a person's use of mechanical system is a separate one from whether we protect the work of others when it is (in various ways, to various degrees, with various likelihoods) reproduced by use of those mechanical systems.

Re:AI weights are not open “source” by makeitdouble on Wednesday July 05, 2023 @05:32PM (#36607456)
On photography, the argument was condensed into "who pushed the button". We saw it with the monkey auto-portrait copyright fight where copyright was not granted to the photographer, and other nature photography using photo traps where the copyright stuck with the human basically because they were the last operator of the camera.

The interesting part is, those controversial case are pretty recent when the art of photography is century(ies?) old now. I wouldn't expect super clear guidelines regarding AI art before a few decades of weird cases fought tooth and nails in court.

Re:AI weights are not open “source” by tokai on Wednesday July 05, 2023 @06:48PM (#36608295)
Eh? The copyright was the photographers and not the monkeys.

https://petapixel.com/2018/04/24/photographer-wins-monkey-se...

Re:AI weights are not open “source” by makeitdouble on Wednesday July 05, 2023 @07:28PM (#36608708)
There was two different arguments:

- whether the monkey has the copyright (PETA's argument): this was smacked down by the court twice, the second court explicitely setting a precedent.

- whether the photograph has coypright: as far as I know he doesn't, as the work was deemed non copyrightable (ruled as not created by a human)

https://en.wikipedia.org/wiki/Monkey_selfie_copyright_disput...

Re:AI weights are not open “source” by shagie on Wednesday July 05, 2023 @07:00PM (#36608398)
You'll still face an uphill battle.

https://www.copyright.gov/comp3/chap300/ch300-copyrightable-...

313.2 Works That Lack Human Authorship

As discussed in Section 306, the Copyright Act protects “original works of authorship.” 17 U.S.C. § 102(a) (emphasis added). To qualify as a work of “authorship” a work must be created by a human being. See Burrow-Giles Lithographic Co., 111 U.S. at 58. Works that do not satisfy this requirement are not copyrightable.

The U.S. Copyright Office will not register works produced by nature, animals, or plants. Likewise, the Office cannot register a work purportedly created by divine or supernatural beings, although the Office may register a work where the application or the deposit copy(ies) state that the work was inspired by a divine spirit.

    Examples:
    • A photograph taken by a monkey.
    • A mural painted by an elephant.
    ...
Similarly, the Office will not register works produced by a machine or mere mechanical process that operates randomly or automatically without any creative input or intervention from a human author. The crucial question is “whether the ‘work’ is basically one of human authorship, with the computer [or other device] merely being an assisting instrument, or whether the traditional elements of authorship in the work (literary, artistic, or musical expression or elements of selection, arrangement, etc.) were actually conceived and executed not by man but by a machine.” U.S. COPYRIGHT OFFICE, REPORT TO THE LIBRARIAN OF CONGRESS BY THE REGISTER OF COPYRIGHTS 5 (1966).
Re:AI weights are not open “source” by kromem on Wednesday July 05, 2023 @07:27PM (#36608698)
Your prompt for the AI image generation is copyrightable.

The output is not.

The photo you take involved choices of composition and timing and equipment choice.

Just because you don't feel you put in a lot of consideration does not mean at a fundamental level that you still put in creative choices that give the resulting product copyright protection.

But if you took that photo and put it into software which made a derivative image without human creativity, then while the original image would be copyrightable the resulting derivative output would not.

The ideal path forward in copyright would be no infringement in use of materials for training and no protection in AI output with infringement possible against output too close/derivative of protected images.

It's not infringement if you learned to draw tracing Mickey Mouse, your Gerry Gerbil cartoons are fine, but if you draw Mickey Mouse and distribute it, you'll hear from Disney's lawyers.

AI should be the same with the exception that the Gerry Gerbil cartoons would not be copyrightable.

Re:AI weights are not open “source” by wizzwizz4 on Wednesday July 05, 2023 @07:47PM (#36608896)
> then while the original image would be copyrightable the resulting derivative output would not.

Excellent! I'll put the Inheritance Cycle through a synonymiser, and have a copyright-free (if somewhat degraded) version. Take that, Christopher Paolini!

… wait.

What you say might well be correct: the law is often foolish. But I'd imagine the creativity-free derivative work still counts as a derivative work of the original, copyright-eligible work.

Re:AI weights are not open “source” by chottocharaii on Wednesday July 05, 2023 @08:40PM (#36609375)
Yes it'd be a derivative work owned by Paolini. Paolini would have copyright to the derivative work, to the extent that he has rights over derivative material. However, the prompter would have nothing
Re:AI weights are not open “source” by wizzwizz4 on Friday July 07, 2023 @07:22AM (#36630072)
If I write a poem and put it into Stable Diffusion, how is what is produced not a derivative work of my poem? We can argue that it's a derivative work of many other things, but that doesn't make it not a derivative work of the poem.

One way it might not be is if Stable Diffusion is seem more like a hash algorithm than a synonymiser. But I don't see why it should, because there's a meaningful correspondence between the input and the output of the system.

Re:AI weights are not open “source” by kmeisthax on Wednesday July 05, 2023 @07:57PM (#36608989)
If the prompt is copyrightable, then why wouldn't that copyright flow through to the output?

I can't legally pirate Windows just because the source code was run through a compiler. Even though the compiler itself adds no additional creativity, the underlying source code is still a creative work[0], so pirating the binaries still infringes a copyright. Just one that's in a slightly different place than what we're normally used to thinking about.

Just to drive the point home, there's a few other situations in which copyright "flows through" to things not subject to copyright. Back in the days of copyright formalities, if you published before properly registering something, your work would be born into the public domain. And this occasionally happened to serial media - e.g. someone might just forget to register the third season of a TV show. In that particular case[1], seasons one and two are still copyrighted, and because season three is a derivative work of the prior season, nobody but the original owner can actually make any use of season three. The only practical difference is that the company that owns that TV show lost one year of copyright ownership over the third season.

[0] By definitions of law. I honestly think most software shouldn't have been made copyrightable, but once Congress said "software is copyrightable" that put that question to bed.

[1] I don't remember the name of the TV show or the court case, but this IS a thing that happened and this theory IS court tested.

Re:AI weights are not open “source” by Retric on Wednesday July 05, 2023 @10:08PM (#36610106)
In general if you pay someone to paint a picture they own the copyright and it needs to be assigned back to you even if you give them quite specific instructions. The instructions lacked sufficient control over the outcome to give some form of dual copyright.

Presumably that general rule would also prevent your instructions to DALLE from giving you copyright ownership of the output either. The AI isn’t getting ownership, so it’s either in the public domain or a derivative work from the artists creating the training data.

Re:AI weights are not open “source” by kmeisthax on Thursday July 06, 2023 @12:01AM (#36611063)
Right. And furthermore, I don't actually think prompts alone are copyrightable in most cases - I just wanted to propose an argumentum ad absurdum. Certainly, you can't argue creativity when you're also keyword-stuffing your prompts to call up various feature sets that the model just so happens to associate with them.
Re:AI weights are not open “source” by justinjlynn on Thursday July 06, 2023 @06:59AM (#36614035)
The output of a compiler (i.e. A translation program) is created via a prompt (the source code). The output object code is very much copyrighted. People keyword stuff their source code all the time (pragmas) in order to influence the generated output. Why does that object code deserve copyright protection except when the compiler is an AI model (i.e. A translation program)? Compilers use genetic algorithms and weights from profiling in order to generate better output. Where does the output stop being capable of copyright protection because it's no longer "creative"?

If a museum can include a small portion of a frame around a public domain painting and claim new copyright as a result - surely any smallest spark or creative influence qualifies, including choosing a single word and choosing the model and time and which output is selected does as well.

The idea of work for hire, and the notion of copyright assignment, applies to people and not machines or processes employed in the creation of a work. Your brush manufacturer would never dare try to claim that their creative selection of fibres and thus their contribution to the unique brush patterns in your painting constitutes a creative contribution to your work. Why is a complex digital model which does the same any different?

Perhaps it is copyright as a whole that is wrong and is nothing to do with AI. This is what we get for creating imaginary property as a means to finance speculative creative endeavours in a capitalist system. So, yeah. Fun times there - once again technology challenges another economic status quo.

Re:AI weights are not open “source” by Retric on Thursday July 06, 2023 @08:31AM (#36614802)
Multiple independently created compilers can directly translate source code to unoptimized machine code that works in a completely straightforward fashion based on the definition of the language. There’s a great deal of complexity involved in creating more optimized output, but the goal is to have functionally equivalent programs.

There’s no way to map DALLE prompts into any kind of obvious picture from the inout. Even DALLE itself can produce a wide range of outputs from an identical inout.

Re:AI weights are not open “source” by justinjlynn on Thursday July 06, 2023 @12:20PM (#36618337)
There is, the input is the description of the image so produced plus the hidden elements and parameters (randomness, etc) that users often don't see - with these there is a deterministic input to output relationship. The fitness of the model is in how closely the output matches what we expect to see from them given the inputs we give. That's the point of them. Models are compilers. The distinction is really only in the complexity and ambiguity of the language specifications they implement - not in any fundamental aspect of their function. There isn't a single person alive who understands how a non-trivial compiler works in its entirety, just as nobody really knows how LLMs work yet. That's not the point.
Re:AI weights are not open “source” by Retric on Friday July 07, 2023 @04:32AM (#36628906)
That’s not “independently created” you’re suggesting reimplementing the output of a process not from first principles but from the output of the process. I can make a compiler in a programming language without it being a derivative work of any other compiler.

Further, people have programmed in languages before any compilers where created which worked after the compilers where created.

Re:AI weights are not open “source” by justinjlynn on Saturday July 08, 2023 @04:26AM (#36642489)
The CPU is a compiler for programs written in the machine instruction set architecture the CPU claims to implement. So, no, you can't.
Re:AI weights are not open “source” by Retric on Saturday July 08, 2023 @08:19AM (#36643671)
No all CPU’s aren’t a compiler. Words have meanings and you used them incorrectly.

Early CPU’s didn’t compile anything they directly executed the instruction pipeline. As engineers had more transistors to play with they implemented ever more complex systems, but you can have a really simple CPU that works just fine.

Re:AI weights are not open “source” by justinjlynn on Sunday July 09, 2023 @01:03AM (#36651688)
Words have meanings, and the instruction pipeline consists of electrical signals - and those early CPUs were almost all microcoded or had multiphase clocks or some other implementation abstraction which they did not expose to their architectural state... so yes, they were in a very real sense compilers.
Re:AI weights are not open “source” by Retric on Sunday July 09, 2023 @11:07PM (#36661589)
Again “Almost” means not every. So no saying all CPU’s are compilers is clearly false from the words you just wrote.

Also, the number of CPU’s manufactured heavily favored very simple designs.

Re:AI weights are not open “source” by justinjlynn on Sunday July 09, 2023 @11:31PM (#36661735)
Simply because I didn't state "for all and every" doesn't invalidate my point, nor does it support yours as true - further, "heavily favored" suffers from the same problem. The point is, there's a system which takes as input formatted in a specification (a program) and some transformed output (a set of actions to be taken or another program input for another compiler). So, there you go. If a hot dog on a bun could be considered a sandwich, then a CPU could be considered to be a compiler. shrug disagree all you like.
Re:AI weights are not open “source” by Retric on Monday July 10, 2023 @02:50PM (#36671183)
If you say X is Y, but it’s not true for all X then the statement is false. Ie: “All integers are even.” is false.

As to your point that’s not what CPU’s do though, they have both a set of instructions and a set of IO with the outside world. A compiler always results in the same output from a given set of instructions, but with CPU’s you can run the same code and get wildly different output due to that IO.

The only way you can call a CPU a compiler is as a subset of its capabilities. If they they have internal microcodes where a given instruction gets translated into a different internal representation, but that’s not the end it also executes those microcodes.

Re:AI weights are not open “source” by dllthomas on Wednesday July 05, 2023 @09:24PM (#36609694)
> The photo you take involved choices of composition and timing and equipment choice.

And the AI image involved choices of prompt and model, and subsequent selection from among several generated images.

I recognize that what you said here:

> Your prompt for the AI image generation is copyrightable.

> The output is not.

... probably represents the state of the law at the moment (with meaningful amounts of uncertainty), but I don't think there's a principled difference based on the amount or nature of creativity involved. IMO the equivalent would be "you own the specification of (position, equipment, relevant world state) but not the photo" which obviously doesn't do anything we want for photography. And I guess that's a part of my point. We should pick the policy we want to make sure we capture the incentives we want. Maybe it is best that AI assisted art (past some point?) not be copyrightable. But I don't think basing the distinction on the amount or nature or... propagation (I guess?) of creativity makes any sense in distinguishing flippant and bullshit photographs (at least a third of my photos, although I would hesitate to apply the labels to any particular photo by someone else) from prompt-driven generative works.

Re:AI weights are not open “source” by radarsat1 on Wednesday July 05, 2023 @04:27PM (#36606630)
> Weights probably aren't copyrightable in the US. ... is understood to require human authorship.

Are you arguing here that because the weights come from an optimization program, they are not "human authored"? If so I find that to be a strange assertion. If I'm working every day on my model and training algorithm to ensure it produces the best weights possible to solve my problem, I would be very surprised for someone to tell me I have no ownership over those weights because they are generated from a program I wrote and data that I own.

Re:AI weights are not open “source” by hnfong on Thursday July 06, 2023 @11:35AM (#36617626)
In addition to what you mentioned, I'd like to add that photos are copyrightable by the photographer, who merely tweaked some "hyper-parameters" (exposure, ISO, aperture, whatever) and decided when and where to press a button. If such "minimal" amounts of authorship is considered sufficient, I won't be as confident as GP to claim that training an LLM, which requires orders of magnitudes more hyperparameters, labor and capital investment, to be uncopyrightable due to lack of human authorship involved.

It might end up uncopyrightable due to other reasons, but probably not this.

Btw, the phone directories are quite different -- they're just compilation of raw factual public domain information. The LLM weights are anything but. In fact one of the leading theories as to why LLMs are not copyrightable is that they infringe upon the copyrights of the source training materials. (I also don't want to guess whether that argument holds)

Re:AI weights are not open “source” by deepsun on Wednesday July 05, 2023 @04:47PM (#36606863)
> Outputs from LLMs, machine generated art, and machine generated music probably are not copyrightable either.

Let me put a straw man, and try to find a middle point, when the copyright argument stops being applicable:

1. A painting was done by an artist.

2. On a computer.

3. With a help from an image processor software.

4. Using some advanced filters, like super-resolution, that utilize computer vision techniques. Like neural networks.

Many smartphones already automatically process your* photos with some advanced CV algorithms. That can be called "machine generated art".

I'd personally prefer to stop saying "neural network did X", same way as we don't say "a bulldozer built a road, a crane built a house".

Re:AI weights are not open “source” by comfypotato on Wednesday July 05, 2023 @06:02PM (#36607801)
The distinction, defining your straw man, is simply that the image itself is generated by the “commissioned artist” that is the AI.

Even non-generative-AI inside Photoshop only mutates images. Generative AI is the source of images.

Re:AI weights are not open “source” by drdeca on Wednesday July 05, 2023 @06:10PM (#36607882)
Is it though? What of the e.g. choice of prompt, guidance scale, maybe a specification of a pose, etc.?

Or, is the distinction you are making based on there being an image before the model is used?

Re:AI weights are not open “source” by deepsun on Wednesday July 05, 2023 @09:36PM (#36609814)
I'm not sure I understand the "source" term here. All the AI images I've seen so far were generated by humans using software tools like neural networks.
Re:AI weights are not open “source” by Veserv on Wednesday July 05, 2023 @08:34PM (#36609315)
IANAL, but weights are probably not copyrightable because they are “useful” i.e. they have intrinsic utilitarian function as they are necessary for a model to function as described. Useful things can not be copyrighted, only patented. This is the key difference between the two. For works that are useful and creative, only the non-functional aspects can be copyrighted.

Maybe a published copy of the weights might be copyrightable, in the exact form of a “creatively” ordered listing, but the weights themselves would almost certainly not be if the US judicial system rules consistently.

This bypasses the entire argument of whether it is human authorship as weights themselves in bulk are just straight up non-copyrightable regardless of origin according to this reading of the law and precedent.