News for hackers. Stuff that matters.
Re:My AI costs went from $100 to less than $1/day: Fine-tuni... by mpalmer on Friday January 19, 2024 @12:22AM (#39051848)
It took me 30 seconds to read their TOS and confirm you're just making most of that up.

> As between you and OpenAI, and to the extent permitted by applicable law, you (a) retain your ownership rights in Input and (b) own the Output. We hereby assign to you all our right, title, and interest, if any, in and to Output.

It follows that your claim about caching violating OAI's terms is nonsense.

Re:My AI costs went from $100 to less than $1/day: Fine-tuni... by windexh8er on Friday January 19, 2024 @08:34AM (#39055188)
I think you missed my point. "Caching" output by training a more efficient / cheaper model with that output is in fact against their ToS. In my simple brain that is a form of caching, and I stand by my original post.

I've not made anything up. Your claim that I have is nonsense.

OpenAI changing their ToS for the military on a whim: https://archive.is/GILKl - for your enjoyment.

OpenAI ToS: "What You Cannot Do. You may not use our Services for any illegal, harmful, or abusive activity. For example, you may not:

* Use Output to develop models that compete with OpenAI."

Re:My AI costs went from $100 to less than $1/day: Fine-tuni... by mpalmer on Friday January 19, 2024 @09:35AM (#39055920)
> I think you missed my point. "Caching" output by training a more efficient / cheaper model with that output is in fact against their ToS. In my simple brain that is a form of caching.

If that was your point, I'm pretty sure everyone missed it. No one is training models as a form of caching their previous responses. They want to improve the quality of responses they haven't generated yet. That's not caching.

> I've not made anything up.

You said customers don't own the output; they do. I said you made most of it up, and you did. Including your apparent retconning of your original point.

Re:My AI costs went from $100 to less than $1/day: Fine-tuni... by windexh8er on Friday January 19, 2024 @10:09AM (#39056428)
> If that was your point, I'm pretty sure everyone missed it. No one is training models as a form of caching their previous responses. They want to improve the quality of responses they haven't generated yet. That's not caching.

So... You didn't read the article of which you're commenting in?

> You said customers don't own the output; they do. I said you made most of it up, and you did.

You don't own it. If I own something, I can do whatever I want with it. This is just like your iPhone. You don't actually own it, because you can only do with it what Apple allows you to do.

> Including your apparent retconning of your original point.

Wow, enjoy your day. Your misunderstanding is, apparently, my "retconning". Maybe read the original piece you're responding to within the thread.

Re:My AI costs went from $100 to less than $1/day: Fine-tuni... by mpalmer on Friday January 19, 2024 @01:34PM (#39059228)
Did I read the article? You mean the tweet? If you're saying it supports your claim that fine-tuning a model is equivalent to caching, you are mistaken.

> If I own something, I can do whatever I want with it

BRB digitizing my entire media collection and uploading it to the public internet.