News for hackers. Stuff that matters.
Re:Stop selling “unlimited”, when you mean “until we change ... by thimabi on Tuesday July 29, 2025 @08:00AM (#44722209)
Things would be much easier if, instead of “unlimited”, companies simply offered great usage limits. Yes, hoarders would still exist, but their impact would be negligible.

Even better: provide a counter displaying both remaining usage available and the quota reset time.

But companies probably earn so much money from the vast majority of users that having good and clear limits would only empower them to actually benefit as much from the product as they can.

Re:Stop selling “unlimited”, when you mean “until we change ... by vertoc on Tuesday July 29, 2025 @08:22AM (#44722429)
I think the hard part with these ai models is it’s kind of hard to figure out how many tokens you’re going to use, especially as a new user. 4,000 tokens sounds like a lot for instance, but is tiny
Re:Stop selling “unlimited”, when you mean “until we change ... by fuzzzerd on Tuesday July 29, 2025 @10:46AM (#44724089)
While I don't disagree that determining usage is incredibly difficult, it doesn't take a genius to see that something sold "by the million" is something you can expect to to use a lot of.
Re:Stop selling “unlimited”, when you mean “until we change ... by thimabi on Tuesday July 29, 2025 @12:55PM (#44725694)
If companies offered any sort of counter, users would quickly understand their usage patterns and adapt accordingly. But users are kept in the dark on purpose, often not knowing how many tokens they use, and sometimes not even knowing what are the token limits.
Re:Stop selling “unlimited”, when you mean “until we change ... by jollyllama on Tuesday July 29, 2025 @08:46AM (#44722673)
It simply shouldn't be called unlimited, then.
Re:Stop selling “unlimited”, when you mean “until we change ... by const_cast on Tuesday July 29, 2025 @02:30PM (#44726789)
This is the crux of the issue.

Every company wants the marketing of unlimited, but none of them want the accountability.

Re:Stop selling “unlimited”, when you mean “until we change ... by ollybee on Tuesday July 29, 2025 @09:27AM (#44723086)
Two problem with offering usage limits is the real limit you could offer if all users hit it, is low. The users with usage far below the limits feel they are getting a bad deal, compared to if they can't see the limits and they don't hit them, they feel they have "unlimited!".
Re:Stop selling “unlimited”, when you mean “until we change ... by Spooky23 on Tuesday July 29, 2025 @10:27AM (#44723826)
I disagree. People will always hoard a constrained resource. Things like phone service and AI tools find their value when people use them freely.

The AI models have a bunch of different consumption models aimed at different types of use. I work at a huge company, and we’re experimenting with different ways of using LLMs for users based on different compliance and business needs. The people using all you can eat products like NotebookLM, Gemini, ChatGPT use them much more on average and do more varied tasks. There is a significant gap between low/normal/high users.

People using an interface to a metered API, which offers a defined LLM experience consume fewer resources and perform more narrowly scoped tasks.

The cost is similar and satisfaction is about the same.

Re:Stop selling “unlimited”, when you mean “until we change ... by OldfieldFund on Tuesday July 29, 2025 @12:00PM (#44724994)
An even more insidious method is selling "lifetime access," offering incredible over-the-top value, then exiting after 2 or 3 years when the momentum starts dropping. These are essentially rug pulls/exit scams.

There is no such thing as "unlimited" or "lifetime" unless it's self-hosted.