News for hackers. Stuff that matters.
Re:Computer use, a new Claude 3.5 Sonnet, and Claude 3.5 Haiku by pradn on Tuesday October 22, 2024 @11:34AM (#41915327)
Great progress from Anthropic! They really shouldn't change models from under the hood, however. A name should refer to a specific set of model weights, more or less.

On the other hand, as long as its actually advancing the Pareto frontier of capability, re-using the same name means everyone gets an upgrade with no switching costs.

Though, all said, Claude still seems to be somewhat of an insider secret. "ChatGPT" has something like 20x the Google traffic of "Claude" or "Anthropic".

https://trends.google.com/trends/explore?date=now%201-d&geo=...

Re:Computer use, a new Claude 3.5 Sonnet, and Claude 3.5 Haiku by cube2222 on Tuesday October 22, 2024 @11:43AM (#41915443)
There was a recent article[0] trending on HN a about their revenue numbers, split by B2C vs B2B.

Based on it, it seems like Anthropic is 60% of OpenAI API-revenue wise, but just 4% B2C-revenue wise. Though I expect this is partly because the Claude web UI makes 3.5 available for free, and there's not that much reason to upgrade if you're not using it frequently.

[0]: https://www.tanayj.com/p/openai-and-anthropic-revenue-breakd...

Re:Computer use, a new Claude 3.5 Sonnet, and Claude 3.5 Haiku by og_kalu on Tuesday October 22, 2024 @12:06PM (#41915722)
3.5 is rate limited free, same as 4o (4o's limits are actually more generous). I think the real reason is much simpler - Claude/Anthropic has basically no awareness in the general public compared to Open AI.

The chatGPT site had over 3B visits last month (#11 in Worldwide Traffic). Gemini and Character AI get a few hundred million but Claude doesn't even register in comparison. [0]

Last they reported, OpenAI said they had 200M weekly active users.[1] Anthropic doesn't have anything approaching that.

[0] https://www.similarweb.com/blog/insights/ai-news/chatgpt-top...

[1] https://www.reuters.com/technology/artificial-intelligence/o...

Re:Computer use, a new Claude 3.5 Sonnet, and Claude 3.5 Haiku by Eisenstein on Tuesday October 22, 2024 @12:28PM (#41915962)
They also had a very limited roll-out at first. Until somewhat recently Canada and Europe were excluded from the list of places they allowed sign-ups from.
Re:Computer use, a new Claude 3.5 Sonnet, and Claude 3.5 Haiku by rafaelmn on Tuesday October 22, 2024 @04:16PM (#41918218)
I basically have to tell most of my coworkers to stop using GPT and switch to Claude for coding - Sonnet 3.5 is the first model that I feel isn't wasting my time.
Re:Computer use, a new Claude 3.5 Sonnet, and Claude 3.5 Haiku by pradn on Tuesday October 22, 2024 @01:40PM (#41916691)
I suppose business customers are savvy and will do enough research to find the best cost-performance LLM. Whereas consumers are more brand and habit oriented.

I do find myself running into Claude limits with moderate use. It's been so helpful, saving me hours of debugging some errors w/ OSS products. Totally worth $20/mo.

Re:Computer use, a new Claude 3.5 Sonnet, and Claude 3.5 Haiku by diggan on Tuesday October 22, 2024 @11:47AM (#41915496)
> Great progress from Anthropic! They really shouldn't change models from under the hood, however. A name should refer to a specific set of model weights, more or less.

In the API (https://docs.anthropic.com/en/docs/about-claude/models) they have proper naming you can rely on. I think the shorthand of "Sonnet 3.5" is just the "consumer friendly" name user-facing things will use. The new model in API parlance would be "claude-3-5-sonnet-20241022" whereas the previous one's full name is "claude-3-5-sonnet-20240620"

Re:Computer use, a new Claude 3.5 Sonnet, and Claude 3.5 Haiku by pradn on Tuesday October 22, 2024 @01:40PM (#41916697)
That's great to know - business customers require a lot more stability, I suppose!
Re:Computer use, a new Claude 3.5 Sonnet, and Claude 3.5 Haiku by quirino on Tuesday October 22, 2024 @11:44AM (#41915455)
Traveling to the US recently, I was surprised to see Claude ads around the city/in the airport. It seems like they're investing on marketing there.

In my country I've never seen anyone mention them at all.

Re:Computer use, a new Claude 3.5 Sonnet, and Claude 3.5 Haiku by gregbarbosa on Tuesday October 22, 2024 @11:54AM (#41915566)
Been traveling more recently, and I've seen those ads in major cities like NYC or San Francisco, but not Miami.