News for hackers. Stuff that matters.
Re:Claude 3.7 Sonnet and Claude Code by punkpeye on Monday February 24, 2025 @02:45PM (#43164021)
If you are open to alternatives, try https://glama.ai/gateway

We currently serve ~10bn tokens per day (across all models). OpenAI compatible API. No rate limits. Built in logging and tracing.

I work with LLMs every day, so I am always on top of adding models. 3.7 is also already available.

https://glama.ai/models/claude-3-7-sonnet-20250219

The gateway is integrated directly into our chat (https://glama.ai/chat). So you can use most of the things that you are used to having with Claude. And if anything is missing, just let me know and I will prioritize it. If you check our Discord, I have a decent track record of being receptive to feedback and quickly turning around features.

Long term, Glama's focus is predominantly on MCPs, but chat, gateway and LLM routing is integral to the greater vision.

I would love feedback if you are going to give a try [email protected]

Re:Claude 3.7 Sonnet and Claude Code by airstrike on Monday February 24, 2025 @02:49PM (#43164075)
The issue isn't API limits, but web UI limits. We can always get around the web interface's limits by using the claude API directly but then you need to have some other interface...
Re:Claude 3.7 Sonnet and Claude Code by punkpeye on Monday February 24, 2025 @03:15PM (#43164415)
The API still has limits. Even if you are on the highest tier, you will quickly run into those limits when using coding assistants.

The value proposition of Glama is that it combines UI and API.

While everyone focuses on either one or the other, I've been splitting my time equally working on both.

Glama UI would not win against Anthropic if we were to compare them by the number of features. However, the components that I developed were created with craft and love.

You have access to:

* Switch models between OpenAI/Anthropic, etc.

* Side-by-side conversations

* Full-text search of all your conversations

* Integration of LaTeX, Mermaid, rich-text editing

* Vision (uploading images)

* Response personalizations

* MCP

* Every action has a shortcut via cmd+k (ctrl+k)

Re:Claude 3.7 Sonnet and Claude Code by airstrike on Monday February 24, 2025 @04:10PM (#43164969)
Ok, but that's not the issue the parent was mentioning. I've never hit API limits but, like the original comment mentioned, I too constantly hit the web interface limits particularly when discussing relatively large modules.
Re:Claude 3.7 Sonnet and Claude Code by glenstein on Monday February 24, 2025 @04:42PM (#43165299)
Right, that's how I read it also. It's not that there's no limits with the API, but that they're appreciably different.
Re:Claude 3.7 Sonnet and Claude Code by Aeolun on Monday February 24, 2025 @05:56PM (#43165930)
> Even if you are on the highest tier, you will quickly run into those limits when using coding assistants.

Even heavy coding sessions never run into Claude limits, and I’m nowhere near the highest tier.

Re:Claude 3.7 Sonnet and Claude Code by smokeydoe on Monday February 24, 2025 @09:44PM (#43167484)
I think it’s based on the tools you’re using. If I’m using Cline I don't have to try very hard to hit limits. I’m on the second tier.
Re:Claude 3.7 Sonnet and Claude Code by m_kos on Monday February 24, 2025 @06:41PM (#43166283)
Your chat idea is a little similar to Abacus AI. I wish you had a similarly affordable monthly plan for chat only, but your UI seems much better. I may give it a try!
Re:Claude 3.7 Sonnet and Claude Code by cmdtab on Monday February 24, 2025 @03:47PM (#43164764)
Do you have deepseek r1 support? I need it for a current product I’m working on.
Re:Claude 3.7 Sonnet and Claude Code by pclmulqdq on Monday February 24, 2025 @04:16PM (#43165021)
They are just selling a frontend wrapper on other people's services, so if someone else offers deepseek, I'm sure they will integrate it.
Re:Claude 3.7 Sonnet and Claude Code by punkpeye on Monday February 24, 2025 @04:35PM (#43165209)
Indeed we do https://glama.ai/models/deepseek-r1

It is provided by DeepSeek and Avian.

I am also midway of enabling a third-provider (Nebius).

You can see all models/providers over at https://glama.ai/models

As another commenter in this tread said, we are just a 'frontend wrapper' around other people services. Therefore, it is not particularly difficult to add models that are already supported by other providers.

The benefit of using our wrapper is that you can use a single API key and you get one bill for all your AI bills, you don't need to hack together your own logic for routing requests between different providers, failovers, keeping track of their costs, worry what happens if a provider goes down, etc.

The market at the moment is hugely fragmented, with many providers unstable, constantly shifting prices, etc. The benefit of a router is that you don't need to worry about those things.

Re:Claude 3.7 Sonnet and Claude Code by cmdtab on Monday February 24, 2025 @05:05PM (#43165480)
Yeah I am aware. I use open router at the moment but I find it lacks a good UX.
Re:Claude 3.7 Sonnet and Claude Code by punkpeye on Monday February 24, 2025 @05:25PM (#43165659)
Open router is great.

They have a very solid infrastructure.

Scaling infrastructure to handle billions of tokens is no joke.

I believe they are approaching 1 trillion tokens per week.

Glama is way smaller. We only recently crossed 10bn tokens per day.

However, I have invested a lot more into UX/UI of that chat itself, i.e. while OpenRouter is entirely focused on API gateway (which is working for them), I am going for a hybrid approach.

The market is big enough for both projects to co-exist.

Re:Claude 3.7 Sonnet and Claude Code by thrdbndndn on Monday February 24, 2025 @08:37PM (#43167057)
Just tried it, is there a reason why the webUI is so slow?

Try to delete (close) the panel on the right on a side-by-side view. It took a good second to actually close. Creating one isn't much faster.

This is unbearably slow, to be blurt.

Re:Claude 3.7 Sonnet and Claude Code by tesch1 on Tuesday February 25, 2025 @11:01AM (#43173593)
Who is glama.ai though? Could not find company info on the site, the Frank name writing the blog posts seems to be an alias for Popeye the sailor. Am I missing something there? How can a user vet the company?
Re:Claude 3.7 Sonnet and Claude Code by Daniel_Van_Zant on Tuesday February 25, 2025 @11:40AM (#43174149)
I see Cohere, is there any support for in-line citations like you can get with their first party API?