News for hackers. Stuff that matters.
Re:Show HN: AnythingLLM – Open-Source, All-in-One Desktop AI... by monkmartinez on Thursday September 05, 2024 @05:52PM (#41460690)
Openrouter... you get all the models and its not as expensive as you would think. I spent $3 with aider the other day in like the blink of an eye with Anthropic. I am working on a FASTHTML thingy and loaded all the docs, plus a few huge replicate api files into the vector database. Most of my back and forth usage averaged about $0.02 for each turn with Claude 3.5 Sonnet. To give you an idea: My context + prompt were around 18000 tokens with completions around 1500 tokens.

There are no comments on this comment yet.