Re:Multi-agent chatbot murder mystery – AI Alibis (free, in-...
by dtquad on Wednesday July 10, 2024 @12:38PM
(#40928733)
We seriously need a service that is as cheap and fast as the OpenAI/Anthropic APIs but allow us to run the various community-fine-tuned versions of Mixtral and LLaMA 3 that are not/less censored.
[ Parent
| on HN ]
Re:Multi-agent chatbot murder mystery – AI Alibis (free, in-...
by cmcollier on Wednesday July 10, 2024 @12:42PM
(#40928765)
Here's one I've used:
Here are all the models:
Re:Multi-agent chatbot murder mystery – AI Alibis (free, in-...
by rthnbgrredf on Wednesday July 10, 2024 @01:47PM
(#40929449)
Such services already exists. I don't want to promote any in particular, but if you do a research on pay-as-you-go inference of e.g. mixtral or llama3 you will find offerings that offer an API and charge just cents for XY amount of tokens, exactly as OpenAI does.
Re:Multi-agent chatbot murder mystery – AI Alibis (free, in-...
by Tiberium on Wednesday July 10, 2024 @01:38PM
(#40929336)
https://openrouter.ai is exactly that, and they even support payments with crypto.
Re:Multi-agent chatbot murder mystery – AI Alibis (free, in-...
by jsemrau on Wednesday July 10, 2024 @01:42PM
(#40929383)
>and they even support payments with crypto.
What a value proposition! ;-)
Re:Multi-agent chatbot murder mystery – AI Alibis (free, in-...
by immibis on Wednesday July 10, 2024 @02:53PM
(#40930140)
The true meaning of BlockchAIn.
Re:Multi-agent chatbot murder mystery – AI Alibis (free, in-...
by csomar on Thursday July 11, 2024 @04:09AM
(#40934598)
Coinbase commerce? That's hardly crypto and I am not sure if it's better or worse than traditional payments.
Re:Multi-agent chatbot murder mystery – AI Alibis (free, in-...
by whoistraitor on Wednesday July 10, 2024 @01:30PM
(#40929253)
You can use HuggingFace, PerplexityAI, Anyscale, TogetherAI. There are a bunch of options. Many offer OpenAI compatible APIs too.
Re:Multi-agent chatbot murder mystery – AI Alibis (free, in-...
by camel_Snake on Wednesday July 10, 2024 @01:42PM
(#40929380)
I addition to those mentioned by others, there is featherless.ai
Re:Multi-agent chatbot murder mystery – AI Alibis (free, in-...
by SparkyMcUnicorn on Wednesday July 10, 2024 @12:42PM
(#40928766)
I believe openrouter.ai has a few.
Re:Multi-agent chatbot murder mystery – AI Alibis (free, in-...
by Grimblewald on Wednesday July 10, 2024 @10:47PM
(#40933282)
or crowd run, like through petals or kobald's ai horde.