News for hackers. Stuff that matters.
Re:Multi-agent chatbot murder mystery – AI Alibis (free, in-... by dtquad on Wednesday July 10, 2024 @12:38PM (#40928733)
We seriously need a service that is as cheap and fast as the OpenAI/Anthropic APIs but allow us to run the various community-fine-tuned versions of Mixtral and LLaMA 3 that are not/less censored.
Re:Multi-agent chatbot murder mystery – AI Alibis (free, in-... by cmcollier on Wednesday July 10, 2024 @12:42PM (#40928765)
Re:Multi-agent chatbot murder mystery – AI Alibis (free, in-... by rthnbgrredf on Wednesday July 10, 2024 @01:47PM (#40929449)
Such services already exists. I don't want to promote any in particular, but if you do a research on pay-as-you-go inference of e.g. mixtral or llama3 you will find offerings that offer an API and charge just cents for XY amount of tokens, exactly as OpenAI does.
Re:Multi-agent chatbot murder mystery – AI Alibis (free, in-... by Tiberium on Wednesday July 10, 2024 @01:38PM (#40929336)
https://openrouter.ai is exactly that, and they even support payments with crypto.
Re:Multi-agent chatbot murder mystery – AI Alibis (free, in-... by jsemrau on Wednesday July 10, 2024 @01:42PM (#40929383)
>and they even support payments with crypto.

What a value proposition! ;-)

Re:Multi-agent chatbot murder mystery – AI Alibis (free, in-... by immibis on Wednesday July 10, 2024 @02:53PM (#40930140)
The true meaning of BlockchAIn.
Re:Multi-agent chatbot murder mystery – AI Alibis (free, in-... by csomar on Thursday July 11, 2024 @04:09AM (#40934598)
Coinbase commerce? That's hardly crypto and I am not sure if it's better or worse than traditional payments.
Re:Multi-agent chatbot murder mystery – AI Alibis (free, in-... by whoistraitor on Wednesday July 10, 2024 @01:30PM (#40929253)
You can use HuggingFace, PerplexityAI, Anyscale, TogetherAI. There are a bunch of options. Many offer OpenAI compatible APIs too.
Re:Multi-agent chatbot murder mystery – AI Alibis (free, in-... by camel_Snake on Wednesday July 10, 2024 @01:42PM (#40929380)
I addition to those mentioned by others, there is featherless.ai
Re:Multi-agent chatbot murder mystery – AI Alibis (free, in-... by SparkyMcUnicorn on Wednesday July 10, 2024 @12:42PM (#40928766)
I believe openrouter.ai has a few.
Re:Multi-agent chatbot murder mystery – AI Alibis (free, in-... by Grimblewald on Wednesday July 10, 2024 @10:47PM (#40933282)
or crowd run, like through petals or kobald's ai horde.