News for hackers. Stuff that matters.
Re:HuggingChat: Chat with Open Source Models by anybodyz on Wednesday February 21, 2024 @10:16AM (#39454814)
Together serves models optimized for inference speed.

They're not Groq but Together (and Perplexity Labs) have the lowest latencies and fastest tokens per second of any commercial services available right now. Also the lowest prices afaik.

There are no comments on this comment yet.