Re:HuggingChat: Chat with Open Source Models
by anybodyz on Wednesday February 21, 2024 @10:16AM
(#39454814)
Together serves models optimized for inference speed.
They're not Groq but Together (and Perplexity Labs) have the lowest latencies and fastest tokens per second of any commercial services available right now. Also the lowest prices afaik.
They're not Groq but Together (and Perplexity Labs) have the lowest latencies and fastest tokens per second of any commercial services available right now. Also the lowest prices afaik.